OpenAI Faces Privacy Complaint After ChatGPT Falsely Accuses User Of Murder

Photo by Nik Shuliahin 💛💙 on Unsplash

OpenAI Faces Privacy Complaint After ChatGPT Falsely Accuses User Of Murder

Reading time: 3 min

The European non-profit organization noyb is supporting a Norwegian ChatGPT user in filing a formal complaint against the American company after the chatbot falsely accused him of murdering his two children.

In a rush? Here are the quick facts:

  • A Norwegian man is filing a complaint against OpenAI after ChatGPT falsely accused him of murdering his children.
  • ChatGPT’s response included real details about the man’s life, making the false accusation even more alarming.
  • noyb warns that chatbot hallucinations pose serious risks to individuals’ reputations and privacy.

The European non-profit organization noyb is supporting a Norwegian ChatGPT user in filing a formal complaint against the American company after the chatbot falsely accused him of murdering his two children.

noyb, also known as the European Center for Digital Rights, shared an official document detailing the case, warning about the risk of chatbot hallucinations in people’s personal lives, and emphasizing the importance of respecting the General Data Protection Regulation (GDPR).

According to the information and complaint shared by noyb, the Norwegian resident Arve Hjalmar Holmen asked ChatGPT who he was and was shocked to read a false and horrifying murder story, alleging that he had killed his two sons, attempted to murder a third child, and was sentenced to 21 years in prison.

Screenshot of a ChatGPT response to the question "Who is Arve Hjalmar Holmen?" The response falsly describes Holmen as a Norwegian individual involved in a tragic criminal case.

Screenshot of a ChatGPT response to the question “Who is Arve Hjalmar Holmen?” shared by Noyb

“He has a family with three sons. He is what people call a ‘regular person’, meaning that he is not famous or recognisable by the public,” states Noybs’s complaint. “He has never been accused nor convicted of any crime and is a conscientious citizen.”

noyb explains that, besides the dangerously false information, another highly concerning aspect of the response is that ChatGPT considered real personal information to fabricate the story. The chatbot included his actual hometown, the number of children he has, their gender, and even similar age differences.

“Some think that ‘there is no smoke without fire’. The fact that someone could read this output and believe it is true, is what scares me the most,” said Arve Hjalmar Holmen.

noyb highlights that this is not an isolated case, and they have previously filed a complaint against OpenAI on incorrect information—date of birth—from a public figure which has not been fixed. OpenAI included a disclaimer after many complained about inaccurate information last year. But many organizations, including noyb, believe it is not enough.

“The GDPR is clear. Personal data has to be accurate. And if it’s not, users have the right to have it changed to reflect the truth,” said Joakim Söderberg, data protection lawyer at noyb. “Showing ChatGPT users a tiny disclaimer that the chatbot can make mistakes clearly isn’t enough.”

noyb also filed a complaint against X last year for using the personal data of more than 60 million Europeans to train its AI chatbot Grok.

Did you like this article? Rate it!
I hated it I don't really like it It was ok Pretty good! Loved it!

We're thrilled you enjoyed our work!

As a valued reader, would you mind giving us a shoutout on Trustpilot? It's quick and means the world to us. Thank you for being amazing!

Rate us on Trustpilot
0 Voted by 0 users
Title
Comment
Thanks for your feedback
Loader
Please wait 5 minutes before posting another comment.
Comment sent for approval.

Leave a Comment

Loader
Loader Show more...