OpenAI
Incidents involved as both Developer and Deployer
Incident 44325 Report
ChatGPT Abused to Develop Malicious Softwares
2022-12-21
OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.
MoreIncident 68814 Report
Scarlett Johansson Alleges OpenAI's Sky Imitates Her Voice Without Licensing
2024-05-20
OpenAI unveiled a voice assistant with a voice resembling Scarlett Johansson's, despite her refusal to license her voice. Johansson claimed the assistant, "Sky," sounded "eerily similar" to her voice, leading her to seek legal action. OpenAI suspended Sky, asserting the voice was from a different actress.
MoreIncident 42011 Report
Users Bypassed ChatGPT's Content Filters with Ease
2022-11-30
Users reported bypassing ChatGPT's content and keyword filters with relative ease using various methods such as prompt injection or creating personas to produce biased associations or generate harmful content.
MoreIncident 4508 Report
Kenyan Data Annotators Allegedly Exposed to Graphic Content for OpenAI's AI
2021-11-01
Sama AI's Kenyan contractors were reportedly asked with excessively low pay to annotate a large volume of disturbing content to improve OpenAI's generative AI systems such as ChatGPT, and whose contract was terminated prior to completion by Sama AI.
MoreIncidents Harmed By
Incident 42011 Report
Users Bypassed ChatGPT's Content Filters with Ease
2022-11-30
Users reported bypassing ChatGPT's content and keyword filters with relative ease using various methods such as prompt injection or creating personas to produce biased associations or generate harmful content.
MoreIncident 5037 Report
Bing AI Search Tool Reportedly Declared Threats against Users
2023-02-14
Users such as the person who revealed its built-in initial prompts reported Bing AI-powered search tool for making death threats or declaring them as threats, sometimes as an unintended persona.
MoreIncident 9555 Report
Global Cybercrime Network Storm-2139 Allegedly Exploits AI to Generate Deepfake Content
2024-12-19
A global cybercrime network, Storm-2139, allegedly exploited stolen credentials and developed custom tools to bypass AI safety guardrails. They reportedly generated harmful deepfake content, including nonconsensual intimate images of celebrities, and their software is reported to have disabled content moderation, hijacked AI access, and resold illicit services. Microsoft disrupted the operation and filed a lawsuit in December 2024, later identifying key members of the network in February 2025.
MoreIncident 3573 Report
GPT-2 Able to Recite PII in Training Data
2019-02-14
OpenAI's GPT-2 reportedly memorized and could regurgitate verbatim instances of training data, including personally identifiable information such as names, emails, twitter handles, and phone numbers.
MoreIncidents involved as Developer
Incident 54158 Report
ChatGPT Reportedly Produced False Court Case Law Presented by Legal Counsel in Court
2023-05-04
A lawyer in Mata v. Avianca, Inc. used ChatGPT for research. ChatGPT hallucinated court cases, which the lawyer then presented in court. The court determined the cases did not exist.
MoreIncident 70136 Report
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
2024-05-29
John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.
MoreIncident 96825 Report
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation
2022-02-24
A Moscow-based disinformation network, Pravda, allegedly infiltrated AI models by flooding the internet with pro-Kremlin falsehoods. A NewsGuard audit found that 10 major AI chatbots repeated these narratives 33% of the time, citing Pravda sources as legitimate. The tactic, called "LLM grooming," manipulates AI training data to embed Russian propaganda. Pravda is part of Portal Kombat, a larger Russian disinformation network identified by VIGINUM in February 2024, but in operation since February 2022.
MoreIncident 48220 Report
ChatGPT-Assisted University Email Addressing Mass Shooting Denounced by Students
2023-02-16
Vanderbilt University's Office of Equity, Diversity and Inclusion used ChatGPT to write an email addressing student body about the 2023 Michigan State University shooting, which was condemned as "impersonal" and "lacking empathy".
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Murat Ayfer
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Microsoft
Incidents involved as both Developer and Deployer
- Incident 5037 Reports
Bing AI Search Tool Reportedly Declared Threats against Users
- Incident 4776 Reports
Bing Chat Tentatively Hallucinated in Extended Conversations with Users
Incidents Harmed By
- Incident 5037 Reports
Bing AI Search Tool Reportedly Declared Threats against Users
- Incident 5037 Reports
Bing AI Search Tool Reportedly Declared Threats against Users
Incidents involved as Developer
students
Incidents Harmed By
- Incident 4667 Reports
AI-Generated-Text-Detection Tools Reported for High Error Rates
- Incident 7052 Reports
Turkish Student in Isparta Allegedly Uses AI to Cheat on Exam, Leading to Arrest
Incidents involved as Deployer
ChatGPT users
Incidents Harmed By
- Incident 42011 Reports
Users Bypassed ChatGPT's Content Filters with Ease
- Incident 42011 Reports
Users Bypassed ChatGPT's Content Filters with Ease
Incidents involved as Deployer
Incidents involved as both Developer and Deployer
- Incident 7344 Reports
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites
- Incident 3671 Report
iGPT, SimCLR Learned Biased Associations from Internet Training Data
Incidents Harmed By
Incidents involved as Developer
ChatGPT
Incidents involved as Developer
- Incident 6255 Reports
Proliferation of Products on Amazon Titled with ChatGPT Error Messages
- Incident 6154 Reports
Colorado Lawyer Filed a Motion Citing Hallucinated ChatGPT Cases
Incidents involved as Deployer
- Incident 6226 Reports
Chevrolet Dealer Chatbot Agrees to Sell Tahoe for $1
- Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
Incidents implicated systems
GPT-4
Incidents involved as Deployer
- Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
- Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
Incidents implicated systems
Perplexity AI
Incidents Harmed By
- Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
- Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
Incidents involved as Deployer
Meta
Incidents involved as both Developer and Deployer
- Incident 7344 Reports
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites
- Incident 9974 Reports
Meta and OpenAI Accused of Using LibGen’s Pirated Books to Train AI Models
Incidents involved as Developer
Organizations integrating Whisper into customer service systems
Incidents involved as Deployer
FraudGPT
Incidents involved as Developer
Incidents involved as Deployer
Incidents implicated systems
Perplexity
Incidents involved as both Developer and Deployer
- Incident 7344 Reports
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites
- Incident 7501 Report
AI Chatbots Reportedly Inaccurately Conveyed Real-Time Political News
Incidents involved as Developer
Mistral
Incidents involved as both Developer and Deployer
- Incident 7344 Reports
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites
- Incident 8591 Report
AI Models Reportedly Found to Provide Misinformation on Election Processes in Spanish
Incidents involved as Developer
Inflection
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Anthropic
Incidents involved as both Developer and Deployer
- Incident 7344 Reports
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites
- Incident 8591 Report
AI Models Reportedly Found to Provide Misinformation on Election Processes in Spanish
Incidents involved as Developer
Jeff Hancock
Incidents Harmed By
- Incident 8521 Report
Alleged Fake Citations Undermine Expert Testimony in Minnesota Deepfake Law Case