Incidents involved as both Developer and Deployer
Incident 7226 Report
Facebook translates 'good morning' into 'attack them', leading to arrest
2017-10-17
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them," leading to the arrest of a Palestinian man in Beitar Illit, Israel.
MoreIncident 4718 Report
Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia
2019-06-22
Facebook allegedly did not adequately remove hate speech, some of which was extremely violent and dehumanizing, on its platform including through automated means, contributing to the violence faced by ethnic communities in Ethiopia.
MoreIncident 2846 Report
Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship
2018-05-01
Facebook’s removal of posts featuring renowned artworks by many historical artists and their promotional content due to nudity via both automated and human-moderated means were condemned by critics, such as museums and tourism boards, as cultural censorship and prevention of artwork promotion.
MoreIncident 1695 Report
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar
2018-08-15
Facebook allegedly did not adequately remove anti-Rohingya hate speech, some of which was extremely violent and dehumanizing, on its platform, contributing to the violence faced by Rohingya communities in Myanmar.
MoreIncidents Harmed By
Incident 3993 Report
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
2022-11-15
Meta AI trained and hosted a scientific paper generator that sometimes produced bad science and prohibited queries on topics and groups that are likely to produce offensive or harmful content.
MoreIncidents involved as Developer
Incident 8461 Report
Social Media Algorithms Amplified Disinformation Campaign in Honduras Election
2021-10-06
In October 2021, a coordinated network of over 317 fake Twitter accounts leveraged AI-driven algorithms to amplify disinformation about the Honduran presidential election, targeting opposition candidate Xiomara Castro. The campaign spread false narratives to suppress voter turnout and undermine the election's integrity. Social media platforms, including Twitter and Facebook, removed the accounts only after being alerted, which also raised concerns about inadequate moderation.
MoreIncidents involved as Deployer
Incident 4693 Report
Automated Adult Content Detection Tools Showed Bias against Women Bodies
2006-02-25
Automated content moderation tools to detect sexual explicitness or "raciness" reportedly exhibited bias against women bodies, resulting in suppression of reach despite not breaking platform policies.
MoreIncident 7581 Report
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs
2023-09-11
Meta's AI moderation systems reportedly failed to block ads for illegal drugs on Facebook and Instagram, allowing users to access dangerous substances. The system's failure is linked to the overdose death of Elijah Ott, a 15-year-old boy who sought drugs through Instagram.
MoreIncidents implicated systems
Incident 92916 Report
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
2024-12-06
Leading up to Germany’s February 23, 2025, federal election, the alleged Russian Doppelgänger, Storm-1516, and Matryoshka (Operation Overload) disinformation campaigns have reportedly been deploying AI-generated deepfake videos and fake news sites to spread false claims about German politicians and public figures. AI-powered bots have allegedly been amplifying the content across social media. Researchers suggest the campaign sought to erode trust in Germany’s democratic process. Germany's domestic intelligence agency (BfV) described the scale as unprecedented.
MoreIncident 8855 Report
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust
2025-01-03
Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.
MoreIncident 9374 Report
Bolivian Criminal Network Allegedly Used Deepfake of Education Minister to Defraud at Least 19 Victims in Employment Scam
2025-02-10
A Bolivian criminal network allegedly used AI-generated deepfake audio of Education Minister Omar Véliz Ramos to impersonate him in phone calls, defrauding at least 19 victims in a fake job scheme. Scammers reportedly lured applicants via social media, used cloned voices for credibility, and demanded payment via QR codes. Authorities uncovered the scheme, seizing devices and arresting multiple suspects, including one orchestrating the fraud from prison. Losses reportedly exceed $720,000 USD.
MoreIncident 9144 Report
Alleged Deepfake of Luis Suárez Used to Scam Uruguayans in Fake Investment Scheme
2024-12-26
On December 26, 2024, UTE, Uruguay's public utility company, warned of an alleged deepfake video circulating on Instagram, Facebook, and Threads. The video reportedly features manipulated images and voice of footballer Luis Suárez, falsely promoting an investment scheme claiming a 10,400 peso investment could yield 175,000 pesos monthly. It also reportedly uses AI-altered Telemundo footage. UTE urged the public not to share personal data, as the scam links to phishing sites posing as official sources.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
YouTube
Incidents involved as both Developer and Deployer
- Incident 2684 Reports
Permanent Removal of Social Media Content via Automated Tools Allegedly Prevented Investigative Efforts
- Incident 1682 Reports
Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs
Incidents implicated systems
Meta
Incidents involved as both Developer and Deployer
- Incident 4718 Reports
Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia
- Incident 1695 Reports
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar
Incidents Harmed By
- Incident 3993 Reports
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
- Incident 3993 Reports
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
Incidents involved as Developer
Incidents involved as Deployer
Incidents involved as both Developer and Deployer
- Incident 3432 Reports
Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems
- Incident 1421 Report
Facebook’s Advertisement Moderation System Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers
Incidents involved as Deployer
- Incident 4693 Reports
Automated Adult Content Detection Tools Showed Bias against Women Bodies
- Incident 7581 Report
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs
Incidents implicated systems
Unknown deepfake technology developer
Incidents involved as Developer
- Incident 92916 Reports
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
- Incident 9374 Reports
Bolivian Criminal Network Allegedly Used Deepfake of Education Minister to Defraud at Least 19 Victims in Employment Scam
Unknown voice cloning technology
Incidents implicated systems
- Incident 92916 Reports
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
- Incident 9374 Reports
Bolivian Criminal Network Allegedly Used Deepfake of Education Minister to Defraud at Least 19 Victims in Employment Scam