Incidents impliqués en tant que développeur et déployeur
Incident 7226 Rapports
Facebook translates 'good morning' into 'attack them', leading to arrest
2017-10-17
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them," leading to the arrest of a Palestinian man in Beitar Illit, Israel.
PlusIncident 4718 Rapports
Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia
2019-06-22
Facebook allegedly did not adequately remove hate speech, some of which was extremely violent and dehumanizing, on its platform including through automated means, contributing to the violence faced by ethnic communities in Ethiopia.
PlusIncident 2846 Rapports
Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship
2018-05-01
Facebook’s removal of posts featuring renowned artworks by many historical artists and their promotional content due to nudity via both automated and human-moderated means were condemned by critics, such as museums and tourism boards, as cultural censorship and prevention of artwork promotion.
PlusIncident 1695 Rapports
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar
2018-08-15
Facebook allegedly did not adequately remove anti-Rohingya hate speech, some of which was extremely violent and dehumanizing, on its platform, contributing to the violence faced by Rohingya communities in Myanmar.
PlusAffecté par des incidents
Incident 3993 Rapports
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
2022-11-15
Meta AI trained and hosted a scientific paper generator that sometimes produced bad science and prohibited queries on topics and groups that are likely to produce offensive or harmful content.
PlusIncidents involved as Developer
Incident 8461 Rapport
Social Media Algorithms Amplified Disinformation Campaign in Honduras Election
2021-10-06
In October 2021, a coordinated network of over 317 fake Twitter accounts leveraged AI-driven algorithms to amplify disinformation about the Honduran presidential election, targeting opposition candidate Xiomara Castro. The campaign spread false narratives to suppress voter turnout and undermine the election's integrity. Social media platforms, including Twitter and Facebook, removed the accounts only after being alerted, which also raised concerns about inadequate moderation.
PlusIncidents involved as Deployer
Incident 4693 Rapports
Automated Adult Content Detection Tools Showed Bias against Women Bodies
2006-02-25
Automated content moderation tools to detect sexual explicitness or "raciness" reportedly exhibited bias against women bodies, resulting in suppression of reach despite not breaking platform policies.
PlusIncident 7581 Rapport
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs
2023-09-11
Meta's AI moderation systems reportedly failed to block ads for illegal drugs on Facebook and Instagram, allowing users to access dangerous substances. The system's failure is linked to the overdose death of Elijah Ott, a 15-year-old boy who sought drugs through Instagram.
PlusIncidents implicated systems
Incident 92916 Rapports
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
2024-12-06
Leading up to Germany’s February 23, 2025, federal election, the alleged Russian Doppelgänger, Storm-1516, and Matryoshka (Operation Overload) disinformation campaigns have reportedly been deploying AI-generated deepfake videos and fake news sites to spread false claims about German politicians and public figures. AI-powered bots have allegedly been amplifying the content across social media. Researchers suggest the campaign sought to erode trust in Germany’s democratic process. Germany's domestic intelligence agency (BfV) described the scale as unprecedented.
PlusIncident 8855 Rapports
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust
2025-01-03
Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.
PlusIncident 9374 Rapports
Bolivian Criminal Network Allegedly Used Deepfake of Education Minister to Defraud at Least 19 Victims in Employment Scam
2025-02-10
A Bolivian criminal network allegedly used AI-generated deepfake audio of Education Minister Omar Véliz Ramos to impersonate him in phone calls, defrauding at least 19 victims in a fake job scheme. Scammers reportedly lured applicants via social media, used cloned voices for credibility, and demanded payment via QR codes. Authorities uncovered the scheme, seizing devices and arresting multiple suspects, including one orchestrating the fraud from prison. Losses reportedly exceed $720,000 USD.
PlusIncident 9144 Rapports
Alleged Deepfake of Luis Suárez Used to Scam Uruguayans in Fake Investment Scheme
2024-12-26
On December 26, 2024, UTE, Uruguay's public utility company, warned of an alleged deepfake video circulating on Instagram, Facebook, and Threads. The video reportedly features manipulated images and voice of footballer Luis Suárez, falsely promoting an investment scheme claiming a 10,400 peso investment could yield 175,000 pesos monthly. It also reportedly uses AI-altered Telemundo footage. UTE urged the public not to share personal data, as the scam links to phishing sites posing as official sources.
PlusEntités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
Entités liées
Incidents impliqués en tant que développeur et déployeur
Incidents involved as Deployer
YouTube
Incidents impliqués en tant que développeur et déployeur
- Incident 2684 Report
Permanent Removal of Social Media Content via Automated Tools Allegedly Prevented Investigative Efforts
- Incident 1682 Report
Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs
Incidents implicated systems
Meta
Incidents impliqués en tant que développeur et déployeur
- Incident 4718 Report
Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia
- Incident 1695 Report
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar
Affecté par des incidents
- Incident 3993 Report
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
- Incident 3993 Report
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
Incidents involved as Developer
Incidents involved as Deployer
Incidents impliqués en tant que développeur et déployeur
- Incident 3432 Report
Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems
- Incident 1421 Report
Facebook’s Advertisement Moderation System Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers
Incidents involved as Deployer
- Incident 4693 Report
Automated Adult Content Detection Tools Showed Bias against Women Bodies
- Incident 7581 Report
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs
Incidents implicated systems
Unknown deepfake technology developer
Incidents involved as Developer
- Incident 92916 Report
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
- Incident 9374 Report
Bolivian Criminal Network Allegedly Used Deepfake of Education Minister to Defraud at Least 19 Victims in Employment Scam
Unknown voice cloning technology
Incidents implicated systems
- Incident 92916 Report
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
- Incident 9374 Report
Bolivian Criminal Network Allegedly Used Deepfake of Education Minister to Defraud at Least 19 Victims in Employment Scam