Incidents involved as both Developer and Deployer
Incident 7226 Reports
Facebook translates 'good morning' into 'attack them', leading to arrest
2017-10-17
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them," leading to the arrest of a Palestinian man in Beitar Illit, Israel.
MoreIncident 4718 Reports
Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia
2019-06-22
Facebook allegedly did not adequately remove hate speech, some of which was extremely violent and dehumanizing, on its platform including through automated means, contributing to the violence faced by ethnic communities in Ethiopia.
MoreIncident 2846 Reports
Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship
2018-05-01
Facebook’s removal of posts featuring renowned artworks by many historical artists and their promotional content due to nudity via both automated and human-moderated means were condemned by critics, such as museums and tourism boards, as cultural censorship and prevention of artwork promotion.
MoreIncident 1695 Reports
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar
2018-08-15
Facebook allegedly did not adequately remove anti-Rohingya hate speech, some of which was extremely violent and dehumanizing, on its platform, contributing to the violence faced by Rohingya communities in Myanmar.
MoreIncidents Harmed By
Incident 3993 Reports
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
2022-11-15
Meta AI trained and hosted a scientific paper generator that sometimes produced bad science and prohibited queries on topics and groups that are likely to produce offensive or harmful content.
MoreIncidents involved as Developer
Incident 8461 Report
Social Media Algorithms Amplified Disinformation Campaign in Honduras Election
2021-10-06
In October 2021, a coordinated network of over 317 fake Twitter accounts leveraged AI-driven algorithms to amplify disinformation about the Honduran presidential election, targeting opposition candidate Xiomara Castro. The campaign spread false narratives to suppress voter turnout and undermine the election's integrity. Social media platforms, including Twitter and Facebook, removed the accounts only after being alerted, which also raised concerns about inadequate moderation.
MoreIncidents involved as Deployer
Incident 4693 Reports
Automated Adult Content Detection Tools Showed Bias against Women Bodies
2006-02-25
Automated content moderation tools to detect sexual explicitness or "raciness" reportedly exhibited bias against women bodies, resulting in suppression of reach despite not breaking platform policies.
MoreIncident 7581 Report
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs
2023-09-11
Meta's AI moderation systems reportedly failed to block ads for illegal drugs on Facebook and Instagram, allowing users to access dangerous substances. The system's failure is linked to the overdose death of Elijah Ott, a 15-year-old boy who sought drugs through Instagram.
MoreIncidents implicated systems
Incident 8855 Reports
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust
2025-01-03
Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.
MoreIncident 9144 Reports
Alleged Deepfake of Luis Suárez Used to Scam Uruguayans in Fake Investment Scheme
2024-12-26
On December 26, 2024, UTE, Uruguay's public utility company, warned of an alleged deepfake video circulating on Instagram, Facebook, and Threads. The video reportedly features manipulated images and voice of footballer Luis Suárez, falsely promoting an investment scheme claiming a 10,400 peso investment could yield 175,000 pesos monthly. It also reportedly uses AI-altered Telemundo footage. UTE urged the public not to share personal data, as the scam links to phishing sites posing as official sources.
MoreIncident 9073 Reports
Taranaki, New Zealand Resident Allegedly Defrauded of $224K in Bitcoin Scam Using Deepfake of Prime Minister Christopher Luxon
2024-07-15
A Taranaki, New Zealand resident allegedly lost $224,000 in a Bitcoin scam involving a deepfake video reportedly depicting Prime Minister Christopher Luxon. The AI-generated video, shared on Facebook, purportedly promoted cryptocurrency investments targeting superannuitants. Scammers posing as financial advisers reportedly gained remote access to the victim’s computer and created accounts to facilitate the transfer of funds.
MoreIncident 9231 Report
Nottingham Gallery Owner Allegedly Defrauded by Deepfake Impersonating Pierce Brosnan, Leading to Business Closure
2025-02-08
Nottingham gallery owner Simone Simms was allegedly deceived over many months by a deepfake impersonating actor Pierce Brosnan. Believing she was in direct contact with Brosnan, she reportedly arranged an art exhibition and sold £20,000 in tickets. When the real Brosnan denied involvement, Simms reportedly canceled the event and issued refunds. Despite acting in good faith, she reportedly faced reputational and financial harm, which led to the gallery’s closure in August 2024.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Incidents involved as both Developer and Deployer
- Incident 3432 Reports
Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems
- Incident 1421 Report
Facebook’s Advertisement Moderation System Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers
Incidents involved as Deployer
- Incident 4693 Reports
Automated Adult Content Detection Tools Showed Bias against Women Bodies
- Incident 7581 Report
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs
Incidents implicated systems
Meta
Incidents involved as both Developer and Deployer
- Incident 4718 Reports
Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia
- Incident 1695 Reports
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar
Incidents Harmed By
- Incident 3993 Reports
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
- Incident 3993 Reports
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content