Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Facebook users

Incidents Harmed By

Incident 7226 Report
Facebook translates 'good morning' into 'attack them', leading to arrest

2017-10-17

Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them," leading to the arrest of a Palestinian man in Beitar Illit, Israel.

More

Incident 26710 Report
Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

2017-06-15

Face-matching algorithm by Clearview AI was built using scraped images from social media sites such as Instagram and Facebook without user consent, violating social media site policies, and allegedly privacy regulations.

More

Incident 2846 Report
Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship

2018-05-01

Facebook’s removal of posts featuring renowned artworks by many historical artists and their promotional content due to nudity via both automated and human-moderated means were condemned by critics, such as museums and tourism boards, as cultural censorship and prevention of artwork promotion.

More

Incident 3246 Report
GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

2019-11-12

A large network of pages, groups, and fake accounts having GAN-generated face photos associated with The BL, a US-based media outlet, reportedly bypassed Facebook moderation systems to push "pro-Trump" narratives on its platform and Instagram.

More

Incidents involved as Developer

Incident 7122 Report
Meta AI Hallucinates Harassment Allegations Against New York Politicians

2024-04-26

Meta's AI chatbot in Facebook Messenger falsely accused multiple state lawmakers of sexual harassment, fabricating incidents, investigations, and consequences that never occurred. These fabricated stories, discovered by City & State, sparked outrage among the affected lawmakers and raised concerns about the reliability of the chatbot. Meta acknowledged the errors and committed to ongoing improvements.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Facebook

Incidents involved as both Developer and Deployer
  • Incident 72
    26 Reports

    Facebook translates 'good morning' into 'attack them', leading to arrest

  • Incident 284
    6 Reports

    Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

  • Incident 758
    1 Report

    Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

unnamed Palestinian Facebook user

Incidents Harmed By
  • Incident 72
    26 Reports

    Facebook translates 'good morning' into 'attack them', leading to arrest

More
Entity

Palestinian Facebook users

Incidents Harmed By
  • Incident 72
    26 Reports

    Facebook translates 'good morning' into 'attack them', leading to arrest

More
Entity

Arabic-speaking Facebook users

Incidents Harmed By
  • Incident 72
    26 Reports

    Facebook translates 'good morning' into 'attack them', leading to arrest

More
Entity

Facebook users interested in COVID information

Incidents Harmed By
  • Incident 84
    1 Report

    Tiny Changes Let False Claims About COVID-19, Voting Evade Facebook Fact Checks

More
Entity

Facebook users interested in the US Presidential Election

Incidents Harmed By
  • Incident 84
    1 Report

    Tiny Changes Let False Claims About COVID-19, Voting Evade Facebook Fact Checks

More
Entity

Facebook users interested in the Lekki Massacre incident

Incidents Harmed By
  • Incident 82
    1 Report

    #LekkiMassacre: Why Facebook labelled content from October 20 incident ‘false’

More
Entity

Black people

Incidents Harmed By
  • Incident 113
    1 Report

    Facebook's AI Put "Primates" Label on Video Featuring Black Men

More
Entity

LinkedIn

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

YouTube

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

Incidents implicated systems
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Twitter

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

  • Incident 343
    2 Reports

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

More
Entity

Netflix

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

LinkedIn users

Incidents Harmed By
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

YouTube users

Incidents Harmed By
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Twitter Users

Incidents Harmed By
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Netflix users

Incidents Harmed By
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Facebook content creators

Incidents Harmed By
  • Incident 164
    1 Report

    Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric

More
Entity

Facebook users of minority groups

Incidents Harmed By
  • Incident 163
    2 Reports

    Facebook’s Hate Speech Detection Algorithms Allegedly Disproportionately Failed to Remove Racist Content towards Minority Groups

More
Entity

Facebook users sharing photo evidence of slavery

Incidents Harmed By
  • Incident 275
    2 Reports

    Facebook’s Moderation Algorithm Banned Users for Historical Evidence of Slavery

More
Entity

Clearview AI

Incidents involved as both Developer and Deployer
  • Incident 267
    10 Reports

    Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

More
Entity

social media users

Incidents Harmed By
  • Incident 267
    10 Reports

    Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

More
Entity

Instagram users

Incidents Harmed By
  • Incident 267
    10 Reports

    Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent

  • Incident 324
    6 Reports

    GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

More
Entity

Spamouflage Dragon

Incidents involved as Deployer
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

  • Incident 328
    2 Reports

    Fake Accounts Using GAN Faces Deployed by Propaganda Campaign on Social Platforms

More
Entity

unknown

Incidents involved as Developer
  • Incident 324
    6 Reports

    GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

  • Incident 328
    2 Reports

    Fake Accounts Using GAN Faces Deployed by Propaganda Campaign on Social Platforms

More
Entity

Facebook users having posts about painful events

Incidents Harmed By
  • Incident 326
    3 Reports

    Facebook Automated Year-in-Review Highlights Showed Users Painful Memories

  • Incident 327
    1 Report

    Facebook’s On-This-Day Feature Mistakenly Showed Painful Memories to Users

More
Entity

Facebook users posting legitimate COVID-19 news

Incidents Harmed By
  • Incident 317
    1 Report

    Bug in Facebook’s Anti-Spam Filter Allegedly Blocked Legitimate Posts about COVID-19

More
Entity

museums on Facebook

Incidents Harmed By
  • Incident 284
    6 Reports

    Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship

More
Entity

Facebook users interested in arts

Incidents Harmed By
  • Incident 284
    6 Reports

    Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship

More
Entity

The BL

Incidents involved as Deployer
  • Incident 324
    6 Reports

    GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms

More
Entity

Instagram

Incidents involved as both Developer and Deployer
  • Incident 343
    2 Reports

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

  • Incident 758
    1 Report

    Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

More
Entity

Marcus Rashford

Incidents Harmed By
  • Incident 343
    2 Reports

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

More
Entity

Jadon Sancho

Incidents Harmed By
  • Incident 343
    2 Reports

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

More
Entity

Bukayo Saka

Incidents Harmed By
  • Incident 343
    2 Reports

    Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems

More
Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

Incidents Harmed By
  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Microsoft

Incidents involved as Developer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Google

Incidents involved as Developer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Amazon

Incidents involved as Developer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Facebook users speaking Swahili

Incidents Harmed By
  • Incident 393
    1 Report

    Facebook AI-Supported Moderation for Ads Failed to Detect Violating Content

More
Entity

Facebook users speaking English

Incidents Harmed By
  • Incident 393
    1 Report

    Facebook AI-Supported Moderation for Ads Failed to Detect Violating Content

More
Entity

Palestinian social media users

Incidents Harmed By
  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

More
Entity

Facebook employees having families affected by the conflict

Incidents Harmed By
  • Incident 359
    1 Report

    Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict

More
Entity

political campaigns

Incidents Harmed By
  • Incident 522
    1 Report

    Facebook Political Ad Delivery Algorithms Inferred Users' Political Alignment, Inhibiting Political Campaigns' Reach

More
Entity

Facebook users in online support communities

Incidents Harmed By
  • Incident 700
    2 Reports

    Meta's AI Chatbots Are Entering Online Support Communities Uninvited

More
Entity

Kristen Gonzalez

Incidents Harmed By
  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

More
Entity

Clyde Vanel

Incidents Harmed By
  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

More
Entity

New York lawmakers

Incidents Harmed By
  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

  • Incident 712
    2 Reports

    Meta AI Hallucinates Harassment Allegations Against New York Politicians

More
Entity

Synthesia

Incidents Harmed By
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

Incidents involved as Developer
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

More
Entity

Meta Platforms

Incidents involved as both Developer and Deployer
  • Incident 758
    1 Report

    Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

More
Entity

Elijah Ott

Incidents Harmed By
  • Incident 758
    1 Report

    Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

More
Entity

California residents

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Wildfire evacuees

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Emergency responders

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Disaster relief workers

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Fire safety coordinators

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Facebook users in disaster zones

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Meta users

Incidents Harmed By
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 803
    1 Report

    Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts

More
Entity

Meta AI Characters

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

More
Entity

DangerousAI

Incidents involved as Deployer
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 818
    2 Reports

    Jennifer Aniston’s Likeness Exploited in Deepfake Collagen Supplement Promotion

  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown voice cloning technology developer

Incidents involved as Developer
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Volodymyr Zelenskyy

Incidents Harmed By
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Donald Trump

Incidents Harmed By
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

General public

Incidents Harmed By
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown deepfake app

Incidents implicated systems
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown voice cloning technology

Incidents implicated systems
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown deepfake creators

Incidents involved as Deployer
  • Incident 818
    2 Reports

    Jennifer Aniston’s Likeness Exploited in Deepfake Collagen Supplement Promotion

More
Entity

scammers

Incidents involved as Deployer
  • Incident 818
    2 Reports

    Jennifer Aniston’s Likeness Exploited in Deepfake Collagen Supplement Promotion

More
Entity

Jennifer Aniston

Incidents Harmed By
  • Incident 818
    2 Reports

    Jennifer Aniston’s Likeness Exploited in Deepfake Collagen Supplement Promotion

More
Entity

Jennifer Aniston fans

Incidents Harmed By
  • Incident 818
    2 Reports

    Jennifer Aniston’s Likeness Exploited in Deepfake Collagen Supplement Promotion

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba