Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

YouTube users

Incidents Harmed By

Incident 1446 Report
YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

2020-06-28

YouTube's AI-powered hate speech detection system falsely flagged chess content and banned chess creators allegedly due to its misinterpretation of strategy language such as "black," "white," and "attack" as harmful and dangerous.

More

Incident 4865 Report
AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

2022-12-01

Synthesia's AI-generated video-making tool was reportedly used by Spamouflage to disseminate pro-China propaganda news on social media using videos featuring highly realistic fictitious news anchors.

More

Incident 9654 Report
Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

2025-03-04

Scammers are reportedly using an AI-generated deepfake of YouTube CEO Neal Mohan to steal user credentials. The fake video announces false changes to YouTube’s monetization policy, and it then tricks creators into clicking malicious links or downloading malware. The scam spreads through private videos and emails from a fake YouTube address. It exploits platform features to appear legitimate. Victims risk losing account access or exposing sensitive data.

More

Incident 2813 Report
YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm

2019-02-04

Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube’s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

YouTube

Incidents involved as both Developer and Deployer
  • Incident 144
    6 Reports

    YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

  • Incident 281
    3 Reports

    YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm

Incidents implicated systems
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

  • Incident 873
    1 Report

    YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls

More
Entity

Facebook

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

Incidents implicated systems
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

LinkedIn

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Twitter

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Netflix

Incidents involved as both Developer and Deployer
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Facebook users

Incidents Harmed By
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

LinkedIn users

Incidents Harmed By
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Twitter Users

Incidents Harmed By
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Netflix users

Incidents Harmed By
  • Incident 168
    2 Reports

    Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs

More
Entity

Antonio Radic

Incidents Harmed By
  • Incident 144
    6 Reports

    YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

More
Entity

YouTube chess content creators

Incidents Harmed By
  • Incident 144
    6 Reports

    YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

More
Entity

YouTube content creators

Incidents Harmed By
  • Incident 229
    2 Reports

    Content Using Bestiality Thumbnails Allegedly Evaded YouTube’s Thumbnail Monitoring System

More
Entity

Spamouflage Dragon

Incidents involved as Deployer
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

  • Incident 328
    2 Reports

    Fake Accounts Using GAN Faces Deployed by Propaganda Campaign on Social Platforms

More
Entity

unknown

Incidents involved as Developer
  • Incident 328
    2 Reports

    Fake Accounts Using GAN Faces Deployed by Propaganda Campaign on Social Platforms

More
Entity

YouTube climate-skeptic users

Incidents Harmed By
  • Incident 305
    2 Reports

    YouTube’s Recommendation Algorithm Allegedly Promoted Climate Misinformation Content

More
Entity

YouTube young users

Incidents Harmed By
  • Incident 281
    3 Reports

    YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm

More
Entity

Synthesia

Incidents Harmed By
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

Incidents involved as Developer
  • Incident 486
    5 Reports

    AI Video-Making Tool Abused to Deploy Pro-China News on Social Media

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 873
    1 Report

    YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls

More
Entity

Adolescent girls

Incidents Harmed By
  • Incident 873
    1 Report

    YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls

More
Entity

scammers

Incidents involved as Deployer
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

Fraudsters

Incidents involved as Deployer
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

Phishers

Incidents involved as Deployer
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

Scammers impersonating Neal Mohan

Incidents involved as Deployer
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

YouTube creators

Incidents Harmed By
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

YouTube account holders

Incidents Harmed By
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

YouTube monetization system

Incidents implicated systems
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

Gmail

Incidents implicated systems
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

Outlook

Incidents implicated systems
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

Unknown deepfake apps

Incidents implicated systems
  • Incident 965
    4 Reports

    Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators

More
Entity

DangerousAI

Incidents involved as Deployer
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown voice cloning technology developer

Incidents involved as Developer
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Volodymyr Zelenskyy

Incidents Harmed By
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Donald Trump

Incidents Harmed By
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

General public

Incidents Harmed By
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown deepfake app

Incidents implicated systems
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More
Entity

Unknown voice cloning technology

Incidents implicated systems
  • Incident 1005
    1 Report

    Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba