Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

TikTok users

Incidents Harmed By

Incident 8697 Report
TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content

2024-11-04

Seven French families are suing TikTok, alleging its algorithm exposed minors to harmful content promoting self-harm, eating disorders, and suicide. Two teenagers reportedly died by suicide after viewing such content, while others allegedly attempted suicide or developed mental health issues. The case seeks to establish TikTok's legal liability for failing to protect minors from harmful algorithmic content.

More

Incident 4816 Report
Deepfake TikTok Video Featured Joe Rogan Endorsing Supplement Brand

2023-02-12

A deepfake video featuring podcast host Joe Rogan advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.

More

Incident 9765 Report
AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice

2025-03-08

AI-generated avatars posing as OB-GYNs on TikTok, part of the so-called, crudely termed "Coochie Doctor" trend, have been falsely claiming years of experience while promoting dubious health advice. Many, including an avatar named "Violet," were created using the Captions app, which generates scripted AI influencers.

More

Incident 1174 Report
TikTok's "Suggested Accounts" Algorithm Allegedly Reinforced Racial Bias through Feedback Loops

2020-02-24

TikTok's "Suggested Accounts" recommendations allegedly reinforced racial bias despite not basing recommendations on race or creators' profile photo.

More

Incidents involved as Deployer

Incident 5682 Report
AI-Generated Voices Amplify Conspiracy Theories on TikTok

2023-06-01

NewsGuard has identified 17 TikTok accounts that have been using AI-generated voices to advance and amplify conspiracy theories and false claims beginning in June 2023. By September 25, 2023, these accounts had amassed over 336 million views and over 14.5 million likes. Videos include baseless claims involving public figures such as Barack Obama, Oprah Winfrey, and Jamie Foxx.

More

Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

2024-04-29

The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

TikTok

Incidents involved as both Developer and Deployer
  • Incident 869
    7 Reports

    TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content

  • Incident 117
    4 Reports

    TikTok's "Suggested Accounts" Algorithm Allegedly Reinforced Racial Bias through Feedback Loops

Incidents Harmed By
  • Incident 300
    2 Reports

    TikTok's "For You" Algorithm Allegedly Abused by Online Personality to Promote Anti-Women Hate

  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

Incidents implicated systems
  • Incident 976
    5 Reports

    AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice

More
Entity

TikTok users under 18 years old

Incidents Harmed By
  • Incident 132
    1 Report

    TikTok’s Content Moderation Allegedly Failed to Adequately Take down Videos Promoting Eating Disorders

More
Entity

TikTok content creators

Incidents Harmed By
  • Incident 117
    4 Reports

    TikTok's "Suggested Accounts" Algorithm Allegedly Reinforced Racial Bias through Feedback Loops

More
Entity

TikTok new users

Incidents Harmed By
  • Incident 185
    4 Reports

    TikTok's "For You" Algorithm Directed New Users towards Disinformation about the War in Ukraine

More
Entity

TikTok male teenager users

Incidents Harmed By
  • Incident 300
    2 Reports

    TikTok's "For You" Algorithm Allegedly Abused by Online Personality to Promote Anti-Women Hate

More
Entity

TikTok male users

Incidents Harmed By
  • Incident 300
    2 Reports

    TikTok's "For You" Algorithm Allegedly Abused by Online Personality to Promote Anti-Women Hate

More
Entity

TikTok teenage users

Incidents Harmed By
  • Incident 300
    2 Reports

    TikTok's "For You" Algorithm Allegedly Abused by Online Personality to Promote Anti-Women Hate

More
Entity

Lalani Erika Renee Walton

Incidents Harmed By
  • Incident 286
    3 Reports

    TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls

More
Entity

Arriani Jaileen Arroyo

Incidents Harmed By
  • Incident 286
    3 Reports

    TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls

More
Entity

Lalani Erika Renee Walton's family

Incidents Harmed By
  • Incident 286
    3 Reports

    TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls

More
Entity

Arriani Jaileen Arroyo's family

Incidents Harmed By
  • Incident 286
    3 Reports

    TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls

More
Entity

TikTok young users

Incidents Harmed By
  • Incident 286
    3 Reports

    TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls

  • Incident 279
    3 Reports

    TikTok’s “For You” Algorithm Exposed Young Users to Pro-Eating Disorder Content

More
Entity

young TikTok users

Incidents Harmed By
  • Incident 397
    2 Reports

    Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human

More
Entity

Gen Z TikTok users

Incidents Harmed By
  • Incident 397
    2 Reports

    Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human

More
Entity

unknown

Incidents involved as both Developer and Deployer
  • Incident 493
    1 Report

    TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban

Incidents involved as Developer
  • Incident 481
    6 Reports

    Deepfake TikTok Video Featured Joe Rogan Endorsing Supplement Brand

More
Entity

TikTok user @e.news.tv

Incidents involved as Deployer
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

TikTok user @d.news.tv

Incidents involved as Deployer
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

TikTok user @drphilshowtv

Incidents involved as Deployer
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

TikTok user @ynewstv2023

Incidents involved as Deployer
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

ElevenLabs

Incidents involved as Developer
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

Barack Obama

Incidents Harmed By
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

Oprah Winfrey

Incidents Harmed By
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

Jamie Foxx

Incidents Harmed By
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

Joan Rivers

Incidents Harmed By
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

Phil McGraw

Incidents Harmed By
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

Yahoo! News

Incidents Harmed By
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

E! News

Incidents Harmed By
  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

General public

Incidents Harmed By
  • Incident 790
    2 Reports

    Unrestricted AI Avatar Tool Accidentally Released by TikTok Permits Recitation of Hitler Quotes and Other Harmful Speech

  • Incident 568
    2 Reports

    AI-Generated Voices Amplify Conspiracy Theories on TikTok

More
Entity

Julia Munslow

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

ChatGPT

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

GPT-3.5

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

GPT-4

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

Perplexity AI

Incidents Harmed By
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

OpenAI

Incidents Harmed By
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents involved as Developer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

Perplexity.ai

Incidents involved as Developer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

@mikesmithtrainer

Incidents involved as Deployer
  • Incident 481
    6 Reports

    Deepfake TikTok Video Featured Joe Rogan Endorsing Supplement Brand

More
Entity

Joe Rogan

Incidents Harmed By
  • Incident 481
    6 Reports

    Deepfake TikTok Video Featured Joe Rogan Endorsing Supplement Brand

More
Entity

Joe Rogan fans

Incidents Harmed By
  • Incident 481
    6 Reports

    Deepfake TikTok Video Featured Joe Rogan Endorsing Supplement Brand

More
Entity

Unknown deepfake creator

Incidents involved as Deployer
  • Incident 802
    1 Report

    AI Deepfake of Brian May Exploited in Scam Offering Fake Queen Backstage Tickets

More
Entity

Unknown scammers

Incidents involved as Deployer
  • Incident 802
    1 Report

    AI Deepfake of Brian May Exploited in Scam Offering Fake Queen Backstage Tickets

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 802
    1 Report

    AI Deepfake of Brian May Exploited in Scam Offering Fake Queen Backstage Tickets

More
Entity

Queen (band) fans

Incidents Harmed By
  • Incident 802
    1 Report

    AI Deepfake of Brian May Exploited in Scam Offering Fake Queen Backstage Tickets

More
Entity

Brian May fans

Incidents Harmed By
  • Incident 802
    1 Report

    AI Deepfake of Brian May Exploited in Scam Offering Fake Queen Backstage Tickets

More
Entity

Unknown deepfake creators

Incidents involved as Deployer
  • Incident 809
    1 Report

    TikTok Hosts AI-Generated English-Language Hitler Speeches with Millions of Views

More
Entity

Unknown deepfake technology developers

Incidents involved as Developer
  • Incident 809
    1 Report

    TikTok Hosts AI-Generated English-Language Hitler Speeches with Millions of Views

More
Entity

Unknown TikTok users

Incidents involved as Deployer
  • Incident 976
    5 Reports

    AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice

More
Entity

Captions

Incidents involved as Developer
  • Incident 976
    5 Reports

    AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice

More
Entity

Captions AI

Incidents implicated systems
  • Incident 976
    5 Reports

    AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice

More
Entity

Unknown AI developers

Incidents involved as Deployer
  • Incident 810
    1 Report

    TikTok Network Amplifies AI-Generated Nazi Propaganda and Hate Speech

More
Entity

Pro-Nazi TikTok accounts

Incidents involved as Developer
  • Incident 810
    1 Report

    TikTok Network Amplifies AI-Generated Nazi Propaganda and Hate Speech

More
Entity

Seven French families

Incidents Harmed By
  • Incident 869
    7 Reports

    TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content

More
Entity

Minors using TikTok

Incidents Harmed By
  • Incident 869
    7 Reports

    TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content

More
Entity

TikTok recommendation algorithms

Incidents implicated systems
  • Incident 869
    7 Reports

    TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba