Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Meta users

Incidents Harmed By

Incident 8855 Report
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

2025-01-03

Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.

More

Incident 8752 Report
Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

2024-01-08

143 deepfake ads, over 100 of which reportedly impersonated former British Prime Minister Rishi Sunak, were promoted on Meta's platform to advertise the fraudulent investment scheme "Quantum AI." Funding for the ads reportedly originated from 23 countries. Up to 462,000 users may have been exposed to the false content. The campaign used generative AI tools to create high-quality misinformation, including spoofed BBC news clips for added legitimacy

More

Incident 9992 Report
Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

2025-03-12

A phishing campaign has reportedly been impersonating Meta support using a fake chatbot interface to hijack Instagram Business accounts. Victims received emails claiming ad violations and were directed to a fraudulent site mimicking Meta's support. There, a simulated chatbot instructed users to add the attacker’s Authenticator app as a secure login method, enabling account takeover. It remains unclear whether the chatbot used AI or was human-operated via a bot-like interface. See editor's note.

More

Incident 8031 Report
Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts

2024-05-14

AI-generated spam images are increasingly filling Facebook feeds, with the platform’s algorithm reportedly amplifying these posts. Many of these images are bizarre, fake, and used in scams, misleading users into engaging with non-existent products or clickbait.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 803
    1 Report

    Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts

More
Entity

Facebook

Incidents involved as both Developer and Deployer
  • Incident 803
    1 Report

    Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

More
Entity

Facebook users

Incidents Harmed By
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 803
    1 Report

    Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts

More
Entity

Quantum AI scammers

Incidents involved as Deployer
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Unknown deepfake technology developers

Incidents involved as Developer
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Rishi Sunak

Incidents Harmed By
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Quantum AI victims

Incidents Harmed By
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

BBC News presenters

Incidents Harmed By
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Unknown deepfake technology apps

Incidents implicated systems
  • Incident 875
    2 Reports

    Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

More
Entity

Instagram users

Incidents Harmed By
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Meta AI Characters

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

More
Entity

Instagram

Incidents implicated systems
  • Incident 885
    5 Reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust

  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

minors

Incidents Harmed By
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Instagram recommendation algorithm

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Instagram Reels

Incidents implicated systems
  • Incident 957
    1 Report

    Alleged Instagram Algorithm Malfunction Floods Users’ Reels Feeds with Violent and Graphic Content

More
Entity

Scammers impersonating Meta support

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

scammers

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Phishers

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Fraudsters

Incidents involved as Deployer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Unknown generative AI developers

Incidents involved as Developer
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Instagram Business users

Incidents Harmed By
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More
Entity

Unknown chatbot interface

Incidents implicated systems
  • Incident 999
    2 Reports

    Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba