Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Entités

Children

Affecté par des incidents

Incident 62418 Rapports
Child Sexual Abuse Material Taints Image Generators

2023-12-20

The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.

Plus

Incident 5516 Rapports
Alexa Plays Pornography Instead of Kids Song

2016-12-30

An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.

Plus

Incident 114 Rapports
Google’s YouTube Kids App Presents Inappropriate Content

2015-05-19

YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.

Plus

Incident 95811 Rapports
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

2025-02-26

Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.

Plus

Entités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
 

Entity

YouTube

Incidents impliqués en tant que développeur et déployeur
  • Incident 1
    14 Report

    Google’s YouTube Kids App Presents Inappropriate Content

Plus
Entity

Amazon

Incidents impliqués en tant que développeur et déployeur
  • Incident 55
    16 Report

    Alexa Plays Pornography Instead of Kids Song

Plus
Entity

OpenAI

Incidents impliqués en tant que développeur et déployeur
  • Incident 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Plus
Entity

internet users

Affecté par des incidents
  • Incident 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Plus
Entity

social media users

Affecté par des incidents
  • Incident 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Plus
Entity

Meta

Incidents impliqués en tant que développeur et déployeur
  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Plus
Entity

Instagram

Incidents impliqués en tant que développeur et déployeur
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Incidents involved as Deployer
  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Plus
Entity

General public

Affecté par des incidents
  • Incident 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Plus
Entity

minors

Affecté par des incidents
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Plus
Entity

teenagers

Affecté par des incidents
  • Incident 583
    1 Report

    Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content

Plus
Entity

Various people

Affecté par des incidents
  • Incident 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Deployer
  • Incident 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Plus
Entity

Various organizations

Affecté par des incidents
  • Incident 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Deployer
  • Incident 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Plus
Entity

LAION

Affecté par des incidents
  • Incident 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Incidents involved as Developer
  • Incident 624
    18 Report

    Child Sexual Abuse Material Taints Image Generators

Plus
Entity

Instagram users

Affecté par des incidents
  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Plus
Entity

Instagram sellers

Affecté par des incidents
  • Incident 723
    2 Report

    Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Plus
Entity

Unknown Dark Web users

Incidents involved as Deployer
  • Incident 784
    1 Report

    Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them

Plus
Entity

Unknown deepfake creators

Incidents impliqués en tant que développeur et déployeur
  • Incident 784
    1 Report

    Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them

Plus
Entity

Unknown AI developers

Incidents involved as Developer
  • Incident 784
    1 Report

    Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them

Incidents involved as Deployer
  • Incident 780
    1 Report

    Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography

Plus
Entity

Meta Platforms

Incidents impliqués en tant que développeur et déployeur
  • Incident 788
    1 Report

    Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Plus
Entity

Seth Herrera

Incidents involved as Developer
  • Incident 780
    1 Report

    Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography

Plus
Entity

Suspects identified in Operation Cumberland

Incidents involved as Deployer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

CSAM distributors

Incidents involved as Deployer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Unknown deepfake CSAM tools

Incidents involved as Developer
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Potential victims of exploitation

Affecté par des incidents
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Unknown deepfake apps

Incidents implicated systems
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Unknown CSAM apps

Incidents implicated systems
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus
Entity

Dark web marketplaces

Incidents implicated systems
  • Incident 958
    11 Report

    Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material

Plus

Recherche

  • Définition d'un « incident d'IA »
  • Définir une « réponse aux incidents d'IA »
  • Feuille de route de la base de données
  • Travaux connexes
  • Télécharger la base de données complète

Projet et communauté

  • À propos de
  • Contacter et suivre
  • Applications et résumés
  • Guide de l'éditeur

Incidents

  • Tous les incidents sous forme de liste
  • Incidents signalés
  • File d'attente de soumission
  • Affichage des classifications
  • Taxonomies

2023 - AI Incident Database

  • Conditions d'utilisation
  • Politique de confidentialité
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 5fc5e5b