Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Victims of deepfake child abuse

Incidents Harmed By

Incident 9631 Report
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

2025-03-05

Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

General public

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

General public of Australia

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Google Gemini users

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of deepfake terrorism content

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of online radicalization

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Gemini

Incidents implicated systems
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 30ebe76