Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Women depicted in deepfake pornography

Incidents Harmed By

Incident 10042 Report
San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law

2024-08-15

In August 2024, the San Francisco City Attorney’s Office filed a first-of-its-kind lawsuit against 16 websites accused of using generative AI to create and distribute nonconsensual pornographic deepfakes, including images of minors. The sites, which had over 200 million visits in six months, invited users to upload real images to generate explicit fakes. By March 2025, 11 of the targeted websites had shut down following legal pressure.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Operators of 16 deepfake pornography websites

Incidents involved as Deployer
  • Incident 1004
    2 Reports

    San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law

More
Entity

Unknown deepfake technology developers

Incidents involved as Developer
  • Incident 1004
    2 Reports

    San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law

More
Entity

Minors depicted in deepfake pornography

Incidents Harmed By
  • Incident 1004
    2 Reports

    San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law

More
Entity

Unknown deepfake apps

Incidents implicated systems
  • Incident 1004
    2 Reports

    San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law

More
Entity

Unknown generative AI tools

Incidents implicated systems
  • Incident 1004
    2 Reports

    San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • f28fa7c