Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 480: Non-Consensual Deepfake Porn Targeted Female Content Creators

Description: Unauthorized, non-consensual deepfake pornography showing faces of high-profile female streamers and content creators was published on a subscription-based website, which gained notoriety after a male streamer was caught accessing the site.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: unknown developed and deployed an AI system, which harmed Maya Higa , female streamers , female content creators , @Sweet Anita , @QTCinderella and @Pokimane.

Incident Stats

Incident ID
480
Report Count
15
Incident Date
2023-01-30
Editors
Khoa Lam
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.2. Exposure to toxic content

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

Incident Reports

Reports Timeline

+2
Popular Female Twitch Streamers Targeted In Deepfake Pornography Scandal
Deepfake Porn Creator Deletes Internet Presence After Tearful 'Atrioc' Apology+1
A Deepfake Porn Scandal Has Rocked Twitch
+2
AI porn is easy to make now. For women, that’s a nightmare.
+3
QTCinderella Finds She Cannot Sue The Creator Of Deepfake Site
I was in deepfake porn, fans think it’s real — it can happen to anyoneThe Debate on Deepfake Porn Misses the PointTwitch Finally Addresses Porn Deepfake Scandal Over A Month Later
Popular Female Twitch Streamers Targeted In Deepfake Pornography Scandal

Popular Female Twitch Streamers Targeted In Deepfake Pornography Scandal

kotaku.com

QTCinderella vows to sue deepfake website Atrioc was caught watching

QTCinderella vows to sue deepfake website Atrioc was caught watching

dotesports.com

Deepfake Porn Creator Deletes Internet Presence After Tearful 'Atrioc' Apology

Deepfake Porn Creator Deletes Internet Presence After Tearful 'Atrioc' Apology

vice.com

A Deepfake Porn Scandal Has Rocked Twitch

A Deepfake Porn Scandal Has Rocked Twitch

buzzfeednews.com

Twitch star QTCinderella’s deepfake porn nightmare: ‘F–k the internet’

Twitch star QTCinderella’s deepfake porn nightmare: ‘F–k the internet’

nypost.com

AI porn is easy to make now. For women, that’s a nightmare.

AI porn is easy to make now. For women, that’s a nightmare.

washingtonpost.com

They appeared in deepfake porn videos without their consent. Few laws protect them.

They appeared in deepfake porn videos without their consent. Few laws protect them.

nbcnews.com

She discovered a naked video of herself online, but it wasn't her: The trauma of deepfake porn

She discovered a naked video of herself online, but it wasn't her: The trauma of deepfake porn

usatoday.com

QTCinderella Finds She Cannot Sue The Creator Of Deepfake Site

QTCinderella Finds She Cannot Sue The Creator Of Deepfake Site

thegamer.com

QTCinderella stares into legal void over explicit deepfakes

QTCinderella stares into legal void over explicit deepfakes

videogames.si.com

Nonconsensual deepfake porn puts AI in spotlight

Nonconsensual deepfake porn puts AI in spotlight

cnn.com

How ‘deepfake’ pornography victimizes women online

How ‘deepfake’ pornography victimizes women online

cnn.com

I was in deepfake porn, fans think it’s real — it can happen to anyone

I was in deepfake porn, fans think it’s real — it can happen to anyone

nypost.com

The Debate on Deepfake Porn Misses the Point

The Debate on Deepfake Porn Misses the Point

wired.com

Twitch Finally Addresses Porn Deepfake Scandal Over A Month Later

Twitch Finally Addresses Porn Deepfake Scandal Over A Month Later

kotaku.com

Popular Female Twitch Streamers Targeted In Deepfake Pornography Scandal
kotaku.com · 2023

Yesterday, Twitch streamer Brandon “Atrioc” Ewing issued a tearful apology during his livestream after he accidentally revealed that he had deepfake pornography of popular female Twitch streamers open on his computer. The video of his apolo…

QTCinderella vows to sue deepfake website Atrioc was caught watching
dotesports.com · 2023

As one of many streamers who have been objectified and exploited by the deepfaked lewd photo plague gaining traction after Atrioc inadvertently exposed it to thousands of viewers, QTCinderella vowed to sue the person responsible for creatin…

Deepfake Porn Creator Deletes Internet Presence After Tearful 'Atrioc' Apology
vice.com · 2023

On Monday, Twitch streamer Brandon Ewing, who goes by Atrioc online, admitted to buying and watching deepfakes from an account that makes non-consensual, sexually explicit AI-generated videos of his colleagues in the streaming world.

In a l…

A Deepfake Porn Scandal Has Rocked Twitch
buzzfeednews.com · 2023

The article reported that popular streamers Pokimane, Maya Higa, and QTCinderella were among those who appeared as deepfakes. Anita — who gained notice on Twitch for embracing her Tourette’s syndrome and educating her audience about it — wa…

Twitch star QTCinderella’s deepfake porn nightmare: ‘F–k the internet’
nypost.com · 2023

A popular gamer on Twitch has tearfully revealed she is the latest high-profile victim of deepfake porn, with predators pasting her face into a pre-existing adult video to make it seem she legitimately appeared in the kinky clip.

QTCinderel…

AI porn is easy to make now. For women, that’s a nightmare.
washingtonpost.com · 2023

QTCinderella built a name for herself by gaming, baking and discussing her life on the video-streaming platform Twitch, drawing hundreds of thousands of viewers at once. She pioneered "The Streamer Awards" to honor other high-performing con…

They appeared in deepfake porn videos without their consent. Few laws protect them.
nbcnews.com · 2023

Artificial intelligence-generated pornography featuring the faces of nonconsenting women is becoming more pervasive online, and the issue is spilling into the world of popular influencers and streamers.

In January, the British livestreamer …

She discovered a naked video of herself online, but it wasn't her: The trauma of deepfake porn
usatoday.com · 2023

Her inbox was flooded with explicit screenshots, seemingly from a pornographic video. She recognized her face, but not her body. For just a second, she questioned if the footage could be real. It certainly lookedthat way, though she knew sh…

QTCinderella Finds She Cannot Sue The Creator Of Deepfake Site
thegamer.com · 2023

Twitch streamer and YouTuber QTCinderella was in tears after she spoke out against the constant "exploitation and objectification" of women on a stream a couple weeks ago. It was triggered by the discovery that fellow streamer Atrioc had vi…

QTCinderella stares into legal void over explicit deepfakes
videogames.si.com · 2023

Twitch streamer QTCinderella has vented her frustration with the inadequacies of the US legal system after she couldn't find a lawyer to file a suit against the owner of a website that published deepfake porn videos depicting her.

She had p…

Nonconsensual deepfake porn puts AI in spotlight
cnn.com · 2023

In its annual “worldwide threat assessment,” top US intelligence officials have warned in recent years of the threat posed by so-called deepfakes – convincing fake videos made using artificial intelligence.

“Adversaries and strategic compet…

How ‘deepfake’ pornography victimizes women online
cnn.com · 2023

CNN's Donie O'Sullivan speaks with a Twitch streamer who was horrified to learn her likeness was being used in 'deepfake' pornography – a tactic being used as a method of online targeted harassment.

I was in deepfake porn, fans think it’s real — it can happen to anyone
nypost.com · 2023

Now, this is really faked up. 

Sweet Anita, a 32-year-old British social media star with more than 1.9 million Twitch followers, is deeply freaked out after discovering that her face has been digitally superimposed into deepfake pornography…

The Debate on Deepfake Porn Misses the Point
wired.com · 2023

When Blaire, a streamer known online as QTCinderella, first heard that her face had been deepfaked onto a porn performer’s body, she was puzzled. A popular creator with more than 800,000 followers on Twitch, she often streamed herself playi…

Twitch Finally Addresses Porn Deepfake Scandal Over A Month Later
kotaku.com · 2023

A month after Twitch streamer Brandon “Atrioc” Ewing accidentally revealed that he was watching sexually explicit deepfakes of his fellow streamers while on stream, Twitch has issued a lengthy statement regarding its stance on the controver…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Wikipedia Vandalism Prevention Bot Loop

Wikipedia Vandalism Prevention Bot Loop

Feb 2017 · 6 reports
Fake LinkedIn Profiles Created Using GAN Photos

Fake LinkedIn Profiles Created Using GAN Photos

Feb 2022 · 4 reports
Deepfake Obama Introduction of Deepfakes

Deepfake Obama Introduction of Deepfakes

Jul 2017 · 29 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Wikipedia Vandalism Prevention Bot Loop

Wikipedia Vandalism Prevention Bot Loop

Feb 2017 · 6 reports
Fake LinkedIn Profiles Created Using GAN Photos

Fake LinkedIn Profiles Created Using GAN Photos

Feb 2022 · 4 reports
Deepfake Obama Introduction of Deepfakes

Deepfake Obama Introduction of Deepfakes

Jul 2017 · 29 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 5fc5e5b