Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 777: South Korea Experiences a Surge of Explicit Deepfake Pornography

Description: At the end of August 2024, South Korean authorities began investigating a significant surge in the creation and dissemination, often via Telegram, of explicit deepfake pornography created without consent from the stolen social media content of female classmates, teachers, and neighbors.
Editor Notes: In one report, seven suspects were arrested, six of whom were teenagers. Another report mentions a graduate of Seoul National University in his 40s. One of the Telegram channels dedicated to the deepfakes was reported to have 220,000 members. One report indicates that between January 1 and August 25, 781 deepfake victims sought assistance from the state agency handling digital sex crimes, with 288 of those victims, or approximately 37%, being minors. This incident ID is for cataloguing the reporting on this pronounced flurry of deepfake pornography incidents in South Korea at the end of summer 2024.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Unnamed deepfake technology developers developed an AI system deployed by Unnamed deepfake creators, which harmed South Korean women.

Incident Stats

Incident ID
777
Report Count
6
Incident Date
2024-08-28
Editors
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

4.3. Fraud, scams, and targeted manipulation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Malicious Actors & Misuse

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

Incident Reports

Reports Timeline

+1
South Korea faces deepfake porn 'emergency'
+1
(Yonhap Feature) S. Korean women scurrying to take down selfies amid deepfake porn crimes
South Korean Teenagers Detained Over Deepfake Sexual ImagesSouth Korea Is Facing Deepfake Porn CrisisIn S​outh Korea, Misogyny Has a New Weapon: Deepfake Sex Videos
South Korea faces deepfake porn 'emergency'

South Korea faces deepfake porn 'emergency'

bbc.com

(Yonhap Feature) S. Korean women scurrying to take down selfies amid deepfake porn crimes

(Yonhap Feature) S. Korean women scurrying to take down selfies amid deepfake porn crimes

en.yna.co.kr

Inside the deepfake porn crisis engulfing Korean schools

Inside the deepfake porn crisis engulfing Korean schools

bbc.com

South Korean Teenagers Detained Over Deepfake Sexual Images

South Korean Teenagers Detained Over Deepfake Sexual Images

nytimes.com

South Korea Is Facing Deepfake Porn Crisis

South Korea Is Facing Deepfake Porn Crisis

bloomberg.com.

In S​outh Korea, Misogyny Has a New Weapon: Deepfake Sex Videos

In S​outh Korea, Misogyny Has a New Weapon: Deepfake Sex Videos

nytimes.com

South Korea faces deepfake porn 'emergency'
bbc.com · 2024

South Korea's president has urged authorities to do more to "eradicate" the country's digital sex crime epidemic, amid a flood of deepfake pornography targeting young women.

Authorities, journalists and social media users recently identifie…

(Yonhap Feature) S. Korean women scurrying to take down selfies amid deepfake porn crimes
en.yna.co.kr · 2024

SEOUL, Sept. 2 (Yonhap) -- Deepfake porn images have sent many South Korean women scurrying to take down selfies from Facebook, Instagram and other social media platforms as concerns have been mounting that no one is an exception to the cri…

Inside the deepfake porn crisis engulfing Korean schools
bbc.com · 2024

Last Saturday, a Telegram message popped up on Heejin's phone from an anonymous sender. "Your pictures and personal information have been leaked. Let's discuss."

As the university student entered the chatroom to read the message, she receiv…

South Korean Teenagers Detained Over Deepfake Sexual Images
nytimes.com · 2024

The authorities in South Korea are investigating a surge of sexually explicit images and video clips that have spread online and shocked the nation, leading the police to detain seven male suspects --- six of them teenagers --- the police s…

South Korea Is Facing Deepfake Porn Crisis
bloomberg.com. · 2024

South Korea has been rocked by a wave of sexually explicit deepfake images being created and shared online, indiscriminately targeting women and girls using their school photos, social media selfies and even military headshots. A Telegram c…

In S​outh Korea, Misogyny Has a New Weapon: Deepfake Sex Videos
nytimes.com · 2024

In 2020, as the South Korean authorities were pursuing a blackmail ring that forced young women to ​make sexually ​explicit videos for paying viewers, they found something else floating through the dark recesses of social media: pornographi…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.
unreviewed
Incident Date:
2024-09-13
Previous IncidentNext Incident

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 30ebe76