Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 797: Teenager Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia

Description: At Bacchus Marsh Grammar, a school in Victoria state in Australia, an adolescent male made deepfake pornography of 50 girls, ages 9 to 12. He then allegedly uploaded the pictures to Instagram, and others subsequently shared them on Snapchat.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Unknown deepfake technology developer developed an AI system deployed by Unnamed adolescent male , Instagram users and Snapchat users, which harmed Bacchus Marsh Grammar students and Bacchus Marsh Grammar girls.

Incident Stats

Incident ID
797
Report Count
5
Incident Date
2024-06-07
Editors
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

4.3. Fraud, scams, and targeted manipulation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Malicious Actors & Misuse

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

Incident Reports

Reports Timeline

Incident Occurrence+1
Fifty Bacchus Marsh Grammar girls targeted with AI fake nudes
+1
Bacchus Marsh Grammar: schoolboy arrested after 50 female students allegedly targeted in fake explicit AI photos scandal
Vomit-inducing deepfake nudes show yet again that when misogyny intersects with AI and elitism, girls get hurt | Van Badham
Fifty Bacchus Marsh Grammar girls targeted with AI fake nudes

Fifty Bacchus Marsh Grammar girls targeted with AI fake nudes

smh.com.au

Parent reacts after 50 girls targeted in AI explicit photo scandal at Melbourne school

Parent reacts after 50 girls targeted in AI explicit photo scandal at Melbourne school

sbs.com.au

Bacchus Marsh Grammar: schoolboy arrested after 50 female students allegedly targeted in fake explicit AI photos scandal

Bacchus Marsh Grammar: schoolboy arrested after 50 female students allegedly targeted in fake explicit AI photos scandal

theguardian.com

Parent outraged over 'incredibly graphic' fake images of Bacchus Marsh Grammar students

Parent outraged over 'incredibly graphic' fake images of Bacchus Marsh Grammar students

abc.net.au

Vomit-inducing deepfake nudes show yet again that when misogyny intersects with AI and elitism, girls get hurt | Van Badham

Vomit-inducing deepfake nudes show yet again that when misogyny intersects with AI and elitism, girls get hurt | Van Badham

theguardian.com

Fifty Bacchus Marsh Grammar girls targeted with AI fake nudes
smh.com.au · 2024

A teenage male has been arrested after fake nude images of 50 girls at a regional Victorian private school were shared on social media.

Faces of the girls, in years 9 to 12 at Bacchus Marsh Grammar, were used in images of nudes generated by…

Parent reacts after 50 girls targeted in AI explicit photo scandal at Melbourne school
sbs.com.au · 2024

The mother of a 16-year-old girl whose classmates' social media photos were "mutilated" into fake nude images says her daughter vomited when she saw them online.

Trauma therapist Emily, who did not provide her surname, said she learned on S…

Bacchus Marsh Grammar: schoolboy arrested after 50 female students allegedly targeted in fake explicit AI photos scandal
theguardian.com · 2024

A teenage boy has been arrested and then released after fake explicit images, described as “mutilated” and “incredibly graphic”, were allegedly circulated on social media using the likenesses of about 50 female students from a private schoo…

Parent outraged over 'incredibly graphic' fake images of Bacchus Marsh Grammar students
abc.net.au · 2024
  • In short:  A parent has described explicit fake images of Bacchus Marsh Grammar students circulated online as 'sickening.'
  • A teenager has been arrested and released pending further enquiries after complaints were made about the AI images.
  • …
Vomit-inducing deepfake nudes show yet again that when misogyny intersects with AI and elitism, girls get hurt | Van Badham
theguardian.com · 2024

A teenage private schoolboy has been arrested for allegedly distributing “incredibly graphic” deepfake images of 50 girls from Bacchus Marsh grammar in Victoria. The story represents a triskelion knot of technolibertarianism, exclusivity an…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

Selected by our editors
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Oct 2023 · 57 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Australian Automated Debt Assessment System Issued False Notices to Thousands

Australian Automated Debt Assessment System Issued False Notices to Thousands

Jul 2015 · 39 reports
Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent

Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent

May 2022 · 2 reports
Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Aug 2017 · 4 reports
Previous IncidentNext Incident

Similar Incidents

Selected by our editors
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes

Oct 2023 · 57 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Australian Automated Debt Assessment System Issued False Notices to Thousands

Australian Automated Debt Assessment System Issued False Notices to Thousands

Jul 2015 · 39 reports
Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent

Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent

May 2022 · 2 reports
Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Facial Recognition Trial Performed Poorly at Notting Hill Carnival

Aug 2017 · 4 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba