Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Women

Incidents Harmed By

Incident 1927 Report
Sexist and Racist Google Adsense Advertisements

2013-01-23

Advertisements chosen by Google Adsense are reported as producing sexist and racist results.

More

Incident 1811 Report
Gender Biases of Google Image Search

2015-04-04

Google Image returns results that under-represent women in leadership roles, notably with the first photo of a female "CEO" being a Barbie doll after 11 rows of male CEOs.

More

Incident 5910 Report
Gender Biases in Google Translate

2017-04-13

A Cornell University study in 2016 highlighted Google Translate's pattern of assigning gender to occupations in a way showing an implicit gender bias against women.

More

Incident 139 Report
High-Toxicity Assessed on Text Involving Women and Minority Groups

2017-02-27

Google's Perspective API, which assigns a toxicity score to online text, seems to award higher toxicity scores to content involving non-white, male, Christian, heterosexual phrases.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Microsoft Research

Incidents involved as both Developer and Deployer
  • Incident 12
    1 Report

    Common Biases of Vector Embeddings

More
Entity

Boston University

Incidents involved as both Developer and Deployer
  • Incident 12
    1 Report

    Common Biases of Vector Embeddings

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 19
    27 Reports

    Sexist and Racist Google Adsense Advertisements

  • Incident 18
    11 Reports

    Gender Biases of Google Image Search

Incidents involved as Developer
  • Incident 12
    1 Report

    Common Biases of Vector Embeddings

More
Entity

Minority Groups

Incidents Harmed By
  • Incident 19
    27 Reports

    Sexist and Racist Google Adsense Advertisements

  • Incident 13
    9 Reports

    High-Toxicity Assessed on Text Involving Women and Minority Groups

More
Entity

LinkedIn

Incidents involved as both Developer and Deployer
  • Incident 47
    9 Reports

    LinkedIn Search Prefers Male Names

More
Entity

St George's Hospital Medical School

Incidents involved as Deployer
  • Incident 43
    4 Reports

    Racist AI behaviour is not a new problem

More
Entity

Dr. Geoffrey Franglen

Incidents involved as Developer
  • Incident 43
    4 Reports

    Racist AI behaviour is not a new problem

More
Entity

Natural Cycles

Incidents involved as both Developer and Deployer
  • Incident 150
    3 Reports

    Swedish Contraceptive App, Natural Cycles, Allegedly Failed to Correctly Map Menstrual Cycle

More
Entity

Natural Cycles users

Incidents Harmed By
  • Incident 150
    3 Reports

    Swedish Contraceptive App, Natural Cycles, Allegedly Failed to Correctly Map Menstrual Cycle

More
Entity

Stability AI

Incidents involved as both Developer and Deployer
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

Runway

Incidents involved as Developer
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

LAION

Incidents involved as Developer
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

EleutherAI

Incidents involved as Developer
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

CompVis LMU

Incidents involved as Developer
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

racial minority groups

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

gender minority groups

Incidents Harmed By
  • Incident 529
    3 Reports

    Stable Diffusion Exhibited Biases for Prompts Featuring Professions

More
Entity

Telegram channels

Incidents involved as both Developer and Deployer
  • Incident 530
    3 Reports

    Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service

More
Entity

Alberto

Incidents involved as Developer
  • Incident 530
    3 Reports

    Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service

More
Entity

underage girls

Incidents Harmed By
  • Incident 530
    3 Reports

    Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service

More
Entity

female celebrities

Incidents Harmed By
  • Incident 530
    3 Reports

    Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service

More
Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 580
    1 Report

    Alleged Gender Discrimination in Facebook Job Ads Algorithm

More
Entity

Underrepresented genders

Incidents Harmed By
  • Incident 580
    1 Report

    Alleged Gender Discrimination in Facebook Job Ads Algorithm

More
Entity

General public

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

  • Incident 580
    1 Report

    Alleged Gender Discrimination in Facebook Job Ads Algorithm

More
Entity

Advertisers

Incidents Harmed By
  • Incident 580
    1 Report

    Alleged Gender Discrimination in Facebook Job Ads Algorithm

More
Entity

Unknown deepfake creators

Incidents involved as both Developer and Deployer
  • Incident 782
    1 Report

    AI 'Nudify' Apps Used as Tools for Blackmail and Extortion

More
Entity

Extortionists

Incidents involved as Deployer
  • Incident 782
    1 Report

    AI 'Nudify' Apps Used as Tools for Blackmail and Extortion

More
Entity

Women in India

Incidents Harmed By
  • Incident 782
    1 Report

    AI 'Nudify' Apps Used as Tools for Blackmail and Extortion

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

Marginalized groups

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

people with disabilities

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

People with larger bodies

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

LGBTQ+ people

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

People of color

Incidents Harmed By
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More
Entity

Sora

Incidents implicated systems
  • Incident 1000
    2 Reports

    Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 5fc5e5b