Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Minority Groups

Incidents Harmed By

Incident 1927 Report
Sexist and Racist Google Adsense Advertisements

2013-01-23

Advertisements chosen by Google Adsense are reported as producing sexist and racist results.

More

Incident 6023 Report
FaceApp Racial Filters

2017-04-25

FaceApp is criticized for offering racist filters.

More

Incident 5318 Report
Biased Google Image Results

2016-03-31

On June 6, 2016, Google image searches of "three black teenagers" resulted in mostly mugshot images whereas Google image searchers of "three white teenagers" consisted of mostly stock images, suggesting a racial bias in Google's algorithm.

More

Incident 139 Report
High-Toxicity Assessed on Text Involving Women and Minority Groups

2017-02-27

Google's Perspective API, which assigns a toxicity score to online text, seems to award higher toxicity scores to content involving non-white, male, Christian, heterosexual phrases.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Microsoft Research

Incidents involved as both Developer and Deployer
  • Incident 12
    1 Report

    Common Biases of Vector Embeddings

More
Entity

Boston University

Incidents involved as both Developer and Deployer
  • Incident 12
    1 Report

    Common Biases of Vector Embeddings

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 19
    27 Reports

    Sexist and Racist Google Adsense Advertisements

  • Incident 53
    18 Reports

    Biased Google Image Results

Incidents involved as Developer
  • Incident 12
    1 Report

    Common Biases of Vector Embeddings

More
Entity

Women

Incidents Harmed By
  • Incident 19
    27 Reports

    Sexist and Racist Google Adsense Advertisements

  • Incident 13
    9 Reports

    High-Toxicity Assessed on Text Involving Women and Minority Groups

More
Entity

St George's Hospital Medical School

Incidents involved as Deployer
  • Incident 43
    4 Reports

    Racist AI behaviour is not a new problem

More
Entity

Dr. Geoffrey Franglen

Incidents involved as Developer
  • Incident 43
    4 Reports

    Racist AI behaviour is not a new problem

More
Entity

FaceApp

Incidents involved as both Developer and Deployer
  • Incident 60
    23 Reports

    FaceApp Racial Filters

More
Entity

Allen Institute for AI

Incidents involved as both Developer and Deployer
  • Incident 146
    3 Reports

    Research Prototype AI, Delphi, Reportedly Gave Racially Biased Answers on Ethics

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 179
    3 Reports

    DALL-E 2 Reported for Gender and Racially Biased Outputs

More
Entity

underrepresented groups

Incidents Harmed By
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

  • Incident 179
    3 Reports

    DALL-E 2 Reported for Gender and Racially Biased Outputs

More
Entity

Boris Dayma

Incidents involved as both Developer and Deployer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Suraj Patil

Incidents involved as Developer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Pedro Cuenca

Incidents involved as Developer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Khalid Saifullah

Incidents involved as Developer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Tanishq Abraham

Incidents involved as Developer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Phúc Lê Khắc

Incidents involved as Developer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Luke Melas

Incidents involved as Developer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Ritobrata Ghosh

Incidents involved as Developer
  • Incident 262
    4 Reports

    DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes

More
Entity

Meta AI

Incidents involved as both Developer and Deployer
  • Incident 399
    3 Reports

    Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content

Incidents Harmed By
  • Incident 399
    3 Reports

    Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content

More
Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 399
    3 Reports

    Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content

Incidents Harmed By
  • Incident 399
    3 Reports

    Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content

More
Entity

Facebook

Incidents involved as both Developer and Deployer
  • Incident 399
    3 Reports

    Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content

Incidents Harmed By
  • Incident 399
    3 Reports

    Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba