Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Amazon

Incidents involved as both Developer and Deployer

Incident 3435 Report
Amazon Alexa Responding to Environmental Inputs

2015-12-05

There are multiple reports of Amazon Alexa products (Echo, Echo Dot) reacting and acting upon unintended stimulus, usually from television commercials or news reporter's voices.

More

Incident 3733 Report
Female Applicants Down-Ranked by Amazon Recruiting Tool

2016-08-10

Amazon shuts down internal AI recruiting tool that would down-rank female applicants.

More

Incident 1524 Report
Amazon Censors Gay Books

2008-05-23

Amazon's book store "cataloging error" led to books containing gay and lesbian themes to lose their sales ranking, therefore losing visibility on the sales platform.

More

Incident 217 Report
Warehouse robot ruptures can of bear spray and injures workers

2018-12-05

Twenty-four Amazon workers in New Jersey were hospitalized after a robot punctured a can of bear repellent spray in a warehouse.

More

Incidents Harmed By

Incident 6255 Report
Proliferation of Products on Amazon Titled with ChatGPT Error Messages

2024-01-12

Products named after ChatGPT error messages are proliferating on Amazon, such as lawn chairs and religious texts. These names, often resembling AI-generated errors, indicate a lack of editing and undermine the sense of authenticity and reliability of product listings.

More

Incident 5282 Report
Amazon Algorithmic Pricing Allegedly Hiked up Price of Reference Book to Millions

2023-04-08

Amazon's pricing algorithm was implicated in a reference book about flies' unusual high price of millions of dollars, allegedly due to two sellers using the paid service which based their product's pricing on one another's as competitors.

More

Incident 5751 Report
Amazon Rife with Many Allegedly AI-Generated Books of Suspect Quality

2023-06-28

Amazon’s Kindle Unlimited young adult romance bestseller list was flooded with allegedly AI-generated books that made little to no sense, disrupting the rankings. These books were reported to be "clearly there to click farm." Despite being removed from the bestseller list, many remained available for purchase. The incident raised concerns about the integrity of the platform, and the potential financial impact on legitimate authors.

More

Incidents involved as Developer

Incident 1115 Report
Amazon Flex Drivers Allegedly Fired via Automated Employee Evaluations

2015-09-25

Amazon Flex's contract delivery drivers were dismissed using a minimally human-interfered automated employee performance evaluation based on indicators impacted by out-of-driver's-control factors and without having a chance to defend against or appeal the decision.

More

Incident 4693 Report
Automated Adult Content Detection Tools Showed Bias against Women Bodies

2006-02-25

Automated content moderation tools to detect sexual explicitness or "raciness" reportedly exhibited bias against women bodies, resulting in suppression of reach despite not breaking platform policies.

More

Incident 7782 Report
Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries

2024-09-04

Amazon's Alexa was found to provide politically biased responses when asked about the 2024 presidential candidates. It refused to give reasons to vote for Donald Trump, citing neutrality, while offering detailed endorsements for Kamala Harris. Amazon labeled the discrepancy an "error" and reportedly corrected it.

More

Incidents involved as Deployer

Incident 3954 Report
Amazon Forced Deployment of AI-Powered Cameras on Delivery Drivers

2021-03-02

Amazon delivery drivers were forced to consent to algorithmic collection and processing of their location, movement, and biometric data through AI-powered cameras, or be dismissed.

More

Incident 1162 Report
Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make

2021-09-20

Amazon's automated performance evaluation system involving AI-powered cameras incorrectly punished delivery drivers for non-existent mistakes, impacting their chances for bonuses and rewards.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Warehouse Workers

Incidents Harmed By
  • Incident 2
    17 Reports

    Warehouse robot ruptures can of bear spray and injures workers

More
Entity

Amazon Customers

Incidents Harmed By
  • Incident 15
    24 Reports

    Amazon Censors Gay Books

  • Incident 625
    5 Reports

    Proliferation of Products on Amazon Titled with ChatGPT Error Messages

More
Entity

female applicants

Incidents Harmed By
  • Incident 37
    33 Reports

    Female Applicants Down-Ranked by Amazon Recruiting Tool

More
Entity

Oliver Haberstroh

Incidents Harmed By
  • Incident 33
    4 Reports

    Amazon Alexa Plays Loud Music when Owner is Away

More
Entity

Neighbors

Incidents Harmed By
  • Incident 33
    4 Reports

    Amazon Alexa Plays Loud Music when Owner is Away

More
Entity

Alexa Device Owners

Incidents Harmed By
  • Incident 34
    35 Reports

    Amazon Alexa Responding to Environmental Inputs

  • Incident 778
    2 Reports

    Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries

Incidents involved as Deployer
  • Incident 778
    2 Reports

    Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries

More
Entity

Children

Incidents Harmed By
  • Incident 55
    16 Reports

    Alexa Plays Pornography Instead of Kids Song

More
Entity

Amazon Flex

Incidents involved as Deployer
  • Incident 111
    5 Reports

    Amazon Flex Drivers Allegedly Fired via Automated Employee Evaluations

More
Entity

Amazon Flex employees

Incidents Harmed By
  • Incident 111
    5 Reports

    Amazon Flex Drivers Allegedly Fired via Automated Employee Evaluations

More
Entity

Amazon Flex drivers

Incidents Harmed By
  • Incident 111
    5 Reports

    Amazon Flex Drivers Allegedly Fired via Automated Employee Evaluations

More
Entity

Netradyne

Incidents involved as Developer
  • Incident 395
    4 Reports

    Amazon Forced Deployment of AI-Powered Cameras on Delivery Drivers

  • Incident 116
    2 Reports

    Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make

More
Entity

Amazon delivery drivers

Incidents Harmed By
  • Incident 395
    4 Reports

    Amazon Forced Deployment of AI-Powered Cameras on Delivery Drivers

  • Incident 116
    2 Reports

    Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make

More
Entity

Amazon workers

Incidents Harmed By
  • Incident 116
    2 Reports

    Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make

  • Incident 157
    1 Report

    Amazon's Monitoring System Allegedly Pushed Delivery Drivers to Prioritize Speed over Safety, Leading to Crash

More
Entity

Rekognition users

Incidents Harmed By
  • Incident 114
    1 Report

    Amazon's Rekognition Falsely Matched Members of Congress to Mugshots

More
Entity

arrested people

Incidents Harmed By
  • Incident 114
    1 Report

    Amazon's Rekognition Falsely Matched Members of Congress to Mugshots

More
Entity

Microsoft

Incidents involved as both Developer and Deployer
  • Incident 102
    2 Reports

    Personal voice assistants struggle with black voices, new study shows

  • Incident 587
    1 Report

    Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias

Incidents involved as Developer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

IBM

Incidents involved as both Developer and Deployer
  • Incident 102
    2 Reports

    Personal voice assistants struggle with black voices, new study shows

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 102
    2 Reports

    Personal voice assistants struggle with black voices, new study shows

  • Incident 587
    1 Report

    Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias

Incidents involved as Developer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Apple

Incidents involved as both Developer and Deployer
  • Incident 102
    2 Reports

    Personal voice assistants struggle with black voices, new study shows

  • Incident 587
    1 Report

    Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias

More
Entity

Black people

Incidents Harmed By
  • Incident 102
    2 Reports

    Personal voice assistants struggle with black voices, new study shows

More
Entity

Amazon fulfillment center workers

Incidents Harmed By
  • Incident 125
    3 Reports

    Amazon’s Robotic Fulfillment Centers Have Higher Serious Injury Rates

More
Entity

Kristin Livdahl's daughter

Incidents Harmed By
  • Incident 160
    3 Reports

    Alexa Recommended Dangerous TikTok Challenge to Ten-Year-Old Girl

More
Entity

Amazon Echo customers

Incidents Harmed By
  • Incident 160
    3 Reports

    Alexa Recommended Dangerous TikTok Challenge to Ten-Year-Old Girl

More
Entity

children using Alexa

Incidents Harmed By
  • Incident 160
    3 Reports

    Alexa Recommended Dangerous TikTok Challenge to Ten-Year-Old Girl

More
Entity

people attempting suicides

Incidents Harmed By
  • Incident 156
    2 Reports

    Amazon Reportedly Sold Products and Recommended Frequently Bought Together Items That Aid Suicide Attempts

More
Entity

small businesses on Amazon

Incidents Harmed By
  • Incident 251
    3 Reports

    Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products

More
Entity

Amazon users

Incidents Harmed By
  • Incident 330
    1 Report

    “Amazon’s Choice” Algorithm Failed to Recommend Functional Products and Prone to Review Manipulation

  • Incident 329
    1 Report

    Amazon Recommended Explosive-Producing Ingredients as “Frequently Bought Together” Items for Chemicals

More
Entity

Danielle's family

Incidents Harmed By
  • Incident 361
    1 Report

    Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact

More
Entity

Amazon Echo users

Incidents Harmed By
  • Incident 361
    1 Report

    Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact

More
Entity

Meta

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

LinkedIn

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Instagram

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Facebook

Incidents involved as Deployer
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

LinkedIn users

Incidents Harmed By
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Instagram users

Incidents Harmed By
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Facebook users

Incidents Harmed By
  • Incident 469
    3 Reports

    Automated Adult Content Detection Tools Showed Bias against Women Bodies

More
Entity

Amazon warehouse workers

Incidents Harmed By
  • Incident 386
    3 Reports

    Amazon’s "Time Off Task" System Made False Assumptions about Workers' Time Management

More
Entity

Uber

Incidents involved as both Developer and Deployer
  • Incident 527
    2 Reports

    Tech Companies Reportedly Influenced Gig Workers' Behaviors Using Algorithms to Vary Pay for Same Amount of Work

More
Entity

Uber drivers

Incidents Harmed By
  • Incident 527
    2 Reports

    Tech Companies Reportedly Influenced Gig Workers' Behaviors Using Algorithms to Vary Pay for Same Amount of Work

More
Entity

gig workers

Incidents Harmed By
  • Incident 527
    2 Reports

    Tech Companies Reportedly Influenced Gig Workers' Behaviors Using Algorithms to Vary Pay for Same Amount of Work

More
Entity

Amazon delivery workers

Incidents Harmed By
  • Incident 527
    2 Reports

    Tech Companies Reportedly Influenced Gig Workers' Behaviors Using Algorithms to Vary Pay for Same Amount of Work

More
Entity

Consumers relying on accurate image categorization

Incidents Harmed By
  • Incident 587
    1 Report

    Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias

More
Entity

members of racial and ethnic minorities who risk being stereotyped or misrepresented

Incidents Harmed By
  • Incident 587
    1 Report

    Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias

More
Entity

Alexa children users

Incidents Harmed By
  • Incident 556
    4 Reports

    Amazon Allegedly Violated Children's Privacy through Default Voice Collection Settings

More
Entity

Amazon sellers

Incidents Harmed By
  • Incident 625
    5 Reports

    Proliferation of Products on Amazon Titled with ChatGPT Error Messages

Incidents involved as Deployer
  • Incident 625
    5 Reports

    Proliferation of Products on Amazon Titled with ChatGPT Error Messages

More
Entity

OpenAI

Incidents involved as Developer
  • Incident 625
    5 Reports

    Proliferation of Products on Amazon Titled with ChatGPT Error Messages

More
Entity

ChatGPT

Incidents involved as Developer
  • Incident 625
    5 Reports

    Proliferation of Products on Amazon Titled with ChatGPT Error Messages

More
Entity

unknown

Incidents involved as both Developer and Deployer
  • Incident 575
    1 Report

    Amazon Rife with Many Allegedly AI-Generated Books of Suspect Quality

More
Entity

Authors

Incidents Harmed By
  • Incident 575
    1 Report

    Amazon Rife with Many Allegedly AI-Generated Books of Suspect Quality

More
Entity

Donald Trump presidential campaign

Incidents Harmed By
  • Incident 778
    2 Reports

    Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries

More
Entity

Donald Trump supporters

Incidents Harmed By
  • Incident 778
    2 Reports

    Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries

More
Entity

General public

Incidents Harmed By
  • Incident 967
    1 Report

    Amazon and Google AI Allegedly Promote Mein Kampf as ‘a True Work of Art’ in Search Results

More
Entity

Google search algorithm

Incidents implicated systems
  • Incident 967
    1 Report

    Amazon and Google AI Allegedly Promote Mein Kampf as ‘a True Work of Art’ in Search Results

More
Entity

Google featured snippets

Incidents implicated systems
  • Incident 967
    1 Report

    Amazon and Google AI Allegedly Promote Mein Kampf as ‘a True Work of Art’ in Search Results

More
Entity

Amazon review summarizer

Incidents implicated systems
  • Incident 967
    1 Report

    Amazon and Google AI Allegedly Promote Mein Kampf as ‘a True Work of Art’ in Search Results

More
Entity

Amazon product review

Incidents implicated systems
  • Incident 967
    1 Report

    Amazon and Google AI Allegedly Promote Mein Kampf as ‘a True Work of Art’ in Search Results

More
Entity

Amazon content moderation systems

Incidents implicated systems
  • Incident 967
    1 Report

    Amazon and Google AI Allegedly Promote Mein Kampf as ‘a True Work of Art’ in Search Results

More
Entity

Google AI overview

Incidents implicated systems
  • Incident 967
    1 Report

    Amazon and Google AI Allegedly Promote Mein Kampf as ‘a True Work of Art’ in Search Results

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba