Incident 1019: "Jewish Baby Strollers" Provided Anti-Semitic Google Images, Allegedly Resulting from Hate Speech Campaign

Description: Google's Image search for "Jewish baby strollers" showed offensive, anti-Semitic results, allegedly a result of a coordinated hate-speech campaign involving malicious actors on 4chan.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Google developed and deployed an AI system, which harmed Jewish people and Google Images users.

Incident Stats

Incident ID
1019
Report Count
2
Incident Date
2017-08-15
Editors
Sean McGregor, Khoa Lam
Applied Taxonomies
CSETv0, CSETv1, GMF, MIT

CSETv1 Taxonomy Classifications

Taxonomy Details

Incident Number

88

Special Interest Intangible Harm

yes

CSETv0 Taxonomy Classifications

Taxonomy Details

Problem Nature

Robustness, Assurance

Physical System

Software only

Level of Autonomy

High

Nature of End User

Amateur

Public Sector Deployment

No

Data Inputs

images, tags, appended texts, user input

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

1.2. Exposure to toxic content

Risk Domain

  1. Discrimination and Toxicity

Entity

Human

Timing

Post-deployment

Intent

Intentional

A Google search for ‘Jewish baby strollers’ yields anti-Semitic images. An extremist campaign may be to blame.
jta.org · 2020

(JTA) — The Google results are shocking: Do an image search for “Jewish baby strollers” and you’ll see row upon row of portable ovens — an offensive allusion to the Holocaust.

Google says it’s looking into the search results and wants to im…

Jewish Baby Stroller Image Algorithm
timebulletin.com · 2020

The anti-Semitic movement has been on the rise coordinated by an online group named ‘raid’. They operate by manipulating the google image search engine results by attaching abusive images tagged with innocent keywords which in turn, shows t…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story

· 12 reports
Biased Google Image Results

Biased Google Image Results

· 18 reports
Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

· 2 reports
Previous Incident