Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 433: Chicago Police's Strategic Subject List Reportedly Biased Along Racial Lines

Description: Chicago Police Department (CPD)'s Strategic Subject List as output of an algorithm purportedly to identify victims or perpetrators of violence was reportedly ineffective, easily abused, and biased against low-income communities of color.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Chicago Police Department developed and deployed an AI system, which harmed low-income communities , communities of color and Black Chicago residents.

Incident Stats

Incident ID
433
Report Count
10
Incident Date
2012-08-01
Editors
Khoa Lam
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.1. Unfair discrimination and misrepresentation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

Incident Reports

Reports Timeline

Incident OccurrencePolice data could be labelling 'suspects' for crimes they have not committed+3
Study Casts Doubt on Chicago Police’s Secretive “Heat List”
+1
Predictive policing violates more than it protects: Column
Inside the Algorithm That Tries to Predict Gun Violence in ChicagoThe Contradictions of Chicago Police's Secretive ListCPD decommissions ‘Strategic Subject List’
Police data could be labelling 'suspects' for crimes they have not committed

Police data could be labelling 'suspects' for crimes they have not committed

theguardian.com

Study Casts Doubt on Chicago Police’s Secretive “Heat List”

Study Casts Doubt on Chicago Police’s Secretive “Heat List”

chicagomag.com

Chicago’s predictive policing tool just failed a major test

Chicago’s predictive policing tool just failed a major test

theverge.com

To predict and serve?

To predict and serve?

rss.onlinelibrary.wiley.com

Pitfalls of Predictive Policing

Pitfalls of Predictive Policing

rand.org

Predictive policing violates more than it protects: Column

Predictive policing violates more than it protects: Column

usatoday.com

Predictive Policing Is Not as Predictive As You Think

Predictive Policing Is Not as Predictive As You Think

cfr.org

Inside the Algorithm That Tries to Predict Gun Violence in Chicago

Inside the Algorithm That Tries to Predict Gun Violence in Chicago

nytimes.com

The Contradictions of Chicago Police's Secretive List

The Contradictions of Chicago Police's Secretive List

chicagomag.com

CPD decommissions ‘Strategic Subject List’

CPD decommissions ‘Strategic Subject List’

chicago.suntimes.com

Police data could be labelling 'suspects' for crimes they have not committed
theguardian.com · 2016

A police officer stands at the corner of a busy intersection, scanning the crowd with her body camera. The feed is live-streamed into the Real Time Crime Center at department headquarters, where specialized software uses biometric recogniti…

Study Casts Doubt on Chicago Police’s Secretive “Heat List”
chicagomag.com · 2016

For the last four years, the Chicago Police Department has kept a list of people they believe are most likely to be involved in a shooting. The list—known as the "heat list" or the Strategic Subject List—was developed using a secret algorit…

Chicago’s predictive policing tool just failed a major test
theverge.com · 2016

Struggling to reduce its high murder rate, the city of Chicago has become an incubator for experimental policing techniques. Community policing, stop and frisk, "interruption" tactics — the city has tried many strategies. Perhaps most contr…

To predict and serve?
rss.onlinelibrary.wiley.com · 2016

In late 2013, Robert McDaniel – a 22-year-old black man who lives on the South Side of Chicago – received an unannounced visit by a Chicago Police Department commander to warn him not to commit any further crimes. The visit took McDaniel by…

Pitfalls of Predictive Policing
rand.org · 2016

Consider it the real-life "Minority Report": Chicago police say they're successfully using big data to predict who will get shot — and who will do the shooting. But life is more complicated than the movies. The statistics that police tout t…

Predictive policing violates more than it protects: Column
usatoday.com · 2016

From Los Angeles to New York, there is a quiet revolution underway within police departments across the country.

Just as major tech companies and political campaigns have leveraged data to target potential customers or voters, police depart…

Predictive Policing Is Not as Predictive As You Think
cfr.org · 2017

The problem of policing has always been that it's after-the-fact. If law enforcement officers could be at the right place at the right time, crime could be prevented, lives could be saved, and society would surely be safer. In recent years,…

Inside the Algorithm That Tries to Predict Gun Violence in Chicago
nytimes.com · 2017

Gun violence in Chicago has surged since late 2015, and much of the news media attention on how the city plans to address this problem has focused on the Strategic Subject List, or S.S.L.

The list is made by an algorithm that tries to predi…

The Contradictions of Chicago Police's Secretive List
chicagomag.com · 2017

Chicago is a leader in using predictive policing, the use of data and algorithms to inform its overall strategy and on-the-ground decision making. One such tool that’s been used since 2012 is the Strategic Subject List, a computer model tha…

CPD decommissions ‘Strategic Subject List’
chicago.suntimes.com · 2020

The Chicago Police Department’s “Strategic Subject List” was quietly put out to pasture in November, according to the Office of the Inspector General, which had raised several issues regarding the program’s efficacy.

After 10 years, the Chi…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Police Departments Reported ShotSpotter as Unreliable and Wasteful

Police Departments Reported ShotSpotter as Unreliable and Wasteful

Oct 2012 · 15 reports
Predictive Policing Biases of PredPol

Predictive Policing Biases of PredPol

Nov 2015 · 17 reports
Predictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups

Predictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups

Sep 2015 · 12 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Police Departments Reported ShotSpotter as Unreliable and Wasteful

Police Departments Reported ShotSpotter as Unreliable and Wasteful

Oct 2012 · 15 reports
Predictive Policing Biases of PredPol

Predictive Policing Biases of PredPol

Nov 2015 · 17 reports
Predictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups

Predictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups

Sep 2015 · 12 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 30ebe76