AI-enabled decision support systems
Incidents implicated systems
インシデント 137545 Report
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
2026-02-10
After the 02/10/2026 school shooting in Tumbler Ridge, British Columbia, OpenAI said a user later identified as the suspect, Jesse Van Rootselaar, had previously used ChatGPT to describe scenarios involving gun violence. Those chats were reportedly auto-flagged and reviewed and the account was banned, but OpenAI says it did not alert the RCMP because it allegedly did not present a credible, imminent threat; the company reportedly contacted police after the attack.
もっとインシデント 3734 Report
Amazon's Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings
2016-08-10
Between 2014 and 2017, Amazon reportedly developed an AI-powered recruiting tool to score job applicants, trained on a decade of resumes purportedly drawn largely from men. Media reports say the system learned to favor male candidates, penalizing terms like "women's" and graduates from certain all-women's colleges. Efforts to remove these biases reportedly did not guarantee fairness, and the project was ultimately abandoned. Amazon reportedly states recruiters never solely relied on the tool.
もっとインシデント 4021 Report
COMPAS Algorithm Reportedly Performs Poorly in Crime Recidivism Prediction
2016-05-23
Correctional Offender Management Profiling for Alternative Sanctions (COMPAS), a recidivism risk-assessment algorithmic tool used in the judicial system to assess likelihood of defendants' recidivism, is found to be less accurate than random untrained human evaluators.
もっとインシデント 60821 Report
UnitedHealth Accused of Deploying Allegedly Flawed AI to Deny Medical Coverage
2023-02-28
UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.
もっと関連団体
同じインシデントに関連するその他のエンティティ。たとえば、インシデントの開発者がこのエンティティで、デプロイヤーが別のエンティティである場合、それらは関連エンティティとしてマークされます。
関連団体
Educational communities
影響を受けたインシデント
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 19512 レポート
Predictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups
Incidents involved as Deployer
Associated machine learning models trained on historical Amazon resume data
Incidents implicated systems
St George’s Hospital Medical School automated admissions screening program
Incidents implicated systems
Law enforcement facial recognition systems
Incidents implicated systems
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
- インシデント 15452 レポート
Florida Police Reportedly Wrongfully Arrested Commercial Crabber Robert Dillon After Allegedly False Facial Recognition Match
Chicago Police Department
開発者と提供者の両方の立場で関わったインシデント
影響を受けたインシデント
Incidents involved as Deployer
ShotSpotter
Incidents involved as Developer
- インシデント 11215 レポート
Police Departments Reported ShotSpotter as Unreliable and Wasteful
- インシデント 2559 レポート
Unreliable ShotSpotter Audio Previously Used to Convict Chicago Man in Murder Case
Incidents implicated systems
University of Texas at Austin's Department of Computer Science
Incidents involved as Deployer
Unknown
影響を受けたインシデント
- インシデント 5172 レポート
Man Arrested For Sock Theft by False Facial Match Despite Alibi
- インシデント 5181 レポート
New York Detective Reportedly Misused Woody Harrelson's Face to Perform Face Recognition Search
Incidents involved as Developer
Optum
Incidents involved as Developer
- インシデント 1247 レポート
Optum Algorithmic Health Risk Scores Reportedly Underestimated Black Patients' Needs
Incidents implicated systems
Microsoft
Incidents involved as Developer
- インシデント 1884 レポート
Argentinian City Government Deployed Teenage-Pregnancy Predictive Algorithm Using Invasive Demographic Data
- インシデント 14002 レポート
West Midlands Police Reportedly Relied on Erroneous Copilot-Generated Intelligence in Maccabi Tel Aviv Away-Fan Ban Decision
Incidents involved as Deployer
Intensive Partnerships for Effective Teaching teacher-evaluation system
Incidents implicated systems
Law enforcement
影響を受けたインシデント
- インシデント 4465 レポート
ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina
- インシデント 11911 レポート
NYPD Facial Recognition System Allegedly Produced Erroneous Match That Reportedly Resulted in Wrongful Detention of Trevis Williams
Incidents involved as Deployer
Clearview AI
Incidents involved as Developer
- インシデント 4406 レポート
Louisiana Police Wrongfully Arrested Black Man Using False Face Match
- インシデント 4124 レポート
Finnish Police Were Reportedly Reprimanded After National Bureau of Investigation Unit Allegedly Used Clearview AI to Identify Potential Abuse Victims
Incidents implicated systems
Turnitin
開発者と提供者の両方の立場で関わったインシデント
Incidents involved as Developer
- インシデント 5721 レポート
University Student Reportedly Received Zero After Turnitin AI Detector Flagged Essay
- インシデント 8491 レポート
AI Detection Tools Allegedly Misidentify Neurodivergent and ESL Students' Work as AI-Generated in Academic Settings
Incidents implicated systems
Chatbot developers
Incidents involved as Developer
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 5385 レポート
Texas A&M-Commerce Professor Reportedly Used ChatGPT to Accuse Students of Cheating and Assign Incomplete Grades
Incidents implicated systems
Large language model developers
Incidents involved as Developer
- インシデント 137545 レポート
OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- インシデント 5385 レポート
Texas A&M-Commerce Professor Reportedly Used ChatGPT to Accuse Students of Cheating and Assign Incomplete Grades
Incidents implicated systems
Black men who underwent lung function tests between 2010 and 2020 and potentially received inaccurate or delayed diagnoses and medical interventions due to the biased algorithm
影響を受けたインシデント
National security and intelligence stakeholders
影響を受けたインシデント
- インシデント 6593 レポート
Purported Mass Facial Recognition Program in Gaza Reportedly Used by Israeli Forces to Identify Palestinians
- インシデント 17011 レポート
AI Chatbot Reportedly Misidentified Chinese Ship Cargo as Nuclear-Program Components, Prompting U.S. Military Interception Preparations
Incidents involved as Deployer
GPTZero
Incidents involved as Developer
- インシデント 8491 レポート
AI Detection Tools Allegedly Misidentify Neurodivergent and ESL Students' Work as AI-Generated in Academic Settings
- インシデント 16321 レポート
Yale Student Suspended and Given F After GPTZero Allegedly Misclassified Exam as AI-Generated
Incidents implicated systems
Wrongfully arrested individuals
影響を受けたインシデント
- インシデント 15452 レポート
Florida Police Reportedly Wrongfully Arrested Commercial Crabber Robert Dillon After Allegedly False Facial Recognition Match
- インシデント 8961 レポート
Alleged Misuse of Facial Recognition Technology by Law Enforcement Reportedly Leading to Wrongful Arrests and Violations of Investigative Standards
Real-time facial recognition alert pipeline to New Orleans Police Department
Incidents implicated systems
Automated person-tracking via clothing and physical descriptors
Incidents implicated systems
Unspecified developer of aerial imagery risk analysis system
Incidents involved as Developer
Department of Government Efficiency (DOGE)
開発者と提供者の両方の立場で関わったインシデント
Incidents involved as Deployer
Omnilert
Incidents involved as Developer
- インシデント 12503 レポート
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
- インシデント 12671 レポート
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation
Incidents implicated systems
United States Customs and Border Protection
Incidents involved as Deployer
- インシデント 13531 レポート
ICE Facial Recognition App Mobile Fortify Reportedly Misidentified Woman Twice During Immigration Enforcement in Oregon
- インシデント 13621 レポート
Border Patrol Agent Allegedly Claimed Facial Recognition Identified Minneapolis ICE Observer and Global Entry Was Reportedly Revoked Three Days Later
United States Department of Homeland Security
Incidents involved as Developer
Incidents involved as Deployer
Mobile Fortify
Incidents implicated systems
- インシデント 13531 レポート
ICE Facial Recognition App Mobile Fortify Reportedly Misidentified Woman Twice During Immigration Enforcement in Oregon
- インシデント 13621 レポート
Border Patrol Agent Allegedly Claimed Facial Recognition Identified Minneapolis ICE Observer and Global Entry Was Reportedly Revoked Three Days Later