Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 77: Knightscope's Park Patrol Robot Ignored Bystander Pressing Emergency Button to Alert Police about Fight

Description: A Knightscope K5 autonomous "police" robot patrolling Huntington Park, California failed to respond to an onlooker who attempted to activate its emergency alert button when a nearby fight broke out.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Knightscope developed and deployed an AI system, which harmed Cogo Guebara and unnamed woman injured in the fight.

Incident Stats

Incident ID
77
Report Count
5
Incident Date
2019-10-04
Editors
Sean McGregor, Khoa Lam
Applied Taxonomies
CSETv0, CSETv1, GMF, MIT

CSETv1 Taxonomy Classifications

Taxonomy Details

Incident Number

The number of the incident in the AI Incident Database.
 

77

CSETv0 Taxonomy Classifications

Taxonomy Details

Problem Nature

Indicates which, if any, of the following types of AI failure describe the incident: "Specification," i.e. the system's behavior did not align with the true intentions of its designer, operator, etc; "Robustness," i.e. the system operated unsafely because of features or changes in its environment, or in the inputs the system received; "Assurance," i.e. the system could not be adequately monitored or controlled during operation.
 

Unknown/unclear

Physical System

Where relevant, indicates whether the AI system(s) was embedded into or tightly associated with specific types of hardware.
 

Vehicle/mobile robot

Level of Autonomy

The degree to which the AI system(s) functions independently from human intervention. "High" means there is no human involved in the system action execution; "Medium" means the system generates a decision and a human oversees the resulting action; "low" means the system generates decision-support output and a human makes a decision and executes an action.
 

High

Nature of End User

"Expert" if users with special training or technical expertise were the ones meant to benefit from the AI system(s)’ operation; "Amateur" if the AI systems were primarily meant to benefit the general public or untrained users.
 

Amateur

Public Sector Deployment

"Yes" if the AI system(s) involved in the accident were being used by the public sector or for the administration of public goods (for example, public transportation). "No" if the system(s) were being used in the private sector or for commercial purposes (for example, a ride-sharing company), on the other.
 

No

Data Inputs

A brief description of the data that the AI system(s) used or were trained on.
 

LIDAR, sonar, video camera, vibration detection, thermal anomaly detection, automatic signal detection, audio

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

7.3. Lack of capability or robustness

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. AI system safety, failures, and limitations

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Incident Reports

Reports Timeline

+2
A RoboCop, a park and a fight: How expectations about robots are clashing with reality
+1
Police robot completely ignores woman begging for help
California’s First Robotic Police Officer Ignored a Woman Reporting a Crime, Then 'Sang her a Song'
A RoboCop, a park and a fight: How expectations about robots are clashing with reality

A RoboCop, a park and a fight: How expectations about robots are clashing with reality

nbcnews.com

Police robot told woman to go away after she tried to report crime – then sang a song

Police robot told woman to go away after she tried to report crime – then sang a song

metro.co.uk

Police robot completely ignores woman begging for help

Police robot completely ignores woman begging for help

lawenforcementtoday.com

Police Robot Ignores Woman's Call for Help in an American Park

Police Robot Ignores Woman's Call for Help in an American Park

interestingengineering.com

California’s First Robotic Police Officer Ignored a Woman Reporting a Crime, Then 'Sang her a Song'

California’s First Robotic Police Officer Ignored a Woman Reporting a Crime, Then 'Sang her a Song'

thesized.com

A RoboCop, a park and a fight: How expectations about robots are clashing with reality
nbcnews.com · 2019

HUNTINGTON PARK, Calif. — When a fight broke out recently in the parking lot of Salt Lake Park, a few miles south of downtown Los Angeles, Cogo Guebara did what seemed the most practical thing at the time: she ran over to the park’s police …

Police robot told woman to go away after she tried to report crime – then sang a song
metro.co.uk · 2019

A police robot told a woman to go away after she tried to report a violent brawl breaking out nearby – then trundled off while singing a song. Cogo Guebara rushed over to the motorized police officer and pushed its emergency alert button on…

Police robot completely ignores woman begging for help
lawenforcementtoday.com · 2019

HUNTINGTON PARK, Calif. – Police officers can’t be everywhere at once. Between budget cuts, staffing issues and an increase in violent crime across the country, cops are in huge demand.

So naturally we turn to technology to help solve the p…

Police Robot Ignores Woman's Call for Help in an American Park
interestingengineering.com · 2019

As our world becomes more and more automated, with robotics taking over many human roles and offering assistance, we have to wonder just how useful some of these inventions truly are.

When you need the police, you still have to call 911

As …

California’s First Robotic Police Officer Ignored a Woman Reporting a Crime, Then 'Sang her a Song'
thesized.com · 2019

Not everybody is a fan of law enforcement. Perhaps this is what inspired the Californian city of Huntington Park to take a more modern approach to police.

A mechanical enforcement officer, dubbed HP Robocop, has been patrolling Salt Lake Pa…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Sleeping Driver on Tesla AutoPilot

Sleeping Driver on Tesla AutoPilot

Dec 2018 · 24 reports
Security Robot Rolls Over Child in Mall

Security Robot Rolls Over Child in Mall

Jul 2016 · 27 reports
Security Robot Drowns Itself in a Fountain

Security Robot Drowns Itself in a Fountain

Jul 2017 · 30 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Sleeping Driver on Tesla AutoPilot

Sleeping Driver on Tesla AutoPilot

Dec 2018 · 24 reports
Security Robot Rolls Over Child in Mall

Security Robot Rolls Over Child in Mall

Jul 2016 · 27 reports
Security Robot Drowns Itself in a Fountain

Security Robot Drowns Itself in a Fountain

Jul 2017 · 30 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 9d70fba