Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 71: Google admits its self driving car got it wrong: Bus crash was caused by software

Description: On February 14, 2016, a Google autonomous test vehicle partially responsible for a low-speed collision with a bus on El Camino Real in Google’s hometown of Mountain View, CA.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Google developed and deployed an AI system, which harmed Mountain View municipal bus passengers and Mountain View municipal bus.

Incident Stats

Incident ID
71
Report Count
28
Incident Date
2016-09-26
Editors
Sean McGregor, Khoa Lam
Applied Taxonomies
CSETv0, CSETv1, GMF, MIT

CSETv1 Taxonomy Classifications

Taxonomy Details

Incident Number

The number of the incident in the AI Incident Database.
 

71

AI Tangible Harm Level Notes

Notes about the AI tangible harm level assessment
 

A Google driverless car collided with a bus

Special Interest Intangible Harm

An assessment of whether a special interest intangible harm occurred. This assessment does not consider the context of the intangible harm, if an AI was involved, or if there is characterizable class or subgroup of harmed entities. It is also not assessing if an intangible harm occurred. It is only asking if a special interest intangible harm occurred.
 

no

Date of Incident Year

The year in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the year, estimate. Otherwise, leave blank. Enter in the format of YYYY
 

2014

Date of Incident Month

The month in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the month, estimate. Otherwise, leave blank. Enter in the format of MM
 

10

Date of Incident Day

The day on which the incident occurred. If a precise date is unavailable, leave blank. Enter in the format of DD
 

CSETv0 Taxonomy Classifications

Taxonomy Details

Problem Nature

Indicates which, if any, of the following types of AI failure describe the incident: "Specification," i.e. the system's behavior did not align with the true intentions of its designer, operator, etc; "Robustness," i.e. the system operated unsafely because of features or changes in its environment, or in the inputs the system received; "Assurance," i.e. the system could not be adequately monitored or controlled during operation.
 

Robustness

Physical System

Where relevant, indicates whether the AI system(s) was embedded into or tightly associated with specific types of hardware.
 

Vehicle/mobile robot

Level of Autonomy

The degree to which the AI system(s) functions independently from human intervention. "High" means there is no human involved in the system action execution; "Medium" means the system generates a decision and a human oversees the resulting action; "low" means the system generates decision-support output and a human makes a decision and executes an action.
 

High

Nature of End User

"Expert" if users with special training or technical expertise were the ones meant to benefit from the AI system(s)’ operation; "Amateur" if the AI systems were primarily meant to benefit the general public or untrained users.
 

Amateur

Public Sector Deployment

"Yes" if the AI system(s) involved in the accident were being used by the public sector or for the administration of public goods (for example, public transportation). "No" if the system(s) were being used in the private sector or for commercial purposes (for example, a ride-sharing company), on the other.
 

No

Data Inputs

A brief description of the data that the AI system(s) used or were trained on.
 

traffic patterns, radar, LIDAR, video camera footage

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

7.3. Lack of capability or robustness

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. AI system safety, failures, and limitations

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Incident Reports

Reports Timeline

Apple Lexus RX 450h self-driving test car rear-ended during road testing in Silicon Valley+16
Google self-driving car crashes into a bus (update: statement)
+9
Who's Responsible When a Self-Driving Car Crashes?
Humans were to blame in Google self-driving car crash, police say
Apple Lexus RX 450h self-driving test car rear-ended during road testing in Silicon Valley

Apple Lexus RX 450h self-driving test car rear-ended during road testing in Silicon Valley

abc.net.au

Google self-driving car crashes into a bus (update: statement)

Google self-driving car crashes into a bus (update: statement)

engadget.com

Google's Self-Driving Car Hit Another Vehicle for the First Time

Google's Self-Driving Car Hit Another Vehicle for the First Time

recode.net

Google driverless car hits bus in California

Google driverless car hits bus in California

telegraph.co.uk

Google's self-driving car caused an accident, so what now?

Google's self-driving car caused an accident, so what now?

cnbc.com

Google self-driving car hits a bus

Google self-driving car hits a bus

bbc.com

Google car hits bus, first time at fault

Google car hits bus, first time at fault

usatoday.com

Google’s Self-Driving Car Probably Caused Its First Accident

Google’s Self-Driving Car Probably Caused Its First Accident

technologyreview.com

Can Google’s Driverless Car Project Survive a Fatal Accident?

Can Google’s Driverless Car Project Survive a Fatal Accident?

theatlantic.com

Google accepts blame for its self-driving car causing crash

Google accepts blame for its self-driving car causing crash

newscientist.com

Google self-driving car crashes into bus and company admits it is 'partially' responsible

Google self-driving car crashes into bus and company admits it is 'partially' responsible

independent.co.uk

Google self-driving car hits public bus near Mountain View headquarters

Google self-driving car hits public bus near Mountain View headquarters

mercurynews.com

Google Self-Driving Car Crashes Into Bus

Google Self-Driving Car Crashes Into Bus

learningenglish.voanews.com

Google Driverless Car Sideswipes Bus, Gets Caught On Video

Google Driverless Car Sideswipes Bus, Gets Caught On Video

huffingtonpost.ca

Google self-driving car caught on video colliding with bus

Google self-driving car caught on video colliding with bus

theguardian.com

Watch Google’s Self-Driving Lexus Crash Into a California Bus

Watch Google’s Self-Driving Lexus Crash Into a California Bus

inverse.com

Video shows Google self-driving car hit a bus

Video shows Google self-driving car hit a bus

cbsnews.com

Google admits its self driving car got it wrong: Bus crash was caused by software

Google admits its self driving car got it wrong: Bus crash was caused by software

dailymail.co.uk

Who's Responsible When a Self-Driving Car Crashes?

Who's Responsible When a Self-Driving Car Crashes?

scientificamerican.com

Google self-driving car badly damaged in accident but wasn't at fault

Google self-driving car badly damaged in accident but wasn't at fault

autoblog.com

Google's self-driving car is the victim in a serious crash

Google's self-driving car is the victim in a serious crash

engadget.com

Google self-driving car crash in US

Google self-driving car crash in US

newshub.co.nz

Google's self-driving car involved in serious crash after van jumps a red light

Google's self-driving car involved in serious crash after van jumps a red light

telegraph.co.uk

Google self-driving car gets bashed up in its worst crash yet

Google self-driving car gets bashed up in its worst crash yet

digitaltrends.com

Google autonomous SUV involved in serious crash after a van runs red light in Mountain View

Google autonomous SUV involved in serious crash after a van runs red light in Mountain View

bizjournals.com

Google's self-driving car in broadside collision after other car jumps red light

Google's self-driving car in broadside collision after other car jumps red light

theguardian.com

Google’s self-driving car has been involved in its worst crash yet

Google’s self-driving car has been involved in its worst crash yet

thenextweb.com

Humans were to blame in Google self-driving car crash, police say

Humans were to blame in Google self-driving car crash, police say

fastcompany.com

Apple Lexus RX 450h self-driving test car rear-ended during road testing in Silicon Valley
abc.net.au · 2008

Apple Lexus RX 450h self-driving test car rear-ended during road testing in Silicon Valley

Updated

An Apple Inc self-driving car was rear-ended while merging onto an expressway near the company's Silicon Valley headquarters this month, the …

Google self-driving car crashes into a bus (update: statement)
engadget.com · 2016

This was a minor incident, and we're happy to report that there were no injuries. However, this might be the first instance where one of Google's self-driving cars caused an accident. If so, the Mountain View crew can no longer say it's an …

Google's Self-Driving Car Hit Another Vehicle for the First Time
recode.net · 2016

Since Google’s robot cars have been on the road, they have been involved with 17 different accidents. But in those incidents, Google’s car wasn’t to blame — another car struck Google’s or the test driver behind the autonomous vehicle was at…

Google driverless car hits bus in California
telegraph.co.uk · 2016

Google said on Monday it bore "some responsibility" after one of its self-driving cars struck a bus in a minor crash earlier this month.

The accident may be the first case of one of its autonomous cars hitting another vehicle and the fault …

Google's self-driving car caused an accident, so what now?
cnbc.com · 2016

The accident report Google filed with the California Department of Motor Vehicles described the crash as, "The Google AV test driver saw the bus approaching in the left-side mirror but believed the bus would stop or slow to allow the Google…

Google self-driving car hits a bus
bbc.com · 2016

Image copyright AP Image caption Google cars have clocked up over one million miles on public roads

One of Google's self-driving cars crashed into a bus in California earlier this month. There were no injuries.

It is not the first time one …

Google car hits bus, first time at fault
usatoday.com · 2016

CLOSE A self-driving Lexus SUV owned by Google's parent company Alphabet struck a bus February 14 while it was testing on the streets of Mountain View, Calif. Wochit

A Google-owned Lexus SUV packed with autonomous car sensors had its first …

Google’s Self-Driving Car Probably Caused Its First Accident
technologyreview.com · 2016

One of Google’s self-driving cars hit a bus, and if it is found to be at fault—which is looking probable—it will be the first time one of the company’s autonomous vehicles has been responsible for an accident on the road.

According to this …

Can Google’s Driverless Car Project Survive a Fatal Accident?
theatlantic.com · 2016

There’s still something that might, though.

I’ve interviewed dozens of computer scientists, artificial-intelligence researchers, engineers, and other thinkers focused on self-driving cars in the past several months, and almost all of them b…

Google accepts blame for its self-driving car causing crash
newscientist.com · 2016

AP/Press Association Images/Tony Avelar

On 14 February, the AI in charge of one of Google’s cars drove into the side of a bus. The incident – which California’s Department of Motor Vehicles documented publicly yesterday – is the first clear…

Google self-driving car crashes into bus and company admits it is 'partially' responsible
independent.co.uk · 2016

A Google driverless car has been involved in an accident with a bus and Google has said it “bears some responsibility” for the first time.

The company admitted that it was partially responsible for the minor collision, which happened earlie…

Google self-driving car hits public bus near Mountain View headquarters
mercurynews.com · 2016

MOUNTAIN VIEW — A Google self-driving car has for the first time caused a crash, pulling into traffic and sideswiping a public bus.

No one was injured in the minor fender bender, but Google has adjusted the software for its fleet of autonom…

Google Self-Driving Car Crashes Into Bus
learningenglish.voanews.com · 2016

Google’s self-driving car hit a small bump in the road.

The driverless car had an accident February 14 in California. The accident was reported to the Department of Motor Vehicles in California February 23.

According to WIRED, a technology …

Google Driverless Car Sideswipes Bus, Gets Caught On Video
huffingtonpost.ca · 2016

LOS ANGELES -- Newly released video shows the moment a Google self-driving car learned the hard way not to tussle with a public bus.

The collision happened on Valentine's Day, when a Google vehicle struck the side of a public bus in the Sil…

Google self-driving car caught on video colliding with bus
theguardian.com · 2016

Newly released video shows the moment a Google self-driving car learned the hard way not to tussle with a public bus.

The collision happened on Valentine’s Day 2016, when a Google vehicle struck the side of a public bus in the Silicon Valle…

Watch Google’s Self-Driving Lexus Crash Into a California Bus
inverse.com · 2016

On Valentine’s Day, the inevitable happened to Google as one of its self-driving Lexuses was involved in a low-speed crash with a city bus, and thanks to video obtained via a Freedom of Information Act request, we can see what that crash lo…

Video shows Google self-driving car hit a bus
cbsnews.com · 2016

LOS ANGELES -- Newly released video shows the moment a Google self-driving car learned the hard way not to tussle with a public bus.

The collision happened on Valentine's Day, when a Google vehicle struck the side of a public bus in the Sil…

Google admits its self driving car got it wrong: Bus crash was caused by software
dailymail.co.uk · 2016

Google has revealed that its self driving car hit a bus because it made an incorrect assumption about where it would go.

The firm admitted the crash would not be its last - while humans were allowed on the roads.

'Our car was making an assu…

Who's Responsible When a Self-Driving Car Crashes?
scientificamerican.com · 2016

Valentine's Day was a bummer in Mountain View, Calif. For the first time, one of Google's self-driving cars, a modified Lexus SUV, caused a crash. Detecting a pile of sandbags surrounding a storm drain in its path, the car moved into the ce…

Google self-driving car badly damaged in accident but wasn't at fault
autoblog.com · 2016

A self-driving Lexus RX 450h hybrid sport utility vehicle owned and operated by Google was involved in an accident in Mountain View, California, on Friday afternoon. Nobody was injured, though there was an occupant inside the Lexus at the t…

Google's self-driving car is the victim in a serious crash
engadget.com · 2016

Google will likely shed full detail on the collision in its self-driving car report due at the end of the month. It makes no bones about what happened in a statement, though (see below). The Lexus didn't enter the intersection until "at lea…

Google self-driving car crash in US
newshub.co.nz · 2016

A Google self-driving car was filmed being towed away after a crash with another vehicle in Mountain View, California on Friday (local time).

Although the collision left a Lexus SUV badly damaged, nobody was hospitalised - but a Google spok…

Google's self-driving car involved in serious crash after van jumps a red light
telegraph.co.uk · 2016

One of Google's self-driving cars has been involved in the project's most serious crash to date.

The autonomous Lexus car was taken off the road after a human-controlled van went through a red traffic light and collided with the Google vehi…

Google self-driving car gets bashed up in its worst crash yet
digitaltrends.com · 2016

As Google and others make steady progress toward perfecting their respective self-driving technologies, one of the ongoing challenges is how to deal with the sudden careless actions of drivers in regular vehicles. After all, the switch to s…

Google autonomous SUV involved in serious crash after a van runs red light in Mountain View
bizjournals.com · 2016

A Lexus SUV with Google’s self-driving technology was involved in a serious crash on Friday after a human-operated vehicle ran a red light in Mountain View.

Video obtained by 9to5Google shows the Google-owned vehicle crossing the intersecti…

Google's self-driving car in broadside collision after other car jumps red light
theguardian.com · 2016

Autonomous Lexus SUV could not prevent accident that caved in front and rear passenger-side doors, setting off airbags and forcing it to be towed away

One of Google’s self-driving cars was involved in one of the worst autonomous vehicle acc…

Google’s self-driving car has been involved in its worst crash yet
thenextweb.com · 2016

Google has confirmed that one of its self-driving vehicles sustained significant damage in a traffic accident involving a commercial van on Friday, September 23.

The collision took place at the corner of W El Camino Real and Calderon Ave in…

Humans were to blame in Google self-driving car crash, police say
fastcompany.com · 2018

An autonomous car being tested by Google-owned Waymo was involved in a serious collision in the Phoenix, Arizona suburb of Chandler, when a car being driven by a human swerved to avoid another car, and left the human operator in the Waymo w…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

A Collection of Tesla Autopilot-Involved Crashes

A Collection of Tesla Autopilot-Involved Crashes

Jun 2016 · 22 reports
Uber Autonomous Cars Running Red Lights

Uber Autonomous Cars Running Red Lights

Aug 2014 · 10 reports
Uber AV Killed Pedestrian in Arizona

Uber AV Killed Pedestrian in Arizona

Mar 2018 · 25 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

A Collection of Tesla Autopilot-Involved Crashes

A Collection of Tesla Autopilot-Involved Crashes

Jun 2016 · 22 reports
Uber Autonomous Cars Running Red Lights

Uber Autonomous Cars Running Red Lights

Aug 2014 · 10 reports
Uber AV Killed Pedestrian in Arizona

Uber AV Killed Pedestrian in Arizona

Mar 2018 · 25 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 30ebe76