Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 151: California Regulator Suspended Pony.ai's Driverless Testing Permit Following a Non-Fatal Collision

Description: A Pony.ai vehicle operating in autonomous mode crashed into a center divider and a traffic sign in San Francisco, prompting a regulator to suspend the driverless testing permit for the startup.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Pony.ai developed and deployed an AI system, which harmed San Francisco city government.

Incident Stats

Incident ID
151
Report Count
10
Incident Date
2021-10-28
Editors
Sean McGregor, Khoa Lam
Applied Taxonomies
GMF, CSETv1, MIT

CSETv1 Taxonomy Classifications

Taxonomy Details

Incident Number

The number of the incident in the AI Incident Database.
 

151

Special Interest Intangible Harm

An assessment of whether a special interest intangible harm occurred. This assessment does not consider the context of the intangible harm, if an AI was involved, or if there is characterizable class or subgroup of harmed entities. It is also not assessing if an intangible harm occurred. It is only asking if a special interest intangible harm occurred.
 

no

Date of Incident Year

The year in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the year, estimate. Otherwise, leave blank. Enter in the format of YYYY
 

2021

Date of Incident Month

The month in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the month, estimate. Otherwise, leave blank. Enter in the format of MM
 

10

Date of Incident Day

The day on which the incident occurred. If a precise date is unavailable, leave blank. Enter in the format of DD
 

28

Estimated Date

“Yes” if the data was estimated. “No” otherwise.
 

No

GMF Taxonomy Classifications

Taxonomy Details

Known AI Goal Snippets

One or more snippets that justify the classification.
 

(Snippet Text: On October 28, 2021, after turning right onto Fremont Blvd from Cushing Pkwy, the Pony.ai Autonomous Vehicle ("Pony.ai AV") performed a left lane change maneuver in autonomous mode. , Related Classifications: Autonomous Driving)

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

7.3. Lack of capability or robustness

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. AI system safety, failures, and limitations

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Incident Reports

Reports Timeline

Incident OccurrenceReport of Traffic Collision Involving an Autonomous Vehicle+5
California suspends Pony.ai's driverless testing after accident
At-Fault Robotaxi Accidents For Waymo, Pony.AI, Olli And What They Mean For The Future+1
Startup Pony.ai agrees to automated driving software recall
Report of Traffic Collision Involving an Autonomous Vehicle

Report of Traffic Collision Involving an Autonomous Vehicle

dmv.ca.gov

California suspends Pony.ai's driverless testing after accident

California suspends Pony.ai's driverless testing after accident

therobotreport.com

California suspends Toyota-backed Pony.ai's driverless testing permit

California suspends Toyota-backed Pony.ai's driverless testing permit

engadget.com

Pony.ai’s permit to test driverless vehicles in California is suspended after crash

Pony.ai’s permit to test driverless vehicles in California is suspended after crash

theverge.com

California DMV Suspends Pony.ai Driverless Testing Permit After Small Crash

California DMV Suspends Pony.ai Driverless Testing Permit After Small Crash

autoevolution.com

California suspends Pony.ai driverless test permit after crash

California suspends Pony.ai driverless test permit after crash

techcrunch.com

California halts Pony.ai's driverless testing permit after accident

California halts Pony.ai's driverless testing permit after accident

reuters.com

At-Fault Robotaxi Accidents For Waymo, Pony.AI, Olli And What They Mean For The Future

At-Fault Robotaxi Accidents For Waymo, Pony.AI, Olli And What They Mean For The Future

forbes.com

Startup Pony.ai agrees to automated driving software recall

Startup Pony.ai agrees to automated driving software recall

reuters.com

Pony.ai to issue recall of autonomous driving software

Pony.ai to issue recall of autonomous driving software

techcrunch.com

Report of Traffic Collision Involving an Autonomous Vehicle
dmv.ca.gov · 2021

On October 28, 2021, after turning right onto Fremont Blvd from Cushing Pkwy, the Pony.ai Autonomous Vehicle ("Pony.ai AV") performed a left lane change maneuver in autonomous mode. While performing the lane change, the Pony.ai AV came into…

California suspends Pony.ai's driverless testing after accident
therobotreport.com · 2021

Following an accident on October 28, 2021 while operating a vehicle in autonomous mode, Pony.ai‘s driverless testing permit has been suspended by the California Department of Motor Vehicles (DMV). This is the first time the state of Califor…

California suspends Toyota-backed Pony.ai's driverless testing permit
engadget.com · 2021

Pony.ai, a Chinese autonomous driving company backed by Toyota, can no longer test fully self driving vehicles in California, for now at least. According to Reuters, the DMV suspended its driverless testing permit on November 19th, a few we…

Pony.ai’s permit to test driverless vehicles in California is suspended after crash
theverge.com · 2021

One of the company’s AVs collided with a center divider in October.

Pony.ai, an autonomous vehicle startup based in Silicon Valley and Guangzhou, China, is temporarily unable to test driverless vehicles in California after a vehicle crash l…

California DMV Suspends Pony.ai Driverless Testing Permit After Small Crash
autoevolution.com · 2021

Founded in 2015 by two former Baidu developers, Pony.ai is the first company to test driverless vehicles on public roads in both the United States and China. After getting approval to test autonomous vehicles in California in May 2021, the …

California suspends Pony.ai driverless test permit after crash
techcrunch.com · 2021

Pony.ai, a Chinese autonomous driving startup with an office in the U.S., has paused its driverless pilot fleet in California six months after it was approved by local regulators to test autonomous vehicles without a human safety driver.

On…

California halts Pony.ai's driverless testing permit after accident
reuters.com · 2021

SAN FRANCISCO, Dec 13 (Reuters) - A California regulator on Monday said it has suspended a driverless testing permit for startup technology firm Pony.ai following an accident - the first time it has issued such a suspension.

On Oct. 28, a P…

At-Fault Robotaxi Accidents For Waymo, Pony.AI, Olli And What They Mean For The Future
forbes.com · 2021

Three different robotaxi-related accidents at the end of this year raise some interesting issues about what they mean going forward. This includes a serious injury accident when an Olli shuttle near Toronto ran off the road, the loss of Pon…

Startup Pony.ai agrees to automated driving software recall
reuters.com · 2022

WASHINGTON, March 8 (Reuters) - Startup technology firm Pony.ai agreed to issue a recall for some versions of its autonomous driving system software after an October crash in California, U.S. regulators said on Tuesday.

The recall covers th…

Pony.ai to issue recall of autonomous driving software
techcrunch.com · 2022

Autonomous vehicle startup Pony.ai will issue a recall for three vehicles following an October crash in California, according to the National Highway Traffic and Safety Administration (NHTSA).

The agency said on Tuesday that this was the fi…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

A Collection of Tesla Autopilot-Involved Crashes

A Collection of Tesla Autopilot-Involved Crashes

Jun 2016 · 22 reports
Uber Autonomous Cars Running Red Lights

Uber Autonomous Cars Running Red Lights

Aug 2014 · 10 reports
Google admits its self driving car got it wrong: Bus crash was caused by software

Google admits its self driving car got it wrong: Bus crash was caused by software

Sep 2016 · 28 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

A Collection of Tesla Autopilot-Involved Crashes

A Collection of Tesla Autopilot-Involved Crashes

Jun 2016 · 22 reports
Uber Autonomous Cars Running Red Lights

Uber Autonomous Cars Running Red Lights

Aug 2014 · 10 reports
Google admits its self driving car got it wrong: Bus crash was caused by software

Google admits its self driving car got it wrong: Bus crash was caused by software

Sep 2016 · 28 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 30ebe76