Welcome to the
AI Incident Database

Incident 1016: Jailbroken Lovable AI Allegedly Used to Generate and Host Phishing Pages, Steal Credentials, and Bypass Security

“Lovable AI Found Most Vulnerable to VibeScamming — Enabling Anyone to Build Live Scam Pages”Latest Incident Report

thehackernews.com2025-04-09

Lovable, a generative artificial intelligence (AI) powered platform that allows for creating full-stack web applications using text-based prompts, has been found to be the most susceptible to jailbreak attacks, allowing novice and aspiring…

Incident 1017: Alleged Deepfake Investment Scam in Spain Defrauds 208 Victims of €19 million ($20.9 million)

“Six arrested for AI-powered investment scams that stole $20 million”

bleepingcomputer.com2025-04-09

Spain's police arrested six individuals behind a large-scale cryptocurrency investment scam that used AI tools to generate deepfake ads featuring popular public figures to lure people.

The scam was very successful, defrauding 19 million Eur…

Incident 1018: OpenAI's 4o Model Reportedly Enables Fraudulent Document Generation

“OpenAI's New Image Generator Is Incredible for Creating Fraudulent Documents”

futurism.com2025-04-09

OpenAI's latest image-generating 4o model is surprisingly good at generating text inside images, a feat that had proved particularly difficult for its many predecessors.

And that makes it a powerful tool for generating images of fraudulent …

Incident 1015: Reported Darknet Launch of Xanthorox AI Introduces Autonomous Cyberattack Platform

“Xanthorox AI: A New Breed of Malicious AI Threat Hits the Darknet”

esecurityplanet.com2025-04-08

A new and dangerous AI-powered hacking tool is making waves across the cybercrime underworld --- and experts say it could change the way digital attacks are launched.

Called Xanthorox AI, the tool was first spotted earlier this year on dark…

Incident 1011: Deepfake of Bermuda Premier David Burt Promotes Investment Scam Using Royal Gazette Branding

“Government warns of AI social-media scam”

royalgazette.com2025-04-06

The Government has warned the public about a fake AI-generated video circulating on social media.

The video, which was seen on Facebook, included branding that falsely suggested it was related to a report in The Royal Gazette and featured i…

About the Database

The AI Incident Database is dedicated to indexing the collective history of harms or near harms realized in the real world by the deployment of artificial intelligence systems. Like similar databases in aviation and computer security, the AI Incident Database aims to learn from experience so we can prevent or mitigate bad outcomes.

You are invited to submit incident reports, whereupon submissions will be indexed and made discoverable to the world. Artificial intelligence will only be a benefit to people and society if we collectively record and learn from its failings. (Learn More)

Cluster Analysis of AI Incident Journalism

By Sherry Chen, Steven Shen, and Shyam Sivasubramanian

2024-07-22

This blog post is a contributed by Sherry, Steven, an Shyam, students at The George Washington University School of Business who analyzed th...

The Database in Print

Read about the database on the PAI Blog, Vice News, Venture Beat, Wired, arXiv , and Newsweek among other outlets.

Incident Report Submission Leaderboards

These are the persons and entities credited with creating and submitted incident reports. More details are available on the leaderboard page.

New Incidents Contributed

Reports added to Existing Incidents

Total Report Contributions

The AI Incident Briefing

An envelope with a neural net diagram on its left

Create an account to subscribe to new incident notifications and other updates.

Random Incidents

Predictive Policing Biases of PredPol

Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates

ChatGPT Introduces Errors in Critical Child Protection Court Report

Child Sexual Abuse Material Taints Image Generators

ChatGPT Reportedly Produced False Court Case Law Presented by Legal Counsel in Court

The Responsible AI Collaborative

The AI Incident Database is a project of the Responsible AI Collaborative, an organization chartered to advance the AI Incident Database. The governance of the Collaborative is architected around the participation in its impact programming. For more details, we invite you to read the founding report and learn more on our board and contributors.

View the Responsible AI Collaborative's Form 990 and tax-exempt application.