Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

internet users

Incidents Harmed By

Incident 44325 Report
ChatGPT Abused to Develop Malicious Softwares

2022-12-21

OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.

More

Incident 5613 Report
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

2019-03-11

OpenAI's products such as ChatGPT and DALL-E were alleged in a lawsuit using stolen private information from internet users without their informed consent or knowledge.

More

Incident 7362 Report
Underground Market for LLMs Powers Malware and Phishing Scams

2023-12-01

A study by Indiana University researchers uncovered widespread misuse of large language models (LLMs) for cybercrime. Cybercriminals, according to that study, use LLMs like OpenAI's GPT-3.5 and GPT-4 to create malware, phishing scams, and scam websites. These models are available on underground markets, often bypassing safety checks through jailbreaking. Named malicious LLMs are BadGPT, XXXGPT, Evil-GPT, WormGPT, FraudGPT, BLACKHATGPT, EscapeGPT, DarkGPT, and WolfGPT.

More

Incident 1091 Report
PimEyes's Facial Recognition AI Allegedly Lacked Safeguards to Prevent Itself from Being Abused

2017-01-01

PimEyes offered its subscription-based AI service to anyone in the public to search for matching facial images across the internet, which critics said lacked public oversight and government rules to prevent itself from misuse such as stalking women.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

PimEyes

Incidents involved as both Developer and Deployer
  • Incident 109
    1 Report

    PimEyes's Facial Recognition AI Allegedly Lacked Safeguards to Prevent Itself from Being Abused

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 443
    25 Reports

    ChatGPT Abused to Develop Malicious Softwares

  • Incident 561
    3 Reports

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Incidents involved as Developer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

Oracle

Incidents involved as both Developer and Deployer
  • Incident 387
    1 Report

    Oracle's Algorithmic Data Processing System Alleged as Unlawful and Violating Privacy Rights

More
Entity

Children

Incidents Harmed By
  • Incident 561
    3 Reports

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

More
Entity

social media users

Incidents Harmed By
  • Incident 561
    3 Reports

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

More
Entity

Cybercriminals

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

BadGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

XXXGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

Evil-GPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

WormGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

FraudGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

BLACKHATGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

EscapeGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

DarkGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

WolfGPT

Incidents involved as Deployer
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

Organizations

Incidents Harmed By
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More
Entity

Individuals targeted by malware

Incidents Harmed By
  • Incident 736
    2 Reports

    Underground Market for LLMs Powers Malware and Phishing Scams

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 30ebe76