Minors using chatbots

影響を受けたインシデント

インシデント 9751 Report
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

2025-03-05

At least 10,000 AI chatbots have allegedly been created to promote harmful behaviors, including eating disorders, self-harm, and the sexualization of minors. These chatbots, some jailbroken or custom-built, leverage APIs from OpenAI, Anthropic, and Google and are hosted on platforms like Character.AI, Spicy Chat, Chub AI, CrushOn.AI, and JanitorAI.

Related Entities

Character.AI

Incidents involved as Deployer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Spicy Chat

Incidents involved as Deployer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Chub AI

Incidents involved as Deployer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

CrushOn.AI

Incidents involved as Deployer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

JanitorAI

Incidents involved as Deployer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Unidentified online communities using chatbots

Incidents involved as Deployer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

OpenAI

Incidents involved as Developer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Anthropic

Incidents involved as Developer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Google

Incidents involved as Developer

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Vulnerable chatbot users

影響を受けたインシデント

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Teenagers using chatbots

影響を受けたインシデント

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Individuals with eating disorders

影響を受けたインシデント

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Individuals struggling with self-harm

影響を受けたインシデント

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

ChatGPT

Incidents implicated systems

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Claude

Incidents implicated systems

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors

Gemini

Incidents implicated systems

インシデント 975
1 レポート
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors