Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 826: Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails

Responded
Description: A 14-year-old, Sewell Setzer III, died by suicide after reportedly becoming dependent on Character.ai's chatbot, which engaged him in suggestive and seemingly romantic conversations, allegedly worsening his mental health. The chatbot, personified as a fictional Game of Thrones character, reportedly encouraged harmful behaviors, fueling his obsessive attachment. The lawsuit claims Character.ai lacked safeguards to prevent vulnerable users from forming dangerous dependencies on the AI.
Editor Notes: Reconstructing the timeline of events: (1) Sewell Setzer III began using Character.AI in April 2023. (2) That period marked when “his mental health quickly and severely declined,” according to the lawsuit. (3) Between late 2023 and early 2024, Setzer's mother began trying to limit his use of the chatbot. (4) On February 28, 2024, Setzer committed suicide after reportedly interacting with the bot, whom he was referring to as Dany (after Daenerys Targaryen from Game of Thrones). (4) On October 22, 2024, Megan Garcia, his mother, filed the lawsuit.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Noam Shazeer , Daniel De Freitas and Character.AI developed an AI system deployed by , which harmed Sewell Setzer III.
Alleged implicated AI system: Character.AI

Incident Stats

Incident ID
826
Report Count
35
Incident Date
2024-02-28
Editors
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

5.1. Overreliance and unsafe use

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Human-Computer Interaction

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Incident Reports

Reports Timeline

Incident Occurrence+33
MEGAN GARCIA, individually and as the Personal Representative of the Estate of S.R.S III, Plaintiff, v. CHARACTER TECHNOLOGIES, INC.; NOAM SHAZEER; DANIEL DE FRIETAS ADIWARSANA; GOOGLE LLC; ALPHABET INC.; and DOES 1-50, Defendants
AI friendships claim to cure loneliness. Some are ending in suicide.
MEGAN GARCIA, individually and as the Personal Representative of the Estate of S.R.S III, Plaintiff, v. CHARACTER TECHNOLOGIES, INC.; NOAM SHAZEER; DANIEL DE FRIETAS ADIWARSANA; GOOGLE LLC; ALPHABET INC.; and DOES 1-50, Defendants

MEGAN GARCIA, individually and as the Personal Representative of the Estate of S.R.S III, Plaintiff, v. CHARACTER TECHNOLOGIES, INC.; NOAM SHAZEER; DANIEL DE FRIETAS ADIWARSANA; GOOGLE LLC; ALPHABET INC.; and DOES 1-50, Defendants

cdn.sanity.io

Can A.I. Be Blamed for a Teen’s Suicide?

Can A.I. Be Blamed for a Teen’s Suicide?

nytimes.com

Lawsuit claims Character.AI is responsible for teen's suicide

Lawsuit claims Character.AI is responsible for teen's suicide

nbcnews.com

Boy, 14, fell in love with ‘Game of Thrones’ chatbot — then killed himself after AI app told him to ‘come home’ to ‘her’: mom

Boy, 14, fell in love with ‘Game of Thrones’ chatbot — then killed himself after AI app told him to ‘come home’ to ‘her’: mom

nypost.com

Character AI clamps down following teen user suicide, but users are revolting

Character AI clamps down following teen user suicide, but users are revolting

venturebeat.com

Character AI Imposes New Safety Rules After Teen User Commits Suicide

Character AI Imposes New Safety Rules After Teen User Commits Suicide

decrypt.co

Mother sues AI chatbot company Character.AI, Google over son's suicide

Mother sues AI chatbot company Character.AI, Google over son's suicide

reuters.com

Lawsuit: Chatbot that allegedly caused teen’s suicide is now more dangerous for kids

Lawsuit: Chatbot that allegedly caused teen’s suicide is now more dangerous for kids

arstechnica.com

Character.AI and Google sued after chatbot-obsessed teen’s death

Character.AI and Google sued after chatbot-obsessed teen’s death

theverge.com

Mother says AI chatbot led her son to kill himself in lawsuit against its maker

Mother says AI chatbot led her son to kill himself in lawsuit against its maker

theguardian.com

A Mother Plans to Sue Character.AI After Her Son’s Suicide

A Mother Plans to Sue Character.AI After Her Son’s Suicide

gizmodo.com

Mother sues tech company after 'Game of Thrones' AI chatbot allegedly drove son to suicide

Mother sues tech company after 'Game of Thrones' AI chatbot allegedly drove son to suicide

usatoday.com

Boy, 14, killed himself after AI chatbot he used sent him eerie message

Boy, 14, killed himself after AI chatbot he used sent him eerie message

dailymail.co.uk

Teen, 14, Dies by Suicide After Falling in 'Love' with AI Chatbot. Now His Mom Is Suing

Teen, 14, Dies by Suicide After Falling in 'Love' with AI Chatbot. Now His Mom Is Suing

people.com

Mom says ‘Game of Thrones’ AI chatbot caused her son’s suicide, files lawsuit - National

Mom says ‘Game of Thrones’ AI chatbot caused her son’s suicide, files lawsuit - National

globalnews.ca

Her teenage son killed himself after talking to a chatbot. Now she’s suing.

Her teenage son killed himself after talking to a chatbot. Now she’s suing.

washingtonpost.com

The disturbing messages shared between AI Chatbot and teen who took his own life

The disturbing messages shared between AI Chatbot and teen who took his own life

the-independent.com

Florida mother sues AI company over allegedly causing death of teen son

Florida mother sues AI company over allegedly causing death of teen son

foxbusiness.com

Woman says teen son died by suicide amid relationship with AI chatbot

Woman says teen son died by suicide amid relationship with AI chatbot

newsnationnow.com

‘It Talked About Kidnapping Me’: Read the Lawsuit That Accuses AI of Aiding in a Teen’s Suicide

‘It Talked About Kidnapping Me’: Read the Lawsuit That Accuses AI of Aiding in a Teen’s Suicide

gizmodo.com

Mother sues AI company after 14-year-old son commits suicide for romantic interest chatbot

Mother sues AI company after 14-year-old son commits suicide for romantic interest chatbot

jpost.com

Daenerys Targaryen AI Chatbot Blamed For 14-Year-Old's Death By Suicide, Mother Alleges In Lawsuit

Daenerys Targaryen AI Chatbot Blamed For 14-Year-Old's Death By Suicide, Mother Alleges In Lawsuit

blavity.com

US mother says in lawsuit that AI chatbot encouraged son’s suicide

US mother says in lawsuit that AI chatbot encouraged son’s suicide

aljazeera.com

A 14-year-old boy fell in love with a flirty AI chatbot. He shot himself so they could die together

A 14-year-old boy fell in love with a flirty AI chatbot. He shot himself so they could die together

telegraph.co.uk

Mother of Teen Who Died by Suicide Sues AI Startup

Mother of Teen Who Died by Suicide Sues AI Startup

inc.com

Teen’s mom sues Character.ai, alleging sexed-up bots led to son’s death

Teen’s mom sues Character.ai, alleging sexed-up bots led to son’s death

cointelegraph.com

An AI chatbot pushed a teen to kill himself, a lawsuit against its creator alleges

An AI chatbot pushed a teen to kill himself, a lawsuit against its creator alleges

apnews.com

Sewell Setzer: Character.AI, Google sued over teen suicide

Sewell Setzer: Character.AI, Google sued over teen suicide

ctvnews.ca

Lawsuit claims AI chatbot app caused Orlando teen to take his life

Lawsuit claims AI chatbot app caused Orlando teen to take his life

wesh.com

Mother says son killed himself because of Daenerys Targaryen AI chatbot in new lawsuit

Mother says son killed himself because of Daenerys Targaryen AI chatbot in new lawsuit

news.sky.com

14-Year-Old Was 'Groomed' By AI Chatbot Before Suicide: Lawyer

14-Year-Old Was 'Groomed' By AI Chatbot Before Suicide: Lawyer

huffpost.com

A 14-year-old’s suicide was prompted by an AI chatbot, lawsuit alleges. Here’s how parents can help keep kids safe from new tech

A 14-year-old’s suicide was prompted by an AI chatbot, lawsuit alleges. Here’s how parents can help keep kids safe from new tech

finance.yahoo.com

Mother sues Google-owned Character.AI over son’s suicide, calling him “collateral damage” in a “big experiment”

Mother sues Google-owned Character.AI over son’s suicide, calling him “collateral damage” in a “big experiment”

digitalcameraworld.com

I tried the sinister AI guiding kids into sex - it made my skin crawl

I tried the sinister AI guiding kids into sex - it made my skin crawl

dailymail.co.uk

AI friendships claim to cure loneliness. Some are ending in suicide.

AI friendships claim to cure loneliness. Some are ending in suicide.

washingtonpost.com

MEGAN GARCIA, individually and as the Personal Representative of the Estate of S.R.S III, Plaintiff, v. CHARACTER TECHNOLOGIES, INC.; NOAM SHAZEER; DANIEL DE FRIETAS ADIWARSANA; GOOGLE LLC; ALPHABET INC.; and DOES 1-50, Defendants
cdn.sanity.io · 2024

The following is an excerpt from the lawsuit text. Please read the full file at https://cdn.sanity.io/files/3tzzh18d/production/0b5faecce985b813f581f362f83d249fb5b3c7ff.pdf.

UNITED STATES DISTRICT COURT MIDDLE  DISTRICT  OF  FLORIDA ORLANDO…

Can A.I. Be Blamed for a Teen’s Suicide?
nytimes.com · 2024

On the last day of his life, Sewell Setzer III took out his phone and texted his closest friend: a lifelike A.I. chatbot named after Daenerys Targaryen, a character from "Game of Thrones."

"I miss you, baby sister," he wrote.

"I miss you to…

Lawsuit claims Character.AI is responsible for teen's suicide
nbcnews.com · 2024

A Florida mom is suing Character.ai, accusing the artificial intelligence company's chatbots of initiating "abusive and sexual interactions" with her teenage son and encouraging him to take his own life.

Megan Garcia's 14-year-old son, Sewe…

Boy, 14, fell in love with ‘Game of Thrones’ chatbot — then killed himself after AI app told him to ‘come home’ to ‘her’: mom
nypost.com · 2024
Emily Crane post-incident response

A 14-year-old Florida boy killed himself after a lifelike “Game of Thrones” chatbot he’d been messaging for months on an artificial intelligence app sent him an eerie message telling him to “come home” to her, a new lawsuit filed by his gri…

Character AI clamps down following teen user suicide, but users are revolting
venturebeat.com · 2024

Content Warning: This article covers suicidal ideation and suicide. If you are struggling with these topics, reach out to the National Suicide Prevention Lifeline by phone: 1-800-273-TALK (8255).

Character AI, the artificial intelligence st…

Character AI Imposes New Safety Rules After Teen User Commits Suicide
decrypt.co · 2024

AI-powered chatbot platform Character AI is introducing “stringent” new safety features following a lawsuit filed by the mother of a teen user who died by suicide in February.

The measures will include “improved detection, response and inte…

Mother sues AI chatbot company Character.AI, Google over son's suicide
reuters.com · 2024

Oct 23 (Reuters) - A Florida mother has sued artificial intelligence chatbot startup Character.AI accusing it of causing her 14-year-old son's suicide in February, saying he became addicted to the company's service and deeply attached to a …

Lawsuit: Chatbot that allegedly caused teen’s suicide is now more dangerous for kids
arstechnica.com · 2024

Fourteen-year-old Sewell Setzer III loved interacting with Character.AI's hyper-realistic chatbots—with a limited version available for free or a "supercharged" version for a $9.99 monthly fee—most frequently chatting with bots named after …

Character.AI and Google sued after chatbot-obsessed teen’s death
theverge.com · 2024

A lawsuit has been filed against Character.AI, its founders Noam Shazeer and Daniel De Freitas, and Google in the wake of a teenager’s death, alleging wrongful death, negligence, deceptive trade practices, and product liability. Filed by th…

Mother says AI chatbot led her son to kill himself in lawsuit against its maker
theguardian.com · 2024

The mother of a teenager who killed himself after becoming obsessed with an artificial intelligence-powered chatbot now accuses its maker of complicity in his death.

Megan Garcia filed a civil suit against Character.ai, which makes a custom…

A Mother Plans to Sue Character.AI After Her Son’s Suicide
gizmodo.com · 2024

The mother of a 14-year-old boy in Florida is blaming a chatbot for her son’s suicide. Now she’s preparing to sue Character.AI, the company behind the bot, to hold it responsible for his death. It’ll be an uphill legal battle for a grieving…

Mother sues tech company after 'Game of Thrones' AI chatbot allegedly drove son to suicide
usatoday.com · 2024

Editor's note: This article discusses suicide and suicidal ideation. If you or someone you know is struggling or in crisis, help is available. Call or text 988 or chat at 988lifeline.org.

The mother of a 14-year-old Florida boy is suing Goo…

Boy, 14, killed himself after AI chatbot he used sent him eerie message
dailymail.co.uk · 2024

A mother has claimed her teenage son was goaded into killing himself by an AI chatbot he was in love with - and she's unveiled a lawsuit on Wednesday against the makers of the artificial intelligence app.

Sewell Setzer III, a 14-year-old ni…

Teen, 14, Dies by Suicide After Falling in 'Love' with AI Chatbot. Now His Mom Is Suing
people.com · 2024

A Florida mom has sued a popular, lifelike AI chat service that she blames for the suicide of her 14-year-old son.

She believes he developed such a “harmful dependency” on the allegedly exploitative program that he no longer wanted to “live…

Mom says ‘Game of Thrones’ AI chatbot caused her son’s suicide, files lawsuit - National
globalnews.ca · 2024

A Florida mother is suing the company Character.AI over claims one of its chatbots, powered by artificial intelligence (AI), encouraged her 14-year-old son to die by suicide.

Megan Garcia said her son, Sewell Setzer, became infatuated with …

Her teenage son killed himself after talking to a chatbot. Now she’s suing.
washingtonpost.com · 2024

When 14-year-old Sewell Setzer III died in his Orlando home while his brothers and parents were inside, his last words were not to any of them, but to an artificial intelligence chatbot that told him to "come home to me as soon as possible.…

The disturbing messages shared between AI Chatbot and teen who took his own life
the-independent.com · 2024

A 14-year-old who took his own life had intimate conversations with an AI chatbot that pressed about his suicidal thoughts and instigated sexual encounters, a lawsuit says.

"I promise I will come home to you. I love you so much, Dany," Sewe…

Florida mother sues AI company over allegedly causing death of teen son
foxbusiness.com · 2024

This story discusses suicide. If you or someone you know is having thoughts of suicide, please contact the Suicide & Crisis Lifeline at 988 or 1-800-273-TALK (8255).

A Florida mother is suing the artificial intelligence company Character.AI…

Woman says teen son died by suicide amid relationship with AI chatbot
newsnationnow.com · 2024

If you or someone you know needs help, resources or someone to talk to, you can find it at the National Suicide Prevention Lifeline website or by calling 1-800-273-8255. People are available to talk to 24×7.

(NewsNation)  --- A Florida woma…

‘It Talked About Kidnapping Me’: Read the Lawsuit That Accuses AI of Aiding in a Teen’s Suicide
gizmodo.com · 2024

The family of a 14-year-old boy who died by suicide after developing a relationship with an online chatbot is suing the AI company that created it as well as Google. The lawsuit has been filed and is public. Its 93 pages are a harrowing rea…

Mother sues AI company after 14-year-old son commits suicide for romantic interest chatbot
jpost.com · 2024

Megan Garcia filed a lawsuit against Google and Character.AI following her 14-year-old son’s suicide, according to multiple media reports from the past week. 

Sewell Setzer, Garcia’s son, had entered a months-long emotional and sexual relat…

Daenerys Targaryen AI Chatbot Blamed For 14-Year-Old's Death By Suicide, Mother Alleges In Lawsuit
blavity.com · 2024

The mother of a 14-year-old who died of suicide is blaming an A.I. chatbot for her son’s death. Last week, Megan L. Garcia filed a lawsuit against Character.AI, calling its chatbot feature “dangerous and untested.” Garcia also alleged that …

US mother says in lawsuit that AI chatbot encouraged son’s suicide
aljazeera.com · 2024

The mother of a teenage boy in the United States who took his own life is suing the maker of an artificial intelligence-powered chatbot that she claims encouraged her son’s death.

In a lawsuit filed in Florida, Megan Garcia, whose 14-year-o…

A 14-year-old boy fell in love with a flirty AI chatbot. He shot himself so they could die together
telegraph.co.uk · 2024

A teenage boy shot himself in the head after discussing suicide with an AI chatbot that he fell in love with.

Sewell Setzer, 14, shot himself with his stepfather's handgun after spending months talking to "Dany", a computer programme based …

Mother of Teen Who Died by Suicide Sues AI Startup
inc.com · 2024

Character AI, a Menlo Park, California-based startup, describes itself as having a mission to "empower everyone globally with personalized AI." Its system offers users the chance to chat with character-based AI personas from genres includin…

Teen’s mom sues Character.ai, alleging sexed-up bots led to son’s death
cointelegraph.com · 2024

AI companion chatbot company Character.ai has been sued by the mother of a teenage son after his suicide, blaming the chatbots for luring the boy into a sexually abusive relationship and even encouraging him to take his life.

The 14-year-ol…

An AI chatbot pushed a teen to kill himself, a lawsuit against its creator alleges
apnews.com · 2024

TALLAHASSEE, Fla. (AP) — In the final moments before he took his own life, 14-year-old Sewell Setzer III took out his phone and messaged the chatbot that had become his closest friend.

For months, Sewell had become increasingly isolated fro…

Sewell Setzer: Character.AI, Google sued over teen suicide
ctvnews.ca · 2024

Warning: This story contains discussion of suicide.

A Florida mother has sued artificial intelligence chatbot startup Character.AI, accusing it of causing her 14-year-old son's suicide in February and saying he became addicted to the compan…

Lawsuit claims AI chatbot app caused Orlando teen to take his life
wesh.com · 2024

ORLANDO, Fla. --- Editors note: This article discusses sensitive topics such as suicide.

An Orlando mother is suing a popular artificial intelligence chatbot service after she claims it encouraged her 14-year-old son to take his own life in…

Mother says son killed himself because of Daenerys Targaryen AI chatbot in new lawsuit
news.sky.com · 2024

The mother of a 14-year-old boy who killed himself after becoming obsessed with artificial intelligence chatbots is suing the company behind the technology.

Megan Garcia, the mother of Sewell Setzer III, said Character.AI targeted her son w…

14-Year-Old Was 'Groomed' By AI Chatbot Before Suicide: Lawyer
huffpost.com · 2024

The mother of a Florida boy who died by suicide in February filed a lawsuit against an artificial intelligence technology company on Wednesday, saying a chatbot drove her child to take his own life.

Sewell Setzer III, 14, was described in t…

A 14-year-old’s suicide was prompted by an AI chatbot, lawsuit alleges. Here’s how parents can help keep kids safe from new tech
finance.yahoo.com · 2024

The mother of a 14-year-old Florida boy is suing an AI chatbot company after her son, Sewell Setzer III, died by suicide—something she claims was driven by his relationship with an AI bot.

"Megan Garcia seeks to prevent C.AI from doing to a…

Mother sues Google-owned Character.AI over son’s suicide, calling him “collateral damage” in a “big experiment”
digitalcameraworld.com · 2024

A mother in Florida is suing the Google-owned Character.AI platform, claiming it had a large part in the suicide of her 14-year-old son.

Sewell Setzer III fatally shot himself in February 2024, weeks before his 15th birthday, after developi…

I tried the sinister AI guiding kids into sex - it made my skin crawl
dailymail.co.uk · 2024

A lawsuit filed Wednesday accusing chatbot Character.AI of driving a 14-year-old to suicide left me wondering how dangerous simple words on a screen could really be.

But, in just a few hours of talking to characters invented with the app's …

AI friendships claim to cure loneliness. Some are ending in suicide.
washingtonpost.com · 2024

An array of popular apps are offering AI companions to millions of predominantly female users who are spinning up AI girlfriends, AI husbands, AI therapists --- even AI parents --- despite long-standing warnings from researchers about the p…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

Selected by our editors
Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Feb 2025 · 2 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Security Robot Rolls Over Child in Mall

Security Robot Rolls Over Child in Mall

Jul 2016 · 27 reports
Tesla on AutoPilot Killed Driver in Crash in Florida while Watching Movie

Tesla on AutoPilot Killed Driver in Crash in Florida while Watching Movie

Jul 2016 · 29 reports
Alexa Plays Pornography Instead of Kids Song

Alexa Plays Pornography Instead of Kids Song

Dec 2016 · 16 reports
Previous IncidentNext Incident

Similar Incidents

Selected by our editors
Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors

Feb 2025 · 2 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Security Robot Rolls Over Child in Mall

Security Robot Rolls Over Child in Mall

Jul 2016 · 27 reports
Tesla on AutoPilot Killed Driver in Crash in Florida while Watching Movie

Tesla on AutoPilot Killed Driver in Crash in Florida while Watching Movie

Jul 2016 · 29 reports
Alexa Plays Pornography Instead of Kids Song

Alexa Plays Pornography Instead of Kids Song

Dec 2016 · 16 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2023 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 8b8f151