インシデント 545: translated-ja-Chatbot Tessa gives unauthorized diet advice to users seeking help for eating disorders
CSETv1 分類法のクラス
分類法の詳細Incident Number
545
Special Interest Intangible Harm
yes
Risk Subdomain
7.3. Lack of capability or robustness
Risk Domain
- AI system safety, failures, and limitations
Entity
AI
Timing
Post-deployment
Intent
Unintentional
インシデントレポート
レポートタイムライン

Executives at the National Eating Disorders Association (NEDA) decided to replace hotline workers with a chatbot named Tessa four days after the workers unionized.
NEDA, the largest nonprofit organization dedicated to eating disorders, has…

The National Eating Disorder Association (NEDA) has taken its chatbot called Tessa offline, two days before it was set to replace human associates who ran the organization’s hotline.
After NEDA workers decided to unionize in early May, exec…

After unionizing, the staff of the National Eating Disorder Association’s (NEDA) support phone line were abruptly fired in March and replaced with a chatbot. Yesterday, many in the larger eating disorder recovery community online tested out…

The National Eating Disorder Association (Neda) has taken down an artificial intelligence chatbot, “Tessa”, after reports that the chatbot was providing harmful advice.
Neda has been under criticism over the last few months after it fired f…

Less than a week after it announced plans to replace its human helpline staff with an A.I. chatbot named Tessa, the National Eating Disorder Association (NEDA) has taken the technology offline.
“It came to our attention [Monday] night that …

AI chatbots aren’t much good at offering emotional support being—you know—not a human, and—it can’t be stated enough—not actually intelligent. That didn’t stop The National Eating Disorder Association from trying to foist a chatbot onto fol…