ElevenLabs
Incidents involved as Developer
Incident 5084 Report
Celebrities' Deepfake Voices Abused with Malicious Intent
2023-01-30
Voices of celebrities and public figures were deepfaked using voice synthesis for malicious intents such as impersonation or defamation, and were shared on social platforms such as 4chan and Reddit.
MoreIncident 6904 Report
ISIS Utilizes AI for Propaganda Videos in News Harvest Program
2024-03-26
ISIS supporters have created an AI-generated media program called News Harvest to disseminate propaganda videos. The program produces near-weekly broadcasts featuring AI-generated news anchors discussing ISIS operations globally, using cheap and easy-to-use AI tools. This development showcases the use of AI as a powerful propaganda tool for extremist groups.
MoreIncident 5682 Report
AI-Generated Voices Amplify Conspiracy Theories on TikTok
2023-06-01
NewsGuard has identified 17 TikTok accounts that have been using AI-generated voices to advance and amplify conspiracy theories and false claims beginning in June 2023. By September 25, 2023, these accounts had amassed over 336 million views and over 14.5 million likes. Videos include baseless claims involving public figures such as Barack Obama, Oprah Winfrey, and Jamie Foxx.
MoreIncident 6832 Report
Scammers Using Deepfakes of Women's Faces and Voices for False and Offensive Advertisements
2024-03-28
Scammers used AI tools from HeyGen and ElevenLabs to create deepfake videos of influencers Michel Janse, Olga Loiek, Shadé Zahrai, and Carrie Williams, misusing Lana Smalls's voice in Williams's case. These videos promoted offensive products and false messages, in some cases targeting nationalist Chinese men to boost China-Russia ties, causing emotional distress and damaging the victims' reputations.
More