ElevenLabs, a startup offering AI-powered voice cloning services, has banned a user after its technology was used to create a deepfake audio impersonation of President Joe Biden for a misleading robocall.
The robocall, sent to some New Hampshire voters last week, featured fake audio of Biden telling people not to vote in the state’s primary. Security company Pindrop analyzed the recording and determined with over 99% confidence that it was synthesized using ElevenLabs’ voice cloning tools.
ElevenLabs says it is investigating the incident and has identified and removed the account responsible for creating the fake Biden audio. The company stated it is “dedicated to preventing the misuse of audio AI tools and takes any incidents of misuse extremely seriously.”
Table of Contents
Expert Predict More Voice Deepfakes Ahead of 2020 Election
This Biden deepfake exemplifies the potential for voice cloning tech to be weaponized to manipulate voters. Carnegie Mellon University professor Kathleen Carley told The Hill this could be “just the tip of the iceberg in what could be done with respect to voter suppression or attacks on election workers.” She predicts more voice fakes aimed at disrupting the upcoming 2020 U.S. presidential election.
When ElevenLabs first launched its voice cloning platform, some internet users quickly began using it to create fake celebrity audio. While the company does warn against illegal uses of its tech, additional safeguards may be needed to prevent impactful election interference.
AI Voice Cloning Companies Walk Fine Line
Moving forward, AI voice cloning startups will likely need to balance enabling creative application of the technology while protecting against potentially harmful misinformation. As these tools become more advanced and accessible, companies offering them walk an increasingly fine line between upholding free speech and preventing abuse.
