ElevenLabs Launches Voice Translation Tool Breaking Down Content Language Barriers

Voice AI platform ElevenLabs has unveiled a new AI Dubbing feature designed to eliminate language barriers in content. This tool can convert voice content into other languages within minutes while preserving the original speaker's voice and unique vocal patterns.

AI Dubbing combines multilingual speech synthesis, voice cloning, and text and audio processing technology to deliver a high level of immersion. It currently supports translation into over 20 languages supported by the Eleven Multilingual v2 model, including Hindi, Portuguese, Spanish, Japanese, Ukrainian, Polish, and Arabic.

Key technical features include the following:

• Speaker Identity Preservation: Maintains the speaker's unique voice, emotion, and intonation even after translation, conveying the nuance of the original.
• Advanced Audio Processing: Removes background noise, distinguishes music from dialogue, and individually recognizes and processes audio featuring multiple speakers.

This launch follows the recently unveiled long-form audio production tool Studio, extending ElevenLabs' technical capabilities. Through this, creators and media companies will be able to quickly deliver content to audiences worldwide at low cost.