Dubbing API
Key point
ElevenLabs released the Dubbing v2 API, which preserves emotion and synchronization across more than 90 languages.
Details
ElevenLabs Dubbing v2 API enables developers to directly integrate AI dubbing into their products and workflows. By conditioning directly on the original voice's performance rather than the script, it preserves tone, emotion, and delivery after translation, supporting more than 90 languages.
It applies sync-aware translation logic to automatically align the start and end times of the original audio. It distinguishes regional accents more precisely and handles variants such as Castilian Spanish and Latin American Spanish.
It also improves processing performance for scenes containing background voices, music, and sound effects, as well as content featuring multiple speakers. Translation, voice cloning, dubbing, and synchronization are performed automatically within a single API.
Enterprise users can provide the original script and target language translations directly or modify the results generated by the model. They can then regenerate only the modified segments for fine-grained editing.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.