AI dubbing
A technology that translates speech from a video or audio recording into another language via machine processing and has it spoken in a voice resembling the original speaker.
In plain terms
Traditional dubbing requires a translator, dubbing director, actors, and a studio, so it can take weeks and cost a lot. AI dubbing does most of this with software: you upload the video, select the target language, and after a short time you receive the version speaking in another language.
It is as if the translator not only translates what the speaker says but delivers it in their voice and with their intonation. More advanced systems also adjust lip movements to the new text, making it appear as if the person originally spoke in that language.
It is truly useful where no dubbing was previously done because it was not cost-effective: for instructional videos, podcasts, corporate training, and smaller YouTube channels. Compared to subtitles, the advantage is that you do not need to read; compared to traditional dubbing, it is fast and cheap. However, it currently falls short in acting performance.
How it works
- Speech recognition: the system transcribes what is spoken in the recording and marks who speaks when. Meanwhile, it separates speech from music and background noise.
- Translation: a machine translator or language model translates the text into the target language and strives to phrase it so that the sentences last roughly as long as the original.
- Voice cloning and speech synthesis: the system takes a sample from the original speaker's voice and has the translated text spoken in their tone, with similar intonation and emotions.
- Timing and mixing: the new speech is aligned to the image, then the original music and ambient sounds are mixed back underneath.
- Lip sync (not available in all systems): a video model redraws the speaker's mouth movements to match the sounds of a new language.
An everyday example
You open an American DIY video, and the creator speaks in Hungarian, in a slightly robotic but understandable voice. They did not learn Hungarian: the video was translated using an AI dubbing service. Some platforms, such as YouTube, also offer such automatic dubbing tracks for certain languages, and this can be switched back to the original language in the settings.
Who is affected
A common misconception
Limits and risks
- A translation error is harder to spot here than in subtitles because it sounds confident and natural, and you do not see the original text next to it.
- In smaller languages similar to Hungarian, pronunciation, stress and inflection stumble more often than in English or Spanish.
- The same technique can be misused: someone can be made to say things they never said. Therefore, cloning someone's voice generally requires the affected person's consent for legal and ethical reasons.
- From August 2026, the EU AI Act requires artificially generated or altered audio to be labeled in certain cases, but practice is not yet uniform. So you cannot always tell that what you hear was not recorded by a human.
Similar, but not the same
- voice cloning – Voice cloning is only copying one person's voice; AI dubbing uses this as part of a full process, together with translation and timing.
- Machine captioning – Captioning adds written text below an image, while AI dubbing replaces the audio track itself with another language.
- Deepfake – A deepfake is a forged image or voice suitable for deception, while AI dubbing is typically a translation created with the author's knowledge, although both use technically related tools.
Related concepts
Generative AI, Synthetic media, Generative voice
voice cloning, Speech synthesis, Speech recognition, Machine translation, Real-time speech translation, Deepfake
A brief history
Dubbing has existed since the early years of sound film; its machine version was made possible by the convergence of speech recognition, machine translation and voice cloning. The wider public encountered it in 2023, when several companies launched such services at the same time and the major video and podcast platforms began testing them.
Where things stand
By the end of 2026, this is increasingly common on major video platforms and for corporate and educational content, and streaming services are also experimenting with it. However, dubbing for feature films and high-quality series remains largely human work. Professional organizations of dubbing actors are urging regulation of rights over the voice.
Also known as
AI-szinkron · AI dubbing · MI-szinkron · Machine dubbing · automatikus szinkron · AI dubbing · auto dubbing · automatic dubbing
Sources
This entry was machine-edited and has undergone machine expert review; the “In the news” section updates automatically from Agent Age stories.