YouTube Expands AI Auto-Dubbing To Thousands Of Channels
YouTube has announced the expansion of its AI-powered auto-dubbing feature to “hundreds of thousands of channels” within the YouTube Partner Program, focusing on knowledge and informational content, but says it will expand content categories in the future.
In a Rush? Here are the Quick Facts!
- Dubbing supports nine languages, including French, Spanish, Japanese, and English.
- AI dubs are auto-created but can be previewed, unpublished, or deleted by creators.
- YouTube cautions the dubbing technology is new and may have translation inaccuracies.
The languages offered depend on the original video’s language. Videos initially in English can be translated into French, German, Hindi, Italian, Spanish, Indonesian, Japanese, and Portuguese. For videos in these languages, YouTube will produce English dubs.
Viewers can identify auto-dubbed videos through the “auto-dubbed” label or use the track selector to switch to the original language. The platform also remembers users’ language preferences for future videos.
For eligible channels, AI dubs are generated automatically when a video is uploaded. Creators have the option to preview, unpublish, or delete the dubs before they go live, as detailed in a YouTube support document.
To view the dubbed version while watching the video, users can select the track selector option to switch between the dubbed audio and the original language. The Verge provides an example of an English dub for a French video on making potatoes au gratin:
Despite the innovation, YouTube acknowledges that the technology is still developing and may not always deliver perfect translations or accurately represent the original speaker’s voice. The company is actively working to improve its accuracy and quality.
Creators can manage the feature in YouTube Studio under “Advanced Settings,” where they can review dubs before publishing.
Additionally, future updates will introduce “Expressive Speech,” previewed at Made on YouTube, which aims to replicate the creator’s tone, emotion, and even environmental ambiance.
Leave a Comment
Cancel