Skip to main content
All CollectionsVideo CreationVideo Translation
How do I dub and translate videos not made in AI Studios?
How do I dub and translate videos not made in AI Studios?

AI Dubbing translates videos into multiple languages with synced speech and lip movements. Learn how to get the best results.

DeepBrain AI avatar
Written by DeepBrain AI
Updated yesterday

Our AI Dubbing tool transforms your videos by detecting the original language, translating it into multiple languages, and flawlessly syncing speech with lip movements. It helps your content connect with a global audience effortlessly, delivering an immersive and natural viewing experience.

Supported languages: English, Hindi, Portuguese, Chinese, Spanish, French, German, Japanese, Korean, Russian, Arabic, Indonesian, Italian, Dutch, Turkish, Polish, Swedish, Filipino, Malay, Romanian, Ukrainian, Greek, Czech, Danish, Finnish, Bulgarian, Croatian, Slovak, Tamil, Vietnamese.

Tips for Getting the Best Out of AI Dubbing

To make sure your video looks and sounds great with AI Dubbing, here are some tips to keep in mind before uploading your video:

Recommended

  • 👌 Use videos where the face is clearly visible. Slight side angles are okay!

  • 👌 Make sure key facial features (like eyes, nose, mouth, and eyebrows) aren't blocked by anything like microphones, hands, logos, or captions.

  • 👌 Close-up shots of the face work best for accurate lip-syncing.

  • 👌 Make sure the lighting is even—avoid super bright lights or heavy shadows.

  • 👌 Videos with just one speaker at a time give the best results.

Avoid

  • ❌ Videos where the face is mostly in profile or only partly visible.

  • ❌ Videos with a lot of background noise.

  • ❌ Multiple people speaking at the same time.

  • ❌ Frequent scene changes or lots of camera movement.

Note: AI Dubbing and AI Studios' Video Translation are two different features.

  • AI Dubbing: Handles translation of videos created outside AI Studios (typically videos filmed or produced without AI Avatars).

  • Video Translation: Translates videos created within AI Studios (videos made using AI Studios' AI Avatars)

To learn more about translating AI Studios-created videos, refer to this guide.


How to Dub Videos with AI

1. Getting Started with AI Dubbing

  1. Navigate to AI Dubbing

    • Find the AI Dubbing tool in the AI Studios dashboard. It's under the "For You" section or the "Social Media" tab in the features menu. Alternatively, you can use this link.

  2. Upload Your Video

    • Drag and drop your video file or click the upload button and select the video you want to dub.

    • Supported file formats include MP4, MOV, and WEBM, with a maximum size of 5GB.

  3. Configure the Dubbing Settings (optional)

    • Choose the source language and target language(s)

    • Select the number of speakers in the video.

  4. Choose Dubbing Options (optional)

    • Voice-Only Dubbing → Create a dubbed video without lip-syncing.

    • Remove BGM → Remove background music and noise for clearer speech output.

Once your selections are made, the [Proofread] and [Export] buttons will activate.

Tip: Uploading an SRT or ASS subtitle file during this step improves the final dubbed video's accuracy and speeds up synthesis. AI Dubbing uses these files' text as a translation foundation and their timestamps to achieve better speech timing. Read more about this feature here.


2. Using the Proofread Tool (Optional)

💡 The proofreading feature for AI Dubbing is only available to Team & Enterprise plan users.

Open the Proofread Editor

  1. Click [Proofread] to open the editing page.

    • It may take a few minutes for the proofreading page to load. The processing time varies based on file size, video quality, and the number of target languages.

  2. Adjust Speakers

    • If the AI assigned speakers incorrectly, click the "Speaker" menu to correct the script to the intended speaker.

    • Use the preview feature to verify the changes were made correctly.

  3. Change Voice

    • The default setting clones the original speaker’s voice for translation.

    • If you want to change the voice used in the final dubbing, you can select one from the AI voice library.

  4. Edit Speech Timing & Script

    • Modify translations manually to make sure the speech is delivered in the final video as intended.

    • Click [Update] or [Preview] to apply and review changes.

‼️ Important Proofreading Notes:

  • When editing the generated script, keep in mind that the recommended text length varies based on the time set for each segment.

    • Text longer than the original script typically results in faster speech.

    • Shorter text may result in slower speech or added silence.

  • Avoid overlapping speech segments to prevent audio conflicts.

  • Delete unnecessary speech segments (deletions cannot be undone).


3. Export Your Final Video

  1. Once editing is complete, select an export option and click [Export]:

    • Lip-Synced Dubbing (Default): This is best for videos with visible speakers (e.g., interviews, podcasts, monologues).

    • Voice-Only Dubbing: Ideal for content without on-screen speakers (e.g., documentaries, animations).

Ready to dub a video? Click here to upload a video.


Processing Time and Costs

Processing Time

The time needed to generate a new dubbed video depends on your subscription plan, video length, number of speakers, and resolution. Usually, it takes anywhere from a few minutes to a few hours, but sometimes it might take a bit longer. We appreciate your patience and suggest waiting up to 24 hours before contacting customer support. We're always working to make this technology faster and more efficient, so you can expect improvements with every update.

Costs

AI Dubbing is available for Free, Personal, Team, and Enterprise plans. Under the credit-based subscription model, each minute of dubbing uses 1 credit from your subscription. This credit-based model is part of a previous pricing structure and applies only to users who have chosen to retain it. This is different for unlimited-plan subscribers.

For new subscribers or those interested in transitioning to the updated AI Studios subscription plan, please visit the pricing page for the latest details. [Read about the new plan changes]


FAQ

1. Why is my dubbed video not synthesizing?

This issue might occur for several reasons:

  • Face visibility: Your face might not be fully visible in the video.

    • Solution: Use a video where your face is clearly visible without any obstructions.

  • Terms of use: The content may violate our terms of use.

    • Solution: Review our terms of use to ensure your content is compliant.

  • Unsupported video type: The video format may not be supported.

    • Solution: Use MP4, MOV, or WEBM files with standard encoding.

  • File issues: Your file may have codec problems or be password-protected.

    • Solution: Re-encode the file using a tool like HandBrake or remove any password protection.

If none of these resolve the issue, please contact customer support for assistance.

2. Why is the lip sync in my dubbed video glitchy?

This might happen due to:

  • Low video quality: Blurry or grainy videos can make it hard for the AI to sync accurately.

    • Solution: Upload a video that shows the face of the speaker(s) clearly.

  • Facial hair: Beards or mustaches may interfere with the AI’s ability to outline your lips.

    • Solution: Consider trimming facial hair for clearer facial features in the video.

  • Obstructions: Objects or hands blocking your lower face can cause issues.

    • Solution: Avoid covering your face in the video and making large hand movements that cover your face.

  • Bad lighting: Poor lighting can make it hard for the AI to track your facial movements.

    • Solution: Record in a well-lit environment with even lighting on your face.

  • Extreme face angles: The AI may struggle if your face is at an unusual angle or moving too dramatically.

    • Solution: Keep your face at a natural angle and minimize sudden, dramatic head movements.

3. Why is my video not being uploaded?

This is likely due to plan limitations. The length of video you can generate varies by subscription tier. If your video isn't uploading, check if the video length is within your plan's limits (i.e., 10 minutes for Personal users).

  • Solution: Trim the video or film a shorter version.

If the problem persists, adjust these factors and try again, or reach out to support for additional help.

Did this answer your question?