AI audio translators

Flame Between Renders
1

the boss just came through to ask me about AI. (Aaaarrrrggghhh!!). Thankfully he was not interested in creating video content, but wants us to look into the options for using AI to translate the voiceovers into other languages.

We are not wanting to clone voices and any of that dodgy non-legal stuff. Its purely for product demos being sent to customers in other territories, so we can play a video in a language they understand.

My question is do any of you have experience doing this, and if so, what website would you reccomend?

2

Doesn’t Synthesia do that? AI Video Translator - Instant Video and Audio Translation

1 Like
3

thanks Tom, a quick google reveals hundreds of sites…i was hoping someone might have tried a few and have some recommendations of what to try and what to avoid.

Life is too short to waste auditioning AI bots if its been done by others already!!

4

We use https://elevenlabs.io/ to get voice talent to say new lines. We’ve had a few celebrity voice-overs that needed a new phrase. Due to their lack of availability and time constraints, we created the new line trained using the existing material. The talent gets final approval and I don’t think they mind this process because they paid as if they did it.

So anyway I just did a quick test from English to Spanish and it seems ok. You won’t get perfect accents but it sounds fine to me.

1 Like
5

In my experience the biggest issue will be that with anything AI related, you need to check it to see if it did it right. Even with human translators we always have had to have some take a second look.

So, yes, you may be able to use AI. But you will still need someone who speaks the language and can check it. If you don’t have that, I wouldn’t touch an AI solution, but pay the traditional services and pick one who you can reasonably trust.

A lot depends on content. Is this specific content (like product description), or just conversational stuff? And how critical is it that it makes sense? If there are minor issues, is that acceptable?

2 Likes
6

and don’t forget, you can always use speech to text on your results to get a text string

2 Likes
7

all good points…thanks for the input, chaps.

8

We do heaps of translations and nothing beats human. AI is nowhere near to being perfect and dosen’t get langauge nuances and tone. We have tried them all inc Elevenlabs. How many languages do you need?

2 Likes
10

Our offices have also used eleven labs for many jobs.