All users of the browser of the same name will be able to watch an English-language news release, an interview, a favorite TV series or a movie with automatic translation from Yandex neural networks. A video up to 30 minutes long is fully translated in 10-20 minutes. Not only is the translation performed, the viewer receives the video in Russian voice-over. Even the gender of the speaker is taken into account - girls are spoken in the voice of "Alice", men in a male voice. And if the video has already been translated and is in the Yandex database, no time is required to process it at all.
Available to everyone
Auto translation from Yandex.Browser is enabled for wordpress web design agency all users by default, you can disable it by going to the page settings, where you can enable and disable the function as desired. To activate, just click on the corresponding icon, which automatically appears on top of all videos for which this option is available.
Thanks to the innovation, all those who do not have a good command of English, but want to immerse themselves in the world of Western media, will be able to watch videos with automatic translation on YouTube, Vimeo, TikTok, Twitter, Facebook and Vkontakte. The only exception will be licensed content protected by copyright law.
The prototype of the translator was presented by Yandex back in July, but at that time the service had some restrictions. And in early September, the function became available in the Yandex application and browser on Android, Mac, Linux and Windows. In the future, the launch of adaptations from other world languages, as well as the addition of new voices for dubbing, has been announced.
How does this work
In order to perform a translation, neural networks need to perform several separate tasks:
Recognize speech.
Translate it into text.
Break it down into sentences.
Determine the gender of the speaker.
Translate the text into English.
Synthesize voiceover for Russian dubbing, female or male.
Match the obtained result with the video sequence in terms of timing.
To ensure that the translation into Russian matches the picture, a special algorithm monitors the speaker's speech rate. Previously, such work was done by people, took up a significant amount of resources and was quite expensive. And although automatic translation is not yet able to convey all the subtleties of intonation, actor's pauses and the play of timbre and volume of the voice, it can do the main thing: convey the meaning of what was said to native speakers of another language. In addition, the voiceover goes over the original sound, so intonations will not escape attentive listeners.
Communication without borders
According to the head of Yandex.Browser Roman Ivanov, the implementation of such a program was started back in 2011 and to date impressive results have been achieved: neural networks successfully translate not only video, but also text and images. The goal of the project: erasing language boundaries on the Internet.
While the translation takes some time, it may happen that the notification about the possibility of watching the video does not arrive, but there is no reason to worry: if the user clicked the button, the video will certainly be translated and saved on Yandex servers. After that, not only the user who ordered the translation into Russian, but also other users of the system will have access to it at any time. Thus, you will not have to wait to watch popular videos. |
