SeamlessM4T

August 24, 2023

Meta, the parent company of Facebook, has launched AI model named SeamlessM4T.
SeamlessM4T is the first all-in-one multimodal and multilingual AI translation model that allows people to communicate effortlessly through speech and text across different languages.
This single model can perform speech-to-text, speech-to-speech, text-to-speech, and text-to-text translations for up to 100 languages depending on the task.
It supports
- Speech recognition for nearly 100 languages
- Speech-to-text translation for nearly 100 input and output languages
- Speech-to-speech translation, supporting nearly 100 input languages and 36 (including English) output languages
- Text-to-text translation for nearly 100 languages
- Text-to-speech translation, supporting nearly 100 input languages and 35 (including English) output languages.
Compared to approaches using separate models, SeamlessM4T’s single system approach reduces errors and delays, increasing the efficiency and quality of the translation process.