Skip to main content Home Business intelligence Community, Social, and Gaming Customer Support Education Internal Communications Live and Remote Communications Readiness and Training Web Localization and Ecommerce More Solutions Text Translation Document Translation Custom Translator Translator Apps Office SharePoint Yammer Visual Studio Speech Translation Computer Vision Conversational Language Understanding More Languages Blog FAQ Text Translation Document Translation Custom Translator Other Cognitive Services Support Contact Confidentiality Attribution Machine Translation Customers Partners Partner Program Community Partners Try for free now Microsoft 365 Azure Copilot Windows Surface XBOX Deals Small Business Support Windows Apps Outlook OneDrive Microsoft Teams OneNote Microsoft Edge Moving from Skype to Teams Computers Shop XBOX Accessories VR & mixed reality Certified Refurbished Trade-in for cash XBOX Game Pass Ultimate PC Game Pass XBOX games PC games Microsoft AI Microsoft Security Dynamics 365 Microsoft 365 for business Microsoft Power Platform Windows 365 Small Business Digital Sovereignty Azure Microsoft Developer Microsoft Learn Support for AI marketplace apps Microsoft Tech Community Microsoft Marketplace Software companies Visual Studio Microsoft Rewards Free downloads & security Education Gift cards Licensing Unlocked stories View Sitemap

Microsoft Translator Blog

Breakthroughs in Translating Speech from our Research Teams

This is the year of machine learning and big data. Whether it is predicting political results, supercharging your Excel spreadsheets, helping map queries to intent in Search, or even customizing a translation engine to best fit your content – these research areas are playing a starring role in transforming technology and productivity.

A couple of weeks back, at the 14th annual Computing in the 21st Century Conference, attendees saw a glimpse of where else these technologies are taking us – and loved it. Rick Rashid, who heads up Microsoft Research worldwide, went up on stage and in the span of eight sentences, got the 2000+ strong crowd up on their feet and cheering. It was a moment where technology was indistinguishable from magic – and one that would spur science fiction writers to start thinking of bigger challenges for researchers to tackle 🙂

Watch the video to see for yourself:

 

 

A combination of powerful technologies were employed to make this amazing demonstration possible: Deep Neural Network based processing combined with high performance computing allowed a significant jump in accuracy of speech recognition. The Microsoft Translator technology that you use each day was customized to best fit Rick’s speech content. New speech synthesis technology that allows personalization of acoustic characteristics was able to create “Rick’s voice” in a language he does not speak. You can read Rick’s blog post here.

Some of these technologies are already available today, especially the industry-leading translation (Microsoft Translator) with customization capabilities (Translator Hub). If you are a Windows Phone user, you have been enjoying the most innovative translation app on any phone for over a year now, which includes an early speech translation experience that has been tuned for travel situations. The audio output that you hear on Bing Translator website uses some of the newer speech synthesis engines coming out of our Speech research. Deep-Neural-Net research is also behind our audio/video indexing service – MAVIS, which is available commercially.

The excitement that has been rippling across the web in response to this demonstration is an indicator of how much everyone wants to experience this ‘magic’. There is much work to do, but you will see the benefits of this amazing research in our products in our future releases.

Vikram Dendi
Director
Microsoft/Bing Translator & Microsoft Research


English (United States)
Your Privacy Choices Opt-Out Icon Your Privacy Choices
Consumer Health Privacy Contact us Privacy Manage cookies Terms of use Trademarks About our ads