Human language technologies
Researching software and systems that bridge the linguistic divide between people and machines to make communicating with computers as natural as speaking with family and friends.
Microsoft Research Blog
Making machines recognize and transcribe conversations in meetings using audio and video
The ability to perceive communication signals and make sense of them played an essential role in the evolution of human intelligence. Computing technology is following the same trajectory. Now, computer vision and automatic speech recognition…
Video
Understanding Knowledge Distillation in Neural Sequence Generation
Sequence-level knowledge distillation (KD) — learning a student model with targets decoded from a pre-trained teacher model — has been widely used in sequence generation applications (e.g. model compression, non-autoregressive translation (NAT), low-resource translation, etc).…
