Research
Researching how sound is captured, processed, and understood, from speech recognition to spatial audio.
We investigate the use of low bitrate causal quantized audio representations to fine-tune large language models (LLMs) using LoRA for comprehending and generating audio. Differing from earlier approaches that depend on continuous audio representations for…
In this talk, we explore advancements in computational models for speech quality assessment. Self-supervised learning models have emerged as powerful front-ends, outperforming supervised-only models. However, their large size renders them impractical for production tasks. We…
This talk will explore how large-scale self-supervised learning, combined with our latest multimodal neurotechnology—the newly released Muse integrating EEG and functional near-infrared spectroscopy (fNIRS)—and an open citizen science platform, accelerates the development of robust and…
In this issue: our CHI 2025 & ICLR 2025 contributions, plus research on causal reasoning & LLMs; countering LLM jailbreak attacks; and how people use AI vs. AI-alone. Also, SVP of Microsoft Health Jim Weinstein…
