Jinyu Li

Partner Applied Science Manager

论文与出版物

查看方式：

- DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation
  
  Yayue Deng, Dingdong Wang, Yuxuan Hu, Jinyu Li, Yanqing Liu, Yuanyuan Wang, Weidong Chen, Helen M. Meng, Shujie Liu, Xixin Wu, Jinyu Li, Yanqing Liu
  
  EMNLP 2026 | September 2026
  
  Publication
- EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning
  
  Dingdong Wang, Shujie Liu, Tianhua Zhang, Youjun Chen, Jinyu Li, Helen M. Meng
  
  ICLR 2026 | January 2026
  
  Publication
- Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audio
  
  Mohan Shi, Xiong Xiao, Ruchao Fan, Shaoshi Ling, Jinyu Li
  
  November 2025
  
  arXiv | November 2025
  
  Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- Boosting Large Language Model for Speech Synthesis: An Empirical Study
  
  Hongkun Hao, Long Zhou, Shujie Liu, Jinyu Li, Shujie Hu, Rui Wang, Furu Wei
  
  ICASSP | April 2025
  
  Publication
- Target word activity detector: An approach to obtain ASR word boundaries without lexicon
  
  Sunit Sivasankaran, Eric Sun, Jinyu Li, Yan Huang, Jing Pan
  
  ICASSP | April 2025
  
  Publication
- V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow
  
  Jeongsoo Choi, Ji-Hoon Kim, Jinyu Li, Joon Son Chung, Shujie Liu
  
  ICASSP | April 2025
  
  Publication
- CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation
  
  Rui Zhao, Jinyu Li, Ruchao Fan, Matt Post
  
  SLT Workshop | December 2024
  
  Publication
- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation
  
  Zongyi Li, Shujie Hu, Shujie Liu, Long Zhou, Jeongsoo Choi, Lingwei Meng, Xun Guo, Jinyu Li, Hefei Ling, Furu Wei
  
  October 2024
  
  October 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning
  
  Jing Pan, Jian Wu, Yashesh Gaur , Sunit Sivasankaran, Zhuo Chen , Shujie Liu, Jinyu Li
  
  Interspeech 2024 | September 2024
  
  Publication
- Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation
  
  Peidong Wang, Jian Xue, Jinyu Li, Junkun Chen, Aswin Shanmugam Subramanian
  
  Interspeech 2024 | September 2024
  
  Publication
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- Autoregressive Speech Synthesis without Vector Quantization
  
  Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
  
  July 2024
  
  arXiv | July 2024
  
  Publication 项目
- VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
  
  Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
  
  June 2024
  
  arxiv | June 2024
  
  Publication 项目
- VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
  
  Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
  
  June 2024
  
  arXiv | June 2024
  
  Publication 项目
- VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
  
  Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
  
  June 2024
  
  arXiv | June 2024
  
  DOI Publication Publication 项目
- NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
  
  Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
  
  ICML | June 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- End-to-End Automatic Speech Recognition
  
  Jinyu Li
  
  MSR-TR-2024-30 | May 2024
  
  作者：Microsoft
  
  IEEE SPS Webinar
  
  Publication
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation
  
  Sara Pap, Peidong Wang, Junkun Chen, Jian Xue, Naoyuki Kanda, Jinyu Li, Yashesh Gaur
  
  ICASSP | April 2024
  
  Publication
- ResidualTransformer: Residual Low-Rank Learning with Weight-Sharing for Transformer Layers
  
  Yiming Wang, Jinyu Li
  
  ICASSP | April 2024
  
  Publication
- t-SOT FNT: streaming multi-talker ASR with text-only domain adaptation capability
  
  Jian Wu, Naoyuki Kanda, Takuya Yoshioka, Rui Zhao, Zhuo Chen, Jinyu Li
  
  ICASSP | April 2024
  
  Publication
- WavLLM: Towards Robust and Adaptive Speech Large Language Model
  
  Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
  
  March 2024
  
  arXiv | March 2024
  
  DOI Publication Publication
- SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data
  
  Ziqiang Zhang, Sanyuan Chen, Long Zhou, Yu Wu, Shuo Ren, Shujie Liu, Zhuoyuan Yao, Xun Gong, Lirong Dai, Jinyu Li, Furu Wei
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2024
  
  Publication
- Advanced Long-Content Speech Recognition with Factorized Neural Transducer
  
  Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2024
  
  Publication
- A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability
  
  Jian Xue, Peidong Wang, Jinyu Li, Eric Sun
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training
  
  Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
  
  December 2023
  
  Publication
- Decoder-only Modeling for Speech
  
  Jinyu Li
  
  December 2023
  
  December 2023
  
  Invited Talk at NTU and SJTU
  
  Publication
- Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach
  
  Junkun Chen, Jian Xue, Peidong Wang, Jing Pan, Jinyu Li
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Large-Scale Streaming End-to-End Speech Translation
  
  Jinyu Li
  
  December 2023
  
  December 2023
  
  Invited Talk at NTU and SJTU
  
  Publication
- On decoder-only architecture for speech-to-text and large language model integration
  
  Jian Wu, Yashesh Gaur, Zhuo Chen, Long Zhou, Yimeng Zhu, Tianrui Wang, Jinyu Li, Shujie Liu, Bo Ren, Linquan Liu, Yu Wu
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition
  
  Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
- Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignments
  
  Sara Papi, Peidong Wang, Junkun Chen, Jian Xue, Jinyu Li, Yashesh Gaur
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Recent Advances in End-to-End Automatic Speech Recognition (Invited Talk at ASC 2023)
  
  Jinyu Li
  
  | November 2023
  
  作者：Microsoft
  
  Publication
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Accelerating Transducers through Adjacent Token Merging
  
  Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
  
  Interspeech | August 2023
  
  Publication
- LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model Using Neural Transducers
  
  Peidong Wang, Eric Sun, Jian Xue, Yu Wu, Long Zhou, Yashesh Gaur, Shujie Liu, Jinyu Li
  
  Interspeech | August 2023
  
  Publication
- CTCBERT: Advancing Hidden-unit BERT with CTC Objectives
  
  Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li
  
  ICASSP | June 2023
  
  Publication
- Fast and accurate factorized neural transducer for text adaption of end-to-end speech recognition models
  
  Rui Zhao, Jian Xue, Partha Parthasarathy, Veljko Miljanic, Jinyu Li
  
  ICASSP | June 2023
  
  Publication
- Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation
  
  Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng zhao
  
  ICASSP | June 2023
  
  Publication
- Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation
  
  Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei
  
  ICASSP | June 2023
  
  Publication
- LongFNT: Long-form Speech Recognition with Factorized Neural Transducer
  
  Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
  
  ICASSP | June 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  ICASSP | June 2023
  
  Publication
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  ICASSP | June 2023
  
  Publication
- Speaker Change Detection for Transformer Transducer ASR
  
  Jian Wu, Zhuo Chen, Min Hu, Xiong Xiao, Jinyu Li
  
  June 2023
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  ICASSP | June 2023
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  ICASSP | June 2023
  
  Publication
- VatLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning
  
  Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei
  
  IEEE Transactions on Multimedia | May 2023
  
  Publication
- Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling
  
  Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
  
  March 2023
  
  arXiv | March 2023
  
  Publication PDF 项目
- STREAMING, FAST AND ACCURATE ON-DEVICE INVERSE TEXT NORMALIZATION FOR AUTOMATIC SPEECH RECOGNITION
  
  Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphanso, Jinyu Li, Yifan Gong
  
  Spoken Language Technology Workshop | January 2023
  
  Publication
- Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
  
  Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
  
  January 2023
  
  arXiv | January 2023
  
  Publication PDF 项目
- Advancing end-to-end automatic speech recognition and beyond
  
  Jinyu Li
  
  International Symposium on Chinese Spoken Language Processing | December 2022
  
  Publication
- SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
  
  Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
  
  EMNLP 2022 | October 2022
  
  Publication
- Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
  
  Interspeech 2022 | September 2022
  
  Publication
- Large-Scale Streaming End-to-End Speech Translation with Neural Transducers
  
  Jian Xue, Peidong Wang, Jinyu Li, Matt Post, Yashesh Gaur
  
  Interspeech | September 2022
  
  Publication
- Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data
  
  Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Separating Long-Form Speech with Group-Wise Permutation Invariant Training
  
  Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training
  
  Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Zhuo Chen, Gang Liu, Jinyu Li, Jian Wu, Xiangzhan Yu, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Towards Contextual Spelling Correction for Customization of End-to-End Speech Recognition Systems
  
  Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic, Sheng Zhao, Hosam Khalil
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2022, 第 30 卷: pp. 3089-3097
  
  Publication
- WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
  
  Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
  
  IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
  
  Publication
- A Configurable Multilingual Model is All You Need to Recognize All Languages
  
  Long Zhou, Jinyu Li, Eric Sun, Shujie Liu
  
  ICASSP 2022 | May 2022
  
  Publication
- Continuous Streaming Multi-Talker ASR with Dual-path Transducers
  
  Desh Raj, Liang Lu, Zhuo Chen, Yashesh Gaur, Jinyu Li
  
  ICASSP 2022 | May 2022
  
  Publication
- Endpoint Detection for Streaming End-to-End Multi-talker ASR
  
  Liang Lu, Jinyu Li, Yifan Gong
  
  ICASSP 2022 | May 2022
  
  Publication
- Factorized Neural Transducer for Efficient Language Model Adaptation
  
  Xie Chen, Zhong Meng, Sarangarajan Parthasarathy, Jinyu Li
  
  ICASSP 2022 | May 2022
  
  Publication
- Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition
  
  Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
  
  ICASSP 2022 | May 2022
  
  Publication
- Self-Supervised Learning for speech recognition with Intermediate layer supervision
  
  Chengyi Wang, Yu Wu, Sanyuan Chen, Shujie Liu, Jinyu Li, Yao Qian, Zhenglu Yang
  
  ICASSP 2022 | May 2022
  
  Publication
- UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
  
  ICASSP | May 2022
  
  Publication
- UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
  
  ICASSP 2022 | May 2022
  
  Publication
- Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognition
  
  Yiming Wang, Jinyu Li, Heming Wang, Yao Qian, Chengyi Wang, Yu Wu
  
  ICASSP 2022 | May 2022
  
  Publication
- Continuous Speech Separation with Recurrent Selective Attention Network
  
  Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
  
  ICASSP 2021 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing
  
  Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
  
  ACL 2022 | May 2022
  
  Publication
- Recent Advances in End-to-End Automatic Speech Recognition
  
  Jinyu Li
  
  APSIPA Transactions on Signal and Information Processing | April 2022
  
  Publication
- On Addressing Practical Challenges For RNN-Transducer
  
  Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2021
  
  Publication
- Advancing end-to-end automatic speech recognition
  
  Jinyu Li
  
  MSR-TR-2021-32 | October 2021
  
  作者：Microsoft
  
  Keynote talk at the conference on Computational Linguistics and Speech Processing, 2021.
  
  Publication
- A Light-weight contextual spelling correction model for customizing transducer-based speech recognition systems
  
  Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li
  
  Interspeech 2021 | August 2021
  
  Publication
- Improving Multilingual Transformer Transducer Models by Reducing Language Confusions
  
  Eric Sun, Jinyu Li, Zhong Meng, Yu Wu, Jian Xue, Shujie Liu, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS
  
  Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He
  
  Interspeech 2021 | August 2021
  
  Publication
- Investigation of Practical Aspects of Single Channel Speech Separation for ASR
  
  Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka, Naoyuki Kanda, Shujie Liu, Jinyu Li
  
  Interspeech 2021 | August 2021
  
  Publication
- Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
  
  Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Multiple Softmax Architecture for Streaming Multilingual End-to-End ASR Systems
  
  Vikas Joshi, Amit Das, Eric Sun, Rupesh Mehta, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
  
  Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias are All You Need
  
  Yan Huang, Guoli Ye, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Streaming Multi-talker Speech Recognition with Joint Speaker Identification
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Ultra Fast Speech Separation Model with Teacher Student Learning
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
  
  Interspeech 2021 | August 2021
  
  Publication
- Ensemble Combination between Different Time Segmentations
  
  Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
  
  2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
  
  Publication
- Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication
- Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
  
  Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Continuous speech separation with Conformer
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
  
  ICASSP | June 2021
  
  Publication
- Developing real-time streaming transformer transducer for speech recognition on large-scale dataset
  
  Xie Chen, Yu Wu, Zhenghao Wang, Shujie Liu, Jinyu Li
  
  ICASSP | June 2021
  
  Publication
- Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
  
  ICASSP | June 2021
  
  Publication
- Streaming end-to-end multi-talker speech recognition
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  IEEE Signal Processing Letter | April 2021, 第 28 卷
  
  Publication
- Adaptation Algorithms for Speech Recognition: An Overview
  
  Peter Bell, Joachim Fainberg, Ondrej Klejch, Jinyu Li, Steve Renals, Pawel Swietojanski
  
  IEEE Open Journal of Signal Processing | February 2021
  
  Publication
- Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
  
  Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
  
  SLT 2021 | January 2021
  
  Publication
- Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
  
  SLT 2021 | January 2021
  
  Publication
- Dual-Path RNN For Long Recording Speech Separation
  
  Chenda Li, Yi Luo, Cong Han, Jinyu Li, Takuya Yoshioka, Tianyan Zhou, Marc Delcroix, Keisuke Kinoshita, Christoph Boeddeker, Yanmin Qian, Shinji Watanabe, Zhuo Chen
  
  Spoken Language Technology Workshop | January 2021
  
  Publication
- Listen, Look and Deliberate: Visual context-aware speech recognition using pre-trained text-video representations
  
  Shahram Ghorbani, Yashesh Gaur, Yu Shi, Jinyu Li
  
  Spoken Language Technology Workshop | January 2021
  
  Publication
- Speaker Separation Using Speaker Inventories and Estimated Speech
  
  Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
  
  IEEE Transactions on Audio, Speech, and Language Processing | December 2020, 第 29 卷: pp. 537-546
  
  PDF DOI
- Developing streaming end-to-end models for automatic speech recognition in industry
  
  Jinyu Li
  
  MSR-TR-2020-45 | December 2020
  
  作者：Microsoft
  
  Publication
- Sequence-Level Self-Learning with Multiple Hypotheses
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  Interspeech | October 2020
  
  Publication DOI 项目
- Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
  
  Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition
  
  Jinyu Li, Yu Wu, Yashesh Gaur, Chengyi Wang, Rui Zhao , Shujie Liu
  
  Interspeech | October 2020
  
  Publication
- Sequence-level self-learning with multi-task learning framework
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  October 2020
  
  项目
- An End-to-end Architecture of Online Multi-channel Speech Separation
  
  Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo , Lei Xie
  
  Interspeech | October 2020
  
  Publication
- Combination of end-to-end and hybrid models for speech recognition
  
  Jeremy Wong, Yashesh Gaur, Rui Zhao, Liang Lu, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Exploring Transformers for Large-Scale Speech Recognition
  
  Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Low Latency End-to-End Streaming Speech Recognition with a Scout Network
  
  Chengyi Wang, Yu Wu, Liang Lu, Shujie Liu, Jinyu Li, Guoli Ye, Ming Zhou
  
  Interspeech | October 2020
  
  Publication
- Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator
  
  Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Semantic Mask for Transformer based End-to-End Speech Recognition
  
  Chengyi Wang, Yu Wu, yujiao du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao, Ming Zhou
  
  Interspeech | October 2020
  
  Publication
- Transfer Learning Approaches for Streaming End-to-End Speech Recognition System
  
  Vikas Joshi, Rui Zhao, Rupesh R. Mehta, Kshitiz Kumar, Jinyu Li
  
  Interspeech | October 2020
  
  Publication
- High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model
  
  Jinyu Li, Rui Zhao, Eric Sun, Jeremy Wong, Amit Das, Zhong Meng, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Continuous speech separation: dataset and analysis
  
  Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Xiong Xiao, Jinyu Li
  
  ICASSP | April 2020
  
  Publication
- Exploring pre-training with alignments for RNN transducer based end-to-end speech recognition
  
  Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- L-Vector: Neural Label Embedding for Domain Adaptation
  
  Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
  
  ICASSP | April 2020
  
  Publication
- Minimum latency training strategies for streaming sequence-to-sequence ASR
  
  Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Recent Progresses On Deep Learning For Speech Recognition
  
  Jinyu Li, Dong Yu
  
  Handbook of Pattern Recognition and Computer Vision: 6th Edition | 2020
  
  Publication
- Using personalized speech synthesis and neural language generator for rapid speaker adaptation
  
  Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units
  
  Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
  
  IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING | December 2019, pp. 1880-1892
  
  Publication
- Character-aware attention-based end-to-end speech recognition
  
  Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- CNN with phonetic attention for text-independent speaker verification
  
  Tianyan Zhou, yong zhao, Jinyu Li, Yifan Gong, Jian Wu
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Domain adaptation via teacher-student learning for end-to-end speech recognition
  
  Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Improving RNN Transducer Modeling for End-to-End Speech Recognition
  
  Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Speech Separation Using Speaker Inventory
  
  Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
  
  Automatic Speech Recognition and Understanding Workshop | November 2019
  
  PDF DOI
- Acoustic-to-Phrase Models for Speech Recognition
  
  Yashesh Gaur, Jinyu Li, Zhong Meng, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Layer Trajectory BLSTM
  
  Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Speaker Adaptation for Attention-Based End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Adversarial Speaker Adaptation
  
  Zhong Meng, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Adversarial Speaker Verification
  
  Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Attentive Adversarial Learning for Domain-Invariant Training
  
  Zhong Meng, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Conditional Teacher-Student Learning
  
  Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Improving Layer Trajectory LSTM With Future Context Frames
  
  Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Towards Code-Switching ASR for End-to-End CTC Models
  
  Ke Li, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Universal Acoustic Modeling Using Neural Mixture Models
  
  Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  SLT 2018 | December 2018
  
  Publication 项目
- Exploring layer trajectory LSTM with depth processing units and attention
  
  Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
  
  Spoken Language Technology | December 2018
  
  Publication
- MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  Spoken Language Technology | December 2018
  
  Publication
- Speaker Adaptation for End-to-End CTC Models
  
  Ke Li, Jinyu Li, yong zhao, Yifan Gong (ygong), Kshitiz Kumar
  
  Spoken Language Technology | December 2018
  
  Publication
- Adversarial Feature-Mapping for Speech Enhancement
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
  
  Interspeech 2018 | September 2018
  
  Publication
- Cycle-Consistent Speech Enhancement
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
  
  Interspeech 2018 | September 2018
  
  Publication
- Improved training for online end-to-end speech recognition systems
  
  Suyoun Kim, Michael L. Seltzer, Jinyu Li, Rui Zhao
  
  Interspeech 2018 | September 2018
  
  PDF
- Layer Trajectory LSTM
  
  Jinyu Li, Changliang Liu, Yifan Gong
  
  Interspeech 2018 | September 2018
  
  PDF
- Advancing Acoustic-to-Word CTC Model
  
  Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Advancing Connectionist Temporal Classification With Attention Modeling
  
  Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Developing Far-Field Speaker System Via Teacher-Student Learning
  
  Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Efficient Integration of Fixed Beamformers and Speech Separation Networks for Multi-Channel Far-Field Speech Separation
  
  Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
  
  ICASSP 2018 | April 2018
  
  Publication
- Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang (Fred) Juang
  
  ICASSP | April 2018
  
  Publication
- DOMAIN AND SPEAKER ADAPTATION FOR CORTANA SPEECH RECOGNITION
  
  Yong Zhao, Jinyu Li, Shixiong Zhang, Liping Chen, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Efficient integration of fixed beamformers and speech separation networks for multi-channel far-field speech separation
  
  Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Speaker-Invariant Training via Adversarial Learning
  
  Zhong Meng, Jinyu Li, Zhuo Chen, Yong Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang (Fred) Juang
  
  ICASSP | April 2018
  
  Publication
- Progressive Joint Modeling in Unsupervised Single-channel Overlapped Speech Recognition
  
  Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2018
  
  PDF
- Acoustic-To-Word Model Without OOV
  
  Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
  
  ASRU | December 2017
  
  PDF
- Cracking the cocktail party problem by multi-beam deep attractor network
  
  Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
  
  ASRU 2018 | December 2017
  
  Publication
- Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition
  
  Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
  
  ASRU | December 2017
  
  Publication
- Deep Learning Acoustic Model in Microsoft Cortana Voice Assistant
  
  Jinyu Li
  
  MSR-TR-2017-60 | November 2017
  
  作者：Microsoft
  
  Publication
- Improving mask learning based speech enhancement system with restoration layers and residual connection
  
  Zhuo Chen, Yan Huang, Jinyu Li, Yifan Gong
  
  Interspeech | August 2017
  
  Publication
- Large-Scale Domain Adaptation via Teacher-Student Learning
  
  Jinyu Li, Michael Seltzer, Xi Wang, Rui Zhao, Yifan Gong
  
  Interspeech | August 2017
  
  PDF
- Challenges and Solutions to Deep Learning Network Acoustic Modeling in Speech Recognition Products at Microsoft
  
  Yifan Gong, Jinyu Li
  
  New Era for Robust Speech Recognitino: Exploiting Deep Learning | 作者：Springer | 2017
  
  Publication 论文与出版物
- Recent Progresses in Deep Learning Based Acoustic Models
  
  Dong Yu, Jinyu Li
  
  IEEE/CAA JOURNAL OF AUTOMATICA SINICA | July 2017
  
  PDF
- Extended low-rank plus diagonal adaptation for deep and recurrent neural networks
  
  yong zhao, Jinyu Li, kshitiz kumar, Yifan Gong
  
  ICASSP | April 2017
  
  PDF
- Improved Cepstra Minimum-Mean-Square-Error Noise Reduction Algorithm For Robust Speech Recognition
  
  Jinyu Li, Yan Huang, Yifan Gong
  
  ICASSP | April 2017
  
  PDF
- End-to-End Attention Based Text-Dependent Speaker Verification
  
  Shixiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
  
  SLT workshop | December 2016
  
  PDF
- Deep Convolutional Neural Networks with Layer-wise Context Expansion and Attention
  
  Dong Yu, Wayne Xiong, Jasha Droppo, Andreas Stolcke, Guoli Ye, Jinyu Li, Geoffrey Zweig
  
  Proc. Interspeech | September 2016
  
  PDF 论文与出版物项目
- EXPLORING MULTIDIMENSIONAL LSTMS FOR LARGE VOCABULARY ASR
  
  Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
  
  ICASSP | March 2016
  
  PDF
- Low-rank Plus Diagonal Adaption for Deep Neural Networks
  
  Yong Zhao, Jinyu Li, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- Recurrent Support Vector Machines for Speech Recognition
  
  Shi-Xiong Zhang, Rui Zhao, Chaojun Liu, Jinyu Li, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- Simplifying Long Short-term Memory Acoustic Models for Fast Training and Decoding
  
  Yajie Miao, Jinyu Li, Yongqiang Wang, Shi-Xiong Zhang, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- LSTM Time and Frequency Recurrence for Automatic Speech Recognition
  
  Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
  
  IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
  
  PDF
- Compensation with Prior Knowledge
  
  Jinyu Li, Li Deng, Yifan Gong
  
  Robust Automatic Speech Recognition: A Bridge to Practical Applications | 作者：Elsevier | 2015
  
  PDF
- Robust Automatic Speech Recognition – A Bridge to Practical Applications (1st Edition)
  
  Jinyu Li, Li Deng, R. Haeb-Umbach, Y. Gong
  
  Published by Elsevier | October 2015
  
  Publication 论文与出版物
- Maximum a Posteriori Adaptation of Network Parameters in Deep Models
  
  Zheng Huang, Sabato Marco Siniscalchi, I-Fan Chen, Jinyu Li, Jiadong Wu, Chin-Hui Lee
  
  September 2015
  
  PDF
- Rapid Adaptation for Deep Neural Networks through Multi-Task Learning
  
  Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Ji Wu, Chin-Hui Lee
  
  Interspeech | September 2015
  
  PDF
- SVD-based Universal DNN Modeling for Multiple Scenarios
  
  Changliang Liu, Jinyu Li, Yifan Gong
  
  September 2015
  
  PDF
- An Analysis of Convolutional Neural Networks for Speech Recognition
  
  Jui-Ting Huang, Jinyu Li, Yifan Gong
  
  ICASSP | April 2015
  
  PDF
- Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression and Click-Through Data
  
  Yong Zhao, Jinyu Li, Jian Xue, Yifan Gong
  
  ICASSP | April 2015
  
  ICASSP
  
  PDF
- Small-footprint high-performance deep neural network-based speech recognition using split-VQ
  
  Yongqiang Wang, Jinyu Li, Yifan Gong
  
  ICASSP | April 2015
  
  PDF
- variable-activation and variable-input deep neural network for robust speech recognition
  
  Rui Zhao, Jinyu Li, Yifan Gong
  
  IEEE SLT workshop | December 2014
  
  Publication
- Beyond Cross-entropy: Towards Better Frame-level Objective Functions For Deep Neural Network Training In Automatic Speech Recognition
  
  Zhen Huang, Jinyu Li, Chao Weng, Chin-Hui Lee
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Deep Neural Network for Automatic Speech Recognition: from the Industry’s View
  
  Jinyu Li
  
  September 2014
  
  September 2014
  
  PDF
- Feature Space Maximum A Posteriori Linear Regression for Adaptation of Deep Neural Networks
  
  Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Chao Weng, Chin-Hui Lee
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Learning Small-Size DNN with Output-Distribution-Based Criteria
  
  Jinyu Li, Rui Zhao, Jui-Ting Huang, Yifan Gong
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Variable-Component Deep Neural Network for Robust Speech Recognition
  
  Jinyu Li, Yifan Gong
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- An Overview of Noise-Robust Automatic Speech Recognition
  
  Jinyu Li, Li Deng, Yifan Gong, Reinhold Haeb-Umbach
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | April 2014, 第 22 卷: pp. 745
  
  PDF
- Factorized adaptation for deep neural network
  
  Jinyu Li, Jui-Ting Huang, Yifan Gong
  
  ICASSP | January 2014
  
  PDF
- Feature Compensation Using Linear Combination of Speaker and Environment Dependent Correction Vectors
  
  Xiong Xiao, Jinyu Li, Eng Siong Chng, Haizhou Li
  
  ICASSP | January 2014
  
  Publication
- Investigation of Maxout Networks For Speech Recognition
  
  Pawel Swietojanski, Jinyu Li, Jui-Ting Huang
  
  ICASSP | January 2014
  
  Publication
- Singular Value Decomposition Based Low-footprint Speaker Adaptation and Personalization for Deep Neural Network
  
  Jian Xue, Jinyu Li, Dong Yu, Mike Seltzer, Yifan Gong
  
  ICASSP | January 2014
  
  PDF
- Cross-language Knowledge Transfer using Multilingual Deep Neural Network with Shared Hidden Layers
  
  Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  PDF
- Feature Learning in Deep Neural Networks – Studies on Speech Recognition
  
  Dong Yu, Mike Seltzer, Jinyu Li, Jui-Ting Huang, Frank Seide
  
  International Conference on Learning Representations | May 2013
  
  PDF
- Recent Advances in Deep Learning for Speech Research at Microsoft
  
  Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
  
  May 2013
  
  PDF 项目
- Hermitian Polynomial for Speaker Adaptation of Connectionist Speech Recognition Systems
  
  Sabato Marco Simiscalchi, Jinyu Li, Chin-Hui Lee
  
  IEEE Transactions on Audio, Speech, and Language Processing | January 2013
  
  PDF
- Investigations on Hessian-Free Optimization for Cross-Entropy Training of Deep Neural Networks
  
  Simon Wiesler, Jinyu Li, Jian Xue
  
  Interspeech | January 2013
  
  Interspeech
  
  PDF
- Model-Based Margin Estimation for Hidden Markov Model Learning and Generalization
  
  Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee
  
  IET Signal Processing | January 2013
  
  PDF
- Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition
  
  Jian Xue, Jinyu Li, Yifan Gong
  
  Interspeech | January 2013
  
  PDF
- Improvements to VTS Feature Enhancement
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  March 2012
  
  PDF
- Efficient VTS Adaptation Using Jacobian Approximation
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  Interspeech | January 2012
  
  PDF
- Improvements to VTS feature enhancement
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  Proc. ICASSP | January 2012
  
  PDF
- Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM
  
  Jinyu Li, Dong Yu, Jui-Ting Huang, Tifan Gong
  
  IEEE Workshop on Spoken Language Technology | January 2012
  
  PDF
- LASSO environment model combination for robust speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2012
  
  PDF
- Calibration of Confidence Measures In Speech Recognition
  
  Dong Yu, Jinyu Li, Li Deng
  
  IEEE Transactions on Audio, Speech, and Language Processing | November 2011
  
  PDF
- Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
  
  Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  ICML Workshop 2011 | June 2011
  
  PDF
- Calibration of Confidence Measures In Speech Recognition
  
  Dong Yu, Jinyu Li, Li Deng
  
  IEEE Transactions on Audio, Speech and Language Processing | January 2011
  
  PDF
- Feature normalization using structured full transforms for robust speech recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2011
  
  Proc. Interspeech
  
  PDF
- LASSO model adaptation for automatic speech recognition
  
  Jinyu Li, Ming Yuan, Chin-Hui Lee
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing | January 2011
  
  PDF
- Maximum likelihood adaptation of histogram equalization with constraint for robust speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2011
  
  Proc. ICASSP
  
  PDF
- Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
  
  Jinyu Li, Li Deng, Dong Yu
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing | January 2011
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing
  
  PDF
- Unscented Transform with Online Distortion Estimation for HMM Adaptation
  
  Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  Interspeech 2010 | September 2010
  
  PDF
- Word Confidence Calibration Using A Maximum Entropy Model With Constraints On Confidence and Word Distributions
  
  Dong Yu, Shizhen Wang, Jinyu Li, Li Deng
  
  March 2010
  
  PDF
- A study on the generalization capability of acoustic models for robust speech recognition
  
  Jinyu Li
  
  IEEE Transactions on Audio, Speech and Language Processing | January 2010
  
  PDF
- Shrinkage Model Adaptation in Automatic Speech Recognition
  
  Jinyu Li, Yu Tsao, Chin-Hui Lee
  
  Interspeech | January 2010
  
  PDF
- Unscented transform with online distortion estimation for HMM adaptation
  
  Jinyu Li
  
  Proc. Interspeech | January 2010
  
  PDF
- Word Confidence Calibration Using A Maximum Entropy Model With Constraints On Confidence and Word Distributions
  
  Jinyu Li, Li Deng, Dong Yu
  
  Proc. ICASSP | January 2010
  
  PDF
- A study on hidden Markov model’s generalization capability for speech recognition
  
  Jinyu Li
  
  Proc. ASRU | January 2009
  
  PDF
- A study on soft margin estimation of linear regression parameters for speaker adaptation
  
  Jinyu Li
  
  Proc. Interspeech | January 2009
  
  PDF
- A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Computer Speech and Language | January 2009, 第 23 卷: pp. 389-405
  
  PDF 项目项目
- Ensemble speaker and speaking environment modeling approach with advanced online estimation process
  
  Yu Tsao, Jinyu Li, Chin-Hui Lee
  
  Proc. ICASSP | January 2009
  
  Proc. ICASSP
  
  PDF
- Soft margin estimation on improving environment structures for ensemble speaker and speaking environment modeling
  
  Jinyu Li
  
  ACM Proc. the 3rd International Universal Communication Symposium | January 2009
  
  ACM Proc. the 3rd International Universal Communication Symposium
  
  PDF
- SOFT MARGIN ESTIMATION FOR AUTOMATIC SPEECH RECOGNITION
  
  Jinyu Li
  
  December 2008
  
  December 2008
  
  PDF
- Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目
- HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目项目
- HMM adaptation using a phase-sensitive acoustic distortion model for environment-robust speech recognition
  
  Jinyu Li, Li Deng, Dong Yu, Alex Acero
  
  Proc. ICASSP | January 2008
  
  Proc. ICASSP
  
  PDF
- On a Generalization of Margin-Based Discriminative Training to Robust Speech Recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2008
  
  PDF
- Soft Margin Estimation with Various Separation Levels for LVCSR
  
  Jinyu Li
  
  Proc. Interspeech | January 2008
  
  PDF
- High-Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions Via Vector Taylor Series
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Proceedings IEEE Workshop on ASRU | April 2007
  
  Proceedings IEEE Workshop on ASRU
  
  PDF 项目项目
- A study on soft margin estimation for LVCSR
  
  Jinyu Li
  
  Proc. IEEE Automatic Speech Recognition and Understanding | January 2007
  
  PDF
- Approximate Test Risk Bound Minimization through Soft Margin Estimation
  
  Jinyu Li
  
  IEEE Trans. on Audio, Speech, and Language Proc | January 2007
  
  PDF
- Approximate test risk minimization through soft margin estimation
  
  Jinyu Li
  
  Proc. ICASSP | January 2007
  
  PDF
- Detection-Based ASR in the Automatic Speech Attribute Transcription Project
  
  Jinyu Li
  
  Proc. Interspeech | January 2007
  
  Proc. Interspeech
  
  PDF
- High-Performance HMM Adaptation with Joint Compensation of Additive and Convolutive Distortions via Vector Taylor Series
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Proc. IEEE Automatic Speech Recognition and Understanding | January 2007
  
  Proc. IEEE Automatic Speech Recognition and Understanding
  
  PDF
- Soft Margin Feature Extraction for Automatic Speech Recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2007
  
  PDF
- A study on lattice rescoring with knowledge scores for automatic speech recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2006
  
  Proc. Interspeech
  
  PDF
- Application of EÎ±Nets to feature recognitionof articulation manner in knowledge-based automatic speech recognition
  
  Jinyu Li
  
  Lecture Notes in Computer Science | January 2006
  
  PDF
- Language recognition based on score distribution feature vectors and discriminative classifier fusion
  
  Jinyu Li
  
  Proc. IEEE Odyssey Workshop on Speaker and Language Recognition | January 2006
  
  PDF
- Soft Margin Estimation of Hidden Markov Model Parameters (best student paper)
  
  Jinyu Li
  
  Proc. Interspeech | January 2006
  
  Best Student Paper
  
  PDF
- A study on knowledge source integration for candidate rescoring in automatic speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2005
  
  PDF
- A study on separation between acoustic models and its applications
  
  Jinyu Li
  
  Proc. Interspeech | January 2005
  
  PDF
- On Designing and Evaluating Speech Event Detectors
  
  Jinyu Li
  
  Proc. Interspeech | January 2005
  
  PDF
- A complexity reduction of ETSI advanced front-end for DSR
  
  Jinyu Li
  
  Proc. ICASSP | January 2004
  
  PDF
- Dimensionality reduction using MCE-optimized LDA transformation
  
  Jinyu Li
  
  Proc. ICASSP | January 2004
  
  PDF
- A novelsearch algorithm for LSF VQ
  
  Jinyu Li
  
  Proc. ICSLP | January 2000
  
  Proc. ICSLP
  
  PDF

- DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation
  
  Yayue Deng, Dingdong Wang, Yuxuan Hu, Jinyu Li, Yanqing Liu, Yuanyuan Wang, Weidong Chen, Helen M. Meng, Shujie Liu, Xixin Wu, Jinyu Li, Yanqing Liu
  
  EMNLP 2026 | September 2026
  
  Publication
- EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning
  
  Dingdong Wang, Shujie Liu, Tianhua Zhang, Youjun Chen, Jinyu Li, Helen M. Meng
  
  ICLR 2026 | January 2026
  
  Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation
  
  Zongyi Li, Shujie Hu, Shujie Liu, Long Zhou, Jeongsoo Choi, Lingwei Meng, Xun Guo, Jinyu Li, Hefei Ling, Furu Wei
  
  October 2024
  
  October 2024
  
  Publication
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- Autoregressive Speech Synthesis without Vector Quantization
  
  Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
  
  July 2024
  
  arXiv | July 2024
  
  Publication 项目
- VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
  
  Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
  
  June 2024
  
  arxiv | June 2024
  
  Publication 项目
- VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
  
  Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
  
  June 2024
  
  arXiv | June 2024
  
  DOI Publication Publication 项目
- NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
  
  Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
  
  ICML | June 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- WavLLM: Towards Robust and Adaptive Speech Large Language Model
  
  Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
  
  March 2024
  
  arXiv | March 2024
  
  DOI Publication Publication
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling
  
  Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
  
  March 2023
  
  arXiv | March 2023
  
  Publication PDF 项目
- SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
  
  Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
  
  EMNLP 2022 | October 2022
  
  Publication
- Separating Long-Form Speech with Group-Wise Permutation Invariant Training
  
  Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
  
  Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
  
  IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
  
  Publication
- Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
  
  Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Streaming Multi-talker Speech Recognition with Joint Speaker Identification
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
  
  Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Ensemble Combination between Different Time Segmentations
  
  Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
  
  2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
  
  Publication
- Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication
- Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
  
  Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Streaming end-to-end multi-talker speech recognition
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  IEEE Signal Processing Letter | April 2021, 第 28 卷
  
  Publication
- Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
  
  Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
  
  SLT 2021 | January 2021
  
  Publication
- Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
  
  SLT 2021 | January 2021
  
  Publication
- Speaker Separation Using Speaker Inventories and Estimated Speech
  
  Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
  
  IEEE Transactions on Audio, Speech, and Language Processing | December 2020, 第 29 卷: pp. 537-546
  
  PDF DOI
- Sequence-Level Self-Learning with Multiple Hypotheses
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  Interspeech | October 2020
  
  Publication DOI 项目
- Sequence-level self-learning with multi-task learning framework
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  October 2020
  
  项目
- Speech Separation Using Speaker Inventory
  
  Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
  
  Automatic Speech Recognition and Understanding Workshop | November 2019
  
  PDF DOI
- Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  SLT 2018 | December 2018
  
  Publication 项目
- Robust Automatic Speech Recognition – A Bridge to Practical Applications (1st Edition)
  
  Jinyu Li, Li Deng, R. Haeb-Umbach, Y. Gong
  
  Published by Elsevier | October 2015
  
  Publication 论文与出版物
- Small-footprint high-performance deep neural network-based speech recognition using split-VQ
  
  Yongqiang Wang, Jinyu Li, Yifan Gong
  
  ICASSP | April 2015
  
  PDF
- Recent Advances in Deep Learning for Speech Research at Microsoft
  
  Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
  
  May 2013
  
  PDF 项目
- Feature Learning in Deep Neural Networks – Studies on Speech Recognition
  
  Dong Yu, Mike Seltzer, Jinyu Li, Jui-Ting Huang, Frank Seide
  
  International Conference on Learning Representations | May 2013
  
  PDF
- Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
  
  Jinyu Li, Li Deng, Dong Yu
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing | January 2011
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing
  
  PDF
- Word Confidence Calibration Using A Maximum Entropy Model With Constraints On Confidence and Word Distributions
  
  Jinyu Li, Li Deng, Dong Yu
  
  Proc. ICASSP | January 2010
  
  PDF
- Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目
- HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目项目
- DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation
  
  Yayue Deng, Dingdong Wang, Yuxuan Hu, Jinyu Li, Yanqing Liu, Yuanyuan Wang, Weidong Chen, Helen M. Meng, Shujie Liu, Xixin Wu, Jinyu Li, Yanqing Liu
  
  EMNLP 2026 | September 2026
  
  Publication
- EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning
  
  Dingdong Wang, Shujie Liu, Tianhua Zhang, Youjun Chen, Jinyu Li, Helen M. Meng
  
  ICLR 2026 | January 2026
  
  Publication
- Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audio
  
  Mohan Shi, Xiong Xiao, Ruchao Fan, Shaoshi Ling, Jinyu Li
  
  November 2025
  
  arXiv | November 2025
  
  Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- Autoregressive Speech Synthesis without Vector Quantization
  
  Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
  
  July 2024
  
  arXiv | July 2024
  
  Publication 项目
- VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
  
  Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
  
  June 2024
  
  arxiv | June 2024
  
  Publication 项目
- VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
  
  Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
  
  June 2024
  
  arXiv | June 2024
  
  DOI Publication Publication 项目
- NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
  
  Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
  
  ICML | June 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- WavLLM: Towards Robust and Adaptive Speech Large Language Model
  
  Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
  
  March 2024
  
  arXiv | March 2024
  
  DOI Publication Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling
  
  Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
  
  March 2023
  
  arXiv | March 2023
  
  Publication PDF 项目
- Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
  
  Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
  
  January 2023
  
  arXiv | January 2023
  
  Publication PDF 项目
- SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
  
  Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
  
  EMNLP 2022 | October 2022
  
  Publication
- Separating Long-Form Speech with Group-Wise Permutation Invariant Training
  
  Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Factorized Neural Transducer for Efficient Language Model Adaptation
  
  Xie Chen, Zhong Meng, Sarangarajan Parthasarathy, Jinyu Li
  
  ICASSP 2022 | May 2022
  
  Publication
- Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition
  
  Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
  
  ICASSP 2022 | May 2022
  
  Publication
- Continuous Streaming Multi-Talker ASR with Dual-path Transducers
  
  Desh Raj, Liang Lu, Zhuo Chen, Yashesh Gaur, Jinyu Li
  
  ICASSP 2022 | May 2022
  
  Publication
- Endpoint Detection for Streaming End-to-End Multi-talker ASR
  
  Liang Lu, Jinyu Li, Yifan Gong
  
  ICASSP 2022 | May 2022
  
  Publication
- Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognition
  
  Yiming Wang, Jinyu Li, Heming Wang, Yao Qian, Chengyi Wang, Yu Wu
  
  ICASSP 2022 | May 2022
  
  Publication
- Self-Supervised Learning for speech recognition with Intermediate layer supervision
  
  Chengyi Wang, Yu Wu, Sanyuan Chen, Shujie Liu, Jinyu Li, Yao Qian, Zhenglu Yang
  
  ICASSP 2022 | May 2022
  
  Publication
- A Configurable Multilingual Model is All You Need to Recognize All Languages
  
  Long Zhou, Jinyu Li, Eric Sun, Shujie Liu
  
  ICASSP 2022 | May 2022
  
  Publication
- UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
  
  ICASSP 2022 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- Continuous Speech Separation with Recurrent Selective Attention Network
  
  Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
  
  ICASSP 2021 | May 2022
  
  Publication
- Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
  
  Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Streaming Multi-talker Speech Recognition with Joint Speaker Identification
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
  
  Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Ensemble Combination between Different Time Segmentations
  
  Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
  
  2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
  
  Publication
- Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication
- Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
  
  Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Streaming end-to-end multi-talker speech recognition
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  IEEE Signal Processing Letter | April 2021, 第 28 卷
  
  Publication
- Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
  
  Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
  
  SLT 2021 | January 2021
  
  Publication
- Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
  
  SLT 2021 | January 2021
  
  Publication
- Speaker Separation Using Speaker Inventories and Estimated Speech
  
  Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
  
  IEEE Transactions on Audio, Speech, and Language Processing | December 2020, 第 29 卷: pp. 537-546
  
  PDF DOI
- An End-to-end Architecture of Online Multi-channel Speech Separation
  
  Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo , Lei Xie
  
  Interspeech | October 2020
  
  Publication
- Continuous speech separation: dataset and analysis
  
  Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Xiong Xiao, Jinyu Li
  
  ICASSP | April 2020
  
  Publication
- Speech Separation Using Speaker Inventory
  
  Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
  
  Automatic Speech Recognition and Understanding Workshop | November 2019
  
  PDF DOI
- Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  SLT 2018 | December 2018
  
  Publication 项目
- MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  Spoken Language Technology | December 2018
  
  Publication
- Efficient Integration of Fixed Beamformers and Speech Separation Networks for Multi-Channel Far-Field Speech Separation
  
  Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
  
  ICASSP 2018 | April 2018
  
  Publication
- Cracking the cocktail party problem by multi-beam deep attractor network
  
  Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
  
  ASRU 2018 | December 2017
  
  Publication
- DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation
  
  Yayue Deng, Dingdong Wang, Yuxuan Hu, Jinyu Li, Yanqing Liu, Yuanyuan Wang, Weidong Chen, Helen M. Meng, Shujie Liu, Xixin Wu, Jinyu Li, Yanqing Liu
  
  EMNLP 2026 | September 2026
  
  Publication
- Boosting Large Language Model for Speech Synthesis: An Empirical Study
  
  Hongkun Hao, Long Zhou, Shujie Liu, Jinyu Li, Shujie Hu, Rui Wang, Furu Wei
  
  ICASSP | April 2025
  
  Publication
- V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow
  
  Jeongsoo Choi, Ji-Hoon Kim, Jinyu Li, Joon Son Chung, Shujie Liu
  
  ICASSP | April 2025
  
  Publication
- Target word activity detector: An approach to obtain ASR word boundaries without lexicon
  
  Sunit Sivasankaran, Eric Sun, Jinyu Li, Yan Huang, Jing Pan
  
  ICASSP | April 2025
  
  Publication
- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation
  
  Rui Zhao, Jinyu Li, Ruchao Fan, Matt Post
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation
  
  Peidong Wang, Jian Xue, Jinyu Li, Junkun Chen, Aswin Shanmugam Subramanian
  
  Interspeech 2024 | September 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning
  
  Jing Pan, Jian Wu, Yashesh Gaur , Sunit Sivasankaran, Zhuo Chen , Shujie Liu, Jinyu Li
  
  Interspeech 2024 | September 2024
  
  Publication
- VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
  
  Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
  
  June 2024
  
  arXiv | June 2024
  
  Publication 项目
- End-to-End Automatic Speech Recognition
  
  Jinyu Li
  
  MSR-TR-2024-30 | May 2024
  
  作者：Microsoft
  
  IEEE SPS Webinar
  
  Publication
- ResidualTransformer: Residual Low-Rank Learning with Weight-Sharing for Transformer Layers
  
  Yiming Wang, Jinyu Li
  
  ICASSP | April 2024
  
  Publication
- t-SOT FNT: streaming multi-talker ASR with text-only domain adaptation capability
  
  Jian Wu, Naoyuki Kanda, Takuya Yoshioka, Rui Zhao, Zhuo Chen, Jinyu Li
  
  ICASSP | April 2024
  
  Publication
- Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation
  
  Sara Pap, Peidong Wang, Junkun Chen, Jian Xue, Naoyuki Kanda, Jinyu Li, Yashesh Gaur
  
  ICASSP | April 2024
  
  Publication
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data
  
  Ziqiang Zhang, Sanyuan Chen, Long Zhou, Yu Wu, Shuo Ren, Shujie Liu, Zhuoyuan Yao, Xun Gong, Lirong Dai, Jinyu Li, Furu Wei
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2024
  
  Publication
- Advanced Long-Content Speech Recognition with Factorized Neural Transducer
  
  Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2024
  
  Publication
- Decoder-only Modeling for Speech
  
  Jinyu Li
  
  December 2023
  
  December 2023
  
  Invited Talk at NTU and SJTU
  
  Publication
- Large-Scale Streaming End-to-End Speech Translation
  
  Jinyu Li
  
  December 2023
  
  December 2023
  
  Invited Talk at NTU and SJTU
  
  Publication
- Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training
  
  Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
  
  December 2023
  
  Publication
- Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition
  
  Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
- On decoder-only architecture for speech-to-text and large language model integration
  
  Jian Wu, Yashesh Gaur, Zhuo Chen, Long Zhou, Yimeng Zhu, Tianrui Wang, Jinyu Li, Shujie Liu, Bo Ren, Linquan Liu, Yu Wu
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach
  
  Junkun Chen, Jian Xue, Peidong Wang, Jing Pan, Jinyu Li
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignments
  
  Sara Papi, Peidong Wang, Junkun Chen, Jian Xue, Jinyu Li, Yashesh Gaur
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability
  
  Jian Xue, Peidong Wang, Jinyu Li, Eric Sun
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Recent Advances in End-to-End Automatic Speech Recognition (Invited Talk at ASC 2023)
  
  Jinyu Li
  
  | November 2023
  
  作者：Microsoft
  
  Publication
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Accelerating Transducers through Adjacent Token Merging
  
  Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
  
  Interspeech | August 2023
  
  Publication
- LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model Using Neural Transducers
  
  Peidong Wang, Eric Sun, Jian Xue, Yu Wu, Long Zhou, Yashesh Gaur, Shujie Liu, Jinyu Li
  
  Interspeech | August 2023
  
  Publication
- Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation
  
  Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng zhao
  
  ICASSP | June 2023
  
  Publication
- Fast and accurate factorized neural transducer for text adaption of end-to-end speech recognition models
  
  Rui Zhao, Jian Xue, Partha Parthasarathy, Veljko Miljanic, Jinyu Li
  
  ICASSP | June 2023
  
  Publication
- Speaker Change Detection for Transformer Transducer ASR
  
  Jian Wu, Zhuo Chen, Min Hu, Xiong Xiao, Jinyu Li
  
  June 2023
  
  Publication
- Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation
  
  Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei
  
  ICASSP | June 2023
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  ICASSP | June 2023
  
  Publication
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  ICASSP | June 2023
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  ICASSP | June 2023
  
  Publication
- LongFNT: Long-form Speech Recognition with Factorized Neural Transducer
  
  Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
  
  ICASSP | June 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  ICASSP | June 2023
  
  Publication
- CTCBERT: Advancing Hidden-unit BERT with CTC Objectives
  
  Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li
  
  ICASSP | June 2023
  
  Publication
- VatLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning
  
  Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei
  
  IEEE Transactions on Multimedia | May 2023
  
  Publication
- STREAMING, FAST AND ACCURATE ON-DEVICE INVERSE TEXT NORMALIZATION FOR AUTOMATIC SPEECH RECOGNITION
  
  Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphanso, Jinyu Li, Yifan Gong
  
  Spoken Language Technology Workshop | January 2023
  
  Publication
- Advancing end-to-end automatic speech recognition and beyond
  
  Jinyu Li
  
  International Symposium on Chinese Spoken Language Processing | December 2022
  
  Publication
- SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
  
  Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
  
  EMNLP 2022 | October 2022
  
  Publication
- Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Zhuo Chen, Gang Liu, Jinyu Li, Jian Wu, Xiangzhan Yu, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Large-Scale Streaming End-to-End Speech Translation with Neural Transducers
  
  Jian Xue, Peidong Wang, Jinyu Li, Matt Post, Yashesh Gaur
  
  Interspeech | September 2022
  
  Publication
- Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data
  
  Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training
  
  Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Separating Long-Form Speech with Group-Wise Permutation Invariant Training
  
  Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Towards Contextual Spelling Correction for Customization of End-to-End Speech Recognition Systems
  
  Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic, Sheng Zhao, Hosam Khalil
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2022, 第 30 卷: pp. 3089-3097
  
  Publication
- WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
  
  Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
  
  IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
  
  Publication
- UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
  
  ICASSP | May 2022
  
  Publication
- SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing
  
  Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
  
  ACL 2022 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- Continuous Speech Separation with Recurrent Selective Attention Network
  
  Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
  
  ICASSP 2021 | May 2022
  
  Publication
- Recent Advances in End-to-End Automatic Speech Recognition
  
  Jinyu Li
  
  APSIPA Transactions on Signal and Information Processing | April 2022
  
  Publication
- On Addressing Practical Challenges For RNN-Transducer
  
  Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2021
  
  Publication
- Advancing end-to-end automatic speech recognition
  
  Jinyu Li
  
  MSR-TR-2021-32 | October 2021
  
  作者：Microsoft
  
  Keynote talk at the conference on Computational Linguistics and Speech Processing, 2021.
  
  Publication
- Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias are All You Need
  
  Yan Huang, Guoli Ye, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Multiple Softmax Architecture for Streaming Multilingual End-to-End ASR Systems
  
  Vikas Joshi, Amit Das, Eric Sun, Rupesh Mehta, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS
  
  Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He
  
  Interspeech 2021 | August 2021
  
  Publication
- Improving Multilingual Transformer Transducer Models by Reducing Language Confusions
  
  Eric Sun, Jinyu Li, Zhong Meng, Yu Wu, Jian Xue, Shujie Liu, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Investigation of Practical Aspects of Single Channel Speech Separation for ASR
  
  Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka, Naoyuki Kanda, Shujie Liu, Jinyu Li
  
  Interspeech 2021 | August 2021
  
  Publication
- Ultra Fast Speech Separation Model with Teacher Student Learning
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
  
  Interspeech 2021 | August 2021
  
  Publication
- A Light-weight contextual spelling correction model for customizing transducer-based speech recognition systems
  
  Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li
  
  Interspeech 2021 | August 2021
  
  Publication
- Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
  
  Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Streaming Multi-talker Speech Recognition with Joint Speaker Identification
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
  
  Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Ensemble Combination between Different Time Segmentations
  
  Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
  
  2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
  
  Publication
- Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication
- Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
  
  Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Developing real-time streaming transformer transducer for speech recognition on large-scale dataset
  
  Xie Chen, Yu Wu, Zhenghao Wang, Shujie Liu, Jinyu Li
  
  ICASSP | June 2021
  
  Publication
- Continuous speech separation with Conformer
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
  
  ICASSP | June 2021
  
  Publication
- Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
  
  ICASSP | June 2021
  
  Publication
- Streaming end-to-end multi-talker speech recognition
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  IEEE Signal Processing Letter | April 2021, 第 28 卷
  
  Publication
- Adaptation Algorithms for Speech Recognition: An Overview
  
  Peter Bell, Joachim Fainberg, Ondrej Klejch, Jinyu Li, Steve Renals, Pawel Swietojanski
  
  IEEE Open Journal of Signal Processing | February 2021
  
  Publication
- Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
  
  Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
  
  SLT 2021 | January 2021
  
  Publication
- Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
  
  SLT 2021 | January 2021
  
  Publication
- Listen, Look and Deliberate: Visual context-aware speech recognition using pre-trained text-video representations
  
  Shahram Ghorbani, Yashesh Gaur, Yu Shi, Jinyu Li
  
  Spoken Language Technology Workshop | January 2021
  
  Publication
- Dual-Path RNN For Long Recording Speech Separation
  
  Chenda Li, Yi Luo, Cong Han, Jinyu Li, Takuya Yoshioka, Tianyan Zhou, Marc Delcroix, Keisuke Kinoshita, Christoph Boeddeker, Yanmin Qian, Shinji Watanabe, Zhuo Chen
  
  Spoken Language Technology Workshop | January 2021
  
  Publication
- Speaker Separation Using Speaker Inventories and Estimated Speech
  
  Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
  
  IEEE Transactions on Audio, Speech, and Language Processing | December 2020, 第 29 卷: pp. 537-546
  
  PDF DOI
- Developing streaming end-to-end models for automatic speech recognition in industry
  
  Jinyu Li
  
  MSR-TR-2020-45 | December 2020
  
  作者：Microsoft
  
  Publication
- On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition
  
  Jinyu Li, Yu Wu, Yashesh Gaur, Chengyi Wang, Rui Zhao , Shujie Liu
  
  Interspeech | October 2020
  
  Publication
- Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
  
  Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Exploring Transformers for Large-Scale Speech Recognition
  
  Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- An End-to-end Architecture of Online Multi-channel Speech Separation
  
  Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo , Lei Xie
  
  Interspeech | October 2020
  
  Publication
- Combination of end-to-end and hybrid models for speech recognition
  
  Jeremy Wong, Yashesh Gaur, Rui Zhao, Liang Lu, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Low Latency End-to-End Streaming Speech Recognition with a Scout Network
  
  Chengyi Wang, Yu Wu, Liang Lu, Shujie Liu, Jinyu Li, Guoli Ye, Ming Zhou
  
  Interspeech | October 2020
  
  Publication
- Transfer Learning Approaches for Streaming End-to-End Speech Recognition System
  
  Vikas Joshi, Rui Zhao, Rupesh R. Mehta, Kshitiz Kumar, Jinyu Li
  
  Interspeech | October 2020
  
  Publication
- Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator
  
  Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Recent Progresses On Deep Learning For Speech Recognition
  
  Jinyu Li, Dong Yu
  
  Handbook of Pattern Recognition and Computer Vision: 6th Edition | 2020
  
  Publication
- Minimum latency training strategies for streaming sequence-to-sequence ASR
  
  Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Exploring pre-training with alignments for RNN transducer based end-to-end speech recognition
  
  Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Continuous speech separation: dataset and analysis
  
  Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Xiong Xiao, Jinyu Li
  
  ICASSP | April 2020
  
  Publication
- Using personalized speech synthesis and neural language generator for rapid speaker adaptation
  
  Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- L-Vector: Neural Label Embedding for Domain Adaptation
  
  Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
  
  ICASSP | April 2020
  
  Publication
- CNN with phonetic attention for text-independent speaker verification
  
  Tianyan Zhou, yong zhao, Jinyu Li, Yifan Gong, Jian Wu
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Character-aware attention-based end-to-end speech recognition
  
  Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Domain adaptation via teacher-student learning for end-to-end speech recognition
  
  Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Improving RNN Transducer Modeling for End-to-End Speech Recognition
  
  Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units
  
  Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
  
  IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING | December 2019, pp. 1880-1892
  
  Publication
- Speech Separation Using Speaker Inventory
  
  Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
  
  Automatic Speech Recognition and Understanding Workshop | November 2019
  
  PDF DOI
- Speaker Adaptation for Attention-Based End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Acoustic-to-Phrase Models for Speech Recognition
  
  Yashesh Gaur, Jinyu Li, Zhong Meng, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Layer Trajectory BLSTM
  
  Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Improving Layer Trajectory LSTM With Future Context Frames
  
  Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Adversarial Speaker Verification
  
  Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Adversarial Speaker Adaptation
  
  Zhong Meng, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Towards Code-Switching ASR for End-to-End CTC Models
  
  Ke Li, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Attentive Adversarial Learning for Domain-Invariant Training
  
  Zhong Meng, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Conditional Teacher-Student Learning
  
  Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Universal Acoustic Modeling Using Neural Mixture Models
  
  Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  SLT 2018 | December 2018
  
  Publication 项目
- Exploring layer trajectory LSTM with depth processing units and attention
  
  Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
  
  Spoken Language Technology | December 2018
  
  Publication
- MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  Spoken Language Technology | December 2018
  
  Publication
- Speaker Adaptation for End-to-End CTC Models
  
  Ke Li, Jinyu Li, yong zhao, Yifan Gong (ygong), Kshitiz Kumar
  
  Spoken Language Technology | December 2018
  
  Publication
- Improved training for online end-to-end speech recognition systems
  
  Suyoun Kim, Michael L. Seltzer, Jinyu Li, Rui Zhao
  
  Interspeech 2018 | September 2018
  
  PDF
- Adversarial Feature-Mapping for Speech Enhancement
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
  
  Interspeech 2018 | September 2018
  
  Publication
- Cycle-Consistent Speech Enhancement
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
  
  Interspeech 2018 | September 2018
  
  Publication
- Layer Trajectory LSTM
  
  Jinyu Li, Changliang Liu, Yifan Gong
  
  Interspeech 2018 | September 2018
  
  PDF
- Advancing Connectionist Temporal Classification With Attention Modeling
  
  Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Advancing Acoustic-to-Word CTC Model
  
  Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Developing Far-Field Speaker System Via Teacher-Student Learning
  
  Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Efficient Integration of Fixed Beamformers and Speech Separation Networks for Multi-Channel Far-Field Speech Separation
  
  Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
  
  ICASSP 2018 | April 2018
  
  Publication
- DOMAIN AND SPEAKER ADAPTATION FOR CORTANA SPEECH RECOGNITION
  
  Yong Zhao, Jinyu Li, Shixiong Zhang, Liping Chen, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Efficient integration of fixed beamformers and speech separation networks for multi-channel far-field speech separation
  
  Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Speaker-Invariant Training via Adversarial Learning
  
  Zhong Meng, Jinyu Li, Zhuo Chen, Yong Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang (Fred) Juang
  
  ICASSP | April 2018
  
  Publication
- Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang (Fred) Juang
  
  ICASSP | April 2018
  
  Publication
- Progressive Joint Modeling in Unsupervised Single-channel Overlapped Speech Recognition
  
  Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2018
  
  PDF
- Acoustic-To-Word Model Without OOV
  
  Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
  
  ASRU | December 2017
  
  PDF
- Cracking the cocktail party problem by multi-beam deep attractor network
  
  Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
  
  ASRU 2018 | December 2017
  
  Publication
- Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition
  
  Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
  
  ASRU | December 2017
  
  Publication
- Deep Learning Acoustic Model in Microsoft Cortana Voice Assistant
  
  Jinyu Li
  
  MSR-TR-2017-60 | November 2017
  
  作者：Microsoft
  
  Publication
- Improving mask learning based speech enhancement system with restoration layers and residual connection
  
  Zhuo Chen, Yan Huang, Jinyu Li, Yifan Gong
  
  Interspeech | August 2017
  
  Publication
- Large-Scale Domain Adaptation via Teacher-Student Learning
  
  Jinyu Li, Michael Seltzer, Xi Wang, Rui Zhao, Yifan Gong
  
  Interspeech | August 2017
  
  PDF
- Challenges and Solutions to Deep Learning Network Acoustic Modeling in Speech Recognition Products at Microsoft
  
  Yifan Gong, Jinyu Li
  
  New Era for Robust Speech Recognitino: Exploiting Deep Learning | 作者：Springer | 2017
  
  Publication 论文与出版物
- Recent Progresses in Deep Learning Based Acoustic Models
  
  Dong Yu, Jinyu Li
  
  IEEE/CAA JOURNAL OF AUTOMATICA SINICA | July 2017
  
  PDF
- Extended low-rank plus diagonal adaptation for deep and recurrent neural networks
  
  yong zhao, Jinyu Li, kshitiz kumar, Yifan Gong
  
  ICASSP | April 2017
  
  PDF
- Improved Cepstra Minimum-Mean-Square-Error Noise Reduction Algorithm For Robust Speech Recognition
  
  Jinyu Li, Yan Huang, Yifan Gong
  
  ICASSP | April 2017
  
  PDF
- End-to-End Attention Based Text-Dependent Speaker Verification
  
  Shixiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
  
  SLT workshop | December 2016
  
  PDF
- Deep Convolutional Neural Networks with Layer-wise Context Expansion and Attention
  
  Dong Yu, Wayne Xiong, Jasha Droppo, Andreas Stolcke, Guoli Ye, Jinyu Li, Geoffrey Zweig
  
  Proc. Interspeech | September 2016
  
  PDF 论文与出版物项目
- EXPLORING MULTIDIMENSIONAL LSTMS FOR LARGE VOCABULARY ASR
  
  Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
  
  ICASSP | March 2016
  
  PDF
- Recurrent Support Vector Machines for Speech Recognition
  
  Shi-Xiong Zhang, Rui Zhao, Chaojun Liu, Jinyu Li, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- Compensation with Prior Knowledge
  
  Jinyu Li, Li Deng, Yifan Gong
  
  Robust Automatic Speech Recognition: A Bridge to Practical Applications | 作者：Elsevier | 2015
  
  PDF
- Rapid Adaptation for Deep Neural Networks through Multi-Task Learning
  
  Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Ji Wu, Chin-Hui Lee
  
  Interspeech | September 2015
  
  PDF
- Maximum a Posteriori Adaptation of Network Parameters in Deep Models
  
  Zheng Huang, Sabato Marco Siniscalchi, I-Fan Chen, Jinyu Li, Jiadong Wu, Chin-Hui Lee
  
  September 2015
  
  PDF
- Small-footprint high-performance deep neural network-based speech recognition using split-VQ
  
  Yongqiang Wang, Jinyu Li, Yifan Gong
  
  ICASSP | April 2015
  
  PDF
- An Analysis of Convolutional Neural Networks for Speech Recognition
  
  Jui-Ting Huang, Jinyu Li, Yifan Gong
  
  ICASSP | April 2015
  
  PDF
- variable-activation and variable-input deep neural network for robust speech recognition
  
  Rui Zhao, Jinyu Li, Yifan Gong
  
  IEEE SLT workshop | December 2014
  
  Publication
- Beyond Cross-entropy: Towards Better Frame-level Objective Functions For Deep Neural Network Training In Automatic Speech Recognition
  
  Zhen Huang, Jinyu Li, Chao Weng, Chin-Hui Lee
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Deep Neural Network for Automatic Speech Recognition: from the Industry’s View
  
  Jinyu Li
  
  September 2014
  
  September 2014
  
  PDF
- An Overview of Noise-Robust Automatic Speech Recognition
  
  Jinyu Li, Li Deng, Yifan Gong, Reinhold Haeb-Umbach
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | April 2014, 第 22 卷: pp. 745
  
  PDF
- Investigation of Maxout Networks For Speech Recognition
  
  Pawel Swietojanski, Jinyu Li, Jui-Ting Huang
  
  ICASSP | January 2014
  
  Publication
- Feature Compensation Using Linear Combination of Speaker and Environment Dependent Correction Vectors
  
  Xiong Xiao, Jinyu Li, Eng Siong Chng, Haizhou Li
  
  ICASSP | January 2014
  
  Publication
- Hermitian Polynomial for Speaker Adaptation of Connectionist Speech Recognition Systems
  
  Sabato Marco Simiscalchi, Jinyu Li, Chin-Hui Lee
  
  IEEE Transactions on Audio, Speech, and Language Processing | January 2013
  
  PDF
- Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition
  
  Jian Xue, Jinyu Li, Yifan Gong
  
  Interspeech | January 2013
  
  PDF
- Improvements to VTS Feature Enhancement
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  March 2012
  
  PDF
- Improvements to VTS feature enhancement
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  Proc. ICASSP | January 2012
  
  PDF
- Efficient VTS Adaptation Using Jacobian Approximation
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  Interspeech | January 2012
  
  PDF
- Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM
  
  Jinyu Li, Dong Yu, Jui-Ting Huang, Tifan Gong
  
  IEEE Workshop on Spoken Language Technology | January 2012
  
  PDF
- Calibration of Confidence Measures In Speech Recognition
  
  Dong Yu, Jinyu Li, Li Deng
  
  IEEE Transactions on Audio, Speech and Language Processing | January 2011
  
  PDF
- A study on the generalization capability of acoustic models for robust speech recognition
  
  Jinyu Li
  
  IEEE Transactions on Audio, Speech and Language Processing | January 2010
  
  PDF
- A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Computer Speech and Language | January 2009, 第 23 卷: pp. 389-405
  
  PDF 项目项目
- A study on hidden Markov model’s generalization capability for speech recognition
  
  Jinyu Li
  
  Proc. ASRU | January 2009
  
  PDF
- HMM adaptation using a phase-sensitive acoustic distortion model for environment-robust speech recognition
  
  Jinyu Li, Li Deng, Dong Yu, Alex Acero
  
  Proc. ICASSP | January 2008
  
  Proc. ICASSP
  
  PDF
- High-Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions Via Vector Taylor Series
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Proceedings IEEE Workshop on ASRU | April 2007
  
  Proceedings IEEE Workshop on ASRU
  
  PDF 项目项目
- High-Performance HMM Adaptation with Joint Compensation of Additive and Convolutive Distortions via Vector Taylor Series
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Proc. IEEE Automatic Speech Recognition and Understanding | January 2007
  
  Proc. IEEE Automatic Speech Recognition and Understanding
  
  PDF
- Ensemble Combination between Different Time Segmentations
  
  Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
  
  2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
  
  Publication
- Sequence-level self-learning with multi-task learning framework
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  October 2020
  
  项目
- Semantic Mask for Transformer based End-to-End Speech Recognition
  
  Chengyi Wang, Yu Wu, yujiao du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao, Ming Zhou
  
  Interspeech | October 2020
  
  Publication
- High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model
  
  Jinyu Li, Rui Zhao, Eric Sun, Jeremy Wong, Amit Das, Zhong Meng, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Feature Learning in Deep Neural Networks – Studies on Speech Recognition
  
  Dong Yu, Mike Seltzer, Jinyu Li, Jui-Ting Huang, Frank Seide
  
  International Conference on Learning Representations | May 2013
  
  PDF
- Calibration of Confidence Measures In Speech Recognition
  
  Dong Yu, Jinyu Li, Li Deng
  
  IEEE Transactions on Audio, Speech, and Language Processing | November 2011
  
  PDF
- Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
  
  Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  ICML Workshop 2011 | June 2011
  
  PDF
- Unscented Transform with Online Distortion Estimation for HMM Adaptation
  
  Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  Interspeech 2010 | September 2010
  
  PDF
- Word Confidence Calibration Using A Maximum Entropy Model With Constraints On Confidence and Word Distributions
  
  Dong Yu, Shizhen Wang, Jinyu Li, Li Deng
  
  March 2010
  
  PDF
- A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Computer Speech and Language | January 2009, 第 23 卷: pp. 389-405
  
  PDF 项目项目
- Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目
- HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目项目
- Sequence-level self-learning with multi-task learning framework
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  October 2020
  
  项目
- Factorized adaptation for deep neural network
  
  Jinyu Li, Jui-Ting Huang, Yifan Gong
  
  ICASSP | January 2014
  
  PDF
- Simplifying Long Short-term Memory Acoustic Models for Fast Training and Decoding
  
  Yajie Miao, Jinyu Li, Yongqiang Wang, Shi-Xiong Zhang, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- Low-rank Plus Diagonal Adaption for Deep Neural Networks
  
  Yong Zhao, Jinyu Li, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- Learning Small-Size DNN with Output-Distribution-Based Criteria
  
  Jinyu Li, Rui Zhao, Jui-Ting Huang, Yifan Gong
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Cross-language Knowledge Transfer using Multilingual Deep Neural Network with Shared Hidden Layers
  
  Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  PDF
- Model-Based Margin Estimation for Hidden Markov Model Learning and Generalization
  
  Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee
  
  IET Signal Processing | January 2013
  
  PDF
- Shrinkage Model Adaptation in Automatic Speech Recognition
  
  Jinyu Li, Yu Tsao, Chin-Hui Lee
  
  Interspeech | January 2010
  
  PDF
- Ensemble speaker and speaking environment modeling approach with advanced online estimation process
  
  Yu Tsao, Jinyu Li, Chin-Hui Lee
  
  Proc. ICASSP | January 2009
  
  Proc. ICASSP
  
  PDF
- HMM adaptation using a phase-sensitive acoustic distortion model for environment-robust speech recognition
  
  Jinyu Li, Li Deng, Dong Yu, Alex Acero
  
  Proc. ICASSP | January 2008
  
  Proc. ICASSP
  
  PDF
- Approximate Test Risk Bound Minimization through Soft Margin Estimation
  
  Jinyu Li
  
  IEEE Trans. on Audio, Speech, and Language Proc | January 2007
  
  PDF
- A study on soft margin estimation for LVCSR
  
  Jinyu Li
  
  Proc. IEEE Automatic Speech Recognition and Understanding | January 2007
  
  PDF
- LSTM Time and Frequency Recurrence for Automatic Speech Recognition
  
  Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
  
  IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
  
  PDF
- Singular Value Decomposition Based Low-footprint Speaker Adaptation and Personalization for Deep Neural Network
  
  Jian Xue, Jinyu Li, Dong Yu, Mike Seltzer, Yifan Gong
  
  ICASSP | January 2014
  
  PDF
- Compensation with Prior Knowledge
  
  Jinyu Li, Li Deng, Yifan Gong
  
  Robust Automatic Speech Recognition: A Bridge to Practical Applications | 作者：Elsevier | 2015
  
  PDF
- SVD-based Universal DNN Modeling for Multiple Scenarios
  
  Changliang Liu, Jinyu Li, Yifan Gong
  
  September 2015
  
  PDF
- Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression and Click-Through Data
  
  Yong Zhao, Jinyu Li, Jian Xue, Yifan Gong
  
  ICASSP | April 2015
  
  ICASSP
  
  PDF
- Feature Space Maximum A Posteriori Linear Regression for Adaptation of Deep Neural Networks
  
  Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Chao Weng, Chin-Hui Lee
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- A novelsearch algorithm for LSF VQ
  
  Jinyu Li
  
  Proc. ICSLP | January 2000
  
  Proc. ICSLP
  
  PDF
- Variable-Component Deep Neural Network for Robust Speech Recognition
  
  Jinyu Li, Yifan Gong
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- LASSO environment model combination for robust speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2012
  
  PDF
- Maximum likelihood adaptation of histogram equalization with constraint for robust speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2011
  
  Proc. ICASSP
  
  PDF
- Feature normalization using structured full transforms for robust speech recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2011
  
  Proc. Interspeech
  
  PDF
- Unscented transform with online distortion estimation for HMM adaptation
  
  Jinyu Li
  
  Proc. Interspeech | January 2010
  
  PDF
- A study on soft margin estimation of linear regression parameters for speaker adaptation
  
  Jinyu Li
  
  Proc. Interspeech | January 2009
  
  PDF
- Soft margin estimation on improving environment structures for ensemble speaker and speaking environment modeling
  
  Jinyu Li
  
  ACM Proc. the 3rd International Universal Communication Symposium | January 2009
  
  ACM Proc. the 3rd International Universal Communication Symposium
  
  PDF
- SOFT MARGIN ESTIMATION FOR AUTOMATIC SPEECH RECOGNITION
  
  Jinyu Li
  
  December 2008
  
  December 2008
  
  PDF
- On a Generalization of Margin-Based Discriminative Training to Robust Speech Recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2008
  
  PDF
- Soft Margin Estimation with Various Separation Levels for LVCSR
  
  Jinyu Li
  
  Proc. Interspeech | January 2008
  
  PDF
- Approximate test risk minimization through soft margin estimation
  
  Jinyu Li
  
  Proc. ICASSP | January 2007
  
  PDF
- Detection-Based ASR in the Automatic Speech Attribute Transcription Project
  
  Jinyu Li
  
  Proc. Interspeech | January 2007
  
  Proc. Interspeech
  
  PDF
- Soft Margin Feature Extraction for Automatic Speech Recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2007
  
  PDF
- Soft Margin Estimation of Hidden Markov Model Parameters (best student paper)
  
  Jinyu Li
  
  Proc. Interspeech | January 2006
  
  Best Student Paper
  
  PDF
- Application of EÎ±Nets to feature recognitionof articulation manner in knowledge-based automatic speech recognition
  
  Jinyu Li
  
  Lecture Notes in Computer Science | January 2006
  
  PDF
- Language recognition based on score distribution feature vectors and discriminative classifier fusion
  
  Jinyu Li
  
  Proc. IEEE Odyssey Workshop on Speaker and Language Recognition | January 2006
  
  PDF
- A study on lattice rescoring with knowledge scores for automatic speech recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2006
  
  Proc. Interspeech
  
  PDF
- A study on knowledge source integration for candidate rescoring in automatic speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2005
  
  PDF
- A study on separation between acoustic models and its applications
  
  Jinyu Li
  
  Proc. Interspeech | January 2005
  
  PDF
- On Designing and Evaluating Speech Event Detectors
  
  Jinyu Li
  
  Proc. Interspeech | January 2005
  
  PDF
- Dimensionality reduction using MCE-optimized LDA transformation
  
  Jinyu Li
  
  Proc. ICASSP | January 2004
  
  PDF
- A complexity reduction of ETSI advanced front-end for DSR
  
  Jinyu Li
  
  Proc. ICASSP | January 2004
  
  PDF
- Investigations on Hessian-Free Optimization for Cross-Entropy Training of Deep Neural Networks
  
  Simon Wiesler, Jinyu Li, Jian Xue
  
  Interspeech | January 2013
  
  Interspeech
  
  PDF
- LASSO model adaptation for automatic speech recognition
  
  Jinyu Li, Ming Yuan, Chin-Hui Lee
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing | January 2011
  
  PDF

- A novelsearch algorithm for LSF VQ
  
  Jinyu Li
  
  Proc. ICSLP | January 2000
  
  Proc. ICSLP
  
  PDF
- DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation
  
  Yayue Deng, Dingdong Wang, Yuxuan Hu, Jinyu Li, Yanqing Liu, Yuanyuan Wang, Weidong Chen, Helen M. Meng, Shujie Liu, Xixin Wu, Jinyu Li, Yanqing Liu
  
  EMNLP 2026 | September 2026
  
  Publication
- EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning
  
  Dingdong Wang, Shujie Liu, Tianhua Zhang, Youjun Chen, Jinyu Li, Helen M. Meng
  
  ICLR 2026 | January 2026
  
  Publication
- CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching
  
  Leying Zhang, Yao Qian, Xiaofei Wang, Manthan Thakker, Dongmei Wang, Jianwei Yu, Haibin Wu, Yuxuan Hu, Jinyu Li, Yanmin Qian, Sheng Zhao
  
  NeurIPS 2025 | May 2025
  
  DOI
- Boosting Large Language Model for Speech Synthesis: An Empirical Study
  
  Hongkun Hao, Long Zhou, Shujie Liu, Jinyu Li, Shujie Hu, Rui Wang, Furu Wei
  
  ICASSP | April 2025
  
  Publication
- V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow
  
  Jeongsoo Choi, Ji-Hoon Kim, Jinyu Li, Joon Son Chung, Shujie Liu
  
  ICASSP | April 2025
  
  Publication
- Target word activity detector: An approach to obtain ASR word boundaries without lexicon
  
  Sunit Sivasankaran, Eric Sun, Jinyu Li, Yan Huang, Jing Pan
  
  ICASSP | April 2025
  
  Publication
- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation
  
  Rui Zhao, Jinyu Li, Ruchao Fan, Matt Post
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation
  
  Peidong Wang, Jian Xue, Jinyu Li, Junkun Chen, Aswin Shanmugam Subramanian
  
  Interspeech 2024 | September 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning
  
  Jing Pan, Jian Wu, Yashesh Gaur , Sunit Sivasankaran, Zhuo Chen , Shujie Liu, Jinyu Li
  
  Interspeech 2024 | September 2024
  
  Publication
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models
  
  Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao
  
  ICML | June 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication 项目
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication 项目
- ResidualTransformer: Residual Low-Rank Learning with Weight-Sharing for Transformer Layers
  
  Yiming Wang, Jinyu Li
  
  ICASSP | April 2024
  
  Publication
- t-SOT FNT: streaming multi-talker ASR with text-only domain adaptation capability
  
  Jian Wu, Naoyuki Kanda, Takuya Yoshioka, Rui Zhao, Zhuo Chen, Jinyu Li
  
  ICASSP | April 2024
  
  Publication
- Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation
  
  Sara Pap, Peidong Wang, Junkun Chen, Jian Xue, Naoyuki Kanda, Jinyu Li, Yashesh Gaur
  
  ICASSP | April 2024
  
  Publication
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training
  
  Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
  
  December 2023
  
  Publication
- Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition
  
  Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
- On decoder-only architecture for speech-to-text and large language model integration
  
  Jian Wu, Yashesh Gaur, Zhuo Chen, Long Zhou, Yimeng Zhu, Tianrui Wang, Jinyu Li, Shujie Liu, Bo Ren, Linquan Liu, Yu Wu
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach
  
  Junkun Chen, Jian Xue, Peidong Wang, Jing Pan, Jinyu Li
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignments
  
  Sara Papi, Peidong Wang, Junkun Chen, Jian Xue, Jinyu Li, Yashesh Gaur
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability
  
  Jian Xue, Peidong Wang, Jinyu Li, Eric Sun
  
  Workshop of Automatic Speech Recognition and Understanding | December 2023
  
  Publication
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- Accelerating Transducers through Adjacent Token Merging
  
  Yuang Li, Yu Wu, Jinyu Li, Shujie Liu
  
  Interspeech | August 2023
  
  Publication
- LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model Using Neural Transducers
  
  Peidong Wang, Eric Sun, Jian Xue, Yu Wu, Long Zhou, Yashesh Gaur, Shujie Liu, Jinyu Li
  
  Interspeech | August 2023
  
  Publication
- Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation
  
  Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng zhao
  
  ICASSP | June 2023
  
  Publication
- Fast and accurate factorized neural transducer for text adaption of end-to-end speech recognition models
  
  Rui Zhao, Jian Xue, Partha Parthasarathy, Veljko Miljanic, Jinyu Li
  
  ICASSP | June 2023
  
  Publication
- Speaker Change Detection for Transformer Transducer ASR
  
  Jian Wu, Zhuo Chen, Min Hu, Xiong Xiao, Jinyu Li
  
  June 2023
  
  Publication
- Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation
  
  Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei
  
  ICASSP | June 2023
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  ICASSP | June 2023
  
  Publication
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  ICASSP | June 2023
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  ICASSP | June 2023
  
  Publication
- LongFNT: Long-form Speech Recognition with Factorized Neural Transducer
  
  Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
  
  ICASSP | June 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  ICASSP | June 2023
  
  Publication
- CTCBERT: Advancing Hidden-unit BERT with CTC Objectives
  
  Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li
  
  ICASSP | June 2023
  
  Publication
- STREAMING, FAST AND ACCURATE ON-DEVICE INVERSE TEXT NORMALIZATION FOR AUTOMATIC SPEECH RECOGNITION
  
  Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphanso, Jinyu Li, Yifan Gong
  
  Spoken Language Technology Workshop | January 2023
  
  Publication
- Advancing end-to-end automatic speech recognition and beyond
  
  Jinyu Li
  
  International Symposium on Chinese Spoken Language Processing | December 2022
  
  Publication
- SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
  
  Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
  
  EMNLP 2022 | October 2022
  
  Publication
- Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Zhuo Chen, Gang Liu, Jinyu Li, Jian Wu, Xiangzhan Yu, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Large-Scale Streaming End-to-End Speech Translation with Neural Transducers
  
  Jian Xue, Peidong Wang, Jinyu Li, Matt Post, Yashesh Gaur
  
  Interspeech | September 2022
  
  Publication
- Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data
  
  Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training
  
  Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei
  
  Interspeech | September 2022
  
  Publication
- Separating Long-Form Speech with Group-Wise Permutation Invariant Training
  
  Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
  
  Interspeech 2022 | September 2022
  
  Publication
- UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
  
  ICASSP | May 2022
  
  Publication
- Factorized Neural Transducer for Efficient Language Model Adaptation
  
  Xie Chen, Zhong Meng, Sarangarajan Parthasarathy, Jinyu Li
  
  ICASSP 2022 | May 2022
  
  Publication
- Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition
  
  Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
  
  ICASSP 2022 | May 2022
  
  Publication
- Continuous Streaming Multi-Talker ASR with Dual-path Transducers
  
  Desh Raj, Liang Lu, Zhuo Chen, Yashesh Gaur, Jinyu Li
  
  ICASSP 2022 | May 2022
  
  Publication
- Endpoint Detection for Streaming End-to-End Multi-talker ASR
  
  Liang Lu, Jinyu Li, Yifan Gong
  
  ICASSP 2022 | May 2022
  
  Publication
- Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognition
  
  Yiming Wang, Jinyu Li, Heming Wang, Yao Qian, Chengyi Wang, Yu Wu
  
  ICASSP 2022 | May 2022
  
  Publication
- Self-Supervised Learning for speech recognition with Intermediate layer supervision
  
  Chengyi Wang, Yu Wu, Sanyuan Chen, Shujie Liu, Jinyu Li, Yao Qian, Zhenglu Yang
  
  ICASSP 2022 | May 2022
  
  Publication
- A Configurable Multilingual Model is All You Need to Recognize All Languages
  
  Long Zhou, Jinyu Li, Eric Sun, Shujie Liu
  
  ICASSP 2022 | May 2022
  
  Publication
- UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
  
  Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu
  
  ICASSP 2022 | May 2022
  
  Publication
- SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing
  
  Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei
  
  ACL 2022 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- Continuous Speech Separation with Recurrent Selective Attention Network
  
  Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
  
  ICASSP 2021 | May 2022
  
  Publication
- On Addressing Practical Challenges For RNN-Transducer
  
  Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2021
  
  Publication
- Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias are All You Need
  
  Yan Huang, Guoli Ye, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Multiple Softmax Architecture for Streaming Multilingual End-to-End ASR Systems
  
  Vikas Joshi, Amit Das, Eric Sun, Rupesh Mehta, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS
  
  Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He
  
  Interspeech 2021 | August 2021
  
  Publication
- Improving Multilingual Transformer Transducer Models by Reducing Language Confusions
  
  Eric Sun, Jinyu Li, Zhong Meng, Yu Wu, Jian Xue, Shujie Liu, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Investigation of Practical Aspects of Single Channel Speech Separation for ASR
  
  Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka, Naoyuki Kanda, Shujie Liu, Jinyu Li
  
  Interspeech 2021 | August 2021
  
  Publication
- Ultra Fast Speech Separation Model with Teacher Student Learning
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
  
  Interspeech 2021 | August 2021
  
  Publication
- A Light-weight contextual spelling correction model for customizing transducer-based speech recognition systems
  
  Xiaoqiang Wang, Yanqing Liu, Sheng Zhao, Jinyu Li
  
  Interspeech 2021 | August 2021
  
  Publication
- Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
  
  Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Streaming Multi-talker Speech Recognition with Joint Speaker Identification
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
  
  Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  Interspeech 2021 | August 2021
  
  Publication
- Ensemble Combination between Different Time Segmentations
  
  Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
  
  2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
  
  Publication
- Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication
- Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
  
  Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
  
  ICASSP 2021 | June 2021
  
  Publication 项目项目
- Developing real-time streaming transformer transducer for speech recognition on large-scale dataset
  
  Xie Chen, Yu Wu, Zhenghao Wang, Shujie Liu, Jinyu Li
  
  ICASSP | June 2021
  
  Publication
- Continuous speech separation with Conformer
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
  
  ICASSP | June 2021
  
  Publication
- Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
  
  Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
  
  ICASSP | June 2021
  
  Publication
- Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
  
  Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
  
  SLT 2021 | January 2021
  
  Publication
- Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
  
  Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
  
  SLT 2021 | January 2021
  
  Publication
- Listen, Look and Deliberate: Visual context-aware speech recognition using pre-trained text-video representations
  
  Shahram Ghorbani, Yashesh Gaur, Yu Shi, Jinyu Li
  
  Spoken Language Technology Workshop | January 2021
  
  Publication
- Dual-Path RNN For Long Recording Speech Separation
  
  Chenda Li, Yi Luo, Cong Han, Jinyu Li, Takuya Yoshioka, Tianyan Zhou, Marc Delcroix, Keisuke Kinoshita, Christoph Boeddeker, Yanmin Qian, Shinji Watanabe, Zhuo Chen
  
  Spoken Language Technology Workshop | January 2021
  
  Publication
- Sequence-Level Self-Learning with Multiple Hypotheses
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  Interspeech | October 2020
  
  Publication DOI 项目
- On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition
  
  Jinyu Li, Yu Wu, Yashesh Gaur, Chengyi Wang, Rui Zhao , Shujie Liu
  
  Interspeech | October 2020
  
  Publication
- Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
  
  Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Exploring Transformers for Large-Scale Speech Recognition
  
  Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- An End-to-end Architecture of Online Multi-channel Speech Separation
  
  Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo , Lei Xie
  
  Interspeech | October 2020
  
  Publication
- Combination of end-to-end and hybrid models for speech recognition
  
  Jeremy Wong, Yashesh Gaur, Rui Zhao, Liang Lu, Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- Low Latency End-to-End Streaming Speech Recognition with a Scout Network
  
  Chengyi Wang, Yu Wu, Liang Lu, Shujie Liu, Jinyu Li, Guoli Ye, Ming Zhou
  
  Interspeech | October 2020
  
  Publication
- Semantic Mask for Transformer based End-to-End Speech Recognition
  
  Chengyi Wang, Yu Wu, yujiao du, Jinyu Li, Shujie Liu, Liang Lu, Shuo Ren, Guoli Ye, Sheng Zhao, Ming Zhou
  
  Interspeech | October 2020
  
  Publication
- Transfer Learning Approaches for Streaming End-to-End Speech Recognition System
  
  Vikas Joshi, Rui Zhao, Rupesh R. Mehta, Kshitiz Kumar, Jinyu Li
  
  Interspeech | October 2020
  
  Publication
- Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator
  
  Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong
  
  Interspeech | October 2020
  
  Publication
- High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model
  
  Jinyu Li, Rui Zhao, Eric Sun, Jeremy Wong, Amit Das, Zhong Meng, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Minimum latency training strategies for streaming sequence-to-sequence ASR
  
  Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Exploring pre-training with alignments for RNN transducer based end-to-end speech recognition
  
  Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- Continuous speech separation: dataset and analysis
  
  Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Xiong Xiao, Jinyu Li
  
  ICASSP | April 2020
  
  Publication
- Using personalized speech synthesis and neural language generator for rapid speaker adaptation
  
  Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong
  
  ICASSP | April 2020
  
  Publication
- L-Vector: Neural Label Embedding for Domain Adaptation
  
  Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
  
  ICASSP | April 2020
  
  Publication
- CNN with phonetic attention for text-independent speaker verification
  
  Tianyan Zhou, yong zhao, Jinyu Li, Yifan Gong, Jian Wu
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Character-aware attention-based end-to-end speech recognition
  
  Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Domain adaptation via teacher-student learning for end-to-end speech recognition
  
  Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Improving RNN Transducer Modeling for End-to-End Speech Recognition
  
  Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
  
  Automatic Speech Recognition and Understanding Workshop | December 2019
  
  Publication
- Speech Separation Using Speaker Inventory
  
  Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
  
  Automatic Speech Recognition and Understanding Workshop | November 2019
  
  PDF DOI
- Speaker Adaptation for Attention-Based End-to-End Speech Recognition
  
  Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Acoustic-to-Phrase Models for Speech Recognition
  
  Yashesh Gaur, Jinyu Li, Zhong Meng, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Layer Trajectory BLSTM
  
  Eric Sun, Jinyu Li, Yifan Gong
  
  Interspeech | September 2019
  
  Publication
- Improving Layer Trajectory LSTM With Future Context Frames
  
  Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Adversarial Speaker Verification
  
  Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Adversarial Speaker Adaptation
  
  Zhong Meng, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Towards Code-Switching ASR for End-to-End CTC Models
  
  Ke Li, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Attentive Adversarial Learning for Domain-Invariant Training
  
  Zhong Meng, Jinyu Li, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Conditional Teacher-Student Learning
  
  Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Universal Acoustic Modeling Using Neural Mixture Models
  
  Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
  
  ICASSP | May 2019
  
  Publication
- Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  SLT 2018 | December 2018
  
  Publication 项目
- Exploring layer trajectory LSTM with depth processing units and attention
  
  Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
  
  Spoken Language Technology | December 2018
  
  Publication
- MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
  
  Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
  
  Spoken Language Technology | December 2018
  
  Publication
- Speaker Adaptation for End-to-End CTC Models
  
  Ke Li, Jinyu Li, yong zhao, Yifan Gong (ygong), Kshitiz Kumar
  
  Spoken Language Technology | December 2018
  
  Publication
- Improved training for online end-to-end speech recognition systems
  
  Suyoun Kim, Michael L. Seltzer, Jinyu Li, Rui Zhao
  
  Interspeech 2018 | September 2018
  
  PDF
- Adversarial Feature-Mapping for Speech Enhancement
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
  
  Interspeech 2018 | September 2018
  
  Publication
- Cycle-Consistent Speech Enhancement
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
  
  Interspeech 2018 | September 2018
  
  Publication
- Layer Trajectory LSTM
  
  Jinyu Li, Changliang Liu, Yifan Gong
  
  Interspeech 2018 | September 2018
  
  PDF
- Advancing Connectionist Temporal Classification With Attention Modeling
  
  Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Advancing Acoustic-to-Word CTC Model
  
  Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Developing Far-Field Speaker System Via Teacher-Student Learning
  
  Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Efficient Integration of Fixed Beamformers and Speech Separation Networks for Multi-Channel Far-Field Speech Separation
  
  Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
  
  ICASSP 2018 | April 2018
  
  Publication
- DOMAIN AND SPEAKER ADAPTATION FOR CORTANA SPEECH RECOGNITION
  
  Yong Zhao, Jinyu Li, Shixiong Zhang, Liping Chen, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Efficient integration of fixed beamformers and speech separation networks for multi-channel far-field speech separation
  
  Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
  
  ICASSP | April 2018
  
  PDF
- Speaker-Invariant Training via Adversarial Learning
  
  Zhong Meng, Jinyu Li, Zhuo Chen, Yong Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang (Fred) Juang
  
  ICASSP | April 2018
  
  Publication
- Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation
  
  Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang (Fred) Juang
  
  ICASSP | April 2018
  
  Publication
- Acoustic-To-Word Model Without OOV
  
  Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
  
  ASRU | December 2017
  
  PDF
- Cracking the cocktail party problem by multi-beam deep attractor network
  
  Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
  
  ASRU 2018 | December 2017
  
  Publication
- Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition
  
  Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
  
  ASRU | December 2017
  
  Publication
- Improving mask learning based speech enhancement system with restoration layers and residual connection
  
  Zhuo Chen, Yan Huang, Jinyu Li, Yifan Gong
  
  Interspeech | August 2017
  
  Publication
- Large-Scale Domain Adaptation via Teacher-Student Learning
  
  Jinyu Li, Michael Seltzer, Xi Wang, Rui Zhao, Yifan Gong
  
  Interspeech | August 2017
  
  PDF
- Extended low-rank plus diagonal adaptation for deep and recurrent neural networks
  
  yong zhao, Jinyu Li, kshitiz kumar, Yifan Gong
  
  ICASSP | April 2017
  
  PDF
- Improved Cepstra Minimum-Mean-Square-Error Noise Reduction Algorithm For Robust Speech Recognition
  
  Jinyu Li, Yan Huang, Yifan Gong
  
  ICASSP | April 2017
  
  PDF
- End-to-End Attention Based Text-Dependent Speaker Verification
  
  Shixiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
  
  SLT workshop | December 2016
  
  PDF
- Deep Convolutional Neural Networks with Layer-wise Context Expansion and Attention
  
  Dong Yu, Wayne Xiong, Jasha Droppo, Andreas Stolcke, Guoli Ye, Jinyu Li, Geoffrey Zweig
  
  Proc. Interspeech | September 2016
  
  PDF 论文与出版物项目
- EXPLORING MULTIDIMENSIONAL LSTMS FOR LARGE VOCABULARY ASR
  
  Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
  
  ICASSP | March 2016
  
  PDF
- Simplifying Long Short-term Memory Acoustic Models for Fast Training and Decoding
  
  Yajie Miao, Jinyu Li, Yongqiang Wang, Shi-Xiong Zhang, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- Recurrent Support Vector Machines for Speech Recognition
  
  Shi-Xiong Zhang, Rui Zhao, Chaojun Liu, Jinyu Li, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- Low-rank Plus Diagonal Adaption for Deep Neural Networks
  
  Yong Zhao, Jinyu Li, Yifan Gong
  
  ICASSP | March 2016
  
  ICASSP
  
  PDF
- LSTM Time and Frequency Recurrence for Automatic Speech Recognition
  
  Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
  
  IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
  
  PDF
- Rapid Adaptation for Deep Neural Networks through Multi-Task Learning
  
  Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Ji Wu, Chin-Hui Lee
  
  Interspeech | September 2015
  
  PDF
- Maximum a Posteriori Adaptation of Network Parameters in Deep Models
  
  Zheng Huang, Sabato Marco Siniscalchi, I-Fan Chen, Jinyu Li, Jiadong Wu, Chin-Hui Lee
  
  September 2015
  
  PDF
- SVD-based Universal DNN Modeling for Multiple Scenarios
  
  Changliang Liu, Jinyu Li, Yifan Gong
  
  September 2015
  
  PDF
- Small-footprint high-performance deep neural network-based speech recognition using split-VQ
  
  Yongqiang Wang, Jinyu Li, Yifan Gong
  
  ICASSP | April 2015
  
  PDF
- Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression and Click-Through Data
  
  Yong Zhao, Jinyu Li, Jian Xue, Yifan Gong
  
  ICASSP | April 2015
  
  ICASSP
  
  PDF
- An Analysis of Convolutional Neural Networks for Speech Recognition
  
  Jui-Ting Huang, Jinyu Li, Yifan Gong
  
  ICASSP | April 2015
  
  PDF
- variable-activation and variable-input deep neural network for robust speech recognition
  
  Rui Zhao, Jinyu Li, Yifan Gong
  
  IEEE SLT workshop | December 2014
  
  Publication
- Variable-Component Deep Neural Network for Robust Speech Recognition
  
  Jinyu Li, Yifan Gong
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Learning Small-Size DNN with Output-Distribution-Based Criteria
  
  Jinyu Li, Rui Zhao, Jui-Ting Huang, Yifan Gong
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Beyond Cross-entropy: Towards Better Frame-level Objective Functions For Deep Neural Network Training In Automatic Speech Recognition
  
  Zhen Huang, Jinyu Li, Chao Weng, Chin-Hui Lee
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Feature Space Maximum A Posteriori Linear Regression for Adaptation of Deep Neural Networks
  
  Zhen Huang, Jinyu Li, Sabato Marco Siniscalchi, I-Fan Chen, Chao Weng, Chin-Hui Lee
  
  Interspeech | September 2014
  
  Interspeech
  
  PDF
- Investigation of Maxout Networks For Speech Recognition
  
  Pawel Swietojanski, Jinyu Li, Jui-Ting Huang
  
  ICASSP | January 2014
  
  Publication
- Factorized adaptation for deep neural network
  
  Jinyu Li, Jui-Ting Huang, Yifan Gong
  
  ICASSP | January 2014
  
  PDF
- Singular Value Decomposition Based Low-footprint Speaker Adaptation and Personalization for Deep Neural Network
  
  Jian Xue, Jinyu Li, Dong Yu, Mike Seltzer, Yifan Gong
  
  ICASSP | January 2014
  
  PDF
- Feature Compensation Using Linear Combination of Speaker and Environment Dependent Correction Vectors
  
  Xiong Xiao, Jinyu Li, Eng Siong Chng, Haizhou Li
  
  ICASSP | January 2014
  
  Publication
- Recent Advances in Deep Learning for Speech Research at Microsoft
  
  Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
  
  May 2013
  
  PDF 项目
- Cross-language Knowledge Transfer using Multilingual Deep Neural Network with Shared Hidden Layers
  
  Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  PDF
- Feature Learning in Deep Neural Networks – Studies on Speech Recognition
  
  Dong Yu, Mike Seltzer, Jinyu Li, Jui-Ting Huang, Frank Seide
  
  International Conference on Learning Representations | May 2013
  
  PDF
- Investigations on Hessian-Free Optimization for Cross-Entropy Training of Deep Neural Networks
  
  Simon Wiesler, Jinyu Li, Jian Xue
  
  Interspeech | January 2013
  
  Interspeech
  
  PDF
- Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition
  
  Jian Xue, Jinyu Li, Yifan Gong
  
  Interspeech | January 2013
  
  PDF
- Improvements to VTS Feature Enhancement
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  March 2012
  
  PDF
- Improvements to VTS feature enhancement
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  Proc. ICASSP | January 2012
  
  PDF
- LASSO environment model combination for robust speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2012
  
  PDF
- Efficient VTS Adaptation Using Jacobian Approximation
  
  Jinyu Li, Mike Seltzer, Yifan Gong
  
  Interspeech | January 2012
  
  PDF
- Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM
  
  Jinyu Li, Dong Yu, Jui-Ting Huang, Tifan Gong
  
  IEEE Workshop on Spoken Language Technology | January 2012
  
  PDF
- Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
  
  Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  ICML Workshop 2011 | June 2011
  
  PDF
- Calibration of Confidence Measures In Speech Recognition
  
  Dong Yu, Jinyu Li, Li Deng
  
  IEEE Transactions on Audio, Speech and Language Processing | January 2011
  
  PDF
- Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
  
  Jinyu Li, Li Deng, Dong Yu
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing | January 2011
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing
  
  PDF
- Maximum likelihood adaptation of histogram equalization with constraint for robust speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2011
  
  Proc. ICASSP
  
  PDF
- Feature normalization using structured full transforms for robust speech recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2011
  
  Proc. Interspeech
  
  PDF
- LASSO model adaptation for automatic speech recognition
  
  Jinyu Li, Ming Yuan, Chin-Hui Lee
  
  ICML Workshop on Learning Architectures, Representations, and Optimization for Speech and Visual Information Processing | January 2011
  
  PDF
- Unscented Transform with Online Distortion Estimation for HMM Adaptation
  
  Jinyu Li, Dong Yu, Li Deng, Yifan Gong
  
  Interspeech 2010 | September 2010
  
  PDF
- Word Confidence Calibration Using A Maximum Entropy Model With Constraints On Confidence and Word Distributions
  
  Dong Yu, Shizhen Wang, Jinyu Li, Li Deng
  
  March 2010
  
  PDF
- Unscented transform with online distortion estimation for HMM adaptation
  
  Jinyu Li
  
  Proc. Interspeech | January 2010
  
  PDF
- Shrinkage Model Adaptation in Automatic Speech Recognition
  
  Jinyu Li, Yu Tsao, Chin-Hui Lee
  
  Interspeech | January 2010
  
  PDF
- Word Confidence Calibration Using A Maximum Entropy Model With Constraints On Confidence and Word Distributions
  
  Jinyu Li, Li Deng, Dong Yu
  
  Proc. ICASSP | January 2010
  
  PDF
- Ensemble speaker and speaking environment modeling approach with advanced online estimation process
  
  Yu Tsao, Jinyu Li, Chin-Hui Lee
  
  Proc. ICASSP | January 2009
  
  Proc. ICASSP
  
  PDF
- A study on hidden Markov model’s generalization capability for speech recognition
  
  Jinyu Li
  
  Proc. ASRU | January 2009
  
  PDF
- A study on soft margin estimation of linear regression parameters for speaker adaptation
  
  Jinyu Li
  
  Proc. Interspeech | January 2009
  
  PDF
- Soft margin estimation on improving environment structures for ensemble speaker and speaking environment modeling
  
  Jinyu Li
  
  ACM Proc. the 3rd International Universal Communication Symposium | January 2009
  
  ACM Proc. the 3rd International Universal Communication Symposium
  
  PDF
- Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目
- HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  April 2008
  
  PDF 项目项目
- On a Generalization of Margin-Based Discriminative Training to Robust Speech Recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2008
  
  PDF
- Soft Margin Estimation with Various Separation Levels for LVCSR
  
  Jinyu Li
  
  Proc. Interspeech | January 2008
  
  PDF
- HMM adaptation using a phase-sensitive acoustic distortion model for environment-robust speech recognition
  
  Jinyu Li, Li Deng, Dong Yu, Alex Acero
  
  Proc. ICASSP | January 2008
  
  Proc. ICASSP
  
  PDF
- High-Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions Via Vector Taylor Series
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Proceedings IEEE Workshop on ASRU | April 2007
  
  Proceedings IEEE Workshop on ASRU
  
  PDF 项目项目
- A study on soft margin estimation for LVCSR
  
  Jinyu Li
  
  Proc. IEEE Automatic Speech Recognition and Understanding | January 2007
  
  PDF
- Approximate test risk minimization through soft margin estimation
  
  Jinyu Li
  
  Proc. ICASSP | January 2007
  
  PDF
- Detection-Based ASR in the Automatic Speech Attribute Transcription Project
  
  Jinyu Li
  
  Proc. Interspeech | January 2007
  
  Proc. Interspeech
  
  PDF
- High-Performance HMM Adaptation with Joint Compensation of Additive and Convolutive Distortions via Vector Taylor Series
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Proc. IEEE Automatic Speech Recognition and Understanding | January 2007
  
  Proc. IEEE Automatic Speech Recognition and Understanding
  
  PDF
- Soft Margin Feature Extraction for Automatic Speech Recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2007
  
  PDF
- Soft Margin Estimation of Hidden Markov Model Parameters (best student paper)
  
  Jinyu Li
  
  Proc. Interspeech | January 2006
  
  Best Student Paper
  
  PDF
- Application of EÎ±Nets to feature recognitionof articulation manner in knowledge-based automatic speech recognition
  
  Jinyu Li
  
  Lecture Notes in Computer Science | January 2006
  
  PDF
- Language recognition based on score distribution feature vectors and discriminative classifier fusion
  
  Jinyu Li
  
  Proc. IEEE Odyssey Workshop on Speaker and Language Recognition | January 2006
  
  PDF
- A study on lattice rescoring with knowledge scores for automatic speech recognition
  
  Jinyu Li
  
  Proc. Interspeech | January 2006
  
  Proc. Interspeech
  
  PDF
- A study on knowledge source integration for candidate rescoring in automatic speech recognition
  
  Jinyu Li
  
  Proc. ICASSP | January 2005
  
  PDF
- A study on separation between acoustic models and its applications
  
  Jinyu Li
  
  Proc. Interspeech | January 2005
  
  PDF
- On Designing and Evaluating Speech Event Detectors
  
  Jinyu Li
  
  Proc. Interspeech | January 2005
  
  PDF
- Dimensionality reduction using MCE-optimized LDA transformation
  
  Jinyu Li
  
  Proc. ICASSP | January 2004
  
  PDF
- A complexity reduction of ETSI advanced front-end for DSR
  
  Jinyu Li
  
  Proc. ICASSP | January 2004
  
  PDF
- Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audio
  
  Mohan Shi, Xiong Xiao, Ruchao Fan, Shaoshi Ling, Jinyu Li
  
  November 2025
  
  arXiv | November 2025
  
  Publication
- Autoregressive Speech Synthesis without Vector Quantization
  
  Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
  
  July 2024
  
  arXiv | July 2024
  
  Publication 项目
- VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
  
  Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
  
  June 2024
  
  arxiv | June 2024
  
  Publication 项目
- VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
  
  Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
  
  June 2024
  
  arXiv | June 2024
  
  Publication 项目
- VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
  
  Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
  
  June 2024
  
  arXiv | June 2024
  
  DOI Publication Publication 项目
- WavLLM: Towards Robust and Adaptive Speech Large Language Model
  
  Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
  
  March 2024
  
  arXiv | March 2024
  
  DOI Publication Publication
- Decoder-only Modeling for Speech
  
  Jinyu Li
  
  December 2023
  
  December 2023
  
  Invited Talk at NTU and SJTU
  
  Publication
- Large-Scale Streaming End-to-End Speech Translation
  
  Jinyu Li
  
  December 2023
  
  December 2023
  
  Invited Talk at NTU and SJTU
  
  Publication
- Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling
  
  Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
  
  March 2023
  
  arXiv | March 2023
  
  Publication PDF 项目
- Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
  
  Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei
  
  January 2023
  
  arXiv | January 2023
  
  Publication PDF 项目
- Deep Neural Network for Automatic Speech Recognition: from the Industry’s View
  
  Jinyu Li
  
  September 2014
  
  September 2014
  
  PDF
- ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation
  
  Zongyi Li, Shujie Hu, Shujie Liu, Long Zhou, Jeongsoo Choi, Lingwei Meng, Xun Guo, Jinyu Li, Hefei Ling, Furu Wei
  
  October 2024
  
  October 2024
  
  Publication
- End-to-End Automatic Speech Recognition
  
  Jinyu Li
  
  MSR-TR-2024-30 | May 2024
  
  作者：Microsoft
  
  IEEE SPS Webinar
  
  Publication
- Recent Advances in End-to-End Automatic Speech Recognition (Invited Talk at ASC 2023)
  
  Jinyu Li
  
  | November 2023
  
  作者：Microsoft
  
  Publication
- Advancing end-to-end automatic speech recognition
  
  Jinyu Li
  
  MSR-TR-2021-32 | October 2021
  
  作者：Microsoft
  
  Keynote talk at the conference on Computational Linguistics and Speech Processing, 2021.
  
  Publication
- Developing streaming end-to-end models for automatic speech recognition in industry
  
  Jinyu Li
  
  MSR-TR-2020-45 | December 2020
  
  作者：Microsoft
  
  Publication
- Deep Learning Acoustic Model in Microsoft Cortana Voice Assistant
  
  Jinyu Li
  
  MSR-TR-2017-60 | November 2017
  
  作者：Microsoft
  
  Publication
- SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data
  
  Ziqiang Zhang, Sanyuan Chen, Long Zhou, Yu Wu, Shuo Ren, Shujie Liu, Zhuoyuan Yao, Xun Gong, Lirong Dai, Jinyu Li, Furu Wei
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2024
  
  Publication
- Advanced Long-Content Speech Recognition with Factorized Neural Transducer
  
  Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2024
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- VatLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning
  
  Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei
  
  IEEE Transactions on Multimedia | May 2023
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Towards Contextual Spelling Correction for Customization of End-to-End Speech Recognition Systems
  
  Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic, Sheng Zhao, Hosam Khalil
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2022, 第 30 卷: pp. 3089-3097
  
  Publication
- WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
  
  Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
  
  IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
  
  Publication
- Recent Advances in End-to-End Automatic Speech Recognition
  
  Jinyu Li
  
  APSIPA Transactions on Signal and Information Processing | April 2022
  
  Publication
- Streaming end-to-end multi-talker speech recognition
  
  Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
  
  IEEE Signal Processing Letter | April 2021, 第 28 卷
  
  Publication
- Adaptation Algorithms for Speech Recognition: An Overview
  
  Peter Bell, Joachim Fainberg, Ondrej Klejch, Jinyu Li, Steve Renals, Pawel Swietojanski
  
  IEEE Open Journal of Signal Processing | February 2021
  
  Publication
- Speaker Separation Using Speaker Inventories and Estimated Speech
  
  Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
  
  IEEE Transactions on Audio, Speech, and Language Processing | December 2020, 第 29 卷: pp. 537-546
  
  PDF DOI
- Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units
  
  Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
  
  IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING | December 2019, pp. 1880-1892
  
  Publication
- Progressive Joint Modeling in Unsupervised Single-channel Overlapped Speech Recognition
  
  Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2018
  
  PDF
- Recent Progresses in Deep Learning Based Acoustic Models
  
  Dong Yu, Jinyu Li
  
  IEEE/CAA JOURNAL OF AUTOMATICA SINICA | July 2017
  
  PDF
- An Overview of Noise-Robust Automatic Speech Recognition
  
  Jinyu Li, Li Deng, Yifan Gong, Reinhold Haeb-Umbach
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | April 2014, 第 22 卷: pp. 745
  
  PDF
- Hermitian Polynomial for Speaker Adaptation of Connectionist Speech Recognition Systems
  
  Sabato Marco Simiscalchi, Jinyu Li, Chin-Hui Lee
  
  IEEE Transactions on Audio, Speech, and Language Processing | January 2013
  
  PDF
- Model-Based Margin Estimation for Hidden Markov Model Learning and Generalization
  
  Sabato Marco Siniscalchi, Jinyu Li, Chin-Hui Lee
  
  IET Signal Processing | January 2013
  
  PDF
- Calibration of Confidence Measures In Speech Recognition
  
  Dong Yu, Jinyu Li, Li Deng
  
  IEEE Transactions on Audio, Speech, and Language Processing | November 2011
  
  PDF
- A study on the generalization capability of acoustic models for robust speech recognition
  
  Jinyu Li
  
  IEEE Transactions on Audio, Speech and Language Processing | January 2010
  
  PDF
- A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
  
  Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
  
  Computer Speech and Language | January 2009, 第 23 卷: pp. 389-405
  
  PDF 项目项目
- Approximate Test Risk Bound Minimization through Soft Margin Estimation
  
  Jinyu Li
  
  IEEE Trans. on Audio, Speech, and Language Proc | January 2007
  
  PDF
- Recent Progresses On Deep Learning For Speech Recognition
  
  Jinyu Li, Dong Yu
  
  Handbook of Pattern Recognition and Computer Vision: 6th Edition | 2020
  
  Publication
- Challenges and Solutions to Deep Learning Network Acoustic Modeling in Speech Recognition Products at Microsoft
  
  Yifan Gong, Jinyu Li
  
  New Era for Robust Speech Recognitino: Exploiting Deep Learning | 作者：Springer | 2017
  
  Publication 论文与出版物
- Compensation with Prior Knowledge
  
  Jinyu Li, Li Deng, Yifan Gong
  
  Robust Automatic Speech Recognition: A Bridge to Practical Applications | 作者：Elsevier | 2015
  
  PDF
- Sequence-level self-learning with multi-task learning framework
  
  Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
  
  October 2020
  
  项目
- Robust Automatic Speech Recognition – A Bridge to Practical Applications (1st Edition)
  
  Jinyu Li, Li Deng, R. Haeb-Umbach, Y. Gong
  
  Published by Elsevier | October 2015
  
  Publication 论文与出版物
- SOFT MARGIN ESTIMATION FOR AUTOMATIC SPEECH RECOGNITION
  
  Jinyu Li
  
  December 2008
  
  December 2008
  
  PDF

Jinyu Li

论文与出版物

DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation

EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning

Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audio

CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matching

Boosting Large Language Model for Speech Synthesis: An Empirical Study

Target word activity detector: An approach to obtain ASR word boundaries without lexicon

V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow

CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation

Investigating neural audio codecs for speech language model-based speech generation

Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech

ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation

An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS

COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning

Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

Autoregressive Speech Synthesis without Vector Quantization

VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment

VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers

VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

End-to-End Automatic Speech Recognition

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

DiariST: Streaming Speech Translation with Speaker Diarization

Leveraging Timestamp Information for Serialized Joint Streaming Recognition and Translation

ResidualTransformer: Residual Low-Rank Learning with Weight-Sharing for Transformer Layers

t-SOT FNT: streaming multi-talker ASR with text-only domain adaptation capability

WavLLM: Towards Robust and Adaptive Speech Large Language Model

SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data

Advanced Long-Content Speech Recognition with Factorized Neural Transducer

A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability

Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training

Decoder-only Modeling for Speech

Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach

Large-Scale Streaming End-to-End Speech Translation

On decoder-only architecture for speech-to-text and large language model integration

Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition

Token-Level Serialized Output Training for Joint Streaming ASR and ST Leveraging Textual Alignments

Recent Advances in End-to-End Automatic Speech Recognition (Invited Talk at ASC 2023)

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Accelerating Transducers through Adjacent Token Merging

LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model Using Neural Transducers

CTCBERT: Advancing Hidden-unit BERT with CTC Objectives

Fast and accurate factorized neural transducer for text adaption of end-to-end speech recognition models

Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation

Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation

LongFNT: Long-form Speech Recognition with Factorized Neural Transducer

Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition

Simulating realistic speech overlaps improves multi-talker ASR

Speaker Change Detection for Transformer Transducer ASR

Speech separation with large-scale self-supervised learning

VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition

VatLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning

Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

STREAMING, FAST AND ACCURATE ON-DEVICE INVERSE TEXT NORMALIZATION FOR AUTOMATIC SPEECH RECOGNITION

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

Advancing end-to-end automatic speech recognition and beyond

SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training

Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition

Large-Scale Streaming End-to-End Speech Translation with Neural Transducers

Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

Streaming Multi-Talker ASR with Token-Level Serialized Output Training

Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings

Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training

Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition

VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition

Towards Contextual Spelling Correction for Customization of End-to-End Speech Recognition Systems

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

A Configurable Multilingual Model is All You Need to Recognize All Languages

Continuous Streaming Multi-Talker ASR with Dual-path Transducers

Endpoint Detection for Streaming End-to-End Multi-talker ASR

Factorized Neural Transducer for Efficient Language Model Adaptation

Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition

Self-Supervised Learning for speech recognition with Intermediate layer supervision

UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training

UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training