Publication Magneto: A Foundation Transformer Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei ICML 2023 | June 2023
Publication Improving Contextual Spelling Correction by External Acoustics Attention and Semantic Aware Data Augmentation Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Sheng zhao ICASSP | June 2023
Publication Speaker Change Detection for Transformer Transducer ASR Jian Wu, Zhuo Chen, Min Hu, Xiong Xiao, Jinyu Li June 2023
Publication Learning to Rank in Generative Retrieval Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li AAAI 2024 | June 2023
Publication HyperTuning: Toward Adapting Large Language Models without Back-propagation Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen ICML 2023 | June 2023
Publication Orca: Progressive Learning from Complex Explanation Traces of GPT-4 Subhabrata (Subho) Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, Ahmed Awadallah arXiv: Computation and Language | June 2023 Video Project
Publication Less is More: Task-aware Layer-wise Distillation for Language Model Compression Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao ICML 2023 | June 2023
Publication BEATs: Audio Pre-Training with Acoustic Tokenizers Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Furu Wei ICML 2023 | June 2023
Publication LongFNT: Long-form Speech Recognition with Factorized Neural Transducer Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian ICASSP | June 2023
Publication CTCBERT: Advancing Hidden-unit BERT with CTC Objectives Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li ICASSP | June 2023