Publication HyperTuning: Toward Adapting Large Language Models without Back-propagation Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen ICML 2023 | June 2023
Publication Orca: Progressive Learning from Complex Explanation Traces of GPT-4 Subhabrata (Subho) Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, Ahmed Awadallah arXiv: Computation and Language | June 2023 Video Project
Publication Less is More: Task-aware Layer-wise Distillation for Language Model Compression Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao ICML 2023 | June 2023
Publication BEATs: Audio Pre-Training with Acoustic Tokenizers Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Furu Wei ICML 2023 | June 2023
Publication LongFNT: Long-form Speech Recognition with Factorized Neural Transducer Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian ICASSP | June 2023
Publication CTCBERT: Advancing Hidden-unit BERT with CTC Objectives Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li ICASSP | June 2023
Publication Fast and accurate factorized neural transducer for text adaption of end-to-end speech recognition models Rui Zhao, Jian Xue, Partha Parthasarathy, Veljko Miljanic, Jinyu Li ICASSP | June 2023
Publication IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languages Jay Gala, Pranjal A. Chitale, AK Raghavan, Sumanth Doddapaneni, Varun Gumma, Aswanth Kumar, J. Nawale, Anupama Sujatha, Ratish Puduppully, Vivek Raghavan, Pratyush Kumar, Mitesh M. Khapra, Raj Dabre, Anoop Kunchukuttan Transactions on Machine Learning Research | May 2023
Publication Uncovering and Quantifying Social Biases in Code Generation Yan Liu, Xiaokang Chen, Yan Gao, Zhe Su, Fengji Zhang, Daoguang Zan, Jian-Guang Lou, Pin-Yu Chen, Tsung-Yi Ho NeurIPS 2023 | May 2023
Publication ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata (Subho) Mukherjee, Yuchen Liu, Dongkuan Xu arXiv: Computation and Language | May 2023