Publication A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training Nitay Calderon, Subhabrata (Subho) Mukherjee, Roi Reichart, Amir Kantor ACL 2023 | May 2023
Publication Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences Chaojun Wang, Yang Liu, Wai Lam ACL 2023 Findings | May 2023
Publication VatLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei IEEE Transactions on Multimedia | May 2023
Publication Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao 11th International Conference on Learning Representations (ICLR 2023) | May 2023
Publication CASR: Generating Complex Sequences with Autoregressive Self-Boost Refinement Hongwei Han, Mengyu Zhou, Shi Han, Xiu Li, Dongmei Zhang The Eleventh International Conference on Learning Representations (ICLR ’23) | May 2023
Publication TextDiffuser: Diffusion Models as Text Painters Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei NeurIPS 2023 | May 2023
Publication Generate rather than Retrieve: Large Language Models are Strong Context Generators Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang ICLR 2023 | May 2023
Publication i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
Publication LMGQS: A Large-scale Dataset for Query-focused Summarization Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng May 2023
Publication AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao ACL | May 2023 Project