Publication Unsupervised Summarization with Customized Granularities Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
Publication Automatic Rule Induction for Efficient Semi-Supervised Learning Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
Publication Leveraging Locality in Abstractive Text Summarization Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev EMNLP 2022 | December 2022
Publication Task Compass: Scaling Multi-task Pre-training with Task Prefix Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng EMNLP 2022 | December 2022
Publication XDoc: Unified Pre-training for Cross-Format Document Understanding Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei EMNLP 2022 | December 2022 Project
Publication FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu December 2022
Publication LiteTransformerSearch: Training-free On-device Search for Efficient Autoregressive Language Models Mojan Javaheripi, Shital Shah, Subhabrata (Subho) Mukherjee, Tomasz L. Religa, Caio C. T. Mendes, Gustavo H. de Rosa, Sébastien Bubeck, Farinaz Koushanfar, Debadeepta Dey NeurIPS 2022 | December 2022 Project
Publication AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao NeurIPS 2022 | December 2022 Project Project
Publication Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production Hany Hassan Awadalla, YOUNG JIN KIM December 2022 Project
Publication A Unified Encoder-Decoder Framework with Entity Memory Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022