Publication XDoc: Unified Pre-training for Cross-Format Document Understanding Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei EMNLP 2022 | December 2022 Project
Publication FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu December 2022
Publication Industry-scale CO2 Flow Simulations with Model-Parallel Fourier Neural Operators Philipp Witte, Russell Hewett, Ranveer Chandra NeurIPS 2022 Workshop Tackling Climate Change with Machine Learning | December 2022 Project
Publication A Unified Understanding of Deep NLP Models for Text Classification Zhen Li, Xiting Wang, Weikai Yang, Jing Wu, Zhengyan Zhang, Zhiyuan Liu, Maosong Sun, Hui Zhang, Shixia Liu IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG) | December 2022, Vol 28(12)
Publication Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production Hany Hassan Awadalla, YOUNG JIN KIM December 2022 Project
Publication ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
Publication Surrogate Modeling for Methane Dispersion Simulations Using Fourier Neural Operator Qie Zhang, Micro Milletari, Yagna Oruganti, Philipp Witte NeurIPS 2022 Workshop Tackling Climate Change with Machine Learning | December 2022 Proposal Track Project
Publication LiteTransformerSearch: Training-free On-device Search for Efficient Autoregressive Language Models Mojan Javaheripi, Shital Shah, Subhabrata (Subho) Mukherjee, Tomasz L. Religa, Caio C. T. Mendes, Gustavo H. de Rosa, Sébastien Bubeck, Farinaz Koushanfar, Debadeepta Dey NeurIPS 2022 | December 2022 Project
Publication AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao NeurIPS 2022 | December 2022 Project Project
Publication RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL Jiexing Qi, Jingyao Tang, Ziwei He, Yu Cheng, Chenghu Zhou, Xinbing Wang, Quanshi Zhang, Zhouhan Lin Conference on Empirical Methods in Natural Language Processing (EMNLP 2022) | December 2022