Publication Communication-efficient federated learning via knowledge distillation Chuhan Wu, Fangzhao Wu, Lingjuan Lyu, Yongfeng Huang, Xing Xie Nature Communications | April 2022, Vol 13
Publication Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling Nuo Chen, Linjun Shou (寿林钧), Ming Gong (YIMING), Jian Pei, Daxin Jiang (姜大昕) NAACL 2022 | April 2022
Publication METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao April 2022 arXiv:2204.06644
Publication Adversarial Retriever-Ranker for dense text retrieval Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen ICLR 2022 | April 2022
Publication EventBERT: A Pre-Trained Model for Event Correlation Reasoning Yucheng Zhou, Xiubo Geng, Tao Shen, Guodong Long, Daxin Jiang (姜大昕) TheWebConf 2022 | April 2022
Publication Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao ArXiv | April 2022
Publication Knowledge Infused Decoding Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah ICLR 2022 | April 2022 Github
Publication Taming Sparsely Activated Transformer with Stochastic Experts Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao ICLR 2022 | April 2022 Projet
Publication LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen ICLR 2022 | April 2022 Vidéo Github Projet
Publication LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao NAACL 2022 | April 2022 Github Projet Projet