论文与出版物 Communication-efficient federated learning via knowledge distillation Chuhan Wu, Fangzhao Wu, Lingjuan Lyu, Yongfeng Huang, Xing Xie Nature Communications | April 2022, 第 13 卷
论文与出版物 Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling Nuo Chen, Linjun Shou (寿林钧), Ming Gong (YIMING), Jian Pei, Daxin Jiang (姜大昕) NAACL 2022 | April 2022
论文与出版物 METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao April 2022 arXiv:2204.06644
论文与出版物 Adversarial Retriever-Ranker for dense text retrieval Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen ICLR 2022 | April 2022
论文与出版物 EventBERT: A Pre-Trained Model for Event Correlation Reasoning Yucheng Zhou, Xiubo Geng, Tao Shen, Guodong Long, Daxin Jiang (姜大昕) TheWebConf 2022 | April 2022
论文与出版物 Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao ArXiv | April 2022
论文与出版物 Knowledge Infused Decoding Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah ICLR 2022 | April 2022 Github
论文与出版物 Taming Sparsely Activated Transformer with Stochastic Experts Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao ICLR 2022 | April 2022 项目
论文与出版物 LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen ICLR 2022 | April 2022 视频 Github 项目
论文与出版物 LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao NAACL 2022 | April 2022 Github 项目 项目