公開日 Communication-efficient federated learning via knowledge distillation Chuhan Wu, Fangzhao Wu, Lingjuan Lyu, Yongfeng Huang, Xing Xie Nature Communications | April 2022, 巻13
公開日 Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling Nuo Chen, Linjun Shou (寿林钧), Ming Gong (YIMING), Jian Pei, Daxin Jiang (姜大昕) NAACL 2022 | April 2022
公開日 METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao April 2022 arXiv:2204.06644
公開日 Adversarial Retriever-Ranker for dense text retrieval Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen ICLR 2022 | April 2022
公開日 EventBERT: A Pre-Trained Model for Event Correlation Reasoning Yucheng Zhou, Xiubo Geng, Tao Shen, Guodong Long, Daxin Jiang (姜大昕) TheWebConf 2022 | April 2022
公開日 Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao ArXiv | April 2022
公開日 Knowledge Infused Decoding Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah ICLR 2022 | April 2022 Github
公開日 Taming Sparsely Activated Transformer with Stochastic Experts Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao ICLR 2022 | April 2022 プロジェクト
公開日 LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen ICLR 2022 | April 2022 動画 Github プロジェクト
公開日 LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao NAACL 2022 | April 2022 Github プロジェクト プロジェクト