Publication A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training Nitay Calderon, Subhabrata (Subho) Mukherjee, Roi Reichart, Amir Kantor ACL 2023 | May 2023
Publication Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences Chaojun Wang, Yang Liu, Wai Lam ACL 2023 Findings | May 2023
Publication Hard-Meta-Dataset++: Towards Understanding Few-Shot Performance on Difficult Tasks Samyadeep Basu, Megan Stanley, John Bronskill, Soheil Feizi, Daniela Massiceti International Conference on Learning Representations | May 2023 Project
Publication Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao 11th International Conference on Learning Representations (ICLR 2023) | May 2023
Publication Relational Attention: Generalizing Transformers for Graph-Structured Tasks Cameron Diao, Ricky Loynd ICLR 2023 | May 2023 Spotlight
Publication CASR: Generating Complex Sequences with Autoregressive Self-Boost Refinement Hongwei Han, Mengyu Zhou, Shi Han, Xiu Li, Dongmei Zhang The Eleventh International Conference on Learning Representations (ICLR ’23) | May 2023
Publication Transformers Learn Shortcuts to Automata Bingbin Liu, Jordan Ash, Surbhi Goel, Akshay Krishnamurthy, Cyril Zhang ICLR | May 2023 oral presentation
Publication Trust Region Bounds for Decentralized PPO Under Non-stationarity Mingfei Sun, Sam Devlin, Jacob Beck, Katja Hofmann, Shimon Whiteson International Conference on Autonomous Agents and Multiagent Systems (AAMAS) | May 2023 Best Paper Award Project
Publication Over-parameterized Model Optimization with Polyak-{\L}ojasiewicz Condition Yixuan Chen, Yubin Shi, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang, Robert Dick, Qin Lv, Yingying Zhao, Fan Yang, Ning Gu, Li Shang ICLR 23 | May 2023
Publication LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao ICLR 2023 | May 2023