Publication Rethinking Positional Encoding in Language Pre-training Guolin Ke, Di He, Tie-Yan Liu 2021 International Conference on Learning Representations | May 2021
Publication GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training Tianle Cai, Shengjie Luo, Keyulu Xu, Di He, Tie-Yan Liu, Liwei Wang 2021 International Conference on Machine Learning | May 2021
Publication Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inference Shumao Zhang, Pengchuan Zhang, Thomas Hou 2021 International Conference on Machine Learning | May 2021
Publication A Unified Bayesian Framework for Discriminative and Generative Continual Learning Abhishek Kumar, Sunabha Chatterjee, Piyush Rai ICML 2021 | May 2021
Publication What Makes Instance Discrimination Good for Transfer Learning Nanxuan Zhao, Zhirong Wu, Rynson W. H. Lau, Stephen Lin International Conference on Learning Representations (ICLR) | May 2021
Publication Filtered Inner Product Projection for Crosslingual Embedding Alignment Vin Sachidananda, Ziyi Yang, Chenguang Zhu International Conference on Learning Representations (ICLR) | May 2021
Publication Taking Notes on the Fly Helps Language Pre-Training Qiyu Wu, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu 2021 International Conference on Learning Representations | May 2021
Publication IDF++: Analyzing and Improving Integer Discrete Flows for Lossless Compression Rianne van den Berg, Alexey A. Gritsenko, Mostafa Dehghani, Casper Kaae Sønderby, Tim Salimans International Conference on Learning Representations | May 2021
Publication DeBERTa: Decoding-Enhanced BERT with Disentangled Attention Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen 2021 International Conference on Learning Representations | May 2021 Under review Github Project Project
Publication Revisiting Dynamic Convolution via Matrix Decomposition Yunsheng Li, Yinpeng Chen, Xiyang Dai, mengchen liu, Dong Chen, Ye Yu, Lu Yuan, Zicheng Liu, Mei Chen, Nuno Vasconcelos 2021 International Conference on Learning Representations | May 2021 Project