Publication Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Wei Chen ACL-IJCNLP 2021 | May 2021
Publication Resource-Guided Configuration Space Reduction for Deep Learning Models Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang ICSE 2021 | May 2021 The 43rd International Conference on Software Engineering Project
Publication OpEvo: An Evolutionary Method for Tensor Operator Optimization Xiaotian Gao, Wei Cui, Lintao Zhang, Mao Yang AAAI 2021 | May 2021
Publication Agatha: Smart Contract for DNN Computation Zihan Zheng, Peichen Xie, Xian Zhang, Shuo Chen, Yang Chen, Xiaobing Guo, Guangzhong Sun, Guangyu Sun, Lidong Zhou May 2021 arXiv | May 2021
Publication CopulaNet: Learning residue co-evolution directly from multiple sequence alignment for protein structure prediction Fusong Ju, Jianwei Zhu, Bin Shao, Lupeng Kong, Tie-Yan Liu, Wei-Mou Zheng, Dongbo Bu Nature Communications | May 2021, Vol 12(1): pp. 2535-2535 Project
Publication Dynamic of Stochastic Gradient Descent with State-dependent Noise Qi Meng, Shiqi Gong, Wei Chen, Zhi-Ming Ma, Tie-Yan Liu arXiv: Learning | May 2021
Publication Rethinking Positional Encoding in Language Pre-training Guolin Ke, Di He, Tie-Yan Liu 2021 International Conference on Learning Representations | May 2021
Publication GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training Tianle Cai, Shengjie Luo, Keyulu Xu, Di He, Tie-Yan Liu, Liwei Wang 2021 International Conference on Machine Learning | May 2021
Publication Taking Notes on the Fly Helps Language Pre-Training Qiyu Wu, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu 2021 International Conference on Learning Representations | May 2021
Publication Learning to Automate Chart Layout Configurations Using Crowdsourced Paired Comparison Aoyu Wu, Liwenhan Xie, Bongshin Lee, Yun Wang, Weiwei Cui, Huamin Qu Proceedings of the ACM Conference on Human Factors in Computing Systems | May 2021
Research
Research