Publication XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao ArXiv | June 2021 arXiv:2106.04563 Github Project Project
Publication UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training Mingyang Zhou, Luowei Zhou, Shuohang Wang, Yu Cheng, Linjie Li, Zhou Yu, Jingjing Liu IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021) | June 2021
Publication End-to-End NLP Knowledge Graph Construction Ishani Mondal, Yufang Hou, Charles Jochim ACL-IJCNLP 2021 | June 2021
Publication Structure-Grounded Pretraining for Text-to-SQL Xiang Deng, Ahmed Awadallah, Chris Meek, Alex Polozov, Huan Sun, Matthew Richardson NAACL 2021 | June 2021 Project
Publication Improving Zero-Shot Cross-lingual Transfer for Multilingual Question Answering over Knowledge Graph Yucheng Zhou, Xiubo Geng, Tao Shen, Wenqiang Zhang, Daxin Jiang (姜大昕) NAACL | June 2021
Publication VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei June 2021
Publication Developing real-time streaming transformer transducer for speech recognition on large-scale dataset Xie Chen, Yu Wu, Zhenghao Wang, Shujie Liu, Jinyu Li ICASSP | June 2021
Publication MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding Jia-chen Gu, Chongyang Tao, Zhen-Hua Ling, Can Xu, Xiubo Geng, Daxin Jiang (姜大昕) ACL 2021 | June 2021
Publication Continuous speech separation with Conformer Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou ICASSP | June 2021
Publication One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers Chuhan Wu, Fangzhao Wu, Yongfeng Huang ACL-IJCNLP 2021 | June 2021