Publication Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Anand Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2021) | November 2021 Best Student Paper Project
Publication Interpretable Feedback for AutoML and a Proposal forDomain-customized AutoML for Networking Behnaz Arzani, Kevin Hsieh, Haoxian Chen HotNets 2021 | November 2021
Publication Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL Aashaka Shah, Vijay Chidambaram, Meghan Cowan, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi, Rachee Singh November 2021 arXiv preprint | November 2021
Publication LWMPI: An MPI library for NoC‐based lightweight manycore processors with on‐chip memory constraints João Fellipe Uller, João Vicente Souto, Pedro Henrique Penna, M. Castro, H. Freitas, Jean-François Méhaut, Pedro Henrique Penna Concurrency and Computation: Practice and Experience | November 2021, Vol 35: pp. 32-48
Publication How Complex is DNS? Siva Kesava Reddy Kakarla, Ryan Beckett, Todd Millstein, George Varghese HotNets 2021 | November 2021
Publication Towards a Cost vs. Quality Sweet Spot for Monitoring Networks Nofel Yaseen, Behnaz Arzani, Krishna Chintalapudi, Vaishnavi Ranganathan, Felipe Vieira Frujeri, Kevin Hsieh, Daniel S. Berger, Vincent Liu, Srikanth Kandula HotNets 2021 | November 2021
Publication GLOW: Global Weighted Self-Attention Network for Web Search Xuan Shan, Chuanjie Liu, Yiqian Xia, Qi Chen, Yusi Zhang, Kaize Ding, Yaobo Liang, Angen Luo, Yuxiang Luo 2021 INTERNATIONAL CONFERENCE ON BIG DATA | November 2021
Publication SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang NeurIPS 2021 | November 2021 Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
Publication Faa$T: A Transparent Auto-Scaling Cache for Serverless Applications Francisco Romero, Gohar Irfan Chaudhry, Íñigo Goiri, Pragna Gopa, Paul Batum, Neeraja J. Yadwadkar, Rodrigo Fonseca, Christos Kozyrakis, Ricardo Bianchini Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021 Project Project
Publication Provisioning Differentiated Last-Level Cache Allocations to VMs in Public Clouds Mohammad Shahrad, Sameh Elnikety, Ricardo Bianchini Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021 Project