Yifan Xiong的肖像

Yifan Xiong

Senior Researcher

新闻与深度文章

Research Focus: August 5, 2024
微软研究院博客

In this issue: Research Forum Ep. 4 explores multimodal AI. Registration is now open; Surveying developers’ AI needs; SuperBench improves cloud AI infrastructure reliability; Virtual Voices: Exploring factors influencing participation in virtual meetings.

奖项 | USENIX ATC 2024

Best Paper Award at USENIX ATC 2024 

Our paper titled "SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation" received the Best Paper Award at the 2024 USENIX Annual Technical Conference (USENIX ATC '24).

A line graph comparing the end-to-end performance of Meta’s MoE language model using Azure NDm A100 v4 VMs with and without Tutel. The x-axis is the number of A100 (80GB) GPUs, beginning at 8 and going up to 512, and the y-axis is the throughput (K tokens/s), beginning with 0 and going up to 1,000 in intervals of 100. Tutel always achieves higher throughput than fairseq.
微软研究院博客

| Wei Cui, Yifan Xiong, Peng Cheng, 和 Rafael Salas

Mixture of experts (MoE) is a deep learning model architecture in which computational cost is sublinear to the number of parameters, making scaling easier. Nowadays, MoE is the only approach demonstrated to scale deep learning models to trillion-plus parameters, paving…