Artificial Intelligence
Building intelligent machines that complement human reasoning and extend what people can do.
Blog de recherche Microsoft
Splitwise improves GPU usage by splitting LLM inference phases
Expanded LLM use creates new demands on cloud GPU capacity. Splitwise presents an efficient solution by separating the two essential phases of LLM inference, achieving higher throughput within a limited power budget.
Outil
ParrotServe
“Parrot: Efficient Serving of LLM-based Applications with Semantic Variable” Parrot is a distributed serving system for LLM-based Applications. The Parrot API w/ Semantic Variable is served by a centralized cluster manager called ServeCore, which manages…
Publication
EgoGen: An Egocentric Synthetic Data Generator
Publication