Microsoft Research Special Projects
Note: This research has reached its conclusion, and this page is for historical reference and archival purposes only. The Microsoft Research Special Projects group operates on the boundary between engineering and research to drive breakthrough…
TorchScale – A Library for Transformers at (Any) Scale
TorchScale is a PyTorch library that allows researchers and developers to scale up Transformers efficiently and effectively. It has the implementation of fundamental research to improve modeling generality and capability as well as training stability…
Research Focus: Week of December 5, 2022
This special edition of Research Focus highlights some of the 100+ papers from Microsoft Research that were accepted for publication at NeurIPS 2022 – the thirty-sixth annual Conference on Neural Information Processing Systems. In this issue,…