Artificial Intelligence
Building intelligent machines that complement human reasoning and extend what people can do.
Project
Project Florence (AI)
Project Florence (AI) is a Microsoft AI Cognitive Services initiative, to advance the state of the art computer vision technologies and develop the next generation framework for visual recognition.
Video
Self-Tuning Networks: Amortizing the Hypergradient Computation for Hyperparameter Optimization
Optimization of many deep learning hyperparameters can be formulated as a bilevel optimization problem. While most black-box and gradient-based approaches require many independent training runs, we aim to adapt hyperparameters online as the network trains.…
Publication
Platform for Situated Intelligence
Microsoft Research Blog
Factorized layers revisited: Compressing deep networks without playing the lottery
From BiT (928 million parameters (opens in new tab)) to GPT-3 (175 billion parameters (opens in new tab)), state-of-the-art machine learning models are rapidly growing in size. With the greater expressivity and easier trainability of…
