ZeRO-2 & DeepSpeed: Shattering barriers of deep learning speed & scale
In February, we announced DeepSpeed, an open-source deep learning training optimization library, and ZeRO (Zero Redundancy Optimizer), a novel memory optimization technology in the library, which vastly advances large model training by improving scale, speed,…
OpenDP Platform for Differential Privacy
The Science Behind InterpretML: Explainable Boosting Machine
Learn more about the research that powers InterpretML from Explainable Boosting Machine creator, Rich Caurana from Microsoft Research. Learn More: Azure Blog Responsible ML Azure ML
Objects are the secret key to revealing the world between vision and language
Humans perceive the world through many channels, such as images viewed by the eyes or voices heard by the ears. Though any individual channel might be incomplete or noisy, humans can naturally align and fuse…
A Locally Adaptive Interpretable Regression
Diving into Deep InfoMax with Dr. Devon Hjelm
Dr. Devon Hjelm is a senior researcher at the Microsoft Research lab in Montreal, and on the podcast, he joins me to dive deep into his research on Deep InfoMax, a novel self-supervised learning approach…