Novel Image Captioning
When does a machine “understand” an image? One definition is when it can generate a novel caption that summarizes the salient content within an image. This content may include objects that are present, their attributes,…
Backward Compatibility ML
The Backward Compatibility ML library is an open-source project for evaluating AI system updates in a new way for increasing system reliability and human trust in AI predictions for actions. This project’s series of loss…
Building multimodal, integrative AI systems with Platform for Situated Intelligence
In the last decade, we’ve seen fast-paced progress in many individual AI areas, such as computer vision, speech, and machine translation. However, anyone who’s tried bringing multiple AI technologies together in end-to-end systems designed for…
DeepSpeed: Extreme-scale model training for everyone
In February, we announced DeepSpeed, an open-source deep learning training optimization library, and ZeRO (Zero Redundancy Optimizer), a novel memory optimization technology in the library, which vastly advances large model training by improving scale, speed,…
Building multimodal, integrative AI systems with Platform for Situated Intelligence webinar
In this webinar, Dan Bohus, a Senior Principal Researcher in the Perception and Interaction Group at Microsoft Research, will introduce Platform for Situated Intelligence, an open-source framework that aims to address these challenges and accelerate and…
Platform for Situated Intelligence: An open-source framework for multimodal, integrative AI
Over the years at Microsoft Research, we’ve studied how to build AI systems that perceive, understand, and act in a human-filled world in real time. Our motivation has been to create computing systems that can…