Artificial Intelligence
Building intelligent machines that complement human reasoning and extend what people can do.
Microsoft Research Blog
Research Focus: Week of November 22, 2023
A new deep-learning compiler for dynamic sparsity; Tongue Tap could make tongue gestures viable for VR/AR headsets; Ranking LLM-Generated Loop Invariants for Program Verification; Assessing the limits of zero-shot foundation models in single-cell biology.
Tool
MX Pytorch Emulation Library
PyTorch emulation library for Microscaling (MX)-compatible data formats
Microsoft Research Blog
Orca 2: Teaching Small Language Models How to Reason
At Microsoft, we’re expanding AI capabilities by training small language models to achieve the kind of enhanced reasoning and comprehension typically found only in much larger models.
Project
Orca
Using AI, to improve AI Orca is a research team in Microsoft Research. Orca focuses on creating automated pipelines for creating high-quality synthetic data at scale, and training models for specialization and model self-improvement. Orca’s research…
Microsoft Research Blog
Lifelong model editing in large language models: Balancing low-cost targeted edits and catastrophic forgetting
Lifelong model editing fixes mistakes discovered after model deployment. This work could expand sequential editing to model properties like fairness and privacy and enable a new class of solutions for adapting LLMs over long deployment…
Podcast
Abstracts: November 20, 2023
Today I’m talking to Shrey Jain, an applied scientist at Microsoft Research, and Dr. Zoë Hitzig, a junior fellow at the Harvard Society of Fellows.
