Disaggregated model evaluation and comparison

January 23, 2023

This video is an introduction to disaggregated model evaluation and comparison in Machine Learning. Throughout this video we will describe the main concepts of disaggregated evaluation, how these concepts relate to Responsible AI approaches of scoring and evaluating a ML model, and how they can be used in practice.

Research Area
- Artificial intelligence
Research Lab
- Microsoft Research Lab - Redmond
Group
- Adaptive Systems and Interaction Group

Watch Next

Introducing Muse: Our first generative AI model designed for gameplay ideation
May 20, 2026
Guiding the AI disruption to the Good Place
May 14, 2026
Yash Lara,

David Rothschild
New fine-tuning of language models: Match meaning, not tokens
May 14, 2026
Yash Lara,

Carles Domingo-Enrich
Introducing Interwhen: Steering reasoning agents with real-time verification
May 14, 2026
Yash Lara,

Amit Sharma
Introducing GitHub Agentic Workflows: AI that runs your repo
May 14, 2026
Yash Lara,

Peli de Halleux
MagenticLite: A full-stack agentic experience powered by Small Models
May 14, 2026
Harkirat Behl,

Weili Shi,

Hussein Mozannar
Generative AI for High-Stakes Decision-Making with Applications in One Health
May 12, 2026
Lingkai Kong
Physics and information theory of generative diffusion
May 5, 2026
Luca Ambrogioni
Language & Voice AI for Africa: From Data to Deployment and Impact
April 30, 2026
Vukosi Marivate,

Tavonga Siyavora,

Tobi Olatunji

, et. al.
Upper Bound 2024: Towards Human-Centered AI in AAA Video Game
June 11, 2024
Raluca Georgescu

Your Privacy Choices