background pattern
October 22, 2026 – October 23, 2026

Advancing the science of AI agent evaluation and governance

位置: New York, NY, USA

Thursday, October 22 (Tentative)

All times are in EST (UTC -4)

9:00 AM – 10:00 AM

Check-in & breakfast social

Breakfast included

10:00 AM – 10:15 AM

Welcome & Workshop Overview

Ramayya Krishnan (opens in new tab), Director, AI Measurement Science and Engineering Center (AIMSEC), Carnegie Mellon University

Wesley Hanwen Deng, Senior Researcher, Microsoft Research New York City

10:15 AM – 10:30 AM

Opening remarks

Sarah Bird, Chief Product Officer of Responsible AI, Microsoft

10:30 AM – 11:00 AM

Keynote 1: Title

Zico Kolter (opens in new tab), Professor, Carnegie Mellon University; Board of Directors, OpenAI

11:00 AM – 11:30 AM

Keynote 2: Title

Yacine Jernite (opens in new tab), ML & Society lead, Hugging Face

11:30 AM – 11:45 AM

Short coffee break

11:45 AM – 12:30 PM

Cross Sector Panel

Zico Kolter (opens in new tab), Professor, Carnegie Mellon University; Board of Directors, OpenAI

Yacine Jernite (opens in new tab), ML & Society lead, Hugging Face

Ramayya Krishnan (opens in new tab), Director, AI Measurement Science and Engineering Center (AIMSEC), Carnegie Mellon University

12:30 PM – 2:00 PM

Lunch break

Lunch included

2:00 PM – 3:00 PM

Lightning talks (session 1)

  • 2:00 PM – 2:15 PM
    Lightning talk 1
  • 2:15 PM – 2:30 PM
    Lightning talk 2
  • 2:30 PM – 2:45 PM
    Lightning talk 3
  • 2:45 PM – 3:00 PM
    Lightning talk 4
3:00 PM – 3:30 PM

Lightning talks panel + Q&A

3:30 PM – 4:00 PM

Coffee break

3:30 PM – 4:30 PM

Lightning talks (session 2)

  • 3:30 PM – 3:45 PM
    Lightning talk 5
  • 3:45 PM – 4:00 PM
    Lightning talk 6
  • 4:00 PM – 4:15 PM
    Lightning talk 7
  • 4:15 PM – 4:30 PM
    Lightning talk 8
4:30 PM – 5:00 PM

Lightning talks panel + Q&A

5:00 PM onward

Happy hour & refreshments

Included

Friday, October 23 (Tentative)

9:00 AM – 10:00 AM

Check-in & breakfast social

Breakfast included

10:00 AM – 11:00 AM

Lightning talks (session 3)

  • 10:00 AM – 10:15 AM
    Lightning talk 9
  • 10:15 AM – 10:30 AM
    Lightning talk 10
  • 10:30 AM – 10:45 AM
    Lightning talk 11
  • 10:45 AM – 11:00 AM
    Lightning talk 12
11:00 AM – 11:30 AM

Lightning talks panel + Q&A

11:30 AM – 1:00 PM

Lunch break

Lunch included

1:00 PM – 2:00 PM

Lightning talks (session 4)

  • 1:00 PM – 1:15 PM
    Lightning talk 13
  • 1:15 PM – 1:30 PM
    Lightning talk 14
  • 1:30 PM – 1:45 PM
    Lightning talk 15
  • 1:45 PM – 2:00 PM
    Lightning talk 16
2:00 PM – 2:30 PM

Lightning talks panel + Q&A

2:30 PM – 4:00 PM

Breakout group discussions

  • Group 1
    Evaluating long-horizon tasks and multi-agent coordination
  • Group 2
    Safety, red-teaming, and vulnerability assessment in autonomous agents
  • Group 3
    Domain specific evaluation and governance of agents
  • Group 4
    Societal impact of agentic economy
4:00 PM – 4:30 PM

Breakout group presentations & key takeaways

4:30 PM – 5:00 PM

Closing remarks

Hanna Wallach, Vice President and Distinguished Scientist, Microsoft Research, New York City