WHAM: World and Human Action Models
Unlocking new forms of creative expression and ushering in the future of interactive media
News & features
In the news | XBOX Wire
Empowering Creators and Players With Muse, a Generative AI Model for Gameplay
In nearly every corner of our lives, the buzz about AI is impossible to ignore. It’s destined to revolutionize how we work, learn, and play. For those of us immersed in the world of gaming—whether as players or creators—the question…
Today we are making available an interactive real-time gameplay experience in Copilot Labs. Head over to this link (opens in new tab) to play an AI rendition of Quake II gameplay, powered by Muse. 5 second video of Quake II…
In the news | IEEE Spectrum
Microsoft’s Muse AI Edits Video Games on the Fly: Muse is a proof of concept for more consistent AI gameplay
“They have trained what’s essentially a neural game engine that has unprecedented temporal coherence and fidelity,” says Julian Togelius, an associate professor of computer science at New York University and co-founder of AI game testing company Modl.ai. “That has wide…
Introducing Muse: Our first generative AI model designed for gameplay ideation
| Katja Hofmann
Today Nature published Microsoft’s research detailing our WHAM, an AI model that generates video game visuals & controller actions. We are releasing the model weights, sample data, & WHAM Demonstrator on Azure AI Foundry, enabling researchers to build on the…
In the news | Official Microsoft Blog
A new level unlocked
Today Microsoft released Muse, a first-of-its-kind generative AI model that we are applying to gaming (opens in new tab). But it’s so much more than that. What we’re sharing today is a huge step forward for gameplay ideation. And what’s even more exciting…
Collaborators: Gaming AI with Haiyan Zhang
| Gretchen Huizinga and Haiyan Zhang
For over a decade, Xbox has been leveraging AI to elevate gaming. Haiyan Zhang, GM of Gaming AI, explores the collaborations behind the work and the potential for generative AI to support better experiences for both players and game creators.