{"id":1060170,"date":"2024-08-05T09:00:00","date_gmt":"2024-08-05T16:00:00","guid":{"rendered":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/?p=1060170"},"modified":"2024-07-30T08:48:34","modified_gmt":"2024-07-30T15:48:34","slug":"players-creators-and-ai-collaborate-to-build-and-expand-rich-game-narratives","status":"publish","type":"post","link":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/blog\/players-creators-and-ai-collaborate-to-build-and-expand-rich-game-narratives\/","title":{"rendered":"Players, creators, and AI collaborate to build and expand rich game narratives"},"content":{"rendered":"\n

This paper was presented at the <\/em><\/strong>IEEE 2024 Conference on Games<\/em><\/strong> (opens in new tab)<\/span><\/a> (IEEE CoG 2024), the leading forum on innovation in and through games.<\/em><\/strong><\/p>\n\n\n\n

\"Player-Driven<\/figure>\n\n\n\n

In the fast-evolving landscape of video game development, crafting dialogues and narratives is a labor-intensive endeavor. Traditionally, creating these elements involved meticulous hand-coding, resulting in static interactions that limit player agency. However, the rise of large language models (LLMs) is introducing possibilities for richer, more dynamic narrative experiences and automating some of the more challenging aspects of game creation. Despite this advance, a key challenge with using LLMs for narrative design in games is that, without human intervention, they tend to repeat patterns.<\/p>\n\n\n\n

We address this in our paper, \u201cPlayer-Driven Emergence in LLM-Driven Game Narrative<\/a>,\u201d presented at IEEE CoG 2024, where we explore how LLMs can foster unique forms of creativity when players participate in the design process. Rather than replacing designers, LLMs can empower players with considerable freedom in their interactions with nonplayer characters (NPC)\u2014characters not controlled by the players but crucial for gameplay. These interactions provide implicit feedback for designers, offering insights unattainable with traditional dialogue trees\u2014a branching structure of player dialogue choices affecting the narrative.<\/p>\n\n\n\n

Creating and designing \u201cDejaboom!\u201d<\/h2>\n\n\n\n

To test this hypothesis, we developed a text-adventure game called \u201cDejaboom!\u201d The game\u2019s premise involves a player waking up at home with d\u00e9j\u00e0 vu, recalling an explosion in their village from the day before. The objective is to relive the day and prevent the disaster. Players interact with five NPCs in the village. After a set number of steps, the bomb explodes, causing the player to lose all the items they gathered but retain memories of the NPC interactions. Figure 1 illustrates the game design.<\/p>\n\n\n\n

Figure. 1. A map of the village shows the locations, objects, and NPCs.<\/figcaption><\/figure>\n\n\n\n

We built the game using TextWorld<\/a>, an open-source, extensible engine for text adventure games, modifying it to include dialogue with NPCs through OpenAI\u2019s GPT-4 model. TextWorld provided the core game logic, while GPT-4 allowed for dynamic input and output\u2014including both game feedback and NPC responses. Figure 2 illustrates our implementation of the game. In a conventional text game, this setup would allow only a fixed set of player commands and offer a predefined set of game responses. However, the use of GPT-4 allows the game\u2019s input and output to be dynamic.<\/p>\n\n\n\n

\"Figure
Figure 2: In our implementation of the game, the user\u2019s commands are classified by GPT-4 as actions or words. Actions are processed by the game agent, while words trigger GPT-4 to generate contextually appropriate NPC responses.<\/figcaption><\/figure>\n\n\n\n\t
\n\t\t\n\n\t\t

\n\t\tSpotlight: Microsoft research newsletter<\/span>\n\t<\/p>\n\t\n\t

\n\t\t\t\t\t\t
\n\t\t\t\t\n\t\t\t\t\t\"\"\n\t\t\t\t<\/a>\n\t\t\t<\/div>\n\t\t\t\n\t\t\t
\n\n\t\t\t\t\t\t\t\t\t

Microsoft Research Newsletter<\/h2>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

Stay connected to the research community at Microsoft.<\/p>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t
\n\t\t\t\t\t\t\n\t\t\t\t\t\t\tSubscribe today\t\t\t\t\t\t<\/a>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t<\/div>\n\t<\/div>\n\t\n\n\n

Narrative analysis and user study<\/h2>\n\n\n\n

Our goal was to identify narrative paths that players create and how they diverge from the designer\u2019s original narrative. We used GPT-4 to transform player game logs into a narrative graph, where a node represents a player\u2019s strategy at specific points and directed edges (arrows) show game progression. We compared these to a graph of the designer\u2019s intended narrative. We defined emergent nodes as those that appear in the narrative graph of players but are not present in the original narrative graph. <\/p>\n\n\n\n

When we applied this approach to a user study with 28 gamers playing Dejaboom!, we found that players often introduced new strategies and elements, indicating a high level of creative engagement. Those generating the most emergent nodes tended to enjoy games that emphasize discovery, exploration, and experimentation, suggesting that such players are ideally suited for a collaborative approach to game development.<\/p>\n\n\n\n

\"Figure
Figure 3: The single circles indicate the initial narrative graph intended by the designers. The double circles denote the emergent nodes created by players, representing creative new paths. <\/figcaption><\/figure>\n\n\n\n

Implications and looking ahead<\/h2>\n\n\n\n

Our goal is to build methods that help empower game creators to create novel NPC experiences, design new narratives, and ultimately build entire new worlds through implicit player feedback and progressive application of advanced AI technologies. This work represents a foundational step, marking the start of a new paradigm of game development in which designers, players and generative AI models can collaboratively design and evolve games. Utilizing AI models introduces a new mechanism for capturing implicit player feedback through their emergent behaviors.<\/p>\n","protected":false},"excerpt":{"rendered":"

Integrating LLMs in video game development can create dynamic and interactive narratives. By involving players in the narrative design process, LLMs can generate unique player-driven strategies and provide valuable feedback for game designers.<\/p>\n","protected":false},"author":42735,"featured_media":1060215,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"user_nicename","value":"Sudha Rao","user_id":"38341"},{"type":"user_nicename","value":"Chris Brockett","user_id":"31423"},{"type":"user_nicename","value":"Bill Dolan","user_id":"31229"}],"msr_hide_image_in_river":0,"footnotes":""},"categories":[1],"tags":[],"research-area":[13556,13554],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-1060170","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-research-blog","msr-research-area-artificial-intelligence","msr-research-area-human-computer-interaction","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[442191],"related-events":[],"related-researchers":[{"type":"user_nicename","value":"Sudha Rao","user_id":38341,"display_name":"Sudha Rao","author_link":"Sudha Rao<\/a>","is_active":false,"last_first":"Rao, Sudha","people_section":0,"alias":"sudhra"}],"msr_type":"Post","featured_image_thumbnail":"\"Player-Driven","byline":"Sudha Rao<\/a>, Chris Brockett, and Bill Dolan","formattedDate":"August 5, 2024","formattedExcerpt":"Integrating LLMs in video game development can create dynamic and interactive narratives. By involving players in the narrative design process, LLMs can generate unique player-driven strategies and provide valuable feedback for game designers.","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/1060170","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/users\/42735"}],"replies":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/comments?post=1060170"}],"version-history":[{"count":16,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/1060170\/revisions"}],"predecessor-version":[{"id":1063038,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/1060170\/revisions\/1063038"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/media\/1060215"}],"wp:attachment":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1060170"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/categories?post=1060170"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/tags?post=1060170"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1060170"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=1060170"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=1060170"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1060170"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=1060170"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=1060170"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=1060170"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=1060170"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}