{"id":579757,"date":"2019-04-26T08:07:51","date_gmt":"2019-04-26T15:07:51","guid":{"rendered":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/?p=579757"},"modified":"2019-04-26T09:43:30","modified_gmt":"2019-04-26T16:43:30","slug":"how-to-better-design-ai-from-ideation-to-user-perception-and-acceptance","status":"publish","type":"post","link":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/blog\/how-to-better-design-ai-from-ideation-to-user-perception-and-acceptance\/","title":{"rendered":"How to better design AI – from ideation to user perception and acceptance"},"content":{"rendered":"

\"How<\/a><\/p>\n

Designing artificial intelligence systems and features poses new challenges for user experience (UX) practitioners. Traditionally, UX designers rely on sketching and low-fidelity, fast prototyping to imagine and test their ideas. The usual design tools and techniques, however, can\u2019t always meet the demands of designing AI-infused systems. For one, these systems are increasingly based on more abstract interactions like language understanding and conversation participation. They\u2019re also intrinsically dynamic and unpredictable, changing over time as they learn and adapt to users, their tasks, and their contexts. For the latter reasons, AI systems often violate well-known usability principles, making updated guidance for designing human-AI interaction necessary. Additionally, designing for AI systems raises questions about what interaction design patterns work best and how they affect user perception.<\/p>\n

Microsoft Research is presenting three papers at the ACM CHI Conference on Human Factors in Computing Systems (CHI) (opens in new tab)<\/span><\/a> to address these needs and empower UX practitioners to design for AI.<\/p>\n

Natural language processing\u2014sketching the abstract<\/h3>\n

The paper \u201cSketching NLP: A Case Study of Exploring the Right Things to Design with Language Intelligence<\/a>\u201d gets to the heart of a fundamental design thinking method: sketching. Designers use various sketching techniques (opens in new tab)<\/span><\/a>, such as storyboards, wireframes, and paper prototypes, to clarify problem spaces and rapidly explore tentative design alternatives. However, many of these standard sketching tools are based on tangible interactions like swiping or pointing and clicking, not more abstract ones. So imagine the difficulties that arise when, let\u2019s say, you and your team are planning to use natural language processing (NLP) techniques to add intelligent writing assistance to a document-authoring application.<\/p>\n

The paper identifies several of these challenges\u2014including how to sketch language interactions abstractly so authors can have a better understanding of the possible outcomes and how to understand and stretch NLP\u2019s technical limits and, within these limits, envision novel NLP applications. It also introduces a new format of wireframe that authors refer to as a notebook<\/em>\u2014a text-editor augmented with features for sketching tentative NLP-based design concepts.<\/p>\n

Through a candid, behind-the-scenes glimpse into the product design process of a team of human-computer interaction (HCI) researchers and NLP scientists, the paper shows such a notebook can serve as a useful common ground for designers, NLP scientists, and potential users to communicate about proposed design concepts. The paper envisions a future when NLP-specific design tools will be as common as wireframes and paper prototypes are today.<\/p>\n

Guidelines for human-AI interaction<\/h3>\n

Besides tools for ideation, designers often rely on principles and heuristics to guide design decisions and evaluate existing solutions. The paper \u201cGuidelines for Human-AI Interaction<\/a>\u201d proposes a foundation for design guidance specific to AI.<\/p>\n

While guidance on designing for AI abounds, the community lacked one unified, trustworthy set of guidelines for creating intuitive interactions between humans and AI systems. The authors synthesized more than two decades of research and thinking in this area<\/a> into a set of guidelines that underwent three rigorous rounds of validation. The resulting 18 guidelines for human-AI interaction (opens in new tab)<\/span><\/a> suggest how AI systems should behave upon initial interaction, during regular interaction, when they\u2019re inevitably wrong, and over time.<\/p>\n

The guidelines can be used to evaluate ideas or systems following established interface inspection methods such as heuristic evaluation. They can also be used to ground ideation (opens in new tab)<\/span><\/a> as teams imagine an AI-infused system\u2019s capabilities. These guidelines are also intended as a basis for dialogue among the different disciplines involved in designing AI-infused systems, such as UX, engineering, data science, and management. The guidelines are available in a poster<\/a> and printable cards<\/a>\u2014stop by the Microsoft booth during CHI<\/a> to meet the authors and get a deck!<\/p>\n

Shaping expectations of AI systems<\/h3>\n

Errors are inherent in AI-infused systems, yet most users don\u2019t expect computers to behave inconsistently or imperfectly. The first two guidelines for human-AI interaction recommend setting expectations about an AI system\u2019s capabilities and performance early on to prevent user frustration and dissatisfaction down the line. The paper \u201cWill You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems<\/a>\u201d evaluates different techniques for adjusting user expectations to increase user acceptance.<\/p>\n

The paper suggests three patterns for shaping expectations: stating an AI\u2019s accuracy explicitly, explaining how the AI works, and allowing users to control the AI\u2019s performance.<\/p>\n

Through studies of these patterns implemented in an AI-infused scheduling assistant, the paper demonstrates their effectiveness in sustaining user acceptance and reveals differences in acceptance when the AI is tuned to avoid false positive errors versus when it is tuned to avoid false negative errors\u2014even with the same overall accuracy. These results suggest the effort and resources required to address an error are a key factor in user acceptance of AI technology. The paper provides UX designers with evidence they can use to support decisions for how to set expectations about AI systems and specific patterns for doing so.<\/p>\n

These three papers seek to assist UX designers in creating AI-powered experiences that are useful, usable, and frustration-free, and they advance scholarly knowledge in areas that have direct implications for how to design AI. We look forward to sharing them at CHI and hope that, if you attend the conference in Glasgow, Scotland, you stop by the Microsoft booth to meet the authors!<\/p>\n","protected":false},"excerpt":{"rendered":"

Designing artificial intelligence systems and features poses new challenges for user experience (UX) practitioners. Traditionally, UX designers rely on sketching and low-fidelity, fast prototyping to imagine and test their ideas. The usual design tools and techniques, however, can\u2019t always meet the demands of designing AI-infused systems. For one, these systems are increasingly based on more […]<\/p>\n","protected":false},"author":38022,"featured_media":580465,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"user_nicename","value":"Mihaela Vorvoreanu","user_id":"36804"},{"type":"user_nicename","value":"Saleema Amershi","user_id":"33505"},{"type":"user_nicename","value":"Justin Cranshaw","user_id":"32450"},{"type":"user_nicename","value":"Shamsi Iqbal","user_id":"33592"}],"msr_hide_image_in_river":0,"footnotes":""},"categories":[194467],"tags":[],"research-area":[13556],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-579757","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artifical-intelligence","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[577950],"related-researchers":[{"type":"user_nicename","value":"Mihaela Vorvoreanu","user_id":36804,"display_name":"Mihaela Vorvoreanu","author_link":"Mihaela Vorvoreanu<\/a>","is_active":false,"last_first":"Vorvoreanu, Mihaela","people_section":0,"alias":"mivorvor"},{"type":"user_nicename","value":"Saleema Amershi","user_id":33505,"display_name":"Saleema Amershi","author_link":"Saleema Amershi<\/a>","is_active":false,"last_first":"Amershi, Saleema","people_section":0,"alias":"samershi"},{"type":"user_nicename","value":"Shamsi Iqbal","user_id":33592,"display_name":"Shamsi Iqbal","author_link":"Shamsi Iqbal<\/a>","is_active":false,"last_first":"Iqbal, Shamsi","people_section":0,"alias":"shamsi"}],"msr_type":"Post","featured_image_thumbnail":"\"\"","byline":"Mihaela Vorvoreanu<\/a>, Saleema Amershi<\/a>, Justin Cranshaw, and Shamsi Iqbal<\/a>","formattedDate":"April 26, 2019","formattedExcerpt":"Designing artificial intelligence systems and features poses new challenges for user experience (UX) practitioners. Traditionally, UX designers rely on sketching and low-fidelity, fast prototyping to imagine and test their ideas. The usual design tools and techniques, however, can\u2019t always meet the demands of designing AI-infused…","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/579757","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/users\/38022"}],"replies":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/comments?post=579757"}],"version-history":[{"count":11,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/579757\/revisions"}],"predecessor-version":[{"id":580540,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/579757\/revisions\/580540"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/media\/580465"}],"wp:attachment":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/media?parent=579757"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/categories?post=579757"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/tags?post=579757"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=579757"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=579757"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=579757"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=579757"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=579757"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=579757"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=579757"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=579757"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}