{"id":11697,"date":"2025-01-20T13:04:39","date_gmt":"2025-01-20T21:04:39","guid":{"rendered":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/?post_type=example&#038;p=11697"},"modified":"2025-02-03T09:49:17","modified_gmt":"2025-02-03T17:49:17","slug":"visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do","status":"publish","type":"example","link":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","title":{"rendered":"Uncertainty highlighting | G2: Make clear how well the system can do what it can&nbsp;do"},"content":{"rendered":"\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"10\" src=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png\" alt=\"blue header bar\" class=\"wp-image-8823\" srcset=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1024x10.png 1024w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-300x3.png 300w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-768x8.png 768w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-1536x16.png 1536w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2023\/05\/blue-header-bar-1536x14-5-23-2048x21.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Highlighting tokens with low generation probabilities (<a href=\"https:\/\/doi.org\/10.48550\/arXiv.2307.03744\" target=\"_blank\" rel=\"noreferrer noopener\">Spatharioti et al., 2023<\/a>) sets expectations for how well the system can do what it can do (<a href=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/\" target=\"_blank\" rel=\"noreferrer noopener\">Guideline 2<\/a>) by using visual cues to convey uncertainty in AI outputs.<\/p>\n\n\n\n<p>The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in mind that overreliance mitigations can backfire. Be sure to test such mitigations in context, with your AI system\u2019s actual users. Learn more about\u00a0<a href=\"https:\/\/aka.ms\/overreliance_review\" target=\"_blank\" rel=\"noreferrer noopener\">overreliance on AI<\/a> and\u00a0<a href=\"https:\/\/aka.ms\/genAI_reliance\" target=\"_blank\" rel=\"noreferrer noopener\">appropriate reliance on generative AI<\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"618\" src=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities-1024x618.png\" alt=\"\" class=\"wp-image-11703\" srcset=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities-1024x618.png 1024w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities-300x181.png 300w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities-768x464.png 768w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities-1536x927.png 1536w, https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities-2048x1236.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>Image captured in February 2024.<\/em><\/figcaption><\/figure>\n","protected":false},"featured_media":11703,"menu_order":0,"template":"","meta":{"toolkit_pattern_number":"","ep_exclude_from_search":false,"footnotes":""},"application-type":[96,99,56,30,59],"goal":[114,123],"guideline-term":[4],"product-category":[70,65],"class_list":["post-11697","example","type-example","status-publish","has-post-thumbnail","hentry","application-type-gen-ai","application-type-llm","application-type-natural-language-processing-text","application-type-search","application-type-text-generation","goal-appropriate-reliance","goal-transparency","guideline-term-make-clear-how-well-the-system-can-do-what-it-can-do","product-category-chatbot","product-category-search-engine"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit\" \/>\n<meta property=\"og:description\" content=\"Highlighting tokens with low generation probabilities (Spatharioti et al., 2023) sets expectations for how well the system can do what it can do (Guideline 2) by using visual cues to convey uncertainty in AI outputs. The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2025-02-03T17:49:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/prod\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2255\" \/>\n\t<meta property=\"og:image:height\" content=\"1361\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\",\"url\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\",\"name\":\"Uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png\",\"datePublished\":\"2025-01-20T21:04:39+00:00\",\"dateModified\":\"2025-02-03T17:49:17+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage\",\"url\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png\",\"contentUrl\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png\",\"width\":2255,\"height\":1361,\"caption\":\"Highlighting tokens with low generation probabilities in the AI outputs. Some tokens in the AI output are highlighted in red.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"G2: Make clear how well the system can do what it can do.\",\"item\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Uncertainty highlighting | G2: Make clear how well the system can do what it can&nbsp;do\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#website\",\"url\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png\",\"contentUrl\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","og_locale":"en_US","og_type":"article","og_title":"Uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","og_description":"Highlighting tokens with low generation probabilities (Spatharioti et al., 2023) sets expectations for how well the system can do what it can do (Guideline 2) by using visual cues to convey uncertainty in AI outputs. The techniques used in this example have the potential to foster appropriate reliance on AI, by reducing overreliance. Keep in [&hellip;]","og_url":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2025-02-03T17:49:17+00:00","og_image":[{"width":2255,"height":1361,"url":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/prod\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","url":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/","name":"Uncertainty highlighting | G2: Make clear how well the system can do what it can do - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"image":{"@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage"},"thumbnailUrl":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png","datePublished":"2025-01-20T21:04:39+00:00","dateModified":"2025-02-03T17:49:17+00:00","breadcrumb":{"@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#primaryimage","url":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png","contentUrl":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2025\/01\/Visual-uncertainty-expressions-low-generation-probabilities.png","width":2255,"height":1361,"caption":"Highlighting tokens with low generation probabilities in the AI outputs. Some tokens in the AI output are highlighted in red."},{"@type":"BreadcrumbList","@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/example\/visual-uncertainty-expressions-g2-make-clear-how-well-the-system-can-do-what-it-can-do\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"G2: Make clear how well the system can do what it can do.","item":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/"},{"@type":"ListItem","position":3,"name":"Uncertainty highlighting | G2: Make clear how well the system can do what it can&nbsp;do"}]},{"@type":"WebSite","@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#website","url":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11697","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example"}],"about":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/example"}],"version-history":[{"count":3,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11697\/revisions"}],"predecessor-version":[{"id":11802,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/11697\/revisions\/11802"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media\/11703"}],"wp:attachment":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=11697"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=11697"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=11697"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=11697"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=11697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}