{"id":8207,"date":"2025-06-11T08:35:44","date_gmt":"2025-06-11T12:35:44","guid":{"rendered":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/?page_id=8207"},"modified":"2025-06-11T08:35:44","modified_gmt":"2025-06-11T12:35:44","slug":"day-1-optimizing-ai-conversations-a-case-study-personalized-shopping-assistance-frameworks","status":"publish","type":"page","link":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/day-1-optimizing-ai-conversations-a-case-study-personalized-shopping-assistance-frameworks\/","title":{"rendered":"Day 1&#8211; Optimizing AI Conversations: A Case Study Personalized Shopping Assistance Frameworks"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8210\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230629.395-300x156.png\" alt=\"\" width=\"656\" height=\"341\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230629.395-300x156.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230629.395-1024x533.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230629.395-768x400.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230629.395-1536x800.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230629.395-600x312.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230629.395.png 1974w\" sizes=\"auto, (max-width: 656px) 100vw, 656px\" \/><\/p>\n<p>\u2014 Hello everyone and glad to be here and how to design AI for truly intelligent conversations<\/p>\n<ul>\n<li>How do we bridge gap between expectations of AI assistant and the actual experience?<\/li>\n<\/ul>\n<p>\u2014 Goal to move AI from reactive tool to proactive guide, that works with natural and intutitive interaction<\/p>\n<ul>\n<li>Reasoning is model for structuring information for helpful responses<\/li>\n<\/ul>\n<p>\u2014 Before we deep dive, let\u2019s ask if you have had bad experience with chatbot or virtual assistants<\/p>\n<ul>\n<li>Will talk about how to approach challenge and significant impact it had on the user experience and why behind the design decisions<\/li>\n<\/ul>\n<p><!-- notionvc: fe764fb8-8334-40ec-924e-924772be9eaa --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8211\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230631.235-300x151.png\" alt=\"\" width=\"636\" height=\"320\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230631.235-300x151.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230631.235-1024x515.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230631.235-768x386.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230631.235-1536x772.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230631.235-600x302.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230631.235.png 1958w\" sizes=\"auto, (max-width: 636px) 100vw, 636px\" \/><\/p>\n<p>\u2014 Evolution of conversation design, and see where we came from<\/p>\n<ul>\n<li>Had bots built on rule-based scripts and clunky decision trees. The systems were brittle and easily broke<\/li>\n<\/ul>\n<p>\u2014 Then had intent classifiers, which mapped user references to pre-defined labels and decision trees and recognized variations of requests<\/p>\n<ul>\n<li>Needed to code for every conceivable iterations<\/li>\n<\/ul>\n<p>\u2014 Now with LLM have new era of contextual inference of inferring the meaning of the input from the user and grasp intent behind the words<\/p>\n<ul>\n<li>Designing conversation and how to reason, and orchestrating LLM cognitive process<\/li>\n<\/ul>\n<p>\u2014 Think of GPS, which used to require the end user to put in exact steps, but it evolved to understand broader instructions and calculate routes dynamically<\/p>\n<p><!-- notionvc: 0ab73a0c-1a0f-4e78-bacc-b72a57f3248e --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8212\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230633.341-300x153.png\" alt=\"\" width=\"673\" height=\"343\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230633.341-300x153.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230633.341-1024x523.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230633.341-768x392.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230633.341-1536x784.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230633.341-600x306.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230633.341.png 1974w\" sizes=\"auto, (max-width: 673px) 100vw, 673px\" \/><\/p>\n<p>\u2014 Building on understanding of conversational design, brought focus to specific challenges team faced to create a truly helpful AI shopping assistant<\/p>\n<ul>\n<li>Goal of personalized guidance from assistant<\/li>\n<\/ul>\n<p>\u2014 Assembled team of diverse and dedicated members (conversation designers, data scientists, and researchers)<\/p>\n<ul>\n<li>Collaboration let us approach problem from multiple angles, and data driven insights<\/li>\n<\/ul>\n<p>\u2014 Important to have design and data working together<\/p>\n<p>\u2014 Initial investigation of research and analysis showed key problem<\/p>\n<ul>\n<li>Users were overwhelmed and misunderstood\n<ul>\n<li>Needed to grasp why users were feeling this way<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><!-- notionvc: 03abb7e6-619b-43cb-bc62-9a2a81f05cc2 --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8213\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230635.418-300x169.png\" alt=\"\" width=\"669\" height=\"377\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230635.418-300x169.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230635.418-1024x577.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230635.418-768x432.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230635.418-1536x865.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230635.418-600x338.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230635.418.png 1602w\" sizes=\"auto, (max-width: 669px) 100vw, 669px\" \/><\/p>\n<p>\u2014 There are two layers of user friction<\/p>\n<ol>\n<li>Catalog Exploration Paradox, which is clash between the mental model of online shopping and AI results<\/li>\n<li>The expectation gap: where the assistant guesses instead of clarifying user intent\n<ol>\n<li>Two layers intertwined and needed to tackle both problems simultaneously<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<p><!-- notionvc: a113f103-9820-4ac9-9bfd-9602d07c2883 --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8214\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230637.543-300x169.png\" alt=\"\" width=\"644\" height=\"363\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230637.543-300x169.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230637.543-1024x578.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230637.543-768x434.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230637.543-1536x867.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230637.543-600x339.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230637.543.png 1594w\" sizes=\"auto, (max-width: 644px) 100vw, 644px\" \/><\/p>\n<p>\u2014 Example of catalog visualization paradox<\/p>\n<ul>\n<li>Online shopping experience has real value\u2014 E-commerce layout is something user is accustomed to, with high visual bandwidth\n<ul>\n<li>Images and descriptions are happening all at once<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>\u2014 Efficient browsing and comparison<\/p>\n<p><!-- notionvc: 80abcc4b-ed9a-4574-ac59-d0402daf7c68 --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8215\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230639.485-300x172.png\" alt=\"\" width=\"680\" height=\"390\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230639.485-300x172.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230639.485-1024x587.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230639.485-768x440.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230639.485-1536x880.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230639.485-600x344.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230639.485.png 1598w\" sizes=\"auto, (max-width: 680px) 100vw, 680px\" \/><\/p>\n<p>\u2014 This approach has drawbacks<\/p>\n<ul>\n<li>Abundance of choices lead to information overload\u2014 which AI can help mitigate<\/li>\n<\/ul>\n<p>\u2014 How can we maintain benefits of rich bandwidth without overwhelm with personalized guidance and compliments?<\/p>\n<p>\u2014 Now let\u2019s look at conversational AI interaction<\/p>\n<ul>\n<li>Conversational AI restricts items that can be displayed,\n<ul>\n<li>User choices are restricted, and people are wondering if missing different options and reduces confidence in AI ability to provide full overview of available products<\/li>\n<\/ul>\n<\/li>\n<li>When AI fails to understand complex user input, and ask unnecessary questions to user which frustrates users, as opposed to them just browsing\n<ul>\n<li>Limited preview they have, restricts ability to explore catalog tasks like filtering and browsing<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><!-- notionvc: af06dcb1-cdda-49ba-b76b-8ba36bab2d2d --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8216\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230642.030-300x169.png\" alt=\"\" width=\"667\" height=\"376\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230642.030-300x169.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230642.030-1024x576.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230642.030-768x432.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230642.030-1536x864.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230642.030-600x338.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230642.030.png 1600w\" sizes=\"auto, (max-width: 667px) 100vw, 667px\" \/><\/p>\n<p>\u2014 To solidify this, see the example above<\/p>\n<ul>\n<li>Left interface can scan and compare, but AI has to be prompted every time to get a result<\/li>\n<\/ul>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8217\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230644.092-300x170.png\" alt=\"\" width=\"593\" height=\"336\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230644.092-300x170.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230644.092-1024x582.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230644.092-768x436.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230644.092-1536x873.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230644.092-600x341.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230644.092.png 1602w\" sizes=\"auto, (max-width: 593px) 100vw, 593px\" \/><\/p>\n<p>\u2014 Example of expectation gap of how AI should work, with how it actually answers questions<\/p>\n<ul>\n<li>User asks for Diwali and classic example of expectation gap and cultural context and gender they were shopping for and erodes trust<\/li>\n<\/ul>\n<p><em>\u2014 If an AI fails to meet unspoken expectations, a user loses confidence in the system\u2014 its equivalent to someone not answering the questions you ask them<\/em><\/p>\n<p><!-- notionvc: 04e55f14-c899-42df-acc9-7390391d1ac1 --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8218\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230646.057-300x169.png\" alt=\"\" width=\"541\" height=\"305\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230646.057-300x169.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230646.057-1024x576.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230646.057-768x432.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230646.057-1536x863.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230646.057-600x337.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230646.057.png 1594w\" sizes=\"auto, (max-width: 541px) 100vw, 541px\" \/><\/p>\n<p>\u2014 Our team was faced with mountain of evidence for broken UX, from rage-clicks to a drop-off rate in usage<\/p>\n<ul>\n<li>We shifted our perspective, as we didn\u2019t need better NLP, but needed to define core problem, and moving beyond conversations as linear flows, but complex reasoning systems\n<ul>\n<li>These would be systems powered by AI, but orchestrated by us<\/li>\n<\/ul>\n<\/li>\n<li>This wasn\u2019t technical challenge, but design, communications, and psychological challenge<\/li>\n<\/ul>\n<p><!-- notionvc: 9335af19-cda0-4057-9694-a8f067ef335f --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8219\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230648.343-300x169.png\" alt=\"\" width=\"517\" height=\"291\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230648.343-300x169.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230648.343-1024x578.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230648.343-768x434.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230648.343-1536x867.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230648.343-600x339.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230648.343.png 1580w\" sizes=\"auto, (max-width: 517px) 100vw, 517px\" \/><\/p>\n<p>\u2014 We analyzed how users interact with the assistant and thousands of chat-logs and phrasing request<\/p>\n<ul>\n<li>Not realizing how queries and how they were contained<\/li>\n<\/ul>\n<p>\u2014 Three patterns for user queries<\/p>\n<ul>\n<li><em><strong>Broad queries<\/strong><\/em> asking with little info for assistant to work with<\/li>\n<li><strong>Medium queries<\/strong> had some more detail, and helped narrow down search space<\/li>\n<li><strong>Narrow queries<\/strong>\u00a0very specific requests with lot of information upfront<\/li>\n<\/ul>\n<p>\u2014 Traditional bots treated all these queries in similar way and relied on keyword matching, regardless of diversity of input<\/p>\n<ul>\n<li>LLM can adapt response based on nuance of query, but only if we provided robust structure to reason with\u2014 so we asked if we could have model breakdown query and analyze it like a salesperson would<\/li>\n<\/ul>\n<p><!-- notionvc: 5e4fe3a8-abfd-494b-b669-d07b2d39bcfb --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8220\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230650.851-300x168.png\" alt=\"\" width=\"543\" height=\"304\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230650.851-300x168.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230650.851-1024x574.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230650.851-768x431.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230650.851-1536x861.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230650.851-600x336.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230650.851.png 1566w\" sizes=\"auto, (max-width: 543px) 100vw, 543px\" \/><\/p>\n<p>\u2014 Concrete example of this can be seen above<\/p>\n<ul>\n<li>Traditional system of grabbing keyword of laptop, but LLM would provide much more sophisticated analysis and, we taught our model to breakdown user input to three key structure facets and primary function for performance requirements<\/li>\n<\/ul>\n<p>\u2014 If asking for gaming laptop it implied they need processor and constraints, like budget available, and preference, a desirable but flexible criteria<\/p>\n<ul>\n<li>Crucial to emphasize structure wasn\u2019t through fine-tuning or ML models, but through crafted prompt design<\/li>\n<li>Structuring prompts to guide LLM to output info in format that system could easily use \u2014 like sales person grasping customer needs<\/li>\n<\/ul>\n<p><!-- notionvc: 2f88a93f-1716-479d-90ab-0bde7f58bed9 --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8221\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230652.837-300x169.png\" alt=\"\" width=\"509\" height=\"287\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230652.837-300x169.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230652.837-1024x576.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230652.837-768x432.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230652.837-1536x864.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230652.837-600x337.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230652.837.png 1576w\" sizes=\"auto, (max-width: 509px) 100vw, 509px\" \/><\/p>\n<p>\u2014 Here\u2019s how AI assistant applied framework<\/p>\n<ul>\n<li>If query is broad and lacks detail\u2014 provide follow-up questions to get use case and information, i.e. budget and what to use laptop for<\/li>\n<li>If query is medium\u2014 choose to skip clarifying questions and show results and ask if more is needed<\/li>\n<\/ul>\n<p>\u2014 AI thinks through the conversation and considers what details need to be provided, and crafted prompts with logic to guide assistant to decision making process<\/p>\n<p>\u2014 Architecture is what makes assistant adaptive, and it allows to handle wide range of user inputs, with flexibility and intelligence<\/p>\n<p><!-- notionvc: 1711a557-8c5c-4b5e-a466-99e608df602f --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8222\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230654.973-300x160.png\" alt=\"\" width=\"493\" height=\"263\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230654.973-300x160.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230654.973-1024x546.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230654.973-768x410.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230654.973-1536x819.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230654.973-600x320.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230654.973.png 1564w\" sizes=\"auto, (max-width: 493px) 100vw, 493px\" \/><\/p>\n<p>\u2014 Here\u2019s a side-by-side comparison of the current and improved experience<\/p>\n<p>\u2014 In the status quo<\/p>\n<ul>\n<li>Preview results immediately that might be unhelpful<\/li>\n<li>Two or three predefined choices and restricted user ability to specify their own requirements<\/li>\n<li>Mandatory checklist and people feel interrogated not helped<\/li>\n<li>Endless follow-up questions<\/li>\n<\/ul>\n<p>\u2014 From the AI assistant<\/p>\n<ul>\n<li>Improved reasoning and not results and brief intelligence conversation with needs and goals and what matters to the users<\/li>\n<li>Ends gracefully with enough info to provide helpful recommendations and avoiding repetitive questions and expanded to display multiple options<\/li>\n<\/ul>\n<p>\u2014 This shows how power of structuring AI behavior and guiding intelligence to shape user experience<\/p>\n<p><!-- notionvc: 10da4cfc-b67b-4fb2-9632-1e8010450339 --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8223\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230657.097-300x172.png\" alt=\"\" width=\"520\" height=\"298\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230657.097-300x172.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230657.097-1024x587.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230657.097-768x440.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230657.097-1536x881.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230657.097-600x344.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230657.097.png 1594w\" sizes=\"auto, (max-width: 520px) 100vw, 520px\" \/><\/p>\n<p>\u2014 Favorite part was results we saw with 2.5x increase in monthly active users and using assistant more frequently and more time interacting with it, and higher-level of user satisfaction and engagement and substantial last touch, and taking desired actions with different AI assistants<\/p>\n<p>\u2014 What excited us the most was qualitative feedback from users<\/p>\n<ul>\n<li>Our approach felt was validated<\/li>\n<li>The LLM was no longer a tool for specific task, but trusted guide and advisor<\/li>\n<\/ul>\n<p>\u2014 More natural language, and fewer frustration markers and demonstrate. Power of designing for reasoning and not a response<\/p>\n<p><!-- notionvc: 0288f9a7-5993-4302-a876-1442779b9655 --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8224\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230659.146-300x173.png\" alt=\"\" width=\"588\" height=\"339\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230659.146-300x173.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230659.146-1024x589.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230659.146-768x442.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230659.146-1536x884.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230659.146-600x345.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230659.146.png 1588w\" sizes=\"auto, (max-width: 588px) 100vw, 588px\" \/><\/p>\n<p>\u2014 Arrive at core takeaway of guiding for reasoning as opposed to response, and design for reasoning<\/p>\n<ul>\n<li>Right response for AI and specific answers with efficiency over understanding<\/li>\n<li><em>Focus on designing prompts and frameworks that empower the AI to understand the intent behind the user\u2019s query, extract the relevant info, and provide information on how to respond<\/em>\n<ul>\n<li>Like teaching a student, and teaching them how to think<\/li>\n<\/ul>\n<\/li>\n<li>Can overcome limitations of keyword matching, and far more adaptable and helpful AI assistants<\/li>\n<\/ul>\n<p><!-- notionvc: ba426d6b-d340-49dc-b464-35ebc58f482a --><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-8225\" src=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230701.508-300x169.png\" alt=\"\" width=\"568\" height=\"320\" srcset=\"https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230701.508-300x169.png 300w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230701.508-1024x577.png 1024w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230701.508-768x433.png 768w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230701.508-1536x865.png 1536w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230701.508-600x338.png 600w, https:\/\/rm-media.nyc3.digitaloceanspaces.com\/wp-content\/uploads\/sites\/36\/2025\/06\/image-2025-06-10T230701.508.png 1576w\" sizes=\"auto, (max-width: 568px) 100vw, 568px\" \/><\/p>\n<p>\u2014 Thank you<\/p>\n<p><span style=\"text-decoration: underline\">Q&amp;A<\/span><\/p>\n<ol>\n<li>Can you explain U\/V Last touch a bit more?\n<ol>\n<li>Metric created to see how chatbot interactions responsible for making a purchase happen<\/li>\n<\/ol>\n<\/li>\n<li>Did this require developing or refining taxonomy terms?\n<ol>\n<li>Prompting helped us far more than taxonomy for us and orchestration layer for us and purchase for us, and relevant agent that went for us and extensive tagging\n<ol>\n<li>Limited prompting<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/li>\n<li>Did you explore ways to help users ask better questions through the design?\n<ol>\n<li>It was not explicit, but implicit. The prompts encouraged people to ask longer questions and make them feel comfortable in typing what they wanted<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<p><!-- notionvc: 909c71e7-4f60-4c24-8582-d53eb9d3b384 --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u2014 Hello everyone and glad to be here and how to design AI for truly intelligent conversations How do we bridge gap between expectations of AI assistant and the actual experience? \u2014 Goal to move AI from reactive tool to proactive guide, that works with natural and intutitive interaction Reasoning is model for structuring information [&hellip;]<\/p>\n","protected":false},"author":334,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"_seopress_robots_primary_cat":"","_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","om_disable_all_campaigns":false,"footnotes":""},"class_list":["post-8207","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/pages\/8207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/users\/334"}],"replies":[{"embeddable":true,"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/comments?post=8207"}],"version-history":[{"count":3,"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/pages\/8207\/revisions"}],"predecessor-version":[{"id":8319,"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/pages\/8207\/revisions\/8319"}],"wp:attachment":[{"href":"https:\/\/rosenfeldmedia.com\/designing-with-ai\/wp-json\/wp\/v2\/media?parent=8207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}