{"id":184139,"date":"2013-10-03T14:46:50","date_gmt":"2013-10-03T14:46:50","guid":{"rendered":"https:\/\/staging.rm.gfolkdev.net\/?p=184139"},"modified":"2022-10-04T15:05:24","modified_gmt":"2022-10-04T15:05:24","slug":"quickpanel-launch-a-healthcare-exchange-with-no-user-testing","status":"publish","type":"post","link":"https:\/\/rosenfeldmedia.com\/quickpanel-launch-a-healthcare-exchange-with-no-user-testing\/","title":{"rendered":"QuickPanel: Launch a Healthcare Exchange with No User Testing?"},"content":{"rendered":"

The Wall Street Journal just informed us that \u201cGroups Leading Insurance Sign-Ups Haven’t Tested Program’s Web Tool<\/a>\u201d (login required, sorry). The exchange sign-up process, expected to take as long as 45 minutes, would help U.S. citizens through complex issues, such as understanding their coverage options, deductibles, and prices. But it hasn\u2019t even been tried by the community workers whose job it is to help citizens through the process. <\/em><\/p>\n

Still, \u201ca state Department of Health spokesman said\u2026 that everything was \u2018on track\u2019.” Good idea? We asked some of our UX experts<\/a> to weigh in on the process:<\/em><\/p>\n

Rosenfeld Media:<\/strong> Should state governments have delayed launching their health exchanges to perform user testing, even if it meant missing their launch deadline?<\/p>\n

Steve Portigal<\/strong> It\u2019s interesting that in some contexts we applaud moving quickly, launching in beta, and having real users give feedback to help refine the product. Granted, there\u2019s more at stake here for the producers (e.g., the states) and the users than there would be (say) for an app that finds dog walkers in your area, but it\u2019s intriguing how we reframe this as a clusterfuck already. Meanwhile, if there\u2019s a \u201cshould\u201d here, it\u2019s that they should have developed a plan that included time to expose the exchange signup process\u2014in whatever form\u2014to real people.<\/p>\n

If just one small piece fails, that can be enough to keep someone from succeeding.<\/p><\/blockquote>\n

<\/p>\n

Aarron Walter:<\/strong> Healthcare is complicated even for the experts who drafted the legislation, so it should come as no surprise that U.S. citizens with varying levels of proficiency with technology and the English language will struggle and fail to enroll in the new ACA system. Lives are quite literally at stake. \u00a0If healthcare is to be a fundamental right of Americans, then the system that provides it needs to be usable and accessible for all on day one of the launch.<\/p>\n

Whitney Quesenbery<\/strong> Was there really \u201cno usability testing\u201d? \u00a0Or was there not enough testing, so that each piece of the system was strong?\u00a0 I know that work on the health exchanges started long ago, including some early design research and templates. \u00a0But a design framework, even with a good interaction style guide, is just the start of a large complex system, and getting all those details right is a real challenge. If just one small piece fails, that can be enough to keep someone from succeeding.<\/p>\n

Rosenfeld Media:<\/strong> Just like flubbed launches, delayed launches are embarrassing. Is there a sweet spot here? In other words, at what point is continuing user testing less valuable than launching?<\/p>\n

If there\u2019s a \u201cshould\u201d here, it\u2019s that they should have developed a plan that included time to expose the exchange signup process\u2014in whatever form\u2014to real people.<\/p><\/blockquote>\n

<\/p>\n

Steve Portigal:<\/strong> Context is everything. If the thing you are launching is on the front page of every paper and your vociferous opponents are willing to shut the government down rather than have you launch, then you probably want to be as flawless as possible. Launch a reduced experience, but make sure it works. If you are delivering a product for a small set of elite users, you have more forgiveness baked in. Backlash is a function of hype (see: iOS7).<\/p>\n

Whitney Quesenbery:<\/strong> \u00a0I\u2019d like to suggest a different question. I don\u2019t think there was any way that the opening was going to be delayed\u2014that just isn\u2019t politically feasible in the current context. \u00a0Maybe the question is what could have been done to make the first 24 hours more of a success.<\/p>\n

The real test of the usability of the system will be what happens after the opening day (or week) rush. First, they need to solve the technical problems. The best designed site is useless if you can\u2019t sign on or if you hit bugs. Then, we\u2019ll be able to see if people can understand how to set up an account, compare their options, and complete an application.<\/p>\n

I agree with Steve\u2019s comment above that a better process for getting everyone ready\u2014especially the front-line health workers is the big \u201cshould.\u201d \u00a0Demos, training, and support could all have helped everyone be more confident that they knew how the exchanges would work. It\u2019s really hard to see something for the first time on the day that you\u2019re supposed to be helping others.<\/p>\n

Rosenfeld Media:<\/strong> If you were consulting for an exchange that had launched without user testing, what advice would you be giving them this minute?<\/p>\n

Steve Portigal:<\/strong> Pay my invoice ASAP. Okay, more realistically, I\u2019d be encouraging them to develop a triage plan. What are the elements of the experience (e.g., accuracy, completion, actionable) that are essential, and how can they, even anecdotally, begin to take the temperature of those measures and to develop a way to determine iterative changes and rapidly issue incremental releases.<\/p>\n

If healthcare is to be a fundamental right of Americans, then the system that provides it needs to be usable and accessible for all on day one of the launch.<\/p><\/blockquote>\n

<\/p>\n

Whitney Quesenbery:<\/strong> I\u2019d want the team out in the community health centers and listening in on the support lines, observing, listening, and learning. Make sure they know where the barriers are and understand exactly what problems people are having: Where is the process is confusing? Where people don\u2019t understand the instructions or information? Where is the interaction counterintuitive? It\u2019s an opportunity for doing usability testing in the field and seeing first-hand how the marketplaces are working. Those insights are critical to both prioritizing the work of fixing problems and making sure any changes are done right. \u00a0The worst thing they could do is flail around. Fix the most immediate and visible problems, and then keep working on the others in a careful way.<\/p>\n

Like what our experts had to say? Guess what: you can have them bring their brains to you. Steve Portigal<\/a>, Whitney Quesenbery<\/a>, and Aarron Walter are available for consulting<\/a> and training<\/a> through Rosenfeld Media.<\/em><\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

The Wall Street Journal just informed us that \u201cGroups Leading Insurance Sign-Ups Haven’t Tested Program’s Web Tool\u201d (login required, sorry). The exchange sign-up process, expected to take as long as 45 minutes, would help U.S. citizens through complex issues, such as understanding their coverage options, deductibles, and prices. But it hasn\u2019t even been tried by … Continued<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_seopress_robots_primary_cat":"","_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","footnotes":""},"categories":[26],"tags":[],"acf":[],"_links":{"self":[{"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/posts\/184139"}],"collection":[{"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/comments?post=184139"}],"version-history":[{"count":4,"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/posts\/184139\/revisions"}],"predecessor-version":[{"id":186455,"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/posts\/184139\/revisions\/186455"}],"wp:attachment":[{"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/media?parent=184139"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/categories?post=184139"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rosenfeldmedia.com\/wp-json\/wp\/v2\/tags?post=184139"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}