{"id":1152,"date":"2014-03-09T23:06:02","date_gmt":"2014-03-10T04:06:02","guid":{"rendered":"http:\/\/juneux.com\/blog\/?p=1152"},"modified":"2018-07-23T11:26:17","modified_gmt":"2018-07-23T16:26:17","slug":"the-5-step-process-we-use-to-plan-conduct-usability-studies","status":"publish","type":"post","link":"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/","title":{"rendered":"The 5-Step Process I Use to Plan &#038; Conduct Usability Studies"},"content":{"rendered":"<p><span style=\"font-size: x-large;\">Over the past 15 years, I have conducted more than 400 usability tests on types of sites and apps. Here is my process<\/span><span style=\"font-size: x-large;\">.<\/span><\/p>\n<p>My\u00a0process for planning and conducting a usability study from start to finish includes 5 steps:<\/p>\n<ol>\n<li><a href=\"#discovery\">Discovery<\/a><\/li>\n<li><a href=\"#recruiting\">Recruiting &amp; Scheduling<\/a><\/li>\n<li><a href=\"#script\">Script Development<\/a><\/li>\n<li><a href=\"#facilitation\">Facilitation<\/a><\/li>\n<li><a href=\"#analysis\">Analysis &amp; Findings<\/a><\/li>\n<\/ol>\n<p>Below is a brief overview of each step.<\/p>\n<h2 id=\"discovery\"><b>1. Discovery: Laying the Groundwork<\/b><\/h2>\n<p>In this phase, I will\u00a0learn about the objectives of your usability study: <i>what<\/i> you want to specifically learn and <i>who<\/i> you want to test your site or software. I\u00a0use this information to write a <b>usability<\/b> <b>test plan<\/b>.<\/p>\n<p>The test plan includes every detail that will be used for recruiting participants and developing the script, plus the <b>testing methodology<\/b>\u00a0I will use and the overall schedule. It\u2019s the foundation for everything that lies ahead.<\/p>\n<p>There are several types of testing methodologies and hybrid approaches I\u00a0use when conducting a usability study. One of the most common is called the \u201c<b>think-aloud methodology<\/b>.\u201d<\/p>\n<blockquote><p><strong><i>Think-Aloud Method &#8211;<\/i><\/strong><br \/>\nSimply, I\u00a0ask the participant to \u201cthink aloud\u201d as they complete each task. This inner dialog gives us insight into what is frustrating, interesting, confusing, and so on, so that I\u00a0can understand where to <strong>explore more deeply<\/strong>. This information also gives me\u00a0important clues as to how a usability issue might be best resolved.<\/p>\n<p>But\u2026 I&#8217;m\u00a0careful to not rely too much on what the participant <strong>says<\/strong>. What comes out of their mouth sometimes is <strong>not a true reflection<\/strong> of their experience.<\/p>\n<p>This is why usability study facilitators are more interested in <strong>user<\/strong> <b>behaviors<\/b> rather than <strong>opinions<\/strong> (better suited for a focus group study) or <strong>preferences<\/strong> (better suited for A\/B testing or an online quantitative study).<\/p><\/blockquote>\n<p>Once the test plan is approved, I\u00a0move into recruiting and script development.<\/p>\n<p>To learn more about the number and types of issues that I\u00a0see in a typical usability study, please read my\u00a0post <a title=\"What Creates the Most Usability Issues | JuneUX.com\" href=\"http:\/\/juneux.com\/blog\/2012\/02\/content-creates-most-usability-issues\/\">Confusing, Incomplete Content Creates the Most Usability Issues<\/a>.<\/p>\n<h2 id=\"recruiting\"><b>2.\u00a0<\/b><b>Recruiting &amp; Scheduling: Finding the Right People<\/b><\/h2>\n<p>The recruiting process makes or breaks the quality of any usability study. I\u00a0use a <strong>rigorous approach<\/strong> to ensure I\u00a0find participants who truly represent your customers or users.<\/p>\n<p>The output from this phase includes 2 documents: the <b>screener<\/b> and the <b>participant schedule. <\/b>Working from the test plan, I\u00a0develop a \u201cscreener\u201d (a phone script or online survey) to help me\u00a0find the right participants \u2014 and weed out those who are not a good match.<\/p>\n<p>The aptly named \u201cparticipant schedule\u201d includes a list of the participants, the date and time of each session, and background information about each person (e.g., age, household income, profession).<\/p>\n<p>Once the screener is approved, I\u00a0move\u00a0onto recruiting.<\/p>\n<p>I\u00a0find <strong>high-quality participants<\/strong> using one or more of the following methods:<\/p>\n<ul>\n<li>Your email database<\/li>\n<li>Your website via an intercept tool<\/li>\n<li>Your social media accounts<\/li>\n<li>An outside research panel<\/li>\n<\/ul>\n<p>Depending on your target audience, I\u00a0may look at <strong>alternative recruiting methods<\/strong> such as posting flyers at college campuses to recruit students, or recruiting your newest employees to test your company\u2019s intranet or job board.<\/p>\n<p>The amount of <strong>gratuity<\/strong> (the amount paid to the participant for their time) depends on the length of the session and the target audience. For example, the gratuity for a surgeon would be dramatically higher than for a college student. Cash always works, but I\u2019ve found gratuity in the form of gift cards or high-value coupons also work well.<\/p>\n<h2 id=\"script\"><b>3.\u00a0<\/b><b>Script Development: Setting up Good Data Collection<\/b><\/h2>\n<p>In parallel to the recruiting and scheduling phase, I\u00a0begin work on the script \u2014 also called a \u201cdiscussion guide\u201d or \u201cfacilitator\u2019s guide.\u201d<\/p>\n<p>A <strong>comprehensive discussion guide<\/strong> ensures that each session is conducted in a <strong>consistent manner<\/strong>. That is, every participant completes the same tasks and answers the same baseline questions. I might rotate the tasks between sessions, or give different tasks to different types of users, but I\u00a0always ensure there is a solid script to follow.<\/p>\n<p>In a 60-minute usability session, there are typically 2 to 7 tasks that the participant will complete. Alternatively, I\u00a0might create the tasks with the participant in the beginning of the session rather than have pre-defined tasks.<\/p>\n<p>Each section of the discussion guide will include a timeframe to ensure the discussion stays on track.<\/p>\n<p>In most cases, my\u00a0discussion guides include 5 sections:<\/p>\n<ol>\n<li>Provide <b>overview<\/b> of session so participant knows what to expect.<\/li>\n<li>Ask <b>ice-breaker questions<\/b> to put participant at ease.<\/li>\n<li>Explain the <b>methodology <\/b>(i.e.,\u00a0ask participant to think aloud).<\/li>\n<li><b>Conduct the study<\/b> (i.e.,\u00a0ask participant to complete tasks).<\/li>\n<li>Ask <b>follow-up<\/b> questions.<\/li>\n<\/ol>\n<p>Once the discussion guide is finalized and participants are scheduled, we are\u00a0ready for show time.<\/p>\n<h2 id=\"facilitation\"><b>4.\u00a0<\/b><b>Facilitation: Uncovering Successes &amp; Usability Issues<\/b><\/h2>\n<p>On testing day, the participant will be brought into the usability lab at a research facility or conference room at your location; or they will simply dial-in to a toll-free number (if it\u2019s a remote study). As an observer, you will be able to watch the session from a computer. If the session is in-person, you will see both the participant&#8217;s face and the screen (but just their screen in a remote study).<\/p>\n<p>The script is used to facilitate and guide the session, but the conversation can go in any number of directions based on what the participant encounters.<\/p>\n<p>Some participants will only make it through one of the pre-determined tasks in the time allotted. Others will rush through all of the tasks at breakneck speed (I\u00a0try to have additional tasks for these cases). And everything in-between.<\/p>\n<p>Once a task is given to the participant, I\u00a0try to interrupt them as little as possible. If the participant forgets to think aloud, I\u00a0will nudge them with &#8220;What are you thinking about here?&#8221; But otherwise, I\u00a0will mostly\u00a0<strong>remain mute until the task is complete<\/strong>. I\u00a0find this gives us better, <strong>truer insights<\/strong> into the user flow and experience.<\/p>\n<p>Toward the end of each session, you and the other observers will have a chance to submit additional questions that I\u00a0will pose to the participant.<\/p>\n<p>In between every 2 to 3 test sessions, I\u00a0will lead <b>recap sessions<\/b> with all of the observers. During this regroup, I\u00a0will capture everything each observer saw and heard into a single spreadsheet. Recap sessions are critical to the success of a usability study. As a subject matter expert in your area, you will pick up cues from a participant that <b>no one else will detect.<\/b><\/p>\n<p>By the fifth session, the <strong>biggest usability issues<\/strong> will be absolutely clear. I\u00a0recommend conducting a minimum of 8-10 sessions to uncover the majority of issues, but only 5 sessions are needed to find the biggest obstacles. Pretty cool, huh?<\/p>\n<h2 id=\"analysis\"><b>5.\u00a0<\/b><b>Analysis &amp; Findings: Presenting the Themes<\/b><\/h2>\n<p>In the days following the usability study, I\u00a0will conduct <strong>analysis<\/strong> of the findings, identify the usability <strong>themes<\/strong>, and then develop my\u00a0recommended <strong>next steps<\/strong> and put them into a high-level presentation.<\/p>\n<p>A typical report includes 6 sections:<\/p>\n<ol>\n<li><b>Overview<\/b> of study (e.g., project background, test objectives)<\/li>\n<li>Usability study <b>methodology<\/b> used<\/li>\n<li>Profiles of <b>participants<\/b> and recruiting methodology used<\/li>\n<li><b>Executive summary<\/b> of high-level wins and opportunities<\/li>\n<li><b>Detailed findings<\/b> and recommendations<\/li>\n<li><b>Appendix<\/b> of all documentation (e.g., test plan, session recordings)<\/li>\n<\/ol>\n<p>I\u00a0like to deliver the presentation in person as well as allow enough time for a meaningful discussion at the end.<\/p>\n<p>I\u00a0know presentation decks are often shared with teams who were not involved in the usability study, so I\u00a0ensure the report provides the background and context needed to be <strong>immediately actionable<\/strong>.<\/p>\n<p>If you need additional help solving critical usability issues, June UX also provides digital strategy, user research, user experience design, and content strategy services. Need more information? I&#8217;d love to chat with you.<\/p>\n<h3><strong>Related Articles<\/strong><\/h3>\n<p><a href=\"http:\/\/juneux.com\/blog\/2016\/03\/how-i-work-remote-mobile-usability-testing\/\">How I Remote Mobility Usability Test<\/a><br \/>\n<a href=\"http:\/\/juneux.com\/blog\/2016\/03\/how-i-work-user-research-planning\/\">How I Plan User Research<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Over the past 15 years, I have conducted more than 400 usability tests on types of sites and apps. Here is my process. My\u00a0process for planning and conducting a usability study from start to finish includes 5 steps: Discovery Recruiting &amp; Scheduling Script Development Facilitation Analysis &amp; Findings Below is a brief overview of each &hellip; <a href=\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;The 5-Step Process I Use to Plan &#038; Conduct Usability Studies&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[19],"tags":[],"class_list":["post-1152","post","type-post","status-publish","format-standard","hentry","category-usability"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The 5-Step Process I Use to Plan &amp; Conduct Usability Studies - June UX<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The 5-Step Process I Use to Plan &amp; Conduct Usability Studies - June UX\" \/>\n<meta property=\"og:description\" content=\"Over the past 15 years, I have conducted more than 400 usability tests on types of sites and apps. Here is my process. My\u00a0process for planning and conducting a usability study from start to finish includes 5 steps: Discovery Recruiting &amp; Scheduling Script Development Facilitation Analysis &amp; Findings Below is a brief overview of each &hellip; Continue reading &quot;The 5-Step Process I Use to Plan &#038; Conduct Usability Studies&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/\" \/>\n<meta property=\"og:site_name\" content=\"June UX\" \/>\n<meta property=\"article:published_time\" content=\"2014-03-10T04:06:02+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-07-23T16:26:17+00:00\" \/>\n<meta name=\"author\" content=\"Kristine Remer\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@kristineremer\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kristine Remer\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/\",\"url\":\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/\",\"name\":\"The 5-Step Process I Use to Plan & Conduct Usability Studies - June UX\",\"isPartOf\":{\"@id\":\"https:\/\/juneux.com\/blog\/#website\"},\"datePublished\":\"2014-03-10T04:06:02+00:00\",\"dateModified\":\"2018-07-23T16:26:17+00:00\",\"author\":{\"@id\":\"https:\/\/juneux.com\/blog\/#\/schema\/person\/9239f257eb7b6082954622f7bb7a13bb\"},\"breadcrumb\":{\"@id\":\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/juneux.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The 5-Step Process I Use to Plan &#038; Conduct Usability Studies\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/juneux.com\/blog\/#website\",\"url\":\"https:\/\/juneux.com\/blog\/\",\"name\":\"June UX\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/juneux.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/juneux.com\/blog\/#\/schema\/person\/9239f257eb7b6082954622f7bb7a13bb\",\"name\":\"Kristine Remer\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/juneux.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/04287e5398aef336c1ac28a3811a49c9a8ab86020c33349ef1f186ade6efc3c7?s=96&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/04287e5398aef336c1ac28a3811a49c9a8ab86020c33349ef1f186ade6efc3c7?s=96&r=g\",\"caption\":\"Kristine Remer\"},\"description\":\"Kristine Remer is a CX insights leader, UX researcher, and strategist in Minneapolis. She helps organizations drive significant business outcomes by finding and solving customer problems. She never misses the Minnesota State Fair and loves dark chocolate mochas, kayaking, escape rooms, and planning elaborate treasure hunts for her children.\",\"sameAs\":[\"linkedin.com\/in\/kristineremer\",\"https:\/\/twitter.com\/kristineremer\"],\"url\":\"https:\/\/juneux.com\/blog\/author\/klremer\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The 5-Step Process I Use to Plan & Conduct Usability Studies - June UX","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/","og_locale":"en_US","og_type":"article","og_title":"The 5-Step Process I Use to Plan & Conduct Usability Studies - June UX","og_description":"Over the past 15 years, I have conducted more than 400 usability tests on types of sites and apps. Here is my process. My\u00a0process for planning and conducting a usability study from start to finish includes 5 steps: Discovery Recruiting &amp; Scheduling Script Development Facilitation Analysis &amp; Findings Below is a brief overview of each &hellip; Continue reading \"The 5-Step Process I Use to Plan &#038; Conduct Usability Studies\"","og_url":"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/","og_site_name":"June UX","article_published_time":"2014-03-10T04:06:02+00:00","article_modified_time":"2018-07-23T16:26:17+00:00","author":"Kristine Remer","twitter_card":"summary_large_image","twitter_creator":"@kristineremer","twitter_misc":{"Written by":"Kristine Remer","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/","url":"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/","name":"The 5-Step Process I Use to Plan & Conduct Usability Studies - June UX","isPartOf":{"@id":"https:\/\/juneux.com\/blog\/#website"},"datePublished":"2014-03-10T04:06:02+00:00","dateModified":"2018-07-23T16:26:17+00:00","author":{"@id":"https:\/\/juneux.com\/blog\/#\/schema\/person\/9239f257eb7b6082954622f7bb7a13bb"},"breadcrumb":{"@id":"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/juneux.com\/blog\/2014\/03\/the-5-step-process-we-use-to-plan-conduct-usability-studies\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/juneux.com\/blog\/"},{"@type":"ListItem","position":2,"name":"The 5-Step Process I Use to Plan &#038; Conduct Usability Studies"}]},{"@type":"WebSite","@id":"https:\/\/juneux.com\/blog\/#website","url":"https:\/\/juneux.com\/blog\/","name":"June UX","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/juneux.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/juneux.com\/blog\/#\/schema\/person\/9239f257eb7b6082954622f7bb7a13bb","name":"Kristine Remer","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/juneux.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/04287e5398aef336c1ac28a3811a49c9a8ab86020c33349ef1f186ade6efc3c7?s=96&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/04287e5398aef336c1ac28a3811a49c9a8ab86020c33349ef1f186ade6efc3c7?s=96&r=g","caption":"Kristine Remer"},"description":"Kristine Remer is a CX insights leader, UX researcher, and strategist in Minneapolis. She helps organizations drive significant business outcomes by finding and solving customer problems. She never misses the Minnesota State Fair and loves dark chocolate mochas, kayaking, escape rooms, and planning elaborate treasure hunts for her children.","sameAs":["linkedin.com\/in\/kristineremer","https:\/\/twitter.com\/kristineremer"],"url":"https:\/\/juneux.com\/blog\/author\/klremer\/"}]}},"_links":{"self":[{"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/posts\/1152","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/comments?post=1152"}],"version-history":[{"count":57,"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/posts\/1152\/revisions"}],"predecessor-version":[{"id":5139,"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/posts\/1152\/revisions\/5139"}],"wp:attachment":[{"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/media?parent=1152"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/categories?post=1152"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/juneux.com\/blog\/wp-json\/wp\/v2\/tags?post=1152"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}