<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>
<channel>
	<title>Complete Usability &#187; Usability and User Experience | Complete Usability</title>
	<atom:link href="http://completeusability.com/category/user-testing/feed/" rel="self" type="application/rss+xml" />
	<link>http://completeusability.com</link>
	<description>The big picture of usability and user experience</description>
	<lastBuildDate>Tue, 06 Dec 2011 20:02:55 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
		<item>
		<title>Simple user interfaces: the snow plow principle, part 2</title>
		<link>http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/</link>
		<comments>http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/#comments</comments>
		<pubDate>Thu, 03 Feb 2011 17:39:23 +0000</pubDate>
		<dc:creator>Mike B. Fisher</dc:creator>
				<category><![CDATA[Common usability issues]]></category>
		<category><![CDATA[Usability and User experience]]></category>
		<category><![CDATA[User testing]]></category>
		<category><![CDATA[information displays]]></category>
		<category><![CDATA[interface design]]></category>
		<category><![CDATA[simplicity]]></category>
		<category><![CDATA[usability]]></category>
		<category><![CDATA[visual standards]]></category>
		<guid isPermaLink="false">http://completeusability.com/?p=2051</guid>
		<description><![CDATA[Quick Summary: In part 1 of this article we covered what I call the user interface &#8220;snow plow principle&#8221; &#8211; the notion that displaying too much information and offering too many options is akin to driving a snow plow to the corner store to get your groceries. Here in part 2 we look at some [...]
Related posts:<ol><li><a href='http://completeusability.com/simple-user-interfaces-the-snowplow-principle/' rel='bookmark' title='Simple user interfaces: the snow plow principle'>Simple user interfaces: the snow plow principle</a></li>
<li><a href='http://completeusability.com/streamlining-user-interfaces-part-1/' rel='bookmark' title='Streamlining user interfaces, part 1'>Streamlining user interfaces, part 1</a></li>
<li><a href='http://completeusability.com/reduce-costs-improve-usability-visual-standards-part-1/' rel='bookmark' title='Reduce costs and improve usability with visual standards, part 1'>Reduce costs and improve usability with visual standards, part 1</a></li>
</ol>]]></description>
			<content:encoded><![CDATA[<p><a class="post_image_link" href="http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/" title="Permanent link to Simple user interfaces: the snow plow principle, part 2"><img class="post_image alignright" src="http://completeusability.com/wp-content/uploads/2010/12/usability-snowplow-principle.jpg" width="150" height="120" alt="Post image for Simple user interfaces: the snow plow principle, part 2" /></a>
</p><blockquote><p><strong><span style="color: #800000;">Quick Summary</span></strong>: In <a title="Complete Usability: Simple user interfaces: the snowplow principle" href="/simple-user-interfaces-the-snowplow-principle/" target="_self">part 1 of this article</a> we covered what I call the user interface &#8220;snow plow principle&#8221; &#8211; the notion that displaying too much information and offering too many options is akin to driving a snow plow to the corner store to get your groceries. Here in part 2 we look at some solutions to the problem.</p></blockquote>
<p><img title="More..." src="http://completeusability.com/wp-includes/js/tinymce/plugins/wordpress/img/trans.gif" alt="" /><br />
<span class="drop_cap">P</span>acking too much into an interface results in user confusion, information overload, and a poor user experience. Sounds like an outcome worth avoiding, doesn&#8217;t it?</p>
<p><span id="more-2051"></span></p>
<p>Solving this problem doesn&#8217;t require rocket science (or snow plow science for that matter), but it does require thinking in ways that you or your team may not be used to. Here are some strategies and tactics to consider.</p>
<p style="padding-left: 30px;"><strong>1. Make simplicity a stated project goal</strong>. For some organizations this goes without saying, but many simply pay lip service to user-centered design. User-centered design requires a commitment to research and planning, and it requires that you make the effort to learn what your users want. This knowledge enables you to deliver upon their needs and expectations. A good starting point is to ensure that documents describing your project include simplicity and ease of use as critical design requirements.</p>
<p style="padding-left: 30px;"><strong>2. Learn about your users’ goals and needs</strong>. Many organizations and teams base design decisions on assumptions about user needs. This is only marginally better than ignoring users altogether. Even the most knowledgeable members of your team aren&#8217;t the customers who actually use the product. In other words, guessing about user needs and goals is a shortcut to building the wrong interface. It’s dangerous to assume you know what your users want; instead, <em>ask them</em> (I’ll cover how to ask in other articles).</p>
<p style="padding-left: 30px;">You should research and document:</p>
<ul>
<li><strong>Who</strong> your users are (their demographics, skill sets, work environments)</li>
<li><strong>What they need</strong> from your application or website, and</li>
<li><strong>How your product fits</strong> in to their workflow.</li>
</ul>
<p style="padding-left: 30px;">This baseline knowledge enables you to design for simplicity by focusing on:</p>
<ul>
<li>What&#8217;s <em>most needed</em></li>
<li>by the <em>greatest number of users</em></li>
<li>in the <em>greatest number of high probability use cases</em>.</li>
</ul>
<p style="padding-left: 30px;">Armed with this knowledge, you can move or remove elements and functions that are less important, for example those of little relevance to most users, or those that aren’t needed most of the time.</p>
<p style="padding-left: 30px;"><strong>3. Establish a purpose and goal(s) for each key screen</strong>. You should associate a set of user goals and business objectives to every screen of your application or website. For example:</p>
<ul>
<li>What should users accomplish or get out of a given screen/page?</li>
<li>What is the desired user outcome for the screen?</li>
<li>How does this benefit the user?</li>
<li>How does it benefit your company?</li>
</ul>
<p style="padding-left: 30px;">Understanding the answers to these questions enables you to measure each element of a screen/page against its purpose and its contribution to overall user and company goals.</p>
<p style="padding-left: 30px;"><strong>4. Prioritize interface elements accordingly</strong>. Once you have a sense for what&#8217;s important to your users and what isn&#8217;t, you can adjust the interface to emphasize key functions and information, making these items easy to notice and understand. Remember, these must be the attributes, elements, and functions that are most important <em>to your users in fulfilling their goals</em>, <span style="text-decoration: underline;">not</span> those most important to the development, design, or marketing team.</p>
<p style="padding-left: 30px;"><strong>5. Supress or move low-probability information and options</strong>. This is the &#8220;less&#8221; aspect of &#8220;less is more&#8221;. When an interface element isn&#8217;t needed often, it should be suppressed or eliminated. This doesn&#8217;t necessarily mean hiding less-used options many levels deep. It can mean in essence &#8220;hiding them in plain sight&#8221; by making them less prominent within a layout. One example of this is replacing a block of disclaimer or explanatory text with a brief overview and a link to &#8220;learn more&#8221;. Another small example is displaying the most popular/likely items in a list first, for example placing “United States” first in a list of countries on a shipping form if the great majority of your customers are in the United States (also see <a title="Complete Usability: Country drop-downs" href="/country-drop-downs/" target="_self">this related article</a>).</p>
<p style="padding-left: 30px;"><strong>6. Edit what’s left; err on the side of brevity</strong>. Once you’ve reduced an interface to its most essential elements, it’s time to ensure that your language is clear and concise, and that your layout enables users to find and understand the key information and options. Whenever possible, disclaimers, instructions, and other text should be brief while still remaining clear and compelling. Writing for the web and for software is an art in itself, and is beyond the scope of this article. I’ll cover more on that at a later time.</p>
<p style="padding-left: 30px;"><strong>7. Test your user experience</strong>. The quality of a user experience can be measured. If you’re not measuring yours then you’re “flying blind” and merely guessing at the effectiveness of your product. Test your website or application periodically, even if it’s meeting your business objectives. There are many ways to do this, for example formal or informal user testing, or online surveys. Regardless of the methods, the goal is to ensure that the application or website stays aligned with user needs. When the two diverge, it’s time to make improvements. On a related note, remember that <span style="text-decoration: underline;">user needs are not static</span>; they change over time. If you haven’t spoken to your users about their needs lately you might be overlooking an important opportunity for improvement.</p>
<p>Paradoxically, there&#8217;s much more to say about simplicity; this article only scratches the surface. I plan to cover more on this important topic in the coming weeks and months. In the meantime I hope it provides some food for thought and a starting point for discussion and positive change.</p>
<p>Photo by <a title="Photo by Joost J. Bakker. Creative Commons Licensed." href="http://www.flickr.com/photos/joost-ijmuiden/4237324762/" target="_blank">Joost J. Bakker</a>. Creative Commons licensed.</p>
<p>Related posts:<ol><li><a href='http://completeusability.com/simple-user-interfaces-the-snowplow-principle/' rel='bookmark' title='Simple user interfaces: the snow plow principle'>Simple user interfaces: the snow plow principle</a></li>
<li><a href='http://completeusability.com/streamlining-user-interfaces-part-1/' rel='bookmark' title='Streamlining user interfaces, part 1'>Streamlining user interfaces, part 1</a></li>
<li><a href='http://completeusability.com/reduce-costs-improve-usability-visual-standards-part-1/' rel='bookmark' title='Reduce costs and improve usability with visual standards, part 1'>Reduce costs and improve usability with visual standards, part 1</a></li>
</ol></p>]]></content:encoded>
			<wfw:commentRss>http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>7 reasons to avoid remote user testing</title>
		<link>http://completeusability.com/7-reasons-to-avoid-remote-user-testing/</link>
		<comments>http://completeusability.com/7-reasons-to-avoid-remote-user-testing/#comments</comments>
		<pubDate>Mon, 22 Nov 2010 22:55:06 +0000</pubDate>
		<dc:creator>Mike B. Fisher</dc:creator>
				<category><![CDATA[Usability and User experience]]></category>
		<category><![CDATA[User testing]]></category>
		<category><![CDATA[Interaction design]]></category>
		<category><![CDATA[remote user testing]]></category>
		<category><![CDATA[usability]]></category>
		<guid isPermaLink="false">http://completeusability.com/?p=1975</guid>
		<description><![CDATA[Quick Summary:  In part 1 of this two-part article I explained the top reasons that remote user testing can be a great way to gather user feedback. But remote testing has also has an ugly side. Here in part two we explore some of the significant drawbacks. Remote user testing is great&#8230; isn&#8217;t it? Yes [...]
Related posts:<ol><li><a href='http://completeusability.com/5-reasons-to-love-remote-user-testing/' rel='bookmark' title='5 reasons to love remote user testing'>5 reasons to love remote user testing</a></li>
<li><a href='http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/' rel='bookmark' title='Simple user interfaces: the snow plow principle, part 2'>Simple user interfaces: the snow plow principle, part 2</a></li>
</ol>]]></description>
			<content:encoded><![CDATA[<p><a class="post_image_link" href="http://completeusability.com/7-reasons-to-avoid-remote-user-testing/" title="Permanent link to 7 reasons to avoid remote user testing"><img class="post_image alignright" src="http://completeusability.com/wp-content/uploads/2010/10/telephone.jpg" width="150" height="150" alt="Post image for 7 reasons to avoid remote user testing" /></a>
</p><div>
<div>
<blockquote><p><strong><span style="color: #800000;">Quick Summary</span></strong>:  In <a title="Complete Usability: 5 reasons to love remote user testing" href="/5-reasons-to-love-remote-user-testing/" target="_self">part 1 of this two-part article</a> I explained the top reasons that remote user testing can be a great way to gather user feedback. But remote testing has also has an ugly side. Here in part two we explore some of the significant drawbacks.</p></blockquote>
<p><span id="more-1975"></span></p>
<h2>Remote user testing is great&#8230; isn&#8217;t it?</h2>
<p>Yes and no. I previously covered some of the key benefits. To summarize, remote user testing enables you to:</p>
<ul>
<li>Test representative users from diverse geographic locations</li>
<li>Test less expensively than traditional in-person user research</li>
<li>Test more rapidly, with less lead time</li>
</ul>
<p>But there are also some serious drawbacks, and it&#8217;s important to understand them.</p>
<h2>Maybe remote testing isn&#8217;t so great</h2>
<p>Let’s examine some of the problems that can arise, and you’ll see why remote user testing isn&#8217;t necessarily a good choice, and certainly isn’t a replacement for all types of in-person user testing.</p>
<p style="padding-left: 30px;"><strong>1. </strong><strong>Greater burden on respondents</strong>.  Despite some important advances in technology, many remote user testing solutions require users perform some type of setup in order to participate. This is a potential failure point. Some technologies like Cisco’s WebEx require users to install before they can join a session. This isn&#8217;t necessarily a problem, but it necessitates that you verify everything&#8217;s working on the user&#8217;s end before a session can begin. If there&#8217;s a problem, it can be difficult to troubleshoot over the phone &#8211; and it costs valuable session time. By comparison, with in-person testing users typically just show up to a research facility and sit down at a properly configured computer.</p>
<p style="padding-left: 30px;"><strong>2. </strong><strong>Some respondents are unwilling to install software</strong>.  It’s possible to pre-screen respondents to ensure they’re willing to allow software to be installed on their computers, but many people are understandably distrustful of any request to install software on their computer. In today’s age of virus-laden websites and email attachments this isn’t surprising. So in planning remote user testing, depending on the technology used, it becomes necessary to recruit people who are willing install the required software. And if you&#8217;re interested in testing a group that includes less-savvy Internet users this can be problematic.</p>
<p style="padding-left: 30px;"><strong>3. Not everyone has a suitable connection.</strong> Depending on what you&#8217;re testing, the need for good bandwidth can be an issue. This isn&#8217;t a problem if you’re testing respondents with an ideal demographic and geographic profile (for example, tech-savvy professionals living in the Bay Area). But depending on your demographic profile it may be difficult to find respondents who have access to a reliable, fast connection.</p>
<p style="padding-left: 30px;"><strong>4. Greater dependency on consistent bandwidth</strong>.  Naturally, technical glitches can occur during an in-person session as well as over a remote testing session. But with an in-person session, if your Internet connection fails or your application crashes you have the option of switching to a set of printed screens (you remembered to bring those, right?). By comparison if you lose the connection during a remote user testing session, you’re at a dead stop until the connection can be re-established. This may require additional troubleshooting and remote support for the respondent, and can eat up valuable session time.</p>
<p style="padding-left: 30px;"><strong>5. More “no show” respondents</strong>.  In my experience, it&#8217;s not at all unusual for a remote user testing respondent to fail to answer their phone at the appointed time, resulting in a &#8220;no show&#8221;. I speculate this is in part because remote respondents have a more tenuous connection to the idea of attending session. In other words, the bar is lower for them &#8211; they haven&#8217;t been forced to schedule time to leave work and/or drive to a research facility. So perhaps the commitment seems less &#8220;real&#8221;. Regardless of the reasons, a higher rate of &#8220;no shows&#8221; makes it more important to have back-up respondents if you wish to stick to a testing schedule. And that means more recruitment, more incentives, and more administrative overhead for the sessions.</p>
<p style="padding-left: 30px;"><strong>6. Loss of subtle (but often useful) cues</strong>.  This is perhaps my greatest gripe with remote testing. With in-person testing there&#8217;s a wealth of information to be had from observing body language, facial expressions and other subtle cues that simply aren&#8217;t available in a remote user testing session. Watching a respondent physically interact with an application or website can often reveal important insights into the user experience. But in a remote user testing session the respondent&#8217;s presence is reduced to a voice and a mouse pointer. You don&#8217;t know:</p>
<ul>
<li>Where the respondent is looking on their screen (unless you ask)</li>
<li>What their body language, expressions, and gestures are indicating</li>
<li>What they&#8217;ve said that&#8217;s too quiet for the telephone to pick up (subtle verbal cues like mumbling and muttering can be telling!)</li>
</ul>
<p style="padding-left: 30px;"><strong>7. </strong><strong>Difficulty creating a personal connection</strong>. Some people are natural user testing respondents &#8211; they&#8217;re confident, speak freely, and can clearly articulate their opinions. Then there&#8217;s everyone else. Many people are more withdrawn, less confident in their opinions, or have a difficult time expressing themselves. But these people can be great user testing respondents; they just need a little more guidance or encouragement. When your only connection to a person is a distance voice on the phone, it&#8217;s very difficult to establish the personal connection that enables a moderator to coach a reticent or reluctant respondent.</p>
<h2>So, remote user testing should be avoided, right?</h2>
<div>Actually, no. Despite the drawbacks, remote user testing surely has its place.  If you have the right combination of factors (demographic profile, type of feedback needed) remote user testing is still a great and less expensive way to get feedback from a diverse group of users. But I don&#8217;t see it ever replacing in-person research &#8211; there&#8217;s simply too much that can be lost in translation.</div>
<p><div>Photo by <a title="Photo by malias. Creative Commons licensed." href="http://www.flickr.com/photos/malias/50216300/" target="_blank">malias</a>. Creative Commons licensed.</div>
</div>
</div>
<p>Related posts:<ol><li><a href='http://completeusability.com/5-reasons-to-love-remote-user-testing/' rel='bookmark' title='5 reasons to love remote user testing'>5 reasons to love remote user testing</a></li>
<li><a href='http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/' rel='bookmark' title='Simple user interfaces: the snow plow principle, part 2'>Simple user interfaces: the snow plow principle, part 2</a></li>
</ol></p>]]></content:encoded>
			<wfw:commentRss>http://completeusability.com/7-reasons-to-avoid-remote-user-testing/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>5 reasons to love remote user testing</title>
		<link>http://completeusability.com/5-reasons-to-love-remote-user-testing/</link>
		<comments>http://completeusability.com/5-reasons-to-love-remote-user-testing/#comments</comments>
		<pubDate>Mon, 27 Sep 2010 02:23:51 +0000</pubDate>
		<dc:creator>Mike B. Fisher</dc:creator>
				<category><![CDATA[Usability and User experience]]></category>
		<category><![CDATA[User testing]]></category>
		<category><![CDATA[Interaction design]]></category>
		<category><![CDATA[remote user testing]]></category>
		<category><![CDATA[usability]]></category>
		<guid isPermaLink="false">http://completeusability.com/?p=1957</guid>
		<description><![CDATA[Quick Summary: There are many reasons to love remote user testing; in part 1 of this 2-part article I explain what I consider to be the 5 most important benefits. In part 2 I&#8217;ll explain why sometimes it&#8217;s wise to avoid remote testing entirely. I recently completed a fairly exhaustive user testing project for a [...]
Related posts:<ol><li><a href='http://completeusability.com/7-reasons-to-avoid-remote-user-testing/' rel='bookmark' title='7 reasons to avoid remote user testing'>7 reasons to avoid remote user testing</a></li>
<li><a href='http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/' rel='bookmark' title='Simple user interfaces: the snow plow principle, part 2'>Simple user interfaces: the snow plow principle, part 2</a></li>
</ol>]]></description>
			<content:encoded><![CDATA[<p><a class="post_image_link" href="http://completeusability.com/5-reasons-to-love-remote-user-testing/" title="Permanent link to 5 reasons to love remote user testing"><img class="post_image alignright" src="http://completeusability.com/wp-content/uploads/2010/10/telephone.jpg" width="150" height="150" alt="Post image for 5 reasons to love remote user testing" /></a>
</p><div>
<blockquote><p><strong><span style="color: #800000;">Quick Summary</span></strong>: There are many reasons to love remote user testing; in part 1 of this 2-part article I explain what I consider to be the 5 most important benefits. In part 2 I&#8217;ll explain why sometimes it&#8217;s wise to avoid remote testing entirely.</p></blockquote>
<p><span class="drop_cap">I</span> recently completed a fairly exhaustive user testing project for a large financial firm. For a variety of reasons the client elected to have all the sessions conducted remotely. The project got me to thinking about the circumstances in which remote user testing works well, and those where it doesn’t.</p>
<p><span id="more-1957"></span></p>
<p>In this two-part article I’ll tackle the pros and cons of remote user testing, starting first with the top benefits of remote user testing. Then I’ll turn the tables and explore some of the important pitfalls, and the reasons remote testing may or may not be a good choice for you.</p>
<h2>What&#8217;s Remote User Testing?</h2>
<p>Remote user testing is the process of conducting research with the respondent located somewhere other than the test moderator and/or anyone else participating (like the client). A typical example is a user test session where the moderator is in one city and the respondent is somewhere else, perhaps in a different time zone or all the way on the other side of the world. In its most basic form, a remote testing session might simply be a telephone call between the moderator and the respondent (basically an interview), but more often it involves the respondent interacting with an application or website while the moderator watches and speaks with the respondent.</p>
<p>Remote testing has enjoyed increasing popularity in recent years, in part because the tools to share screens and applications have matured, and also because the user experience field itself has grown.</p>
<h2>Why Remote Testing?</h2>
<p>There are a number of reasons to consider testing users without ever seeing them face-to-face. These include:</p>
<p style="padding-left: 30px;"><strong>1. Access to a broader geographic mix of people</strong>. If your plans call for testing users in very different locations, remote testing is a huge benefit. Suppose for example you had a product that would be used by customers in the US and UK, and you had reason to believe that users in the two countries would have different needs or use the product in different ways. Or suppose your users in New York have demonstrably different needs from those in Los Angeles. Remote testing makes it possible to gather feedback from geographically diverse sets of users without the need to travel to all of them. Under some circumstances this can be a huge benefit and a substantial savings in time and cost.</p>
<p style="padding-left: 30px;"><strong>2. Elimination of other geographic boundaries</strong>. With remote testing, the user experience professional(s) can be in one location, the client in one or more additional locations, and the respondent somewhere else entirely. Everyone can listen in and/or participate in the sessions..</p>
<p style="padding-left: 30px;"><strong>3. Rapid set-up</strong>. In most cases, remote testing sessions can be created easily on-the-fly or with little advance notice using nothing more than web-based tools. WebEx for example can quickly begin a new session and generate a conference number (toll free if desired). This makes it possible to schedule test sessions around respondents’ schedules, something that can be very helpful especially if the particular user group is short on time or difficult to schedule. Ever try to schedule a group of doctors or business executives for user test sessions? Remote testing offers a solution to an otherwise thorny problem.</p>
<p style="padding-left: 30px;"><strong>4. Reduced cost</strong>. As I alluded to above, remote testing <em>can</em> be less expensive than traditional in-person testing, though this depends on a few factors. If you’re testing remotely there may be no need for a traditional testing facility with its ubiquitous one-way mirrors and jars of peanut M&amp;Ms at the ready. It may also be possible to pay respondents a lower incentive since they’re not required to take the time to drive to a research facility. WebEx and GoToMyPC [others?] offer suitable service plans beginning at $50 per month for unlimited use. By comparison, $50 wouldn’t even cover the cost of the bagels the test facility serves when a client is observing test sessions in person.</p>
<p style="padding-left: 30px;"><strong>5. No special tools required</strong>. Remote testing can be accomplished with nothing more than a good Internet connection, a willing respondent, and a screencast/conference service like WebEx or GoToMyPC. Both of these services can record sessions for you, so there’s no need to even use a screen capture application like Camtasia or Silverback. This lower bar to entry means that even garage companies can afford to conduct user testing with representative customers from anywhere in the world. A side benefit to using screencast solutions like WebEx is that many companies are already familiar with such tools, and can therefore attend and/or participate without needing to learn to use software.</p>
<h2>So, shouldn&#8217;t all usability testing be done remotely?</h2>
<p>No, not even remotely (pardon the pun). With the geographic boundaries eliminated, costs lowered, and processes simplified, you might wonder why <span style="text-decoration: underline;">all</span> user testing isn’t conducted remotely. The answer lies in understanding the significant and sometimes deal-breaking tradeoffs. I’ll cover that in part two of this article, where I’ll switch sides and explain why remote user testing isn’t necessarily everything it’s cracked up to be.</p>
<hr size="1" />
<div>Photo by <a title="Photo by malias. Creative Commons licensed." href="http://www.flickr.com/photos/malias/50216300/" target="_blank">malias</a>. Creative Commons licensed.</div>
</div>
<p>Related posts:<ol><li><a href='http://completeusability.com/7-reasons-to-avoid-remote-user-testing/' rel='bookmark' title='7 reasons to avoid remote user testing'>7 reasons to avoid remote user testing</a></li>
<li><a href='http://completeusability.com/simple-user-interfaces-the-snow-plow-principle-part-2/' rel='bookmark' title='Simple user interfaces: the snow plow principle, part 2'>Simple user interfaces: the snow plow principle, part 2</a></li>
</ol></p>]]></content:encoded>
			<wfw:commentRss>http://completeusability.com/5-reasons-to-love-remote-user-testing/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Your users have baggage</title>
		<link>http://completeusability.com/expectations-and-biases/</link>
		<comments>http://completeusability.com/expectations-and-biases/#comments</comments>
		<pubDate>Mon, 30 Mar 2009 05:15:32 +0000</pubDate>
		<dc:creator>Mike B. Fisher</dc:creator>
				<category><![CDATA[Common usability issues]]></category>
		<category><![CDATA[Interaction design]]></category>
		<category><![CDATA[Usability and User experience]]></category>
		<category><![CDATA[User testing]]></category>
		<category><![CDATA[information architecture]]></category>
		<category><![CDATA[messaging]]></category>
		<category><![CDATA[setting expectations]]></category>
		<guid isPermaLink="false">http://frightfullybad.com/?p=719</guid>
		<description><![CDATA[Users come to every website or application with a variety of expectations, assumptions and biases from previous experiences. It's important to acknowledge this, and to determine what your users' biases are - then address the ones that affect usability.
Related posts:<ol><li><a href='http://completeusability.com/why-require-registration-part-1/' rel='bookmark' title='Why require registration? Part 1'>Why require registration? Part 1</a></li>
<li><a href='http://completeusability.com/improved-error-handling-part-1-helping-users-notice-errors/' rel='bookmark' title='Improved error handling, part 1: helping users notice errors'>Improved error handling, part 1: helping users notice errors</a></li>
<li><a href='http://completeusability.com/communicating-status/' rel='bookmark' title='Communicating status'>Communicating status</a></li>
</ol>]]></description>
			<content:encoded><![CDATA[<p><a class="post_image_link" href="http://completeusability.com/expectations-and-biases/" title="Permanent link to Your users have baggage"><img class="post_image alignright" src="http://completeusability.com/wp-content/uploads/2009/03/packed-and-ready-to-roll-by-striatic.jpg" width="150" height="150" alt="Post image for Your users have baggage" /></a>
</p><blockquote><p><span style="color: #800000;"><strong>Quick summary</strong></span>: Users come to every website or application with expectations, assumptions and biases that are forged from previous experiences. It&#8217;s important to understand your users&#8217; biases &#8211; and address the ones that affect usability.</p></blockquote>
<p>I hate to be the one to break it to you, but your users have baggage. Lots of it.</p>
<p>I’m not referring to carry-ons or checked luggage. And I don&#8217;t mean deep emotional problems (although they may have those too). I mean that everyone who visits your website or uses your application brings with them certain assumptions and expectations from previous experiences.</p>
<p>Why should you care? Unless you’re willing to understand and accommodate your users’ baggage you may be inadvertently creating a frightfully bad user experience for them. So it’s best to understand your users&#8217; baggage and then determine what you can do about it.</p>
<p><span id="more-719"></span></p>
<h2>User Expectations and biases</h2>
<p>Everyone who uses technology &#8211; websites, applications, kiosks, products &#8211; walks away from each experience with certain impressions and memories. Sometimes the experience reinforces what we already believed. Other times the experience results in new opinions or assumptions, or changes existing ones. Good, bad or indifferent these memories get filed away and later become part of the filters through which we view the world.</p>
<p>This is important to usability because when someone begins to interact with your product they’re perceiving it through their own unique set of filters. In other words, their previous experiences have a big impact on how they interact with your product &#8211; and what they expect from it.</p>
<p>This type of “baggage” takes many forms, for example:</p>
<ul>
<li><strong>Stories about others’ experiences</strong>. A user coming to your website might have recently read a story in the media about a big online privacy breech, and be wondering just how secure your website really is. Or he/she may have heard a story from a friend or family member about identity theft. This user is likely to be especially sensitive to privacy and security issues and messaging (or lack of it).</li>
</ul>
<ul>
<li><strong>Their own personal experiences</strong>. Perhaps your user recently ordered an item but found out a week later that it was out of stock for six months. This user may be wary of making a purchase if they don’t feel a strong sense that the order will be filled promptly.</li>
</ul>
<p>User baggage isn’t limited to bad experiences. It also takes the form of assumptions and expectations about things like:</p>
<ul>
<li>Information architecture (“I expect to find silverware in the housewares section”)</li>
<li>Data entry (“I expect to put parentheses around my area code”)</li>
<li>Terminology (“I call them oyster forks, don’t you?”)</li>
<li>Search syntax (“I expect to search by typing in sentences like ‘show me forks under $10’”)</li>
</ul>
<p>… and so on. These assumptions and expectations cause users to interact with your website or application in a certain way. The problems often begin when the website or application works in a way that&#8217;s contrary to users&#8217; expectations.</p>
<h2>What should we do about user expectations and biases?</h2>
<p>We need some ways to understand and then address this type of user baggage.</p>
<p>The best way I know to understand what baggage users carry with them is simply to ask. Well, maybe not directly (&#8220;Say, what baggage are <em>you</em> saddled with?&#8221;). But there are a number of ways to find out, and not surprisingly they’re all consistent with best practices for usability and user experience design. Three of my favorites are:</p>
<ul>
<li><strong>User testing</strong>. So far there’s no substitute for sitting down with representative users and observing how they interact with your product. It’s an opportunity to uncover important assumptions and expectations, and it can enable you to address the most serious disconnects between what your users expect and what you’re giving them. I’ll cover user testing in considerably more detail in future articles. Naturally user testing isn&#8217;t the only way to inform improvements to usability and user experience &#8211; but it&#8217;s the most powerful.</li>
</ul>
<ul>
<li><strong>Online surveys</strong>. Collecting information via quick online surveys is another great way to gain insight into your users’ thoughts. Tools like <a title="Survey Monkey" href="http://www.surveymonkey.com/" target="_blank">Survey Monkey</a> can be used to gather information on terminology preferences, for example by displaying a product image and asking users to choose which category it belongs to. The disadvantage to surveys is that you get “what” users think but not “why”. In other words you may be able to determine that most of your users expect to find speakers in a section labeled “studio monitors”, but you won’t necessarily know why they feel that &#8220;studio monitors&#8221; is a better choice than &#8220;speakers&#8221; or &#8220;sound reinforcement&#8221;.</li>
</ul>
<ul>
<li><strong>Remote observation tools</strong>. Tools like <a title="Clicktale" href="http://www.clicktale.com/" target="_blank">ClickTale</a> and <a title="Userfly" href="http://www.userfly.com/" target="_blank">Userfly</a> enable you to record users&#8217; interactions with your website. You can then play back the recordings later to see exactly what users clicked and typed, and when. These tools can be very helpful in uncovering user baggage. Their primary limitation is that &#8211; just like surveys &#8211; they don&#8217;t address the &#8220;why&#8221; of user behavior as effectively as user testing. Still, they can be a good starting point for learning where user behaviors and expectations differ from what a website or application delivers.</li>
</ul>
<p>Regardless of how we gather information from users, once we begin to see what baggage they bring with them we can address it. Again there are a number of ways this can be done, but the two most important are:</p>
<ul>
<li>Revising the site or application to more closely match user expectations; or,</li>
<li>Setting expectations more clearly.</li>
</ul>
<p>Revising the site or application generally involves things like:</p>
<ul>
<li><strong>Using terminology that users expect</strong>. If most of your users think that product #218 is an oyster fork, then call it that. Or use more than one name (&#8220;Oyster fork/3-pronged fork&#8221;).</li>
</ul>
<ul>
<li><strong>Matching information architecture to user expectations</strong>. Similarly if users expect to find their oyster forks in a section called &#8220;housewares&#8221; but you&#8217;ve got them in a section called &#8220;silver&#8221; or &#8220;other&#8221; then there&#8217;s a problem.</li>
</ul>
<ul>
<li><strong>Adding or revising functionality to match expectations</strong>. Using the example from above, if users tend to use parentheses when entering phone numbers the ideal solution is for the website or application to simply accommodate parentheses.</li>
</ul>
<p>Of course there are situations where it may be unfeasible (or undesirable) to change aspects of a website or application to match user expectations. The next best alternative is to set expectations more effectively. This can be done in a variety of ways such as:</p>
<ul>
<li><strong>Adding text hints and contextual help</strong>. If users tend to make mistakes with data entry (like the earlier example of parentheses around an area code) then it makes sense to either modify your site or application so that it can handle such input, or help set expectations that it can&#8217;t. Text hints such as &#8220;(numbers only)&#8221; or &#8220;xxx-xxx-xxxx&#8221; can help guide users towards entering data in the format it&#8217;s needed.</li>
</ul>
<ul>
<li><strong>Ensuring important messaging is easy to see and clearly written</strong>. I&#8217;ve touched upon this in several previous articles but to recap: if you want to ensure that customers with privacy and security concerns (and that&#8217;s most of them) feel comfortable, it&#8217;s important to address these points very clearly. It&#8217;s also important to make sure users can actually see and notice these messages. They need to be large enough and presented in places where users will naturally look.</li>
</ul>
<h3>In conclusion</h3>
<ul>
<li>Users&#8217; previous experiences create filters through which they see and interact with your application or website.</li>
<li>It&#8217;s important to understand your users&#8217; biases and expectations because they can play a big role in ease of use.</li>
<li>User testing, online surveys, and remote observation are three tools that can help uncover and understand user expectations and biases.</li>
<li>Once you understand your users&#8217; biases you can work around them; in many cases this involves simple changes like terminology. Sometimes the necessary changes are more complex and involve site structure or information architecture.</li>
<li>It&#8217;s wise to gather information about expectations and biases periodically because they tend to change over time.</li>
</ul>
<p>Yes, your users have plenty of baggage. But it needn&#8217;t result in frightfully bad user experiences.</p>
<hr />
<p class="fisher-photo-caption" style="text-align: left;">Photo: <a title="Photo by Striatic" href="http://www.flickr.com/photos/striatic/19839430/" target="_blank">striatic</a>. Creative Commons licensed.</p>
<p>Related posts:<ol><li><a href='http://completeusability.com/why-require-registration-part-1/' rel='bookmark' title='Why require registration? Part 1'>Why require registration? Part 1</a></li>
<li><a href='http://completeusability.com/improved-error-handling-part-1-helping-users-notice-errors/' rel='bookmark' title='Improved error handling, part 1: helping users notice errors'>Improved error handling, part 1: helping users notice errors</a></li>
<li><a href='http://completeusability.com/communicating-status/' rel='bookmark' title='Communicating status'>Communicating status</a></li>
</ol></p>]]></content:encoded>
			<wfw:commentRss>http://completeusability.com/expectations-and-biases/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

