Testing & QA - ImageConstrux - software development best practices
SeminarsConsultingResources & ToolsAbout Us
Solutions
I'm hearing about "test first" development. What is that?
Solution One Go
How can a tester improve his or her skills?
Solution Two Go
Testing & QA .:. Software Testing & QA Resources .:. Usability Testing Resources

Usability Testing Techniques

5-Second Tests

5 Second tests are used to find out if users can figure out what a web page is supposed to do in 5 seconds. It seems like a short time, but users often only allow a few seconds to decide if a page has the information they want on it or not.

Spool, Jared, "Usability Tools Podcast - 5 Second Usability Tests.", UIE, September 10, 2007.

Perfetti, Christine, "5-Second Tests: Measuring Your Site’s Content Pages", UIE, June 9, 2005.

Inherent Value Tests

Inherent value tests are designed to find out what inherent value or benefit users find in your site, and then to help you redo the design so that novice users can see the value clearly displayed. They are used where there are loyal customers who love your site and another group of people who don't use the site who can't see why it's useful.

Spool, Jared, "Inherent Value Testing.", UIE, February 19, 2004.

Spool, Jared, "Conducting Inherent Value Testing", UIE, February 25, 2004.

Spool, Jared, "Usability Tools Podcast: Inherent Value Tests", UIE podcast, February 25, 2004.

Usability Inspection Methods

Nielsen, Jakob and Robert L. Mack, (eds.). Usability inspection methods. New York, NY: Wiley, 1994.

Nielsen, Jakob, "Heuristic evaluation", Papers and Essays.

GOMS (Goals, Operations, Methods, and Selections)

Bovair, S., Kieras, David E., & Polson, P.G, , "The acquisition and performance of text-editing skill: A cognitive complexity analysis", Human Computer Interaction, 5, 1-48, 1990.

Bovair, S. & Kieras, David E,, "Toward a model of acquiring procedures from text", In R. Barr, M. L. Kamil, P. Mosenthal and P. D. Pearson (Eds.), Handbook of Reading Research, Vol. II, 1991 (pp. 206-229). New York: Longman.

John, Bonnie E. & David E. Kieras, "Using GOMS for user interface design and evaluation: Which technique?", ACM Transactions on Computer-Human Interaction, 3, 287-319, 1996.

John, Bonnie E & David Kieras, "The GOMS family of user interface analysis techniques: Comparison and contrast", ACM Transactions on Computer-Human Interaction, 3, 320-351, 1996.

John, Bonnie E. and Kieras, David E., "The GOMS family of analysis techniques: Tools for design and evaluation", Carnegie Mellon University School of Computer Science Technical Report No. CMU-CS-94-181. Also appears as the Human-Computer Interaction Institute Technical Report No. CMU-HCII-94-106.

Kieras, David, "Using the Keystroke-Level Model to Estimate Execution Times", On-line handout on an approach to using this simple form of GOMS model.

Kieras, David, "A Guide to GOMS Model Usability Evaluation using NGOMSL", On-line handout using NGOMSL; similar to Kieras 1997, 1988.

Kieras, David E., & Bovair, S., "The acquisition of procedures from text: A production-system analysis of transfer of training", Journal of Memory and Language, 25, 507-524, 1986.

Kieras, David E., & Polson, P.G., "An approach to the formal analysis of user complexity. International Journal of Man-Machine Studies", 22, 365-394, 1985.

Kieras, David E., "Task analysis and the design of functionality", In A. Tucker (Ed.) The Computer Science and Engineering Handbook. Boca Raton, CRC Inc. 1401-1423, 1997.

Kieras, David E., "A Guide to GOMS model usability evaluation using NGOMSL", In M. Helander, T. Landauer, and P. Prabhu (Eds.), Handbook of human-computer interaction. (Second Edition), 1997. Amsterdam: North-Holland. 733-766.

Kieras, David E., "Towards a practical GOMS model methodology for user interface design", In M. Helander (Ed.), Handbook of Human-Computer Interaction, 1988 (pp. 135-158). Amsterdam: North-Holland Elsevier.

Kieras, David E., Wood, S.D., Abotel, K., and Hornof, A., "GLEAN: A Computer-Based Tool for Rapid GOMS Model Usability Evaluation of User-Interface Designs", UIST’95 Proceedings of the ACM Symposium on User Interface Software and Technology. November, 1995.

Usability Testing - General

Barnum, Carol M, Usability testing and research. New York, NY: Longman, 2002.

Dumas, Joseph S. and Janice C. Redish, A practical guide to usability testing, rev. edition. Portland, OR: Intellect Books, 1999.

Instone , Keith, Usable Web site has links to resources for user demographics.

Kuniavsky, Mike, Observing the User Experience: A Practitioner’s Guide to User Research. San Francisco, CA, Morgan Kauffman, 2003.

Molich, Rolf, Nigel Bevan, Ian Curson, Scott Butler, Erika Kindlund, Dana Miller and Jurek Kirakowski. "Comparative Usability Evaluation (CUE) Tests". CUE-2 is a comparative usability test of the popular www.hotmail.com website. Nine teams have simultaneously usability tested this website. Their reports are available from this URL, along with overall findings about the study.

Nielsen, Jakob, "Cost of user testing a website", Alertbox for May 3, 1998.

Nielsen, Jakob, "Quantitative Studies: How Many Users to Test?", Alertbox for June 26, 2006.

Nielsen, Jakob, "Benefits of Extremely Low-Budget User Testing", Alertbox for April, 2006.

Nielsen, Jakob, "Usability for $200", Alertbox for June 2, 2003.

Nielsen, Jakob, "Recruiting Test Participants for Usability Studies", Alertbox for January 20, 2003.

Nielsen, Jakob, "Why you only need to test with 5 users", Alertbox March 19, 2000.

Nielsen, Jakob, "Success rate: the simplest usability metric", Alertbox for February 18, 2001.

Nielsen, Jakob, "Usability metrics", Alertbox for January 21, 2001.

Nielsen, Jakob, "Outliers and Luck in User Performance", Alertbox for March 6, 2006.

Nielsen, Jakob, "Variability in User Performance", Alertbox for May 15, 2006.

Nielsen, Jakob, "Usability: Empiricism or Ideology", Alertbox for June 27, 2005.

Nielsen, Jakob, "Novice vs. expert users", Alertbox for February 6, 2000.

Nielsen, Jakob, "Failure of corporate websites", Alertbox for October 18, 1998.

Nielsen, Jakob, "Testing Whether Web Page Templates are Helpful", Alertbox for May 17, 1998.

Nielsen, Jakob, "The Myth of the Genius Designer", Alertbox for May 29, 2007.

Nielsen, Jakob, "B2B Usability", Alertbox for June 1, 2006.

Nielsen, Jakob, "First Rule of Usability? Don’t Listen to Users", Alertbox for August 5, 2001.

Nielsen, Jakob, "Location is Irrelevant for Usability Studies", Alertbox for April 30, 2007.

Nielsen, Jakob, "Multiple-User Simultaneous Testing (MUST)", Alertbox for October 15, 2007.

Nielsen, Jakob, "High-Cost Usability Sometimes Makes Sense", Alertbox for November 5, 2007.

Perfetti, Christine, "5-Second Tests: Measuring Your Site’s Content Pages", UIE, June 9, 2005.

Perfetti, Christine, "Usability Testing Best Practices: An Interview with Rolf Molich", UIE, July 24, 2003.

Perfetti, Christine, "Five Techniques for Getting Buy-In for Usability Testing", UIE, April 24, 2007.

Rubin, Jeffrey, Handbook of usability testing: how to plan, design, and conduct effective tests. New York: Wiley, 1994.

Scanlon, Tara, "Surprises on the Web: Results from Usability Testing", UIE, September 1, 1996.

Schroeder , Will, "Testing Web Sites with Eye-Tracking", UIE, Sept 1, 1998.

Society for Technical Communication, Topics in Usability this site contains resources on usability testing.

Spolsky, Joel, "Usability Testing with Morae", Joel on Software article, July 30, 2005.

Spolsky, Joel, "A game of inches", Joel on Software article, June 7, 2007.

Spool, Jared, "The Road to Recommendation", UIE, January 6, 2006.

Spool, Jared, "Interview-Based Tasks: Learning from Leonardo DiCaprio", UIE, March 7, 2006.

Spool, Jared, "Streamlining Usability Testing by Avoiding the Lab, UIE, May 25, 2005.

Spool, Jared, "Seven Common Usability Testing Mistakes", UIE, February 15, 2005.

Spool, Jared, "Usability Testing. Oh, The Things You Can Learn.", UIE, February 27, 2007.

Spool, Jared, "CUE: A Usability Testing Bake-Off", UIE, August 19, 2005.

Spool, Jared, "Usability Tools Podcast: The Truth About Page Download Time", podcast, September 24, 2007. When users say a site is slow or fast, it doesn’t correlate with the actual download time, rather it correlates with whether the user was successful in doing their task or not. If successful, the site was ‘fast’ and if not, ‘slow’.

Spool, Jared, "Usability Tools Podcast: Interview-Based Tasks for Usability Testing", podcast, October 1, 2007. Classical usability testing sets up predefined tasks for users to do; but if users do tasks they are interested in, they interact differently with the application.

Spool, Jared, "Usability Tools Podcast: Statistical Significance", podcast, October 22, 2007.

Spool, Jared, "A Counter-Intuitive Approach to Evaluating Design Alternatives", UIEtips, May 19, 2008. This is about using inherent value tests when the budget is tight and the client wanted to evaluate several design alternatives.

Stanford-Poynter project Eyetracking study of 67 users reading news online.

login >