Links on Usability Engineering

Expert Ratings of Usability Maxims

Published in the ‘Ergonomics in Design’ journal in 1997. He collected and created this list of 34 thumb rules (given below in order of priority) that were found particularly useful during the design process by colleagues working in the human-computer interface (HCI) design field.

  1. Know thy user, and YOU are not thy user.
  2. Things that look the same should act the same.
  3. Everyone makes mistakes, so every mistake should be fixable.
  4. The information for the decision needs to be there when the decision is needed.
  5. Error messages should actually mean something to the user, and tell the user how to fix the problem.
  6. Every action should have a reaction.
  7. Don’t overload the user’s buffers.
  8. Consistency, consistency, consistency.
  9. Minimize the need for a mighty memory.
  10. Keep it simple.
  11. The more you do something, the easier it should be to do.
  12. The user should always know what is happening.
  13. The user should control the system. The system shouldn’t control the user. The user is the boss, and the system should show it.
  14. The idea is to empower the user, not speed up the system.
  15. Eliminate unnecessary decisions, and illuminate the rest.
  16. If I made an error, let me know about it before I get into REAL trouble.
  17. The best journey is the one with the fewest steps. Shorten the distance between the user and their goal.
  18. The user should be able to do what the user wants to do.
  19. Things that look different should act different.
  20. You should always know how to find out what to do next.
  21. Don’t let people accidentally shoot themselves.
  22. Even experts are novices at some point. Provide help.
  23. Design for regular people and the real world.
  24. Keep it neat. Keep it organized.
  25. Provide a way to bail out and start over.
  26. The fault is not in thyself, but in thy system.
  27. If it is not needed, it’s not needed.
  28. Color is information.
  29. Everything in its place, and a place for everything.
  30. The user should be in a good mood when done.
  31. If I made an error, at least let me finish my thought before I have to fix it.
  32. Cute is not a good adjective for systems.
  33. Let people shape the system to themselves, and paint it with their own personality.
  34. To know the system is to love it.

Expert Ratings of Usability Maxims (article access requires purchase)

Landing Page Testing: Choosing Between A/B Or Multivariate Approaches

The author desribes A/B tests and multivariate tests (MVT), the difference between them and how one can choose which best fits their needs. A comparison between the techniques is mentioned, taking into consideration the overall use of the testing technique, coding needs, design needs, granularity of results and other considerations.
Landing Page Testing: Choosing Between A/B Or Multivariate Approaches

How to Conduct a Heuristic Evaluation

Heuristic evaluation (Nielsen and Molich, 1990; Nielsen 1994) is a usability engineering method for finding the usability problems in a user interface design so that they can be attended to as part of an iterative design process. Heuristic evaluation involves having a small set of evaluators examine the interface and judge its compliance with recognized usability principles (the “heuristics”).

In general, heuristic evaluation is difficult for a single individual to do because one person will never be able to find all the usability problems in an interface. Luckily, experience from many different projects has shown that different people find different usability problems. Therefore, it is possible to improve the effectiveness of the method significantly by involving multiple evaluators.

How to Conduct a Heuristic Evaluation

Cross-user analysis: Benefits of skill level comparison in usability testing

This study presents a cross-user usability test approach and analysis technique that extends beyond merely identifying the existence of a usability problem to introducing an empirical basis for identifying the type of usability problem that exists. For experimental purposes, 60 users were tested with three levels of user-competency determined by experience in using: (1) computers, and (2) the tested application. Applying the Tukey honestly significant difference (HSD) test to each test element provided statistical comparison between different experience levels.

Analysis results between experience levels suggested which levels encountered usability problems. The authors demonstrate that statistical calculations of cross-user data can render empirical support for categorizing usability problems.

Cross-user analysis: Benefits of skill level comparison in usability testing (300 kb)

Designing Web Sites for Older Adults: A Review of Recent, Relevant Research (2004)

In this document from 2004, then recent, relevant research about Web site design and older adult users are reviewed. From the research reviewed here, the authors developed a set of heuristics to use in persona-based, task-based reviews of 50 Web sites that older adult users are likely to go to.

Designing Web Sites for Older Adults: A Review of Recent, Relevant Research (PDF, 380 kb)

This document was published on December 14, 2004.

International Journal of Mobile Human Computer Interaction (IJMHCI)

The International Journal of Mobile Human Computer Interaction (IJMHCI) brings together a comprehensive collection of research articles from international experts on the design, evaluation, and use of innovative handheld, mobile, and wearable technologies.

This journal will also consider issues associated with the social and/or organizational impacts of such technologies. Emerging theories, methods, and interaction designs are included and complemented with case studies, which demonstrate the practical application of these new ideas.

International Journal of Mobile Human Computer Interaction (IJMHCI)

Designing web sites for older adults: Expert review of usability for older adults at 50 web sites

In this document from 2005, findings from an expert review of 50 Web sites are presented. In a variation on the traditional heuristic evaluation methodology, heuristics were derived from research about older adults and Web design to perform persona-based, task-based reviews of Web sites that older adult users are likely to go to. The heuristics are extracted from our findings in Designing Web Sites for Older Adults: A Review of Recent, Relevant Research.

Designing web sites for older adults: Expert review of usability for older adults at 50 web sites (PDF, 1.7 mb)

Corporate Usability Maturity

Summary
As their usability approach matures, organizations typically progress through the same sequence of stages, from initial hostility to widespread reliance on user research. An organization that reaches the managed usability stage still has far to go to reach usability nirvana. Attaining these higher maturity levels requires many years of effort.

Stage 1: Hostility Toward Usability
Stage 2: Developer-Centered Usability
Stage 3: Skunkworks Usability
Stage 4: Dedicated Usability Budget
Stage 5: Managed Usability
Stage 6: Systematic Usability Process
Stage 7: Integrated User-Centered Design
Stage 8: User-Driven Corporation

Corporate Usability Maturity: Stages 1-4
Corporate Usability Maturity: Stages 5-8

Bias in Usability Testing

What does “bias” mean in usability testing? Is it bad? good? In between? What are sources of bias in usability testing? Which one(s) should we worry about most? How do we know our methods are any good? Especially when we all do things differently

Bias in Usability Testing (226 kb)

Journal of usability studies

The Journal of Usability Studies (JUS) is a peer-reviewed, international, online publication dedicated to promote and enhance the practice, research, and education of usability engineering.

Its aim is to provide usability practitioners and researchers with a forum to share:

  • Empirical findings
  • usability case studies (research case studies, not business case studies)
  • opinions and experiences (regarding the practice and education of usability engineering)
  • Reports of good practices in usability engineering

Journal of usability studies