Using GOMS for user interface design and evaluation: which technique?

This alert has been successfully added and will be sent to: You will be notified whenever a record that you have chosen has been cited.

To manage your alert preferences, click on the button below. Manage my Alerts

New Citation Alert!

Abstract

Since the seminal book, The Psychology of Human-Computer Interaction, the GOMS model has been one of the few widely known theoretical concepts in human-computer interaction. This concept has spawned much research to verify and extend the original work and has been used in real-world design and evaluation situations. This article synthesizes the previous work on GOMS to provide an integrated view of GOMS models and how they can be used in design. We briefly describe the major variants of GOMS that have matured sufficiently to be used in actual design. We then provide guidance to practitioners about which GOMS variant to use for different design situations. Finally, we present examples of the application of GOMS to practical design problems and then summarize the lessons learned.

References

ATWOOD,M.E.,GRAY,W.D.,AND JOHN, B. E. 1996. Project Ernestine: Analytic and empirical methods applied to a real-world CHI problem. In Human-Computer Interface Design: Success Stories, Emerging Methods and Real-World Context, M. Rudisill, C. Lewis, P. B., Polson, and T. D. McKay, Eds. Morgan Kaufmann, San Mateo, Calif.

BEARD,D.V.,SMITH,D.K.,AND DENELSBECK, K. M. 1996. Quick and dirty GOMS: A case study of computed tomography interpretation. Hum. Comput. Interact. 11, 2, 157-180.

BYRNE,M.D.,WOOD,S.D.,SUKAVIRIYA, P., FOLEY,J.D.,AND KIERAS, D. E. 1994. Auto-mating interface evaluation. In Human Factors in Computer Systems, CHI '94. ACM, New York, 232-237.

CARD,S.AND MORAN, T. 1988. User technology: From pointing to pondering. In A History of Personal Workstations, A. Goldberg, Ed. ACM, New York, 489-522.

CARD,S.K.,MORAN,T.P.,AND NEWELL, A. 1980. The keystroke-level model for user performance time with interactive systems. Commun. ACM 23, 7 (July), 396-410.

CARD,S.K.,MORAN,T.P.,AND NEWELL, A. 1983. The Psychology of Human-Computer Interaction. Lawrence Erlbaum, Hillsdale, N.J.

CARLEY,K.M.AND PRIETULA, M. J. 1994. Computational Organization Theory. Lawrence Erlbaum, Hillsdale, N.J.

CHUAH,M.C.,JOHN,B.E.,AND PANE, J. 1994. Analyzing graphic and textual layouts with GOMS: Results of a preliminary analysis. In Proceedings Companion of CHI '94. ACM, New York, 323-324.

DIAPER, D., Ed. 1989. Task Analysis for Human-Computer Interaction. Ellis Horwood, Chichester, U.K.

DILLON, A., SWEENEY, M., AND MAGUIRE, M. 1993. A survey of usability engineering within the European IT industry:Current practice and needs. In People and Computers, Proceed-ings of HCI 93, J. L. Alty, D. Diaper, and S. Guest Eds. Cambridge University Press, Cambridge, Mass., 81-94.

ELKERTON, J. 1993. Using GOMS models to design documentation and user interfaces: An uneasy courtship. In Proceedings of INTERCHI'93. Position paper for workshop on human-computer interaction advances derived from real world experiences. ACM, New York.

ELKERTON,J.AND PALMITER, S. L. 1991. Designing help using a GOMS model: An informa-tion retrieval evaluation. Hum. Factors 33, 2, 185-204.

ENDESTAD,T.AND MEYER, P. 1993. GOMS analysis as an evaluation tool in process control: An evaluation of the ISACS-1 prototype and the COPMA system. Tech. Rep. HWR-349, OECD Halden Reactor Project, Inst. for Energiteknikk, Halden, Norway.

GILBRETH,F.B.AND GILBRETH, L. M. 1917. Applied Motion Study. The MacMillan Company, New York.

GONG, R. 1993. Validating and refining the GOMS model methodology for software user interface design and evaluation. Ph.D. dissertation, Univ. of Michigan, Ann Arbor, Mich.

GONG,R.AND ELKERTON, J. 1990. Designing minimal documentation using a GOMS model: A usability evaluation of an engineering approach. In Human Factors in Computer Systems, CHI '90. ACM, New York, 99-106.

GONG,R.AND KIERAS, D. 1994. A validation of the GOMS model methodology in the development of a specialized, commercial software application. In Human Factors in Computer Systems, CHI '94. ACM, New York, 351-357.

GOTT, S. P. 1988. Apprenticeship instruction for real-world tasks: The coordination of procedures, mental models, and strategies. In Review of Research in Education, Ernst Z. Rothkopf, Ed. AERA, Washington, D. C.

GRAY,W.D.AND SALZMAN, M. C. 1996. Damaged merchandise? A review of experiments that compare usability evaluation methods. Unpublished report, Dept. of Psychology, George Mason Univ., Fairfax, Va.

GRAY,W.D.,JOHN,B.E.,AND ATWOOD, M. E. 1993. Project Ernestine: A validation of GOMS for prediction and explanation of real-world task performance. Hum. Comput. Interact. 8, 3, 237-209.

JOHN, B. E. 1990. Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information. In Human Factors in Computer Systems, CHI '90. ACM, New York, 107-115.

JOHN, B. E. 1994. Toward a deeper comparison of methods: A reaction to Nielsen and Phillips and new data. In the Proceedings Companion of CHI '94. ACM, New York, 285-286.

JOHN, B. E. 1995. Why GOMS? interactions 2, 4, 80-89.

JOHN,B.E.AND GRAY, W. D. 1995. GOMS analyses for parallel activities. In Human Factors in Computer Systems, CHI '95. ACM, New York.

JOHN,B.E.AND KIERAS, D. E. 1996. The GOMS family of analysis techniques: Comparison and contrast. ACM Trans. Comput. Hum. Interact. 3, 4 (Dec.), 320-351. This issue.

JOHN,B.E.AND VERA, A. H. 1992. A GOMS analysis for a graphic, machine-paced, highly interactive task. In Human Factors in Computer Systems, CHI '92. ACM, New York, 251-258.

JOHN,B.E.,VERA,A.H.,AND NEWELL, A. 1994. Toward real-time GOMS: A model of expert behavior in a highly interactive task. Behav. Inf. Tech. 13, 4, 255-267.

JONG, H.-S. 1991. The subgoal structure as a cognitive control mechanism in a human-computer interaction framework. Ph.D. dissertation, The Univ. of Michigan, Ann Arbor, Mich.

KARAT,J.AND BENNETT, J. 1991. Modeling the user interaction methods imposed by designs. In Mental Models and Human-Computer Interaction, M. Tauber and D. Ackermann Eds. Vol. 2. Elsevier, Amsterdam.

KARAT, J., BOYES, L., WEISGERBER, S., AND SCHAFER, C. 1986. Transfer between word processing systems. In Human Factors in Computer Systems, CHI '86. ACM, New York, 67-71.

KIERAS, D. E. 1988. Towards a practical GOMS model methodology for user interface design. In The Handbook of Human-Computer Interaction, M. Helander, Ed. North-Holland, Amsterdam, 135-158.

KIERAS, D. E. 1994. GOMS modeling of user interfaces using NGOMSL. In Human Factors in Computer Systems, CHI '94. ACM, New York.

KIERAS, D. E. 1996a. Guide to GOMS model usability evaluation using NGOMSL. In The Handbook of Human-Computer Interaction, M. Helander and T. Landauer Eds. 2nd ed. North-Holland, Amsterdam.

KIERAS, D. E. 1996b. Task analysis and the design of functionality. In Handbook of Computer Science and Engineering, T. Allen, Ed. CRC Press, Boca Raton, Fla.

KIERAS,D.E.AND POLSON, P. G. 1985. An approach to the formal analysis of user complexity. Int. J. Man-Machine Stud. 22, 365-394.

KIERAS,D.E.,WOOD,S.D.,ABOTEL,K.AND HORNOF, A. 1995. GLEAN: A computer-based tool for rapid GOMS model usability evaluation of user interface designs. In UIST'95 Proceedings. ACM, New York.

KIRWAN,B.AND AINSWORTH, L. K. 1992. A Guide to Task Analysis. Taylor and Francis, London.

LANDAUER, T. K. 1995. The Trouble with Computers: Usefulness, Usability, and Productiv-ity. MIT Press, Cambridge, Mass.

LEE,A.Y.,POLSON,P.G.,AND BAILEY, W. A. 1989. Learning and transfer of measurement tasks. In Human Factors in Computer Systems, CHI '89. ACM, New York, 115-120.

LERCH,F.J.,MANTEI,M.M.,AND OLSON, J. R. 1989. Translating ideas into action: Cognitive analysis of errors in spreadsheet formulas. In Human Factors in Computer Systems, CHI '89. ACM, New York, 121-126.

LEWIS,C.AND RIEMAN, J. 1994. Task-Centered User Interface Design: A Practical Introduc-tion. Shareware book available at ftp.cs.colorado.edu/pub/cs/distribs/clewis/HCI-Design-Book.

LOHSE, G. L. 1993. A cognitive model for understanding graphical perception. Hum. Com-put. Interact. 8, 4, 353-388.

MONKIEWICZ, J. 1992. CAD's next-generation user interface. Comput. Aided Eng. (Nov.), 55-56.

NESBITT, K., GORTON, D., AND RANTANEN, J. 1994. A case study of GOMS analysis: Extension of user interfaces. Tech. Rep. BHPR/ETR/R/94/048, BHP Research-Newcastle Laboratories, Australia.

NEWELL,A.AND SIMON, H. A. 1972. Human Problem Solving. Prentice-Hall, Englewood Cliffs, N.J. NIELSEN,J.AND MACK, R. L., Eds. 1994. Usability Inspection Methods. John Wiley and Sons, New York.

NIELSEN,J.AND PHILLIPS, V. L. 1993. Estimating the relative usability of two interfaces: Heuristic, formal, and empirical methods compared. In Proceedings of INTERCHI '93. ACM, New York, 214-221.

NILSEN, E., JONG, H., OLSON,J.S.,AND POLSON, P. G. 1992. Method engineering: From data to model to practice. In Human Factors in Computer Systems, CHI '92. ACM, New York, 313-319.

NORMAN, D. A. 1983. Design rules based on analyses of human error. Commun. ACM 26, 4 (Apr.), 254-258.

OBERG, E., JONES,F.D.,AND HORTON, H. L. 1978. Machinery's Handbook: A Reference Book for the Mechanical Engineer, Draftsman, Toolmaker and Machinist. 20th ed. Industrial Press, New York.

OLSON,J.S.AND MORAN, T. P. 1996. Mapping the method muddle: Guidance in using methods for user interface design. In Human-Computer Interface Design: Success Stories, Emerging Methods and Real-World Context, M. Rudisill, C. Lewis, P. B., Polson, and T. D. McKay, Eds. Morgan Kaufmann, San Mateo, Calif.

OLSON,J.R.AND OLSON, G. M. 1990. The growth of cognitive modeling in human-computer interaction since GOMS. Hum. Comput. Interact. 5, 221-265.

PECK,V.A.AND JOHN, B. E. 1992. Browser-Soar: A cognitive model of a highly interactive task. In Human Factors in Computer Systems, CHI '92. ACM, New York, 165-172.

REASON, J. 1990. Human Error. Cambridge University Press, Cambridge, Mass.

RIEMAN, J., LEWIS, C., YOUNG,R.M.,AND POLSON, P. G. 1994. "Why is a Raven like a writing desk?" Lessons in interface consistency and analogical reasoning from two cognitive archi-tectures. In Human Factors in Computer Systems, CHI '94. ACM, New York, 438-444.

SMELCER, J. B. 1989. Understanding user errors in database query. Ph.D. dissertation, The Univ. of Michigan, Ann Arbor, Mich.

STEINBERG,L.S.AND GITOMER, D. H. 1993. Cognitive task analysis, interface design, and technical troubleshooting. In Proceedings of the 1993 International Workshop on Intelligent User Interfaces, W. D. Gray, W. E. Hefley, and D. Murray, Eds. ACM, New York, 185-191.

VAN COTT,H.P.AND KINKADE, R. G. 1972. Human Engineering Guide to Equipment Design, Rev. ed. American Institutes for Research, Washington, D.C.

VERA,A.H.AND ROSENBLATT, J. K. 1995. Developing user model-based intelligent agents. In Proceedings of the 17th Annual Conference of the Cognitive Science Society, J. D. Moore and J. F. Lehman, Eds. Lawrence Erlbaum, Hillsdale, N.J., 500-505.

WHARTON, C., RIEMAN, J., LEWIS, C., AND POLSON, P. 1994. The Cognitive Walkthrough Method: A practitioner's guide. In Usability Inspection Methods, J. Nielsen and R. L. Mack, Eds. John Wiley and Sons, New York.

WOOD, S. 1993. Issues in the Implementation of a GOMS-Model Design Tool. Unpublished report, Univ. of Michigan, Ann Arbor, Mich.

Cited By

Index Terms

Using GOMS for user interface design and evaluation: which technique?

Recommendations

The GOMS family of user interface analysis techniques: comparison and contrast

Sine the publication of The Psychology of Human-Computer Interaction, the GOMS model has been one of the most widely known theoretical concepts in HCI. This concept has produced severval GOMS analysis techniques that differ in appearance and form, .

The GOMS SIG: troubleshooting, lessons learned, novel applications, teaching techniques & future research

CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing Systems

GOMS is many things to many people, It is the only validated analytic usability evaluation method (UEM) in the field of human-computer interaction. It is being used by practitioners at some of the world's largest and some of the smallest software .

The GOMS SIG: troubleshooting, lessons learned, novel applications, teaching techniques, & future research

CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing Systems

GOMS is many things to many people. It is the only validated analytic usability evaluation method (UEM) in the field of human-computer interaction. It is being used by practitioners at some of the world's largest and some of the smallest software .

Reviews

Reviewer: Jaroslav Pokorny

In this paper, the well-known goals, operations, methods, and selection rules (GOMS ) model [1] is considered. The authors try to use HCI cognitive modeling in real-world design and evaluation tasks and provide guidance to practitioners on how to select a GOMS variant for these purposes. In the introduction, the role of engineering models of HCI is explained. The authors emphasize that GOMS models are usefully approximate, make a priori predictions, cover a range of behavior involved in many HCI tasks, and have been proven to be learnable and usable for computer system designers. The rest of the introduction is devoted to an overview of the GOMS concept. GOMS is a way to analyze the knowledge of how to perform a task in terms of goals, operators, methods, and selection rules. Section 2 focuses on applying GOMS techniques to a design. The authors discuss GOMS methods in detail, considering the type of task the user will be engaged in and the types of information gained by applying the method. Then they examine a few of the common uses of the information provided by GOMS models, such as the time to learn and use GOMS, profiling, comparing alternative designs, sensitivity and parametric analysis, and documentation and online help systems. Section 3 provides a number of example applications of GOMS analysis in real-world system design. These cases illustrate the wide applicability of GOMS models for the design and evaluation of interfaces for different kinds of systems. In their summary and conclusions, the authors formulate hypotheses about the usefulness of GOMS techniques to designers. The paper offers an interesting alternative approach to a design area where a particular task was solved, usually in an intuitive way. The paper is clear and understandable. It provides guidance for the use of GOMS in practice.

Computing Reviews logoComputing Reviews logo

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.