Abstract
Human factors evaluation is a critical process for ensuring the success of man-machine systems. Meister (1987a, b) describes more traditional methods for systems design, development and testing, and system effectiveness testing. However, recent advances in man-machine interface system (M-MIS) technology (i.e., sensors, processors, displays and controls, and the overall control room configuration) and the man-machine systems that they control have created the need for more sophisticated approaches to evaluation. In particular, special attention is needed to address (a) cognitive issues related to how operators develop and maintain awareness of the state of the controlled system and (b) crew coordination issues related to the ways that individuals interact with each other and the rest of the man-machine system to accomplish operational goals. These issues may be difficult and expensive to resolve if evaluation is left until late in the design process and tested using a production prototype or a full-scope, full-scale simulator. This paper proposes an alternative approach in which human performance issues are evaluated earlier in the design process using lower fidelity testbeds (e.g., part-task simulators) in addition to more traditional means. This approach requires a systematic evaluation framework for defining issues and specifying required attributes of testbed fidelity.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beltracchi, L. (1987). A direct manipulation interface for heat engines based upon the Rankine cycle, IEEE Systems, Man, and Cybernetics, Report No. SMC-17, pp. 478–487.
Endsley, M. R. (1988). Design and evaluation for situation awareness enhancement. Proceedings of the Human Factors Society, 32nd Annual Meeting, Santa Monica: Human Factors Society, pp. 97–101.
Foushee, H. C., and Helmreich, R. L. (1988). Group interaction and flight crew performance. In E. L. Wiener and D. C. Nagel (Eds.), Human Factors In Aviation. San Diego: Academic Press, Inc.
Henderson, A., and Card, S. (1987). Rooms: The use of multiple virtual workspaces to reduce space contention in a window-based graphical interface. ACM Transactions on Graphics, 5, pp. 211–243.
Hutchins, E. (1990). The technology of team navigation. In J. Galegher, R. Kraut, and C. Egido (Eds.), Intellectual Work: Social and Technical Bases of Collaborative Work. Hillsdale, NJ: Lawrence Erlbaum, Inc.
International Electrotechnical Commission (1989). Design for Control Rooms of NuclearPower Plants IEC, 964, first edition, Geneva.
Meister, D. (1987a). Systems design, development and testing. In G. Salvendy (Ed.), Handbook of Human Factors (pp. 17–42 ). New York: John Wiley and Sons.
Meister, D. (1987b). System effectiveness testing. In G. Salvendy (Ed.), Handbook of Human Factors (pp. 1271–1297 ). New York: John Wiley and Sons.
Mumaw, R. J., Roth, E. M., and Stubler, W. F. (1991). An analytic technique for framing
control room evaluation issues. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics,pp 1355–1360.
O’Hara, J. M., and Wachtel, J. (1991). Advanced control room evaluation: General approach and rationale. Proceedings of the Human Factors Society 35th Annual Meeting (pp 1243–1247 ). Santa Monica, CA: Human Factors Society.
Oser, R. G., McCallum, E., Salas, B., and Morgan, B. (1989). Toward a Definition of Team Work: An Analysis of Critical Team Behaviors. Human Factors Division, Naval Training Systems Center, Technical Report No. 89–004.
Rasmussen, J. (1986). Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering. New York: Elsevier Science (North-Holland )
Rasmussen, J., and Goodstein, L. P. (1988). Information technology and work. In M. Helander (Ed.), Handbook of Human-Computer Interaction. Amsterdam, New York: Elsevier Science Publishers B.V. (North-Holland).
Roth, E. M., Mumaw, R. J., and Stubler, W. F. (1992). Human factors evaluation issues for advanced control rooms: A research agenda. Proceedings of the 1992 IEEE Fifth Conference on Human Factors and Power Plants. New York: Institute of Electrical and Electronics Engineers.
Sheridan, T. B. (1987). Supervisory control. In G. Salvendy (Ed.), Handbook of Human Factors. New York: John Wiley and Sons.
Stinnett, T. A. (1989). Human factors in the super cockpit. In J. S. Jensen (Ed.), Aviation Psychology (pp. 1–37 ). Essex: Anchor Press Ltd.
Stubler, W. F. (1990). When is a Naval outer air battle like a nuclear power plant? Proceedings of the Human Factors Society 34th Annual Meeting, pp. 51–55.
Stubler, W. F., Roth, E. M., and Mumaw, R. J. (1991). Evaluation issues for computer-based control rooms. Proceedings of the Human Factors Society 35th Annual Meeting, pp. 383387.
U.S. Department of Defense. (1979). Human engineering requirements for military systems, equipment, and facilities, Report No. MIL-H-46855B.
U.S. Nuclear Regulatory Commission. (1981). Guidelines for Control Room Design Reviews, Report No. NUREG-0700.
Vicente, K. J. (1990). Ecological interface design as an analytic evaluation tool. ANS Topical Meeting on Advances in Human Factors Research: Nuclear and Beyond (pp 259–265 ). Nashville, TN: ANS.
Wiener, E. L. (1989). Human Factors of Advanced Technology (“Glass Cockpit”) NASA, Transport Aircraft, Technical Report No. 117528.
Wilson, J., and Rosenberg, D. (1988). Rapid prototyping for user interface design. In M. Helander (Ed.), Handbook of Human-Computer Interaction. Amsterdam, New York: Elsevier Science Publishers B.V. (North-Holland).
Woods, D. D. (1984). Visual momentum: A concept to improve the cognitive coupling of person and computer. International Journal of Man-Machine Studies, 21, 229–244.
Woods, D. D. (1988). Coping with complexity: The psychology of human behavior in complex systems. In L. P. Goodstein, H. B. Andersen, and S. E. Olsen (Eds.), Tasks, Errors and Mental Models (Mental Models, Tasks, and Errors?), London: Taylor and Francis.
Woods, D. D., and Elias, G. S. (1988). Significance Messages: An integrated display concept. Proceedings of the Human Factors Society, 32nd Annual Meeting, pp. 1350–1354.
Woods, D. D., O’Brien, J., and Hanes, L. F. (1987). Human factors challenges in process control: The case of nuclear power plants. In G. Salvendy (Ed.), Handbook of Human Factors (pp 1724–1770 ). New York: John Wiley and Sons.
Woods, D. D., Roth, E. M., Stubler,W. F., and Mumaw, R. J. (1990). Navigating through large display networks in dynamic control applications. Proceedings of the Human Factors Society 34th Annual Meeting. Santa Monica, CA: Human Factors Society, pp. 396–399.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stubler, W.F., Roth, E.M., Mumaw, R.J. (1993). Integrating Verification and Validation with the Design of Complex Man-Machine Systems. In: Wise, J.A., Hopkin, V.D., Stager, P. (eds) Verification and Validation of Complex Systems: Human Factors Issues. NATO ASI Series, vol 110. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-02933-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-662-02933-6_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-08155-2
Online ISBN: 978-3-662-02933-6
eBook Packages: Springer Book Archive