Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-76fb5796d-x4r87 Total loading time: 0 Render date: 2024-04-26T03:57:06.183Z Has data issue: false hasContentIssue false
This chapter is part of a book that is no longer available to purchase from Cambridge Core

23 - Professional Judgments and “Naturalistic Decision Making”

from PART V.A - PROFESSIONAL DOMAINS

By
Karol G. Ross ,
Jennifer L. Shafer  and
Gary Klein
Edited by
K. Anders Ericsson ,
Neil Charness ,
Paul J. Feltovich  and
Robert R. Hoffman
Karol G. Ross
Affiliation:
Klein Associates Inc
Jennifer L. Shafer
Affiliation:
Klein Associates Inc
Gary Klein
Affiliation:
Klein Associates Inc
K. Anders Ericsson
Affiliation:
Florida State University
Neil Charness
Affiliation:
Florida State University
Paul J. Feltovich
Affiliation:
University of West Florida
Robert R. Hoffman
Affiliation:
University of West Florida
Get access

Summary

This chapter looks at expertise from the perspective of the community of practice known as Naturalistic Decision Making (NDM). We provide an overview of the emergence of NDM, the underlying theoretical orientation, and key NDM research. We discuss the impact NDM has had on one particular domain of expert judgment, military decision making. We conclude by discussing applications and continuing research issues in NDM.

Emergence of Naturalistic Decision Making

The focus of NDM research is on expert practitioners trying to figure out what to do under difficult circumstances. The need to understand decision making in the context of time pressure, uncertainty, ill-defined goals, and high personal stakes was a major impetus for the emergence of NDM. The coalescence of NDM as a field of study was marked by the publication of Decision Making in Action: Models and Methods (G. A. Klein, Orasanu, Calderwood, & Zsambok, 1993).

Zsambok (1997) described how this publication brought together the contextual factors that defined NDM:

The identification of key contextual factors that affect the way real-world decision making occurs, in contrast to their counterparts in the traditional decision research paradigm, evolved as a major contribution of the 1989 NDM conference (Orasanu & Connolly, 1993). They are: 1. Ill-structured problems (not artificial, well-structured problems). 2. Uncertain, dynamic environments (not static, simulated situations). 3. Shifting, ill-defined, or competing goals (not clear and stable goals). 4. Action/feedback loops (not one-shot decisions). 5. Time stress (as opposed to ample time for tasks). 6. High stakes (not situations devoid of true consequences for the decision maker). […]

Type
Chapter
Information
The Cambridge Handbook of Expertise and Expert Performance , pp. 403 - 420
Publisher: Cambridge University Press
Print publication year: 2006

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.Google Scholar
Blendell, C., Molloy, J. J., Catchpole, L. J., & Henderson, S. M. (in preparation). Defence Evaluation and Research Agency, Ministry of Defence, United Kingdom.Google Scholar
Boose, J. H. (1986). Expertise transfer for expert system design. Amsterdam: Elsevier.Google Scholar
Borstein, B. H., Emler, A. C., & Chapman, G. B. (1999). Rationality in medical treatment decisions: Is there a sunk-cost effect? Social Sciences & Medicine, 49, 215–222.CrossRefGoogle Scholar
Bramer, M. (Ed.). (1985). Research and development in expert systems. Cambridge, UK: Cambridge University Press.Google Scholar
Brezovic, C. P., Klein, G. A., & Thordsen, M. (1987). Decision making in armored platoon command (Contract MDA903-85-C-0327 for U.S. Army Research Institute, Alexandria, VA). Fairborn, OH: Klein Associates Inc. [also published as DTIC No. ADA231775, http://www.dtic.mil].Google Scholar
Calderwood, R., Klein, G. A., & Crandall, B. W. (1988). Time pressure, skill, and move quality in chess. American Journal of Psychology, 101, 481–493.CrossRefGoogle Scholar
Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5, 121–152.CrossRefGoogle Scholar
Chi, M. T. H., Glaser, R., & Farr, M. J. (Eds.). (1988). The nature of expertise. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Cohen, M. S. (1993). Three paradigms for viewing decision biases. In Klein, G. A., Orasanu, J., Calderwood, R., & Zsambok, C. E. (Eds.), Decision making in action: Models and methods (pp. 36–50). Norwood, NJ: Ablex.Google Scholar
Cohen, M. S., Freeman, J. T., & Thompson, B. B. (1997). Training the naturalistic decision maker. In Zsambok, C. E. & Klein, G. (Eds.), Naturalistic decision making (pp. 257–268). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Coombs, C. H., Dawes, R. M., & Tversky, A. (1970). Mathematical psychology. Englewood Cliffs, NJ: Prentice Hall.Google Scholar
Crandall, B., & Calderwood, R. (1989). Clinical assessment skills of experienced neonatal intensive care nurses (Contract 1 R43 NR0191101 for The National Center for Nursing, NIH). Fairborn, OH: Klein Associates Inc.Google Scholar
Crandall, B. W., Kyne, M., Militello, L., & Klein, G. A. (1992). Describing expertise in one-on-one instruction (Contract MDA903-91-C-0058 for U.S. Army Research Institute, Alexandria, VA). Fairborn, OH: Klein Associates Inc.Google Scholar
Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors, 37, 32–64.CrossRefGoogle Scholar
Ericsson, K. A. (1996). The acquisition of expert performance: An introduction to some of the issues. In Ericsson, K. A. (Ed.), The road to excellence: The acquisition of expert performance in the arts and sciences, sports, and games (pp. 1–50). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Ericsson, K. A., & Charness, N. (1994). Expert performance: Its structure and acquisition. American Psychologist, 49, 725–747.CrossRefGoogle Scholar
Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (2nd ed.). Cambridge, MA: MIT Press.Google Scholar
Fallesen, J. J., & Pounds, J. (2001). Identifying and testing a naturalistic approach for cognitive skills training. In Salas, E. & Klein, G. (Eds.), Linking expertise and naturalistic decision making. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Flin, R., Slaven, G., & Stewart, K. (1996). Emergency decision making in the offshore oil and gas industry. Human Factors, 38, 262–277.CrossRefGoogle Scholar
Glaser, R. (1996). Changing the agency for learning: Acquiring expert performance. In Ericsson, K. A. (Ed.), The road to excellence (pp. 303–311). Mahwah, NJ: Erlbaum.Google Scholar
Hoffman, R. R. (1995). A review of naturalistic decision making research on the critical decision method of knowledge elicitation and the recognition priming model of decision-making, with a focus on implications for military proficiency (Prepared for the University of Nottingham under sponsorship of the Defense Research Agency-Farnborough and Epistemics, Ltd.).
Hoffman, R. R. (Ed.). (2006). Expertise out of context: Proceedings of the Sixth International Conference on Naturalistic Decision Making. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Hoffman, R. R., Crandall, B. W., & Shadbolt, N. R. (1998). Use of the critical decision method to elicit expert knowledge: A case study in cognitive task analysis methodology. Human Factors, 40, 254–276.CrossRefGoogle Scholar
Hutton, R. J. B., Miller, T. E., & Thordsen, M. L. (2003). Decision-centered design: Leveraging cognitive task analysis in design. In Hollnagel, E. (Ed.), Handbook of cognitive task design (pp. 383–416). Mahwah, NJ: Erlbaum.CrossRefGoogle Scholar
Jacobson, M. J., & Spiro, R. J. (1994). A framework for the contextual analysis of technology-based learning environments. Journal of Computing in Higher Education, 5, 3–32.CrossRefGoogle Scholar
Johnston, J., Driskell, J. E., & Salas, E. (1997). Vigilant and hypervigilant decision making. Journal of Applied Psychology, 82, 614–622.CrossRefGoogle ScholarPubMed
Kahneman, D., & Tversky, A. (1972). Subjective probability: A judgment of representativeness. Cognitive Psychology, 3, 430–454.CrossRefGoogle Scholar
Kahneman, D., & Tversky, A. (1982a). On the study of statistical intuitions. Cognition, 11, 123–141.CrossRefGoogle Scholar
Kahneman, D., & Tversky, A. (1982b). On the study of statistical intuitions. In Kahneman, D., Slovic, P., & Tversky, A. (Eds.), Judgment under uncertainty: Heuristics and biases. Cambridge, MA: Cambridge University Press.CrossRefGoogle Scholar
Keller, R. (1987). Expert systems technology: Development and applications. Englewood Cliffs, NJ: Prentice Hall.Google Scholar
Keren, G. (1987). Facing uncertainty in the game of bridge: A calibration study. Organizational Behavior and Human Decision Processes, 39, 98–114.CrossRefGoogle Scholar
Klein, G. (1997). The current status of the naturalistic decision making framework. In Flin, R., Salas, E., Strub, M. E., & Martin, L. (Eds.), Decision making under stress: Emerging themes and applications (pp. 11–28). Aldershot: Ashgate.Google Scholar
Klein, G. (1998). Sources of power: How people make decisions. Cambridge, MA: MIT Press.Google Scholar
Klein, G. (2004). The power of intuition. New York: A Currency Book/Doubleday.Google Scholar
Klein, G., & Wolf, S. (1998). The role of leverage points in option generation. IEEE Transactions on Systems, Man and Cybernetics: Applications and Reviews, 28, 157–160.CrossRefGoogle Scholar
Klein, G., Wolf, S., Militello, L., & Zsambok, C. E. (1995). Characteristics of skilled option generation in chess. Organizational Behavior and Human Decision Processes, 62, 63–69.CrossRefGoogle Scholar
Klein, G. A. (1987). Applications of analogical reasoning. Journal of Metaphor and Symbolic Activity, 2, 201–218.CrossRefGoogle Scholar
Klein, G. A. (1989). Recognition-primed decisions. In Rouse, W. B. (Ed.), Advances in man-machine systems research (Vol. 5, pp. 47–92). Greenwich, CT: JAI Press, Inc. [also published as DTIC No. ADA240659].Google Scholar
Klein, G. A., & Brezovic, C. P. (1986). Design engineers and the design process: Decision strategies and human factors literature. Proceedings of the Human Factors and Ergonomics Society 30th Annual Meeting, 2, 771–775.CrossRefGoogle Scholar
Klein, G. A., Calderwood, R., & Clinton-Cirocco, A. (1986). Rapid decision making on the fireground. Proceedings of the Human Factors and Ergonomics Society 30th Annual Meeting, 1, 576–580.CrossRefGoogle Scholar
Klein, G. A., & Crandall, B. W. (1995). The role of mental simulation in naturalistic decision making. In Hancock, P., Flach, J., Caird, J., & Vicente, K. (Eds.), Local applications of the ecological approach to human-machine systems (Vol. 2, pp. 324–358). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Klein, G. A., & Hoffman, R. (1993). Seeing the invisible: Perceptual/cognitive aspects of expertise. In Rabinowitz, M. (Ed.), Cognitive science foundations of instruction (pp. 203–226). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Klein, G. A., Orasanu, J., Calderwood, R., & Zsambok, C. E. (Eds.). (1993). Decision making in action: Models and methods. Norwood, NJ: Ablex.Google Scholar
Klinger, D. W., & Klein, G. (1999). Emergency response organizations: An accident waiting to happen. Ergonomics In Design, 7, 20–25.CrossRefGoogle Scholar
Kobus, D. A., Proctor, S., Bank, T. E., & Holste, S. T. (2000). Decision-making in a dynamic environment: The effects of experience and information uncertainty (No. 1832). Space and Naval Warfare Systems Center.CrossRefGoogle Scholar
Larkin, J. H. (1983). The role of problem representation in physics. In Gentner, D. & Stevens, A. L. (Eds.), Mental models. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Lave, J., & Wenger, E. (1991). Situation learning-legitimate peripheral participation. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Lipshitz, R. (1993). Converging themes in the study of decision making in realistic settings. In Klein, G. A., Orasanu, J., Calderwood, R., & Zsambok, C. E. (Eds.), Decision making in action: Models and methods (pp. 103–137). Norwood, NJ: Ablex.Google Scholar
Lipshitz, R. (2001). Puzzle seeking and model-building on the fire ground: A discussion of Karl Weick's keynote address. In Salas, E. & Klein, G. (Eds.), Expertise and naturalistic decision making (pp. 337–345). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Lipshitz, R., Klein, G., Orasanu, J., & Salas, E. (2001). Focus article: Taking stock of naturalistic decision making. Journal of Behavioral Decision Making, 14, 331–352.CrossRefGoogle Scholar
Lipshitz, R., & Strauss, O. (1997). Coping with uncertainty: A naturalistic decision making analysis. Organizational Behavior and Human Decision Processes, 66, 149–163.CrossRefGoogle Scholar
Orasanu, J., & Connolly, T. (1993). The reinvention of decision making. In Klein, G. A., Orasanu, J., Calderwood, R., & Zsambok, C. E. (Eds.), Decision making in action: Models and methods (pp. 3–20). Norwood, NJ: Ablex.Google Scholar
Pascual, R., & Henderson, S. (1997). Evidence of naturalistic decision making in military command and control. In Zsambok, C. E. & Klein, G. (Eds.), Naturalistic decision making (pp. 217–226). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Pascual, R. G., Blendell, C., Molloy, J. J., Catchpole, L. J., & Henderson, S. M. (in preparation). An investigation of alternative command planning processes (Defense Education and Research Agency paper prepared for the United Kingdom Ministry of Defence).
Phillips, J. K., Klein, G., & Sieck, W. R. (2004). Expertise in judgment and decision making: A case for training intuitive decision skills. In Koehler, D. J. & Harvey, N. (Eds.), Blackwell handbook of judgment & decision making (pp. 297–315). Victoria, Australia: Blackwell Publishing.CrossRefGoogle Scholar
Pliske, R. M., McCloskey, M. J., & Klein, G. (2001). Decision skills training: Facilitating learning from experience. In Salas, E. & Klein, G. (Eds.), Linking expertise and naturalistic decision making (pp. 37–53). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Randel, J. M., Pugh, H. L., & Reed, S. K. (1996). Differences in expert and novice situation awareness in naturalistic decision making. International Journal of Human-Computer Studies, 45, 579–597.CrossRefGoogle Scholar
Ross, K. G., Battaglia, D. A., Phillips, J. K., Domeshek, E. A., & Lussier, J. W. (2003). Mental models underlying tactical thinking skills. In Proceedings of the Interservice/Industry Training, Simulation, and Education Conference 2003. Arlington, VA: National Training Systems Association.Google Scholar
Ross, K. G., Halterman, J. A., Pierce, L. G., & Ross, W. A. (1998). Preparing for the instructional technology gap: A constructivist approach. Paper presented at the 1998 Interservice/Industry Training, Simulation, and Education Conference, Orlando, FL.
Ross, K. G., Klein, G., Thunholm, P., Schmitt, J. F., & Baxter, H. C. (2004). The recognition-primed decision model. Military Review, ⅬXXIV, 6–10.Google Scholar
Ross, K. G., Lussier, J. W., & Klein, G. (2005). From recognition-primed decision making to decision skills training. In Haberstroh, S. & Betsch, T. (Eds.), Routines of decision making (pp. 327–341). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Ross, K. G., McHugh, A., Moon, B. M., Klein, G., Armstrong, A. A., & Rall, E. (2002). High-level cognitive processes in field research (Year One Final Report under Contract 02TA2-SP1-RT1 for U.S. Army Research Laboratory under Cooperative Agreement DAAD19-01-2-0009). Fairborn, OH: Klein Associates Inc.Google Scholar
Ross, K. G., & Pierce, L. G. (2000). Cognitive engineering of training for adaptive battlefield thinking. In IEA 14th Triennial Congress and HFES 44th Annual Meeting (Vol. 2, pp. 410–413). Santa Monica, CA: Human Factors and Grgononics Society.Google Scholar
Rouse, W. B., & Morris, N. M. (1986). On looking into the black box: Prospects and limits on the search for mental models. Psychological Bulletin, 100, 349–363.CrossRefGoogle Scholar
Schmidt, R. A., & Wulf, G. (1997). Continuous concurrent feedback degrades skill learning: Implications for training and simulation. Human Factors, 39, 509–525.CrossRefGoogle ScholarPubMed
Schmitt, J. F., & Klein, G. (1996). Fighting in the fog: Dealing with battlefield uncertainty. Marine Corps Gazette, 80, 62–69.Google Scholar
Schmitt, J. F., & Klein, G. (1999). How we plan. Marine Corps Gazette, 83(10), 18–26.Google Scholar
Schuler, J. W. (1994). AN/SLQ-32 Operator Training: Development of Performance Assessment Instrument (NPRDC-TN-94-13). San Diego, CA: Navy Personnel Research and Development Center.Google Scholar
Serfaty, D., MacMillan, J., Entin, E. E., & Entin, E. B. (1997). The decision-making expertise of battle commanders. In Zsambok, C. E. & Klein, G. (Eds.), Naturalistic decision making (pp. 233–246). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Shanteau, J. (1989). Cognitive heuristics and biases in behavioral auditing: Review, comments, and observations. Accounting Organizations and Society, 14, 165–177.CrossRefGoogle Scholar
Simon, H. A. (1957). Models of man: Social and rational. New York: John Wiley & Sons, Inc.Google Scholar
Smith, J. F., & Kida, T. (1991). Heuristics and biases: Expertise and task realism in auditing. Psychological Bulletin, 109, 472–489.CrossRefGoogle Scholar
Stanard, T., Uehara, M. A., & Hutton, R. J. B. (2003). Decision-centered design: Principles & processes (Year one Report prepared through participation in the Advanced Decision Architectures Collaborative Technology Alliance [Contract #02TA1-SP3-RT2] sponsored by the U.S. Army Research Laboratory under Cooperative Agreement DAAD19-01-2-0009). Fairborn, OH: Klein Associates Inc.
Suchman, L. A. (1987). Plans and situated actions: The problem of human-machine communication. Cambridge, England: Cambridge University Press.Google Scholar
Thunholm, P. (in press). Military decision making under time-pressure: To evaluate or not to evaluate three options before the decision is made? Organizational Behavior and Human Decision Processes.Google Scholar
Tversky, A., & Kahneman, D. (1982). Causal schemas in judgments under uncertainty. In Kahneman, D., Slovic, P., & Tversky, A. (Eds.), Judgment under uncertainty: Heuristics and biases. Cambridge, MA: Cambridge University Press.CrossRefGoogle Scholar
U.S. Army. (2003). Field Manual 6-0, Mission command: The command and control of army forces. Washington, DC: U.S. Army.
Army, U. S.. (1997). Field Manual 101-5, Staff organization and operations. Washington, DC: Department of the Army.Google Scholar
U.S. Marine Corps. (2001). MCWP 5-1, Marine Corps planning process. Quantico, VA: U.S. Marine Corps.
Waterman, D. A. (1986). A guide to expert systems. Reading, MA: Addison-Wesley.Google Scholar
Weiss, S., & Kulikowski, C. (1984). A practical guide to designing expert systems. Totowa, NJ: Rowman and Allanheld.Google Scholar
Winograd, T., & Flores, F. (1986). Understanding computers and cognition: A new foundation for design. Norwood, NJ: Ablex.Google Scholar
Zsambok, C. E. (1997). Naturalistic decision making: Where are we now? In Zsambok, C. E. & Klein, G. (Eds.), Naturalistic decision making (pp. 3–16). Mahwah, NJ: Erlbaum.Google Scholar
Zsambok, C. E., Klein, G., Kyne, M. M., & Klinger, D. W. (1992). Advanced team decision making: A developmental model (Contract MDA903-90-C-0117 for U.S. Army Research Institute for the Behavioral and Social Sciences). Fairborn, OH: Klein Associates Inc. [also published as DTIC No. 259512, http://www.dtic.mil].

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×