Skip to main content
SpringerLink
Log in

Cognitive Engineering and Information Displays

  • Reference work entry
  • First Online:
Handbook of Visual Display Technology

  • 309 Accesses

Abstract

While the intention behind the use of information displays may be the inducement of different forms of perception, high-level cognitive processes are always engaged when viewing information displays. Cognitive Engineering, which involves the meaning of display content, should be considered when designing display systems. In this chapter, we present an overview of human reasoning and decision making, which we believe is most relevant to the future of information display design including wearable displays. In this perspective, we discuss how displays may be categorized to interface either with the analytical reasoning system via content involving symbology or with the intuitive reasoning system that may require some level of immersion and more advanced levels of display hardware to achieve cognitive engineering.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 1,399.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 1,999.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Ackerman PL (1988) Determinants of individual differences during skill acquisition: cognitive abilities and information processing. J Exp Psychol Gen 117:288–318

    Article  Google Scholar 

  • Awh E, Vogel EK, Oh S-H (2006) Interactions between attention and working memory. Neuroscience 139:201–208

    Article  Google Scholar 

  • Baddeley AD (1986) Working memory. Oxford University Press, New York

    Google Scholar 

  • Baddeley AD (2003) Working memory: looking back and looking forward. Nat Rev Neurosci 4:829–839

    Article  Google Scholar 

  • Baddeley AD, Hitch GJ (1974) Working memory. In: Bower GH (ed) The psychology of learning and motivation: advances in research and theory, vol 8. Academic, New York, pp 47–89

    Google Scholar 

  • Baddeley AD, Logie RH (1999) Working memory: the multi-component model. In: Miyake A, Shah P (eds) Models of working memory: mechanisms of active maintenance and executive control. Cambridge University Press, New York, pp 28–61

    Chapter  Google Scholar 

  • Biederman I (1972) Perceiving real-world scenes. Science 177:77–80

    Article  Google Scholar 

  • Biederman I (1981) On the semantics of a glance at a scene. In: Kubovy M, Pomerantz JR (eds) Perceptual organization. Erlbaum, Hillsdale, pp 213–253

    Google Scholar 

  • Biederman I, Glass AL, Stacy EW (1973) Searching for objects in real-world scenes. J Exp Psychol 97:22–27

    Article  Google Scholar 

  • Biocca F (1997) The cyborg’s dilemma: embodiment in virtual environments. J Comput Mediat Commun. http://jcmc.indiana.edu/vol3/issue2/biocca2.html

  • Biocca F, Rolland JP (1998) Virtual eyes can rearrange your body: adaptation to virtual eye location in see-thru head-mounted displays. Presence Teleoperators Virtual Environ (MIT Press) 7(3):262–277

    Article  Google Scholar 

  • Cakmakci O, Rolland JP (2006) Head-worn displays: a review. IEEE/OSA J Disp Technol 2(3):199–216

    Article  Google Scholar 

  • Chalmers DJ, French RM, Hofstadter DR (1992) High-level perception, representation, and analogy: a critique of artificial intelligence methodology. J Exp Theor Artif Intell 4:185–211

    Article  Google Scholar 

  • Chase WG, Simon HA (1973) Perception in chess. Cogn Psychol 4:55–81

    Article  Google Scholar 

  • Cowan N (1995) Attention and memory: an integrated framework. Oxford University Press, New York

    Google Scholar 

  • Cowan N (1999) An embedded-process model of working memory. In: Miyake A, Shah P (eds) Models of working memory: mechanisms of active maintenance and executive control. Cambridge University Press, New York, pp 62–101

    Chapter  Google Scholar 

  • Cowan N (2000) The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav Brain Sci 24:87–185

    Article  Google Scholar 

  • de Groot AD (1965) Thought and choice in chess. Mouton, The Hague

    Google Scholar 

  • Egeth HE, Yantis S (1997) Visual attention: control, representation, and time course. Annu Rev Psychol 48:269–297

    Article  Google Scholar 

  • Engle RW, Kane MJ, Tuholski SW (1999) Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. In: Miyake A, Shah P (eds) Models of working memory: mechanisms of active maintenance and executive control. Cambridge University Press, New York, pp 102–134

    Chapter  Google Scholar 

  • Enns JT, Rensink RA (1990) Influence of scene-based properties on visual search. Science 247:721–723

    Article  Google Scholar 

  • Evans JSBT (1984) Heuristic and analytic processes in reasoning. Br J Psychol 75:451–468

    Article  Google Scholar 

  • Evans JSBT (2003) In two minds: dual-process accounts of reasoning. Trends Cogn Sci 17:454–459

    Article  Google Scholar 

  • Evans JSBT (2008) Dual-processing accounts of reasoning, judgment and social cognition. Annu Rev Psychol 59:255–278

    Article  Google Scholar 

  • Fidopiastis CM, Fuhrman C, Meyer C, Rolland JP (2005) Methodology for iterative evaluation of prototype head-mounted displays in virtual environments: visual metrics. Presence SI Immers Proj Technol 14(5):550–562

    Google Scholar 

  • Fidopiastis CM, Stapleton CB, Whiteside JD, Hughes CE, Fiore SM, Martin GA, Rolland JP, Smith EM (2006) Human experience modeler: context-driven cognitive retraining to facilitate transfer of learning. Cyberpsychol Behav 9(2):183–187

    Article  Google Scholar 

  • Gernsbacher MA (1985) Surface information loss in comprehension. Cogn Psychol 17:324–363

    Article  Google Scholar 

  • Gick ML, Holyoak KJ (1980) Analogical problem solving. Cogn Psychol 12:306–355

    Article  Google Scholar 

  • Gick ML, Holyoak KJ (1983) Schema induction and analogical reasoning. Cogn Psychol 15:1–38

    Article  Google Scholar 

  • Grill-Spector K, Kanwisher N (2005) Visual recognition: as soon as you know it is there, you know what it is. Psychol Sci 16:152–160

    Article  Google Scholar 

  • Ha Y, Rolland JP (2002) Optical Assessment of Head-Mounted Displays in Visual Space. Appl Optics 41(25):5282–5289

    Article  Google Scholar 

  • Hammond KR (2007) Beyond rationality: the search for wisdom in a troubled time. Oxford University Press, New York

    Google Scholar 

  • Hoffman RR, Eskridge T, Shelley C (2009) A naturalistic exploration of forms and functions of analogizing. Metaphor Symbol 24:125–154

    Article  Google Scholar 

  • Hogarth R (2001) Educating intuition. University of Chicago Press, Chicago

    Google Scholar 

  • Hogarth R (2002) Deciding analytically or trusting your intuition? The advantages and disadvantages of analytic and intuitive thought. Universitat Pompeu Fabra, Barcelona (UPF economics and business working paper no 654) – faculty of economic and business sciences

    Google Scholar 

  • Holland JH, Holyoak KJ, Nisbett RE, Thagard P (1986) Induction: processes of inference, learning, and discovery. MIT Press, Cambridge, MA

    Google Scholar 

  • Holyoak KJ, Gentner D, Kokinov BN (2001) Introduction: the place of analogy in cognition. In: Gentner D, Holyoak KJ, Kokinov BN (eds) The analogical mind: perspectives from cognitive science. MIT Press, Cambridge, MA, pp 1–20

    Google Scholar 

  • Hua H, Krishnaswamy P, Rolland JP (2006) Video-based eyetracking methods and algorithms in head-mounted displays. Opt Express 14(10):4328–4350

    Article  Google Scholar 

  • Hua H, Pansing CW, Rolland JP (2007) Modeling of an eye-imaging system for optimizing illumination schemes in an eye-tracked head-mounted display. Appl Opt 46(31):7757–7770

    Article  Google Scholar 

  • Juthe A (2005) Argument by analogy. Argumentation 19:1–27

    Article  Google Scholar 

  • Kahneman D, Frederick S (2002) Representativeness revisited: attribute substitution in intuitive judgment. In: Gilovich T, Griffin D, Kahneman D (eds) Heuristics and biases: the psychology of intuitive judgment. Cambridge University Press, New York, pp 49–81

    Chapter  Google Scholar 

  • Kane MJ, Engle RW (2003) Working-memory capacity and the control of attention: the contributions of goal neglect, response competition, and task set to Stroop interference. J Exp Psychol Gen 132:47–70

    Article  Google Scholar 

  • Kane MJ, Conway ARA, Hambrick DZ, Engle RW (2008) Variation in working memory capacity as variation in executive attention and control. In: Conway ARA, Jarrold C, Kane MJ, Miyake A, Towse JN (eds) Variation in working memory. Oxford University Press, New York, pp 21–48

    Chapter  Google Scholar 

  • Klein G (1987) Applications of analogical reasoning. Metaphor Symbolic Activ 2:201–218

    Article  Google Scholar 

  • Klein G (1998) Sources of power: how people make decisions. MIT Press, Cambridge, MA

    Google Scholar 

  • Klein G (2008) Naturalistic decision making. Hum Factors 50:456–460

    Article  Google Scholar 

  • Lopes LL, Oden GC (1991) The rationality of intelligence. In: Eells E, Maruszewski T (eds) Probability and rationality: studies of L. Jonathan Cohen’s philosophy of science. Rodopi, Amsterdam, pp 199–223

    Google Scholar 

  • Mack A, Rock I (1998) Inattentional blindness. MIT Press, Cambridge, MA

    Google Scholar 

  • Mandler JM, Ritchey GH (1977) Long-term memory for pictures. J Exp Psychol Hum Learn Mem 3:386–396

    Article  Google Scholar 

  • Markman AB, Moreau CP (2001) Analogy and analogical comparison in choice. In: Gentner D, Holyoak KJ, Kokinov BN (eds) The analogical mind: perspectives from cognitive science. MIT Press, Cambridge, MA, pp 363–400

    Google Scholar 

  • Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 63:81–97

    Article  Google Scholar 

  • Miyake A, Shah P (1999) Emerging consensus, unresolved issues, future directions. In: Miyake A, Shah P (eds) Models of working memory: mechanisms of active maintenance and executive control. Cambridge University Press, New York, pp 442–482

    Chapter  Google Scholar 

  • Neisser U, Becklen R (1975) Selective looking: attending to visually specified events. Cogn Psychol 7:480–494

    Article  Google Scholar 

  • Oliva A, Torralba A (2006) Building the gist of a scene: the role of global image features in recognition. Prog Brain Res Vis Percept 155:23–36

    Article  Google Scholar 

  • Patterson R (2009) Human factors of stereoscopic displays. J Soc Inf Disp 17:987–996

    Article  Google Scholar 

  • Patterson R, Silzars A (2009) Immersive stereo displays, intuitive reasoning, and cognitive engineering. J Soc Inf Disp 17:443–448

    Article  Google Scholar 

  • Patterson RE (2015) Human Factors of Stereoscopic 3D Displays. London, UK: Springer

    Book  Google Scholar 

  • Patterson R, Pierce BP, Bell H, Andrews D, Winterbottom M (2009) Training robust decision making in immersive environments. J Cogn Eng Decis Mak 3:331–361

    Article  Google Scholar 

  • Patterson R, Pierce B, Bell H, Klein G (2010) Implicit learning, expertise development, and naturalistic decision making. J Cogn Eng Decis Mak 4:289–303

    Article  Google Scholar 

  • Pedone R, Hummel JE, Holyoak K (2001) The use of diagrams in analogical problem solving. Mem Cogn 29:214–221

    Article  Google Scholar 

  • Rolland JP, Fuchs H (2000) Optical versus video see-through head-mounted displays in medical visualization. Presence Teleoperators Virtual Environ (MIT Press) 9(3):287–309

    Article  Google Scholar 

  • Rolland JP, Ariely D, Gibson W (1995) Towards quantifying depth and size perception in virtual environments. Presence Teleoperators Virtual Environ (MIT Press) 4(1):24–49

    Article  Google Scholar 

  • Rolland JP, Krueger M, Goon A (2000) Multi-focal planes in head-mounted displays. Appl Opt 39(19):3209–3215

    Article  Google Scholar 

  • Rolland JP, Meyer C, Arthur K, Rinalducci E (2002) Methods of adjustments versus method of constant stimuli in the quantification of accuracy and precision of rendered depth in head-mounted displays. Presence Teleoperators Virtual Environ 11(6):610–625

    Article  Google Scholar 

  • Rolland JP, Ha Y, Fidopiastis C (2004) Albertian errors in head-mounted displays: I. Choice of eye-points location for a near- or far-field task visualization. J Opt Soc Am A 21(6):901–912

    Article  Google Scholar 

  • Schneider W, Shiffrin RM (1977) Controlled and automatic human information processing: I. Detection, search, and attention. Psychol Rev 84:1–42

    Article  Google Scholar 

  • Simons DJ (2000) Attentional capture and inattentional blindness. Trends Cogn Sci 4:147–155

    Article  Google Scholar 

  • Sloman SA (1996) The empirical case for two systems of reasoning. Psychol Bull 119:3–22

    Article  Google Scholar 

  • Thorpe S, Fize D, Marlot C (1996) Speed of processing in the human visual system. Nature 381:520–522

    Article  Google Scholar 

  • Treisman A, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12:97–136

    Article  Google Scholar 

  • Vaissie L, Rolland JP (2002) Eye-tracking integration in head-mounted displays. US patent 6,433,760 B1, 13 Aug 2002

    Google Scholar 

  • Weisstein N, Harris CS (1974) Visual detection of line segments: an object-superiority effect. Science 186:752–755

    Article  Google Scholar 

  • Weisstein N, Williams MC, Harris CS (1982) Depth, connectedness, and structural relevance in the object-superiority effect: line segments are harder to see in flatter patterns. Perception 11(1):5–17

    Article  Google Scholar 

  • Wolfe JM (1994) Guided search 2.0: a revised model of visual search. Psychon Bull Rev 1:202–238

    Article  Google Scholar 

  • Wolfe JM, Horowitz TS (2004) What attributes guide the deployment of visual attention and how do they do it? Nat Rev Neurosci 5:1–7

    Article  Google Scholar 

  • Wolfe JM, Horowitz TS, Kenner N (2005) Rare items often missed in visual searches. Nature 435:439–440

    Article  Google Scholar 

  • Yeh Y, Silverstein L (1990) Limits of fusion and depth judgments in stereoscopic color displays. Hum Factors 32:45–53

    Article  Google Scholar 

  • Zsambok CE, Klein G (1997) Naturalistic decision making. Erlbaum, Mahwah

    Google Scholar 

Further Reading

  • Beveridge M, Parkins E (1987) Visual representation in analogical problem solving. Mem Cogn 15:230–237

    Article  Google Scholar 

  • Biederman I, Mezzanotte RJ, Rabinowitz JC (1982) Scene perception: detecting and judging objects undergoing relational violations. Cogn Psychol 14:143–177

    Article  Google Scholar 

  • Fidopiastis C (2008) User-centered virtual environment assessment and design for cognitive rehabilitation applications. PhD thesis, University of Central Florida

    Google Scholar 

  • Robinett W, Rolland JP (1992) A computational model for the stereoscopic optics of a head-mounted display. Presence Teleoperators Virtual Environ (MIT Press) 1(1):45–62

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Air Force Research Laboratory, Wright-Patterson AFB, OH, USA

    Robert Earl Patterson

  2. University of Rochester, Rochester, NY, USA

    Jannick P. Rolland

Authors
  1. Robert Earl Patterson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jannick P. Rolland
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Robert Earl Patterson .

Editor information

Editors and Affiliations

  1. Display Technology Center, Panel Integration Division I, Industrial Technology Research Institute (ITRI), Chutung, Hsinchu, Taiwan

    Janglin Chen

  2. Sheffield Hallam University, Sheffield, United Kingdom

    Wayne Cranton

  3. Veritas et Visus, Temple, Texas, USA

    Mark Fihn

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this entry

Cite this entry

Patterson, R.E., Rolland, J.P. (2016). Cognitive Engineering and Information Displays. In: Chen, J., Cranton, W., Fihn, M. (eds) Handbook of Visual Display Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-14346-0_141

Download citation

Publish with us

Policies and ethics

Search

Navigation