Abstract
This meta-analysis integrates 296 effect sizes reported in eye-tracking research on expertise differences in the comprehension of visualizations. Three theories were evaluated: Ericsson and Kintsch’s (Psychol Rev 102:211–245, 1995) theory of long-term working memory, Haider and Frensch’s (J Exp Psychol Learn Mem Cognit 25:172–190, 1999) information-reduction hypothesis, and the holistic model of image perception of Kundel et al. (Radiology 242:396–402, 2007). Eye movement and performance data were cumulated from 819 experts, 187 intermediates, and 893 novices. In support of the evaluated theories, experts, when compared with non-experts, had shorter fixation durations, more fixations on task-relevant areas, and fewer fixations on task-redundant areas; experts also had longer saccades and shorter times to first fixate relevant information, owing to superiority in parafoveal processing and selective attention allocation. Eye movements, reaction time, and performance accuracy were moderated by characteristics of visualization (dynamics, realism, dimensionality, modality, and text annotation), task (complexity, time-on-task, and task control), and domain (sports, medicine, transportation, other). These findings are discussed in terms of their implications for theories of visual expertise in professional domains and their significance for the design of learning environments.
Similar content being viewed by others
Notes
Early research on chess masters (Chase and Simon 1973; Jongman 1968 as cited in de Groot and Gobet 1996, Chapter 4) already indicated that extended memory capacities allow experts to recognize more and larger perceptual chunks than novices. These researchers also introduced the idea that chunking at least partly involves recognition (“revisualization”; Jongman 1968) of visual material in long-term memory. Perceptual chunking now constitutes an important perceptual learning mechanism (cf. the concept of unitization, Goldstone 1998).
By visualization, we mean all kinds of pictorial representations of information, including (but not limited to) pictures, graphs, diagrams, concept maps, video films, animations, and simulations.
References
*Abernethy, B. (1990). Expertise, visual search, and information pick-up in squash. Perception, 19, 63–77.
*Abernethy, B., & Russel, D. G. (1987). The relationship between expertise and visual search strategy in a racquet sport. Human Movement Science, 6, 283–319.
*Amadieu, F., Van Gog, T., Paas, F., Tricot, A., & Mariné, C. (2009). Effects of prior knowledge and concept-map structure on disorientation, cognitive load, and learning. Learning and Instruction, 19, 376–386.
*Augustyniak, P., & Tadeusiewicz, R. (2006). Assessment of electrocardiogram visual interpretation strategy based on scanpath analysis. Physiological Measurement, 27, 597–608.
*Bard, C., & Fleury, M. (1976). Analysis of visual search activity during sport problem situations. Journal of Human Movement Studies, 3, 214–222.
*Bard, C., Fleury, M., Carrière, L., & Hallé, M. (1980). Analysis of gymnastics judges’ visual search. Research Quarterly for Exercise and Sport, 51, 267–273.
Barrouillet, P., & Camos, V. (2007). The time-based resource-sharing model of working memory. In N. Osaka, R. H. Logie, & D. E. Mark (Eds.), The cognitive neuroscience of working memory (pp. 57–80). Oxford: Oxford University Press.
Beal, D. J., Corey, D. M., & Dunlap, W. P. (2002). On the bias of Huffcutt and Arthur’s (1995) procedure for identifying outliers in meta-analysis of correlations. Journal of Applied Psychology, 87, 583–589.
*Bednarik, R., & Tukiainen, M. (2007). Validating the restricted focus viewer: A study using eye-movement tracking. Behavior Research Methods, 39, 274–282.
Bellenkes, A. H., Wickens, C. D., & Kramer, A. F. (1997). Visual scanning and pilot expertise: The role of attentional flexibility and mental model development. Aviation, Space and Environmental Medicine, 48, 569–579.
*Bertrand, C., & Thullier, F. (2009). Effects of player position task complexity in visual exploration behavior in soccer. International Journal of Sport Psychology, 40, 306–323.
Billett, S. (2009). Personal epistemologies, work, and learning. Educational Research Review, 4, 210–219.
Butcher, K. R. (2006). Learning from text with diagrams: Promoting mental model development and inference generation. Journal of Educational Psychology, 98, 182–197.
Campbell, D. J. (1986). Task complexity: A review and analysis. Academy of Management Review, 13, 40–52.
*Cauraugh, J. H., Singer, R. N., & Chen, D. (1993). Visual scanning and anticipation of expert and beginning tennis players. In S. Serpa (Ed.), Proceedings of the World Congress of Sport Psychology (pp. 336–340). Lisbon: International Society of Sport Psychology.
*Chapman, P. R., & Underwood, G. (1998). Visual search of driving situations: Danger and experience. Perception, 27, 951–964.
*Chapman, P. R., & Underwood, G. (1999). Visual search of dynamic scenes: Event types and the role of experience in viewing driving situations. In G. Underwood (Ed.), Eye guidance in reading and scene perception (pp. 369–393). Amsterdam: Elsevier.
*Charness, N., Reingold, E. M., Pomplun, M., & Stampe, D. M. (2001). The perceptual aspect of skilled performance in chess: Evidence from eye movements. Memory & Cognition, 29, 1146–1152.
Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4, 55–81.
Chi, M. T. H. (2006). Two approaches to the study of experts’ characteristics. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 21–30). Cambridge: Cambridge University Press.
*Cooper, L., Gale, A., Darker, I., Toms, A., & Saada, J. (2009). Radiology image perception and observer performance: How does expertise and clinical information alter interpretation? Stroke detection explored through eye-tracking. In B. Sahiner & D. J. Manning (Eds.), Medical Imaging 2009: Image perception, observer performance, and technology assessment Vol. 7263 (pp. 72630K–72630K-12). Bellingham: SPIE.
*Cooper, L., Gale, A., Saada, J., Gedela, S., Scott, H., & Toms, A. (2010). The assessment of stroke multidimensional CT and MR imaging using eye movement analysis: Does modality preference enhance observer performance? In D. J. Manning & C. K. Abbey (Eds.), Medical Imaging 2010: Image perception, observer performance, and technology assessment Vol. 7627 (pp. 76270B–76270B-12). Bellingham: SPIE.
Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87–185.
*Crundall, D., Underwood, G., & Chapman, P. (1999). Driving experience and the functional field of view. Perception, 28, 1075–1087.
*Crundall, D., Chapman, P., Phelps, N., & Underwood, G. (2003). Eye movements and hazard perception in police pursuit and emergency response driving. Journal of Experimental Psychology: Applied, 9, 163–174.
*Crundall, D., Chapman, P., France, E., Underwood, G., & Phelps, N. (2005). What attracts attention during police pursuit driving? Applied Cognitive Psychology, 19, 409–420.
*de Groot, A. D., & Gobet, F. (1996). Perception and memory in chess. Heuristics of the professional eye. Assen: Van Gorcum.
Dwyer, F. M., & Joseph, J. (1984). The effects of prior knowledge, presentation mode, and visual realism on student achievement. Journal of Experimental Education, 52, 110–121.
*Dyer, A. G., Found, B., & Rogers, D. (2006). Visual attention and expertise for forensic signature analysis. Journal of Forensic Sciences, 51, 1397–1404.
Eilam, B., & Poyas, Y. (2008). Learning with multiple representations: Extending multimedia learning beyond the lab. Learning and Instruction, 18, 368–378.
Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211–245.
Ericsson, K. A., & Lehmann, A. C. (1996). Expert and exceptional performance: Evidence of maximal adaptations to task constraints. Annual Review of Psychology, 47, 273–305.
Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.). (2006). Cambridge handbook of expertise and expert performance. Cambridge: Cambridge University Press.
Feltovich, P. J., Prietula, M. J., & Ericsson, K. A. (2006). Studies of expertise from psychological perspectives. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 41–67). Cambridge: Cambridge University Press.
Gibson, J. J. (1986). The ecological approach to visual perception. New York: Psychology.
Ginns, P. (2005). Meta-analysis of the modality effect. Learning and Instruction, 15, 313–331.
Gnaur, D. (2010). Seizing workplace learning affordances in high-pressure work environments. Vocations and Learning, 3, 223–238.
Goldstone, R. L. (1998). Perceptual learning. Annual Review of Psychology, 49, 585–612.
*Goulet, C., Bard, C., & Fleury, M. (1989). Expertise differences in preparing to return a tennis serve: A visual information processing approach. Journal of Sport & Exercise Psychology, 11, 382–398.
Grant, E. R., & Spivey, M. J. (2003). Eye movements and problem solving: Guiding attention guides thought. Psychological Science, 14, 462–466.
Haider, H., & Frensch, P. A. (1999). Eye movement during skill acquisition: More evidence for the information reduction hypothesis. Journal of Experimental Psychology: Learning, Memory, & Cognition, 25, 172–190.
Hall, S. M., & Brannick, M. T. (2002). Comparison of two random effects methods of meta-analysis. Journal of Applied Psychology, 87, 377–389.
*Helsen, W., & Pauwels, J. M. (1990). Analysis of visual search activity in solving tactical game problems. In D. Brogan (Ed.), Visual search (pp. 177–184). London: Taylor & Francis.
*Helsen, W., & Pauwels, J. M. (1992). A cognitive approach to visual search in sport. In D. Brogan (Ed.), Visual search 2 (pp. 379–388). London: Taylor & Francis.
*Helsen, W., & Starkes, J. L. (1999). A multidimensional approach to skilled perception and performance in sport. Applied Cognitive Psychology, 13, 1–27.
Henderson, A. J., Alexander, H., Haywood, A., Stapleton, P., Cooke, M., Patterson, E., et al. (2010). Promoting and providing expert guidance in work-intensive clinical settings. Vocations and Learning, 3, 141–156.
*Hermans, O. & Laarni, J. (2003). Searching information from screen maps. Paper presented at the 9th Scandinavian Research Conference on Geographical Information Science, Espoo.
Hidi, S. (2006). Interest: A unique motivational variable. Educational Research Review, 1, 69–82.
*Huestegge, L., Skottke, E.-M., Anders, S., Müsseler, J., & Debus, G. (2010). The development of hazard perception: Dissociation of visual orientation and hazard processing. Transportation Research Part F: Traffic Psychology and Behaviour, 13, 1–8.
Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks: Sage.
Hyönä, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20, 172–176.
*Jarodzka, H., Scheiter, K., Gerjets, P., & Van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20, 146–154.
Just, M. A., & Carpenter, P. A. (1984). Using eye fixations to study reading comprehension. In D. E. Kieras & M. A. Just (Eds.), New methods in reading comprehension research (pp. 151–182). Hillsdale: Erlbaum.
Kalyuga, S. (2007). Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review, 19, 509–539.
Kalyuga, S. (2008). Relative effectiveness of animated and static diagrams: An effect of learner prior knowledge. Computers in Human Behavior, 24, 852–861.
Kalyuga, S., Chandler, P., & Sweller, J. (2000). Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology, 92, 1–11.
*Kasarskis, P., Stehwien, J., Hickox, J., & Aretz, A. (2001). Comparison of expert and novice scan behaviors during FR flight. Paper presented at the 11th International Symposium on Aviation Psychology, Columbus, OH.
*Kato, T., & Fukuda, T. (2002). Visual search strategies of baseball batters: Eye movements during the preparatory phase of batting. Perceptual and Motor Skills, 94, 380–386.
*Konstantopoulos, P. (2009). Investigating drivers’ visual search strategies: Towards an efficient training intervention. Unpublished doctoral thesis, University of Nottingham, Nottingham, England.
*Kristjanson, A. F., & Antes, J. R. (1989). Eye movement analysis of artists and nonartists viewing paintings. Visual Arts Research, 15, 21–30.
*Krupinski, E. A. (2005). Visual search of mammographic images: Influence of lesion subtlety. Academic Radiology, 12, 965–969.
Krupinski, E. A. (2010). Current perspectives in medical image perception. Attention, Perception, & Psychophysics, 72, 1205–1217.
*Krupinski, E. A., Tillack, A. A., Richter, L., Henderson, J. T., Bhattacharyya, A. K., Scott, K. M., et al. (2006). Eye-movement study and human performance using telepathology virtual slides. Implications for medical education and differences with experience. Human Pathology, 37, 1543–1556.
Kuhn, D. (2009). Do students need to be taught how to reason? Educational Research Review, 4, 1–6.
*Kundel, H. L., Nodine, C. F., Conant, E. F., & Weinstein, S. P. (2007). Holistic component of image perception in mammogram interpretation: Gaze-tracking study. Radiology, 242, 396–402.
*Laurent, E., Ward, P., Williams, A. M., & Ripoll, H. (2006). Expertise in basketball modifies perceptual discrimination abilities, underlying cognitive processes, and visual behaviours. Visual Cognition, 13, 247–271.
Lesgold, A., Rubinson, H., Feltovich, P., Glaser, R., Klopfer, D., & Wang, Y. (1988). Expertise in a complex domain: Diagnosing X-ray pictures. In M. T. H. Chi, R. Glaser, & M. J. Farr (Eds.), The nature of expertise (pp. 311–342). Hillsdale: Erlbaum.
*Litchfield, D., Ball, L. J., Donovan, T., Manning, D. J., & Crawford, T. (2008). Learning from others: Effects of viewing another person’s eye movements while searching for chest nodules. In B. Sahiner & D. J. Manning (Eds.), Medical Imaging 2008: Image perception, observer performance, and technology assessment Vol. 6917 (pp. 691715–691715-9). Bellingham: SPIE.
*Liu X., Gale A. G., & Song, T. (2007). Detection of terrorist threats in air passenger luggage: Expertise development. Paper presented at the 41st Annual IEEE International Carnahan Conference, Ottawa.
Mann, D. T. Y., Williams, A. M., Ward, P., & Janelle, C. M. (2007). Perceptual-cognitive expertise in sport: A meta-analysis. Journal of Sport & Exercise Psychology, 29, 457–478.
*Manning, D., Ethell, S., Donovan, T., & Crawford, T. (2006). How do radiologists do it? The influence of experience and training on searching for chest nodules. Radiography, 12, 134–142.
Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.
Mayer, R. E., & Gallini, J. K. (1990). When is an illustration worth ten thousand words? Journal of Educational Psychology, 82, 715–726.
Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43–52.
*McRobert, A. P., Williams, A. M., Ward, P., & Eccles, D. W. (2009). Tracing the process of expertise in a simulated anticipation task. Ergonomics, 52, 474–483.
Meltzoff, A. N., Brooks, R., Shon, A. P., & Rao, R. P. N. (2010). “Social” robots are psychological agents for infants: A test of gaze following. Neural Networks, 23, 966–972.
Miller, G. (1956). The magical number seven, plus or minus two: Some limits on our capacity for information processing. Psychological Review, 63, 81–97.
*Moran, A., Byrne, A., & McGlade, N. (2002). The effects of anxiety and strategic planning on visual search behaviour. Journal of Sports Sciences, 20, 225–236.
Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91, 358–368.
*Moreno, F. J., Reina, R., Luis, V., & Sabido, R. (2002). Visual search strategies in experienced and inexperienced gymnastic coaches. Perceptual and Motor Skills, 95, 901–902.
*Moreno, F. J., Saavedra, J. M., Sabido, R., Luis, V., & Reina, R. (2006). Visual search strategies of experienced and nonexperienced swimming coaches. Perceptual and Motor Skills, 103, 861–872.
Nalanagula, D., Greenstein, J. S., & Gramopadhye, A. K. (2006). Evaluation of the effect of feedforward training displays of search strategy on visual search performance. International Journal of Industrial Ergonomics, 36, 289–300.
National Research Council (1992). Combining information: Statistical issues and opportunities for research. Washington, DC: National Academy of Sciences.
*Nodine, C. F., Kundel, H. L., Lauver, S. C., & Toto, L. C. (1996). Nature of expertise in searching mammograms for breast masses. Academic Radiology, 3, 1000–1006.
*Nodine, C. F., Mello-Thoms, C., Kundel, H. R., & Weinstein, S. P. (2002). Time course of perception and decision making during mammographic interpretation. American Journal of Roentgenology, 179, 917–923.
*North, J. S., Williams, A. M., Hodges, N., Ward, P., & Ericsson, K. A. (2009). Perceiving patterns in dynamic action sequences: Investigating the processes underpinning stimulus recognition and anticipation skill. Applied Cognitive Psychology, 23, 878–894.
Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38, 1–4.
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (2003). Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities. Computers in Human Behavior, 19, 221–243.
Powers, W. T. (2005). Behavior: The control of perception. New Canaan: Benchmark.
*Raab, M., & Johnson, J. G. (2007). Expertise-based differences in search and option-generation strategies. Journal of Experimental Psychology: Applied, 13, 158–170.
*Reingold, E. M., Charness, N., Pomplun, M., & Stampe, D. M. (2001). Visual span in expert chess players. Psychological Science, 12, 48–55.
*Ripoll, H., Kerlirzin, Y., Stein, J.-F., & Reine, B. (1993). Decision making and visual strategies of boxers in a simulated problem-solving situation. In G. d’Ydewalle & J. Van Rensbergen (Eds.), Perception and cognition: Advances in eye-movement research (pp. 141–147). Amsterdam: North-Holland.
*Ripoll, H., Kerlirzin, Y., Stein, J.-F., & Reine, B. (1995). Analysis of information processing, decision making, and visual strategies in complex problem solving sport situations. Human Movement Science, 14, 325–349.
Rosenthal, R., & DiMatteo, M. R. (2001). Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59–82.
*Savelsbergh, G. J. P., Williams, A. M., Van der Kamp, J., & Ward, P. (2002). Visual search, anticipation and expertise in soccer goalkeepers. Journal of Sports Sciences, 20, 279–287.
*Savelsbergh, G. J. P., Van der Kamp, J., Williams, A. M., & Ward, P. (2005). Anticipation and visual search behaviour in expert soccer goalkeepers. Ergonomics, 48, 1686–1697.
Scheiter, K., Gerjets, P., Huk, T., Imhof, B., & Kammerer, Y. (2009). The effects of realism in learning with dynamic visualizations. Learning and Instruction, 19, 481–494.
Schmidt, F. L., Oh, I.-S., & Hayes, T. L. (2009). Fixed- versus random-effects models in meta-analysis: Model properties and an empirical comparison of differences in results. British Journal of Mathematical and Statistical Psychology, 62, 97–128.
*Schriver, A. T., Morrow, D. G., Wickens, C. D., & Talleur, D. A. (2008). Expertise differences in attentional strategies related to pilot decision making. Human Factors, 50, 864–878.
*Singer, R. N., Cauraugh, J. H., Chen, D., Steinberg, G. M., & Frehlich, S. G. (1996). Visual search, anticipation, and reactive comparisons between highly-skilled and beginning tennis players. Journal of Applied Sport Psychology, 8, 9–26.
Spanjers, I. A. E., Van Gog, T., & Van Merriënboer, J. J. G. (2010). A theoretical analysis of how segmentation of dynamic visualizations optimizes students’ learning. Educational Psychology Review, 22, 411–423.
Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4, 295–312.
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. Berlin: Springer.
*Underwood, G., Crundall, D., & Chapman, P. (2002). Selective searching while driving: The role of experience in hazard detection and general surveillance. Ergonomics, 45, 1–12.
*Vaeyens, R., Lenoir, M., Williams, A. M., & Philippaerts, R. M. (2007). Mechanisms underpinning successful decision making in skilled youth players: An analysis of visual search behaviors. Journal of Motor Behavior, 39, 395–408.
*Van Gog, T., Paas, F., & Van Merriënboer, J. J. G. (2005). Uncovering expertise-related differences in troubleshooting performance: Combining eye movement and concurrent verbal protocol data. Applied Cognitive Psychology, 19, 205–221.
*Vickers, J. N. (1988). Knowledge structures of expert-novice gymnasts. Human Movement Science, 7, 47–72.
Vickers, J. N. (2007). Perception, cognition, and decision training. The quiet eye in action. Champaign: Human Kinetics.
*Vogt, S., & Magnussen, S. (2007). Expertise in pictorial perception: Eye-movement patterns and visual memory in artists and laymen. Perception, 36, 91–100.
*Ward, P., Williams, A. M., & Bennett, S. J. (2002). Visual search and biological motion perception in tennis. Research Quarterly for Exercise and Sport, 73, 107–112.
*Williams, A. M., & Davids, K. (1997). Assessing cue usage in performance contexts: A comparison between eye-movement and concurrent verbal report methods. Behavior Research Methods, Instruments, & Computers, 29, 364–375.
*Williams, A. M., & Davids, K. (1998). Visual search strategy, selective attention, and expertise in soccer. Research Quarterly for Exercise and Sport, 69, 111–128.
*Williams, A. M., & Elliott, D. (1999). Anxiety, expertise, and visual search strategy in karate. Journal of Sport & Exercise Psychology, 21, 362–375.
*Williams, A. M., Davids, K., Burwitz, L., & Williams, J. G. (1994). Visual search strategies in experienced and inexperienced soccer players. Research Quarterly for Exercise and Sport, 65, 127–135.
*Williams, A. M., Ward, P., Knowles, J. M., & Smeeton, N. J. (2002). Anticipation skill in a real-world task: Measurement, training, and transfer in tennis. Journal of Experimental Psychology: Applied, 8, 259–270.
*Wilson, M., McGrath, J., Vine, S., Brewer, J., Defriend, D., & Masters, R. (2010). Psychomotor control in a virtual laparoscopic surgery training environment: Gaze control parameters differentiate novices from experts. Surgical Endoscopy, 24, 2458–2464.
Wood, R. E. (1986). Task complexity: Definition of the construct. Organizational Behavior and Human Decision Processes, 37, 60–82.
Acknowledgments
This research was supported in part by grants from the Academy of Finland and from the Doctoral Program for Multidisciplinary Research on Learning Environments (OPMON).
Author information
Authors and Affiliations
Corresponding author
Additional information
References marked with an asterisk indicate studies included in the meta-analysis.
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Gegenfurtner, A., Lehtinen, E. & Säljö, R. Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains. Educ Psychol Rev 23, 523–552 (2011). https://doi.org/10.1007/s10648-011-9174-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10648-011-9174-7