Abstract
A behavioral and computational treatment of change detection is reported. The behavioral task was to judge whether a single object substitution change occurred between two “flickering” 9-object scenes. Detection performance was found to vary with the similarity of the changing objects; object changes violating orientation and category yielded the fastest and most accurate detection responses. To account for these data, theBOLAR model was developed, which uses color, orientation, and scale selective filters to compute the visual dissimilarity between the pre- and postchange objects from the behavioral study. Relating the magnitude of the BOLAR difference signals to change detection performance revealed that object pairs estimated as visually least similar were the same object pairs most easily detected by observers. The BOLAR model advances change detection theory by (1) demonstrating that the visual similarity between the change patterns can account for much of the variability in change detection behavior, and (2) providing a computational technique for quantifying these visual similarity relationships for real-world objects.
Article PDF
Similar content being viewed by others
References
Adini, Y., Moses, Y., &Ullman, S. (1997). Face recognition: The problem of compensating for illumination changes.IEEE Transactions on Pattern Analysis & Machine Intelligence,19, 721–732.
Allport, D. A. (1980). Attention and performance. In G. Claxton (Ed.),Cognitive psychology (pp. 112–153). London: Routledge & Kegan Paul.
Amit, Y., &Geman, D. (1997). Shape quantization and recognition with randomized trees.Neural Computation,9, 1545–1588.
Ashby, F. G., &Lee, W. W. (1991). Predicting similarity and categorization from identification.Journal of Experimental Psychology: General,120, 150–172.
Ashby, F. G., &Perrin, N. A. (1988). Toward a unified theory of similarity and recognition.Psychological Review,95, 124–150.
Ballard, D. H., &Brown, C. M. (1982).Computer vision. Englewood Cliffs, NJ: Prentice-Hall.
Ballard, D. H., Hayhoe, M. M., Pook, P. K., &Rao, R. P. N. (1997). Deictic codes for the embodiment of cognition.Behavioral & Brain Sciences,20, 723–767.
Bell, A. J., &Sejnowski, T. J. (1997). The “independent components” of natural scenes are edge filters.Vision Research,37, 3327–3338.
Blackmore, S. J., Brelstaff, G., Nelson, K., &Troscianko, T. (1995). Is the richness of our visual world an illusion? Transsaccadic memory for complex scenes.Perception,24, 1075–1081.
Bricolo, E., Poggio, T., &Logothetis, N. (1997). 3D object recognition: A model of view-tuned neurons. In M. Mozer, M. Jordan, & T. Petsche (Eds.),Advances in neural information processing systems 9 (pp. 41–47). Cambridge, MA: MIT Press.
Bridgeman, B., Hendry, D., &Stark, L. (1975). Failure to detect displacement of the visual world during saccadic eye movements.Vision Research,15, 719–722.
Bridgeman, B., &Mayer, M. (1983). Failure to integrate visual information from successive fixations.Bulletin of the Psychonomic Society,21, 285–286.
Brockmole, J. R., Wang, R. F., &Irwin, D. E. (2002). Temporal integration between visual images and visual percepts.Journal of Experimental Psychology: Human Perception & Performance,28, 315–334.
Currie, C. B., McConkie, G. W., Carlson-Radvansky, L. A., &Irwin, D. E. (2000). The role of the saccade target object in the perception of a visually stable world.Perception & Psychophysics,62, 673–683.
Duncan, J., &Humphreys, G. W. (1989). Visual search and stimulus similarity.Psychological Review,96, 433–458.
Eckstein, M. P. (1998). The lower visual search efficiency for conjunctions is due to noise and not serial attentional processing.Psychological Science,9, 111–118.
Edelman, S. (1993). Representing three-dimensional objects by sets of activities of receptive fields.Biological Cybernetics,70, 37–45
Edelman, S. (1998). Representation is representation of similarities.Behavioral & Brain Sciences,21, 449–498.
Feldman, J. A. (1985). Four frames suffice: A provisional model of vision and space.Behavioral & Brain Sciences,8, 265–313.
Freeman, W., &Adelson, E. (1991). The design and use of steerable filters.IEEE Transactions on Pattern Analysis & Machine Intelligence,13, 891–906.
Friedman, A. (1979). Framing pictures: The role of knowledge in automatized encoding and memory for gist.Journal of Experimental Psychology: General,108, 316–355.
Gati, I., &Tversky, A. (1984). Weighting common and distinctive features in perceptual and conceptual judgments.Cognitive Psychology,16, 341–370.
Goldstone, R. L. (1994a). Influences of categorization on perceptual discrimination.Journal of Experimental Psychology: General,123, 178–200.
Goldstone, R. L. (1994b). The role of similarity in categorization: Providing a groundwork.Cognition,52, 125–157.
Goldstone, R. L. (1994c). Similarity, interactive activation, and mapping.Journal of Experimental Psychology: Learning, Memory, & Cognition,20, 3–28.
Goodman, N. (1972). Seven strictures on similarity. In N. Goodman (Ed.),Problems and projects (pp. 437–447). New York: Bobbs-Merrill.
Graham, N. (1992). Breaking the visual stimulus into parts.Current Directions in Psychological Science,1, 55–61.
Graham, N., Kramer, P., &Yager, D. (1987). Signal-detection models for multidimensional stimuli: Probability distributions and combination rules.Journal of Mathematical Psychology,31, 366–409.
Green, D., &Swets, J. (1966).Signal detection theory and psychophysics. New York: Krieger.
Grimes, J. (1996). On the failure to detect changes in scenes across saccades. In K. Akins (Ed.),Perception (pp. 89–110). New York: Oxford University Press.
Hayhoe, M. M., Bensinger, D. G., &Ballard, D. H. (1998). Task constraints in visual working memory.Vision Research,38, 125–137.
Henderson, J. M., &Hollingworth, A. (1999). The role of fixation position in detecting scene changes across saccades.Psychological Science,10, 438–443.
Hollingworth, A., &Henderson, J. M. (2000). Semantic informativeness mediates the detection of changes in natural scenes.Visual Cognition,7, 213–235.
Hubel, D. H., &Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex.Journal of Physiology,160, 106–154.
Irwin, D. E. (1992). Memory for position and identity across eye movements.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 307–317.
Irwin, D. E. (1996). Integrating information across saccadic eye movements.Current Directions in Psychological Science,5, 94–99.
Irwin, D. E., &Andrews, R. V. (1996). Integration and accumulation of information across saccadic eye movements. In T. Inui & J. McClelland (Eds.),Attention and performance XVI: Information integration in perception and communication (pp. 125–155). Cambridge, MA: MIT Press.
Irwin, D. E., Brown, J., &Sun, J. (1988). Visual masking and visual integration across saccadic eye movements.Journal of Experimental Psychology: General,117, 276–287.
Itti, L., &Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention.Vision Research,40, 1489–1506.
Kahneman, D., &Treisman, A. (1984). Changing views of attention and automaticity. In R. Parasuraman & D. R. Davies (Eds.),Varieties of attention (pp. 129–161). Orlando, FL: Academic Press.
Kahneman, D., Treisman, A., &Gibbs, B. J. (1992). The reviewing of object files: Object-specific integration of information.Cognitive Psychology,24, 175–219.
Koch, C., &Ullman, S. (1985). Shifts of selective visual attention: Toward the underlying neural circuitry.Human Neurobiology,4, 219–227.
Lades, M., Vorbruggen, J. C., Buhmann, J., Lange, J., von der Malsburg, C., Wurtz, R. P., &Konen, W. (1993). Distortion invariant object recognition in the dynamic link architecture.IEEE Transactions on Computers,42, 300–311.
Landy, M. S., &Movshon, J. A. (1991).Computational models of visual processing. Cambridge, MA: MIT Press.
Levin, D. T., &Simons, D. J. (1997). Failure to detect changes to attended objects in motion pictures.Psychonomic Bulletin & Review,4, 501–506.
Logan, G. D. (1997). The automaticity of academic life: Unconscious applications of an implicit theory. In R.S. Wyer (Ed.),Advances in social cognition (Vol. 10, pp. 157–179). Mahwah, NJ: Erlbaum.
Lu, Z.-L., &Dosher, B. A. (1999). Characterizing human perceptual inefficiencies with equivalent internal noise.Journal of the Optical Society of America A,16, 764–778.
Malik, J., &Perona, P. (1990). Preattentive texture discrimination with early vision mechanisms.Journal of the Optical Society of America A,7, 923–932.
McConkie, G. W., &Currie, C. B. (1996). Visual stability across saccades while viewing complex pictures.Journal of Experimental Psychology: Human Perception & Performance,22, 563–581.
McConkie, G. W., &Rayner, K. (1976). Identifying the span of the effective stimulus in reading: Literature review and theories of reading. In H. Singer & R. B. Ruddell (Eds.),Theoretical models and processes of reading (2nd ed., pp. 137–162). Newark, DE: International Reading Association.
McConkie, G. W., &Zola, D. (1979). Is visual information integrated across successive fixations in reading?Perception & Psychophysics,25, 221–224.
Medin, D. L., Goldstone, R. L., &Gentner, D. (1990). Similarity involving attributes and relations: Judgments of similarity and difference are not inverses.Psychological Science,1, 64–69.
Medin, D. L., Goldstone, R. L., &Gentner, D. (1993). Respects for similarity.Psychological Review,100, 254–278.
Murphy, G. L., &Medin, D. L. (1985). The role of theories in conceptual coherence.Psychological Review,92, 289–316.
Murphy, G. L., &Wisniewski, E. J. (1989). Categorizing objects in isolation and in scenes: What a superordinate is good for.Journal of Experimental Psychology: Learning, Memory, & Cognition,15, 572–586.
Nosofsky, R. M. (1986). Attention, similarity, and the identification-categorization relationship.Journal of Experimental Psychology: General,115, 39–57.
Nosofsky, R. M. (1992). Similarity scaling and cognitive process models.Annual Review of Psychology,43, 25–53.
O’Regan, J. K. (1992). Solving the “Real” mysteries of visual perception: The world as an outside memory.Canadian Journal of Psychology,46, 461–488.
O’Regan, J. K., Deubel, H., Clark, J. J., &Rensink, R. A. (2000). Picture changes during blinks: Looking without seeing and seeing without looking.Visual Cognition,7, 191–211.
O’Regan, J. K., Rensink, R. A., &Clark, J. J. (1999). Change-blindness as a result of “mudsplashes.”Nature,398, 34.
Palmer, J., Ames, C. T., &Lindsey, D. T. (1993). Measuring the effect of attention on simple visual search.Journal of Experimental Psychology: Human Perception & Performance,19, 108–130.
Palmer, S. E. (1978). Structural aspects of visual similarity.Memory & Cognition,6, 91–97.
Parker, J. R. (1993).Practical computer vision using C. New York: Wiley.
Parker, R. E. (1978). Picture processing during recognition.Journal of Experimental Psychology: Human Perception & Performance,4, 284–293.
Pashler, H. (1988). Familiarity and visual change detection.Perception & Psychophysics,44, 369–378.
Pylyshyn, Z. [W.] (1989). The role of location indexes in spatial perception: A sketch of the FINST spatial-index model.Cognition,32, 65–97.
Pylyshyn, Z. W., &Storm, R. W. (1988). Tracking multiple independent targets: Evidence for a parallel tracking mechanism.Spatial Vision,3, 179–197.
Raymond, J. E., Shapiro, K. L., &Arnell, K. M. (1995). Similarity determines the attentional blink.Journal of Experimental Psychology: Human Perception & Performance,21, 653–662.
Rayner, K., &Pollatsek, A. (1983). Is visual information integrated across saccades?Perception & Psychophysics,34, 39–48.
Rensink, R. A. (2000a). The dynamic representation of scenes.Visual Cognition,7, 17–42.
Rensink, R. A. (2000b). Visual search for change: A probe into the nature of attentional processing.Visual Cognition,7, 345–376.
Rensink, R. A. (2002). Change detection.Annual Review of Psychology,53, 245–277.
Rensink, R. A., O’Regan, J. K., &Clark, J. J. (1997). To see or not to see: The need for attention to perceive changes in scenes.Psychological Science,8, 368–373.
Rohaly, A. M., Ahumada, A. J., Jr., &Watson, A. B. (1997). Object detection in natural backgrounds predicted by discrimination performance and models.Vision Research,37, 3225–3235.
Scholl, B. J. (2000). Attenuated change blindness for exogenously attended items in a flicker paradigm.Visual Cognition,7, 377–396.
Scott-Brown, K. C., Baker, M. R., &Orbach, H. S. (2000). Comparison blindness.Visual Cognition,7, 253–267.
Scott-Brown, K. C., &Orbach, H. S. (1999). Contrast discrimination, non-uniform patterns and change blindness.Proceedings of the Royal Society of London: Series B,265, 2159–2166.
Shepard, R. N. (1980). Multidimensional scaling, tree-f itting, and clustering.Science,210, 390–398.
Shepard, R. N. (1987). Toward a universal law of generalization for psychological science.Science,237, 1317–1323.
Simons, D. J. (2000). Current approaches to change blindness.Visual Cognition,7, 1–15.
Simons, D. J., &Chabris, C. F. (1999). Gorillas in our midst: Sustained inattentional blindness for dynamic events.Perception,28, 1059–1074.
Simons, D. J., Franconeri, S. L., &Reimer, R. L. (2000). Change blindness in the absence of a visual disruption.Perception,29, 1143–1154.
Simons, D. J., &Levin, D. T. (1997). Change blindness.Trends in Cognitive Sciences,1, 261–267.
Simons, D. J., &Levin, D. T. (1998). Failure to detect changes to people during a real-world interaction.Psychonomic Bulletin & Review,5, 644–649.
Sperling, G. (1960). The information available in brief visual presentations.Psychological Monographs,74, (11, Whole No. 498).
Townsend, J. T. (1976). Serial and within-stage independent parallel model equivalence on the minimum completion time.Journal of Mathematical Psychology,14, 219–238.
Townsend, J. T. (1990). Serial vs. parallel processing: Sometimes they look like Tweedledum and Tweedledee but they can (and should) be distinguished.Psychological Science,1, 46–54.
Trick, L. M., &Pylyshyn, Z. W. (1993). What enumeration studies can show us about spatial attention: Evidence for limited capacity preattentive processing.Journal of Experimental Psychology: Human Perception & Performance,19, 331–351.
Tversky, A. (1977). Features of similarity.Psychological Review,84, 327–352.
Wallis, G., &Bülthoff, H. (2000). What’s scene and not seen: Influences of movement and task upon what we see.Visual Cognition,7, 175–190.
Watanabe, S. (1985). Pattern recognition:Human and mechanical. New York: Wiley.
Werner, S., &Thies, B. (2000). Is “change blindness” attenuated by domain-specific expertise? An expert-novices comparison of change detection in football images.Visual Cognition,7, 163–173.
Williams, P., &Simons, D. J. (2000). Detecting changes in novel, complex three-dimensional objects.Visual Cognition,7, 297–322.Wright, M., Green, A., & Baker, S. (2000). Limitations for change detection in multiple Gabor targets.Visual Cognition,7, 237-252.
Zelinsky, G. J. (1998). Detecting changes between scenes:A similaritybased theory using iconic representations (Tech. Rep. No. CNS-98-01). Urbana, IL: Beckman Institute, Cognitive Neuroscience Group.
Zelinsky, G. J. (1999). Effects of visual similarity on change detection: A behavioral and computational analysis.Investigative Ophthalmology & Visual Science,40(4), S50.
Zelinsky, G. J. (2001a). Eye movements during change detection: Implications for search constraints, memory limitations, and scanning strategies.Perception & Psychophysics,63, 209–225.
Zelinsky, G. J. (2001b). A theory of eye movements during real-world visual search.Abstracts of the Psychonomic Society,6, 61.
Zelinsky, G. J. (2002). A theory of gaze behavior during real-world visual search [Abstract].Journal of Vision,2(7), 726a.
Zelinsky, G. J., &Loschky, L. (1998). Toward a more realistic assessment of visual short-term memory.Investigative Ophthalmology & Visual Science,39, S224.
Zelinsky, G. J., & Loschky, L. (2003).Forgetting what we have just seen: Serial order effects for objects in scenes revealed by eye movements. Manuscript submitted for publication.
Zipser, D., &Andersen, R. A. (1988). A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons.Nature,331, 679–684.
Author information
Authors and Affiliations
Corresponding author
Additional information
This project was supported in part by NSF Grant ITR 0082602, and an abbreviated version of this work was presented at the 1999 meeting of the Association for Research in Vision and Ophthalmology
Rights and permissions
About this article
Cite this article
Zelinsky, G.J. Detecting changes between real-world objects using spatiochromatic filters. Psychonomic Bulletin & Review 10, 533–555 (2003). https://doi.org/10.3758/BF03196516
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03196516