Abstract
We present a novel approach to comparing saccadic eye movement sequences based on the Needleman-Wunsch algorithm used in bioinformatics to compare DNA sequences. In the proposed method, the saccade sequence is spatially and temporally binned and then recoded to create a sequence of letters that retains fixation location, time, and order information. The comparison of two letter sequences is made by maximizing the similarity score computed from a substitution matrix that provides the score for all letter pair substitutions and a penalty gap. The substitution matrix provides a meaningful link between each location coded by the individual letters. This link could be distance but could also encode any useful dimension, including perceptual or semantic space. We show, by using synthetic and behavioral data, the benefits of this method over existing methods. The ScanMatch toolbox for MATLAB is freely available online (www.scanmatch.co.uk).
Article PDF
Similar content being viewed by others
References
Altschul, S., Madden, T., Schaffer, A., Zhang, J., Zhang, Z., Miller, W., & Lipman, D. J. (1997). Gapped BLAST and PSIBLAST: A new generation of protein database search programs. Nucleic Acids Research, 25, 3389–3402.
Brandt, S. A., & Stark, L. W. (1997). Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience, 9, 27–38.
Carpenter, R. H. S. (1988). Movements of the eyes (2nd ed.). London: Pion.
Choi, Y. S., Mosley, A. D., & Stark, L. W. (1995). String editing analysis of human visual search. Optometry & Vision Science, 72, 439–451.
Durbin, R., Eddy, S. R., Krogh, A., & Mitchison, G. (1998). Biological sequence analysis: Probabilistic models of proteins and nucleic acids. Cambridge: Cambridge University Press.
Engbert, R., & Kliegl, R. (2001). Mathematical models of eye movements in reading: A possible role for autonomous saccades. Biological Cybernetics, 85, 77–87.
Findlay, J. M., & Gilchrist, I. D. (2003). Active vision: The psychology of looking and seeing. Oxford: Oxford University Press.
Foulsham, T., & Underwood, G. (2008). What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. Journal of Vision, 8(2, Art. 6), 1–17.
Hacisalihzade, S. S., Allen, J. S., & Stark, L. (1992). Visual perception and sequences of eye movement fixations: A stochastic modeling approach. IEEE Transactions on Systems, Man, & Cybernetics, 22, 474–481.
Henderson, J. M., & Pierce, G. L. (2008). Eye movements during scene viewing: Evidence for mixed control of fixation durations. Psychonomic Bulletin & Review, 15, 566–573.
Kirchner, H., & Thorpe, S. J. (2006). Ultrarapid object detection with saccadic eye movements: Visual processing speed revisited. Vision Research, 46, 1762–1776.
Levenshtein, V. (1966). Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics—Doklady, 10, 707–710.
Markov, A. (1971). Extension of the limit theorems of probability theory to a sum of variables connected in a chain. In Dynamic probabilistic systems: Vol. I. Markov models (pp. 552–577). New York: Wiley.
Maughan, L., Gutnikov, S., & Stevens, R. (2007). Like more, look more. Look more, like more: The evidence from eye-tracking. Journal of Brand Management, 14, 335–342.
Mosimann, U. P., Muri, R. M., Burn, D. J., Felblinger, J., O’Brien, J. T., & McKeith, I. G. (2005). Saccadic eye movement changes in Parkinson’s disease dementia and dementia with Lewy bodies. Brain, 128, 1267–1276.
Mount, D. W. (2008). Comparison of the PAM and BLOSUM amino acid substitution matrices. Cold Spring Harbor Protocols, 2008:7. doi:10.1101/pdb.ip59
Needleman, S. B., & Wunsch, C. D. (1970). A general method applicable to the search for similarities in the amino acid sequence of two proteins. Journal of Molecular Biology, 48, 443–453.
Noton, D., & Stark, L. (1971). Scanpaths in eye movements during pattern perception. Science, 171, 308–311.
Okuda, T., Tanaka, E., & Kasai, T. (1976). A method for the correction of garbled words based on the Levenshtein metric. IEEE Transactions on Computers, C-25, 172–178.
Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107–123.
Pieters, R., Rosbergen, E., & Wedel, M. (1999). Visual attention to repeated print advertising: A test of scanpath theory. Journal of Marketing Research, 36, 424–438.
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372–422.
Rayner, K. (2009). Eye movements and attention in reading, scene perception and visual search. Quarterly Journal of Experimental Psychology, 62, 1457–1506.
Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: Effects of scale and time. Vision Research, 45, 643–659.
Wagner, R. A., & Lowrance, R. (1975). An extension of the string-tostring correction problem. Journal of the ACM, 22, 177–183.
Zingale, C. M., & Kowler, E. (1987). Planning sequences of saccades. Vision Research, 27, 1327–1341.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by the NWO and ESRC Bilateral Grant Scheme.
Rights and permissions
About this article
Cite this article
Cristino, F., Mathôt, S., Theeuwes, J. et al. ScanMatch: A novel method for comparing fixation sequences. Behavior Research Methods 42, 692–700 (2010). https://doi.org/10.3758/BRM.42.3.692
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BRM.42.3.692