Abstract
Object discrimination is a fundamental cognitive function for human brains. In this study, we utilized an analysis approach for single-trial electroencephalography (EEG) to analyze the spatio-temporal activation patterns of visual objects processing in human brains, and attempted to apply it to discriminate different visual objects. The spatial patterns were respectively extracted from scalp EEG and the reconstructed cortical sources, while the experiment participants were perceiving 4 different categories of visual objects (faces, buildings, cats and cars). By classifying the patterns extracted from single-trial EEG, the presented visual objects could be discriminated by a computer, and the classification accuracies may provide a quantitative index to evaluate the spatial differences of the brain activations related to different visual objects. Our results demonstrated that the spatial patterns on both the scalp and the sources levels resulted in higher classification accuracies than chance rate. We also examined the classification results using temporally non-overlapping time intervals of different event-related potential (ERP) components. The temporal changes of classification accuracies may reflect the temporal distribution of the discriminative information in the EEG responses. The present pattern extraction and classification methods may compose a computational model for single-trial EEG data analysis in investigations of the spatio-temporal activation patterns for object recognition. These spatio-temporal patterns in EEG may be useful to identifying the discriminative spatial areas and time stages to improve the accuracies and efficiencies of object discrimination. In addition, investigating and utilizing humans’ cognitive mechanisms of object recognition may improve computers’ processing efficiency of visual information.
Similar content being viewed by others
References
Ishai A, Ungerleider L G, Martin A, et al. Distributed representation of objects in the human ventral visual pathway. Proc Natl Acad Sci USA, 1999, 96: 9379–9384
Cox D D, Savoy R L. Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex. NeuroImage, 2003, 19: 261–270
Haynes J D, Rees G. Predicting the orientation of invisible stimuli from activity in primary visual cortex. Nat Neurosci, 2008, 8: 686–691
Hanson S J, Matsuka T, Haxby J V. Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area? NeuroImage, 2004, 23: 156–166
Norman K A, Polyn S M, Detre G J, et al. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci, 2006, 10: 424–430
Song S T, Zhan Z C, Long Z Y, et al. Comparative study of SVM methods combined with voxel selection for object category classification on fMRI data. PLoS ONE, 2011, 6: e17191
Simanova I, van Gerven M, Oostenveld R, et al. Identifying object categories from event-related EEG toward decoding of conceptual representations. PLoS ONE, 2010, 5: e14465
Thierry G, Martin C D, Downing P, et al. Controlling for interstimulus perceptual variance abolishes N170 face selectivity. Nat Neurosci, 2007, 10: 505–511
Itier R J, Taylor M J. N170 or N1? Spatiotemporal differences between object and face processing using ERPs. Cereb Cortex, 2004, 14: 32–142
Herrmann M J, Ehlis A C, Muehlberger A, et al. Source localization of early stages of face processing. Brain Topogr, 2005, 18: 77–85
Philiastides M, Ratcliff R, Sajda P. Neural representation of task difficulty and decision making during perceptual categorization: A timing diagram. J Neurosci, 2006, 26: 8965–8975
Eimer M. Event-related brain potentials distinguish processing stages involved in face perception and recognition. Clin Neurophysiol, 2000, 111: 694–705
VanRullen R, Thorpe S J. The time course of visual processing: From early perception to decision-making. J Cogn Neurosci, 2001, 13: 454–461
Liu J, Harris A, Kanwisher N. Stages of processing in face perception: an MEG study. Nat Neurosci, 2002, 5: 910–916
Xu Y, Liu J, Kanwisher N. The M170 is selective for faces, not for expertise. Neuropsychologia, 2005, 43: 588–597
Sugase Y, Yamane S, Ueno S, et al. Global and fine information coded by single neurons in the temporal visual cortex. Nature, 1999, 400: 869–873
Grill-Spector K, Kanwisher N. Common cortical mechanisms for different components of visual object recognition: A combined behavioral and fMRI study. J Vision, 2001, 1: 474a
Rossion B, Gauthier I, Tarr M J, et al. The N170 occipito-temporal component is delayed and enhanced to inverted faces but not to inverted objects: An electrophysiological account of face-specific processes in the human brain. NeuroReport, 2000, 11: 69–74
Tanaka J W, Curran T. A neural basis for expert object recognition. Psychol Sci, 2001, 12: 43–47
Handy T D. Event-related potentials: A methods handbook. Cambridge: MIT Press, 2005
Hoffmannn U, Vesin J M, Ebrahimi T. Spatial filters for the classification of event-related potentials. In: Proceedings of the 14th European Symposium on Artificial Neural Networks, Bruges, Belgium, 2006. 47–52
Liao X, Yao D, Wu D, et al. Combining spatial filters for the classification of single-trial EEG in a finger movement task. IEEE Trans Biomed Eng, 2007, 54: 821–831
Henson R N, Flandin G, Friston K J, et al. A parametric empirical bayesian framework for fMRI-constrained MEG/EEG source reconstruction. Hum Brain Mapp, 2010, 31: 1512–1531
Duda R O, Hart P E, Stork D G. Pattern classification. 2nd ed. New York: John Wiley & Sons, 2001
Chang C C, Lin C J. LIBSVM: a library for support vector machines. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm, 2001
Rossion B, Joyce C A, Cottrell G W, et al. Early lateralization and orientation tuning for face, word, and object processing in the visual cortex. NeuroImage, 2003, 20: 1609–1624
Allison T, Puce A, Spencer D D, et al. Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cereb Cortex, 1999, 9: 415–430
Haxby J V, Gobbini M I, Furey M L, et al. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science, 2001, 293: 2425–2430
Caldara R, Thut G, Servoir P, et al. Face versus non-face object perception and the ‘other-race’ effect: a spatio-temporal event-related potential study. Clin Neurophysiol, 2003, 114: 515–528
Author information
Authors and Affiliations
Corresponding author
Additional information
WANG ChangMing was born in 1982. He received the bachelor’s degree in information engineering from Zhejiang University, Hangzhou, China in 2005. He is currently a Ph.D. candidate in National Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University. His research interests include EEG/ERP signal processing, EEG-based mind reading and brain-computer interface. He is a member of Beijing Psychological Society.
YAO Li was born in 1961. She received the Ph.D. degree in pattern recognition and intelligent system from Institute of Automation, Chinese Academy of Sciences, Beijing, China in 1998. Currently, she is a professor in National Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University. Her research interests include Methodology in cognitive neuroscience, neuro-engineering and mind reading. Dr. Yao is a member of Chinese Society of Neural Network, as well as the deputy director of Beijing Institute of Electronics Professional Committee in Education.
ZHANG JiaCai was born in 1975. He received the Ph.D. degree in pattern recognition and intelligent system from Institute of Automation, Chinese Academy of Sciences, Beijing, China in 2004. Currently, he is an associate professor in Beijing Normal University. His research interests include braincomputer interface, brain signal processing, and neurofeedback.
Electronic supplementary material
Supplementary material, approximately 5.83 MB.
Rights and permissions
About this article
Cite this article
Wang, C., Hu, X., Yao, L. et al. Spatio-temporal pattern analysis of single-trial EEG signals recorded during visual object recognition. Sci. China Inf. Sci. 54, 2499–2507 (2011). https://doi.org/10.1007/s11432-011-4507-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-011-4507-1