Abstract
We used event-related functional magnetic resonance imaging to identify brain regions involved in syntactic and semantic processing. Healthy adult males read well-formed sentences randomly intermixed with sentences which either contained violations of syntactic structure or were semantically implausible. Reading anomalous sentences, as compared to well-formed sentences, yielded distinct patterns of activation for the two violation types. Syntactic violations elicited significantly greater activation than semantic violations primarily in superior frontal cortex. Semantically incongruent sentences elicited greater activation than syntactic violations in the left hippocampal and parahippocampal gyri, the angular gyri bilaterally, the right middle temporal gyrus, and the left inferior frontal sulcus. These results demonstrate that syntactic and semantic processing result in nonidentical patterns of activation, including greater frontal engagement during syntactic processing and larger increases in temporal and temporo-parietal regions during semantic analyses.
Similar content being viewed by others
REFERENCES
Bader, M. (1998). Prosodic influences on reading syntactically ambiguous sentences. In J. D. Fodor, & F. Ferriera (Eds.), Reanalysis in sentence processing, (pp. 1–46). Dordrecht: Kluwer Academic.
Bavelier, D., Corina, D., Jezzard, P., Padmanabhan, S., Clark, V. P., Karni, A., Prinster, A., Braun, A., Lalwani, A., Rauschecker, J. P., Turner, R., & Neville, H. (1997). Sentence reading: A functional MRI study at 4 Tesla. Journal of Cognitive Neuroscience,9, 664–686.
Boynton, G. M., Engel, S. A., Glover, G. H., & Heeger, D. J. (1996). Linear systems analysis of functional magnetic resonance imaging in human V1. Journal of Neuroscience, 16, 4207–4221.
Binder, J. R., Swanson, S. J., Hammeke, T. A., Morris, G. L., et al. (1996). Determination of language dominance using functional MRI: A comparison with the Wada test. Neurology, 46,978–984.
Brewer, J. B., Zhao, Z., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. (1998). Making memories: Brain activity that predicts how well visual experience will be remembered. Science, 281, 1185–1187.
Buckner, R. L., Bandettini, P. A., O'Craven, K. M., Savoy, R. L., Petersen, S. E., Raichle, M. E., & Rosen, B. R. (1996). Detection of cortical activation during averaged single trials of a cognitive task using functional magnetic resonance imaging. Proceedings of the National Academy of Sciences,93, 14878–14883.
Buckner, R. L., & Koutstaal, W. (1998). Functional neuroimaging studies of encoding, priming, and explicit memory retrieval. Proceedings of the National Academy, 95, 891.
Caplan, D., Alpert, N., & Waters, G. (1998). Effects of syntactic structure and propositional number on patterns of regional cerebral blood flow. Journal of Cognitive Neuroscience, 10, 541–552.
Caramazza, A., Berndt, R. S., Basili, A. G., & Koller, J. J. (1981). Syntactic processing deficits in aphasia. Cortex, 17, 333–348.
Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: MIT Press.
Cohen, N. J., & Squire, L. R. (1980). Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing what. Science, 210, 207–210.
Coulson, S., King, J. W., & Kutas, M. (1998). Expect the unexpected: Event-related brain response to morphosyntactic violations. Language & Cognitive Processes, 13, 21–58.
Courtney, S. M., Petit, L., Maisog, J. M., Ungerleider, L. G., & Haxby, J. V. (1998). An area specialized for spatial working memory in human frontal cortex. Science,279, 1347–1351.
Cox, R. W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research,29, 162–173.
Cox, R. W., & Hyde, J. S. (1997). Software tools for analysis and visualization of fMRI data. NMR in Biomedicine, 10, 171–178.
Dale, A. M., & Buckner, R. L. (1997). Selective averaging of rapidly presented individual trials using fMRI. Human Brain Mapping, 5, 329–340.
Dale, A. M., & Sereno, M. I. (1993). Improved localization of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: A linear approach. Journal of Cognitive Neuroscience, 5(2), 162–176.
Damasio, A. R. (1992). Aphasia. New England Journal of Medicine, 326, 531–539.
Damasio, A. R., & Damasio, H. (1992). Brain and language. Scientific American, 267, 88–95.
Dehaene, S., Dupoux, E., Mehler, J., Cohen, L., Paulesu, E., Perani, D., van de Moortele, P.-F., Lehericy, S., & Le Bihan, D. (1997). Anatomical variability in the cortical representation of first and second language. Neuroreport,8, 3809–3815.
Demb, J. B., Desmond, J. E., Wagner, A. D., Vaidya, C. J., Glover, G. H., & Gabrieli, J. D. E. (1995). Semantic encoding and retrieval in the left inferior prefrontal cortex: A functional MRI study of task difficulty and process specificity. Journal of Neuroscience, 15, 5870–5878.
Demonet, J.-F., Chollet, F., Ramsay, S., Cardbat, D., Nespoulous, J.-L., Wise R., & Rascol, A. (1992). The anatomy of phonological and semantic processing in normal subjects. Brain, 115, 1753–1768.
Dolan, R. J., & Fletcher, P. F. (1999). Encoding and retrieval in human medial temporal lobes: An empirical investigation using functional magnetic resonance imaging (fMRI). Hippocampus, 9, 25–34.
Embick, D., Marantz, A., Miyashita, Y., O'Neil, W., & Sakai, K. L. (2000). A syntactic specialization for Broca's area. Proceedings of the National Academy of Sciences of the USA, 97, 6150–6154.
Fodor, J. D. (1989). Empty categories in sentence processing. Language and Cognitive Processes, 4, 155–209.
Friederici, A. D. (1995). The time course of syntactic activation during language processing: A model based on neuropsychological and neurophysiological data. Brain & Language, 50, 259–281.
Friederici, A. D. (1996). Diagnosis and reanalysis: Two processing aspects the brain may differentiate. In J. Fodor, & F. Ferreira, (Eds.), Reanalysis in sentence processing. Dordrecht: Kluwer Academic.
Friederici, A. D., & Frisch, S. (2000). Verb argument structure processing: The role of verbspecific and argument-specific information. Journal of Memory and Language, 43, 476–507.
Friederici, A. D., Hahne, A., & von Cramon, D. Y. (1998). First-pass versus second-pass parsing processes in a Wernicke's and a Broca's aphasic: Electrophysiological evidence for a double dissociation. Brain & Language,62, 311–341.
Friederici, A. D., von Cramon, D. Y., & Kotz, S. A. (1999). Language related brain potentials in patients with cortical and subcortical left hemisphere lesions. Brain, 122, 1033–1047.
Friederici, A. D., Wang, Y., Herrmann, C. S., Maess, B., & Oertel, U. (2000). Localization of early syntactic processes in frontal & temporal cortical areas: A magnetoencephalographic study. Human Brain Mapping, 11, 1–11.
Gabrieli, J. D., Corkin, S., Mickel, S. F., & Growdon, J. H. (1993). Intact acquisition and long-term retention of mirror-tracing skill in Alzheimer's disease and in global amnesia. Behavioral Neuroscience, 107, 899–910.
Gibson, E. (1998). Linguistic complexity: Locality of syntactic dependencies. Cognition, 68, 1–76.
Goodgalss, H. (1993). Understanding aphasia. San Diego, CA: Academic Press.
Grabowski, T., Damasio, H., & Damasio, A. R. (1998). Premotor and prefrontal correlates of category-related lexical retrieval. Neuroimage, 7, 232–243.
Graybiel, A. M. (1995). Building action repertoires: Memory and learning functions of the basal ganglia. Current Opinion in Neurobiology, 5, 733–741.
Grimshaw, J. (1979). Complement selection and the lexicon. Linguistic Inquiry, 10, 279–326.
Hagoort, P. (1999). The cognitive architecture of parsing: Evidence from event related brain potentials. Journal of Cognitive Neuroscience,Supplement, p. 9.
Hagoort, P., & Brown, C. M. (1999). The implications of the temporal interaction between syntactic and semantic processes for hemodynamic studies of language. Paper presented at the MGH Visiting Fellowship Program in functional MRI,November 1999.
Hagoort, P., Brown, C., & Groothusen, J. (1993). The syntactic positive shift (SPS) as an ERP measure of syntactic processing. Language & Cognitive Processes,8, 439–483.
Hahne, A., & Friederici, A. D. (1999). Electrophysiological evidence for two steps in syntactic analysis: Early automatic and late controlled processes. Journal of Cognitive Neuroscience, 2, 194–205.
Heindel, W. C., Salmon, D. P., Shults, C. W., Walicke, P. A., & Butters, N. (1989). Neuropsychological evidence for multiple implicit memory systems: a comparison of Alzheimer's, Huntington's, and Parkinson's disease patients. Journal of Neuroscience, 9, 582–587.
Hickok, G., Love, T., Swinney, D., Wong, E., & Buxton, R. B. (1997). Functional MR imaging during auditory word presentation: A single-trial presentation paradigm. Brain & Language, 58, 197–201.
Izvorski, R., & Ullman, M. T. (1999). Verb inflection and the hierarchy of functional categories in agrammatic anterior aphasia. Brain & Language, 69, 288–291.
Izvorski, R., & Ullman, M. T. (2000). Syntactic structure building and the processing of inflection in aphasia. Paper presented at the 13th Annual CUNY Conference on Human Sentence Processing, San Diego.
Josephs, O., Turner, R., & Friston, K. (1997). Event-related fMRI. Human Brain Mapping, 5, 1–7.
Just, M. A., Carpenter, P. A., Keller, T. A., Eddy, W. F., & Thulborn, K. R. (1996). Brain activation modulated by sentence comprehension. Science, 274, 114–116.
Kaan, E., Harris, A., Gibson, E., & Holcomb, P. (2000). The P600 as an index of syntactic integration difficulty. Language and Cognitive Processes, 15, 159–201.
Kiehl, K. A., Laurens, K. R., & Liddle, P. F. (1999). Reading anomalous sentences: An eventrelated fMRI study od semantic processing. Proceedings of the Cognitive Neuroscience Society 6th Annual Meeting, Washington, D.C., April 1999.
Kucera, H., & Francis, W. N. (1967). Computational analysis of present-day American English.Providence, RI: Brown University Press.
Kuperberg, G. E., McGuire, P. K., Bullmore, E. T., Brammer, M. J., Rabe-Hesketh, S., Wright, I. C., Lythogoe, D. J., Williams, S. C. R., & David, A. S. (2000). Common and distinct neural substrates for pragmatic, semantic, and syntactic processing of spoken sentences: An fMRI study. Journal of Cognitive Neuroscience, 12, 321–341.
Kutas, M., & Hillyard, S. A. (1980). Event-related brain potentials to semantically inappropriate and surprisingly large words. Biological Psychology, 11, 9–116.
Kutas, M., & Hillyard, S. A. (1984). Brain potentials during reading reflect word expectancy and semantic association. Nature (London), 307, 161–163.
Lepage, M., Habib, R., & Tulving, E. (1998). Hippocampal PET activations of memory encoding and retreival: the HIPER model. Hippocampus, 8, 313–322.
Martin, A. (1999). Automatic activation of the medial temporal lobe during encoding: Lateralized influences of meaning and novelty. Hippocampus,9, 62–70.
Mazoyer, B. M., Tzourio, N., Frak, V., Syrota, A., Murayama, O., Levrier, O., Salamon, G., Dehaene, S., Cohen, L., & Mehler, J. (1993). The cortical representation of speech. Journal of Cognitive Neuroscience, 5, 467–479.
McCarthy, G., Luby, M., Gore, J., & Goldman-Rakic, P. (1997). Infrequent events transiently activate human prefrontal and parietal cortex as measured by functional MRI. Journal of Neurophysiology,77, 1630–1634.
McCarthy, G., Nobre, A. C., Bentin, S., & Spencer, D. D. (1995). Language-related field potentials in the anterior medial temporal lobe: I. Intracranial distribution and neural generators. Journal of Neuroscience, 15, 1080–1089.
Menon, R. S., Luknowsky, D. C., & Gati, J. S. (1998). Mental chronometry using latencyresolved functional MRI. Proceedings of the National Academy of Sciences of the USA, 95, 10902–10907.
Menon, R. S., & Kim, S.-G. (1999). Spatial and temporal limits in cognitive neuroimaging with fMRI. Trends in Cognitive Sciences, 3, 207–216.
Meyer, M., Friederici, A. D., & von Cramon, D. Y. (2000). Neurocognition of auditory sentence comprehension: Event related fMRI reveals sensitivity to syntactic violations and task demands. Cognitive Brain Research,9, 19–33.
Neter, J., Wasserman, W., & Kutner, M. H. (1985). Applied linear statistics models, 2nd ed. Homewood, IL: Irwin.
Neville, H. J., Nicol, J. L., Barss, A., Forster, K. I., & Garrett, M. (1991). Syntactically based sentence processing classes: Evidence from event-related brain potentials. Journal of Cognitive Neuroscience,3, 151–165.
Newman, A. J., Izvorski, R., Davis, L., Ullman, M. T., & Neville, H. J. (1999). Neural pro-cessing of inflectional morphology: An event-related potential study of English past tense. Poster presented at the 6th Annual Meeting of the Cognitive Neuroscience Society, Washington, DC.
Ni, W., Constable, R. T., Menci, W. E., Pugh, K. R., Fulbright, R. K., Shaywitz, S. E., Shaywitz, B. A., Gore, J. C., & Shankweiler, D. (2000). An event-related neuroimaging study distinguishing form and content in sentence processing. Journal of Cognitive Neuroscience, 12, 120–133.
Nobre, A. C., & McCarthy, G. (1995). Language-related field potentials in the anterior-medial temporal lobe: II. Effects of word type and semantic priming. Journal of Neuroscience, 15, 1190–1098.
Nyberg,, L., Cabeza, R., & Tulving, E. (1996). PET studies of encoding and retrieval: The HERA model. Psychonomic Review Bulletin, 3, 135–148.
Okada, Y. (1983). Neurogenesis of evoked magnetic fields. In S. J. Williamson, G. L. Romani, L. Kaufman, & I. Midena (Eds.). Biomagnetism, an Interdisciplinary Approach (pp. 399–408). New York: Plenum Press.
Osterhout, L., Holcomb, P. J. (1992). Event-related brain potentials elicited by syntactic anomaly. Journal of Memory & Language, 31, 785–806.
Osterhout, L., Holcomb, P., & Swinney, D. (1994). Brain potentials elicited by garden-path sentences: Evidence of the application of verb information during parsing. Journal of Experimental Psychology: Learning, Memory & Cognition, 20(4), 786–803.
Osterhout, L., McKinnon, R., Bersick, M., & Corey, V. (1996). On the language specificity of the brain response to syntactic anomalies: Is the syntactic positive shift a member of the P300 family? Journal of Cognitive Neuroscience,8, 507–526.
Osterhout, L., & Nicol, J. (1999). On the distinctiveness, independence, and time course of the brain responses to syntactic and semantic anomalies. Language and Cognitive Processes, 14, 283–317.
Patel, A. D., Gibson, E., Ratner, J., Besson, M., & Holcomb, P. (1998). Processing syntactic relations in language and music: An event-related potential study. Journal of Cognitive Neuroscience, 10, 717–733.
Pesetsky, D. (1982). Doctoral Dissertation, MIT, Cambridge, MA.
Phillips, J. W., Leahy, R. M., & Mosher, J. C. (1997). The MEG-based imaging of focal neuronal current sources. IEEE Transactions in Medical Imaging, 16(3), 338–348.
Posner, M. I. (1986). I. Overview. In K. R. Boff, & L. Kaufman, et al. (Eds.), Handbook of perception and human performance, Vol.2: Cognitive processes and performance. (pp. 3–10). New York: Wiley.
Price, C. J., Moore, C. J., Humphreys, G. W., Wise, R. J. S. (1997). Segregating semantic from phonological processes during reading. Journal of Cognitive Neuroscience, 9(6), 727–733.
Richter, W., Ugurbil, K., Georgopoulos, A. P., & Kim, S. G. (1997). Time-resolved fMRI of mental rotation. Neuroreport,8, 3697–3702.
Richter, W., Somorjai, R., Summers, R., Jarmasz, M., Menon, R. S., Gati, J. S., Georgopoulos, A. P., Tegeler, C., Ugurbil, K., & Kim, S. G. (2000). Journal of Cognitive Neuroscience, 12, 310–320.
Rencher, A. C. (1995). Methods of multivariate analysis. New York: Wiley.
Rösler, F., Friederici, A. D., Putz, P., & Hahne, A. (1993). Event-related brain potentials while encountering semantic and syntactic constraint violations. Journal of Cognitive Neuroscience, 5, 345–362.
Rugg, M. D. (1985). The effects of semantic priming and word repetition on event-related potentials. Psychophysiology, 22, 642–647.
Rugg, M. D., & Coles, M. G. H. (Eds.) (1995). Electrophysiology of mind. New York: Oxford University Press.
Schacter, D. L., & Wagner, A. D. (1999). Medial temporal lobe activations in fMRI and PET studies of episodic encoding and retrieval. Hippocampus, 9,7–24.
Simos, P. G., Basile, L. F. H., & Papanicolaou, A. C. (1997). Source localization of the N400 response in a sentence reading paradigm using evoked magnetic fields and magnetic resonance imaging. Brain Research, 762, 29–39.
Squire, L. R., & McKee, R. D. (1993). Declarative and nondeclarative memory in opposition: when prior events influence amnesic patients more than normal subjects. Memory & Cognition, 21, 424–430.
Steinhauer, K., Alter, K., & Friederici, A. D. (1999). Brain potentials indicate immediate use of prosodic cues in natural speech processing. Nature Neuroscience, 2, 191–196.
Steinhauer, K., & Friederici, A. D. (2001). Prosodic boundaries, comma rules, and brain responses: The Closure Positive Shift in the ERPs as a universal marker for prosodic phrasing in listeners and readers. Journal of Psycholinguistic Research, 30, 265–293.
Stromswold, K., Caplan, D., Alpert, N., & Rauch, S. (1996). Localization of syntactic comprehension by positron emission tomography. Brain & Language, 52, 452–473.
Tulving, E., Habib, R., Nyberg, L., Lepage, M., & McIntosh, A. R. (1999). Positron emission tomography correlations in and beyond the medial temporal lobe. Hippocampus, 9,71–82.
Tyler, L. K., Ostrin, R. K., Cooke, M., & Moss, H. E. (1995). Automatic access of lexical information in Broca's aphasics: Against the automatically hypothesis. Brain & Language, 48, 131–162.
Ullman, M. T. (2001). “The Declarative/Procedural Model of Language,” Journal of Psycholinguistic Research, 30, 37–69.
Ullman, M., Corkin, S., Coppola, M., Hickok, G., Growdon, J. H., Koroshetz, W. J., & Pinker, S. (1997). A neural dissociation within language: Lexicon, a part of declarative memory, grammar processed by procedural system. Journal of Cognitive Neuroscience, 9, 289–299.
Ullman, M. T., Newman, A., Izvorski, R., & Neville, H. (2000). Electrophysiological correlates of lexicon and grammar: Evidence from inflectional morphology. Paper presented at the 13th Annual CUNY Conference on Human Sentence Processing, San Diego.
Ullman, M. T., Izvorski, R., Love, T., Yee, E., Swinney, D., & Hickok, G. (In press). Neural correlates of lexicon and grammar: Evidence from the production, reading, and judgment of inflection in aphasia. Brain & Language.
Ward, B. D. (2000). Deconvolution of fMRI time series data. Documentation included in the Analysis of Functional Neuroimages software package, available from htpp://varda.biophysics. mcw.edu.
Wagner, A. D., Schacter, D. L., Rotte, M., Koutstaal, W., Maril, A., Dale, A. M., Rosen, B. R., & Buckner, R. L. (1998). Building memories: Remembering and forgetting of verbal experiences as predicted by brain activity. Science, 281, 1188–1191.
Wiggs, C. L., Weisberg, J., & Martin, A. (1999). Neural correlates of semantic and episodic memory retreival. Neuropsychologia, 37, 103–118.
Willingham, D. B. (1998). A neuropsychological theory of motor skill learning. Psychological Review, 105, 558–584.
Wise, S. P., Fried, I., Olivier, A., Paus, T., Rizzolati, G., & Zilles, K. J. (1996). Workshop on the anatomic definition and boundaries of the supplementary sensorimotor area. Advances in Neurology, 70, 489–495.
Woods, R. P., Grafton, S. T., Holmes, C. J., Cherry, S. R., & Mazziotta, J. C. (1998a). Auotmated image registration: I. General methods and intersubject, intramodality validation. Journal of Computer Assisted Tomography, 22, 139–152.
Woods, R. P., Grafton, S. T., Watson,. D. G., Sicotte, N. L., & Mazziotta, J. C. (1998b). Automated image registration: II. Intersubject validation of linear and nonlinear models. Journal of Computer Assisted Tomography, 22, 153–165.
Zarahn, E., Aguirre, G., & D'Esposito, M. (1997). A trial-based experimental design for fMRI. Neuroimage, 6, 122–138.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Newman, A.J., Pancheva, R., Ozawa, K. et al. An Event-Related fMRI Study of Syntactic and Semantic Violations. J Psycholinguist Res 30, 339–364 (2001). https://doi.org/10.1023/A:1010499119393
Issue Date:
DOI: https://doi.org/10.1023/A:1010499119393