Elsevier

Neuropsychologia

Volume 49, Issue 3, February 2011, Pages 546-555
Neuropsychologia

Atypical processing of auditory temporal complexity in autistics

https://doi.org/10.1016/j.neuropsychologia.2010.12.033Get rights and content

Abstract

Autistics exhibit a contrasting combination of auditory behavior, with enhanced pitch processing abilities often coexisting with reduced orienting towards complex speech sounds. Based on an analogous dissociation observed in vision, we expected that autistics’ auditory behavior with respect to complex sound processing may result from atypical activity in non-primary auditory cortex. We employed fMRI to explore the neural basis of complex non-social sound processing in 15 autistic and 13 non-autistics, using a factorial design in which auditory stimuli varied in spectral and temporal complexity. Spectral complexity was modulated by varying the harmonic content, whereas temporal complexity was modulated by varying frequency modulation depth. The detection task was performed similarly by autistics and non-autistics. In both groups, increasing spectral or temporal complexity was associated with activity increases in primary (Heschl's gyrus) and non-primary (anterolateral and posterior superior temporal gyrus) auditory cortex Activity was right-lateralized for spectral and left-lateralized for temporal complexity. Increasing temporal complexity was associated with greater activity in anterolateral superior temporal gyrus in non-autistics and greater effects in Heschl's gyrus in autistics. While we observed similar hierarchical functional organization for auditory processing in both groups, autistics exhibited diminished activity in non-primary auditory cortex and increased activity in primary auditory cortex in response to the presentation of temporally, but not of spectrally complex sounds. Greater temporal complexity effects in regions sensitive to acoustic features and reduced temporal complexity effects in regions sensitive to more abstract sound features could represent a greater focus towards perceptual aspects of speech sounds in autism.

Research highlights

▶ Spectral complexity processing do not differ between autistics and non-autistics. ▶ Autistics show reduced non-primary auditory response to temporal complexity. ▶ Autistics display greater primary auditory effects related to temporal complexity.

Introduction

Behavioral evidence indicates that the cognitive architecture of visual and auditory perceptual processing may be differently organized in autism (Behrmann et al., 2006, Dakin and Frith, 2005, Mottron et al., 2006, Samson et al., 2006). The diagnostic criteria for autism (Lord et al., 1997) include signs related to both hypo- and hyper-reactivity to sounds (Grandin and Scariano, 1986, Metz, 1967, Novick et al., 1980). While autistics1 may display apparent disinterest in speech sounds, and aversive reactions to vacuum cleaner and crowd noises (Goldfarb, 1961), they may also have heightened musical interests, and enhanced auditory abilities such as superior pitch memory and pure tone discrimination (Bonnel et al., 2003, Heaton, 2003).

Auditory processing atypicalities in autism have been interpreted in two frameworks. Weak central coherence theory (Frith & Happe, 1994) hypothesizes that autistics have difficulty integrating local auditory features into larger ensembles at the global level (Kellerman et al., 2005, Nieto Del Rincon, 2008). However, reports of intact global auditory processing in autism challenge this hypothesis (Heaton, 2005, Mottron et al., 1999, Mottron et al., 2000). The enhanced perceptual functioning model (EPF) (Mottron et al., 2006) describes both the superiorities of processing local features and the intact global contour processing within hierarchical auditory patterns (e.g. melody). Moreover, this model emphasizes the link between the bias towards local elements in hierarchical auditory patterns and superior pitch detection for pure tones (Heaton, 2003, Mottron et al., 2000). However, the EPF predictions regarding the processing of psychophysically complex sounds are essentially derived from evidence reported from studies investigating early visual processing that have demonstrated superior abilities in autistics for simple, luminance-defined, information extracted by mechanisms operating within primary (V1) visual cortex (Bertone et al., 2005, Plaisted et al., 1998), and lower performance for tasks involving more complex visual processing requiring involvement of both primary (V1) and non-primary (V2, V3) regions of visual cortex (Bertone et al., 2003, Bertone et al., 2005, Blake et al., 2003, Milne et al., 2002, Pellicano et al., 2005, Vandenbroucke et al., 2009). Atypical integration between primary and non-primary regions of the visual cortex could underlie this dissociation (Bertone et al., 2005). This heuristic was recently extended to audition, resulting in predictions of differential processing by autistics for simple, compared to complex, auditory stimuli (Samson et al., 2006). In support of this idea, enhanced pitch processing has been documented in numerous behavioral (Bonnel et al., 2010, Bonnel et al., 2003, Heaton, 2003, Heaton, 2005, Jones et al., 2009, O’Riordan and Passetti, 2006) and electrophysiological studies of autistics (Ferri et al., 2003, Gomot et al., 2002, Lepisto et al., 2008, Lepisto et al., 2005). In some cases, the behavioral advantage reaches outstanding levels, extending beyond four and five standard deviations above the mean of the control group (Heaton, Davis, & Happe, 2008). Moreover, superior processing of individual sound components might underlie enhanced chord disembodying (Heaton, 2003, Miller, 1989, Mottron et al., 1999) or the unimpaired discrimination of non-social complex sounds in autistics if they were to achieve successful processing though the decomposition of complex sounds (Bonnel et al., 2010).

The relevance of studying auditory perception in autism is not limited to the peaks of ability, as most studies report diminished abilities in processing social auditory information in this population. This is the case for speech recognition in noise (Alcantara et al., 2004, Groen et al., 2009) or prosody perception (Kujala et al., 2005, Peppe et al., 2007). However, typical voice processing abilities in autistics have been reported (Boucher, Lewis, & Collis, 2000). Event-related potential studies have shown reduced cortical responses to complex speech-like sounds, including vowels (Ceponiene et al., 2003, Lepisto et al., 2005, Lepisto et al., 2006, Whitehouse and Bishop, 2008) and consonant–vowel syllables (Jansson-Verkasalo et al., 2003, Russo et al., 2009). Finally, reduced activation of the “voice area” in the superior temporal sulcus (STS) has been reported in autistic adults (Gervais et al., 2004), and a reduced leftward asymmetry has been observed for speech processing (Boddaert et al., 2003, Boddaert et al., 2004, Lepisto et al., 2005, Lepisto et al., 2006, Minagawa-Kawai et al., 2009). It is therefore plausible that atypical processing of psychophysical properties of complex sounds plays a role in the apparent disinterest for speech, evident in most autistics, at least in their early years.

As in the visual system (Grill-Spector & Malach, 2004), auditory cortical analysis is organized hierarchically, with simple feature extraction at the primary level providing input to non-primary fields that subsequently extract more complex features. This functional organization scheme receives empirical support from both animal and human studies. In non-human primates and cats, the primary or ‘core’ auditory region, located in Heschl's gyrus (HG), is more tonotopically organized by frequency, has sharper frequency tuning and shows lower thresholds to pure tones as compared to non-primary auditory fields (Merzenich and Brugge, 1973, Morel et al., 1993, Rauschecker et al., 1995, Schreiner and Cynader, 1984). The non-primary neurons within the superior temporal gyrus (STG), labeled as ‘belt’ and ‘parabelt’ auditory regions, show broader individual frequency tuning, collectively respond to a broader range of frequencies and are selectively responsive to more complex stimuli such as band-passed noise (Rauschecker et al., 1995, Recanzone, 2000). These physiological findings combined with the known anatomical connections among primary and associative auditory regions (Hackett, Stepniewska, & Kaas, 1998) lend support to hierarchical organizational accounts of information flow in non-human auditory cortex (Kaas and Hackett, 1998, Kaas and Hackett, 2000, Rauschecker, 1998). Similar organizational plans are evident in human auditory cortex. An fMRI study reported that pure tone presentation resulted in activity increases in primary auditory cortex (HG), whereas complex band-passed noise elicited activity increases extending to the surrounding non-primary auditory fields in the anterolateral aspect of HG and STG (Wessinger et al., 2001), consistent with the location of the belt region in macaques (Rauschecker, 1998). Similarly, imaging studies have consistently revealed that spectrally complex sounds, with multiple harmonic components, and temporally complex sounds, with varying frequency or amplitude in time, elicit activity increases extending to non-primary auditory areas in anterior, lateral and posterior STG, corresponding to the belt and parabelt regions (Binder et al., 2000, Giraud et al., 2000, Hall et al., 2002, Hart et al., 2003, Schonwiesner et al., 2005a, Schonwiesner and Zatorre, 2009, Thivard et al., 2000, Zatorre and Belin, 2001). Moreover, while primary areas (HG) are sensitive to acoustic variations in speech sounds, non-primary areas within anterior and posterior superior temporal regions are more responsive to abstract sound features like intelligibility than to acoustic signal variations (Okada et al., 2010), supporting the role of these non-primary fields in the processing of more complex auditory information (Rauschecker & Scott, 2009). In addition to a within-hemisphere hierarchical architecture, auditory processing models also incorporate lateralization features (Zatorre, Belin, & Penhune, 2002) mainly, a leftward asymmetry of the auditory cortical response to temporal sound variation (Belin et al., 1998, Jamison et al., 2006, Schonwiesner et al., 2005a, Zaehle et al., 2004, Zatorre and Belin, 2001) and rightward to spectral sound variation (Jamison et al., 2006, Patterson et al., 2002, Schonwiesner et al., 2005b, Zatorre and Belin, 2001).

We used fMRI to examine differential auditory cortical responses to stimuli of varying spectral and temporal complexity in autism. Before being able to account for differential behavioral performances in naturalistic situations, and specifically for atypical autistic performance in music, language and voice processing, a preliminary study exploring the effects of variation in fundamental sound properties is required. For this purpose, we exposed our participants to simple and controlled stimuli, that is pure tones, in addition to spectrally and temporally complex sounds. Although spectral and temporal acoustic features are important characteristics of more complex sounds like speech, it is important to note that the stimuli used here do not represent actual features of speech and remain very simple in comparison to components like vowels, consonants or the structure of formants.

We define sounds as spectrally complex when they include more than one frequency component or harmonic. Similar stimuli have been used to investigate cortical auditory spectral complexity processing (Hall et al., 2002, Hart et al., 2003). We define temporally complex sounds as having frequency variation over time. Similar frequency-modulated sounds have been used in imaging studies (Hall et al., 2002, Hart et al., 2003). Our experiment is novel in this regard, as we use a parametric design with three levels of temporal complexity with increasing frequency modulation depth while maintaining constant modulation rate.

On the basis of previous work in typical individuals, we predicted that sounds of higher spectral and temporal complexity would induce increased activity in primary (HG) and non-primary auditory cortex, mainly with spatial extension to anterolateral STG (Hall et al., 2002, Hart et al., 2003). Based on hypothesized reduced integration among auditory cortical regions (Bertone et al., 2005, Samson et al., 2006), autistics should exhibit reduced activity in response to complex auditory material in non-primary auditory areas, with higher sensitivity to complex sound features. Between-group effects would possibly be more important in response to temporal complexity, which is specifically important for speech recognition, particularly low modulation rates as the one used here (Houtgast and Steeneken, 1985, Tallal et al., 1993). In terms of response lateralization, we expected a rightward asymmetry associated with spectral complexity and leftward for temporal complexity.

Section snippets

Participants

Thirteen typical (TYP) and 15 autistic (AUT) participants were included in this study. There were no significant differences in mean chronological age, Wechsler IQ scored with Canadian Norms (Wechsler, 1991, Wechsler, 1997), Raven's Progressive Matrices scored with norms for North America (Burke, 1985) or manual preference (Table 1). All but one participant in each group were right-handed. All had normal hearing as measured by pure-tone audiometry and no formal musical training. TYP

Behavior

We observed no group performance differences on the sound modulation detection task (Table S1). A Group × Spectral Complexity (Non-harmonic, Harmonic) ANOVA on RT revealed no main effect of Spectral Complexity (F(1, 22) = 2.894, p = 0.103) and no main effect of Group (F(1, 22) = 1.295, p = 0.267). Similarly, the Group × Spectral Complexity ANOVA on ACC did not detect significant main effects or interactions (F < 1).

Second, a Group × Temporal Complexity (FM0, FM25, FM50, FM100) ANOVA on RT revealed a main

Functional organization of auditory complexity processing

The contrast between harmonic and single tone conditions revealed bilateral activity in HG, the location of the primary auditory cortex, with an anterolateral extension of the activity along the STG, mainly on the right. Previous studies comparing harmonic to non-harmonic tones reported either activity in both HG and lateral STG (Hall et al., 2002) or no significant activity (Hart et al., 2003). We report an anterolateral activity extension intermediate between these two studies. Similar

Acknowledgements

We thank all the participants who participated in this study, Elise B. Barbeau for helping with the testing, the staff of the Functional Neuroimaging Unit at Centre de Recherche, Institut Universitaire de Gériatrie de Montréal for their assistance as well as Anna Bonnel for helpful discussions.

This work was supported by Canadian Institutes for Health Research [Grant MOP-84243] to L.M., as well as a doctoral award from Natural Sciences and Engineering Research Council of Canada and an Autism

References (102)

  • E. Jansson-Verkasalo et al.

    Deficient auditory processing in children with Asperger syndrome, as indexed by event-related potentials

    Neuroscience Letters

    (2003)
  • M.F. Joanisse et al.

    Overlapping neural regions for processing rapid temporal cues in speech and nonspeech signals

    Neuroimage

    (2003)
  • T. Kujala et al.

    Neurophysiological evidence for cortical discrimination impairment of prosody in Asperger syndrome

    Neuroscience Letters

    (2005)
  • T. Lepisto et al.

    The perception of invariant speech features in children with autism

    Biological Psychology

    (2008)
  • T. Lepisto et al.

    The discrimination of and orienting to speech and non-speech sounds in children with autism

    Brain Research

    (2005)
  • T. Lepisto et al.

    Auditory perception and attention as reflected by the brain event-related potentials in children with Asperger syndrome

    Clinical Neurophysiology

    (2006)
  • J.A. Maldjian et al.

    An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets

    Neuroimage

    (2003)
  • M.M. Merzenich et al.

    Representation of the cochlear partition of the superior temporal plane of the macaque monkey

    Brain Research

    (1973)
  • B. Novick et al.

    An electrophysiologic indication of auditory processing defects in autism

    Psychiatry Research

    (1980)
  • R.D. Patterson et al.

    The processing of temporal pitch and melody information in auditory cortex

    Neuron

    (2002)
  • E. Pellicano et al.

    Abnormal global processing along the dorsal visual pathway in autism: a possible mechanism for weak visuospatial coherence?

    Neuropsychologia

    (2005)
  • G.H. Recanzone

    Response profiles of auditory cortical neurons to tones and noise in behaving macaque monkeys

    Hearing Research

    (2000)
  • T.M. Talavage et al.

    Frequency-dependent responses exhibited by multiple regions in human auditory cortex

    Hearing Research

    (2000)
  • M.W. Vandenbroucke et al.

    A new approach to the study of detail perception in Autism Spectrum Disorder (ASD): investigating visual feedforward, horizontal and feedback processing

    Vision Research

    (2009)
  • M. Wilke et al.

    LI-tool: a new toolbox to assess lateralization in functional MR-data

    Journal of Neuroscience Methods

    (2007)
  • T. Zaehle et al.

    Segmental processing in the human auditory dorsal stream

    Brain Research

    (2008)
  • J.I. Alcantara et al.

    Speech-in-noise perception in high-functioning individuals with autism or Asperger's syndrome

    Journal of Child Psychology and Psychiatry and Allied Disciplines

    (2004)
  • P. Belin et al.

    Lateralization of speech and auditory temporal processing

    Journal of Cognitive Neuroscience

    (1998)
  • A. Bertone et al.

    Motion perception in autism: a “complex” issue

    Journal of Cognitive Neuroscience

    (2003)
  • A. Bertone et al.

    Enhanced and diminished visuo-spatial information processing in autism depends on stimulus complexity

    Brain

    (2005)
  • J.R. Binder et al.

    Human temporal lobe activation by speech and nonspeech sounds

    Cerebral Cortex

    (2000)
  • R. Blake et al.

    Visual recognition of biological motion is impaired in children with autism

    Psychological Science

    (2003)
  • N. Boddaert et al.

    Perception of complex sounds: abnormal pattern of cortical activation in autism

    American Journal of Psychiatry

    (2003)
  • N. Boddaert et al.

    Perception of complex sounds in autism: abnormal auditory cortical processing in children

    American Journal of Psychiatry

    (2004)
  • A. Bonnel et al.

    Enhanced pitch sensitivity in individuals with autism: a signal detection analysis

    Journal of Cognitive Neuroscience

    (2003)
  • J. Boucher et al.

    Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children

    Journal of Child Psychology and Psychiatry and Allied Disciplines

    (2000)
  • H.R. Burke

    Raven's progressive matrices (1938): More on norms, reliability, and validity

    Journal of Clinical Psychology

    (1985)
  • R. Ceponiene et al.

    Speech-sound-selective auditory impairment in children with autism: they can perceive but do not attend

    Proceedings of the National Academy of Sciences of the United States of America

    (2003)
  • D.L. Collins et al.

    Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space

    Journal of Computer Assisted Tomography

    (1994)
  • H.M. Duvernoy et al.

    The human brain: surface, three-dimensional sectional anatomy, and MRI

    (1991)
  • G.F. Eden et al.

    Utilizing hemodynamic delay and dispersion to detect fMRI signal change without auditory interference: the behavior interleaved gradients technique

    Magnetic Resonance in Medicine

    (1999)
  • H. Gervais et al.

    Abnormal cortical voice processing in autism

    Nature Neuroscience

    (2004)
  • A.L. Giraud et al.

    Representation of the temporal envelope of sounds in the human brain

    Journal of Neurophysiology

    (2000)
  • W. Goldfarb

    Childhood schizophrenia

    (1961)
  • M. Gomot et al.

    Hypersensitivity to acoustic change in children with autism: electrophysiological evidence of left frontal cortex dysfunctioning

    Psychophysiology

    (2002)
  • T. Grandin et al.

    Emergence labeled autistic

    (1986)
  • K. Grill-Spector et al.

    The human visual cortex

    Annual Review of Neuroscience

    (2004)
  • W.B. Groen et al.

    Intact spectral but abnormal temporal processing of auditory stimuli in autism

    Journal of Autism and Developmental Disorders

    (2009)
  • T.A. Hackett et al.

    Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys

    Journal of Comparative Neurology

    (1998)
  • D.A. Hall et al.

    Modulation and task effects in auditory processing measured using fMRI

    Human Brain Mapping

    (2000)
  • Cited by (52)

    • Early enhanced processing and delayed habituation to deviance sounds in autism spectrum disorder

      2018, Brain and Cognition
      Citation Excerpt :

      If this temporal pattern of activation reflects the monkey homolog to the human MMN/N1 and P3/P3a response (Gil-da-Costa, Stoner, Fung, & Albright, 2013; Paller, Zola-Morgan, Squire, & Hillyard, 1988), then by extension, our results may reflect an early enhanced perceptual and subcortical system in ASD (i.e., early N1 sensitivity) and a potentially more responsive involuntary attention system (i.e., slower P3a habituation). Additional support for this hypothesis includes evidence of increased activation within Heschl’s gyrus in response to frequency and duration (i.e., stimuli length) deviance (Samson et al., 2011), and increased prefrontal and inferior parietal activation (Gomot, Belmonte, Bullmore, Bernard, & Baron-Cohen, 2008) in response to novelty deviance. Unlike prior work reporting superior frequency discrimination in ASD (Bonnel et al., 2010; Jones et al., 2009), the overall MMN response was comparable in ASD and controls.

    • The impact of atypical sensory processing on social impairments in autism spectrum disorder

      2018, Developmental Cognitive Neuroscience
      Citation Excerpt :

      The STC also underlies many non-social sensory and perceptual functions, including conscious perception of visual motion, listening to both meaningful and non-meaningful sounds, and multisensory integration (Becker et al., 2013; Lewis et al., 2004; Lapenta et al., 2012). Reduced STC activity or connectivity has also been documented in non-social sensory processing in ASD, including listening to tones and perceptual integration (Samson et al., 2011; Edgar et al., 2014; Peiker et al., 2015). In addition to the role of STC in sensory and social processes, it has been hypothesized that the many connections of the STC with primary sensory cortices, multimodal associative systems, and the limbic system, may explain its role in a diverse range of functions (Boddaert and Zilbovicius, 2002).

    View all citing articles on Scopus
    View full text