Atypical processing of auditory temporal complexity in autistics
Research highlights
▶ Spectral complexity processing do not differ between autistics and non-autistics. ▶ Autistics show reduced non-primary auditory response to temporal complexity. ▶ Autistics display greater primary auditory effects related to temporal complexity.
Introduction
Behavioral evidence indicates that the cognitive architecture of visual and auditory perceptual processing may be differently organized in autism (Behrmann et al., 2006, Dakin and Frith, 2005, Mottron et al., 2006, Samson et al., 2006). The diagnostic criteria for autism (Lord et al., 1997) include signs related to both hypo- and hyper-reactivity to sounds (Grandin and Scariano, 1986, Metz, 1967, Novick et al., 1980). While autistics1 may display apparent disinterest in speech sounds, and aversive reactions to vacuum cleaner and crowd noises (Goldfarb, 1961), they may also have heightened musical interests, and enhanced auditory abilities such as superior pitch memory and pure tone discrimination (Bonnel et al., 2003, Heaton, 2003).
Auditory processing atypicalities in autism have been interpreted in two frameworks. Weak central coherence theory (Frith & Happe, 1994) hypothesizes that autistics have difficulty integrating local auditory features into larger ensembles at the global level (Kellerman et al., 2005, Nieto Del Rincon, 2008). However, reports of intact global auditory processing in autism challenge this hypothesis (Heaton, 2005, Mottron et al., 1999, Mottron et al., 2000). The enhanced perceptual functioning model (EPF) (Mottron et al., 2006) describes both the superiorities of processing local features and the intact global contour processing within hierarchical auditory patterns (e.g. melody). Moreover, this model emphasizes the link between the bias towards local elements in hierarchical auditory patterns and superior pitch detection for pure tones (Heaton, 2003, Mottron et al., 2000). However, the EPF predictions regarding the processing of psychophysically complex sounds are essentially derived from evidence reported from studies investigating early visual processing that have demonstrated superior abilities in autistics for simple, luminance-defined, information extracted by mechanisms operating within primary (V1) visual cortex (Bertone et al., 2005, Plaisted et al., 1998), and lower performance for tasks involving more complex visual processing requiring involvement of both primary (V1) and non-primary (V2, V3) regions of visual cortex (Bertone et al., 2003, Bertone et al., 2005, Blake et al., 2003, Milne et al., 2002, Pellicano et al., 2005, Vandenbroucke et al., 2009). Atypical integration between primary and non-primary regions of the visual cortex could underlie this dissociation (Bertone et al., 2005). This heuristic was recently extended to audition, resulting in predictions of differential processing by autistics for simple, compared to complex, auditory stimuli (Samson et al., 2006). In support of this idea, enhanced pitch processing has been documented in numerous behavioral (Bonnel et al., 2010, Bonnel et al., 2003, Heaton, 2003, Heaton, 2005, Jones et al., 2009, O’Riordan and Passetti, 2006) and electrophysiological studies of autistics (Ferri et al., 2003, Gomot et al., 2002, Lepisto et al., 2008, Lepisto et al., 2005). In some cases, the behavioral advantage reaches outstanding levels, extending beyond four and five standard deviations above the mean of the control group (Heaton, Davis, & Happe, 2008). Moreover, superior processing of individual sound components might underlie enhanced chord disembodying (Heaton, 2003, Miller, 1989, Mottron et al., 1999) or the unimpaired discrimination of non-social complex sounds in autistics if they were to achieve successful processing though the decomposition of complex sounds (Bonnel et al., 2010).
The relevance of studying auditory perception in autism is not limited to the peaks of ability, as most studies report diminished abilities in processing social auditory information in this population. This is the case for speech recognition in noise (Alcantara et al., 2004, Groen et al., 2009) or prosody perception (Kujala et al., 2005, Peppe et al., 2007). However, typical voice processing abilities in autistics have been reported (Boucher, Lewis, & Collis, 2000). Event-related potential studies have shown reduced cortical responses to complex speech-like sounds, including vowels (Ceponiene et al., 2003, Lepisto et al., 2005, Lepisto et al., 2006, Whitehouse and Bishop, 2008) and consonant–vowel syllables (Jansson-Verkasalo et al., 2003, Russo et al., 2009). Finally, reduced activation of the “voice area” in the superior temporal sulcus (STS) has been reported in autistic adults (Gervais et al., 2004), and a reduced leftward asymmetry has been observed for speech processing (Boddaert et al., 2003, Boddaert et al., 2004, Lepisto et al., 2005, Lepisto et al., 2006, Minagawa-Kawai et al., 2009). It is therefore plausible that atypical processing of psychophysical properties of complex sounds plays a role in the apparent disinterest for speech, evident in most autistics, at least in their early years.
As in the visual system (Grill-Spector & Malach, 2004), auditory cortical analysis is organized hierarchically, with simple feature extraction at the primary level providing input to non-primary fields that subsequently extract more complex features. This functional organization scheme receives empirical support from both animal and human studies. In non-human primates and cats, the primary or ‘core’ auditory region, located in Heschl's gyrus (HG), is more tonotopically organized by frequency, has sharper frequency tuning and shows lower thresholds to pure tones as compared to non-primary auditory fields (Merzenich and Brugge, 1973, Morel et al., 1993, Rauschecker et al., 1995, Schreiner and Cynader, 1984). The non-primary neurons within the superior temporal gyrus (STG), labeled as ‘belt’ and ‘parabelt’ auditory regions, show broader individual frequency tuning, collectively respond to a broader range of frequencies and are selectively responsive to more complex stimuli such as band-passed noise (Rauschecker et al., 1995, Recanzone, 2000). These physiological findings combined with the known anatomical connections among primary and associative auditory regions (Hackett, Stepniewska, & Kaas, 1998) lend support to hierarchical organizational accounts of information flow in non-human auditory cortex (Kaas and Hackett, 1998, Kaas and Hackett, 2000, Rauschecker, 1998). Similar organizational plans are evident in human auditory cortex. An fMRI study reported that pure tone presentation resulted in activity increases in primary auditory cortex (HG), whereas complex band-passed noise elicited activity increases extending to the surrounding non-primary auditory fields in the anterolateral aspect of HG and STG (Wessinger et al., 2001), consistent with the location of the belt region in macaques (Rauschecker, 1998). Similarly, imaging studies have consistently revealed that spectrally complex sounds, with multiple harmonic components, and temporally complex sounds, with varying frequency or amplitude in time, elicit activity increases extending to non-primary auditory areas in anterior, lateral and posterior STG, corresponding to the belt and parabelt regions (Binder et al., 2000, Giraud et al., 2000, Hall et al., 2002, Hart et al., 2003, Schonwiesner et al., 2005a, Schonwiesner and Zatorre, 2009, Thivard et al., 2000, Zatorre and Belin, 2001). Moreover, while primary areas (HG) are sensitive to acoustic variations in speech sounds, non-primary areas within anterior and posterior superior temporal regions are more responsive to abstract sound features like intelligibility than to acoustic signal variations (Okada et al., 2010), supporting the role of these non-primary fields in the processing of more complex auditory information (Rauschecker & Scott, 2009). In addition to a within-hemisphere hierarchical architecture, auditory processing models also incorporate lateralization features (Zatorre, Belin, & Penhune, 2002) mainly, a leftward asymmetry of the auditory cortical response to temporal sound variation (Belin et al., 1998, Jamison et al., 2006, Schonwiesner et al., 2005a, Zaehle et al., 2004, Zatorre and Belin, 2001) and rightward to spectral sound variation (Jamison et al., 2006, Patterson et al., 2002, Schonwiesner et al., 2005b, Zatorre and Belin, 2001).
We used fMRI to examine differential auditory cortical responses to stimuli of varying spectral and temporal complexity in autism. Before being able to account for differential behavioral performances in naturalistic situations, and specifically for atypical autistic performance in music, language and voice processing, a preliminary study exploring the effects of variation in fundamental sound properties is required. For this purpose, we exposed our participants to simple and controlled stimuli, that is pure tones, in addition to spectrally and temporally complex sounds. Although spectral and temporal acoustic features are important characteristics of more complex sounds like speech, it is important to note that the stimuli used here do not represent actual features of speech and remain very simple in comparison to components like vowels, consonants or the structure of formants.
We define sounds as spectrally complex when they include more than one frequency component or harmonic. Similar stimuli have been used to investigate cortical auditory spectral complexity processing (Hall et al., 2002, Hart et al., 2003). We define temporally complex sounds as having frequency variation over time. Similar frequency-modulated sounds have been used in imaging studies (Hall et al., 2002, Hart et al., 2003). Our experiment is novel in this regard, as we use a parametric design with three levels of temporal complexity with increasing frequency modulation depth while maintaining constant modulation rate.
On the basis of previous work in typical individuals, we predicted that sounds of higher spectral and temporal complexity would induce increased activity in primary (HG) and non-primary auditory cortex, mainly with spatial extension to anterolateral STG (Hall et al., 2002, Hart et al., 2003). Based on hypothesized reduced integration among auditory cortical regions (Bertone et al., 2005, Samson et al., 2006), autistics should exhibit reduced activity in response to complex auditory material in non-primary auditory areas, with higher sensitivity to complex sound features. Between-group effects would possibly be more important in response to temporal complexity, which is specifically important for speech recognition, particularly low modulation rates as the one used here (Houtgast and Steeneken, 1985, Tallal et al., 1993). In terms of response lateralization, we expected a rightward asymmetry associated with spectral complexity and leftward for temporal complexity.
Section snippets
Participants
Thirteen typical (TYP) and 15 autistic (AUT) participants were included in this study. There were no significant differences in mean chronological age, Wechsler IQ scored with Canadian Norms (Wechsler, 1991, Wechsler, 1997), Raven's Progressive Matrices scored with norms for North America (Burke, 1985) or manual preference (Table 1). All but one participant in each group were right-handed. All had normal hearing as measured by pure-tone audiometry and no formal musical training. TYP
Behavior
We observed no group performance differences on the sound modulation detection task (Table S1). A Group × Spectral Complexity (Non-harmonic, Harmonic) ANOVA on RT revealed no main effect of Spectral Complexity (F(1, 22) = 2.894, p = 0.103) and no main effect of Group (F(1, 22) = 1.295, p = 0.267). Similarly, the Group × Spectral Complexity ANOVA on ACC did not detect significant main effects or interactions (F < 1).
Second, a Group × Temporal Complexity (FM0, FM25, FM50, FM100) ANOVA on RT revealed a main
Functional organization of auditory complexity processing
The contrast between harmonic and single tone conditions revealed bilateral activity in HG, the location of the primary auditory cortex, with an anterolateral extension of the activity along the STG, mainly on the right. Previous studies comparing harmonic to non-harmonic tones reported either activity in both HG and lateral STG (Hall et al., 2002) or no significant activity (Hart et al., 2003). We report an anterolateral activity extension intermediate between these two studies. Similar
Acknowledgements
We thank all the participants who participated in this study, Elise B. Barbeau for helping with the testing, the staff of the Functional Neuroimaging Unit at Centre de Recherche, Institut Universitaire de Gériatrie de Montréal for their assistance as well as Anna Bonnel for helpful discussions.
This work was supported by Canadian Institutes for Health Research [Grant MOP-84243] to L.M., as well as a doctoral award from Natural Sciences and Engineering Research Council of Canada and an Autism
References (102)
- et al.
Seeing it differently: visual processing in autism
Trends in Cognitive Sciences
(2006) - et al.
Event-related fMRI of the auditory cortex
Neuroimage
(1999) - et al.
Enhanced pure-tone pitch discrimination as a special case among persons with high-functioning autism
Neuropsychologia
(2010) - et al.
Vagaries of visual perception in autism
Neuron
(2005) - et al.
The mismatch negativity and the P3a components of the auditory event-related potentials in autistic low-functioning subjects
Clinical Neurophysiology
(2003) - et al.
Autism: beyond “theory of mind”
Cognition
(1994) - et al.
Functional differentiation in the human auditory and language areas revealed by a dichotic listening task
Neuroimage
(2000) - et al.
Research note: exceptional absolute pitch perception for spoken words in an able adult with autism
Neuropsychologia
(2008) - et al.
Image distortion correction in fMRI: A quantitative evaluation
Neuroimage
(2002) - et al.
Evidence for the role of the right auditory cortex in fine pitch resolution
Neuropsychologia
(2008)
Deficient auditory processing in children with Asperger syndrome, as indexed by event-related potentials
Neuroscience Letters
Overlapping neural regions for processing rapid temporal cues in speech and nonspeech signals
Neuroimage
Neurophysiological evidence for cortical discrimination impairment of prosody in Asperger syndrome
Neuroscience Letters
The perception of invariant speech features in children with autism
Biological Psychology
The discrimination of and orienting to speech and non-speech sounds in children with autism
Brain Research
Auditory perception and attention as reflected by the brain event-related potentials in children with Asperger syndrome
Clinical Neurophysiology
An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets
Neuroimage
Representation of the cochlear partition of the superior temporal plane of the macaque monkey
Brain Research
An electrophysiologic indication of auditory processing defects in autism
Psychiatry Research
The processing of temporal pitch and melody information in auditory cortex
Neuron
Abnormal global processing along the dorsal visual pathway in autism: a possible mechanism for weak visuospatial coherence?
Neuropsychologia
Response profiles of auditory cortical neurons to tones and noise in behaving macaque monkeys
Hearing Research
Frequency-dependent responses exhibited by multiple regions in human auditory cortex
Hearing Research
A new approach to the study of detail perception in Autism Spectrum Disorder (ASD): investigating visual feedforward, horizontal and feedback processing
Vision Research
LI-tool: a new toolbox to assess lateralization in functional MR-data
Journal of Neuroscience Methods
Segmental processing in the human auditory dorsal stream
Brain Research
Speech-in-noise perception in high-functioning individuals with autism or Asperger's syndrome
Journal of Child Psychology and Psychiatry and Allied Disciplines
Lateralization of speech and auditory temporal processing
Journal of Cognitive Neuroscience
Motion perception in autism: a “complex” issue
Journal of Cognitive Neuroscience
Enhanced and diminished visuo-spatial information processing in autism depends on stimulus complexity
Brain
Human temporal lobe activation by speech and nonspeech sounds
Cerebral Cortex
Visual recognition of biological motion is impaired in children with autism
Psychological Science
Perception of complex sounds: abnormal pattern of cortical activation in autism
American Journal of Psychiatry
Perception of complex sounds in autism: abnormal auditory cortical processing in children
American Journal of Psychiatry
Enhanced pitch sensitivity in individuals with autism: a signal detection analysis
Journal of Cognitive Neuroscience
Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children
Journal of Child Psychology and Psychiatry and Allied Disciplines
Raven's progressive matrices (1938): More on norms, reliability, and validity
Journal of Clinical Psychology
Speech-sound-selective auditory impairment in children with autism: they can perceive but do not attend
Proceedings of the National Academy of Sciences of the United States of America
Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space
Journal of Computer Assisted Tomography
The human brain: surface, three-dimensional sectional anatomy, and MRI
Utilizing hemodynamic delay and dispersion to detect fMRI signal change without auditory interference: the behavior interleaved gradients technique
Magnetic Resonance in Medicine
Abnormal cortical voice processing in autism
Nature Neuroscience
Representation of the temporal envelope of sounds in the human brain
Journal of Neurophysiology
Childhood schizophrenia
Hypersensitivity to acoustic change in children with autism: electrophysiological evidence of left frontal cortex dysfunctioning
Psychophysiology
Emergence labeled autistic
The human visual cortex
Annual Review of Neuroscience
Intact spectral but abnormal temporal processing of auditory stimuli in autism
Journal of Autism and Developmental Disorders
Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys
Journal of Comparative Neurology
Modulation and task effects in auditory processing measured using fMRI
Human Brain Mapping
Cited by (52)
A comprehensive analysis towards exploring the promises of AI-related approaches in autism research
2024, Computers in Biology and MedicineA preliminary investigation of sound-field amplification as an inclusive classroom adjustment for children with and without Autism Spectrum Disorder
2021, Journal of Communication DisordersEarly childhood network alterations in severe autism
2019, Asian Journal of PsychiatryEarly enhanced processing and delayed habituation to deviance sounds in autism spectrum disorder
2018, Brain and CognitionCitation Excerpt :If this temporal pattern of activation reflects the monkey homolog to the human MMN/N1 and P3/P3a response (Gil-da-Costa, Stoner, Fung, & Albright, 2013; Paller, Zola-Morgan, Squire, & Hillyard, 1988), then by extension, our results may reflect an early enhanced perceptual and subcortical system in ASD (i.e., early N1 sensitivity) and a potentially more responsive involuntary attention system (i.e., slower P3a habituation). Additional support for this hypothesis includes evidence of increased activation within Heschl’s gyrus in response to frequency and duration (i.e., stimuli length) deviance (Samson et al., 2011), and increased prefrontal and inferior parietal activation (Gomot, Belmonte, Bullmore, Bernard, & Baron-Cohen, 2008) in response to novelty deviance. Unlike prior work reporting superior frequency discrimination in ASD (Bonnel et al., 2010; Jones et al., 2009), the overall MMN response was comparable in ASD and controls.
Gyrification changes are related to cognitive strengths in autism
2018, NeuroImage: ClinicalThe impact of atypical sensory processing on social impairments in autism spectrum disorder
2018, Developmental Cognitive NeuroscienceCitation Excerpt :The STC also underlies many non-social sensory and perceptual functions, including conscious perception of visual motion, listening to both meaningful and non-meaningful sounds, and multisensory integration (Becker et al., 2013; Lewis et al., 2004; Lapenta et al., 2012). Reduced STC activity or connectivity has also been documented in non-social sensory processing in ASD, including listening to tones and perceptual integration (Samson et al., 2011; Edgar et al., 2014; Peiker et al., 2015). In addition to the role of STC in sensory and social processes, it has been hypothesized that the many connections of the STC with primary sensory cortices, multimodal associative systems, and the limbic system, may explain its role in a diverse range of functions (Boddaert and Zilbovicius, 2002).