Adult-like processing of naturalistic sounds in auditory cortex by 3- and 9-month old infants
Introduction
In their first months, human infants show surprisingly sophisticated auditory perception, with a predisposition to listen to speech (Vouloumanos and Werker, 2004, Vouloumanos and Werker, 2007) and the ability to discriminate subtle phonetic contrasts in native (Trehub and Rabinovitch, 1972, Trehub, 1973, Eimas, 1975) and in non-native languages (Werker and Tees, 1984). They can discriminate between the voices of different speakers, such as their mother's and a strangers’ voice (DeCasper and Fifer, 1980), and even generalize speech sounds across talkers (Kuhl, 1979, Jusczyk et al., 1992). It is surprising that young infants can perform these complex feats, considering that the cortical auditory system – the network of brain regions that supports complex auditory processing in adults, and its afferent connections – is immature at the time of birth, and it is not until 4.5–6 postnatal months that the differentiation of cortical layers and the myelination of thalamocortical projections are visible in auditory cortex (Moore and Guan, 2001, Moore and Linthicum, 2007). From these observations, some researchers have suggested that early auditory abilities are facilitated mostly by subcortical auditory processing (Moore, 2002, Eggermont and Moore, 2012). This seems unlikely given that functional neuroimaging has shown cortical responses evoked by sound in fetuses (Moore et al., 2001, Draganova et al., 2005, Holst et al., 2005, Eswaran et al., 2007, Jardri et al., 2008), infants born very prematurely (Mahmoudzadeh et al., 2013, Mahmoudzadeh et al., 2016), newborns (Cheour-Luhtanen et al., 1995a, Cheour et al., 1998a, Anderson et al., 2001, Peña et al., 2003, Kotilahti et al., 2010, Perani et al., 2010, Perani et al., 2011, Baldoli et al., 2014) and 3-month olds (Dehaene-Lambertz et al., 2002, Dehaene-Lambertz et al., 2006, Dehaene-Lambertz et al., 2010, Blasi et al., 2011a). What has not been established, however, is the functional role of developing auditory cortex – the auditory features it represents, and the maturity of these responses, which remain unclear.
Some studies have asked whether the immature auditory cortex of very young infants is capable of speech-specific processing. They have found that responses differ in magnitude between speech and non-speech sounds (Dehaene-Lambertz et al., 2002, Dehaene-Lambertz et al., 2010, Peña et al., 2003, Homae et al., 2011, Minagawa-Kawai et al., 2011, Perani et al., 2011, Sato et al., 2011, Shultz et al., 2014), or between different kinds of speech sounds, such as different phonemes (Cheour-Luhtanen et al., 1995b, Cheour et al., 1998b, Mahmoudzadeh et al., 2013, Mahmoudzadeh et al., 2016, Kuhl et al., 2014), or languages (Minagawa-Kawai et al., 2011, Sato et al., 2011, Vannasing et al., 2016). However, the conclusion that these differences in responses reflect speech specificity is confounded by the fact that different sounds differ in their basic acoustic features such as acoustic envelope, pitch, and frequency. Adult auditory cortex is known to be exquisitely sensitive to these simple features (Giraud et al., 2000, Hall et al., 2002a, Patterson et al., 2002, Nourski et al., 2009, Linke et al., 2011a, Kubanek et al., 2013), and so neuroimaging researchers of adult speech perception often go to great lengths to create well controlled acoustic stimuli (Scott et al., 2000, Remez et al., 2001, Sohoglu et al., 2012, Wild et al., 2012a). Because of poor auditory control in infant studies (e.g., forwards vs. backwards speech, or even speech vs. silence), or presentation of a very few sounds in a highly stereotyped sequence (e.g., a train of ‘/ga’ with the occasional ‘/ba’), we still cannot determine which acoustic features drive cortical responses in very young brains. Do these responses reflect differences in simple acoustic features, more complex auditory representations (e.g., phonemes), or tuning to a variety of auditory features?
Furthermore, does the feature tuning of infant auditory cortex appear adult-like? If presented with naturalistic sounds, is the infant cortex driven by the same kinds of auditory features, and in the same way, as the mature auditory cortex? One tantalizing observation from infant functional magnetic resonance imaging (fMRI) is that the spatial distribution of auditory activity resembles that seen in adults (Dehaene-Lambertz et al., 2002, Dehaene-Lambertz et al., 2006, Perani et al., 2011, Shultz et al., 2014). While one can conclude that similar cortical regions process sound in infants and adults, we cannot conclude that they function similarly. For example, It is well known that the functional mismatch response (MMR) – the most common tool for studying infant perception with electroencephalography (EEG) – undergoes significant change in the first six months after birth to become more adult-like (Trainor et al., 2003, He et al., 2007a), which suggests that cortical auditory responses in early infancy are immature, and perhaps quite distinct in function. Yet, alternatively the differences in the morphology of auditory evoked responses might reflect the influence of immature physiology of the coupling between neural activity and the measured signal (Trainor et al., 2003, Eggermont and Moore, 2012), rather than underlying differences in function.
We conducted an experiment to address these unresolved questions about auditory cortex function in early infancy. What acoustic features does auditory cortex process? Is there evidence for tuning to complex in addition to simple acoustic features? Do auditory responses in infant auditory cortex resemble adult cortical responses? We used fMRI to isolate and characterize, in infants (at 3- and 9-months of age) and adults, the responses in auditory cortex evoked by rich and naturalistic sounds that are engaging to infants – sung lullabies. These infant age groups were selected because around six months after birth is considered to be a turning point in terms of auditory perception (e.g., the beginning of a shift from universal to language-specific perception, Werker and Tees, 1984) and anatomical development (e.g., mylenation of thalmocortical projections, Moore and Guan, 2001). We therefore expected to see developmental differences in how auditory cortex responses to rich sounds; for example, perhaps these perceptual and anatomical changes are accompanied by more mature-like processing in auditory cortex. We developed a novel analysis technique, inter-subject regression (ISR), which specifically allowed us to answer these questions. ISR combines the hypothesis-driven general linear model (GLM) with the model-free approach of inter-subject correlation (ISC) (Hasson et al., 2004) in order decompose brain activity into components that reflect different aspects of naturalistic auditory processing. Brain responses driven by simple acoustic features, such as amplitude envelope, pitch, and frequency, were directly modelled from the stimulus (as in a conventional GLM), whereas more complex brain responses to abstract features were identified as the component of evoked response shared by all listeners that could not be attributed to the simple features. Importantly, ISR allowed us to directly measure the similarity of the timecourse of brain activity between infants and adults, while accounting for age-related differences in the hemodynamic response function (HRF) (Arichi et al., 2012) that would make their evoked brain responses appear to be dissimilar. We hypothesized that adult auditory cortex would be sensitive to low-level acoustic features and show coding of more complex features of the rich acoustic stimuli. We also hypothesized that, despite immature cortical anatomy, we would observe reliable tuning to these features at 3 months of age, and that these responses would be somewhat similar to adults. Furthermore, we expected to observe maturational changes in the first year, so that by 9-months, auditory responses would be even more adult-like.
Section snippets
Subjects
Two groups of infants at different ages (3- and 9-months old) were recruited to undergo MRI scanning. These ages were chosen because they fall before and after 6-months – a time that has been proposed to be associated with increasing cortical connectivity (Moore and Guan, 2001, Moore and Linthicum, 2007) and the beginning of significant changes in auditory perception (Kuhl et al., 2008, Werker and Hensch, 2014).
Twenty-four 3-month old infants were recruited, but only six useable fMRI data sets
Results
We first examined whether the temporal pattern of activity in auditory cortex evoked by a series of 15-second lullabies was consistent across adult individuals. All listeners heard the same lullabies in the same order, so that we could assess the inter-subject synchronization in the evoked fMRI signal. A multiple regression model (i.e., the inter-subject regression model) was constructed for each subject (and each hemisphere), using leave-one-subject-out cross validation to assess the
Discussion
These results show that infant auditory cortex at 3- and 9-months of age responds to sequences of rich and naturalistic sounds (sung lullabies) in a way that is similar to adult auditory cortex, and thus that it is capable of performing some mature complex auditory processing despite the apparent immaturity of its structure and afferent connectivity. Importantly, we found that the similarity in these temporal patterns of auditory-evoked activity was not driven by trivial aspects of the
Conflict of interest
The authors have no conflicts of interest to disclose.
Acknowledgements
This research was supported by the Canada Excellence Research Chair (CERC 215063) in Cognitive Neuroimaging, a Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery Grant (NSERC 418293DG-2012), CIHR/NSERC Collaborative Health Research Project (CHRP 201110CPG). We thank the families and infants who participated in our study, the MRI technicians at the Robarts Research Institute Centre for Metabolic Mapping at Western University, London, Ontario, Canada
References (105)
- et al.
The variability of human, BOLD hemodynamic responses
Neuroimage
(1998) - et al.
Neonatal auditory activation detected by functional magnetic resonance imaging
Magn. Reson Imaging
(2001) - et al.
NeuroImage development of BOLD signal hemodynamic responses in the human brain
Neuroimage
(2012) - et al.
Unified segmentation
Neuroimage
(2005) - et al.
The acquisition of abstract words by young infants
Cognition
(2013) - et al.
Cortical auditory processing in preterm newborns: an ERP study
Biol. Psychol.
(2009) - et al.
Early specialization for voice and emotion processing in the infant brain
Curr. Biol.
(2011) - et al.
Early specialization for voice and emotion processing in the infant brain
Curr. Biol.
(2011) - et al.
Mismatch negativity indicates vowel discrimination in newborns
Hear Res.
(1995) - et al.
Mismatch negativity indicates vowel discrimination in newborns
Hear Res.
(1995)
Altered Processing of Acoustic Stimuli during Sleep: reduced Auditory Activation and Visual Deactivation Detected by a Combined fMRI/EEG Study
Neuroimage
Language or music, mother or Mozart? Structural and environmental influences on infants' language networks
Brain Lang.
Sound frequency change detection in fetuses and newborns, a magnetoencephalographic study
Neuroimage
Non-invasive detection and identification of brain activity patterns in the developing fetus
Clin. Neurophysiol.
Development of auditory evoked fields in human fetuses and newborns: a longitudinal MEG study
Clin. Neurophysiol.
Fetal cortical activation to sound at 33 weeks of gestation: a functional MRI study
Neuroimage
Brain Mechanisms in Early Language Acquisition
Neuron
Specific language and reading skills in school-aged children and adolescents are associated with prematurity after controlling for IQ
Neuropsychologia
Representations of the temporal envelope of sounds in human auditory cortex: can the results from invasive intracortical “depth” electrode recordings be replicated using non-invasive MEG “virtual electrodes”?
Neuroimage
Mismatch negativity to speech stimuli in 8-month-old infants and adults
Int J. Psychophysiol.
The processing of temporal pitch and melody information in auditory cortex
Neuron
Frequency-dependent responses exhibited by multiple regions in human auditory cortex
Hear Res.
Changes in auditory cortex and the development of mismatch negativity between 2 and 6 months of age
Int J. Psychophysiol.
Distinct hemispheric specializations for native and non-native languages in one-day-old newborns identified by fNIRS
Neuropsychologia
Neural correlates of successful semantic processing during propofol sedation
Hum. Brain Mapp.
Maturation of preterm newborn brains: a fMRI-DTI study of auditory processing of linguistic stimuli and white matter development
Brain Struct. Funct.
At 6-9 months, human infants know the meanings of many common nouns
Proc. Natl. Acad. Sci. USA.
Colored noise and computational inference in fMRI time series analysis: resampling methods in time and wavelet domains Slnstitute of Psychiatry KCL, London UK
Hum. Brain Mapp.
Neural activity during natural viewing of sesame street statistically predicts test scores in early childhood
PLoS Biol.
Adult talk in the NICU with preterm infants and developmental outcomes
Pediatrics
Categorical speech representation in human superior temporal gyrus
Nat. Neurosci.
Development of language-specific phoneme representations in the infant brain
Nat. ….
Development of language-specific phoneme representations in the infant brain
Nat. ….
Automatic analysis (aa): efficient neuroimaging workflows and parallel processing using Matlab and XML
Front Neuroinform.
Optimizing stimulation and analysis protocols for neonatal fMRI
PLoS One
Dissociating speech perception and comprehension at reduced levels of awareness
Proc. Natl. Acad. Sci.
Hierarchical processing in spoken language comprehension
J. Neurosci.
Of human bonding: newborns prefer their mothers' voices
Sci. (80-).
Functional neuroimaging of speech perception in infants
Science
Functional organization of perisylvian activation during presentation of sentences in preverbal infants
Proc. Natl. Acad. Sci. USA
Propofol attenuates responses of the auditory cortex to acoustic stimulation in a dose-dependent manner: a FMRI study
Acta Anaesthesiol. Scand.
Morphological and Functional Development of the Auditory Nervous System
Auditory and phonetic coding of the cues for speech: discrimination of the [r-l] distinction by young infants
Percept. Psychophys.
Multiplexed echo planar imaging for sub-second whole brain FMRI and fast diffusion imaging
PLoS One
Representation of the temporal envelope of sounds in the human brain
J. Neurophysiol.
“sparse” temporal sampling in auditory fMRI
Hum. Brain Mapp.
Spectral and Temporal Processing in Human Auditory Cortex
Cereb. Cortex.
Spectral and temporal processing in human auditory cortex
Cereb. Cortex.
Pitch processing sites in the human auditory brain
Cereb. Cortex.
Intersubject synchronization of cortical activity DuringNatural vision
Science (80-)
Cited by (21)
Voice categorization in the four-month-old human brain
2024, Current BiologyInfant neuroscience: how to measure brain activity in the youngest minds
2024, Trends in NeurosciencesFunctional MRI responses to naturalistic stimuli are increasingly typical across early childhood
2023, Developmental Cognitive NeuroscienceHomogenization of face neural representation during development
2021, Developmental Cognitive NeuroscienceCitation Excerpt :This finding is in line with prior research that has shown a more variable brain response to faces and scenes in children (e.g., Passarotti et al., 2003; Golarai et al., 2007; Scherf et al., 2007; Moraczewski et al., 2018). Besides, previous studies have found that typical adults usually show higher neural similarity, while individuals with brain immaturity, aging, and psychiatric disorders are accompanied by higher neural variability (lower similarity) (Hasson et al., 2009; Cantlon and Li, 2013; Campbell et al., 2015; Hahamy et al., 2015; Wild et al., 2017). It may be the accumulation of largely shared experience and adoption of similar effective strategies in typical development process that lead to the higher neural similarity in typical adult group.