Elsevier

NeuroImage

Volume 102, Part 2, 15 November 2014, Pages 484-497
NeuroImage

Fine-grained stimulus representations in body selective areas of human occipito-temporal cortex

https://doi.org/10.1016/j.neuroimage.2014.07.066Get rights and content

Highlights

  • Body areas primarily distinguish bodies from non-body stimuli.

  • Body areas contain information to discriminate also non-preferred stimuli.

  • Increasing specificity from EBA to FBA.

  • Category representation varies with location within OTC.

  • Support for functional homologies between human and monkey body areas.

Abstract

Neurophysiological and functional imaging studies have investigated the representation of animate and inanimate stimulus classes in monkey inferior temporal (IT) and human occipito-temporal cortex (OTC). These studies proposed a distributed representation of stimulus categories across IT and OTC and at the same time highlighted category specific modules for the processing of bodies, faces and objects. Here, we investigated whether the stimulus representation within the extrastriate (EBA) and the fusiform (FBA) body areas differed from the representation across OTC. To address this question, we performed an event-related fMRI experiment, evaluating the pattern of activation elicited by 200 individual stimuli that had already been extensively tested in our earlier monkey imaging and single cell studies (Popivanov et al., 2012, 2014). The set contained achromatic images of headless monkey and human bodies, two sets of man-made objects, monkey and human faces, four-legged mammals, birds, fruits, and sculptures. The fMRI response patterns within EBA and FBA primarily distinguished bodies from non-body stimuli, with subtle differences between the areas. However, despite responding on average stronger to bodies than to other categories, classification performance for preferred and non-preferred categories was comparable. OTC primarily distinguished animate from inanimate stimuli. However, cluster analysis revealed a much more fine-grained representation with several homogeneous clusters consisting entirely of stimuli of individual categories. Overall, our data suggest that category representation varies with location within OTC. Nevertheless, body modules contain information to discriminate also non-preferred stimuli and show an increasing specificity in a posterior to anterior gradient.

Introduction

In our everyday life, we encounter numerous visual stimuli we can easily identify. Neurons sensitive to object properties relevant for identification and categorization have been described in monkey inferior temporal cortex (IT) and are thought to be present in human occipito-temporal cortex (OTC) (Kourtzi and Connor, 2011). Kiani et al. (2007) recorded neural responses across anterior IT cortex to natural and artificial object images. They found that the categorical structure of the objects was represented by the pattern of activity distributed over the cell population. The major distinction was present between animate and inanimate objects; nevertheless, the category of animate objects was further divided into faces and bodies, which were divided further into several finer grained categories like human faces and monkey faces, or human bodies and four-limbed animal bodies. This organization seems to be similar at least at the core structure in human OTC, where a primary animate–inanimate organization with further sub-division of the animate category into faces and bodies has been reported (Caramazza and Shelton, 1998, Cichy et al., 2014, Connolly et al., 2012, Huth et al., 2012, Kriegeskorte et al., 2008). Whereas several studies have investigated the organization of IT/OTC with respect to different categories, much less is known about their representation within individual face and body selective regions. Yet, comparing the representation within category selective regions with the representation across whole IT/OTC might shed new light on the discussion of modular versus distributed coding of object information in general (Haxby et al., 2001, Reddy and Kanwisher, 2006).

Electrophysiological studies reported a high fraction of face-selective cells and strong face category selectivity within fMRI defined face patches (Issa and DiCarlo, 2012, Tsao et al., 2006). The same conclusion was also drawn from fMRI experiments in monkeys and humans focusing on face selective patches in IT and OTC respectively (Liu et al., 2013, Reddy and Kanwisher, 2006). These results seemed to favor a modular organization with respect to faces. However, little is known about the categorical structure within body selective regions. Two single cell studies of the middle (Popivanov et al., 2014) and presumably anterior (Bell et al., 2011) superior temporal sulcus (STS) body patches in monkeys reported that the majority of neurons responded stronger to body compared to non-body stimuli. However, the selectivity for body stimuli was much lower compared to the one reported for faces in the face patches. Also, both studies reported single cells within the body patches that were highly selective for other categories. Consequently cluster analysis in the mid STS body patch showed an initial clustering of body versus non-body stimuli, where the non-body cluster in turn contained two distinct sub-clusters, perfectly separating faces from inanimate objects (Popivanov et al., 2014). How these results translate to the human is presently unknown, because fine grained stimulus clustering in the extrastriate (EBA (Downing et al., 2001)) and the fusiform (FBA, (Peelen and Downing, 2005, Schwarzlose et al., 2005)) body areas has not been investigated till date.

To address this issue, we collected individual human fMRI responses to 200 stimuli showing monkey and human bodies and faces, four-legged mammals, birds, fruits, sculptures and man-made objects. The stimulus set was identical to the one used in our previous monkey imaging and single cell studies (Popivanov et al., 2012, Popivanov et al., 2014). We compared the representational similarity among these stimuli at the fMRI voxel level within body selective regions and also across whole human OTC to investigate the following questions: 1) What is the fine grained categorical structure representing a large number of animate and inanimate objects in EBA and FBA, 2) is there any difference in the representation between body selective regions and whole OTC and finally, 3) can we use the representational structure to address potential homologies between human and monkey body-selective regions?

Section snippets

Participants

Eight volunteers (4 females, mean age 25 years, range 23–32 years) participated in the experiment. All participants were right-handed, had normal or corrected-to-normal visual acuity and no history of mental illness or neurological diseases. The study was approved by the Ethical Committee of KU Leuven Medical School and all volunteers gave their written informed consent in accordance with the Helsinki Declaration prior to the experiment. One subject (male) was excluded from the analysis, because

Results

The first goal of this study was to investigate how the similarities among a large set of individual stimuli are represented at the fMRI voxel level in the extrastriate and the fusiform body areas. Next, we intended to compare the obtained representation between the two body areas, and also between the body areas and occipito-temporal cortex in general, to study whether the representation changes with location in OTC. To this end, we examined the fMRI response patterns elicited by individual

Discussion

In this study, we investigated the visual processing of a large variety of static images (n = 200), well matched in low level properties, portraying bodies, faces and inanimate objects. In particular, we examined the representational structure of the animate and inanimate stimuli within the body selective extrastriate and fusiform body areas (EBA and FBA) in comparison to occipito-temporal cortex (OTC). With respect to our questions raised in the introduction, we found that: (1) Representations

Acknowledgments

This study was supported by the Fonds voor Wetenschappelijk Onderzoek FWO Vlaanderen (G.0730.09), GOA (5613N), IUAP (7/11) and PF (10/008) grants. We are grateful to W. Depuydt and M. De Paep for technical support, Dr P. Downing and Dr M. Tarr for providing some of the stimuli, and Dr. J Taubert for reading an earlier version of the manuscript. I.D.P was supported by a fellowship from the Agentschap voor Innovatie door Wetenschap en Technologie (IWT; grant 101071) and J.J. is postdoctoral

References (59)

  • S. Ohayon et al.

    What makes a cell face selective? The importance of contrast

    Neuron

    (2012)
  • I.D. Popivanov et al.

    Stimulus representations in body-selective regions of the macaque cortex assessed with event-related fMRI

    NeuroImage

    (2012)
  • L. Reddy et al.

    Coding of visual objects in the ventral stream

    Curr. Opin. Neurobiol.

    (2006)
  • B. Sadeh et al.

    Stimulation of category-selective brain areas modulates ERP to their preferred categories

    Curr. Biol.

    (2011)
  • M. Spiridon et al.

    How distributed is visual category information in human occipito-temporal cortex? An fMRI study

    Neuron

    (2002)
  • K.S. Weiner et al.

    Sparsely-distributed organization of face and limb activations in human ventral temporal cortex

    NeuroImage

    (2010)
  • C. Baldassi et al.

    Shape similarity, better than semantic membership, accounts for the structure of visual object representations in a population of monkey inferotemporal neurons

    PLoS Comput. Biol.

    (2013)
  • A.H. Bell et al.

    Object representations in the temporal cortex of monkeys and humans as revealed by functional magnetic resonance imaging

    J. Neurophysiol.

    (2009)
  • A.H. Bell et al.

    Relationship between functional magnetic resonance imaging-identified regions and neuronal category selectivity

    J. Neurosci.

    (2011)
  • S. Bracci et al.

    Dissociable neural responses to hands and non-hand body parts in human left extrastriate visual cortex

    J. Neurophysiol.

    (2010)
  • T. Brandman et al.

    The body inversion effect is mediated by face-selective, not body-selective, mechanisms

    J. Neurosci.

    (2010)
  • A. Caramazza et al.

    Domain-specific knowledge systems in the brain: the animate-inanimate distinction

    J. Cogn. Neurosci.

    (1998)
  • R.M. Cichy et al.

    Resolving human object recognition in space and time

    Nat. Neurosci.

    (2014)
  • A.C. Connolly et al.

    The representation of biological classes in the human brain

    J. Neurosci.

    (2012)
  • C. Cortes et al.

    Support-vector networks

    Mach. Learn.

    (1995)
  • J. Davies-Thompson et al.

    Intra- and interhemispheric connectivity between face-selective regions in the human brain

    J. Neurophysiol.

    (2012)
  • P.E. Downing et al.

    A cortical area selective for visual processing of the human body

    Science

    (2001)
  • B. Fischl et al.

    High-resolution intersubject averaging and a coordinate system for the cortical surface

    Hum. Brain Mapp.

    (1999)
  • B. Fischl et al.

    Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex

    IEEE Trans. Med. Imaging

    (2001)
  • Cited by (17)

    • Factors Determining Where Category-Selective Areas Emerge in Visual Cortex

      2019, Trends in Cognitive Sciences
      Citation Excerpt :

      For example, the fusiform face area (FFA) initially conceptualized as one area, decomposes into multiple areas (FFA1 and FFA2) when scanning at a finer spatial resolution [50,51]. Data from human imaging and monkey electrophysiology support a hierarchical model with an increase of the complexity, invariance, and perceptual subjectivity of the represented features [49,53–61]. Areas higher up in the computational hierarchy, corresponding to more anterior regions in ventral OTC in human cortex, represent stimuli such as faces and words in a more holistic, less part-based manner and with higher levels of invariance for image transformations.

    • A behavioral face preference deficit in a monkey with an incomplete face patch system

      2019, NeuroImage
      Citation Excerpt :

      The homology of face category areas in humans and macaques is not firmly established (see Yovel and Freiwald, 2013). However, when considering the functional maps for color, places, bodies, and faces in humans and monkeys (Caspari et al., 2014; Lafer-Sousa et al., 2016), PL and ML, which are missing in monkey D, appear to be at similar relative locations as the human occipital face area (OFA) and FFA, respectively. The anterior face patches AL or AM, which were present in monkey D, might in that scheme correspond to the human anterior temporal face patch (ATFP), whereas the missing dorsal face patches MF and AF might correspond to the human STS face areas.

    • Interpreting the dimensions of neural feature representations revealed by dimensionality reduction

      2018, NeuroImage
      Citation Excerpt :

      First, we outline some conceptual considerations. Since these methods are unsupervised, the results of dimensionality reduction analyses are often interpreted as being a measure of the neural representational space that is ‘hypothesis-neutral’ (Kanwisher, 2010; Kriegeskorte et al., 2008) and ‘bias-free’ (Caspari et al., 2014). However, we argue here that such an approach is hypothesis-neutral and bias-free only if both (1) the methods are unsupervised and (2) the stimulus set adequately samples the relevant feature space.

    View all citing articles on Scopus
    View full text