Abstract
We investigated the effects of adaptation to mouth shapes associated with different spoken sounds (sustained /m/ or /u/) on visual perception of lip speech. Participants were significantly more likely to label ambiguous faces on an /m/-to-/u/ continuum as saying /u/ following adaptation to /m/ mouth shapes than they were in a preadaptation test. By contrast, participants were significantly less likely to label the ambiguous faces as saying /u/ following adaptation to /u/ mouth shapes than they were in a preadaptation test. The magnitude of these aftereffects was equivalent when the same individual was shown in the adaptation and test phases of the experiment and when different individuals were presented in the adaptation and test phases. These findings present novel evidence that adaptation to natural variations in facial appearance influences face perception, and they extend previous research on face aftereffects to visual perception of lip speech.
Article PDF
References
Bertelson, P., Vroomen, J., & de Gelder, B. (2003). Visual recalibration of auditory speech identification: A McGurk aftereffect. Psychological Science, 14, 592–597.
Bestelmeyer, P. E. G., Jones, B. C., DeBruine, L. M., Little, A. C., Perrett, D. I., Schneider, A., et al. (2008). Sex-contingent face aftereffects depend on perceptual category rather than structural encoding. Cognition, 107, 353–365. doi:10.1016/j.cognition.2007.07.018
Bestelmeyer, P. E. G., Jones, B. C., DeBruine, L. M., Little, A. C., Schneider, A., Welling, L. L. M., & Conway, C. A. (2010). Face aftereffects demonstrate interdependent processing of expressions and the invariant characteristics of sex and race. Visual Cognition, 18, 255–274.
Bruce, V., & Young, A. W. (1986). Understanding face recognition. British Journal of Psychology, 77, 305–327.
Calder, A. J., Jenkins, R., Cassel, A., & Clifford, C. W. G. (2008). Visual representation of eye gaze is coded by a nonopponent multichannel system. Journal of Experimental Psychology: General, 137, 244–261. doi:10.1037/0096-3445.137.2.244
DeBruine, L. M., Jones, B. C., Unger, L., Little, A. C., & Feinberg, D. R. (2007). Dissociating averageness and attractiveness: Attractive faces are not always average. Journal of Experimental Psychology: Human Perception & Performance, 33, 1420–1430.
Eisner, F., & McQueen, J. M. (2005). The specificity of perceptual learning in speech processing. Perception & Psychophysics, 67, 224–238.
Fang, F., Ijichi, K., & He, S. (2007). Transfer of the face viewpoint aftereffect from adaptation to different and inverted faces. Journal of Vision, 7(13, Art. 6), 1–9.
García-Pérez, M. A., & Alcalá-Quintana, R. (2005). Sampling plans for fitting the psychometric function. Spanish Journal of Psychology, 8, 256–289.
Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4, 223–233.
Hsu, S.-M., & Young, A. W. (2004). Adaptation effects in facial expression recognition. Visual Cognition, 11, 871–899.
Jaquet, E., Rhodes, G., & Hayward, W. G. (2007). Opposite aftereffects for Chinese and Caucasian faces are selective for social category information and not just physical face differences. Quarterly Journal of Experimental Psychology, 60, 1457–1467.
Jeffery, L., Rhodes, G., & Busey, T. (2006). View-specific coding of face shape. Psychological Science, 17, 501–505. doi:10.1111/j.1467-9280.2006.01735.x
Jenkins, R., Beaver, J. D., & Calder, A. J. (2006). I thought you were looking at me: Direction-specific aftereffects in gaze perception. Psychological Science, 17, 506–513.
Jones, B. C., DeBruine, L. M., & Little, A. C. (2008). Adaptation reinforces preferences for correlates of attractive facial cues. Visual Cognition, 16, 849–858. doi:10.1080/13506280701760811
Leopold, D. A., O'Toole, A. J., Vetter, T., & Blanz, V. (2001). Prototype-referenced shape encoding revealed by high-level aftereffects. Nature Neuroscience, 4, 89–94.
Leopold, D. A., Rhodes, G., Müller, K.-M., & Jeffery, L. (2005). The dynamics of visual adaptation to faces. Proceedings of the Royal Society B, 272, 897–904.
Little, A. C., DeBruine, L. M., & Jones, B. C. (2005). Sex-contingent face aftereffects suggest distinct neural populations code male and female faces. Proceedings of the Royal Society B, 272, 1–5. doi:10.1098/ rspb.2005.3220
Little, A. C., DeBruine, L. M., Jones, B. C., & Waitt, C. (2008). Category contingent aftereffects for faces of different races, ages and species. Cognition, 106, 1537–1547.
McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.
Rhodes, G., Jeffery, L., Watson, T. L., Clifford, C. W. G., & Nakayama, K. (2003). Fitting the mind to the world: Face adaptation and attractiveness aftereffects. Psychological Science, 14, 558–566.
Rotshtein, P., Henson, R. N. A., Treves, A., Driver, J., & Dolan, R. J. (2005). Morphing Marilyn into Maggie dissociates physical and identity face representations in the brain. Nature Neuroscience, 8, 107–113. doi:10.1038/nn1370
Tiddeman, B. P., Perrett, D. I., & Burt, D. M. (2001). Prototyping and transforming facial textures for perception research. IEEE Computer Graphics & Applications, 21, 42–50.
van Linden, S., & Vroomen, J. (2007). Recalibration of phonetic categories by lipread speech versus lexical information. Journal of Experimental Psychology: Human Perception & Performance, 33, 1483–1494.
Vroomen, J., & Baart, M. (2009). Recalibration of phonetic categories by lipread speech: Measuring aftereffects after a 24-hour delay. Language & Speech, 52, 341–350.
Webster, M. A., Kaping, D., Mizokami, Y., & Duhamel, P. (2004). Adaptation to natural facial categories. Nature, 428, 557–561.
Webster, M. A., & MacLin, O. H. (1999). Figural aftereffects in the perception of faces. Psychonomic Bulletin & Review, 6, 647–653.
Winston, J. S., Henson, R. N. A., Fine-Goulden, M. R., & Dolan, R. J. (2004). fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. Journal of Neurophysiology, 92, 1830–1839.
Xu, H., Dayan, P., Lipkin, R. M., & Qian, N. (2008). Adaptation across the cortical hierarchy: Low-level curve adaptation affects high-level facial-expression judgments. Journal of Neuroscience, 28, 3374–3383. doi:10.1523/JNEUROSCI.0182-08.2008
Yamashita, J. A., Hardy, J. L., De Valois, K. K., & Webster, M. A. (2005). Stimulus selectivity of figural aftereffects for faces. Journal of Experimental Psychology: Human Perception & Performance, 31, 420–437. doi:10.1037/0096-1523.31.3.420
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jones, B.C., Feinberg, D.R., Bestelmeyer, P.E.G. et al. Adaptation to different mouth shapes influences visual perception of ambiguous lip speech. Psychonomic Bulletin & Review 17, 522–528 (2010). https://doi.org/10.3758/PBR.17.4.522
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/PBR.17.4.522