Recognition of Emotion in Moving and Static Composite Faces
Abstract
This paper investigates whether the greater accuracy of emotion identification for dynamic versus static expressions, as noted in previous research, can be explained through heightened levels of either component or configural processing. Using a paradigm by Young, Hellawell, and Hay (1987), we tested recognition performance of aligned and misaligned composite faces with six basic emotions (happiness, fear, disgust, surprise, anger, sadness). Stimuli were created using 3D computer graphics and were shown as static peak expressions (static condition) and 7 s video sequences (dynamic condition). The results revealed that, overall, moving stimuli were better recognized than static faces, although no interaction between motion and other factors was found. For happiness, sadness, and surprise, misaligned composites were better recognized than aligned composites, suggesting that aligned composites fuse to form a single expression, while the two halves of misaligned composites are perceived as two separate emotions. For anger, disgust, and fear, this was not the case. These results indicate that emotions are perceived on the basis of both configural and component-based information, with specific activation patterns for separate emotions, and that motion has a quality of its own and does not increase configural or component-based recognition separately.
References
(2005). Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16, 403–410.
(1978). Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance, 4, 373–379.
(2008). The role of motion signals in recognizing subtle facial expressions of emotion. British Journal of Psychology, 99, 167–189.
(1988). Recognizing faces. Hillsdale, NJ: Erlbaum.
(1999). Verification of face identities from images captured on video. Journal of Experimental Psychology: Applied, 5, 339–360.
(2000). Configural information in facial expression perception. Journal of Experimental Psychology, 26, 527–551.
(2008). Facial expressions of emotion (KDEF): Identification under different display-duration conditions. Behavioral Research Methods, 40(1), 109–115.
(1977). From piecemeal to configural representation of faces. Science, 195, 312–314.
(1998). The role of dynamic information in the recognition of unfamiliar faces. Memory and Cognition, 26, 780–790.
(1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.
(1995). What causes the face inversion effect? Journal of Experimental Psychology: Human Perception and Performance, 21, 628–634.
(1998). What is “special” about face perception? Psychological Review, 105, 482–498.
(2006). Perception of dynamic facial expressions of emotion. In , Perception and interactive technologies (pp. 175–178). Berlin: Springer-Verlag.
(2001). Dynamic properties influence the perception of facial expressions. Perception, 30, 875–887.
(2008). The effect of dynamics on identifying basic emotions from synthetic and natural faces. International Journal of Human-Computer Studies, 66, 233–242.
(2003). The use of facial motion and facial form during the processing of identity. Vision Research, 43, 1921–1936.
(2000). Recognizing famous faces: Exploring the benefits of facial motion. Ecological Psychology, 12, 259–272.
(2004). Repetition priming from moving faces. Memory and Cognition, 32, 640–647.
(1999). The role of movement in the recognition of famous faces. Memory and Cognition, 27, 974–985.
(2000). When inverted faces are recognized: The role of configural information in face recognition. Quarterly Journal of Experimental Psychology, 53A, 513–536.
(2007). Haptic recognition of static and dynamic expressions of emotion in the live face. Psychological Science, 18, 158–164.
(2007). The emotion recognition task: A paradigm to measure the perception of facial emotional expressions at different intensities. Perceptual and Motor Skills, 104, 589–598.
(2008). The contribution of different facial regions to the recognition of conversational expressions. Journal of Vision, 8(8), 1–23.
(2002). Recognizing moving faces: A psychological and neural synthesis. Trends in Cognitive Sciences, 6, 261–266.
(2003). Expert face processing: Specialization and constraints. In , Development of face processing (pp. 81–97). Göttingen: Hogrefe.
(2002). Component and configural information in face recognition. 2nd international Workshop on Biologically Motivated Computer Vision, Tübingen, Germany, 2002. Lectures Notes in Computer Science, 2525, 643–650.
(2006). Processing of identity and emotion in faces: A psychophysical, psychological and computational perspective. Progress in Brain Research, 156, 321–343.
(1996). Inversion and processing of component and spatial-relational information of faces. Journal of Experimental Psychology: Human Perception and Performance, 22, 904–915.
(1984). An investigation into component and configural processes underlying face recognition. British Journal of Psychology, 75, 221–242.
(2007). I can’t recognize your face but I can recognize its movement. Cognitive Neuropsychology, 24, 451–466.
(1993). Parts and wholes in face recognition. The Quarterly Journal of Experimental Psychology, 46A, 225–245.
(2006). Facial emotion recognition from moving and static point-light images in schizophrenia. Schizophrenia Research, 85(1–3), 96–105.
(2000). Parts and wholes in expression recognition. Cognition and Emotion, 14, 39–60.
(2004). A unique look at face processing: The impact of masked faces on the processing of facial features. Cognition, 91, 155–172.
(1987). Configural information in face perception. Perception, 16, 747–759.
