Perceiving fear in dynamic body expressions
Introduction
The sound of gunfire immediately causes one to bend forward and to run for cover. Such characteristic fear behaviour protects from danger and also communicates a strong fear signal to observers who may not have heard the noise themselves. Emotional body language (EBL) provides reliable cues to recognise another’s emotions even when viewed from a distance and when the facial expression is not visible. The few currently available studies show that EBL can readily be recognised whether in static postures (de Gelder et al., 2004, Sprengelmeyer et al., 1999), whole body movements (Atkinson et al., 2004, Wallbott and Scherer, 1986) or even simple dynamic point-light displays (Dittrich et al., 1996, Bonda et al., 1996). Because of its survival value, the ability to grasp EBL is likely based on processes that are rapid, highly automatic and possibly relies systems.
At present, very little is known about the neural basis of perceiving EBL. As far as visual communication of emotion is concerned, our most valuable insights are based on investigations using images of static facial expressions. Amygdala and mid-fusiform cortex have consistently been associated with viewing facial expressions of fear (Adolphs, 2002, Dolan, 2002, Haxby et al., 2002). These two brain structures appear also to be important for processing fearful EBL (Hadjikhani and de Gelder, 2003). Yet besides the fact that facial expressions and EBL may share important brain structures, seeing EBL also evokes body specific activations (de Gelder et al., 2004). This is not surprising since EBL represents not only salient visual information but requires that the observer perceives the movements represented in the dynamic images or implied in the still pictures (running away) and grasps the meaning of the action (fleeing from danger).
Some of these characteristic aspects of EBL have recently been addressed in relatively separate research domains. For example, a possible role of premotor areas in emotion recognition has been revealed in brain imaging studies using dynamic facial expressions. Viewing dynamic facial expressions as compared to static ones engages areas processing biological movements and emotion such as the superior temporal sulcus (STS) and the amygdala (AMG), but also areas involved in the production of facial expressions, in particular the parietal and premotor cortex (Decety and Chaminade, 2003, Sato et al., 2004). These results suggest that dynamic images elicit more activity in the areas representing the affective meaning of the stimulus like the amygdala because they provide more information than static ones. On the other hand, dynamic stimuli also contain explicit movement information and this presumably elicits activity in movement sensitive areas like superior temporal sulcus (STS) and in premotor areas, as is indeed the case for dynamical facial expressions (LaBar et al., 2003, Sato et al., 2004). Given the limited information presently available it is unclear whether the different patterns of activation for dynamic and still images reflect a quantitative or also a qualitative difference. In other words, it is not yet clear whether the presence of dynamic information makes a substantial difference. It may be difficult to sort this issue out in the case of faces also because movement may be perceived implicitly even when it is not represented explicitly in the stimuli.
As the examples above bring out, we often perceive EBL when watching a person engaged in one or another action, like running away but also opening the door and making angry or fearful gestures at the unexpected visitor. On some occasions the EBL is directly linked with the emotion as in the case of fear and associated flight reaction as in our previous study (de Gelder et al., 2004). In the case envisaged EBL consists of an instrumental action performed with a strong emotional overtone as when we see a hand grasping a glass angrily (Grosbras and Paus, 2006). Thus clarifying how the brain processes EBL raises issues related to action perception which one does not encounter when investigating emotion expressed in the face.
It is now well established that when one observe other people’s actions, there is activation in the STS, the parietal and the premotor cortex (see review Grèzes and Decety, 2001). This suggests that action observation automatically triggers action representations. This mechanism of shared representations was proposed as the basis of action recognition (Jeannerod, 2001, Rizzolatti et al., 2001, Gallese et al., 2004, Iacoboni, 2005) but also more recently emotion recognition (Preston and deWaal, 2002, Carr et al., 2003, Gallese et al., 2004). Yet the relation between perceiving the emotion and representing the action has not received much attention so far. Furthermore, research on emotion has predominantly used still faces while investigations of action observation most often used video clips. The few available human neuropsychological findings indicate that the dorsal system may sustain some degree of visual processing of dynamic expression of emotion. For example, patients with focal amygdala lesion are impaired in recognizing static but not dynamic facial expressions (Adolphs et al., 1994, Adolphs et al., 2003), and they are able to produce an imitation of a facial expression on demand (Anderson et al., 2000).
The present study focussed on neutral and emotionally expressive instrumental actions and aimed at clarifying the specific contribution of dynamic information to the perception of fearful body expression. Furthermore, our approach allows us to clarify the relation between processing the fear signal provided by whole body actions in emotional and motor areas. Using event-related fMRI and a factorial design, we compared neutral and fear expressing whole body actions and their scrambled counterparts presented in either still or dynamic images. Our goals were to identify the neural circuits that are specifically involved in the perception of an action involving the whole body condition specific effects of fear and the combined effect of fear and dynamic action information.
Section snippets
Participants
Sixteen right-handed subjects (6 men and 10 women, mean age 25 years) with no neurological or psychiatric history participated in the imaging study. All gave informed consent according to institutional guidelines of the local ethics committee (CMO region Arnhem-Nijmegen, The Netherlands). The study was conducted in accordance with the principles and guidelines in the Declaration of Helsinki.
Materials
Construction of materials started with the recording of video films. A group of twelve semi-professional
fMRI results
The first analysis determined which activations were specific to the perception of bodies. The main effect of perceiving bodies as compared to scrambled stimuli was calculated: [(Fd + Fs + Nd + Ns) − 2(Sd + Ss)], where Fs = static fear bodies; Fd = dynamic fear bodies; Ns = static neutral bodies; Nd = dynamic neutral bodies; Ss = static scrambled bodies; Sd = dynamic scrambled bodies. The analysis showed bilateral activations in the occipital and temporal poles, in the motion area MT/V5/EBA, in fusiform gyrus, in
Discussion
The present study aimed at clarifying the relation between brain areas which play a critical role in processing EBL corresponding to an action, the supplementary fear signals provided by EBL and the relation between the activations corresponding to the viewing of dynamic fear actions. Our critical findings are threefold. Viewing the action by itself enhances amygdala activity; there is condition specific activation in the temporal pole and lateral orbital cortex elicited when the action
Acknowledgments
We are grateful to I. Toni for discussions on methods, to P. Gaalman for his technical assistance and to W. van de Riet for assistance with recruiting participants. We thank R.E. Passingham for advice and comments on the paper. JG, SP and BdG were partly supported by Human Frontier Science Program HFSP-RGP0054/2004-C and FP6-2005-NEST-Path Imp 043403.
References (75)
Neural systems for recognizing emotion
Curr. Opin. Neurobiol.
(2002)- et al.
Dissociable neural systems for recognizing emotions
Brain Cogn.
(2003) - et al.
Social perception from visual cues: role of the STS region
Trends Cogn. Sci.
(2000) - et al.
Evidence for an amygdaloid projection to premotor cortex but not to motor cortex in the monkey
Brain Res.
(1983) - et al.
The amygdala theory of autism
Neurosci. Biobehav. Rev.
(2000) - et al.
Mesial temporal neurons in the macaque monkey with responses selective for aspects of social stimuli
Behav. Brain Res.
(1993) - et al.
Response if neurons in the macaque amygdala to complex social stimuli
Behav. Brain Res.
(1990) - et al.
A PET investigation of the attribution of intentions with a nonverbal task
NeuroImage
(2000) - et al.
Movement and mind: a functional imaging study of perception and interpretation of complex intentional movement patterns
NeuroImage
(2000) - et al.
When the self represents the other: a new cognitive neuroscience view on psychological identification
Conscious. Cogn.
(2003)
Functional imaging of ‘theory of mind’
Trends Cogn. Sci.
Dissociable neural pathways for the perception and recognition of expressive and instrumental gestures
Neuropsychologia
Reading the mind in cartoons and stories: an fMRI study of « theory of mind » in verbal and non-verbal tasks
Neuropsychologia
A unifying view of the basis of social cognition
TICS
Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey
Neuroscience
Complex movements evoked by microstimulation of precentral cortex
Neuron
Activations related to “Mirror” and “Canonical” neurones in the human brain: a fMRI study
NeuroImage
Segregated neural representation of distinct emotion dimensions in the prefrontal cortex—An fMRI study
NeuroImage
Seeing fearful body expressions activates the fusiform cortex and amygdala
Curr. Biol.
Human neural systems for face recognition and social communication
Biol. Psychiatry
Functional specialization in dorsal and ventral premotor areas
Prog. Brain Res.
Neural mechanisms of imitation
Curr. Opin. Neurobiol.
The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology
Prog. Neurobiol.
Neural simulation of action: a unifying mechanism for motor cognition
NeuroImage
Differential cerebral activation during observation of expressive gestures and motor acts
Neuropsychologia
Role of the monkey amygdala in social cognition
Int. Congr. Ser.
Localization of grasp representations in humans by PET: 1. Observation versus execution
Exp. Brain Res.
Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study
Brain Res. Cogn. Brain Res.
Impaired recognition of emotion in facial expression following bilateral damage to the human amygdala
Nature
Emotion recognition from faces and prosody following temporal lobectomy
Neuropsychology
Syndrome produced by lesions of the amygdala in monkeys (Macaca mulatta)
J. Comp. Physiol. Psychol.
Amygdalo-cortical projections in the monkey (Macaca fascicularis)
J. Comp. Neurol.
Contribution of the anteromedial temporal lobes to the evaluation of facial emotion
Neuropsychology
Emotion perception from dynamic and static body expressions in point-light and full-light displays
Perception
Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey
J. Comp. Neurol.
The development of social behavior following neonatal amygdala lesions in rhesus monkeys
J. Cogn. Neurosci.
Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions
Brain
Cited by (234)
A large-scale brain network of species-specific dynamic human body perception
2023, Progress in NeurobiologyFreezing responses to virtual characters are impacted by body expression, group affiliation, and threat proximity
2022, Current Research in Behavioral Sciences