Elsevier

NeuroImage

Volume 35, Issue 2, 1 April 2007, Pages 959-967
NeuroImage

Perceiving fear in dynamic body expressions

https://doi.org/10.1016/j.neuroimage.2006.11.030Get rights and content

Abstract

Characteristic fear behaviour like putting the hands in front of the face and running for cover provides strong fear signals to observers who may not themselves be aware of any danger. Using event-related functional magnetic resonance imaging (fMRI) in humans, we investigated how such dynamic fear signals from the whole body are perceived. A factorial design allowed us to investigate brain activity induced by viewing bodies, bodily expressions of fear and the role of dynamic information in viewing them. Our critical findings are threefold. We find that viewing neutral and fearful body expressions enhances amygdala activity; moreover actions expressing fear activate the temporal pole and lateral orbital cortex more than neutral actions; and finally differences in activations between static and dynamic bodily expressions were larger for actions expressing fear in the STS and premotor cortex compared to neutral actions.

Introduction

The sound of gunfire immediately causes one to bend forward and to run for cover. Such characteristic fear behaviour protects from danger and also communicates a strong fear signal to observers who may not have heard the noise themselves. Emotional body language (EBL) provides reliable cues to recognise another’s emotions even when viewed from a distance and when the facial expression is not visible. The few currently available studies show that EBL can readily be recognised whether in static postures (de Gelder et al., 2004, Sprengelmeyer et al., 1999), whole body movements (Atkinson et al., 2004, Wallbott and Scherer, 1986) or even simple dynamic point-light displays (Dittrich et al., 1996, Bonda et al., 1996). Because of its survival value, the ability to grasp EBL is likely based on processes that are rapid, highly automatic and possibly relies systems.

At present, very little is known about the neural basis of perceiving EBL. As far as visual communication of emotion is concerned, our most valuable insights are based on investigations using images of static facial expressions. Amygdala and mid-fusiform cortex have consistently been associated with viewing facial expressions of fear (Adolphs, 2002, Dolan, 2002, Haxby et al., 2002). These two brain structures appear also to be important for processing fearful EBL (Hadjikhani and de Gelder, 2003). Yet besides the fact that facial expressions and EBL may share important brain structures, seeing EBL also evokes body specific activations (de Gelder et al., 2004). This is not surprising since EBL represents not only salient visual information but requires that the observer perceives the movements represented in the dynamic images or implied in the still pictures (running away) and grasps the meaning of the action (fleeing from danger).

Some of these characteristic aspects of EBL have recently been addressed in relatively separate research domains. For example, a possible role of premotor areas in emotion recognition has been revealed in brain imaging studies using dynamic facial expressions. Viewing dynamic facial expressions as compared to static ones engages areas processing biological movements and emotion such as the superior temporal sulcus (STS) and the amygdala (AMG), but also areas involved in the production of facial expressions, in particular the parietal and premotor cortex (Decety and Chaminade, 2003, Sato et al., 2004). These results suggest that dynamic images elicit more activity in the areas representing the affective meaning of the stimulus like the amygdala because they provide more information than static ones. On the other hand, dynamic stimuli also contain explicit movement information and this presumably elicits activity in movement sensitive areas like superior temporal sulcus (STS) and in premotor areas, as is indeed the case for dynamical facial expressions (LaBar et al., 2003, Sato et al., 2004). Given the limited information presently available it is unclear whether the different patterns of activation for dynamic and still images reflect a quantitative or also a qualitative difference. In other words, it is not yet clear whether the presence of dynamic information makes a substantial difference. It may be difficult to sort this issue out in the case of faces also because movement may be perceived implicitly even when it is not represented explicitly in the stimuli.

As the examples above bring out, we often perceive EBL when watching a person engaged in one or another action, like running away but also opening the door and making angry or fearful gestures at the unexpected visitor. On some occasions the EBL is directly linked with the emotion as in the case of fear and associated flight reaction as in our previous study (de Gelder et al., 2004). In the case envisaged EBL consists of an instrumental action performed with a strong emotional overtone as when we see a hand grasping a glass angrily (Grosbras and Paus, 2006). Thus clarifying how the brain processes EBL raises issues related to action perception which one does not encounter when investigating emotion expressed in the face.

It is now well established that when one observe other people’s actions, there is activation in the STS, the parietal and the premotor cortex (see review Grèzes and Decety, 2001). This suggests that action observation automatically triggers action representations. This mechanism of shared representations was proposed as the basis of action recognition (Jeannerod, 2001, Rizzolatti et al., 2001, Gallese et al., 2004, Iacoboni, 2005) but also more recently emotion recognition (Preston and deWaal, 2002, Carr et al., 2003, Gallese et al., 2004). Yet the relation between perceiving the emotion and representing the action has not received much attention so far. Furthermore, research on emotion has predominantly used still faces while investigations of action observation most often used video clips. The few available human neuropsychological findings indicate that the dorsal system may sustain some degree of visual processing of dynamic expression of emotion. For example, patients with focal amygdala lesion are impaired in recognizing static but not dynamic facial expressions (Adolphs et al., 1994, Adolphs et al., 2003), and they are able to produce an imitation of a facial expression on demand (Anderson et al., 2000).

The present study focussed on neutral and emotionally expressive instrumental actions and aimed at clarifying the specific contribution of dynamic information to the perception of fearful body expression. Furthermore, our approach allows us to clarify the relation between processing the fear signal provided by whole body actions in emotional and motor areas. Using event-related fMRI and a factorial design, we compared neutral and fear expressing whole body actions and their scrambled counterparts presented in either still or dynamic images. Our goals were to identify the neural circuits that are specifically involved in the perception of an action involving the whole body condition specific effects of fear and the combined effect of fear and dynamic action information.

Section snippets

Participants

Sixteen right-handed subjects (6 men and 10 women, mean age 25 years) with no neurological or psychiatric history participated in the imaging study. All gave informed consent according to institutional guidelines of the local ethics committee (CMO region Arnhem-Nijmegen, The Netherlands). The study was conducted in accordance with the principles and guidelines in the Declaration of Helsinki.

Materials

Construction of materials started with the recording of video films. A group of twelve semi-professional

fMRI results

The first analysis determined which activations were specific to the perception of bodies. The main effect of perceiving bodies as compared to scrambled stimuli was calculated: [(Fd + Fs + Nd + Ns)  2(Sd + Ss)], where Fs = static fear bodies; Fd = dynamic fear bodies; Ns = static neutral bodies; Nd = dynamic neutral bodies; Ss = static scrambled bodies; Sd = dynamic scrambled bodies. The analysis showed bilateral activations in the occipital and temporal poles, in the motion area MT/V5/EBA, in fusiform gyrus, in

Discussion

The present study aimed at clarifying the relation between brain areas which play a critical role in processing EBL corresponding to an action, the supplementary fear signals provided by EBL and the relation between the activations corresponding to the viewing of dynamic fear actions. Our critical findings are threefold. Viewing the action by itself enhances amygdala activity; there is condition specific activation in the temporal pole and lateral orbital cortex elicited when the action

Acknowledgments

We are grateful to I. Toni for discussions on methods, to P. Gaalman for his technical assistance and to W. van de Riet for assistance with recruiting participants. We thank R.E. Passingham for advice and comments on the paper. JG, SP and BdG were partly supported by Human Frontier Science Program HFSP-RGP0054/2004-C and FP6-2005-NEST-Path Imp 043403.

References (75)

  • H.L. Gallagher et al.

    Functional imaging of ‘theory of mind’

    Trends Cogn. Sci.

    (2003)
  • H.L. Gallagher et al.

    Dissociable neural pathways for the perception and recognition of expressive and instrumental gestures

    Neuropsychologia

    (2004)
  • H.L. Gallagher et al.

    Reading the mind in cartoons and stories: an fMRI study of « theory of mind » in verbal and non-verbal tasks

    Neuropsychologia

    (2000)
  • V. Gallese et al.

    A unifying view of the basis of social cognition

    TICS

    (2004)
  • H.T. Ghashghaei et al.

    Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey

    Neuroscience

    (2002)
  • M.S.A. Graziano et al.

    Complex movements evoked by microstimulation of precentral cortex

    Neuron

    (2002)
  • J. Grèzes et al.

    Activations related to “Mirror” and “Canonical” neurones in the human brain: a fMRI study

    NeuroImage

    (2003)
  • S. Grimm et al.

    Segregated neural representation of distinct emotion dimensions in the prefrontal cortex—An fMRI study

    NeuroImage

    (2006)
  • N. Hadjikhani et al.

    Seeing fearful body expressions activates the fusiform cortex and amygdala

    Curr. Biol.

    (2003)
  • J.V. Haxby et al.

    Human neural systems for face recognition and social communication

    Biol. Psychiatry

    (2002)
  • E. Hoshi et al.

    Functional specialization in dorsal and ventral premotor areas

    Prog. Brain Res.

    (2004)
  • M. Iacoboni

    Neural mechanisms of imitation

    Curr. Opin. Neurobiol.

    (2005)
  • M.L. Kringelbach et al.

    The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology

    Prog. Neurobiol.

    (2004)
  • M. Jeannerod

    Neural simulation of action: a unifying mechanism for motor cognition

    NeuroImage

    (2001)
  • M. Lotze et al.

    Differential cerebral activation during observation of expressive gestures and motor acts

    Neuropsychologia

    (2006)
  • H. Nishijo et al.

    Role of the monkey amygdala in social cognition

    Int. Congr. Ser.

    (2003)
  • G. Rizzolatti et al.

    Localization of grasp representations in humans by PET: 1. Observation versus execution

    Exp. Brain Res.

    (1996)
  • W. Sato et al.

    Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study

    Brain Res. Cogn. Brain Res.

    (2004)
  • R. Adolphs et al.

    Impaired recognition of emotion in facial expression following bilateral damage to the human amygdala

    Nature

    (1994)
  • R. Adolphs et al.

    Emotion recognition from faces and prosody following temporal lobectomy

    Neuropsychology

    (2001)
  • J.P. Aggleton et al.

    Syndrome produced by lesions of the amygdala in monkeys (Macaca mulatta)

    J. Comp. Physiol. Psychol.

    (1981)
  • D.G. Amaral et al.

    Amygdalo-cortical projections in the monkey (Macaca fascicularis)

    J. Comp. Neurol.

    (1984)
  • A.K. Anderson et al.

    Contribution of the anteromedial temporal lobes to the evaluation of facial emotion

    Neuropsychology

    (2000)
  • A.P. Atkinson et al.

    Emotion perception from dynamic and static body expressions in point-light and full-light displays

    Perception

    (2004)
  • H. Barbas

    Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey

    J. Comp. Neurol.

    (1988)
  • M.D. Bauman et al.

    The development of social behavior following neonatal amygdala lesions in rhesus monkeys

    J. Cogn. Neurosci.

    (2004)
  • A. Bechara et al.

    Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions

    Brain

    (2000)
  • Cited by (234)

    View all citing articles on Scopus
    View full text