Skip to main content
SpringerLink
Log in

Processing Faces and Facial Expressions

  • Published:
Neuropsychology Review Aims and scope Submit manuscript

Abstract

This paper reviews processing of facial identity and expressions. The issue of independence of these two systems for these tasks has been addressed from different approaches over the past 25 years. More recently, neuroimaging techniques have provided researchers with new tools to investigate how facial information is processed in the brain. First, findings from “traditional” approaches to identity and expression processing are summarized. The review then covers findings from neuroimaging studies on face perception, recognition, and encoding. Processing of the basic facial expressions is detailed in light of behavioral and neuroimaging data. Whereas data from experimental and neuropsychological studies support the existence of two systems, the neuroimaging literature yields a less clear picture because it shows considerable overlap in activation patterns in response to the different face-processing tasks. Further, activation patterns in response to facial expressions support the notion of involved neural substrates for processing different facial expressions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Abdi, H. (2002). What can psychology and sensory evaluation learn from each other? Food Qual. Pref. 13: 445–451.

    Google Scholar 

  • Adolphs, R. (1999). Social cognition and the human brain. Trends Cogn. Sci. 3: 469–479.

    PubMed  Google Scholar 

  • Adolphs, R. (2001). The neurobiology of social cognition. Curr. Opin. Neurobiol. 11: 231–239.

    PubMed  Google Scholar 

  • Adolphs, R., Tranel, D., Damasio, H., and Damasio, A. R. (1994). Impaired recognition of emotion in facial expressions followingbilateral damage to the human amygdala. Nature 372: 613–614.

    PubMed  Google Scholar 

  • Adolphs, R., Tranel, D., Damasio, H., and Damasio, A. R. (1995). Fear and the human amygdala. J. Neurosci. 15: 5879–5891.

    PubMed  Google Scholar 

  • Adolphs, R., Damasio, H., Tranel, D., and Damasio, A. R. (1996). Cortical systems for the recognition of emotion in facial expressions. J. Neurosci. 16 (23): 7678–7687.

    PubMed  Google Scholar 

  • Adolphs, R., Tranel, D., and Damasio, A. R. (1998). The human amygdala in social judgment. Nature 393: 470–474.

    PubMed  Google Scholar 

  • Adolphs, R., Sears, L., and Piven, J. (2001). Abnormal processing of social information from faces in autism. J. Cogn. Neurosci. 13(2): 232–240.

    PubMed  Google Scholar 

  • Aggleton, J. P. (1992). The functional effects of amygdala lesions in humans: A comparison with findings from monkeys. In Aggleton, J. P. (ed.), The Amygdala, Wiley-Liss, New York, pp. 485–503.

    Google Scholar 

  • Aguirre, G. K., Singh, R., and D'Esposito, M. (1999). Stimulus inversion and the response of face object-sensitive cortical areas. Neuroreport 10: 194–198.

    Google Scholar 

  • Allison, T., Puce, A., Spencer, D. D., and McCarthy, G. (1999). Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cereb. Cortex 9: 415–430.

    PubMed  Google Scholar 

  • Anderson, A. K., and Phelps, E. A. (2000). Expression without recognition: Contributions of the human amygdala to emotional communication. Psychol. Sci. 11: 106–111.

    PubMed  Google Scholar 

  • Archer, J., Hay, D. C., and Young, A. W. (1994). Movement, face processing, and schizophrenia: Evidence of a differential deficit in expression analysis. Br. J. Clin. Psychol. 33: 517–528.

    PubMed  Google Scholar 

  • Attwell, D., and Iadecola, C. (2002). The neural basis of functional brain imaging signals. Trends Neurosci. 25: 621–625.

    PubMed  Google Scholar 

  • Baddeley, A. D., and Woodhead, M. (1981). Techniques for improving eyewitness identification skills. Paper presented at the SSRC Law and Psychology Conference, Trinity College, Oxford.

    Google Scholar 

  • Baird, A. A., Staci, M. A., Gruber, E. M., Fein, D. A., Maas, J. C., Steingard, R. J., et al. (1999). Functional magnetic resonance imaging of facial affect recognition in children and adolescents. J. Am. Acad. Child Adolesc. Psychiatry 38: 195–199.

    PubMed  Google Scholar 

  • Bandettini, P. A., and Ungerleider, L. G. (2001). From neuron to BOLD: New connections. Nat. Neurosci. 4: 864–866.

    PubMed  Google Scholar 

  • Bartlett, J. C., and Searcy, J. (1993). Inversion and configuration of faces. Cognit. Psychol. 25: 281–316.

    PubMed  Google Scholar 

  • Bartlett, J. C., Searcy, J., and Abdi, H. (2003). What are the routes to face recognition? In Peterson, M., and Rhodes, G. (eds.), Analytic and Holistic Processes in the Perception of Faces, Object, and Scenes, Oxford University Press, Oxford, pp. 21–52.

    Google Scholar 

  • Baudouin, J.-Y., Martin, F., Tiberghien, G., Verlut, I., and Frank, N. (2002). Selective attention to facial emotion and identity in schizophrenia. Neuropsychologia 40: 503–511.

    PubMed  Google Scholar 

  • Bentin, S., and Carmel, D. (2002). Accounts for the N170 face-effect:A reply to Rossion, Curran, & Gauthier. Cognition 85: 197–202.

    PubMed  Google Scholar 

  • Bentin, S., and Deouell, L. Y. (2000). Structural encoding and identification in face processing: ERP evidence for separate mechanisms. Cogn. Neuropsychol. 17: 35–54.

    Google Scholar 

  • Bentin, S., Allison, T., Puce, A., Perez, E., and McCarthy, G. (1996). Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 8: 551–565.

    Google Scholar 

  • Bentin, S., Deouell, L. Y., and Soroker, N. (1999). Selective visual streaming in face recognition: Evidence from developmental prosopagnosia. Neuroreport 10: 823–827.

    PubMed  Google Scholar 

  • Bernstein, L. J., Beig, S., Siegenthaler, A. L., and Grady, C. L. (2002). The effect of encoding strategy of the neural correlates of memory for faces. Neuropsychologia 40: 86–98.

    PubMed  Google Scholar 

  • Blair, R. J., and Cipolotti, L. (2000). Impaired social response reversal. A case of “acquired sociopathy.” Brain 123: 1122–1141.

    PubMed  Google Scholar 

  • Blair, R. J., and Coles, M. (2000). Expression recognition and behavioural problems in early adolescence. Cogn. Dev. 15: 421–434.

    Google Scholar 

  • Blair, R. J. R., Morris, J. S., Frith, C. D., Perrett, D. I., and Dolan, J. R. (1999). Dissociable neural responses to facial expressions of sadness and anger. Brain 122: 883–893.

    PubMed  Google Scholar 

  • Breiter, H. C., Etcoff, N., Whalen, P. J., Kennedy, W. A., Rauch, S. L., Buckner, R. L., et al. (1996). Response and habituation of the human amygdala during visual processing of facial expression. Neuron 17: 875–887.

    PubMed  Google Scholar 

  • Bruce, V. (1982). Changing faces: Visual and non-visual coding process in face recognition. Br. J. Psychol. 73: 105–116.

    PubMed  Google Scholar 

  • Bruce, V., and Young, A. (1986). Understanding face recognition. Br. J. Psychol. 77: 305–327.

    PubMed  Google Scholar 

  • Buckner, R. B., and Logan, J. M. (2001). Functional neuroimaging methods: PET and fMRI. In Cabeza, R., and Kingstone, A. (eds.), Handbook of Functional Neuroimaging of Cognition, The MIT Press, Cambridge, pp. 27–48.

    Google Scholar 

  • Calder, A. J., Young, A. W., Rowland, D., Perrett, D. I., Hodges, J. R., and Etcoff, N. L. (1996). Facial emotion recognition after bilateral amygdala damage: Differentially severe impairment of fear. Cogn. Neuropsychol. 13: 699–745.

    Google Scholar 

  • Calder, A. J., Keane, J., Manes, F., Antoun, N., and Young, A. W. (2000). Impaired recognition and experience of disgust following brain injury. Nat. Neurosci. 3: 1077–1078.

    PubMed  Google Scholar 

  • Carmel, D., and Bentin, S. (2002). Domain specificity versus expertize: Factors influencing distinct processing of faces. Cognition 83: 1–29.

    PubMed  Google Scholar 

  • Clark, V. P., Keil, K., Maisog, J. M., Courtney, S., Ungerleider, L. G., and Haxby, J. V. (1996). Functional magnetic resonance imaging of human visual cortex during face matching: A comparison with positron emission tomography. Neuroimage 4: 1–15.

    PubMed  Google Scholar 

  • Conklin, H. M., Calkins, M. E., Anderson, C. W., Dinzeo, T. J., and Iacono, W. G. (2002). Recognition memory for faces in schizophrenia patients and their first-degree relatives. Neuropsychologia 40(13): 2314–2324.

    PubMed  Google Scholar 

  • Critchley, H., Daly, E., Phillips, M., Brammer, M., Bullmore, E., Williams, S., et al. (2000). Explicit and implicit neural mechanisms for processing of social information from facial expressions: A functional magnetic resonance imaging study. Hum. Brain Mapp. 9: 93–105.

    PubMed  Google Scholar 

  • Damasio, A. R., Damasio, H., and Van Hoesen, G. W. (1982). Prosopagnosia: Anatomic basis and behavioral mechanisms. Neurology 32: 331–341.

    PubMed  Google Scholar 

  • Damasio, A. R., Tranel, D., and Damasio, H. (1990). Face agnosia and the neural substrates of memory. Annu. Rev. Neurosci. 13: 89–109.

    PubMed  Google Scholar 

  • Davies, G. M., Ellis, H. D., and Shepherd, J. W. (1978). Face recognition accuracy as a function of mode of representation. J. Appl. Psychol. 63: 180–187.

    Google Scholar 

  • Davis, M., and Whalen, P. J. (2001). The amygdala: Vigilance and emotion. Mol. Psychiatry 6: 13–34.

    PubMed  Google Scholar 

  • De Renzi, E., Faglioni, R., Grossi, D., and Nichelli, P. (1991). Apperceptive and associative forms of prosopagnosia. Cortex 27: 213–222.

    PubMed  Google Scholar 

  • De Renzi, E., Perani, D., Carlesimo, G. A., Silveri, M. C., and Fazio, F. (1994). Prosopagnosia can be associated with damage confined to the right hemisphere. An MRI and PET study and a review of the literature. Neuropsychologia 32: 893–902.

    PubMed  Google Scholar 

  • Desimone, R. (1991). Face selective cells in the temporal cortex of monkeys. J. Cogn. Neurosci. 3: 1–8.

    Google Scholar 

  • D'Esposito, M., Zarahn, E., and Aguirre, G. K. (1999). Event-related functional MRI: Implications for cognitive psychology. Psychol. Bull. 125: 155–164.

    PubMed  Google Scholar 

  • Dolan, R. J., Fletcher, P., Morris, J., Kapur, N., Deakin, F. W., and Frith, C. D. (1996). Neural activation during covert processing of positive emotional facial expressions. Neuroimage 4: 194–200.

    PubMed  Google Scholar 

  • Dubois, S., Rossion, B., Schiltz, C., Bodart, J. M., Michel, C., Bruyer, R., et al. (1999). Effect of familiarity on the processing of human faces. Neuroimage 9: 278–289.

    PubMed  Google Scholar 

  • Dukes, W. D., and Bevan, W. (1967). Stimulus variation and repetition in the acquisition of naming responses. J. Exp. Psychol. 74: 178–181.

    PubMed  Google Scholar 

  • Eimer, M. (2000a). Event-related brain potentials distinguish processing stages involved in face perception and recognition. Clin. Neurophysiol. 111: 694–705.

    PubMed  Google Scholar 

  • Eimer, M. (2000b). Effects of face inversion on the structural encoding and recognition of faces: Evidence from event-related brain potentials. Cogn. Brain Res. 10: 145–158.

    Google Scholar 

  • Eimer, M., and McCarthy, R. A. (1999). Prosopagnosia and structural encoding of faces: Evidence from event-related potentials. Neuroreport 10: 255–259.

    PubMed  Google Scholar 

  • Ekman, P. (1972). Universals and cultural differences in facial expressions of emotion. In Cole, J. (ed.), Nebraska Symposium on Motivation, University of Nebraska Press, Lincoln, pp. 207–283.

    Google Scholar 

  • Ekman, P. (1992). Facial expression and emotion. Am. Psychol. 48(4): 384–392.

    Google Scholar 

  • Ekman, P., and Friesen, W. (1976). Pictures of Facial Affect, Consulting Psychological Press, Palo Alto, CA.

    Google Scholar 

  • Ellis, H. D., Shepherd, J. W., and Davies, G. M. (1979). Identification of familiar and unfamiliar faces from internal and external features: Some implications for theories of face recognition. Perception 8: 431–439.

    PubMed  Google Scholar 

  • Endo, N., Endo, M., Kirita, T., and Maruyama, K. (1992). The effects of expression on face recognition. Tohoku Psychol. Folia 52: 37–44.

    Google Scholar 

  • Etcoff, N. L. (1984). Selective attention to facial identity and facial emotion. Neuropsychologia 22: 281–295.

    PubMed  Google Scholar 

  • Farah, M. J. (1991). Patterns of co-occurrence among the associative agnosias: Implications for visual object representation. Cogn. Neuropsychol. 8: 1–19.

    Google Scholar 

  • Farah, M. J., and Aguirre, G. K. (1999). Imaging visual recognition: PET and fMRI studies of the functional anatomy of human visual recognition. Trends Cogn. Sci. 3: 179–186.

    PubMed  Google Scholar 

  • Farah, M. J., Wilson, K. D., Drain, M., and Tanaka, J. N. (1995). The inverted face effect in prosopagnosia: Evidence for mandatory, face-specific perceptual mechanisms. Vision Res. 35: 2089–2093.

    PubMed  Google Scholar 

  • Farah, M. J., Wilson, K. D., Drain, M., and Tanaka, J. N. (1998). What is “special” about face perception? Psychol. Rev. 105: 482–498.

    PubMed  Google Scholar 

  • Feinstein, J. S., Goldin, P. R., Stein, M. B., Brown, G. G., and Paulus, M. P. (2002). Habituation of attentional networks during emotion processing. Neuroreport 13: 1255–1258.

    PubMed  Google Scholar 

  • Fine, C., and Blair, R. J. R. (2000). Mini review: The cognitive and emotional effects of amygdala damage. Neurocase 6: 435–450.

    Google Scholar 

  • Friston, K. J., Holmes, A., Worsley, K. J., Poline, J.-B., Frith, C. D., and Frackowiak, R. S. J. (1995). Statistical parametric maps in functional imaging: A general linear approach. Hum. Brain Mapp. 2: 189–210.

    Google Scholar 

  • Friston, K. J., Holmes, A., Poline, J.-B., Price, C. J., and Frith, C. D. (1996a). Detecting activations in PET and fMRI: Levels of inference and power. Neuroimage 40: 223–235.

    Google Scholar 

  • Friston, K. J., Price, C. J., Fletcher, R., Moore, C., Frackoviak, R. S. J., and Dolan, R. J. (1996b). The trouble with cognitive subtraction. Neuroimage 40: 97–104.

    Google Scholar 

  • Gauthier, I., Anderson, A. W., Tarr, M. J., Skudlarski, P., and Gore, J. C. (1997). Levels of categorization in visual recognition studied with functional MRI. Curr. Biol. 7: 645–651.

    PubMed  Google Scholar 

  • Gauthier, I., Behrmann, M., and Tarr, M. (1999a). Can face recognition really be dissociated from object recognition? J. Cogn. Neurosci. 11: 349–370.

    PubMed  Google Scholar 

  • Gauthier, I., Tarr, M. J., Anderson, A. W., Skudlarski, P., and Gore, J. C. (1999b). Activation of the middle fusiform “face area” increases with expertise in recognizing novel objects. Nat. Neurosci. 2: 568–573.

    PubMed  Google Scholar 

  • Gauthier, I., Skudlarski, P., Gore, J. C., and Anderson, A. W. (2000). Expertize for cars and birds recruits brain areas involved in face recognition. Nat. Neurosci. 3: 191–197.

    PubMed  Google Scholar 

  • Gauthier, I., and Tarr, M. J. (1997). Becoming a “greeble” expert: Exploring mechanisms for face recognition. Vision Res. 37: 1673–1682.

    PubMed  Google Scholar 

  • George, N., Dolan, R. J., Fink, G. R., Baylis, G. C., Russell, C., and Driver, J. (1999). Contrast polarity and face recognition in the human fusiform gyrus. Nat. Neurosci. 2: 574–580.

    PubMed  Google Scholar 

  • George, N., Driver, J., and Dolan, R. (2001). Seen gaze-direction modulates fusiform activity and its coupling with other brain areas during face processing. Neuroimage 13: 1102–1112.

    PubMed  Google Scholar 

  • Gorno-Tempini, M. L., Pradelli, S., Serafini, M., Pagnoni, G., Baraldi, P., Porro, C., et al. (2001). Explicit and incidental facial expression processing: An fMRI study. Neuroimage 14: 465–473.

    PubMed  Google Scholar 

  • Gray, J. M., Young, A. W., Barker, W. A., Curtis, A., and Gibson, D. (1997). Impaired recognition of disgust in Huntington's disease gene carriers. Brain 120: 2029–2038.

    PubMed  Google Scholar 

  • Grelotti, D. J., Gauthier, I., and Schultz, R. T. (2002). Social interest and the development of cortical face specialization: What autism teaches us about face processing. Dev. Psychobiol. 40: 213–225.

    PubMed  Google Scholar 

  • Hadjikhani, N., and de Gelder, B. (2002). Neural basis of prosopagnosia: An fMRI study. Hum. Brain Mapp. 16: 176–182.

    PubMed  Google Scholar 

  • Hamann, S. (2001). Cognitive and neural mechanisms of emotional memory. Trends Cogn. Sci. 5: 394–400.

    PubMed  Google Scholar 

  • Hamann, S. F., Stefanacci, L., Squire, L., Adolphs, R., Tranel, D., Damasio, H., et al. (1996). Recognizing facial emotion. Nature 379: 497.

    PubMed  Google Scholar 

  • Hasselmo, M. E., Rolls, E. T., and Baylis, G. C. (1989). The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav. Brain Res. 32: 203–218.

    PubMed  Google Scholar 

  • Hariri, A. R., Bookheimer, S. Y., and Mazziotta, J. C. (2000). Modulating emotional responses: Effects of neocortical network on the limbic system. Neuroreport 11: 43–48.

    PubMed  Google Scholar 

  • Harmer, C. J., Grayson, L., and Goodwin, G. M. (2002). Enhanced recognition of disgust in bipolar illness. Biol. Psychiatry 51: 298–304.

    PubMed  Google Scholar 

  • Haxby, J. V., Grady, C. L., Horwitz, B., Ungerleider, L. G., Mishkin, M., Carson, R. E., et al. (1991). Dissociation of spatial as visual processing pathways in the human extrastriate cortex. Proc. Natl. Acad. Sci. U.S.A. 88: 1621–1625.

    PubMed  Google Scholar 

  • Haxby, J. V., Horwitz, B., Underleider, L. J., Maisog, J. M., Pietrini, P., and Grady, C. L. (1994). The functional organization of human extrastriate cortex: A PET-rCBF study of selective attention to faces and locations. J. Neurosci. 14: 6336–6353.

    PubMed  Google Scholar 

  • Haxby, J. V., Ungerleider, L. G., Horwitz, B., Maisog, J. M., Rapoport, S. I., and Grady, C. L. (1996). Face encoding and recognition in the human brain. Proc. Natl. Acad. Sci. U.S.A. 93: 922–927.

    PubMed  Google Scholar 

  • Haxby, J. V., Ungerleider, L. G., Clark, V. P., Schouten, J. L., Hoffman, E. A., and Martin, A. (1999). The effect of face inversion on activity in human neural systems for face and object perception. Neuron 22: 189–199.

    PubMed  Google Scholar 

  • Haxby, J. V., Hoffman, E. A., and Gobbini, I. M. (2000). The distributed human neural system for face perception. Trends Cogn. Sci. 4: 223–233.

    PubMed  Google Scholar 

  • Haxby, J. V., Gobbini, I. M., Furey, M. L., Ishai, A., Schouten, J. L., and Pietrini, P. (2001). Distributed and overlapping representation of faces and objects in the ventral temporal cortex. Science 293: 2425–2430.

    PubMed  Google Scholar 

  • Haxby, J. V., Hoffman, E. A., and Gobbini, I. M. (2002). Human neural systems for face recognition of social communication. Biol. Psychiatry 51: 59–67.

    PubMed  Google Scholar 

  • Heimberg, C., Gur, R. E., Erwin, R. J., Shtasel, D. L., and Gur, R. C. (1992). Facial emotion discrimination: III. Behavioral findings in schizophrenia. Psychiatry Res. 42: 253–265.

    PubMed  Google Scholar 

  • Herrmann, M. J., Aranda, D., Ellgring, H., Mueller, T. J., Strik, W. K., Heidrich, A., et al. (2002). Face-specific event-related potential in humans is independent from facial expression. Int. J. Psychophysiol. 45: 241–244.

    PubMed  Google Scholar 

  • Hoffman, E. A., and Haxby, J. V. (2000). Distinct representations of eye gaze and identity in the distributed human neural system for face perception. Nat. Neurosci. 3: 80–84.

    PubMed  Google Scholar 

  • Humphreys, G. W., Donnelly, N., and Riddoch, M. J. (1993). Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia 31: 173–181.

    PubMed  Google Scholar 

  • Iidaka, T., Omori, M., Murata, T., Kosaka, H., and Yonekura, Y. (2001). Neural Interaction of the Amygdala with the Prefrontal and Temporal Cortices in the Processing of Facial Expressions as Revealed by fMRI. J. Cogn. Neurosci. 13: 1035–1047.

    PubMed  Google Scholar 

  • Irwin, W., Davidson, R. J., Lowe, M. J., Mock, B. J., Sorenson, J. A., and Turski, P. A. (1996). Human amygdala activation detected with echo-planar functional magnetic resonance imaging. Neuroreport 7: 1765–1769.

    PubMed  Google Scholar 

  • Ishai, A., Ungerleider, L. G., Martin, A., Schouten, J. L., and Haxby, J. V. (1999). Distributed representation of objects in the human ventral visual pathway. Proc. Natl. Acad. Sci. U.S.A. 96: 9379–9384.

    PubMed  Google Scholar 

  • Ishai, A., Ungerleider, L. G., Martin, A., and Haxby, J. V. (2000). The representation of objects in the human occipital and temporal cortex. J. Cogn. Neurosci. 12: 35–51.

    PubMed  Google Scholar 

  • Itier, R. J., and Taylor, M. J. (2002). Inversion and contrast polarity reversal affect both encoding and recognition processes of unfamiliar faces: A repetition study using ERPs. Neuroimage 15: 353–372.

    PubMed  Google Scholar 

  • Izard, C. E. (1971). The Face of Emotion, Appleton Century Crofts, New York.

    Google Scholar 

  • Izard, C. E. (1977). Human Emotions, Plenum, New York.

    Google Scholar 

  • Jacobs, D. H., Shuren, J., and Heilman, K. M. (1995). Impaired perception of facial identity and facial affect in Huntington's disease. Neurology 45: 1217–1218.

    PubMed  Google Scholar 

  • Kanwisher, N. (2000). Domain specificity in face perception. Nat. Neurosci. 3: 759–763.

    PubMed  Google Scholar 

  • Kanwisher, N., McDermott, J., and Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. J. Neurosci. 17(11): 4302–4311.

    PubMed  Google Scholar 

  • Kanwisher, N., Tong, F., and Nakayama, K. (1998). The effect of face inversion of the human fusiform face area. Cognition 68: B1-B11.

    PubMed  Google Scholar 

  • Kapur, N., Friston, K. J., Young, A., Frith, C. D., and Frackowiak, R. S. J. (1995). Activation of human hippocampal formation during memory for faces: A PET study. Cortex 31: 99–108.

    PubMed  Google Scholar 

  • Katanoda, K., Yoshikawa, K., and Sugishita, M. (2000). Neural substrates for the recognition of newly learned faces: A functional MRI study. Neuropsychologia 38: 1616–1625.

    PubMed  Google Scholar 

  • Kesler-West, M. L., Andersen, A. D., Smith, C. D., Avison, M. L., Davis, C. E., Kryscio, R. J., et al. (2001). Neural substrates of facial emotion processing using fMRI. Cogn. Brain Res. 11: 213–226.

    Google Scholar 

  • Klin, A., Jones, W., Schultz, R., Volkmar, F., and Cohen, D. (2002). Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch. Gen. Psychiatry 59(9): 809–816.

    PubMed  Google Scholar 

  • Kosaka, H., Omori, M., Murata, T., Iidaka, T., Yamada, H., Okada, T., et al. (2002). Differential amygdala response during facial recognition in patients with schizophrenia: An fMRI study. Schizophr. Res. 57: 87–95.

    PubMed  Google Scholar 

  • Kuskowski, M. A., and Pardo, J. V. (1999). The role of the fusiform gyrus in the successful encoding of face stimuli. Neuroimage 9: 599–610.

    PubMed  Google Scholar 

  • LeDoux, J. (1996). The Emotional Brain, Simon & Schuster, New York.

    Google Scholar 

  • Lennox, B., Jacob, R., Calder, A., Lupson, V., and Bullmore, E. (2002). Behavioural insensitivity to sad facial expressions is associated with attenuated activation in amygdala and cingulate regions in patients with mania. Bipolar Disord. 4: 89.

    PubMed  Google Scholar 

  • Leonard, C. M., Rolls, E. T., Wilson, F. A. W., and Baylis, G. C. (1985). Neurons in the amygdala of the monkey with responses selective for faces. Behav. Brain Res. 15: 159–176.

    PubMed  Google Scholar 

  • Leveroni, C. L., Seidenberg, M., Mayer, A. R., Mead, L. A., Binder, J. R., and Rao, S. M. (2000). Neural systems underlying the recognition of familiar and newly learned faces. J. Neurosci. 20(2): 878–886.

    PubMed  Google Scholar 

  • Logothetis, N., Pauls, J., Augath, N., Trinath, T., and Oeltermann, A. (2001). Neurophysiological investigation of the basis of the fMRI signal. Nature 412: 150–157.

    Article  Google Scholar 

  • Mandal, M. K., Pandey, R., and Prasad, A. B. (1998). Facial expressions of emotion and schizophrenia. Schizophr. Bull. 24: 399–412.

    PubMed  Google Scholar 

  • Marotta, J. J., Genovese, C. R., and Behrmann, M. (2001). A functional MRI study of face recognition in patients with prosopagnosia. Neuroreport 12: 1581–1587.

    PubMed  Google Scholar 

  • McCarthy, G., Puce, A., Gore, J. C., and Allison, T. (1997). Face-specific processing in the human fusiform gyrus. J. Cogn. Neurosci. 9: 605–610.

    Google Scholar 

  • McCarthy, G., Puce, A., Belger, A., and Allison, T. (1999). Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. Cereb. Cortex 9: 431–444.

    PubMed  Google Scholar 

  • McNeill, D. (1998). The Face, Little, Brown, Boston.

    Google Scholar 

  • Milner, B. (1966). Amnesia following operation on the temporal lobes. In Whitty, C. W. M., and Zangwill, O. L. (eds.), Amnesia, Butterworths, London, pp. 109–133.

    Google Scholar 

  • Morris, J. S., Frith, C. D., Perrett, D. I., Rowland, D., Young, A. W., Calder, A. J., et al. (1996). A differential neural response in the human amygdala to fearful and happy facial expressions. Nature 383: 812–815.

    PubMed  Google Scholar 

  • Morris, J. S., Friston, K. J., Buchel, C., Frith, C. D., Young, A. W., Calder, A. J., et al. (1998). A neuromodulatory role of the human amygdala in processing emotional facial expressions. Brain 121: 47–57.

    PubMed  Google Scholar 

  • Morton, J., and Johnson, M. H. (1991). CONSPECT and CONLERN: A two-process theory of infant recognition. Psychol. Rev. 98: 164–181.

    PubMed  Google Scholar 

  • Moscovitch, M., Winocur, G., and Behrmann, M. (1997). What is special about face recognition?Nineteen experiments on a person with visual object agnosia and dyslexia but normal face recognition. J. Cogn. Neurosci. 9: 555–604.

    Google Scholar 

  • Münte, T. F., Brack, M., Grootheer, O., Wieringa, B. N., Matzke, M., and Johannes, S. (1998). Brain potentials reveal the timing of face identity and expression judgments. Neurosci. Res. 30:25–34.

    PubMed  Google Scholar 

  • O'Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D. M., and Dolan, R. J. (2003). Beauty in a smile: The role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 41: 147–155.

    PubMed  Google Scholar 

  • Ojemann, J. G., Ojemann, G. A., and Lettich, E. (1992). Neural activity related to faces and matching in human right nondominant temporal cortex. Brain 115: 1–13.

    PubMed  Google Scholar 

  • O'Toole, A. J., Roark, D. A., and Abdi, H. (2002). Recognizing moving faces: A psychological and neural synthesis. Trends Cogn. Sci. 6: 261–266.

    PubMed  Google Scholar 

  • Patterson, K. E., and Baddeley, A. D. (1977). When face recognition fails. J. Exp. Psychol. [Hum. Learn.] 3: 406–417.

    Google Scholar 

  • Penfield, W., and Perot, P. (1963). The brain's record of auditory and visual experience. Brain 86: 595–696.

    PubMed  Google Scholar 

  • Perrett, D. I., Hietanen, J. K., Oram, M. W., and Benson, P. J. (1992). Organization and functions of cells responsive to faces in the temporal cortex. Philos. Trans. R. Soc. Lond. B Biol. Sci. 335: 23–30.

    PubMed  Google Scholar 

  • Phillips, M. L., Young, A. W., Senior, C., Brammer, M., Andrew, C., Calder, A. J., et al. (1997). A specific neutral substrate for perceiving facial expressions of disgust. Nature 389: 495–498.

    PubMed  Google Scholar 

  • Phillips, M. L., Williams, L., Senior, C., Bullmore, E. T., Brammer, M., Andrew, C., et al. (1999). A differential neural response to threatening and non-threatening negative facial expressions in paranoid and non-paranoid schizophrenics. Psychiatry Res.: Neuroimag. 92: 11–33.

    Google Scholar 

  • Posamentier, M. T. (2002). Developmental Prosopagnosia: A Case Study. PhD dissertation, The University of Texas at Dallas.

  • Price, C. J., Moore, C. J., and Friston, K. J. (1997). Subtractions, conjunctions, and interactions in experimental design of activation studies. Hum. Brain Mapp. 5: 264–272.

    Google Scholar 

  • Puce, A., Allison, T., Gore, C., and McCarthy, G. (1995). Face-sensitive regions in human extrastriate cortex studied by functional MRI. J. Neurophysiol. 74: 1192–1199.

    PubMed  Google Scholar 

  • Puce, A., Allison, T., Asgari, M., Gore, J. C., and McCarthy, G. (1996). Differential sensitivity of human visual cortex to faces, letterstrings, and textures: A functional magnetic resonance imaging study. J. Neurosci. 16: 5205–5215.

    PubMed  Google Scholar 

  • Puce, A., Allison, T., and McCarthy, G. (1999). Electrophysiological studies of human face perception. III: Effects of top-down processing on face-specific potentials. Cereb. Cortex 9: 445–458.

    PubMed  Google Scholar 

  • Rhodes, G. (1985). Lateralized processes in face recognition. Br. J. Psychol. 76: 249–271.

    PubMed  Google Scholar 

  • Rhodes, G. (1993). Configural coding, expertise, and the right hemisphere advantage for face recognition. Brain Cogn. 22: 19–41.

    PubMed  Google Scholar 

  • Rhodes, G., Brake, S., and Atkinson, A. P. (1993). What's lost in inverted faces? Cognition 47: 25–57.

    PubMed  Google Scholar 

  • Rolls, E. T. (1992). Neurophysiological mechanisms underlaying face processing within and beyond the temporal cortical visual areas. Philos. Trans. R. Soc. Lond. B Biol. Sci. 335: 11–21.

    PubMed  Google Scholar 

  • Rolls, E. T. (2000). The brain and emotion. Behav. Brain Sci. 23: 177–234.

    PubMed  Google Scholar 

  • Rosch, E. (1978). Principles of categorization. In Rosch, R., and Lloyd, B. (eds.), Cognition and Categorization, Erlbaum, Hillsdale, NJ, pp. 27–48.

    Google Scholar 

  • Rosselli, M., Ardila, A., and Beltran, C. (2001). Rehabilitation of Balint's syndrome: A single case report. Appl. Neuropsychol. 8: 242–247.

    PubMed  Google Scholar 

  • Rossion, B., Campanella, S., Gomez, C. M., Delinte, A., Debatisse, D., Liard, L., et al. (1999). Task modulation of brain activity related to familiar and unfamiliar face processing: An ERP study. Clin. Neurophysiol. 110: 449–462.

    PubMed  Google Scholar 

  • Rossion, B., Gauthier, I., Tarr, M. J., Despland, P., Bruyer, R., Linotte, S., et al. (2000). The N170 occipito-temporal component is delayed and enhanced to inverted faces but not to inverted objects: An electrophysiological account of face-specific processes in the human brain. Neuroreport 11: 69–74.

    PubMed  Google Scholar 

  • Rossion, B., Curran, T., and Gauthier, I. (2002). A defense of the subordinate-level expertise account for the N170 component. Cognition 85: 189–196.

    PubMed  Google Scholar 

  • Russel, J. A. (1997). Reading emotions from and into faces: Resurrecting a dimensional–contextual perspective. In Russel, J. A., and Fernandez-Dols, J. M. (eds.), The Psychology of Facial Expression, Cambridge University Press, New York, pp. 295–320.

    Google Scholar 

  • Sacks, O. W. (1985). The Man Who Mistook His Wife for a Hat, Harper Collins, New York.

    Google Scholar 

  • Sansone, S., and Tiberghien, G. (1994). Traitement de l'expression faciale et reconnaissance des visages: Ind'ependence ou interaction? Psychol. Fr. 39(4): 327–344.

    Google Scholar 

  • Schneider, F., Weiss, U., Kessler, C., Salloum, J. B., Posse, S., Grodd, W., et al. (1998). Differential amygdala activation in schizophrenia during sadness. Schizophr. Res. 34: 133–142.

    PubMed  Google Scholar 

  • Schultz, R. T., Gauthier, I., Klin, A., Fulbright, R. K., Anderson, A. W., Volkmar, F., et al. (2000a). Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Arch. Gen. Psychiatry 57: 331–340.

    PubMed  Google Scholar 

  • Schultz, R. T., Romanski, L. M., and Tsatsanis, K. D. (2000b). Neurofunctional models of autistic disorder and Asperger syndrome. In Klin, A., Volkmar, F. R., and Sparrow, S. S. (eds.), Asperger Syndrome, Guilford Press, New York, pp. 172–209.

    Google Scholar 

  • Sergent, J., Otha, S., and MacDonald, B. (1992). Functional neuroanatomy of face and object processing. Brain 115: 15–36.

    PubMed  Google Scholar 

  • Sheline, Y. I., Barch, D. M., Donnelly, J. M., Ollinger, J. M., Snyder, A. Z., and Mintun, M. A. (2001). Increased amygdala response to masked emotional faces in depressed subjects resolves with antidepressant treatment: An fMRI study. Biol. Psychiatry 50: 651–658.

    PubMed  Google Scholar 

  • Sidtis, J. T., Strother, S. C., Anderson, J. R., and Rottenberg, D. A. (1999). Are brain functions really additive? Neuroimage 9: 490–496.

    PubMed  Google Scholar 

  • Spiridon, M., and Kanwisher, N. (2002). How distributed is visual category information in human occipito-temporal cortex?An fMRI study. Neuron 35: 1157–1165.

    PubMed  Google Scholar 

  • Sprengelmeyer, R., Young, A. W., Calder, A. J., Karnat, A., Lange, H., Hömberg, V., et al. (1996). Loss of disgust: Perception of faces and emotions in Huntington's disease. Brain 119: 1647–1665.

    PubMed  Google Scholar 

  • Sprengelmeyer, R., Young, A. W., Pundt, I., Sprengelmeyer, A., Calder, A. J., Berrios, G., et al. (1997). Disgust implicated in obsessive–compulsive disorder. Proc. R. Soc. Lond. B Biol. Sci. 264: 1676–1773.

    Google Scholar 

  • Sprengelmeyer, R., Rausch, M., Eysel, U. T., and Przuntek, H. (1998). Neural structures associated with recognition of facial expressions of basic emotions. Proc. R. Soc. Lond. B Biol. Sci. 265: 1927–1931.

    PubMed  Google Scholar 

  • Streit, M., Wulver, W., Brinkmeyer, J., Ihl, R., and Gaebel, W. (2000). Electrophysiological correlates of emotional and structural face processing in humans. Neurosci. Lett. 278: 13–16.

    PubMed  Google Scholar 

  • Talairach, J., and Tournoux, P. (1988). Co-Planar Stereotaxic Atlas of the Human Brain, Thieme Medical, New York.

    Google Scholar 

  • Tarr, M., and Gauthier, I. (2000). FFA: A flexible fusiform area for subordinate-level visual processing automatized by expertise. Nat. Neurosci. 3: 764–769.

    PubMed  Google Scholar 

  • Taylor, S. F., Liberzon, I., Fig, L. M., Decker, L. R., Minoshima, S., and Koeppe, R. A. (1998). The effect of emotional content on visual recognition memory: A PET activation study. Neuroimage 8: 188–197.

    PubMed  Google Scholar 

  • Taylor, S. F., Liberzon, I., and Koeppe, R. A. (2000). The effect of graded aversive stimili on limbic and visual activation. Neuropsychologia 38: 1415–1425.

    PubMed  Google Scholar 

  • Tempini, M. L. G., Price, C. J., Josephs, O., Vandenberghe, R., Cappa, S. F., Kapur, N., et al. (1998). The neural systems sustaining face and proper-name processing. Brain 121: 2103–2118.

    PubMed  Google Scholar 

  • Teunisse, J.-P., and de Gelder, B. (2001). Impaired categorical perception of facial expressions in high-functioning adolescents with autism. Child Neuropsychol. 7: 1–14.

    Google Scholar 

  • Thomas, K. M., Drevets, W. C., Whalen, R. J., Eccard, C. H., Dahl, R. E., Ryan, N. D., et al. (2001). Amygdala response to facial expressions in children and adults. Biol. Psychiatry 49: 309–316.

    PubMed  Google Scholar 

  • Tong, F., Nakayama, K., Moscovitch, M., Weinrib, O., and Kanwisher, N. (2000). Response properties of the human fusiform face area. Cogn. Neuropsychol. 17: 257–279.

    Google Scholar 

  • Tranel, D., Damasio, A. R., and Damasio, H. (1988). Intact recognition of facial expression, gender, and age in patients with impaired recognition of face identity. Neurology 38: 690–696.

    PubMed  Google Scholar 

  • Tulving, E., Kapur, S., Craik, F. I., Moscovitch, M., and Houle, S. (1994). Hemispheric encoding/retrieval asymmetry in episodic memory: Positron emission tomography findings. Proc. Natl. Acad. Sci. U.S.A. 96: 2016–2020.

    Google Scholar 

  • Valentine, T. (1988). Upside-down faces: A review of the effect of inversion upon face-recognition. Br. J. Psychol. 79: 471–491.

    PubMed  Google Scholar 

  • Wacholtz, E. (1996). Can we learn from the clinically significant face processing deficits, prosopagnosia and capgras delusion? Neuropsychol. Rev. 6: 203–258.

    PubMed  Google Scholar 

  • Whalen, P. J., Rauch, S. L., Etcoff, N. L., McInerney, S. C., Lee, M. B., and Jenike, M. A. (1998). Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. J. Neurosci. 18: 411–418.

    PubMed  Google Scholar 

  • Wiser, A. K., Andreasen, N. C., O'Leary, D. S., Crespo-Facorro, B., Boles-Ponto, L. L., Watkins, G. L., et al. (2000). Novel vs. well-learned memory for faces: A positron emission tomography study. J. Cogn. Neurosci. 12: 255–266.

    PubMed  Google Scholar 

  • Wojciulik, E., Kanwisher, N., and Driver, J. (1998). Covert visual attention modulates face-specific activity in the human fusiform gyrus: fMRI study. J. Neurophysiol. 79: 1574–1578.

    PubMed  Google Scholar 

  • Wright, C. I., Fischer, H., Whalen, P. J., McInerney, S. C., Shin, L. M., and Rauch, S. L. (2001). Differential prefrontal cortex and amygdala habituation to repeatedly presented emotional stimuli. Neuroreport 12: 379–383.

    PubMed  Google Scholar 

  • Yang, T. T., Menon, V., Eliez, S., Blasey, C., White, C. D., Reaid, A. J., et al. (2002). Amygdalar activation associated with positive and negative facial expressions. Neuroreport 13: 1737–1741.

    PubMed  Google Scholar 

  • Yaxley, S., Rolls, E. T., and Sienkiewicz, Z. J. (1988). The responsiveness of neurons in the insular gustatory cortex of the macaque money is independent of hunger. Physiol. Behav. 43: 223–229.

    PubMed  Google Scholar 

  • Yin, R. K. (1969). Looking at upside-down faces. J. Exp. Psychol. 81: 141–145.

    Google Scholar 

  • Yin, R. K. (1970). Face recognition by brain-injured patients: A dissociable ability? Neuropsychologia 8: 395–402.

    PubMed  Google Scholar 

  • Young, A. W., McWeeny, K. H., Hay, D. C., and Ellis, A. W. (1986). Matching familiar and unfamiliar faces on identity and expression. Psychol. Res. 48: 63–68.

    PubMed  Google Scholar 

  • Young, A. W., Aggleton, J. P., Hellawell, D. J., Johnson, M., Broks, P., and Hanley, J. R. (1995). Face processing impairments after amygdalotomy. Brain 118: 15–24.

    PubMed  Google Scholar 

  • Young, A. W., Hellawell, D. J., van de Wal, C., and Johnson, M. (1996). Facial expression processing after amygdalotomy. Neuropsychologia 34: 31–39.

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Program in Cognition and Neuroscience, The University of Texas at Dallas, Dallas, Texas

    Mette T. Posamentier & Hervé Abdi

Authors
  1. Mette T. Posamentier
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hervé Abdi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mette T. Posamentier.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Posamentier, M.T., Abdi, H. Processing Faces and Facial Expressions. Neuropsychol Rev 13, 113–143 (2003). https://doi.org/10.1023/A:1025519712569

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1025519712569

Search

Navigation