Elsevier

Behavioural Brain Research

Volume 218, Issue 1, 17 March 2011, Pages 240-247
Behavioural Brain Research

Review
Contributions of ERK signaling in the striatum to instrumental learning and performance

https://doi.org/10.1016/j.bbr.2010.12.010Get rights and content

Abstract

The striatum is critical for learning and decision making; however, the molecular mechanisms that govern striatum function are not fully understood. The extracellular signal regulated kinase (ERK) cascade is an important signaling pathway that underlies synaptic plasticity, cellular excitability, learning and arousal. This review focuses on the role of ERK signaling in striatum function. ERK is activated in the striatum by coordinated dopamine and glutamate receptor signaling, where it underlies corticostriatal synaptic plasticity and influences striatal cell excitability. ERK activation in the dorsal striatum is necessary for action-outcome learning and performance of goal-directed actions. In the ventral striatum, ERK is necessary for the motivating effects of reward-associated stimuli on instrumental performance. Dysregulation of ERK signaling in the striatum by repeated drug exposure contributes to the development of addictive behavior. These results highlight the importance of ERK signaling in the striatum as a critical substrate for learning and as a regulator of ongoing behavior. Furthermore, they suggest that ERK may be a suitable target for therapeutics to treat disorders of learning and decision making that arise from compromised striatum function.

Research highlights

ERK signaling regulates learning, memory, synaptic plasticity and arousal. ▶ Dorsal striatum ERK mediates goal-directed learning and performance. ▶ Ventral striatum ERK mediates Pavlovian-instrumental transfer. ▶ ERK dysregulation may underlie addiction.

Introduction

The striatum, the largest of the basal ganglia nuclei, is a critical substrate for learning and decision making. Impairments in learning and decision making accompany a range of disorders that affect the striatum, including substance abuse disorder, obsessive-compulsive disorder, and Parkinson's disease [1], [2], [3]. Furthermore, the application of sophisticated procedures derived from instrumental conditioning in animals has identified parallel corticostriatal circuits that mediate distinct learning and action control processes [4], [5], [6], [7], [8]. Nevertheless, the molecular mechanisms that underlie learning and decision making in the striatum are not fully understood. One important regulator of neuronal function is the extracellular signal regulated kinase (ERK) pathway. ERK is a member of mitogen activated protein kinase (MAPK) family, and is critical for nervous system development and plasticity in the adult nervous system [9], [10]. ERK signaling in the nervous system has a critical role in memory formation, affect and arousal. Furthermore, the efficacy of a number of psychoactive substances, such as mood stabilizers and addictive drugs, depend, in part, on their ability to activate ERK in the nervous system.

In the following review, we highlight the role of ERK signaling in the striatum in learning and decision making. We begin with a brief overview of ERK signaling in the nervous system and its role in learning and behavior regulation. This is followed by a discussion of the role of ERK signaling in striatal-based learning and decision-making tasks. We conclude with a description of the role of ERK signaling in substance abuse, in which we discuss how alterations in ERK signaling by repeated drug exposure may compromise striatum function and produce features of addictive behavior.

Section snippets

The ERK signaling pathway

Like other MAPK signaling pathways, the ERK cascade consists of three kinases: ERK, of which there are two isoforms, ERK1 and ERK2, and their upstream kinases MEK and raf (see [11], [12] for review). ERK activation occurs in response to a variety of extracellular stimuli and forms an essential pathway for cells to generate adaptive responses to changing environments. These cellular responses include regulation of gene expression and synthesis of new proteins, alteration in cellular structure or

ERK signaling influences striatal synaptic plasticity and excitability

The striatum is the largest of the basal ganglia nuclei and serves as the primary input structure for basal ganglia-thalamo-cortical circuitry. The striatum receives excitatory glutamatergic inputs from cortical, limbic and thalamic regions, as well as dopaminergic input from the midbrain [58], [59]. Dopaminergic input to the striatum accounts for the majority of dopaminergic signaling in the brain. Glutamatergic and dopaminergic synapses form in close proximity on striatal medium spiny neurons

ERK and addiction

Exposure to a variety of substances with abuse potential, including psychostimulants, opioids and nicotine, acutely activate ERK in the striatum and other brain areas [104], [105]. Many enduring behavioral effects of acute drug exposure depend on ERK signaling. For example, pairing a context with drug exposure produces a conditioned place preference (CPP), and ERK inhibition prior to drug-context pairing prevents the formation of this preference [105], [106]. Since ERK does not prevent the

Conclusions

The role of ERK in addictive behavior in the striatum is consistent with its role in action-outcome learning and control of behavior by reward-associated stimuli more generally. This is not surprising given that drug-taking is a form of appetitive behavior. What is different about abused substances is they activate ERK more strongly than natural rewards and that with repeated exposure they increase basal levels of ERK activation. These properties may be responsible for some features of

Acknowledgements

This research was supported by NIH grants HD059527 to BWB and DA026559 to MWS.

References (121)

  • J.D. Runyan et al.

    Intra-medial prefrontal administration of SCH-23390 attenuates ERK phosphorylation and long-term memory for trace fear conditioning in rats

    Neurobiol Learn Mem

    (2004)
  • M.G. Giovannini et al.

    Inhibition of acetylcholine-induced activation of extracellular regulated protein kinase prevents the encoding of an inhibitory avoidance response in the rat

    Neuroscience

    (2005)
  • D. Johnston et al.

    Active dendrites: colorful wings of the mysterious butterflies

    Trends Neurosci

    (2008)
  • M.M. Shah et al.

    Dendritic ion channel trafficking and plasticity

    Trends Neurosci

    (2010)
  • D. Wang et al.

    Characteristics of IA currents in adult rabbit cerebellar Purkinje cells

    Brain Res

    (2006)
  • C.H. Duman et al.

    A role for MAP kinase signaling in behavioral models of depression and antidepressant treatment

    Biol Psychiatry

    (2007)
  • H. Qi et al.

    Antidepressants reverse the attenuation of the neurotrophic MEK/MAPK cascade in frontal cortex by elevated platform stress; reversal of effects on LTP is associated with GluA1 phosphorylation

    Neuropharmacology

    (2009)
  • S.L. Gourley et al.

    Regionally specific regulation of ERK MAP kinase in a model of antidepressant-sensitive chronic depression

    Biol Psychiatry

    (2008)
  • H. Einat et al.

    Cellular plasticity cascades: genes-to-behavior pathways in animal models of bipolar disorder

    Biol Psychiatry

    (2006)
  • D.M. Lovinger

    Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum

    Neuropharmacology

    (2010)
  • M. Di Filippo et al.

    Short-term and long-term plasticity at corticostriatal synapses: implications for learning and memory

    Behav Brain Res

    (2009)
  • D.J. Surmeier et al.

    D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons

    Trends Neurosci

    (2007)
  • C. Mazzucchelli et al.

    Knockout of ERK1 MAP kinase enhances synaptic plasticity in the striatum and facilitates striatal-mediated learning and memory

    Neuron

    (2002)
  • P. Greengard et al.

    Beyond the dopamine receptor: the DARPP-32/protein phosphatase-1 cascade

    Neuron

    (1999)
  • S. Fasano et al.

    Ras-guanine nucleotide-releasing factor 1 (Ras-GRF1) controls activation of extracellular signal-regulated kinase (ERK) signaling in the striatum and long-term behavioral responses to cocaine

    Biol Psychiatry

    (2009)
  • A.G. Carter et al.

    State-dependent calcium signaling in dendritic spines of striatal medium spiny neurons

    Neuron

    (2004)
  • D.J. Surmeier et al.

    Modulation of calcium currents by a D1 dopaminergic protein kinase/phosphatase cascade in rat neostriatal neurons

    Neuron

    (1995)
  • J.C. Horvitz

    Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum

    Behav Brain Res

    (2002)
  • J.C. Horvitz

    Stimulus-response and response-outcome learning mechanisms in the striatum

    Behav Brain Res

    (2009)
  • J.A. Girault et al.

    ERK2: a logical AND gate critical for drug-induced plasticity?

    Curr Opin Pharmacol

    (2007)
  • B.W. Balleine et al.

    Goal-directed instrumental action: contingency and incentive learning and their cortical substrates

    Neuropharmacology

    (1998)
  • H.H. Yin et al.

    Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning

    Behav Brain Res

    (2006)
  • G. Bureau et al.

    Intrastriatal inhibition of extracellular signal-regulated kinases impaired the consolidation phase of motor skill learning

    Neurobiol Learn Mem

    (2010)
  • M.W. Shiflett et al.

    Appetitive Pavlovian conditioned stimuli increase CREB phosphorylation in the nucleus accumbens

    Neurobiol Learn Mem

    (2009)
  • M.J. Frank et al.

    By carrot or by stick: cognitive reinforcement learning in parkinsonism

    Science

    (2004)
  • P.W. Kalivas et al.

    The neural basis of addiction: a pathology of motivation and choice

    Am J Psychiatry

    (2005)
  • J.J. Canales et al.

    Patterns of gene expression and behavior induced by chronic dopamine treatments

    Ann Neurol

    (2000)
  • H.H. Yin et al.

    Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

    Eur J Neurosci

    (2008)
  • B.W. Balleine et al.

    The role of the dorsal striatum in reward and decision-making

    J Neurosci

    (2007)
  • J.R. Wickens et al.

    Striatal contributions to reward and decision making—making sense of regional variations in a reiterated processing matrix

    Reward and Decision Making in Corticobasal Ganglia Networks

    (2007)
  • M. Raman et al.

    Differential regulation and properties of MAPKs

    Oncogene

    (2010)
  • P.P. Roux et al.

    ERK and p38 MAPK-activated protein kinases: a family of protein kinases with diverse biological functions

    Microbiol Mol Biol Rev

    (2004)
  • R.E. Dolmetsch et al.

    Signaling to the nucleus by an L-type calcium channel-calmodulin complex through the MAP kinase pathway

    Science

    (2001)
  • G.M. Thomas et al.

    MAPK cascade signaling and synaptic plasticity

    Nat Rev Neurosci

    (2004)
  • B.I. Kanterewicz et al.

    The extracellular signal-regulated kinase cascade is required for NMDA receptor-independent LTP in area CA1 but not area CA3 of the hippocampus

    J Neurosci

    (2000)
  • Y.Y. Huang et al.

    Both protein kinase A and mitogen-activated protein kinase are required in the amygdala for the macromolecular synthesis-dependent late phase of long-term potentiation

    J Neurosci

    (2000)
  • E. Thiels et al.

    Long-term depression in the adult hippocampus in vivo involves activation of extracellular signal-regulated kinase and phosphorylation of Elk-1

    J Neurosci

    (2002)
  • M. Goldin et al.

    Protein kinase C and ERK involvement in dendritic spine plasticity in cultured rodent hippocampal neurons

    Eur J Neurosci

    (2003)
  • G-Y. Wu et al.

    Spaced stimuli stabilize MAPK pathway activation and its effects on dendritic morphology

    Nat Neurosci

    (2001)
  • S. Davis et al.

    The MAPK/ERK cascade targets both Elk-1 and cAMP response element-binding protein to control long-term potentiation-dependent gene expression in the dentate gyrus in vivo

    J Neurosci

    (2000)
  • Cited by (78)

    • Intra-dorsal striatal acetylcholine M1 but not dopaminergic D1 or glutamatergic NMDA receptor antagonists inhibit consolidation of duration memory in interval timing

      2022, Behavioural Brain Research
      Citation Excerpt :

      The SBF model proposes that MSNs become coincidence detectors of cortical glutamatergic inputs with co-activation of dopaminergic synapses from the midbrain. Although D1 and NMDA receptors are key players in the development of neuronal plasticity in MSNs ([14–19] for review, see [36]), other types of receptors such as dopamine D2 and/or metabotropic glutamate receptors are also involved in plasticity changes in MSN synapses [36]. Therefore, our findings do not contradict the prediction of the SBF model and narrow down the candidates for the receptor types inducing neuronal plasticity underlying the formation of duration memory.

    • The Meaning of Behavior: Discriminating Reflex and Volition in the Brain

      2019, Neuron
      Citation Excerpt :

      The nucleus accumbens core (NACco) and dorsomedial striatum (DMS) were considered as likely contenders, and whereas the NACco was found to contribute to instrumental performance but not goal-directed learning (Corbit et al., 2001; Hart et al., 2018a), systematic exploration found evidence of action-outcome encoding in the posterior dorsomedial striatum (pDMS; Yin et al., 2005a), a region subsequently delineated as a separate anatomical division of the striatum based on its heterogeneous, multimodal cortical inputs (Hunnicutt et al., 2016). In this early work, we found that pre- or post-training lesions of the pDMS, inactivation using the GABA A agonist muscimol, the NMDA antagonist AP-5, or the p-ERK inhibitor UO126 blocked both goal-directed learning and the expression of that learning in performance (Shiflett and Balleine, 2011; Yin et al., 2005a, 2005b). Hart et al., 2018a recently confirmed the involvement of the direct PL to pDMS circuit in goal-directed learning, ruling out any involvement of NACco-projecting PL neurons while establishing the critical role of bilaterally pDMS-projecting PL output neurons in that effect.

    • Betulinic acid derivatives can protect human Müller cells from glutamate-induced oxidative stress

      2019, Experimental Cell Research
      Citation Excerpt :

      The Erk MAPK is primarily considered to be stimulated by growth factors, mitogens and survival factors, resulting in the activation of genes that promote cell growth and differentiation [50–52]. Erk is highly expressed in neurons and also involved in synaptic plasticity, memory and learning [53,54]. However, the Erk pathway also mediates retinal apoptosis and Müller cell death in response to glutamate-induced toxicity [43].

    View all citing articles on Scopus
    View full text