Elsevier

Basal Ganglia

Volume 2, Issue 3, September 2012, Pages 131-138
Basal Ganglia

Cannabinoids and value-based decision making: Implications for neurodegenerative disorders

https://doi.org/10.1016/j.baga.2012.06.005Get rights and content

Abstract

In recent years, disturbances in cognitive function have been increasingly recognized as important symptomatic phenomena in neurodegenerative diseases, including Parkinson’s disease (PD). Value-based decision making in particular is an important executive cognitive function that is not only impaired in patients with PD, but also shares neural substrates with PD in basal ganglia structures and the dopamine system. Interestingly, the endogenous cannabinoid system modulates dopamine function and subsequently value-based decision making. This review will provide an overview of the interdisciplinary research that has influenced our understanding of value-based decision making and the role of dopamine, particularly in the context of reinforcement learning theories, as well as recent animal and human studies that demonstrate the modulatory role of activation of cannabinoid receptors by exogenous agonists or their naturally occurring ligands. The implications of this research for the symptomatology of and potential treatments for PD are also discussed.

Introduction

Disturbances in executive cognitive functions, including decision making, are prominent clinical features in various psychiatric disorders, such as attention-deficit hyperactivity disorder, mood and anxiety disorders, schizophrenia and substance use disorders [1]. In recent years, the notion that cognitive disturbances and impairments in decision making are important symptomatic phenomena in neurodegenerative disorders such as Parkinson’s disease (PD) has gained increasing interest [2], [3], [4], [5]. Interestingly, recent evidence suggests that these cognitive impairments might arise in the prediagnostic and early stages of PD [6], [7], [8] and are possibly caused by functional loss in the corticostriatal circuitry subserving cognitive functions [9].

In general terms, decision making refers to the selection of appropriate actions from various available options based on cost–benefit evaluations and subjective values of the outcomes of these actions. As such, decision making is a complex mental construct that is composed of several cognitive functions that should theoretically lead to adaptive behavioral outcomes or to maintain psychological or physiological homeostasis [10]. These functions and goal-directed action selection in decision making are driven by various neurotransmitter systems in the brain and have in particular been associated with dopamine function [11], [12]. Over the last decades there has been a rise in decision making experimental data, partly due to the development and availability of laboratory tasks assessing aspects of real-life decision making in humans and preclinical animal models [13]. Altogether, these studies have greatly increased our understanding of the scientific basis and neurobiology of decision making, not the least because it is a subject that is studied from multiple disciplines including economics, psychology, neuroscience and computer science [14].

In addition to dopamine modulation of decision making, there is accumulating evidence of cannabinoid involvement in executive cognitive functions including decision making [15], [16]. The endocannabinoid neurotransmitter system consists of at least two receptors, cannabinoid CB1 and cannabinoid CB2, of which primarily the former is highly expressed in the central nervous system. These Gi/o-protein coupled receptors, of which the vast majority is expressed presynaptically, are activated by their endogenous signaling molecules, such as anandamide (AEA) and 2-arachydonylglycerol (2-AG), and in response directly modulate the probability of release of several neurotransmitters including GABA, glutamate and indirectly dopamine [17], [18]. Moreover, cannabinoid CB1 receptors are densely expressed in the brain including frontal cortical regions and several nuclei of the basal ganglia such as the striatum, globus pallidus and substantia nigra [19], [20], [21].

Interestingly, despite the cannabinoid CB1 receptor antagonist Rimonabant being withdrawn from the market, there is large therapeutic potential of cannabinoid mechanisms in several metabolic, psychiatric and neurodegenerative disorders [22], [23].

This review aims at providing more insight into this convergence of cannabinoids, dopamine and value-based decision making in the context of neurodegenerative disorders and in particular PD. To this aim, we first will provide background on different theories of reinforcement learning as a framework for value-based decision making, and we will briefly discuss the role of dopamine in these processes. Next, we will discuss the involvement of the basal ganglia and importance of the endogenous cannabinoid system and its interactions with the dopaminergic system in decision making. Finally, we will review and discuss the available empirical evidence obtained from both clinical and preclinical studies of cannabinoid modulation of value-based decision making.

Section snippets

Theoretical history of reinforcement learning

Reinforcement learning (RL) is a well-supported computational framework for learning values in order to achieve optimal outcomes, which has gained popularity in the study of value-based decision making and its neural mechanisms [24]. The modern rendition of RL has grown from a fairly interdisciplinary history, beginning with animal learning paradigms of psychology and evolving through mathematical formulations and artificial learning research [25]. Both Bush and Mosteller’s first formal

Dopamine and reinforcement learning

Support from neural data and computational models have converged upon the midbrain dopamine system as encoding this key signal [29], [30]. A substantial amount of research has implicated the dopamine system as a key player in value-based decision making, especially in instances of positive reinforcement [31]. Specifically, evidence has accumulated under the framework of a reward prediction error hypothesis (RPE), which posits that dopamine neuronal activity encodes the difference between

Limitations of the dopamine RPE hypothesis

Despite the accumulation of support for the dopamine RPE hypothesis, there are also noteworthy limitations which include contradictory data [46], [47], as well as overarching problems concerning, for example, the treatment of Pavlovian vs. instrumental learning paradigms, limitations of the simple behavioral tasks currently in use, and facets of dopamine function that extend beyond its short-latency phasic firing [46]. Within the broad RL framework itself, the role and expression of a

The axiomatic approach and its advantages

Caplin and Dean proposed an axiomatic approach as a solution to clarify the role of dopamine in decision making, and more specifically RL [55]. Borrowed from economics, this standard methodology encapsulates core theoretical tenets in compact mathematical statements [56]. These axioms then serve as testable predictions, the criteria to which empirical data must conform in order to admit the theory in question. Caplin and Dean applied this method to the RPE hypothesis of dopamine function [28],

Striatal involvement in value-based decision making

In addition to the well-established involvement of prefrontal cortical regions in decision-making [9], [61], rodent studies have provided a vast amount of evidence supporting the pivotal role of the ventral striatum in decision making processes involving cost–benefit assessments. For example, excitotoxic lesions of the nucleus accumbens impair effort-based and delay-based decision making, as well as decision making under risk as has been excellently reviewed elsewhere [13]. On the other hand,

Cannabinoids have a modulatory role on dopamine systems in a manner that is relevant to value-based decision making

As pointed out previously, an accumulating body of evidence suggests that dopamine plays an integral role in value-based decision making [11], [12]. While the precise behavioral outcome resulting from dopamine release likely varies depending on the pattern of dopaminergic neural activity and the postsynaptic target [13], [72], subsecond bursts of mesolimbic dopamine release in the core region of the nucleus accumbens are theorized to modulate cost–benefit assessments by carrying information

Empirical evidence for cannabinoid receptor modulation of value-based decision making

Consistent with findings from rodent studies, the human brain contains high densities of the cannabinoid CB1 receptor in frontocortical and striatal regions [98]. In accordance, accumulating evidence from human neuroimaging studies employing both fMRI and Positron Emission Tomography (PET) approaches indicates that marijuana and THC modulate the activation of prefrontal cortical and subcortical brain regions subserving dopamine function and decision making processes [99]. Furthermore, and

Concluding remarks

This review aimed at (1) providing a background in reinforcement learning as a framework to increase our understanding of different components of value-based decision making and (2) highlighting the importance of cannabinoid signaling that, via its modulatory actions on the dopaminergic system, modulates value-based decision making. Particularly, in view of neurodegenerative disorders such as PD this topic is gaining increasing interest. First, there is now accumulating evidence that executive

Acknowledgements

Angela M. Lee was supported by a Fulbright Program grant from the U.S. Department of State, which was funded through the Netherland-America Foundation. Joseph F. Cheer and Erik B. Oleson are funded through the National Institute on Drug Abuse (R01DA022340, F32DA032266).

References (137)

  • M.J. Frank

    Computational models of motivated action selection in corticostriatal circuits

    Curr Opin Neurobiol

    (2011)
  • J.C. Horvitz

    Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events

    Neuroscience

    (2000)
  • K.C. Berridge et al.

    What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

    Brain Res Brain Res Rev

    (1998)
  • S.M. McClure et al.

    A computational substrate for incentive salience

    Trends Neurosci

    (2003)
  • A. Caplin et al.

    Axiomatic methods, dopamine and reward prediction error

    Curr Opin Neurobiol

    (2008)
  • C.F. Camerer

    Neuroeconomics: opening the gray box

    Neuron

    (2008)
  • J.W. Dalley et al.

    Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates

    Neurosci Biobehav Rev

    (2004)
  • S. Braun et al.

    The dorsomedial striatum mediates flexible choice behavior in spatial tasks

    Behav Brain Res

    (2011)
  • K. Ballard et al.

    Dissociable neural representations of future reward magnitude and delay during temporal discounting

    Neuroimage

    (2009)
  • K. Preuschoff et al.

    Neural differentiation of expected reward and risk in human subcortical structures

    Neuron

    (2006)
  • X. Cai et al.

    Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice

    Neuron

    (2011)
  • J.J. Day et al.

    Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs

    Biol Psychiatry

    (2010)
  • M. Beyene et al.

    Cue-evoked dopamine release in the nucleus accumbens shell tracks reinforcer magnitude during intracranial self-stimulation

    Neuroscience

    (2010)
  • J.F. Cheer et al.

    Coordinated accumbal dopamine release and neural activity drive goal-directed behavior

    Neuron

    (2007)
  • J.D. Salamone

    The involvement of nucleus accumbens dopamine in appetitive and aversive motivation

    Behav Brain Res

    (1994)
  • J. Sokolowski et al.

    The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell

    Pharmacol Biochem Behav

    (1998)
  • G.L. Gessa et al.

    Cannabinoids activate mesolimbic dopamine neurons by an action on cannabinoid CB1 receptors

    Eur J Pharmacol

    (1998)
  • M.D. Julian et al.

    Neuroanatomical relationship between type 1 cannabinoid receptors and dopaminergic systems in the rat basal ganglia

    Neuroscience

    (2003)
  • C.R. Lupica et al.

    Endocannabinoid release from midbrain dopamine neurons: a potential substrate for cannabinoid receptor antagonist treatment of addiction

    Neuropharmacology

    (2005)
  • J.F. Cheer et al.

    Lack of response suppression follows repeated ventral tegmental cannabinoid administration: an in vitro electrophysiological study

    Neuroscience

    (2000)
  • A. Tanimura et al.

    The endocannabinoid 2-arachidonoylglycerol produced by diacylglycerol lipase alpha mediates retrograde suppression of synaptic transmission

    Neuron

    (2010)
  • F. Matyas et al.

    Identification of the sites of 2-arachidonoylglycerol synthesis and action imply retrograde endocannabinoid signaling at both GABAergic and glutamatergic synapses in the ventral tegmental area

    Neuropharmacology

    (2008)
  • B.E. Alger et al.

    Supply and demand for endocannabinoids

    Trends Neurosci

    (2011)
  • A.A. Wakley et al.

    Effects of cannabinoid drugs on the reinforcing properties of food in gestationally undernourished rats

    Pharmacol Biochem Behav

    (2009)
  • E.B. Oleson et al.

    Endocannabinoids shape accumbal encoding of cue-motivated behavior via CB1 receptor activation in the ventral tegmentum

    Neuron

    (2012)
  • American Psychiatric Association

    Diagnostic and statistical manual of mental disorders

    (1994)
  • E. Gleichgerrcht et al.

    Decision-making cognition in neurodegenerative diseases

    Nat Rev Neurol

    (2010)
  • M. Milenkova et al.

    Intertemporal choice in Parkinson’s disease

    Mov Disord

    (2011)
  • J. Pagonabarraga et al.

    Controlled study of decision-making and cognitive impairment in Parkinson’s disease

    Mov Disord

    (2007)
  • V. Voon et al.

    Impulsive choice–Parkinson disease and dopaminergic therapy

    Nat Rev Neurol

    (2011)
  • E. Elgh et al.

    Cognitive function in early Parkinson’s disease: a population-based study

    Eur J Neurol

    (2009)
  • N. Ibarretxe-Bilbao et al.

    Neuroanatomical correlates of impaired decision-making and facial emotion recognition in early Parkinson’s disease

    Eur J Neurosci

    (2009)
  • E.K. Miller et al.

    An integrative theory of prefrontal cortex function

    Annu Rev Neurosci

    (2001)
  • M.P. Paulus

    Decision-making dysfunctions in psychiatry – altered homeostatic processing?

    Science

    (2007)
  • B.W. Balleine et al.

    The role of the dorsal striatum in reward and decision-making

    J Neurosci

    (2007)
  • R.D. Rogers

    The roles of dopamine and serotonin in decision making: evidence from pharmacological experiments in humans

    Neuropsychopharmacol

    (2011)
  • S.B. Floresco et al.

    Cortico-limbic-striatal circuits subserving different forms of cost–benefit decision making

    Cogn Affect Behav Neurosci

    (2008)
  • A. Rangel et al.

    A framework for studying the neurobiology of value-based decision making

    Nat Rev Neurosci

    (2008)
  • N. Solowij et al.

    Cannabis and cognitive dysfunction: parallels with endophenotypes of schizophrenia?

    J Psychiatry Neurosci

    (2007)
  • T.F. Freund et al.

    Role of endogenous cannabinoids in synaptic signaling

    Physiol Rev

    (2003)
  • Cited by (7)

    • Further evidence of anxiety- and depression-like behavior for total genetic ablation of cannabinoid receptor type 1

      2021, Behavioural Brain Research
      Citation Excerpt :

      The risk assessment may be associated to an increase in the time taken to change the initial position and could be interpreted as a longer decision-making process. Experimental and clinical studies have shown the participation of CB1R in decision-making [95], and chronic THC users have shown a disruption in decision-making capacity [96,97], which may be associated to the decrease reported in CB1R [98,99]. Anxiety-like behavior in CB1R−/− mice is one of the characteristics associated with a depressive phenotype.

    • Nonmotor Symptoms in Dystonia

      2017, International Review of Neurobiology
      Citation Excerpt :

      Levodopa is a mainstay in the treatment of DRD, though this has the potential for exacerbating psychiatric manifestations; as for example, increased dopaminergic activity in the mesolimbic pathway may produce hallucinations and delusions (Murray, Lappin, & Di Forti, 2017). The same holds true for cannabinoid agonists, which increase dopaminergic activity in the nucleus accumbens ultimately leading to risk-taking behaviors and substance use, as well as the glutamate receptor inhibitors, which increase glutamate activity in the cortical regions leading to anxiety, psychosis, and addiction (Lee, Oleson, Diergaarde, Cheer, & Pattij, 2012; Linden & Schoepp, 2006; Sperlágh, Windisch, Andó, & Vizi, 2009). Myoclonus-dystonia (MD) is an autosomal dominant progressive movement disorder equally affecting males and females during the first two decades of life (Asmus et al., 2007).

    • The cannabinoid system and impulsive behavior

      2015, Cannabinoids in Neurologic and Mental Disease
    View all citing articles on Scopus
    1

    These authors equally contributed to the manuscript.

    View full text