Advertisement

Nucleus Accumbens Neurons Track Behavioral Preferences and Reward Outcomes During Risky Decision Making

      Background

      To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.

      Methods

      Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.

      Results

      At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.

      Conclusions

      Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats’ preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Biological Psychiatry
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Cardinal R.N.
        Neural systems implicated in delayed and probabilistic reinforcement.
        Neural Netw. 2006; 19: 1277-1301
        • Green L.
        • Myerson J.
        A discounting framework for choice with delayed and probabilistic rewards.
        Psychol Bull. 2004; 130: 769-792
        • Phillips P.E.
        • Walton M.E.
        • Jhou T.C.
        Calculating utility: Preclinical evidence for cost-benefit analysis by mesolimbic dopamine.
        Psychopharmacology (Berl). 2007; 191: 483-495
        • Rangel A.
        • Camerer C.
        • Montague P.R.
        A framework for studying the neurobiology of value-based decision making.
        Nat Rev Neurosci. 2008; 9: 545-556
        • Saddoris M.P.
        • Sugam J.A.
        • Cacciapaglia F.
        • Carelli R.M.
        Rapid dopamine dynamics in the accumbens core and shell: Learning and action. Front Biosci.
        in: 5. 2013: 273-288
        • Avanzi M.
        • Uber E.
        • Bonfa F.
        Pathological gambling in two patients on dopamine replacement therapy for Parkinson's disease.
        Neurol Sci. 2004; 25: 98-101
        • Chang S.W.C.
        • Barack D.L.
        • Platt M.L.
        Mechanistic classification of neural circuit dysfunctions: Insights from neuroeconomics research in animals.
        Biol Psychiatry. 2012; 72: 101-106
        • Dodd M.L.
        • Klos K.J.
        • Bower J.H.
        • Geda Y.E.
        • Josephs K.A.
        • Ahlskog J.E.
        Pathological gambling caused by drugs used to treat Parkinson disease.
        Arch Neurol. 2005; 62: 1377-1381
        • Redish A.D.
        Addiction as a computational process gone awry.
        Science. 2004; 306: 1944-1947
        • Schultz W.
        Potential vulnerabilities of neuronal reward, risk, and decision mechanisms to addictive drugs.
        Neuron. 2011; 69: 603-617
        • Cardinal R.N.
        • Howes N.J.
        Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats.
        BMC Neurosci. 2005; 6: 37
        • Floresco S.B.
        • Whelan J.M.
        Perturbations in different forms of cost/benefit decision making induced by repeated amphetamine exposure.
        Psychopharmacology (Berl). 2009; 205: 189-201
        • St Onge J.R.
        • Floresco S.B.
        Dopaminergic modulation of risk-based decision making.
        Neuropsychopharmacology. 2009; 34: 681-697
        • St. Onge J.
        • Chiu Y.
        • Floresco S.
        Differential effects of dopaminergic manipulations on risky choice.
        Psychopharmacology (Berl). 2010; 211: 209-221
        • St. Onge J.R.
        • Floresco S.B.
        Prefrontal cortical contribution to risk-based decision making.
        Cereb Cortex. 2010; 20: 1816-1828
        • St. Onge J.R.
        • Stopper C.M.
        • Zahm D.S.
        • Floresco S.B.
        Separate prefrontal-subcortical circuits mediate different components of risk-based decision making.
        J Neurosci. 2012; 32: 2886-2899
        • Stopper C.
        • Floresco S.
        Contributions of the nucleus accumbens and its subregions to different aspects of risk-based decision making.
        Cogn Affect Behav Neurosci. 2011; 11: 97-112
        • Stopper C.M.
        • Khayambashi S.
        • Floresco S.B.
        Receptor-specific modulation of risk-based decision making by nucleus accumbens dopamine.
        Neuropsychopharmacology. 2013; 38: 715-728
        • Sugam J.A.
        • Day J.J.
        • Wightman R.M.
        • Carelli R.M.
        Phasic nucleus accumbens dopamine encodes risk-based decision-making behavior.
        Biol Psychiatry. 2012; 71: 199-205
        • Day J.J.
        • Jones J.L.
        • Carelli R.M.
        Nucleus accumbens neurons encode predicted and ongoing reward costs in rats.
        Eur J Neurosci. 2011; 33: 308-321
        • Roesch M.R.
        • Singh T.
        • Brown P.L.
        • Mullins S.E.
        • Schoenbaum G.
        Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards.
        J Neurosci. 2009; 29: 13365-13376
        • Kable J.W.
        • Glimcher P.W.
        The neural correlates of subjective value during intertemporal choice.
        Nat Neurosci. 2007; 10: 1625-1633
        • Cardinal R.N.
        • Parkinson J.A.
        • Lachenal G.
        • Halkerston K.M.
        • Rudarakanchana N.
        • Hall J.
        • et al.
        Effects of selective excitotoxic lesions of the nucleus accumbens core, anterior cingulate cortex, and central nucleus of the amygdala on autoshaping performance in rats.
        Behav Neurosci. 2002; 116: 553-567
        • Dalley J.W.
        • Fryer T.D.
        • Brichard L.
        • Robinson E.S.
        • Theobald D.E.
        • Laane K.
        • et al.
        Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement.
        Science. 2007; 315: 1267-1270
        • Mendez I.A.
        • Simon N.W.
        • Hart N.
        • Mitchell M.R.
        • Nation J.R.
        • Wellman P.J.
        • Setlow B.
        Self-administered cocaine causes long-lasting increases in impulsive choice in a delay discounting task.
        Behav Neurosci. 2010; 124: 470-477
        • Roitman M.F.
        • Wheeler R.A.
        • Carelli R.M.
        Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output.
        Neuron. 2005; 45: 587-597
        • Carelli R.M.
        • Wondolowski J.
        Selective encoding of cocaine versus natural rewards by nucleus accumbens neurons is not related to chronic drug exposure.
        J Neurosci. 2003; 23: 11214-11223
        • Carelli R.M.
        • Deadwyler S.A.
        A comparison of nucleus accumbens neuronal firing patterns during cocaine self-administration and water reinforcement in rats.
        J Neurosci. 1994; 14: 7735-7746
        • Carelli R.M.
        • King V.C.
        • Hampson R.E.
        • Deadwyler S.A.
        Firing patterns of nucleus accumbens neurons during cocaine self-administration in rats.
        Brain Res. 1993; 626: 14-22
        • Saddoris M.P.
        • Stamatakis A.
        • Carelli R.M.
        Neural correlates of Pavlovian-to-instrumental transfer in the nucleus accumbens shell are selectively potentiated following cocaine self-administration.
        Eur J Neurosci. 2011; 33: 2274-2287
        • Cardinal R.N.
        • Pennicott D.R.
        • Sugathapala C.L.
        • Robbins T.W.
        • Everitt B.J.
        Impulsive choice induced in rats by lesions of the nucleus accumbens core.
        Science. 2001; 292: 2499-2501
        • Day J.J.
        • Wheeler R.A.
        • Roitman M.F.
        • Carelli R.M.
        Nucleus accumbens neurons encode Pavlovian approach behaviors: Evidence from an autoshaping paradigm.
        Eur J Neurosci. 2006; 23: 1341-1351
        • Jones J.L.
        • Day J.J.
        • Wheeler R.A.
        • Carelli R.M.
        The basolateral amygdala differentially regulates conditioned neural responses within the nucleus accumbens core and shell.
        Neuroscience. 2010; 169: 1186-1198
        • Nicola S.M.
        • Yun I.A.
        • Wakabayashi K.T.
        • Fields H.L.
        Cue-evoked firing of nucleus accumbens neurons encodes motivational significance during a discriminative stimulus task.
        J Neurophysiol. 2004; 91: 1840-1865
        • Wheeler R.A.
        • Twining R.C.
        • Jones J.L.
        • Slater J.M.
        • Grigson P.S.
        • Carelli R.M.
        Behavioral and electrophysiological indices of negative affect predict cocaine self-administration.
        Neuron. 2008; 57: 774-785
        • Day J.J.
        • Jones J.L.
        • Wightman R.M.
        • Carelli R.M.
        Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs.
        Biol Psychiatry. 2010; 68: 306-309
        • Pothuizen H.H.
        • Jongen-Rêlo A.L.
        • Feldon J.
        • Yee B.K.
        Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive-choice behaviour and salience learning in rats.
        Eur J Neurosci. 2005; 22: 2605-2616
        • Ghods-Sharifi S.
        • Floresco S.B.
        Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell.
        Behav Neurosci. 2010; 124: 179-191
        • Krause M.
        • German P.W.
        • Taha S.A.
        • Fields H.L.
        A pause in nucleus accumbens neuron firing is required to initiate and maintain feeding.
        J Neurosci. 2010; 30: 4746-4756
        • Nicola S.M.
        • Yun I.A.
        • Wakabayashi K.T.
        • Fields H.L.
        Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues.
        J Neurophysiol. 2004; 91: 1866-1882
        • Taha S.A.
        • Fields H.L.
        Encoding of palatability and appetitive behaviors by distinct neuronal populations in the nucleus accumbens.
        J Neurosci. 2005; 25: 1193-1202
        • Porter-Stransky K.A.
        • Seiler J.L.
        • Day J.J.
        • Aragona B.J.
        Development of behavioral preferences for the optimal choice following unexpected reward omission is mediated by a reduction of D2-like receptor tone in the nucleus accumbens.
        Eur J Neurosci. 2013; 38: 2572-2588
        • Judice-Daher D.M.
        • Bueno J.L.
        Lesions of the nucleus accumbens disrupt reinforcement omission effects in rats.
        Behav Brain Res. 2013; 252C: 439-443
        • Purgert R.J.
        • Wheeler D.S.
        • McDannald M.A.
        • Holland P.C.
        Role of amygdala central nucleus in aversive learning produced by shock or by unexpected omission of food.
        J Neurosci. 2012; 32: 2461-2472
        • McCoy A.N.
        • Platt M.L.
        Risk-sensitive neurons in macaque posterior cingulate cortex.
        Nat Neurosci. 2005; 8: 1220-1227
        • O'Neill M.
        • Schultz W.
        Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value.
        Neuron. 2010; 68: 789-800
        • Ogawa M.
        • van der Meer Matthijs A.A.
        • Esber Guillem R.
        • Cerri Domenic H.
        • Stalnaker Thomas A.
        • Schoenbaum G.
        Risk-responsive orbitofrontal neurons track acquired salience.
        Neuron. 2013; 77: 251-258
        • Kepecs A.
        • Uchida N.
        • Zariwala H.A.
        • Mainen Z.F.
        Neural correlates, computation and behavioural impact of decision confidence.
        Nature. 2008; 455: 227-231
        • Berendse H.W.
        • Graaf YG-D
        • Groenewegen H.J.
        Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat.
        J Comp Neurol. 1992; 316: 314-347
        • Wright C.I.
        • Groenewegen H.J.
        Patterns of overlap and segregation between insular cortical, intermediodorsal thalamic and basal amygdaloid afferents in the nucleus accumbens of the rat.
        Neuroscience. 1996; 73: 359-373