Advertisement

Drug Cues, Conditioned Reinforcement, and Drug Seeking: The Sequelae of a Collaborative Venture With Athina Markou

  • Barry J. Everitt
    Correspondence
    Address correspondence to Barry Everitt, Sc.D., Ph.D., Department of Psychology, University of Cambridge, Downing St, Cambridge CB2 3EB, United Kingdom.
    Affiliations
    Behavioral and Clinical Neuroscience Institute and Department of Psychology, University of Cambridge, Cambridge, United Kingdom
    Search for articles by this author
Published:September 25, 2017DOI:https://doi.org/10.1016/j.biopsych.2017.09.013

      Abstract

      Athina Markou spent a research period in my laboratory, then in the Department of Anatomy in Cambridge University, in 1991 to help us establish a cocaine-seeking procedure. Thus we embarked on developing a second-order schedule of intravenous cocaine reinforcement to investigate the neural basis of the pronounced effects of cocaine-associated conditioned stimuli on cocaine seeking. This brief review summarizes the fundamental aspects of cocaine seeking measured using this approach and the importance of the methodology in enabling us to define the neural mechanisms and circuitry underlying conditioned reinforcement and cocaine, heroin, and alcohol seeking. The shift over time and experience of control over drug seeking from a limbic cortical-ventral striatal circuit underlying goal-directed drug seeking to a dorsal striatal system mediating habitual drug seeking are also summarized. The theoretical implications of these data are discussed, thereby revealing the ways in which the outcomes of a collaboration can endure.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Biological Psychiatry
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Gawin F.H.
        • Kleber H.D.
        Abstinence symptomatology and psychiatric diagnosis in cocaine abusers. Clinical observations.
        Arch Gen Psychiatry. 1986; 43: 107-113
        • Taylor J.R.
        • Robbins T.
        Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens.
        Psychopharmacology (Berl). 1984; 84: 405-412
        • Taylor J.R.
        • Robbins T.
        6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine.
        Psychopharmacology (Berl). 1986; 90: 390-397
        • Cador M.
        • Robbins T.W.
        • Everitt B.J.
        Involvement of the amygdala in stimulus-reward associations: Interaction with the ventral striatum.
        Neuroscience. 1989; 30: 77-86
        • Parkinson J.A.
        • Olmstead M.C.
        • Burns L.H.
        • Robbins T.W.
        • Everitt B.J.
        Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine.
        J Neurosci. 1999; 19: 2401-2411
        • Everitt B.J.
        • Stacey P.
        Studies of instrumental behavior with sexual reinforcement in male rats (Rattus norvegicus): II. Effects of preoptic area lesions, castration, and testosterone.
        J Comp Psychol. 1987; 101: 407-419
        • Everitt B.
        • Fray P.
        • Kostarczyk E.
        • Taylor S.
        • Stacey P.
        Studies of instrumental behavior with sexual reinforcement in male rats (Rattus norvegicus): I. Control by brief visual stimuli paired with a receptive female.
        J Comp Psychol. 1987; 101: 395-406
        • Everitt B.J.
        Sexual motivation: A neural and behavioural analysis of the mechanisms underlying appetitive and copulatory responses of male rats.
        Neurosci Biobehav Rev. 1990; 14: 217-232
        • Everitt B.J.
        • Cador M.
        • Robbins T.W.
        Interactions between the amygdala and ventral striatum in stimulus-reward associations: Studies using a second-order schedule of sexual reinforcement.
        Neuroscience. 1989; 30: 63-75
        • Everitt B.J.
        • Robbins T.W.
        Second-order schedules of drug reinforcement in rats and monkeys: Measurement of reinforcing efficacy and drug-seeking behaviour.
        Psychopharmacology. 2000; 153: 17-30
        • Hogarth L.
        • Dickinson A.
        • Duka T.
        Detection versus sustained attention to drug cues have dissociable roles in mediating drug seeking behavior.
        Exp Clin Psychopharmacol. 2009; 17: 21-30
        • Bradley B.P.
        • Mogg K.
        • Wright T.
        • Field M.
        Attentional bias in drug dependence: Vigilance for cigarette-related cues in smokers.
        Psychol Addict Behav. 2003; 17: 66-72
        • Field M.
        • Cox W.
        Attentional bias in addictive behaviors: A review of its development, causes, and consequences.
        Drug Alcohol Depend. 2008; 97: 1-20
        • Hogarth L.
        • Dickinson A.
        • Janowski M.
        • Nikitina A.
        • Duka T.
        The role of attentional bias in mediating human drug-seeking behaviour.
        Psychopharmacology. 2008; 201: 29-41
        • Tomie A.
        • di Poce J.
        • Derenzo C.
        • Pohorecky L.
        Autoshaping of ethanol drinking: an animal model of binge drinking.
        Alcohol Alcohol. 2002; 37: 138-146
        • Saunders B.
        • Robinson T.
        Individual variation in resisting temptation: Implications for addiction.
        Neurosci Biobehav Rev. 2013; 37: 1955-1975
        • Corbit L.H.
        • Janak P.H.
        Ethanol-associated cues produce general pavlovian-instrumental transfer.
        Alcohol Clin Exp Res. 2007; 31: 766-774
        • Milton A.L.
        • Schramm M.J.W.
        • Wawrzynski J.R.
        • Gore F.
        • Oikonomou-Mpegeti F.
        • Wang N.Q.
        • et al.
        Antagonism at NMDA receptors, but not beta-adrenergic receptors, disrupts the reconsolidation of pavlovian conditioned approach and instrumental transfer for ethanol-associated conditioned stimuli.
        Psychopharmacology (Berl). 2012; 219: 751-761
        • LeBlanc K.H.
        • Ostlund S.B.
        • Maidment N.T.
        pavlovian-to-instrumental transfer in cocaine seeking rats.
        Behav Neurosci. 2012; 126: 681-689
        • Hogarth L.
        • Balleine B.
        • Corbit L.
        • Killcross S.
        Associative learning mechanisms underpinning the transition from recreational drug use to addiction.
        Ann N Y Acad Sci. 2013; 1282: 12-24
        • Hogarth L.
        • Dickinson A.
        • Duka T.
        The associative basis of cue-elicited drug taking in humans.
        Psychopharmacology (Berl). 2010; 208: 337-351
        • Everitt B.J.
        • Robbins T.W.
        Drug addiction: Updating actions to habits to compulsions ten years on.
        Annu Rev Psychol. 2016; 67: 23-50
        • Cardinal R.
        • Parkinson J.A.
        • Hall J.
        • Everitt B.J.
        Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal cortex.
        Neurosci Biobehav Rev. 2002; 26: 321-352
        • Corbit L.
        • Balleine B.
        The general and outcome-specific forms of pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell.
        J Neurosci. 2011; 31: 11786-11794
        • Allman M.J.
        • DeLeon I.G.
        • Cataldo M.F.
        • Holland P.C.
        • Johnson A.W.
        Learning processes affecting human decision making: An assessment of reinforcer-selective pavlovian-to-instrumental transfer following reinforcer devaluation.
        J Exp Psychol Anim Behav Process. 2010; 36: 402-408
        • Cardinal R.
        • Winstanley C.A.
        • Robbins T.W.
        • Everitt B.J.
        Limbic corticostriatal systems and delayed reinforcement.
        Ann N Y Acad Sci. 2004; 1021: 33-50
        • Di Ciano P.
        • Everitt B.J.
        Conditioned reinforcing properties of stimuli paired with self-administered cocaine, heroin or sucrose: Implications for the persistence of addictive behaviour.
        Neuropharmacology. 2004; 47: 202-213
        • Mackintosh N.
        The Psychology of Animal Learning.
        Academic Press, Oxford, UK1974
        • Di Ciano P.
        • Benham-Hermetz J.
        • Fogg A.P.
        • Osborne G.E.
        Role of the prelimbic cortex in the acquisition, re-acquisition or persistence of responding for a drug-paired conditioned reinforcer.
        Neuroscience. 2007; 150: 291-298
        • Shaham Y.
        • Shalev U.
        • Lu L.
        • De Wit H.
        • Stewart J.
        The reinstatement model of drug relapse: history, methodology and major findings.
        Psychopharmacology. 2003; 168: 3-20
        • Pickens C.
        • Airavaara M.
        • Theberge F.
        • Fanous S.
        • Hope B.
        • Shaham Y.
        Neurobiology of the incubation of drug craving.
        Trends Neurosci. 2011; 34: 411-420
        • Arroyo M.
        • Markou A.
        • Robbins T.W.
        • Everitt B.J.
        Acquisition, maintenance and reinstatement of intravenous cocaine self-administration under a second-order schedule of reinforcement in rats: Effects of conditioned cues and continuous access to cocaine.
        Psychopharmacology (Berl). 1998; 140: 331-344
        • Markou A.
        • Arroyo M.
        • Everitt B.
        Effect of contingent and non-contingent cocaine on drug-seeking behavior measured using a second-order schedule of cocaine reinforcement in rats.
        Neuropsychopharmacology. 1999; 20: 542-555
        • Alderson H.
        • Robbins T.W.
        • Everitt B.J.
        Heroin self-administration under a second-order schedule of reinforcement: Acquisition and maintenance of heroin-seeking behaviour in rats.
        Psychopharmacology (Berl). 2000; 153: 120-133
        • Belin D.
        • Everitt B.J.
        Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum.
        Neuron. 2008; 57: 432-441
        • Murray J.E.
        • Belin D.
        • Everitt B.J.
        Double dissociation of the dorsomedial and dorsolateral striatal control over the acquisition and performance of cocaine seeking.
        Neuropsychopharmacology. 2012; 37: 2456-2466
        • Giuliano C.
        • Robbins T.W.
        • Wille D.R.
        • Bullmore E.T.
        • Everitt B.J.
        Attenuation of cocaine and heroin seeking by mu-opioid receptor antagonism.
        Psychopharmacology (Berl). 2013; 227: 137-147
        • Giuliano C.
        • Goodlett C.R.
        • Economidou D.
        • Garcia-Pardo M.P.
        • Belin D.
        • Robbins T.W.
        • et al.
        The novel mu-opioid receptor antagonist GSK1521498 decreases both alcohol seeking and drinking: Evidence from a new preclinical model of alcohol seeking.
        Neuropsychopharmacology. 2015; 40: 2981-2992
        • Goldberg S.R.
        • Kelleher R.T.
        • Morse W.H.
        Second-order schedules of drug injection.
        Fed Proc. 1975; 34: 1771-1776
        • Goldberg S.R.
        Comparable behavior maintained under fixed-ratio and second-order schedules of food presentation, cocaine injection or d-amphetamine injection in the squirrel monkey.
        J Pharmacol Exp Ther. 1973; 186: 18-30
        • Goldberg S.R.
        • Spealman R.D.
        • Kelleher R.T.
        Enhancement of drug-seeking behavior by environmental stimuli associated with cocaine or morphine injections.
        Neuropharmacology. 1979; 18: 1015-1017
        • Panlilio L.
        • Yasar S.
        • Nemeth-Coslett R.
        • Katz J.
        • Henningfield J.
        • Solinas M.
        • et al.
        Human cocaine-seeking behavior and its control by drug-associated stimuli in the laboratory.
        Neuropsychopharmacology. 2005; 30: 433-443
        • Goldberg S.R.
        • Morse W.H.
        • Goldberg D.M.
        Behavior maintained under a second-order schedule by intramuscular injection of morphine or cocaine in rhesus monkeys.
        J Pharmacol Exp Ther. 1976; 199: 278-286
        • Ito R.
        • Dalley J.
        • Howes S.R.
        • Robbins T.W.
        • Everitt B.J.
        Dissociation in conditioned dopamine release in the nucleus accumbens core and shell in response to cocaine cues and during cocaine-seeking behavior in rats.
        J Neurosci. 2000; 19: 7489-7495
        • Ito R.
        • Dalley J.
        • Robbins T.
        • Everitt B.
        Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue.
        J Neurosci. 2002; 22: 6247-6253
        • Di Ciano P.
        • Everitt B.
        Reinstatement and spontaneous recovery of cocaine-seeking following extinction and different durations of withdrawal.
        Behav Pharmacol. 2002; 13: 397-405
        • Ito R.
        • Robbins T.
        • Everitt B.
        Differential control over cocaine-seeking behavior by nucleus accumbens core and shell.
        Nat Neurosci. 2004; 7: 389-397
        • Markou A.
        • Weiss F.
        • Gold L.H.
        • Caine S.B.
        • Schulteis G.
        • Koob G.
        Animal models of drug craving.
        Psychopharmacology (Berl). 1993; 112: 163-182
        • Robinson T.E.
        • Berridge K.C.
        The neural basis of drug craving: An incentive-sensitization theory of addiction.
        Brain Res Brain Res Rev. 1993; 18: 247-291
        • Grimm J.W.
        • Hope B.T.
        • Wise R.A.
        • Shaham Y.
        Incubation of cocaine craving after withdrawal.
        Nature. 2001; 412: 141-142
        • Wolf M.E.
        Synaptic mechanisms underlying persistent cocaine craving.
        Nat Rev Neurosci. 2016; 17: 351-365
        • Adams C.
        • Dickinson A.
        Instrumental responding following reinforcer devaluation.
        Q J Exp Psychol Comp Physiol Psychol. 1981; 33: 109-121
        • Piazza P.
        • Deroche-Gamonet V.
        A multistep general theory of transition to addiction.
        Psychopharmacology (Berl). 2013; 229: 387-413
        • Balleine B.
        • Paredes-Olay C.
        • Dickinson A.
        Effects of outcome devaluation on the performance of a heterogeneous instrumental chain.
        Int J Comp Psychol. 2005; 18: 257-272
        • Zapata A.
        • Minney V.
        • Shippenberg T.
        Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats.
        J Neurosci. 2010; 30: 15457-15463
        • Corbit L.H.
        • Chieng B.C.
        • Balleine B.W.
        Effects of repeated cocaine exposure on habit learning and reversal by N-acetylcysteine.
        Neuropsychopharmacology. 2014; 39: 1893-1901
        • Yin H.H.
        • Knowlton B.J.
        • Balleine B.W.
        Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning.
        Eur J Neurosci. 2004; 19: 181-189
        • Parkinson J.A.
        • Roberts A.C.
        • Everitt B.
        • Di Ciano P.
        Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus.
        Q J Exp Psychol B. 2005; 58: 19-30
        • Di Ciano P.
        • Robbins T.W.
        • Everitt B.J.
        Differential effects of nucleus accumbens core, shell, or dorsal striatal inactivations on the persistence, reacquisition, or reinstatement of responding for a drug-paired conditioned reinforcer.
        Neuropsychopharmacology. 2008; 33: 1413-1425
        • Tiffany S.T.
        A cognitive model of drug urges and drug-use behavior: Role of automatic and nonautomatic processes.
        Psychol Rev. 1990; 97: 147-168
        • Belin D.
        • Jonkman S.
        • Dickinson A.
        • Robbins T.W.
        • Everitt B.J.
        Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction.
        Behav Brain Res. 2009; 199: 89-102
        • Everitt B.J.
        • Robbins T.W.
        From the ventral to the dorsal striatum: Devolving views of their roles in drug addiction.
        Neurosci Biobehav Rev. 2013; 37: 1946-1954
        • Everitt B.J.
        Neural and psychological mechanisms underlying compulsive drug seeking habits and drug memories–indications for novel treatments of addiction.
        Eur J Neurosci. 2014; 40: 2163-2182
        • Whitelaw R.B.
        • Markou A.
        • Robbins T.W.
        • Everitt B.J.
        Excitotoxic lesions of the basolateral amygdala impair the acquisition of cocaine-seeking behaviour under a second-order schedule of reinforcement.
        Psychopharmacology (Berl). 1996; 127: 213-224
        • Everitt B.J.
        • Cardinal R.N.
        • Parkinson J.A.
        • Robbins T.W.
        Appetitive behavior impact of amygdala-dependent mechanisms of emotional learning.
        Ann N Y Acad Sci. 2003; 985: 233-250
        • Cardinal R.N.
        • Pennicott D.R.
        • Sugathapala C.L.
        • Robbins T.W.
        • Everitt B.J.
        Impulsive choice induced in rats by lesions of the nucleus accumbens core.
        Science. 2001; 292: 2499-2501
        • Di Ciano P.
        • Everitt B.J.
        Direct interactions between the basolateral amygdala and nucleus accumbens core underlie cocaine-seeking behavior by rats.
        J Neurosci. 2004; 24: 7167-7173
        • Robbins T.W.
        • Everitt B.J.
        Drug addiction: Bad habits add up.
        Nature. 1999; 398: 567-570
        • Everitt B.J.
        • Robbins T.W.
        Neural systems of reinforcement for drug addiction: From actions to habits to compulsion.
        Nat Neurosci. 2005; 8: 1481-1489
        • Vanderschuren L.
        • Di Ciano P.
        • Everitt B.
        Involvement of the dorsal striatum in cue-controlled cocaine seeking.
        J Neurosci. 2005; 25: 8665-8670
        • Yin H.
        • Knowlton B.
        • Balleine B.
        Inactivation of dorsolateral striatum enhances sensitivity to changes in the action–outcome contingency in instrumental conditioning.
        Behav Brain Res. 2006; 166: 189-196
        • Yin H.H.
        • Ostlund S.B.
        • Knowlton B.J.
        • Balleine B.W.
        The role of the dorsomedial striatum in instrumental conditioning.
        Eur J Neurosci. 2005; 22: 513-523
        • Haber S.
        • Fudge J.
        • McFarland N.
        Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum.
        J Neurosci. 2000; 20: 2369-2382
        • Ikemoto S.
        Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex.
        Brain Res Rev. 2007; 56: 27-78
        • Willuhn I.
        • Burgeno L.M.
        • Everitt B.J.
        • Phillips P.E.
        Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use.
        Proc Natl Acad Sci U S A. 2012; 109: 20703-20708
        • Murray J.E.
        • Belin-Rauscent A.
        • Simon M.
        • Giuliano C.
        • Benoit-Marand M.
        • Everitt B.J.
        • et al.
        Basolateral and central amygdala differentially recruit and maintain dorsolateral striatum-dependent cocaine-seeking habits.
        Nat Commun. 2015; 6: 10088
        • El-Amamy H.
        • Holland P.
        Dissociable effects of disconnecting amygdala central nucleus from the ventral tegmental area or substantia nigra on learned orienting and incentive motivation.
        Eur J Neurosci. 2007; 25: 1557-1567
        • Lingawi N.W.
        • Balleine B.W.
        Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits.
        J Neurosci. 2012; 32: 1073-1081
        • Everitt B.J.
        • Giuliano C.
        • Belin D.
        Addictive behaviour in experimental animals: Prospects for translation.
        Philos Trans R Soc B. 2018; 373
        • Xie C.
        • Shao Y.
        • Ma L.
        • Zhai T.
        • Ye E.
        • Fu L.
        • et al.
        Imbalanced functional link between valuation networks in abstinent heroin-dependent subjects.
        Mol Psychiatry. 2014; 19: 10-12
        • Vollstadt-Klein S.
        • Wichert S.
        • Rabinstein J.
        • Buhler M.
        • Klein O.
        • Ende G.
        • et al.
        Initial, habitual and compulsive alcohol use is characterized by a shift of cue processing from ventral to dorsal striatum.
        Addiction. 2010; 105: 1741-1749
        • Sjoerds Z.
        • de Wit S.
        • van den Brink W.
        • Robbins T.W.
        • Beekman A.T.F.
        • Penninx B.W.J.H.
        • et al.
        Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients.
        Transl Psychiatry. 2013; 3: e337
        • Liu L.
        • Yip S.W.
        • Zhang J.T.
        • Wang L.J.
        • Shen Z.J.
        • Liu B.
        • et al.
        Activation of the ventral and dorsal striatum during cue reactivity in Internet gaming disorder.
        Addict Biol. 2017; 22: 791-801
        • Bohbot V.
        • Del Balso D.
        • Conrad K.
        • Konishi K.
        • Leyton M.
        Caudate nucleus-dependent navigational strategies are associated with increased use of addictive drugs.
        Hippocampus. 2013; 23: 973-984
        • Ersche K.D.
        • Gillan C.M.
        • Jones P.S.
        • Williams G.B.
        • Ward L.H.
        • Luijten M.
        • et al.
        Carrots and sticks fail to change behavior in cocaine addiction.
        Science. 2016; 352: 1468-1471
        • Doñamayor N.
        • Strelchuk D.
        • Baek K.
        • Banca P.
        • Voon V.
        The involuntary nature of binge drinking: Goal directedness and awareness of intention.
        Addict Biol. 2018; 23: 515-526
        • Cox S.M.L.
        • Yau Y.
        • Larcher K.
        • Durand F.
        • Kolivakis T.
        • Delaney J.S.
        • et al.
        Cocaine cue-induced dopamine release in recreational cocaine users.
        Sci Rep. 2017; 7: 46665
        • Volkow N.
        • Wang G.J.
        • Telang F.
        • Fowler J.S.
        • Logan J.
        • Childress A.R.
        • et al.
        Cocaine cues and dopamine in dorsal striatum: Mechanism of craving in cocaine addiction.
        J Neurosci. 2006; 26: 6583-6588