The human mind likes simplicity, and so do scientists. This explains the popularity
of dual system theories such as Daniel Kahneman’s fast and slow thinking. A dual systems
theory that has a great following in cognitive neuroscience and computational psychiatry
is the dichotomy between model-based and model-free learning and decision making (
1
). The model-based system suggests a model of the world incorporating hidden states
and details how one can transition between these states. This allows goal-directed
and flexible planning, but it is computationally demanding. The model-free system,
on the other hand, does not entail such a model and suggests learning of stimulus–outcome
associations only through lived experiences. This allows fast and simple computing
but is often constrained to simplistic and habit-like learning. Human behavior is
found to be influenced by both systems, and ventral striatum and dopamine transmission
seems to play a role for a relative weighting of both systems (
1
,
2
).To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Biological PsychiatryAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Model-based influences on humans’ choices and striatal prediction errors.Neuron. 2011; 69: 1204-1215
- Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making.Proc Natl Acad Sci U S A. 2015; 112: 1595-1600
- Neurocognitive endophenotypes of impulsivity and compulsivity: Towards dimensional psychiatry.Trends Cogn Sci. 2012; 16: 81-91
- Disorders of compulsivity: A common bias towards learning habits.Mol Psychiatry. 2015; 20: 345-352
- Characterizing a psychiatric symptom dimension related to deficits in goal-directed control.eLife. 2016; 5e11305
- Credit assignment to state-independent task representations and its relationship with model-based decision making.Proc Natl Acad Sci U S A. 2019; 116: 15871-15876
- Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence.Addict Biol. 2016; 21: 719-731
- When habits are dangerous: Alcohol expectancies and habitual decision making predict relapse in alcohol dependence.Biol Psychiatry. 2017; 82: 847-856
- Model-based and model-free decisions in alcohol dependence.Neuropsychobiology. 2014; 70: 122-131
- Incentives boost model-based control across a range of severity on several psychiatric constructs.Biol Psychiatry. 2019; 85: 425-433
- Model-free and model-based influences in addiction-related behaviors.Biol Psychiatry. 2019; 85: 936-945
- Dissociating neural learning signals in human sign- and goal-trackers.Nat Hum Behav. 2020; 4: 201-214
- An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: Implications for addiction.Neuropsychopharmacology. 2010; 35: 388-400
- Compulsivity and impulsivity traits linked to attenuated developmental frontostriatal myelination trajectories.Nat Neurosci. 2019; 22: 992-999
- Specific frontostriatal circuits for impaired cognitive flexibility and goal-directed planning in obsessive-compulsive disorder: Evidence from resting-state functional connectivity.Biol Psychiatry. 2017; 81: 708-717
Article info
Publication history
Published online: April 22, 2020
Accepted:
March 6,
2020
Received:
February 21,
2020
Identification
Copyright
© 2020 Society of Biological Psychiatry.
