Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning
- Behavioral choice can be characterized along two axes. One axis distinguishes reflexive, model-free systems that slowly accumulate values through experience and a model-based system that uses knowledge to reason prospectively. The second axis distinguishes Pavlovian valuation of stimuli from instrumental valuation of actions or stimulus–action pairs. This results in four values and many possible interactions between them, with important consequences for accounts of individual variation. We here explored whether individual variation along one axis was related to individual variation along the other. Specifically, we asked whether individuals' balance between model-based and model-free learning was related to their tendency to show Pavlovian interferences with instrumental decisions. In two independent samples with a total of 243 participants, Pavlovian–instrumental transfer effects were negatively correlated with the strength of model-based reasoning in a two-step task. This suggests a potential common underlying substrate predisposingBehavioral choice can be characterized along two axes. One axis distinguishes reflexive, model-free systems that slowly accumulate values through experience and a model-based system that uses knowledge to reason prospectively. The second axis distinguishes Pavlovian valuation of stimuli from instrumental valuation of actions or stimulus–action pairs. This results in four values and many possible interactions between them, with important consequences for accounts of individual variation. We here explored whether individual variation along one axis was related to individual variation along the other. Specifically, we asked whether individuals' balance between model-based and model-free learning was related to their tendency to show Pavlovian interferences with instrumental decisions. In two independent samples with a total of 243 participants, Pavlovian–instrumental transfer effects were negatively correlated with the strength of model-based reasoning in a two-step task. This suggests a potential common underlying substrate predisposing individuals to both have strong Pavlovian interference and be less model-based and provides a framework within which to interpret the observation of both effects in addiction.…
Author details: | Miriam SeboldORCiDGND, Daniel SchadORCiDGND, Stephan NebeORCiD, Maria GarbusowORCiDGND, Elisabeth Juenger, Nils B. Kroemer, Norbert Kathmann, Ulrich S. Zimmermann, Michael N. SmolkaORCiDGND, Michael A. RappORCiDGND, Andreas HeinzORCiDGND, Quentin J. M. HuysORCiD |
---|---|
DOI: | https://doi.org/10.1162/jocn_a_00945 |
ISSN: | 0898-929X |
ISSN: | 1530-8898 |
Pubmed ID: | https://pubmed.ncbi.nlm.nih.gov/26942321 |
Title of parent work (English): | Journal of cognitive neuroscience |
Publisher: | MIT Press |
Place of publishing: | Cambridge |
Publication type: | Article |
Language: | English |
Year of first publication: | 2016 |
Publication year: | 2016 |
Release date: | 2020/03/22 |
Volume: | 28 |
Number of pages: | 11 |
First page: | 985 |
Last Page: | 995 |
Funding institution: | German Research Foundation (Deutsche Forschungsgemeinschaft, DFG) [FOR 1617, HE 2597/13-1, HE 2597/14-1, HE 2597/15-1, RA 1047/2-1, SM 80/7-1, ZI 1119/3-1, WI 709/10-1, SCHA 1971/1-2, HE 2597/13-2, HE 2597/14-2, HE 2597/15-2, RA 1047/2-2, SM 80/7-2, ZI 1119/3-2, WI 709/10-2] |
Peer review: | Referiert |
Institution name at the time of the publication: | Humanwissenschaftliche Fakultät / Exzellenzbereich Kognitionswissenschaften |