TY - JOUR A1 - Sebold, Miriam Hannah A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Guggenmos, Matthias A1 - Schad, Daniel A1 - Beck, Anne A1 - Kuitunen-Paul, Sören A1 - Sommer, Christian A1 - Frank, Robin A1 - Neu, Peter A1 - Zimmermann, Ulrich S. A1 - Rapp, Michael A. A1 - Smolka, Michael N. A1 - Huys, Quentin J. M. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas T1 - When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence JF - Biological psychiatry : a journal of psychiatric neuroscience and therapeutics ; a publication of the Society of Biological Psychiatry N2 - BACKGROUND: Addiction is supposedly characterized by a shift from goal-directed to habitual decision making, thus facilitating automatic drug intake. The two-step task allows distinguishing between these mechanisms by computationally modeling goal-directed and habitual behavior as model-based and model-free control. In addicted patients, decision making may also strongly depend upon drug-associated expectations. Therefore, we investigated model-based versus model-free decision making and its neural correlates as well as alcohol expectancies in alcohol-dependent patients and healthy controls and assessed treatment outcome in patients. METHODS: Ninety detoxified, medication-free, alcohol-dependent patients and 96 age-and gender-matched control subjects underwent functional magnetic resonance imaging during the two-step task. Alcohol expectancies were measured with the Alcohol Expectancy Questionnaire. Over a follow-up period of 48 weeks, 37 patients remained abstinent and 53 patients relapsed as indicated by the Alcohol Timeline Followback method. RESULTS: Patients who relapsed displayed reduced medial prefrontal cortex activation during model-based decision making. Furthermore, high alcohol expectancies were associated with low model-based control in relapsers, while the opposite was observed in abstainers and healthy control subjects. However, reduced model-based control per se was not associated with subsequent relapse. CONCLUSIONS: These findings suggest that poor treatment outcome in alcohol dependence does not simply result from a shift from model-based to model-free control but is instead dependent on the interaction between high drug expectancies and low model-based decision making. Reduced model-based medial prefrontal cortex signatures in those who relapse point to a neural correlate of relapse risk. These observations suggest that therapeutic interventions should target subjective alcohol expectancies. KW - Alcohol dependence KW - Alcohol expectancy KW - Goal-directed control KW - Medial prefrontal cortex KW - Reinforcement learning KW - Treatment outcome Y1 - 2017 U6 - https://doi.org/10.1016/j.biopsych.2017.04.019 SN - 0006-3223 SN - 1873-2402 VL - 82 SP - 847 EP - 856 PB - Elsevier CY - New York ER - TY - GEN A1 - Kaminski, Jakob A1 - Schlagenhauf, Florian A1 - Rapp, Michael A. A1 - Awasthi, Swapnil A1 - Ruggeri, Barbara A1 - Deserno, Lorenz A1 - Laura, Daedelow A1 - Banaschewski, Tobias A1 - Bokde, Arun A1 - Quinlan, Erin Burke A1 - Buechel, Christian A1 - Bromberg, Uli A1 - Desrivieres, Sylvane A1 - Flor, Herta A1 - Frouin, Vincent A1 - Garavan, Hugh A1 - Gowland, Penny A1 - Ittermann, Bernd A1 - Martinot, Jean-Luc A1 - Martinot, Marie-Laure Paillere A1 - Nees, Frauke A1 - Orfanos, Dimitri Papadopoulos A1 - Paus, Tomas A1 - Poustka, Luise A1 - Smolka, Michael A1 - Froehner, Juliane A1 - Walter, Henrik A1 - Whelan, Robert A1 - Ripke, Stephan A1 - Schumann, Gunter A1 - Heinz, Andreas T1 - Variance in Dopaminergic Markers BT - a possible marker of individual differences in IQ? T2 - Biological psychiatry : a journal of psychiatric neuroscience and therapeutics ; a publication of the Society of Biological Psychiatry KW - Intelligence KW - Dopamine KW - Epigenetic Biomarkers KW - Reward Anticipation KW - Polygenic Risk Score Y1 - 2018 U6 - https://doi.org/10.1016/j.biopsych.2018.02.311 SN - 0006-3223 SN - 1873-2402 VL - 83 IS - 9 SP - S118 EP - S118 PB - Elsevier CY - New York ER - TY - JOUR A1 - Chen, Hao A1 - Belanger, Matthew J. A1 - Garbusow, Maria A1 - Kuitunen-Paul, Soeren A1 - Huys, Quentin J. M. A1 - Heinz, Andreas A1 - Rapp, Michael A. A1 - Smolka, Michael N. T1 - Susceptibility to interference between Pavlovian and instrumental control predisposes risky alcohol use developmental trajectory from ages 18 to 24 JF - Addiction biology N2 - Pavlovian cues can influence ongoing instrumental behaviour via Pavlovian-to-instrumental transfer (PIT) processes. While appetitive Pavlovian cues tend to promote instrumental approach, they are detrimental when avoidance behaviour is required, and vice versa for aversive cues. We recently reported that susceptibility to interference between Pavlovian and instrumental control assessed via a PIT task was associated with risky alcohol use at age 18. We now investigated whether such susceptibility also predicts drinking trajectories until age 24, based on AUDIT (Alcohol Use Disorders Identification Test) consumption and binge drinking (gramme alcohol/drinking occasion) scores. The interference PIT effect, assessed at ages 18 and 21 during fMRI, was characterized by increased error rates (ER) and enhanced neural responses in the ventral striatum (VS), the lateral and dorsomedial prefrontal cortices (dmPFC) during conflict, that is, when an instrumental approach was required in the presence of an aversive Pavlovian cue or vice versa. We found that a stronger VS response during conflict at age 18 was associated with a higher starting point of both drinking trajectories but predicted a decrease in binge drinking. At age 21, high ER and enhanced neural responses in the dmPFC were associated with increasing AUDIT-C scores over the next 3 years until age 24. Overall, susceptibility to interference between Pavlovian and instrumental control might be viewed as a predisposing mechanism towards hazardous alcohol use during young adulthood, and the identified high-risk group may profit from targeted interventions. KW - interference control KW - Pavlovian-to-instrumental transfer KW - risky drinking Y1 - 2023 U6 - https://doi.org/10.1111/adb.13263 SN - 1355-6215 SN - 1369-1600 VL - 28 IS - 2 PB - Wiley CY - Hoboken ER - TY - GEN A1 - Chen, Hao A1 - Nebe, Stephan A1 - Mojtahedzadeh, Negin A1 - Kuitunen-Paul, Soren A1 - Garbusow, Maria A1 - Schad, Daniel A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. A1 - Heinz, Andreas A1 - Smolka, Michael N. T1 - Susceptibility to interference between Pavlovian and instrumental control is associated with early hazardous alcohol use T2 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe N2 - Pavlovian-to-instrumental transfer (PIT) tasks examine the influence of Pavlovian stimuli on ongoing instrumental behaviour. Previous studies reported associations between a strong PIT effect, high-risk drinking and alcohol use disorder. This study investigated whether susceptibility to interference between Pavlovian and instrumental control is linked to risky alcohol use in a community sample of 18-year-old male adults. Participants (N = 191) were instructed to 'collect good shells' and 'leave bad shells' during the presentation of appetitive (monetary reward), aversive (monetary loss) or neutral Pavlovian stimuli. We compared instrumental error rates (ER) and functional magnetic resonance imaging (fMRI) brain responses between the congruent and incongruent conditions, as well as among high-risk and low-risk drinking groups. On average, individuals showed a substantial PIT effect, that is, increased ER when Pavlovian cues and instrumental stimuli were in conflict compared with congruent trials. Neural PIT correlates were found in the ventral striatum and the dorsomedial and lateral prefrontal cortices (lPFC). Importantly, high-risk drinking was associated with a stronger behavioural PIT effect, a decreased lPFC response and an increased neural response in the ventral striatum on the trend level. Moreover, high-risk drinkers showed weaker connectivity from the ventral striatum to the lPFC during incongruent trials. Our study links interference during PIT to drinking behaviour in healthy, young adults. High-risk drinkers showed higher susceptibility to Pavlovian cues, especially when they conflicted with instrumental behaviour, indicating lower interference control abilities. Increased activity in the ventral striatum (bottom-up), decreased lPFC response (top-down), and their altered interplay may contribute to poor interference control in the high-risk drinkers. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 855 KW - high‐risk drinking KW - interference control KW - Pavlovian‐to‐instrumental transfer Y1 - 2020 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-569609 SN - 1866-8364 IS - 4 ER - TY - JOUR A1 - Chen, Hao A1 - Nebe, Stephan A1 - Mojtahedzadeh, Negin A1 - Kuitunen-Paul, Soren A1 - Garbusow, Maria A1 - Schad, Daniel A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. A1 - Heinz, Andreas A1 - Smolka, Michael N. T1 - Susceptibility to interference between Pavlovian and instrumental control is associated with early hazardous alcohol use JF - Addiction biology N2 - Pavlovian-to-instrumental transfer (PIT) tasks examine the influence of Pavlovian stimuli on ongoing instrumental behaviour. Previous studies reported associations between a strong PIT effect, high-risk drinking and alcohol use disorder. This study investigated whether susceptibility to interference between Pavlovian and instrumental control is linked to risky alcohol use in a community sample of 18-year-old male adults. Participants (N = 191) were instructed to 'collect good shells' and 'leave bad shells' during the presentation of appetitive (monetary reward), aversive (monetary loss) or neutral Pavlovian stimuli. We compared instrumental error rates (ER) and functional magnetic resonance imaging (fMRI) brain responses between the congruent and incongruent conditions, as well as among high-risk and low-risk drinking groups. On average, individuals showed a substantial PIT effect, that is, increased ER when Pavlovian cues and instrumental stimuli were in conflict compared with congruent trials. Neural PIT correlates were found in the ventral striatum and the dorsomedial and lateral prefrontal cortices (lPFC). Importantly, high-risk drinking was associated with a stronger behavioural PIT effect, a decreased lPFC response and an increased neural response in the ventral striatum on the trend level. Moreover, high-risk drinkers showed weaker connectivity from the ventral striatum to the lPFC during incongruent trials. Our study links interference during PIT to drinking behaviour in healthy, young adults. High-risk drinkers showed higher susceptibility to Pavlovian cues, especially when they conflicted with instrumental behaviour, indicating lower interference control abilities. Increased activity in the ventral striatum (bottom-up), decreased lPFC response (top-down), and their altered interplay may contribute to poor interference control in the high-risk drinkers. KW - high‐risk drinking KW - interference control KW - Pavlovian‐to‐instrumental transfer Y1 - 2020 U6 - https://doi.org/10.1111/adb.12983 SN - 1355-6215 SN - 1369-1600 VL - 26 IS - 4 SP - 1 EP - 14 PB - Wiley CY - Hoboken ER - TY - CHAP A1 - Schad, Daniel A1 - Juenger, Elisabeth A1 - Sebold, Miriam Hannah A1 - Garbusow, Maria A1 - Bernhart, Nadine A1 - Javadi, Amir Homayoun A1 - Zimmermann, Ulrich S. A1 - Smolka, Michael N. A1 - Heinz, Andreas A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. T1 - Smart goals, slow habits? Individual differences in processing speed and working memory capacity moderate the balance between habitual and goal-directed choice behavior T2 - Cognitive processing : international quarterly of cognitive science Y1 - 2014 SN - 1612-4782 SN - 1612-4790 VL - 15 IS - 1 SP - S62 EP - S62 PB - Springer CY - Heidelberg ER - TY - GEN A1 - Xie, Chao A1 - Jia, Tianye A1 - Rolls, Edmund T. A1 - Robbins, Trevor W. A1 - Sahakian, Barbara J. A1 - Zhang, Jie A1 - Liu, Zhaowen A1 - Cheng, Wei A1 - Luo, Qiang A1 - Zac Lo, Chun-Yi A1 - Schumann, Gunter A1 - Feng, Jianfeng A1 - Wang, He A1 - Banaschewski, Tobias A1 - Barker, Gareth J. A1 - Bokde, Arun L.W. A1 - Büchel, Christian A1 - Quinlan, Erin Burke A1 - Desrivières, Sylvane A1 - Flor, Herta A1 - Grigis, Antoine A1 - Garavan, Hugh A1 - Gowland, Penny A1 - Heinz, Andreas A1 - Hohmann, Sarah A1 - Ittermann, Bernd A1 - Martinot, Jean-Luc A1 - Paillère Martinot, Marie-Laure A1 - Nees, Frauke A1 - Papadopoulos Orfanos, Dimitri A1 - Paus, Tomáš A1 - Poustka, Luise A1 - Fröhner, Juliane H. A1 - Smolka, Michael N. A1 - Walter, Henrik A1 - Whelan, Robert T1 - Reward versus nonreward sensitivity of the medial versus lateral orbitofrontal cortex relates to the severity of depressive symptoms T2 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe N2 - BACKGROUND: The orbitofrontal cortex (OFC) is implicated in depression. The hypothesis investigated was whether the OFC sensitivity to reward and nonreward is related to the severity of depressive symptoms. METHODS: Activations in the monetary incentive delay task were measured in the IMAGEN cohort at ages 14 years (n = 1877) and 19 years (n = 1140) with a longitudinal design. Clinically relevant subgroups were compared at ages 19 (high-severity group: n = 116; low-severity group: n = 206) and 14. RESULTS: The medial OFC exhibited graded activation increases to reward, and the lateral OFC had graded activation increases to nonreward. In this general population, the medial and lateral OFC activations were associated with concurrent depressive symptoms at both ages 14 and 19 years. In a stratified high-severity depressive symptom group versus control group comparison, the lateral OFC showed greater sensitivity for the magnitudes of activations related to nonreward in the high-severity group at age 19 (p = .027), and the medial OFC showed decreased sensitivity to the reward magnitudes in the high-severity group at both ages 14 (p = .002) and 19 (p = .002). In a longitudinal design, there was greater sensitivity to nonreward of the lateral OFC at age 14 for those who exhibited high depressive symptom severity later at age 19 (p = .003). CONCLUSIONS: Activations in the lateral OFC relate to sensitivity to not winning, were associated with high depressive symptom scores, and at age 14 predicted the depressive symptoms at ages 16 and 19. Activations in the medial OFC were related to sensitivity to winning, and reduced reward sensitivity was associated with concurrent high depressive symptom scores. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 860 KW - adolescents KW - depression KW - monetary incentive delay task KW - nonreward sensitivity KW - orbitofrontal cortex KW - reward anticipation KW - reward sensitivity KW - ventral striatum Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-557882 SN - 1866-8364 IS - 3 ER - TY - JOUR A1 - Xie, Chao A1 - Jia, Tianye A1 - Rolls, Edmund T. A1 - Robbins, Trevor W. A1 - Sahakian, Barbara J. A1 - Zhang, Jie A1 - Liu, Zhaowen A1 - Cheng, Wei A1 - Luo, Qiang A1 - Zac Lo, Chun-Yi A1 - Schumann, Gunter A1 - Feng, Jianfeng A1 - Wang, He A1 - Banaschewski, Tobias A1 - Barker, Gareth J. A1 - Bokde, Arun L.W. A1 - Büchel, Christian A1 - Quinlan, Erin Burke A1 - Desrivières, Sylvane A1 - Flor, Herta A1 - Grigis, Antoine A1 - Garavan, Hugh A1 - Gowland, Penny A1 - Heinz, Andreas A1 - Hohmann, Sarah A1 - Ittermann, Bernd A1 - Martinot, Jean-Luc A1 - Paillère Martinot, Marie-Laure A1 - Nees, Frauke A1 - Papadopoulos Orfanos, Dimitri A1 - Paus, Tomáš A1 - Poustka, Luise A1 - Fröhner, Juliane H. A1 - Smolka, Michael N. A1 - Walter, Henrik A1 - Whelan, Robert T1 - Reward versus nonreward sensitivity of the medial versus lateral orbitofrontal cortex relates to the severity of depressive symptoms JF - Biological Psychiatry: Cognitive Neuroscience and Neuroimaging N2 - BACKGROUND: The orbitofrontal cortex (OFC) is implicated in depression. The hypothesis investigated was whether the OFC sensitivity to reward and nonreward is related to the severity of depressive symptoms. METHODS: Activations in the monetary incentive delay task were measured in the IMAGEN cohort at ages 14 years (n = 1877) and 19 years (n = 1140) with a longitudinal design. Clinically relevant subgroups were compared at ages 19 (high-severity group: n = 116; low-severity group: n = 206) and 14. RESULTS: The medial OFC exhibited graded activation increases to reward, and the lateral OFC had graded activation increases to nonreward. In this general population, the medial and lateral OFC activations were associated with concurrent depressive symptoms at both ages 14 and 19 years. In a stratified high-severity depressive symptom group versus control group comparison, the lateral OFC showed greater sensitivity for the magnitudes of activations related to nonreward in the high-severity group at age 19 (p = .027), and the medial OFC showed decreased sensitivity to the reward magnitudes in the high-severity group at both ages 14 (p = .002) and 19 (p = .002). In a longitudinal design, there was greater sensitivity to nonreward of the lateral OFC at age 14 for those who exhibited high depressive symptom severity later at age 19 (p = .003). CONCLUSIONS: Activations in the lateral OFC relate to sensitivity to not winning, were associated with high depressive symptom scores, and at age 14 predicted the depressive symptoms at ages 16 and 19. Activations in the medial OFC were related to sensitivity to winning, and reduced reward sensitivity was associated with concurrent high depressive symptom scores. KW - adolescents KW - depression KW - monetary incentive delay task KW - nonreward sensitivity KW - orbitofrontal cortex KW - reward anticipation KW - reward sensitivity KW - ventral striatum Y1 - 2021 U6 - https://doi.org/10.1016/j.bpsc.2020.08.017 SN - 0006-3223 SN - 1873-2402 VL - 6 IS - 3 SP - 259 EP - 269 PB - Elsevier Science CY - Amsterdam ER - TY - JOUR A1 - Schad, Daniel A1 - Juenger, Elisabeth A1 - Sebold, Miriam Hannah A1 - Garbusow, Maria A1 - Bernhardt, Nadine A1 - Javadi, Amir-Homayoun A1 - Zimmermann, Ulrich S. A1 - Smolka, Michael N. A1 - Heinz, Andreas A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. T1 - Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning JF - Frontiers in psychology N2 - Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though both have been shown to control choices, the cognitive abilities associated with these systems are under ongoing investigation. Here we examine the link to cognitive abilities, and find that individual differences in processing speed covary with a shift from model-free to model-based choice control in the presence of above-average working memory function. This suggests shared cognitive and neural processes; provides a bridge between literatures on intelligence and valuation; and may guide the development of process models of different valuation components. Furthermore, it provides a rationale for individual differences in the tendency to deploy valuation systems, which may be important for understanding the manifold neuropsychiatric diseases associated with malfunctions of valuation. KW - decision-making KW - reward KW - cognitive abilities KW - model-based and model-free learning KW - fluid intelligence KW - habitual and goal-directed system Y1 - 2014 U6 - https://doi.org/10.3389/fpsyg.2014.01450 SN - 1664-1078 VL - 5 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Sebold, Miriam Hannah A1 - Schad, Daniel A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Juenger, Elisabeth A1 - Kroemer, Nils B. A1 - Kathmann, Norbert A1 - Zimmermann, Ulrich S. A1 - Smolka, Michael N. A1 - Rapp, Michael A. A1 - Heinz, Andreas A1 - Huys, Quentin J. M. T1 - Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning JF - Journal of cognitive neuroscience N2 - Behavioral choice can be characterized along two axes. One axis distinguishes reflexive, model-free systems that slowly accumulate values through experience and a model-based system that uses knowledge to reason prospectively. The second axis distinguishes Pavlovian valuation of stimuli from instrumental valuation of actions or stimulus–action pairs. This results in four values and many possible interactions between them, with important consequences for accounts of individual variation. We here explored whether individual variation along one axis was related to individual variation along the other. Specifically, we asked whether individuals' balance between model-based and model-free learning was related to their tendency to show Pavlovian interferences with instrumental decisions. In two independent samples with a total of 243 participants, Pavlovian–instrumental transfer effects were negatively correlated with the strength of model-based reasoning in a two-step task. This suggests a potential common underlying substrate predisposing individuals to both have strong Pavlovian interference and be less model-based and provides a framework within which to interpret the observation of both effects in addiction. Y1 - 2016 U6 - https://doi.org/10.1162/jocn_a_00945 SN - 0898-929X SN - 1530-8898 VL - 28 SP - 985 EP - 995 PB - MIT Press CY - Cambridge ER -