TY - JOUR A1 - Friedel, Eva A1 - Sebold, Miriam Hannah A1 - Kuitunen-Paul, Sören A1 - Nebe, Stephan A1 - Veer, Ilya M. A1 - Zimmermann, Ulrich S. A1 - Schlagenhauf, Florian A1 - Smolka, Michael N. A1 - Rapp, Michael Armin A1 - Walter, Henrik A1 - Heinz, Andreas T1 - How Accumulated Real Life Stress Experience and Cognitive Speed Interact on Decision-Making Processes JF - Frontiers in human neuroscienc N2 - Rationale: Advances in neurocomputational modeling suggest that valuation systems for goal-directed (deliberative) on one side, and habitual (automatic) decision-making on the other side may rely on distinct computational strategies for reinforcement learning, namely model-free vs. model-based learning. As a key theoretical difference, the model-based system strongly demands cognitive functions to plan actions prospectively based on an internal cognitive model of the environment, whereas valuation in the model-free system relies on rather simple learning rules from operant conditioning to retrospectively associate actions with their outcomes and is thus cognitively less demanding. Acute stress reactivity is known to impair model-based but not model-free choice behavior, with higher working memory capacity protecting the model-based system from acute stress. However, it is not clear which impact accumulated real life stress has on model-free and model-based decision systems and how this influence interacts with cognitive abilities. Methods: We used a sequential decision-making task distinguishing relative contributions of both learning strategies to choice behavior, the Social Readjustment Rating Scale questionnaire to assess accumulated real life stress, and the Digit Symbol Substitution Test to test cognitive speed in 95 healthy subjects. Results: Individuals reporting high stress exposure who had low cognitive speed showed reduced model-based but increased model-free behavioral control. In contrast, subjects exposed to accumulated real life stress with high cognitive speed displayed increased model-based performance but reduced model-free control. Conclusion: These findings suggest that accumulated real life stress exposure can enhance reliance on cognitive speed for model-based computations, which may ultimately protect the model-based system from the detrimental influences of accumulated real life stress. The combination of accumulated real life stress exposure and slower information processing capacities, however, might favor model-free strategies. Thus, the valence and preference of either system strongly depends on stressful experiences and individual cognitive capacities. KW - chronic stress KW - model-based learning KW - model-free learning KW - decision making KW - cognitive speed KW - real-life events Y1 - 2017 U6 - https://doi.org/10.3389/fnhum.2017.00302 SN - 1662-5161 VL - 11 SP - 1 EP - 9 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Nebe, Stephan A1 - Kroemer, Nils B. A1 - Schad, Daniel A1 - Bernhardt, Nadine A1 - Sebold, Miriam Hannah A1 - Mueller, Dirk K. A1 - Scholl, Lucie A1 - Kuitunen-Paul, Sören A1 - Heinz, Andreas A1 - Rapp, Michael Armin A1 - Huys, Quentin J. M. A1 - Smolka, Michael N. T1 - No association of goal-directed and habitual control with alcohol consumption in young adults JF - Addiction biology N2 - Alcohol dependence is a mental disorder that has been associated with an imbalance in behavioral control favoring model-free habitual over model-based goal-directed strategies. It is as yet unknown, however, whether such an imbalance reflects a predisposing vulnerability or results as a consequence of repeated and/or excessive alcohol exposure. We, therefore, examined the association of alcohol consumption with model-based goal-directed and model-free habitual control in 188 18-year-old social drinkers in a two-step sequential decision-making task while undergoing functional magnetic resonance imaging before prolonged alcohol misuse could have led to severe neurobiological adaptations. Behaviorally, participants showed a mixture of model-free and model-based decision-making as observed previously. Measures of impulsivity were positively related to alcohol consumption. In contrast, neither model-free nor model-based decision weights nor the trade-off between them were associated with alcohol consumption. There were also no significant associations between alcohol consumption and neural correlates of model-free or model-based decision quantities in either ventral striatum or ventromedial prefrontal cortex. Exploratory whole-brain functional magnetic resonance imaging analyses with a lenient threshold revealed early onset of drinking to be associated with an enhanced representation of model-free reward prediction errors in the posterior putamen. These results suggest that an imbalance between model-based goal-directed and model-free habitual control might rather not be a trait marker of alcohol intake per se. KW - alcohol KW - goal-directed KW - reinforcement learning Y1 - 2017 U6 - https://doi.org/10.1111/adb.12490 SN - 1355-6215 SN - 1369-1600 VL - 23 IS - 1 SP - 379 EP - 393 PB - Wiley CY - Hoboken ER - TY - GEN A1 - Sebold, Miriam Hannah A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Schad, Daniel A1 - Sommer, Christian A1 - Rapp, Michael Armin A1 - Smolka, Michael N. A1 - Huys, Quentin J. M. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas T1 - Neurobiological correlates of learning and decision-making in alcohol dependence T2 - European psychiatry : the journal of the Association of European Psychiatrists Y1 - 2017 U6 - https://doi.org/10.1016/j.eurpsy.2017.01.084 SN - 0924-9338 SN - 1778-3585 VL - 41 SP - S11 EP - S11 PB - Elsevier CY - Paris ER - TY - JOUR A1 - Sebold, Miriam Hannah A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Guggenmos, Matthias A1 - Schad, Daniel A1 - Beck, Anne A1 - Kuitunen-Paul, Sören A1 - Sommer, Christian A1 - Frank, Robin A1 - Neu, Peter A1 - Zimmermann, Ulrich S. A1 - Rapp, Michael Armin A1 - Smolka, Michael N. A1 - Huys, Quentin J. M. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas T1 - When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence JF - Biological psychiatry : a journal of psychiatric neuroscience and therapeutics ; a publication of the Society of Biological Psychiatry N2 - BACKGROUND: Addiction is supposedly characterized by a shift from goal-directed to habitual decision making, thus facilitating automatic drug intake. The two-step task allows distinguishing between these mechanisms by computationally modeling goal-directed and habitual behavior as model-based and model-free control. In addicted patients, decision making may also strongly depend upon drug-associated expectations. Therefore, we investigated model-based versus model-free decision making and its neural correlates as well as alcohol expectancies in alcohol-dependent patients and healthy controls and assessed treatment outcome in patients. METHODS: Ninety detoxified, medication-free, alcohol-dependent patients and 96 age-and gender-matched control subjects underwent functional magnetic resonance imaging during the two-step task. Alcohol expectancies were measured with the Alcohol Expectancy Questionnaire. Over a follow-up period of 48 weeks, 37 patients remained abstinent and 53 patients relapsed as indicated by the Alcohol Timeline Followback method. RESULTS: Patients who relapsed displayed reduced medial prefrontal cortex activation during model-based decision making. Furthermore, high alcohol expectancies were associated with low model-based control in relapsers, while the opposite was observed in abstainers and healthy control subjects. However, reduced model-based control per se was not associated with subsequent relapse. CONCLUSIONS: These findings suggest that poor treatment outcome in alcohol dependence does not simply result from a shift from model-based to model-free control but is instead dependent on the interaction between high drug expectancies and low model-based decision making. Reduced model-based medial prefrontal cortex signatures in those who relapse point to a neural correlate of relapse risk. These observations suggest that therapeutic interventions should target subjective alcohol expectancies. KW - Alcohol dependence KW - Alcohol expectancy KW - Goal-directed control KW - Medial prefrontal cortex KW - Reinforcement learning KW - Treatment outcome Y1 - 2017 U6 - https://doi.org/10.1016/j.biopsych.2017.04.019 SN - 0006-3223 SN - 1873-2402 VL - 82 SP - 847 EP - 856 PB - Elsevier CY - New York ER - TY - JOUR A1 - Sommer, C. A1 - Garbusow, Maria A1 - Juenger, E. A1 - Pooseh, S. A1 - Bernhardt, Nadine A1 - Birkenstock, J. A1 - Schad, Daniel A1 - Jabs, B. A1 - Gloeckler, T. A1 - Huys, Quentin J. M. A1 - Heinz, A. A1 - Smolka, Michael N. A1 - Zimmermann, Ulrich S. T1 - Strong seduction: impulsivity and the impact of contextual cues on instrumental behavior in alcohol dependence JF - Translational Psychiatry N2 - Alcohol-related cues acquire incentive salience through Pavlovian conditioning and then can markedly affect instrumental behavior of alcohol-dependent patients to promote relapse. However, it is unclear whether similar effects occur with alcohol-unrelated cues. We tested 116 early-abstinent alcohol-dependent patients and 91 healthy controls who completed a delay discounting task to assess choice impulsivity, and a Pavlovian-to-instrumental transfer (PIT) paradigm employing both alcohol-unrelated and alcohol-related stimuli. To modify instrumental choice behavior, we tiled the background of the computer screen either with conditioned stimuli (CS) previously generated by pairing abstract pictures with pictures indicating monetary gains or losses, or with pictures displaying alcohol or water beverages. CS paired to money gains and losses affected instrumental choices differently. This PIT effect was significantly more pronounced in patients compared to controls, and the group difference was mainly driven by highly impulsive patients. The PIT effect was particularly strong in trials in which the instrumental stimulus required inhibition of instrumental response behavior and the background CS was associated to monetary gains. Under that condition, patients performed inappropriate approach behavior, contrary to their previously formed behavioral intention. Surprisingly, the effect of alcohol and water pictures as background stimuli resembled that of aversive and appetitive CS, respectively. These findings suggest that positively valenced background CS can provoke dysfunctional instrumental approach behavior in impulsive alcohol-dependent patients. Consequently, in real life they might be easily seduced by environmental cues to engage in actions thwarting their long-term goals. Such behaviors may include, but are not limited to, approaching alcohol. Y1 - 2017 U6 - https://doi.org/10.1038/tp.2017.158 SN - 2158-3188 VL - 7 SP - 1209 EP - 1222 PB - Nature Publ. Group CY - New York ER -