TY - GEN A1 - Sebold, Miriam A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Schad, Daniel A1 - Sommer, Christian A1 - Rapp, Michael A. A1 - Smolka, Michael N. A1 - Huys, Quentin J. M. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas T1 - Neurobiological correlates of learning and decision-making in alcohol dependence T2 - European psychiatry : the journal of the Association of European Psychiatrists Y1 - 2017 U6 - https://doi.org/10.1016/j.eurpsy.2017.01.084 SN - 0924-9338 SN - 1778-3585 VL - 41 SP - S11 EP - S11 PB - Elsevier CY - Paris ER - TY - JOUR A1 - Nebe, Stephan A1 - Kroemer, Nils B. A1 - Schad, Daniel A1 - Bernhardt, Nadine A1 - Sebold, Miriam A1 - Mueller, Dirk K. A1 - Scholl, Lucie A1 - Kuitunen-Paul, Sören A1 - Heinz, Andreas A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. A1 - Smolka, Michael N. T1 - No association of goal-directed and habitual control with alcohol consumption in young adults JF - Addiction biology N2 - Alcohol dependence is a mental disorder that has been associated with an imbalance in behavioral control favoring model-free habitual over model-based goal-directed strategies. It is as yet unknown, however, whether such an imbalance reflects a predisposing vulnerability or results as a consequence of repeated and/or excessive alcohol exposure. We, therefore, examined the association of alcohol consumption with model-based goal-directed and model-free habitual control in 188 18-year-old social drinkers in a two-step sequential decision-making task while undergoing functional magnetic resonance imaging before prolonged alcohol misuse could have led to severe neurobiological adaptations. Behaviorally, participants showed a mixture of model-free and model-based decision-making as observed previously. Measures of impulsivity were positively related to alcohol consumption. In contrast, neither model-free nor model-based decision weights nor the trade-off between them were associated with alcohol consumption. There were also no significant associations between alcohol consumption and neural correlates of model-free or model-based decision quantities in either ventral striatum or ventromedial prefrontal cortex. Exploratory whole-brain functional magnetic resonance imaging analyses with a lenient threshold revealed early onset of drinking to be associated with an enhanced representation of model-free reward prediction errors in the posterior putamen. These results suggest that an imbalance between model-based goal-directed and model-free habitual control might rather not be a trait marker of alcohol intake per se. KW - alcohol KW - goal-directed KW - reinforcement learning Y1 - 2017 U6 - https://doi.org/10.1111/adb.12490 SN - 1355-6215 SN - 1369-1600 VL - 23 IS - 1 SP - 379 EP - 393 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - Sebold, Miriam A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Guggenmos, Matthias A1 - Schad, Daniel A1 - Beck, Anne A1 - Kuitunen-Paul, Sören A1 - Sommer, Christian A1 - Frank, Robin A1 - Neu, Peter A1 - Zimmermann, Ulrich S. A1 - Rapp, Michael A. A1 - Smolka, Michael N. A1 - Huys, Quentin J. M. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas T1 - When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence JF - Biological psychiatry : a journal of psychiatric neuroscience and therapeutics ; a publication of the Society of Biological Psychiatry N2 - BACKGROUND: Addiction is supposedly characterized by a shift from goal-directed to habitual decision making, thus facilitating automatic drug intake. The two-step task allows distinguishing between these mechanisms by computationally modeling goal-directed and habitual behavior as model-based and model-free control. In addicted patients, decision making may also strongly depend upon drug-associated expectations. Therefore, we investigated model-based versus model-free decision making and its neural correlates as well as alcohol expectancies in alcohol-dependent patients and healthy controls and assessed treatment outcome in patients. METHODS: Ninety detoxified, medication-free, alcohol-dependent patients and 96 age-and gender-matched control subjects underwent functional magnetic resonance imaging during the two-step task. Alcohol expectancies were measured with the Alcohol Expectancy Questionnaire. Over a follow-up period of 48 weeks, 37 patients remained abstinent and 53 patients relapsed as indicated by the Alcohol Timeline Followback method. RESULTS: Patients who relapsed displayed reduced medial prefrontal cortex activation during model-based decision making. Furthermore, high alcohol expectancies were associated with low model-based control in relapsers, while the opposite was observed in abstainers and healthy control subjects. However, reduced model-based control per se was not associated with subsequent relapse. CONCLUSIONS: These findings suggest that poor treatment outcome in alcohol dependence does not simply result from a shift from model-based to model-free control but is instead dependent on the interaction between high drug expectancies and low model-based decision making. Reduced model-based medial prefrontal cortex signatures in those who relapse point to a neural correlate of relapse risk. These observations suggest that therapeutic interventions should target subjective alcohol expectancies. KW - Alcohol dependence KW - Alcohol expectancy KW - Goal-directed control KW - Medial prefrontal cortex KW - Reinforcement learning KW - Treatment outcome Y1 - 2017 U6 - https://doi.org/10.1016/j.biopsych.2017.04.019 SN - 0006-3223 SN - 1873-2402 VL - 82 SP - 847 EP - 856 PB - Elsevier CY - New York ER - TY - JOUR A1 - Sebold, Miriam A1 - Schad, Daniel A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Juenger, Elisabeth A1 - Kroemer, Nils B. A1 - Kathmann, Norbert A1 - Zimmermann, Ulrich S. A1 - Smolka, Michael N. A1 - Rapp, Michael A. A1 - Heinz, Andreas A1 - Huys, Quentin J. M. T1 - Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning JF - Journal of cognitive neuroscience N2 - Behavioral choice can be characterized along two axes. One axis distinguishes reflexive, model-free systems that slowly accumulate values through experience and a model-based system that uses knowledge to reason prospectively. The second axis distinguishes Pavlovian valuation of stimuli from instrumental valuation of actions or stimulus–action pairs. This results in four values and many possible interactions between them, with important consequences for accounts of individual variation. We here explored whether individual variation along one axis was related to individual variation along the other. Specifically, we asked whether individuals' balance between model-based and model-free learning was related to their tendency to show Pavlovian interferences with instrumental decisions. In two independent samples with a total of 243 participants, Pavlovian–instrumental transfer effects were negatively correlated with the strength of model-based reasoning in a two-step task. This suggests a potential common underlying substrate predisposing individuals to both have strong Pavlovian interference and be less model-based and provides a framework within which to interpret the observation of both effects in addiction. Y1 - 2016 U6 - https://doi.org/10.1162/jocn_a_00945 SN - 0898-929X SN - 1530-8898 VL - 28 SP - 985 EP - 995 PB - MIT Press CY - Cambridge ER - TY - JOUR A1 - Garbusow, Maria A1 - Schad, Daniel A1 - Sebold, Miriam A1 - Friedel, Eva A1 - Bernhardt, Nadine A1 - Koch, Stefan P. A1 - Steinacher, Bruno A1 - Kathmann, Norbert A1 - Geurts, Dirk E. M. A1 - Sommer, Christian A1 - Mueller, Dirk K. A1 - Nebe, Stephan A1 - Paul, Soeren A1 - Wittchen, Hans-Ulrich A1 - Zimmermann, Ulrich S. A1 - Walter, Henrik A1 - Smolka, Michael N. A1 - Sterzer, Philipp A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas T1 - Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence JF - Addiction biology N2 - In detoxified alcohol-dependent patients, alcohol-related stimuli can promote relapse. However, to date, the mechanisms by which contextual stimuli promote relapse have not been elucidated in detail. One hypothesis is that such contextual stimuli directly stimulate the motivation to drink via associated brain regions like the ventral striatum and thus promote alcohol seeking, intake and relapse. Pavlovian-to-Instrumental-Transfer (PIT) may be one of those behavioral phenomena contributing to relapse, capturing how Pavlovian conditioned (contextual) cues determine instrumental behavior (e.g. alcohol seeking and intake). We used a PIT paradigm during functional magnetic resonance imaging to examine the effects of classically conditioned Pavlovian stimuli on instrumental choices in n=31 detoxified patients diagnosed with alcohol dependence and n=24 healthy controls matched for age and gender. Patients were followed up over a period of 3 months. We observed that (1) there was a significant behavioral PIT effect for all participants, which was significantly more pronounced in alcohol-dependent patients; (2) PIT was significantly associated with blood oxygen level-dependent (BOLD) signals in the nucleus accumbens (NAcc) in subsequent relapsers only; and (3) PIT-related NAcc activation was associated with, and predictive of, critical outcomes (amount of alcohol intake and relapse during a 3 months follow-up period) in alcohol-dependent patients. These observations show for the first time that PIT-related BOLD signals, as a measure of the influence of Pavlovian cues on instrumental behavior, predict alcohol intake and relapse in alcohol dependence. KW - human Pavlovian-to-instrumental transfer KW - nucleus accumbens KW - relapse in alcohol use disorder Y1 - 2016 U6 - https://doi.org/10.1111/adb.12243 SN - 1355-6215 SN - 1369-1600 VL - 21 SP - 719 EP - 731 PB - Wiley-Blackwell CY - Hoboken ER - TY - JOUR A1 - Sebold, Miriam A1 - Deserno, Lorenz A1 - Nebe, Stefan A1 - Schad, Daniel A1 - Garbusow, Maria A1 - Haegele, Claudia A1 - Keller, Juergen A1 - Juenger, Elisabeth A1 - Kathmann, Norbert A1 - Smolka, Michael N. A1 - Rapp, Michael A. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas A1 - Huys, Quentin J. M. T1 - Model-based and model-free decisions in alcohol dependence JF - Neuropsychobiology : international journal of experimental and clinical research in biological psychiatry, pharmacopsychiatry, Biological Psychology/Pharmacopsychology and Pharmacoelectroencephalography N2 - Background: Human and animal work suggests a shift from goal-directed to habitual decision-making in addiction. However, the evidence for this in human alcohol dependence is as yet inconclusive. Methods: Twenty-six healthy controls and 26 recently detoxified alcohol-dependent patients underwent behavioral testing with a 2-step task designed to disentangle goal-directed and habitual response patterns. Results: Alcohol-dependent patients showed less evidence of goal-directed choices than healthy controls, particularly after losses. There was no difference in the strength of the habitual component. The group differences did not survive controlling for performance on the Digit Symbol Substitution Task. Conclusion: Chronic alcohol use appears to selectively impair goal-directed function, rather than promoting habitual responding. It appears to do so particularly after nonrewards, and this may be mediated by the effects of alcohol on more general cognitive functions subserved by the prefrontal cortex. KW - Alcohol dependence KW - Decision-making KW - Reinforcement learning KW - Dopamine KW - Computational psychiatry Y1 - 2014 U6 - https://doi.org/10.1159/000362840 SN - 0302-282X SN - 1423-0224 VL - 70 IS - 2 SP - 122 EP - 131 PB - Karger CY - Basel ER - TY - JOUR A1 - Schad, Daniel A1 - Juenger, Elisabeth A1 - Sebold, Miriam A1 - Garbusow, Maria A1 - Bernhardt, Nadine A1 - Javadi, Amir-Homayoun A1 - Zimmermann, Ulrich S. A1 - Smolka, Michael N. A1 - Heinz, Andreas A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. T1 - Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning JF - Frontiers in psychology N2 - Theories of decision-making and its neural substrates have long assumed the existence of two distinct and competing valuation systems, variously described as goal-directed vs. habitual, or, more recently and based on statistical arguments, as model-free vs. model-based reinforcement-learning. Though both have been shown to control choices, the cognitive abilities associated with these systems are under ongoing investigation. Here we examine the link to cognitive abilities, and find that individual differences in processing speed covary with a shift from model-free to model-based choice control in the presence of above-average working memory function. This suggests shared cognitive and neural processes; provides a bridge between literatures on intelligence and valuation; and may guide the development of process models of different valuation components. Furthermore, it provides a rationale for individual differences in the tendency to deploy valuation systems, which may be important for understanding the manifold neuropsychiatric diseases associated with malfunctions of valuation. KW - decision-making KW - reward KW - cognitive abilities KW - model-based and model-free learning KW - fluid intelligence KW - habitual and goal-directed system Y1 - 2014 U6 - https://doi.org/10.3389/fpsyg.2014.01450 SN - 1664-1078 VL - 5 PB - Frontiers Research Foundation CY - Lausanne ER - TY - CHAP A1 - Schad, Daniel A1 - Juenger, Elisabeth A1 - Sebold, Miriam A1 - Garbusow, Maria A1 - Bernhart, Nadine A1 - Javadi, Amir Homayoun A1 - Zimmermann, Ulrich S. A1 - Smolka, Michael N. A1 - Heinz, Andreas A1 - Rapp, Michael A. A1 - Huys, Quentin J. M. T1 - Smart goals, slow habits? Individual differences in processing speed and working memory capacity moderate the balance between habitual and goal-directed choice behavior T2 - Cognitive processing : international quarterly of cognitive science Y1 - 2014 SN - 1612-4782 SN - 1612-4790 VL - 15 IS - 1 SP - S62 EP - S62 PB - Springer CY - Heidelberg ER - TY - GEN A1 - Deeken, Friederike A1 - Reichert, Markus A1 - Zech, Hilmar A1 - Wenzel, Julia A1 - Wedemeyer, Friederike A1 - Aguilera, Alvaro A1 - Aslan, Acelya A1 - Bach, Patrick A1 - Bahr, Nadja Samia A1 - Ebrahimi, Claudia A1 - Fischbach, Pascale Christine A1 - Ganz, Marvin A1 - Garbusow, Maria A1 - Großkopf, Charlotte M. A1 - Heigert, Marie A1 - Hentschel, Angela A1 - Karl, Damian A1 - Pelz, Patricia A1 - Pinger, Mathieu A1 - Riemerschmid, Carlotta A1 - Rosenthal, Annika A1 - Steffen, Johannes A1 - Strehle, Jens A1 - Weiss, Franziska A1 - Wieder, Gesine A1 - Wieland, Alfred A1 - Zaiser, Judith A1 - Zimmermann, Sina A1 - Walter, Henrik A1 - Lenz, Bernd A1 - Deserno, Lorenz A1 - Smolka, Michael N. A1 - Liu, Shuyan A1 - Ebner-Priemer, Ulrich Walter A1 - Heinz, Andreas A1 - Rapp, Michael A. T1 - Patterns of Alcohol Consumption Among Individuals With Alcohol Use Disorder During the COVID-19 Pandemic and Lockdowns in Germany T2 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe N2 - Importance Alcohol consumption (AC) leads to death and disability worldwide. Ongoing discussions on potential negative effects of the COVID-19 pandemic on AC need to be informed by real-world evidence. Objective To examine whether lockdown measures are associated with AC and consumption-related temporal and psychological within-person mechanisms. Design, Setting, and Participants This quantitative, intensive, longitudinal cohort study recruited 1743 participants from 3 sites from February 20, 2020, to February 28, 2021. Data were provided before and within the second lockdown of the COVID-19 pandemic in Germany: before lockdown (October 2 to November 1, 2020); light lockdown (November 2 to December 15, 2020); and hard lockdown (December 16, 2020, to February 28, 2021). Main Outcomes and Measures Daily ratings of AC (main outcome) captured during 3 lockdown phases (main variable) and temporal (weekends and holidays) and psychological (social isolation and drinking intention) correlates. Results Of the 1743 screened participants, 189 (119 [63.0%] male; median [IQR] age, 37 [27.5-52.0] years) with at least 2 alcohol use disorder (AUD) criteria according to the Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition) yet without the need for medically supervised alcohol withdrawal were included. These individuals provided 14 694 smartphone ratings from October 2020 through February 2021. Multilevel modeling revealed significantly higher AC (grams of alcohol per day) on weekend days vs weekdays (β = 11.39; 95% CI, 10.00-12.77; P < .001). Alcohol consumption was above the overall average on Christmas (β = 26.82; 95% CI, 21.87-31.77; P < .001) and New Year’s Eve (β = 66.88; 95% CI, 59.22-74.54; P < .001). During the hard lockdown, perceived social isolation was significantly higher (β = 0.12; 95% CI, 0.06-0.15; P < .001), but AC was significantly lower (β = −5.45; 95% CI, −8.00 to −2.90; P = .001). Independent of lockdown, intention to drink less alcohol was associated with lower AC (β = −11.10; 95% CI, −13.63 to −8.58; P < .001). Notably, differences in AC between weekend and weekdays decreased both during the hard lockdown (β = −6.14; 95% CI, −9.96 to −2.31; P = .002) and in participants with severe AUD (β = −6.26; 95% CI, −10.18 to −2.34; P = .002). Conclusions and Relevance This 5-month cohort study found no immediate negative associations of lockdown measures with overall AC. Rather, weekend-weekday and holiday AC patterns exceeded lockdown effects. Differences in AC between weekend days and weekdays evinced that weekend drinking cycles decreased as a function of AUD severity and lockdown measures, indicating a potential mechanism of losing and regaining control. This finding suggests that temporal patterns and drinking intention constitute promising targets for prevention and intervention, even in high-risk individuals. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 805 Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-571460 SN - 1866-8364 IS - 805 ER -