TY - JOUR A1 - Sebold, Miriam Hannah A1 - Schad, Daniel A1 - Nebe, Stephan A1 - Garbusow, Maria A1 - Juenger, Elisabeth A1 - Kroemer, Nils B. A1 - Kathmann, Norbert A1 - Zimmermann, Ulrich S. A1 - Smolka, Michael N. A1 - Rapp, Michael Armin A1 - Heinz, Andreas A1 - Huys, Quentin J. M. T1 - Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning JF - Journal of cognitive neuroscience N2 - Behavioral choice can be characterized along two axes. One axis distinguishes reflexive, model-free systems that slowly accumulate values through experience and a model-based system that uses knowledge to reason prospectively. The second axis distinguishes Pavlovian valuation of stimuli from instrumental valuation of actions or stimulus–action pairs. This results in four values and many possible interactions between them, with important consequences for accounts of individual variation. We here explored whether individual variation along one axis was related to individual variation along the other. Specifically, we asked whether individuals' balance between model-based and model-free learning was related to their tendency to show Pavlovian interferences with instrumental decisions. In two independent samples with a total of 243 participants, Pavlovian–instrumental transfer effects were negatively correlated with the strength of model-based reasoning in a two-step task. This suggests a potential common underlying substrate predisposing individuals to both have strong Pavlovian interference and be less model-based and provides a framework within which to interpret the observation of both effects in addiction. Y1 - 2016 U6 - https://doi.org/10.1162/jocn_a_00945 SN - 0898-929X SN - 1530-8898 VL - 28 SP - 985 EP - 995 PB - MIT Press CY - Cambridge ER - TY - JOUR A1 - Sebold, Miriam Hannah A1 - Deserno, Lorenz A1 - Nebe, Stefan A1 - Schad, Daniel A1 - Garbusow, Maria A1 - Haegele, Claudia A1 - Keller, Juergen A1 - Juenger, Elisabeth A1 - Kathmann, Norbert A1 - Smolka, Michael N. A1 - Rapp, Michael Armin A1 - Schlagenhauf, Florian A1 - Heinz, Andreas A1 - Huys, Quentin J. M. T1 - Model-based and model-free decisions in alcohol dependence JF - Neuropsychobiology : international journal of experimental and clinical research in biological psychiatry, pharmacopsychiatry, Biological Psychology/Pharmacopsychology and Pharmacoelectroencephalography N2 - Background: Human and animal work suggests a shift from goal-directed to habitual decision-making in addiction. However, the evidence for this in human alcohol dependence is as yet inconclusive. Methods: Twenty-six healthy controls and 26 recently detoxified alcohol-dependent patients underwent behavioral testing with a 2-step task designed to disentangle goal-directed and habitual response patterns. Results: Alcohol-dependent patients showed less evidence of goal-directed choices than healthy controls, particularly after losses. There was no difference in the strength of the habitual component. The group differences did not survive controlling for performance on the Digit Symbol Substitution Task. Conclusion: Chronic alcohol use appears to selectively impair goal-directed function, rather than promoting habitual responding. It appears to do so particularly after nonrewards, and this may be mediated by the effects of alcohol on more general cognitive functions subserved by the prefrontal cortex. KW - Alcohol dependence KW - Decision-making KW - Reinforcement learning KW - Dopamine KW - Computational psychiatry Y1 - 2014 U6 - https://doi.org/10.1159/000362840 SN - 0302-282X SN - 1423-0224 VL - 70 IS - 2 SP - 122 EP - 131 PB - Karger CY - Basel ER - TY - JOUR A1 - Scheibe, Christina A1 - Wartenburger, Isabell A1 - Wüstenberg, Torsten A1 - Kathmann, Norbert A1 - Villringer, Arno A1 - Heekeren, Hauke R. T1 - Neural correlates of the interaction between transient and sustained processes : a mixed blocked/event-related fMRI study Y1 - 2006 UR - http://www3.interscience.wiley.com/journal/38751/home SN - 1065-9471 ER - TY - JOUR A1 - Heinzel, Stephan A1 - Lorenz, Robert C. A1 - Pelz, Patricia A1 - Heinz, Andreas A1 - Walter, Henrik A1 - Kathmann, Norbert A1 - Rapp, Michael Armin A1 - Stelzel, Christine T1 - Neural correlates of training and transfer effects in working memory in older adults JF - NeuroImage : a journal of brain function N2 - As indicated by previous research, aging is associated with a decline in working memory (WM) functioning, related to alterations in fronto-parietal neural activations. At the same time, previous studies showed that WM training in older adults may improve the performance in the trained task (training effect), and more importantly, also in untrained WM tasks (transfer effects). However, neural correlates of these transfer effects that would improve understanding of its underlying mechanisms, have not been shown in older participants as yet. In this study, we investigated blood-oxygen-level-dependent (BOLD) signal changes during n-back performance and an untrained delayed recognition (Sternberg) task following 12 sessions (45 min each) of adaptive n-back training in older adults. The Sternberg task used in this study allowed to test for neural training effects independent of specific task affordances of the trained task and to separate maintenance from updating processes. Thirty-two healthy older participants (60-75 years) were assigned either to an n-back training or a no-contact control group. Before (t1) and after (t2) training/waiting period, both the n-back task and the Sternberg task were conducted while BOLD signal was measured using functional Magnetic Resonance Imaging (fMRI) in all participants. In addition, neuropsychological tests were performed outside the scanner. WM performance improved with training and behavioral transfer to tests measuring executive functions, processing speed, and fluid intelligence was found. In the training group, BOLD signal in the right lateral middle frontal gyrus/caudal superior frontal sulcus (Brodmann area, BA 6/8) decreased in both the trained n-back and the updating condition of the untrained Sternberg task at t2, compared to the control group. fMRI findings indicate a training-related increase in processing efficiency of WM networks, potentially related to the process of WM updating. Performance gains in untrained tasks suggest that transfer to other cognitive tasks remains possible in aging. (C) 2016 Elsevier Inc. All rights reserved. KW - Aging KW - Working memory KW - Training KW - Transfer KW - Neuroimaging KW - fMRI KW - Updating KW - Executive functions KW - Fluid intelligence Y1 - 2016 U6 - https://doi.org/10.1016/j.neuroimage.2016.03.068 SN - 1053-8119 SN - 1095-9572 VL - 134 SP - 236 EP - 249 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Heinzel, Stephan A1 - Lorenz, Robert C. A1 - Brockhaus, Wolf-Ruediger A1 - Wuestenberg, Torsten A1 - Kathmann, Norbert A1 - Heinz, Andreas A1 - Rapp, Michael Armin T1 - Working memory load-dependent brain response predicts behavioral training gains in older adults JF - The journal of neuroscience N2 - In the domain of working memory (WM), a sigmoid-shaped relationship between WM load and brain activation patterns has been demonstrated in younger adults. It has been suggested that age-related alterations of this pattern are associated with changes in neural efficiency and capacity. At the same time, WM training studies have shown that some older adults are able to increase their WM performance through training. In this study, functional magnetic resonance imaging during an n-back WM task at different WM load levels was applied to compare blood oxygen level-dependent (BOLD) responses between younger and older participants and to predict gains in WM performance after a subsequent 12-session WM training procedure in older adults. We show that increased neural efficiency and capacity, as reflected by more "youth-like" brain response patterns in regions of interest of the frontoparietal WM network, were associated with better behavioral training outcome beyond the effects of age, sex, education, gray matter volume, and baseline WM performance. Furthermore, at low difficulty levels, decreases in BOLD response were found after WM training. Results indicate that both neural efficiency (i. e., decreased activation at comparable performance levels) and capacity (i. e., increasing activation with increasing WM load) of a WM-related network predict plasticity of the WM system, whereas WM training may specifically increase neural efficiency in older adults. KW - aging KW - fMRI KW - neuroimaging KW - plasticity KW - training KW - working memory Y1 - 2014 U6 - https://doi.org/10.1523/JNEUROSCI.2463-13.2014 SN - 0270-6474 VL - 34 IS - 4 SP - 1224 EP - 1233 PB - Society for Neuroscience CY - Washington ER - TY - JOUR A1 - Garbusow, Maria A1 - Schad, Daniel A1 - Sommer, Christian A1 - Juenger, Elisabeth A1 - Sebold, Miriam Hannah A1 - Friedel, Eva A1 - Wendt, Jean A1 - Kathmann, Norbert A1 - Schlagenhauf, Florian A1 - Zimmermann, Ulrich S. A1 - Heinz, Andreas A1 - Huys, Quentin J. M. A1 - Rapp, Michael Armin T1 - Pavlovian-to-instrumental transfer in alcohol dependence: a pilot study JF - Neuropsychobiology : international journal of experimental and clinical research in biological psychiatry, pharmacopsychiatry, Biological Psychology/Pharmacopsychology and Pharmacoelectroencephalography N2 - Background: Pavlovian processes are thought to play an important role in the development, maintenance and relapse of alcohol dependence, possibly by influencing and usurping ongoing thought and behavior. The influence of pavlovian stimuli on ongoing behavior is paradigmatically measured by pavlovian-to-instrumental transfer (PIT) tasks. These involve multiple stages and are complex. Whether increased PIT is involved in human alcohol dependence is uncertain. We therefore aimed to establish and validate a modified PIT paradigm that would be robust, consistent and tolerated by healthy controls as well as by patients suffering from alcohol dependence, and to explore whether alcohol dependence is associated with enhanced PIT. Methods: Thirty-two recently detoxified alcohol-dependent patients and 32 age- and gender-matched healthy controls performed a PIT task with instrumental go/no-go approach behaviors. The task involved both pavlovian stimuli associated with monetary rewards and losses, and images of drinks. Results: Both patients and healthy controls showed a robust and temporally stable PIT effect. Strengths of PIT effects to drug-related and monetary conditioned stimuli were highly correlated. Patients more frequently showed a PIT effect, and the effect was stronger in response to aversively conditioned CSs (conditioned suppression), but there was no group difference in response to appetitive CSs. Conclusion: The implementation of PIT has favorably robust properties in chronic alcohol-dependent patients and in healthy controls. It shows internal consistency between monetary and drug-related cues. The findings support an association of alcohol dependence with an increased propensity towards PIT. KW - Pavlovian-to-instrumental transfer KW - Alcohol dependence KW - Human Y1 - 2014 U6 - https://doi.org/10.1159/000363507 SN - 0302-282X SN - 1423-0224 VL - 70 IS - 2 SP - 111 EP - 121 PB - Karger CY - Basel ER - TY - JOUR A1 - Garbusow, Maria A1 - Schad, Daniel A1 - Sebold, Miriam Hannah A1 - Friedel, Eva A1 - Bernhardt, Nadine A1 - Koch, Stefan P. A1 - Steinacher, Bruno A1 - Kathmann, Norbert A1 - Geurts, Dirk E. M. A1 - Sommer, Christian A1 - Mueller, Dirk K. A1 - Nebe, Stephan A1 - Paul, Soeren A1 - Wittchen, Hans-Ulrich A1 - Zimmermann, Ulrich S. A1 - Walter, Henrik A1 - Smolka, Michael N. A1 - Sterzer, Philipp A1 - Rapp, Michael Armin A1 - Huys, Quentin J. M. A1 - Schlagenhauf, Florian A1 - Heinz, Andreas T1 - Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence JF - Addiction biology N2 - In detoxified alcohol-dependent patients, alcohol-related stimuli can promote relapse. However, to date, the mechanisms by which contextual stimuli promote relapse have not been elucidated in detail. One hypothesis is that such contextual stimuli directly stimulate the motivation to drink via associated brain regions like the ventral striatum and thus promote alcohol seeking, intake and relapse. Pavlovian-to-Instrumental-Transfer (PIT) may be one of those behavioral phenomena contributing to relapse, capturing how Pavlovian conditioned (contextual) cues determine instrumental behavior (e.g. alcohol seeking and intake). We used a PIT paradigm during functional magnetic resonance imaging to examine the effects of classically conditioned Pavlovian stimuli on instrumental choices in n=31 detoxified patients diagnosed with alcohol dependence and n=24 healthy controls matched for age and gender. Patients were followed up over a period of 3 months. We observed that (1) there was a significant behavioral PIT effect for all participants, which was significantly more pronounced in alcohol-dependent patients; (2) PIT was significantly associated with blood oxygen level-dependent (BOLD) signals in the nucleus accumbens (NAcc) in subsequent relapsers only; and (3) PIT-related NAcc activation was associated with, and predictive of, critical outcomes (amount of alcohol intake and relapse during a 3 months follow-up period) in alcohol-dependent patients. These observations show for the first time that PIT-related BOLD signals, as a measure of the influence of Pavlovian cues on instrumental behavior, predict alcohol intake and relapse in alcohol dependence. KW - human Pavlovian-to-instrumental transfer KW - nucleus accumbens KW - relapse in alcohol use disorder Y1 - 2016 U6 - https://doi.org/10.1111/adb.12243 SN - 1355-6215 SN - 1369-1600 VL - 21 SP - 719 EP - 731 PB - Wiley-Blackwell CY - Hoboken ER -