@techreport{BrodeurMikolaCooketal.2024, type = {Working Paper}, author = {Brodeur, Abel and Mikola, Derek and Cook, Nikolai and Brailey, Thomas and Briggs, Ryan and Gendre, Alexandra de and Dupraz, Yannick and Fiala, Lenka and Gabani, Jacopo and Gauriot, Romain and Haddad, Joanne and Lima, Goncalo and Ankel-Peters, J{\"o}rg and Dreber, Anna and Campbell, Douglas and Kattan, Lamis and Fages, Diego Marino and Mierisch, Fabian and Sun, Pu and Wright, Taylor and Connolly, Marie and Hoces de la Guardia, Fernando and Johannesson, Magnus and Miguel, Edward and Vilhuber, Lars and Abarca, Alejandro and Acharya, Mahesh and Adjisse, Sossou Simplice and Akhtar, Ahwaz and Lizardi, Eduardo Alberto Ramirez and Albrecht, Sabina and Andersen, Synve Nygaard and Andlib, Zubaria and Arrora, Falak and Ash, Thomas and Bacher, Etienne and Bachler, Sebastian and Bacon, F{\´e}lix and Bagues, Manuel and Balogh, Timea and Batmanov, Alisher and Barschkett, Mara and Basdil, B. Kaan and Dower, Jaromneda and Castek, Ondrej and Caviglia-Harris, Jill and Strand, Gabriella Chauca and Chen, Shi and Chzhen, Asya and Chung, Jong and Collins, Jason and Coppock, Alexander and Cordeau, Hugo and Couillard, Ben and Crechet, Jonathan and Crippa, Lorenzo and Cui, Jeanne and Czymara, Christian and Daarstad, Haley and Dao, Danh Chi and Dao, Dong and Schmandt, Marco David and Linde, Astrid de and Melo, Lucas De and Deer, Lachlan and Vera, Micole De and Dimitrova, Velichka and Dollbaum, Jan Fabian and Dollbaum, Jan Matti and Donnelly, Michael and Huynh, Luu Duc Toan and Dumbalska, Tsvetomira and Duncan, Jamie and Duong, Kiet Tuan and Duprey, Thibaut and Dworschak, Christoph and Ellingsrud, Sigmund and Elminejad, Ali and Eissa, Yasmine and Erhart, Andrea and Etingin-Frati, Giulian and Fatemi-Pour, Elaheh and Federice, Alexa and Feld, Jan and Fenig, Guidon and Firouzjaeiangalougah, Mojtaba and Fleisje, Erlend and Fortier-Chouinard, Alexandre and Engel, Julia Francesca and Fries, Tilman and Fortier, Reid and Fr{\´e}chet, Nadjim and Galipeau, Thomas and Gallegos, Sebasti{\´a}n and Gangji, Areez and Gao, Xiaoying and Garnache, Clo{\´e} and G{\´a}sp{\´a}r, Attila and Gavrilova, Evelina and Ghosh, Arijit and Gibney, Garreth and Gibson, Grant and Godager, Geir and Goff, Leonard and Gong, Da and Gonz{\´a}lez, Javier and Gretton, Jeremy and Griffa, Cristina and Grigoryeva, Idaliya and Grtting, Maja and Guntermann, Eric and Guo, Jiaqi and Gugushvili, Alexi and Habibnia, Hooman and H{\"a}ffner, Sonja and Hall, Jonathan D. and Hammar, Olle and Kordt, Amund Hanson and Hashimoto, Barry and Hartley, Jonathan S. and Hausladen, Carina I. and Havr{\´a}nek, Tom{\´a}š and Hazen, Jacob and He, Harry and Hepplewhite, Matthew and Herrera-Rodriguez, Mario and Heuer, Felix and Heyes, Anthony and Ho, Anson T. Y. and Holmes, Jonathan and Holzknecht, Armando and Hsu, Yu-Hsiang Dexter and Hu, Shiang-Hung and Huang, Yu-Shiuan and Huebener, Mathias and Huber, Christoph and Huynh, Kim P. and Irsova, Zuzana and Isler, Ozan and Jakobsson, Niklas and Frith, Michael James and Jananji, Rapha{\"e}l and Jayalath, Tharaka A. and Jetter, Michael and John, Jenny and Forshaw, Rachel Joy and Juan, Felipe and Kadriu, Valon and Karim, Sunny and Kelly, Edmund and Dang, Duy Khanh Hoang and Khushboo, Tazia and Kim, Jin and Kjellsson, Gustav and Kjelsrud, Anders and Kotsadam, Andreas and Korpershoek, Jori and Krashinsky, Lewis and Kundu, Suranjana and Kustov, Alexander and Lalayev, Nurlan and Langlois, Audr{\´e}e and Laufer, Jill and Lee-Whiting, Blake and Leibing, Andreas and Lenz, Gabriel and Levin, Joel and Li, Peng and Li, Tongzhe and Lin, Yuchen and Listo, Ariel and Liu, Dan and Lu, Xuewen and Lukmanova, Elvina and Luscombe, Alex and Lusher, Lester R. and Lyu, Ke and Ma, Hai and M{\"a}der, Nicolas and Makate, Clifton and Malmberg, Alice and Maitra, Adit and Mandas, Marco and Marcus, Jan and Margaryan, Shushanik and M{\´a}rk, Lili and Martignano, Andres and Marsh, Abigail and Masetto, Isabella and McCanny, Anthony and McManus, Emma and McWay, Ryan and Metson, Lennard and Kinge, Jonas Minet and Mishra, Sumit and Mohnen, Myra and M{\"o}ller, Jakob and Montambeault, Rosalie and Montpetit, S{\´e}bastien and Morin, Louis-Philippe and Morris, Todd and Moser, Scott and Motoki, Fabio and Muehlenbachs, Lucija and Musulan, Andreea and Musumeci, Marco and Nabin, Munirul and Nchare, Karim and Neubauer, Florian and Nguyen, Quan M. P. and Nguyen, Tuan and Nguyen-Tien, Viet and Niazi, Ali and Nikolaishvili, Giorgi and Nordstrom, Ardyn and N{\"u}, Patrick and Odermatt, Angela and Olson, Matt and ien, Henning and {\"O}lkers, Tim and Vert, Miquel Oliver i. and Oral, Emre and Oswald, Christian and Ousman, Ali and {\"O}zak, {\"O}mer and Pandey, Shubham and Pavlov, Alexandre and Pelli, Martino and Penheiro, Romeo and Park, RyuGyung and Martel, Eva P{\´e}rez and Petrovičov{\´a}, Tereza and Phan, Linh and Prettyman, Alexa and Proch{\´a}zka, Jakub and Putri, Aqila and Quandt, Julian and Qiu, Kangyu and Nguyen, Loan Quynh Thi and Rahman, Andaleeb and Rea, Carson H. and Reiremo, Adam and Ren{\´e}e, La{\"e}titia and Richardson, Joseph and Rivers, Nicholas and Rodrigues, Bruno and Roelofs, William and Roemer, Tobias and Rogeberg, Ole and Rose, Julian and Roskos-Ewoldsen, Andrew and Rosmer, Paul and Sabada, Barbara and Saberian, Soodeh and Salamanca, Nicolas and Sator, Georg and Sawyer, Antoine and Scates, Daniel and Schl{\"u}ter, Elmar and Sells, Cameron and Sen, Sharmi and Sethi, Ritika and Shcherbiak, Anna and Sogaolu, Moyosore and Soosalu, Matt and Srensen, Erik and Sovani, Manali and Spencer, Noah and Staubli, Stefan and Stans, Renske and Stewart, Anya and Stips, Felix and Stockley, Kieran and Strobel, Stephenson and Struby, Ethan and Tang, John and Tanrisever, Idil and Yang, Thomas Tao and Tastan, Ipek and Tatić, Dejan and Tatlow, Benjamin and Seuyong, F{\´e}raud Tchuisseu and Th{\´e}riault, R{\´e}mi and Thivierge, Vincent and Tian, Wenjie and Toma, Filip-Mihai and Totarelli, Maddalena and Tran, Van-Anh and Truong, Hung and Tsoy, Nikita and Tuzcuoglu, Kerem and Ubfal, Diego and Villalobos, Laura and Walterskirchen, Julian and Wang, Joseph Taoyi and Wattal, Vasudha and Webb, Matthew D. and Weber, Bryan and Weisser, Reinhard and Weng, Wei-Chien and Westheide, Christian and White, Kimberly and Winter, Jacob and Wochner, Timo and Woerman, Matt and Wong, Jared and Woodard, Ritchie and Wroński, Marcin and Yazbeck, Myra and Yang, Gustav Chung and Yap, Luther and Yassin, Kareman and Ye, Hao and Yoon, Jin Young and Yurris, Chris and Zahra, Tahreen and Zaneva, Mirela and Zayat, Aline and Zhang, Jonathan and Zhao, Ziwei and Yaolang, Zhong}, title = {Mass reproducibility and replicability}, series = {I4R discussion paper series}, journal = {I4R discussion paper series}, number = {107}, publisher = {Institute for Replication}, address = {Essen}, issn = {2752-1931}, pages = {250}, year = {2024}, abstract = {This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we uncover a high rate of fully computationally reproducible results (over 85\%). Second, excluding minor issues like missing packages or broken pathways, we uncover coding errors for about 25\% of studies, with some studies containing multiple errors. Third, we test the robustness of the results to 5,511 re-analyses. We find a robustness reproducibility of about 70\%. Robustness reproducibility rates are relatively higher for re-analyses that introduce new data and lower for re-analyses that change the sample or the definition of the dependent variable. Fourth, 52\% of re-analysis effect size estimates are smaller than the original published estimates and the average statistical significance of a re-analysis is 77\% of the original. Lastly, we rely on six teams of researchers working independently to answer eight additional research questions on the determinants of robustness reproducibility. Most teams find a negative relationship between replicators' experience and reproducibility, while finding no relationship between reproducibility and the provision of intermediate or even raw data combined with the necessary cleaning codes.}, language = {en} } @misc{KuschpelLiuSchadetal.2015, author = {Kuschpel, Maxim S. and Liu, Shuyan and Schad, Daniel and Heinzel, Stephan and Heinz, Andreas and Rapp, Michael A.}, title = {Differential effects of wakeful rest, music and video game playing on working memory performance in the n-back task}, url = {http://nbn-resolving.de/urn:nbn:de:kobv:517-opus4-85151}, year = {2015}, abstract = {The interruption of learning processes by breaks filled with diverse activities is common in everyday life. We investigated the effects of active computer gaming and passive relaxation (rest and music) breaks on working memory performance. Young adults were exposed to breaks involving (i) eyes-open resting, (ii) listening to music and (iii) playing the video game "Angry Birds" before performing the n-back working memory task. Based on linear mixed-effects modeling, we found that playing the "Angry Birds" video game during a short learning break led to a decline in task performance over the course of the task as compared to eyes-open resting and listening to music, although overall task performance was not impaired. This effect was associated with high levels of daily mind wandering and low self-reported ability to concentrate. These findings indicate that video games can negatively affect working memory performance over time when played in between learning tasks. We suggest further investigation of these effects because of their relevance to everyday activity.}, language = {en} } @misc{LiuSchadKuschpeletal.2016, author = {Liu, Shuyan and Schad, Daniel and Kuschpel, Maxim S. and Rapp, Michael A. and Heinz, Andreas}, title = {Music and Video Gaming during Breaks}, url = {http://nbn-resolving.de/urn:nbn:de:kobv:517-opus4-90700}, pages = {1 -- 12}, year = {2016}, abstract = {Different systems for habitual versus goal-directed control are thought to underlie human decision-making. Working memory is known to shape these decision-making systems and their interplay, and is known to support goal-directed decision making even under stress. Here, we investigated if and how decision systems are differentially influenced by breaks filled with diverse everyday life activities known to modulate working memory performance. We used a within-subject design where young adults listened to music and played a video game during breaks interleaved with trials of a sequential two-step Markov decision task, designed to assess habitual as well as goal-directed decision making. Based on a neurocomputational model of task performance, we observed that for individuals with a rather limited working memory capacity video gaming as compared to music reduced reliance on the goal-directed decision-making system, while a rather large working memory capacity prevented such a decline. Our findings suggest differential effects of everyday activities on key decision-making processes.}, language = {en} } @article{LiuSchadKuschpeletal.2016, author = {Liu, Shuyan and Schad, Daniel and Kuschpel, Maxim S. and Rapp, Michael A. and Heinz, Andreas}, title = {Music and Video Gaming during Breaks}, series = {PLoS one}, volume = {11}, journal = {PLoS one}, number = {3}, publisher = {Public Library of Science}, address = {Lawrence, Kan.}, issn = {1932-6203}, doi = {10.1371/JOURNAL.PONE.0150165}, pages = {1 -- 12}, year = {2016}, abstract = {Different systems for habitual versus goal-directed control are thought to underlie human decision-making. Working memory is known to shape these decision-making systems and their interplay, and is known to support goal-directed decision making even under stress. Here, we investigated if and how decision systems are differentially influenced by breaks filled with diverse everyday life activities known to modulate working memory performance. We used a within-subject design where young adults listened to music and played a video game during breaks interleaved with trials of a sequential two-step Markov decision task, designed to assess habitual as well as goal-directed decision making. Based on a neurocomputational model of task performance, we observed that for individuals with a rather limited working memory capacity video gaming as compared to music reduced reliance on the goal-directed decision-making system, while a rather large working memory capacity prevented such a decline. Our findings suggest differential effects of everyday activities on key decision-making processes.}, language = {en} } @article{SchadGarbusowFriedeletal.2018, author = {Schad, Daniel and Garbusow, Maria and Friedel, Eva and Sommer, Christian and Sebold, Miriam and H{\"a}gele, Claudia and Bernhardt, Nadine and Nebe, Stephan and Kuitunen-Paul, S{\"o}ren and Liu, Shuyan and Eichmann, Uta and Beck, Anne and Wittchen, Hans-Ulrich and Walter, Henrik and Sterzer, Philipp and Zimmermann, Ulrich S. and Smolka, Michael N. and Schlagenhauf, Florian and Huys, Quentin J. M. and Heinz, Andreas and Rapp, Michael A.}, title = {Neural correlates of instrumental responding in the context of alcohol-related cues index disorder severity and relapse risk}, series = {European archives of psychiatry and clinical neuroscience : official organ of the German Society for Biological Psychiatry}, volume = {269}, journal = {European archives of psychiatry and clinical neuroscience : official organ of the German Society for Biological Psychiatry}, number = {3}, publisher = {Springer}, address = {Heidelberg}, issn = {0940-1334}, doi = {10.1007/s00406-017-0860-4}, pages = {295 -- 308}, year = {2018}, abstract = {The influence of Pavlovian conditioned stimuli on ongoing behavior may contribute to explaining how alcohol cues stimulate drug seeking and intake. Using a Pavlovian-instrumental transfer task, we investigated the effects of alcohol-related cues on approach behavior (i.e., instrumental response behavior) and its neural correlates, and related both to the relapse after detoxification in alcohol-dependent patients. Thirty-one recently detoxified alcohol-dependent patients and 24 healthy controls underwent instrumental training, where approach or non-approach towards initially neutral stimuli was reinforced by monetary incentives. Approach behavior was tested during extinction with either alcohol-related or neutral stimuli (as Pavlovian cues) presented in the background during functional magnetic resonance imaging (fMRI). Patients were subsequently followed up for 6 months. We observed that alcohol-related background stimuli inhibited the approach behavior in detoxified alcohol-dependent patients (t = -3.86, p < .001), but not in healthy controls (t = -0.92, p = .36). This behavioral inhibition was associated with neural activation in the nucleus accumbens (NAcc) (t((30)) = 2.06, p < .05). Interestingly, both the effects were only present in subsequent abstainers, but not relapsers and in those with mild but not severe dependence. Our data show that alcohol-related cues can acquire inhibitory behavioral features typical of aversive stimuli despite being accompanied by a stronger NAcc activation, suggesting salience attribution. The fact that these findings are restricted to abstinence and milder illness suggests that they may be potential resilience factors.}, language = {en} } @article{KuschpelLiuSchadetal.2015, author = {Kuschpel, Maxim S. and Liu, Shuyan and Schad, Daniel and Heinzel, Stephan and Heinz, Andreas and Rapp, Michael A.}, title = {Differential effects of wakeful rest, music and video game playing on working memory performance in the n-back task}, series = {Frontiers in psychology}, journal = {Frontiers in psychology}, number = {6}, publisher = {Frontiers Research Foundation}, address = {Lausanne}, issn = {1664-1078}, doi = {10.3389/fpsyg.2015.01683}, year = {2015}, abstract = {The interruption of learning processes by breaks filled with diverse activities is common in everyday life. We investigated the effects of active computer gaming and passive relaxation (rest and music) breaks on working memory performance. Young adults were exposed to breaks involving (i) eyes-open resting, (ii) listening to music and (iii) playing the video game "Angry Birds" before performing the n-back working memory task. Based on linear mixed-effects modeling, we found that playing the "Angry Birds" video game during a short learning break led to a decline in task performance over the course of the task as compared to eyes-open resting and listening to music, although overall task performance was not impaired. This effect was associated with high levels of daily mind wandering and low self-reported ability to concentrate. These findings indicate that video games can negatively affect working memory performance over time when played in between learning tasks. We suggest further investigation of these effects because of their relevance to everyday activity.}, language = {en} } @article{LiuKuschpelSchadetal.2015, author = {Liu, Shuyan and Kuschpel, Maxim S. and Schad, Daniel and Heinz, Andreas and Rapp, Michael A.}, title = {Differential Effects of Music and Video Gaming During Breaks on Auditory and Visual Learning}, series = {Cyberpsychology, behavior and social networking}, volume = {18}, journal = {Cyberpsychology, behavior and social networking}, number = {11}, publisher = {Liebert}, address = {New Rochelle}, issn = {2152-2715}, doi = {10.1089/cyber.2015.0140}, pages = {647 -- 653}, year = {2015}, abstract = {The interruption of learning processes by breaks filled with diverse activities is common in everyday life. This study investigated the effects of active computer gaming and passive relaxation (rest and music) breaks on auditory versus visual memory performance. Young adults were exposed to breaks involving (a) open eyes resting, (b) listening to music, and (c) playing a video game, immediately after memorizing auditory versus visual stimuli. To assess learning performance, words were recalled directly after the break (an 8:30 minute delay) and were recalled and recognized again after 7 days. Based on linear mixed-effects modeling, it was found that playing the Angry Birds video game during a short learning break impaired long-term retrieval in auditory learning but enhanced long-term retrieval in visual learning compared with the music and rest conditions. These differential effects of video games on visual versus auditory learning suggest specific interference of common break activities on learning.}, language = {en} }