@techreport{BrodeurMikolaCooketal.2024, type = {Working Paper}, author = {Brodeur, Abel and Mikola, Derek and Cook, Nikolai and Brailey, Thomas and Briggs, Ryan and Gendre, Alexandra de and Dupraz, Yannick and Fiala, Lenka and Gabani, Jacopo and Gauriot, Romain and Haddad, Joanne and Lima, Goncalo and Ankel-Peters, J{\"o}rg and Dreber, Anna and Campbell, Douglas and Kattan, Lamis and Fages, Diego Marino and Mierisch, Fabian and Sun, Pu and Wright, Taylor and Connolly, Marie and Hoces de la Guardia, Fernando and Johannesson, Magnus and Miguel, Edward and Vilhuber, Lars and Abarca, Alejandro and Acharya, Mahesh and Adjisse, Sossou Simplice and Akhtar, Ahwaz and Lizardi, Eduardo Alberto Ramirez and Albrecht, Sabina and Andersen, Synve Nygaard and Andlib, Zubaria and Arrora, Falak and Ash, Thomas and Bacher, Etienne and Bachler, Sebastian and Bacon, F{\´e}lix and Bagues, Manuel and Balogh, Timea and Batmanov, Alisher and Barschkett, Mara and Basdil, B. Kaan and Dower, Jaromneda and Castek, Ondrej and Caviglia-Harris, Jill and Strand, Gabriella Chauca and Chen, Shi and Chzhen, Asya and Chung, Jong and Collins, Jason and Coppock, Alexander and Cordeau, Hugo and Couillard, Ben and Crechet, Jonathan and Crippa, Lorenzo and Cui, Jeanne and Czymara, Christian and Daarstad, Haley and Dao, Danh Chi and Dao, Dong and Schmandt, Marco David and Linde, Astrid de and Melo, Lucas De and Deer, Lachlan and Vera, Micole De and Dimitrova, Velichka and Dollbaum, Jan Fabian and Dollbaum, Jan Matti and Donnelly, Michael and Huynh, Luu Duc Toan and Dumbalska, Tsvetomira and Duncan, Jamie and Duong, Kiet Tuan and Duprey, Thibaut and Dworschak, Christoph and Ellingsrud, Sigmund and Elminejad, Ali and Eissa, Yasmine and Erhart, Andrea and Etingin-Frati, Giulian and Fatemi-Pour, Elaheh and Federice, Alexa and Feld, Jan and Fenig, Guidon and Firouzjaeiangalougah, Mojtaba and Fleisje, Erlend and Fortier-Chouinard, Alexandre and Engel, Julia Francesca and Fries, Tilman and Fortier, Reid and Fr{\´e}chet, Nadjim and Galipeau, Thomas and Gallegos, Sebasti{\´a}n and Gangji, Areez and Gao, Xiaoying and Garnache, Clo{\´e} and G{\´a}sp{\´a}r, Attila and Gavrilova, Evelina and Ghosh, Arijit and Gibney, Garreth and Gibson, Grant and Godager, Geir and Goff, Leonard and Gong, Da and Gonz{\´a}lez, Javier and Gretton, Jeremy and Griffa, Cristina and Grigoryeva, Idaliya and Grtting, Maja and Guntermann, Eric and Guo, Jiaqi and Gugushvili, Alexi and Habibnia, Hooman and H{\"a}ffner, Sonja and Hall, Jonathan D. and Hammar, Olle and Kordt, Amund Hanson and Hashimoto, Barry and Hartley, Jonathan S. and Hausladen, Carina I. and Havr{\´a}nek, Tom{\´a}š and Hazen, Jacob and He, Harry and Hepplewhite, Matthew and Herrera-Rodriguez, Mario and Heuer, Felix and Heyes, Anthony and Ho, Anson T. Y. and Holmes, Jonathan and Holzknecht, Armando and Hsu, Yu-Hsiang Dexter and Hu, Shiang-Hung and Huang, Yu-Shiuan and Huebener, Mathias and Huber, Christoph and Huynh, Kim P. and Irsova, Zuzana and Isler, Ozan and Jakobsson, Niklas and Frith, Michael James and Jananji, Rapha{\"e}l and Jayalath, Tharaka A. and Jetter, Michael and John, Jenny and Forshaw, Rachel Joy and Juan, Felipe and Kadriu, Valon and Karim, Sunny and Kelly, Edmund and Dang, Duy Khanh Hoang and Khushboo, Tazia and Kim, Jin and Kjellsson, Gustav and Kjelsrud, Anders and Kotsadam, Andreas and Korpershoek, Jori and Krashinsky, Lewis and Kundu, Suranjana and Kustov, Alexander and Lalayev, Nurlan and Langlois, Audr{\´e}e and Laufer, Jill and Lee-Whiting, Blake and Leibing, Andreas and Lenz, Gabriel and Levin, Joel and Li, Peng and Li, Tongzhe and Lin, Yuchen and Listo, Ariel and Liu, Dan and Lu, Xuewen and Lukmanova, Elvina and Luscombe, Alex and Lusher, Lester R. and Lyu, Ke and Ma, Hai and M{\"a}der, Nicolas and Makate, Clifton and Malmberg, Alice and Maitra, Adit and Mandas, Marco and Marcus, Jan and Margaryan, Shushanik and M{\´a}rk, Lili and Martignano, Andres and Marsh, Abigail and Masetto, Isabella and McCanny, Anthony and McManus, Emma and McWay, Ryan and Metson, Lennard and Kinge, Jonas Minet and Mishra, Sumit and Mohnen, Myra and M{\"o}ller, Jakob and Montambeault, Rosalie and Montpetit, S{\´e}bastien and Morin, Louis-Philippe and Morris, Todd and Moser, Scott and Motoki, Fabio and Muehlenbachs, Lucija and Musulan, Andreea and Musumeci, Marco and Nabin, Munirul and Nchare, Karim and Neubauer, Florian and Nguyen, Quan M. P. and Nguyen, Tuan and Nguyen-Tien, Viet and Niazi, Ali and Nikolaishvili, Giorgi and Nordstrom, Ardyn and N{\"u}, Patrick and Odermatt, Angela and Olson, Matt and ien, Henning and {\"O}lkers, Tim and Vert, Miquel Oliver i. and Oral, Emre and Oswald, Christian and Ousman, Ali and {\"O}zak, {\"O}mer and Pandey, Shubham and Pavlov, Alexandre and Pelli, Martino and Penheiro, Romeo and Park, RyuGyung and Martel, Eva P{\´e}rez and Petrovičov{\´a}, Tereza and Phan, Linh and Prettyman, Alexa and Proch{\´a}zka, Jakub and Putri, Aqila and Quandt, Julian and Qiu, Kangyu and Nguyen, Loan Quynh Thi and Rahman, Andaleeb and Rea, Carson H. and Reiremo, Adam and Ren{\´e}e, La{\"e}titia and Richardson, Joseph and Rivers, Nicholas and Rodrigues, Bruno and Roelofs, William and Roemer, Tobias and Rogeberg, Ole and Rose, Julian and Roskos-Ewoldsen, Andrew and Rosmer, Paul and Sabada, Barbara and Saberian, Soodeh and Salamanca, Nicolas and Sator, Georg and Sawyer, Antoine and Scates, Daniel and Schl{\"u}ter, Elmar and Sells, Cameron and Sen, Sharmi and Sethi, Ritika and Shcherbiak, Anna and Sogaolu, Moyosore and Soosalu, Matt and Srensen, Erik and Sovani, Manali and Spencer, Noah and Staubli, Stefan and Stans, Renske and Stewart, Anya and Stips, Felix and Stockley, Kieran and Strobel, Stephenson and Struby, Ethan and Tang, John and Tanrisever, Idil and Yang, Thomas Tao and Tastan, Ipek and Tatić, Dejan and Tatlow, Benjamin and Seuyong, F{\´e}raud Tchuisseu and Th{\´e}riault, R{\´e}mi and Thivierge, Vincent and Tian, Wenjie and Toma, Filip-Mihai and Totarelli, Maddalena and Tran, Van-Anh and Truong, Hung and Tsoy, Nikita and Tuzcuoglu, Kerem and Ubfal, Diego and Villalobos, Laura and Walterskirchen, Julian and Wang, Joseph Taoyi and Wattal, Vasudha and Webb, Matthew D. and Weber, Bryan and Weisser, Reinhard and Weng, Wei-Chien and Westheide, Christian and White, Kimberly and Winter, Jacob and Wochner, Timo and Woerman, Matt and Wong, Jared and Woodard, Ritchie and Wroński, Marcin and Yazbeck, Myra and Yang, Gustav Chung and Yap, Luther and Yassin, Kareman and Ye, Hao and Yoon, Jin Young and Yurris, Chris and Zahra, Tahreen and Zaneva, Mirela and Zayat, Aline and Zhang, Jonathan and Zhao, Ziwei and Yaolang, Zhong}, title = {Mass reproducibility and replicability}, series = {I4R discussion paper series}, journal = {I4R discussion paper series}, number = {107}, publisher = {Institute for Replication}, address = {Essen}, issn = {2752-1931}, pages = {250}, year = {2024}, abstract = {This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we uncover a high rate of fully computationally reproducible results (over 85\%). Second, excluding minor issues like missing packages or broken pathways, we uncover coding errors for about 25\% of studies, with some studies containing multiple errors. Third, we test the robustness of the results to 5,511 re-analyses. We find a robustness reproducibility of about 70\%. Robustness reproducibility rates are relatively higher for re-analyses that introduce new data and lower for re-analyses that change the sample or the definition of the dependent variable. Fourth, 52\% of re-analysis effect size estimates are smaller than the original published estimates and the average statistical significance of a re-analysis is 77\% of the original. Lastly, we rely on six teams of researchers working independently to answer eight additional research questions on the determinants of robustness reproducibility. Most teams find a negative relationship between replicators' experience and reproducibility, while finding no relationship between reproducibility and the provision of intermediate or even raw data combined with the necessary cleaning codes.}, language = {en} } @article{AbdallaAharonianAitBenkhalietal.2018, author = {Abdalla, Hassan E. and Aharonian, Felix A. and Ait Benkhali, Faical and Ang{\"u}ner, Ekrem Oǧuzhan and Arakawa, M. and Arcaro, C. and Armand, C. and Arrieta, M. and Backes, Michael and Barnard, M. and Becherini, Yvonne and Tjus, J. Becker and Berge, D. and Bernhard, S. and Bernl{\"o}hr, Konrad and Blackwell, R. and B{\"o}ttcher, Markus and Boisson, C. and Bolmont, Julien and Bonnefoy, S. and Bordas, Pol and Bregeon, J. and Brun, F. and Brun, P. and Bryan, M. and B{\"u}chele, M. and Bulik, Tomasz and Bylund, Tomas and Capasso, Massimo and Caroff, S. and Carosi, A. and Casanova, Sabrina and Cerruti, Matteo and Chakraborty, Nachiketa and Chandra, S. and Chaves, R. C. G. and Chen, A. and Colafrancesco, Sergio and Condon, B. and Davids, Isak and Deil, Christoph and Devin, J. and deWilt, P. and Dirson, L. and Djannati-Atai, A. and Dmytriiev, A. and Donath, Axel and Doroshenko, Victor and Dyks, J. and Egberts, Kathrin and Emery, G. and Ernenwein, J. -P. and Eschbach, Stefan and Fegan, S. and Fiasson, Armand and Fontaine, G. and Funk, Sebastian and F{\"u}ßling, Matthias and Gabici, S. and Gallant, Y. A. and Gate, F. and Giavitto, Gianluca and Eisenacher Glawion, Dorit and Glicenstein, Jean-Fran{\c{c}}ois and Gottschall, D. and Grondin, Marie-H{\´e}l{\`e}ne and Hahn, J. and Haupt, M. and Heinzelmann, G. and Henri, Gilles and Hermann, G. and Hinton, James Anthony and Hofmann, Werner and Hoischen, Clemens and Holch, Tim Lukas and Holler, M. and Horns, D. and Huber, D. and Iwasaki, H. and Jacholkowska, A. and Jamrozy, M. and Jankowsky, David and Jankowsky, Felix and Jouvin, L. and Jung-Richardt, I. and Kastendieck, M. A. and Katarzyński, Krzysztof and Katsuragawa, M. and Katz, U. and Kerszberg, D. and Khangulyan, D. and Khelifi, B. and King, J. and Klepser, S. and Kluzniak, W. and Komin, Nu. and Kosack, K. and Krakau, S. and Kraus, M. and Kruger, P. P. and Lamanna, G. and Lau, J. and Lefaucheur, J. and Lemiere, A. and Lemoine-Goumard, M. and Lenain, J. -P. and Leser, Eva and Lohse, T. and Lorentz, M. and Lopez-Coto, R. and Lypova, I. and Malyshev, D. and Marandon, V. and Marcowith, Alexandre and Mariaud, C. and Marti-Devesa, G. and Marx, R. and Maurin, G. and Meintjes, P. J. and Mitchell, A. M. W. and Moderski, R. and Mohamed, M. and Mohrmann, L. and Moulin, Emmanuel and Murach, T. and Nakashima, S. and de Naurois, M. and Ndiyavala, H. and Niederwanger, F. and Niemiec, J. and Oakes, L. and Odaka, H. and Ohm, S. and Ostrowski, M. and Oya, I. and Padovani, M. and Panter, M. and Parsons, R. D. and Perennes, C. and Petrucci, P. -O. and Peyaud, B. and Piel, Q. and Pita, S. and Poireau, V. and Noel, A. Priyana and Prokhorov, D. A. and Prokoph, H. and Puehlhofer, G. and Punch, M. and Quirrenbach, A. and Raab, S. and Rauth, R. and Reimer, A. and Reimer, O. and Renaud, M. and Rieger, F. and Rinchiuso, L. and Romoli, C. and Rowell, G. and Rudak, B. and Ruiz-Velasco, E. and Sahakian, V. and Saito, S. and Sanchez, D. A. and Santangelo, Andrea and Sasaki, M. and Schlickeiser, R. and Schussler, F. and Schulz, A. and Schwanke, U. and Schwemmer, S. and Seglar-Arroyo, M. and Senniappan, M. and Seyffert, A. S. and Shafi, N. and Shilon, I. and Shiningayamwe, K. and Simoni, R. and Sinha, A. and Sol, H. and Spanier, F. and Specovius, A. and Spir-Jacob, M. and Stawarz, L. and Steenkamp, R. and Stegmann, Christian and Steppa, Constantin Beverly and Takahashi, T. and Tavernet, J. -P. and Tavernier, T. and Taylor, A. M. and Terrier, R. and Tibaldo, L. and Tiziani, D. and Tluczykont, M. and Trichard, C. and Tsirou, M. and Tsuji, N. and Tuffs, R. and Uchiyama, Y. and van der Walt, D. J. and van Eldik, C. and van Rensburg, C. and van Soelen, B. and Vasileiadis, G. and Veh, J. and Venter, C. and Viana, A. and Vincent, P. and Vink, J. and Voisin, F. and Voelk, H. J. and Vuillaume, T. and Wadiasingh, Z. and Wagner, S. J. and Wagner, R. M. and White, R. and Wierzcholska, A. and Yang, R. and Zaborov, D. and Zacharias, M. and Zanin, R. and Zdziarski, A. and Zech, Alraune and Zefi, F. and Ziegler, A. and Zorn, J. and Zywucka, N. and Cirelli, M. and Panci, P. and Sala, F. and Silk, J. and Taoso, M.}, title = {Searches for gamma-ray lines and 'pure WIMP' spectra from Dark Matter annihilations in dwarf galaxies with H.E.S.S.}, series = {Journal of cosmology and astroparticle physics}, journal = {Journal of cosmology and astroparticle physics}, number = {11}, publisher = {IOP Publishing Ltd. (Bristol)}, address = {Bristol}, organization = {HESS Collaboration}, issn = {1475-7516}, doi = {10.1088/1475-7516/2018/11/037}, pages = {22}, year = {2018}, abstract = {Dwarf spheroidal galaxies are among the most promising targets for detecting signals of Dark Matter (DM) annihilations. The H.E.S.S. experiment has observed five of these systems for a total of about 130 hours. The data are re-analyzed here, and, in the absence of any detected signals, are interpreted in terms of limits on the DM annihilation cross section. Two scenarios are considered: i) DM annihilation into mono-energetic gamma-rays and ii) DM in the form of pure WIMP multiplets that, annihilating into all electroweak bosons, produce a distinctive gamma-ray spectral shape with a high-energy peak at the DM mass and a lower-energy continuum. For case i), upper limits at 95\% confidence level of about less than or similar to 3 x 10(-25) cm(3) s(-1) are obtained in the mass range of 400 GeV to 1TeV. For case ii), the full spectral shape of the models is used and several excluded regions are identified, but the thermal masses of the candidates are not robustly ruled out.}, language = {en} }