Filtern
Dokumenttyp
- Wissenschaftlicher Artikel (3)
- Postprint (1)
- Arbeitspapier (1)
Sprache
- Englisch (5)
Gehört zur Bibliographie
- ja (5) (entfernen)
Schlagworte
- replication (5) (entfernen)
Atwood analyzes the effects of the 1963 U.S. measles vaccination on long-run labor market outcomes, using a generalized difference-in-differences approach. We reproduce the results of this paper and perform a battery of robustness checks. Overall, we confirm that the measles vaccination had positive labor market effects. While the negative effect on the likelihood of living in poverty and the positive effect on the probability of being employed are very robust across the different specifications, the headline estimate—the effect on earnings—is more sensitive to the exclusion of certain regions and survey years.
This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we uncover a high rate of fully computationally reproducible results (over 85%). Second, excluding minor issues like missing packages or broken pathways, we uncover coding errors for about 25% of studies, with some studies containing multiple errors. Third, we test the robustness of the results to 5,511 re-analyses. We find a robustness reproducibility of about 70%. Robustness reproducibility rates are relatively higher for re-analyses that introduce new data and lower for re-analyses that change the sample or the definition of the dependent variable. Fourth, 52% of re-analysis effect size estimates are smaller than the original published estimates and the average statistical significance of a re-analysis is 77% of the original. Lastly, we rely on six teams of researchers working independently to answer eight additional research questions on the determinants of robustness reproducibility. Most teams find a negative relationship between replicators' experience and reproducibility, while finding no relationship between reproducibility and the provision of intermediate or even raw data combined with the necessary cleaning codes.
The neurophysiological and behavioral correlates of action-related language processing have been debated for long time. A precursor in this field was the study by Buccino et al. (2005) combining transcranial magnetic stimulation (TMS) and behavioral measures (reaction times, RTs) to study the effect of listening to hand- and foot-related sentences. In the TMS experiment, the authors showed a decrease of motor evoked potentials (MEPs) recorded from hand muscles when processing hand-related verbs as compared to foot-related verbs. Similarly, MEPs recorded from leg muscles decreased when participants processed foot-related as compared to hand-related verbs. In the behavioral experiment, using the same stimuli and a semantic decision task the authors found slower RTs when the participants used the body effector (hand or foot) involved in the actual execution of the action expressed by the presented verb to give their motor responses. These findings were interpreted as an interference effect due to a simultaneous involvement of the motor system in both a language and a motor task. Our replication aimed to enlarge the sample size and replicate the findings with higher statistical power. The TMS experiment showed a significant modulation of hand MEPs, but in the sense of a motor facilitation when processing hand-related verbs. On the contrary, the behavioral experiment did not show significant results. The results are discussed within the general debate on the time-course of the modulation of motor cortex during implicit and explicit language processing and in relation to the studies on action observation/understanding.
The neurophysiological and behavioral correlates of action-related language processing have been debated for long time. A precursor in this field was the study by Buccino et al. (2005) combining transcranial magnetic stimulation (TMS) and behavioral measures (reaction times, RTs) to study the effect of listening to hand- and foot-related sentences. In the TMS experiment, the authors showed a decrease of motor evoked potentials (MEPs) recorded from hand muscles when processing hand-related verbs as compared to foot-related verbs. Similarly, MEPs recorded from leg muscles decreased when participants processed foot-related as compared to hand-related verbs. In the behavioral experiment, using the same stimuli and a semantic decision task the authors found slower RTs when the participants used the body effector (hand or foot) involved in the actual execution of the action expressed by the presented verb to give their motor responses. These findings were interpreted as an interference effect due to a simultaneous involvement of the motor system in both a language and a motor task. Our replication aimed to enlarge the sample size and replicate the findings with higher statistical power. The TMS experiment showed a significant modulation of hand MEPs, but in the sense of a motor facilitation when processing hand-related verbs. On the contrary, the behavioral experiment did not show significant results. The results are discussed within the general debate on the time-course of the modulation of motor cortex during implicit and explicit language processing and in relation to the studies on action observation/understanding.
Background: Population-specificity of exploratory dietary patterns limits their generalizability in investigations with type 2 diabetes incidence.
Objective: The aim of this study was to derive country-specific exploratory dietary patterns, investigate their association with type 2 diabetes incidence, and replicate diabetes-associated dietary patterns in other countries.
Methods: Dietary intake data were used, assessed by country-specific questionnaires at baseline of 11,183 incident diabetes cases and 14,694 subcohort members (mean age 52.9 y) from 8 countries, nested within the European Prospective Investigation into Cancer and Nutrition study (mean follow-up time 6.9 y). Exploratory dietary patterns were derived by principal component analysis. HRs for incident type 2 diabetes were calculated by Prentice-weighted Cox proportional hazard regression models. Diabetes-associated dietary patterns were simplified or replicated to be applicable in other countries. A meta-analysis across all countries evaluated the generalizability of the diabetes-association.
Results: Two dietary patterns per country/UK-center, of which overall 3 dietary patterns were diabetes-associated, were identified. A risk-lowering French dietary pattern was not confirmed across other countries: pooled HRFrance per 1 SD: 1.00; 95% CI: 0.90, 1.10. Risk-increasing dietary patterns, derived in Spain and UK-Norfolk, were confirmed, but only the latter statistically significantly: HRSpain: 1.09; 95% CI: 0.97, 1.22 and HRUK-Norfolk: 1.12; 95% CI: 1.04, 1.20. Respectively, this dietary pattern was characterized by relatively high intakes of potatoes, processed meat, vegetable oils, sugar, cake and cookies, and tea. Conclusions: Only few country/center-specific dietary patterns (3 of 18) were statistically significantly associated with diabetes incidence in this multicountry European study population. One pattern, whose association with diabetes was confirmed across other countries, showed overlaps in the food groups potatoes and processed meat with identified diabetes-associated dietary patterns from other studies. The study demonstrates that replication of associations of exploratory patterns with health outcomes is feasible and a necessary step to overcome population-specificity in associations from such analyses.