Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
Gilbert et al. conclude that evidence from the Open Science Collaboration’s Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.
The bimolecular recombination characteristics of conjugated polymer poly[(4,4'-bis(2-ethylhexyl)dithieno[3,2-b:2',3'-d]silole)-2,6-diyl-alt-(2,5-bis 3-tetradecylthiophen-2-y1 thiazolo 5,4-d thiazole)-2,5diy1] (PDTSiTTz) blended with the fullerene series PC60BM, ICMA, ICBA, and ICTA have been investigated using microsecond and femtosecond transient absorption spectroscopy, in conjunction with electroluminescence measurements and ambient photoemission spectroscopy. The non-Langevin polymer PDTSiTTz allows an inspection of intrinsic bimolecular recombination rates uninhibited by diffusion, while the low oscillator strengths of fullerenes allow polymer features to dominate, and we compare our results to those of the well-known polymer Si-PCPDTBT. Using mu s-TAS, we have shown that the trap -limited decay dynamics of the PDTSiTTz polaron becomes progressively slower across the fullerene series, while those of Si-PCPDTBT are invariant. Electroluminescence measurements showed an unusual double peak in pristine PDTSiTTz, attributed to a low energy intragap charge transfer state, likely interchain in nature. Furthermore, while the pristine PDTSiTTz showed a broad, low-intensity density of states, the ICBA and ICTA blends presented a virtually identical DOS to Si-PCPDTBT and its blends. This has been attributed to a shift from a delocalized, interchain highest occupied molecular orbital (HOMO) in the pristine material to a dithienosilole-centered HOMO in the blends, likely a result of the bulky fullerenes increasing interchain separation. This HOMO localization had a side effect of progressively shifting the polymer HOMO to shallower energies, which was correlated with the observed decrease in bimolecular recombination rate and increased "trap" depth. However, since the density of tail states remained the same, this suggests that the traditional viewpoint of "trapping" being dominated by tail states may not encompass the full picture and that the breadth of the DOS may also have a strong influence on bimolecular recombination.