Filtern
Volltext vorhanden
- nein (2)
Erscheinungsjahr
- 2011 (2) (entfernen)
Dokumenttyp
Sprache
- Englisch (2)
Gehört zur Bibliographie
- ja (2)
Schlagworte
- Bayesian inference (1)
- Bundesliga (1)
- Decision-making (1)
- biased decisions (1)
- posterior statistical power (1)
- probability of replication (1)
- random-effects model (1)
- sports statistics (1)
- statistical estimation (1)
Institut
Aggregate and individual replication probability within an explicit model of the research process
(2011)
We study a model of the research process in which the true effect size, the replication jitter due to changes in experimental procedure, and the statistical error of effect size measurement are all normally distributed random variables. Within this model, we analyze the probability of successfully replicating an initial experimental result by obtaining either a statistically significant result in the same direction or any effect in that direction. We analyze both the probability of successfully replicating a particular experimental effect (i.e., the individual replication probability) and the average probability of successful replication across different studies within some research context (i.e., the aggregate replication probability), and we identify the conditions under which the latter can be approximated using the formulas of Killeen (2005a, 2007). We show how both of these probabilities depend on parameters of the research context that would rarely be known in practice. In addition, we show that the statistical uncertainty associated with the size of an initial observed effect would often prevent accurate estimation of the desired individual replication probability even if these research context parameters were known exactly. We conclude that accurate estimates of replication probability are generally unattainable.
Using a large representative database (12,902 matches from the top professional football league in Germany), I show that the number (441) of two-penalty matches is larger than expected by chance, and that among these 441 matches there are considerably more matches in which each team is awarded one penalty than would be expected on the basis of independent penalty kick decisions (odds ratio=11.2, relative risk=6.34). Additional analyses based on the score in the match before a penalty is awarded and on the timing of penalties, suggest that awarding a first penalty to one team raises the referee's penalty evidence criterion for the same team, and lowers the corresponding criterion for the other team.