TY  - JOUR
A1  - Vasishth, Shravan
A1  - Nicenboim, Bruno
T1  - Statistical Methods for Linguistic Research: Foundational Ideas - Part I
T2  - Language and linguistics compass
N2  - We present the fundamental ideas underlying statistical hypothesis testing using the frequentist framework. We start with a simple example that builds up the one-sample t-test from the beginning, explaining important concepts such as the sampling distribution of the sample mean, and the iid assumption. Then, we examine the meaning of the p-value in detail and discuss several important misconceptions about what a p-value does and does not tell us. This leads to a discussion of Type I, II error and power, and Type S and M error. An important conclusion from this discussion is that one should aim to carry out appropriately powered studies. Next, we discuss two common issues that we have encountered in psycholinguistics and linguistics: running experiments until significance is reached and the ‘garden-of-forking-paths’ problem discussed by Gelman and others. The best way to use frequentist methods is to run appropriately powered studies, check model assumptions, clearly separate exploratory data analysis from planned comparisons decided upon before the study was run, and always attempt to replicate results.
Y1  - 2016
UR  - https://publishup.uni-potsdam.de/frontdoor/index/index/docId/45108
SN  - 1749-818X
VL  - 10
SP  - 349
EP  - 369
PB  - Wiley-Blackwell
CY  - Hoboken
ER  -