Balancing Type I error and power in linear mixed models
- Linear mixed-effects models have increasingly replaced mixed-model analyses of variance for statistical inference in factorial psycholinguistic experiments. Although LMMs have many advantages over ANOVA, like ANOVAs, setting them up for data analysis also requires some care. One simple option, when numerically possible, is to fit the full variance covariance structure of random effects (the maximal model; Barr, Levy, Scheepers & Tily, 2013), presumably to keep Type I error down to the nominal a in the presence of random effects. Although it is true that fitting a model with only random intercepts may lead to higher Type I error, fitting a maximal model also has a cost: it can lead to a significant loss of power. We demonstrate this with simulations and suggest that for typical psychological and psycholinguistic data, higher power is achieved without inflating Type I error rate if a model selection criterion is used to select a random effect structure that is supported by the data. (C) 2017 The Authors. Published by Elsevier Inc.
Verfasserangaben: | Hannes MatuschekORCiDGND, Reinhold KlieglORCiDGND, Shravan VasishthORCiDGND, Harald R. Baayen, Douglas Bates |
---|---|
DOI: | https://doi.org/10.1016/j.jml.2017.01.001 |
ISSN: | 0749-596X |
ISSN: | 1096-0821 |
Titel des übergeordneten Werks (Englisch): | Journal of memory and language |
Verlag: | Elsevier |
Verlagsort: | San Diego |
Publikationstyp: | Wissenschaftlicher Artikel |
Sprache: | Englisch |
Jahr der Erstveröffentlichung: | 2017 |
Erscheinungsjahr: | 2017 |
Datum der Freischaltung: | 20.04.2020 |
Freies Schlagwort / Tag: | Hypothesis testing; Linear mixed effect model; Power |
Band: | 94 |
Seitenanzahl: | 11 |
Erste Seite: | 305 |
Letzte Seite: | 315 |
Fördernde Institution: | Deutsche Forschungsgemeinschaft, the Research Group 868 Computational Modeling of Behavioral, Cognitive, and Neural Dynamics |
Organisationseinheiten: | Humanwissenschaftliche Fakultät / Strukturbereich Kognitionswissenschaften / Department Linguistik |
Peer Review: | Referiert |
Name der Einrichtung zum Zeitpunkt der Publikation: | Humanwissenschaftliche Fakultät / Institut für Linguistik / Allgemeine Sprachwissenschaft |