TY - JOUR A1 - Matuschek, Hannes A1 - Kliegl, Reinhold A1 - Vasishth, Shravan A1 - Baayen, Harald R. A1 - Bates, Douglas T1 - Balancing Type I error and power in linear mixed models JF - Journal of memory and language N2 - Linear mixed-effects models have increasingly replaced mixed-model analyses of variance for statistical inference in factorial psycholinguistic experiments. Although LMMs have many advantages over ANOVA, like ANOVAs, setting them up for data analysis also requires some care. One simple option, when numerically possible, is to fit the full variance covariance structure of random effects (the maximal model; Barr, Levy, Scheepers & Tily, 2013), presumably to keep Type I error down to the nominal a in the presence of random effects. Although it is true that fitting a model with only random intercepts may lead to higher Type I error, fitting a maximal model also has a cost: it can lead to a significant loss of power. We demonstrate this with simulations and suggest that for typical psychological and psycholinguistic data, higher power is achieved without inflating Type I error rate if a model selection criterion is used to select a random effect structure that is supported by the data. (C) 2017 The Authors. Published by Elsevier Inc. KW - Power KW - Linear mixed effect model KW - Hypothesis testing Y1 - 2017 U6 - https://doi.org/10.1016/j.jml.2017.01.001 SN - 0749-596X SN - 1096-0821 VL - 94 SP - 305 EP - 315 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Baayen, Harald R. A1 - Vasishth, Shravan A1 - Kliegl, Reinhold A1 - Bates, Douglas T1 - The cave of shadows: Addressing the human factor with generalized additive mixed models JF - Journal of memory and language KW - Generalized additive mixed models KW - Within-experiment adaptation KW - Autocorrelation KW - Experimental time series KW - Confirmatory versus exploratory data analysis KW - Model selection Y1 - 2017 U6 - https://doi.org/10.1016/j.jml.2016.11.006 SN - 0749-596X SN - 1096-0821 VL - 94 SP - 206 EP - 234 PB - Elsevier CY - San Diego ER -