TY - JOUR A1 - Matuschek, Hannes A1 - Kliegl, Reinhold A1 - Vasishth, Shravan A1 - Baayen, Harald R. A1 - Bates, Douglas T1 - Balancing Type I error and power in linear mixed models JF - Journal of memory and language N2 - Linear mixed-effects models have increasingly replaced mixed-model analyses of variance for statistical inference in factorial psycholinguistic experiments. Although LMMs have many advantages over ANOVA, like ANOVAs, setting them up for data analysis also requires some care. One simple option, when numerically possible, is to fit the full variance covariance structure of random effects (the maximal model; Barr, Levy, Scheepers & Tily, 2013), presumably to keep Type I error down to the nominal a in the presence of random effects. Although it is true that fitting a model with only random intercepts may lead to higher Type I error, fitting a maximal model also has a cost: it can lead to a significant loss of power. We demonstrate this with simulations and suggest that for typical psychological and psycholinguistic data, higher power is achieved without inflating Type I error rate if a model selection criterion is used to select a random effect structure that is supported by the data. (C) 2017 The Authors. Published by Elsevier Inc. KW - Power KW - Linear mixed effect model KW - Hypothesis testing Y1 - 2017 U6 - https://doi.org/10.1016/j.jml.2017.01.001 SN - 0749-596X SN - 1096-0821 VL - 94 SP - 305 EP - 315 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Tetzner, Julia A1 - Kliegl, Reinhold A1 - Krahé, Barbara A1 - Busching, Robert A1 - Esser, Günter T1 - Developmental problems in adolescence BT - a person-centered analysis across time and domains JF - Journal of Applied Developmental Psychology N2 - This longitudinal study investigated patterns of developmental problems across depression, aggression, and academic achievement during adolescence, using two measurement points two years apart (N = 1665; age T1: M = 13.14; female = 49.6%). Latent Profile Analyses and Latent Transition Analyses yielded four main findings: A three-type solution provided the best fit to the data: an asymptomatic type (i.e., low problem scores in all three domains), a depressed type (i.e., high scores in depression), an aggressive type (i.e., high scores in aggression). Profile types were invariant over the two data waves but differed between girls and boys, revealing gender specific patterns of comorbidity. Stabilities over time were high for the asymptomatic type and for types that represented problems in one domain, but moderate for comorbid types. Differences in demographic variables (i.e., age, socio-economic status) and individual characteristics (i.e., self-esteem, dysfunctional cognitions, cognitive capabilities) predicted profile type memberships and longitudinal transitions between types. KW - Adolescence KW - Person-centered approach KW - Depression KW - Aggression KW - Academic achievement Y1 - 2017 U6 - https://doi.org/10.1016/j.appdev.2017.08.003 SN - 0193-3973 SN - 1873-7900 VL - 53 SP - 40 EP - 53 PB - Elsevier CY - New York ER - TY - JOUR A1 - Hohenstein, Sven A1 - Matuschek, Hannes A1 - Kliegl, Reinhold T1 - Linked linear mixed models: A joint analysis of fixation locations and fixation durations in natural reading JF - Psychonomic bulletin & review : a journal of the Psychonomic Society N2 - The complexity of eye-movement control during reading allows measurement of many dependent variables, the most prominent ones being fixation durations and their locations in words. In current practice, either variable may serve as dependent variable or covariate for the other in linear mixed models (LMMs) featuring also psycholinguistic covariates of word recognition and sentence comprehension. Rather than analyzing fixation location and duration with separate LMMs, we propose linking the two according to their sequential dependency. Specifically, we include predicted fixation location (estimated in the first LMM from psycholinguistic covariates) and its associated residual fixation location as covariates in the second, fixation-duration LMM. This linked LMM affords a distinction between direct and indirect effects (mediated through fixation location) of psycholinguistic covariates on fixation durations. Results confirm the robustness of distributed processing in the perceptual span. They also offer a resolution of the paradox of the inverted optimal viewing position (IOVP) effect (i.e., longer fixation durations in the center than at the beginning and end of words) although the opposite (i.e., an OVP effect) is predicted from default assumptions of psycholinguistic processing efficiency: The IOVP effect in fixation durations is due to the residual fixation-location covariate, presumably driven primarily by saccadic error, and the OVP effect (at least the left part of it) is uncovered with the predicted fixation-location covariate, capturing the indirect effects of psycholinguistic covariates. We expect that linked LMMs will be useful for the analysis of other dynamically related multiple outcomes, a conundrum of most psychonomic research. KW - Linear mixed model KW - Model linkage KW - Eye movements KW - Reading Y1 - 2017 U6 - https://doi.org/10.3758/s13423-016-1138-y SN - 1069-9384 SN - 1531-5320 VL - 24 SP - 637 EP - 651 PB - Springer CY - New York ER - TY - JOUR A1 - Masson, Michael E. J. A1 - Rabe, Maximilian M. A1 - Kliegl, Reinhold T1 - Modulation of additive and interactive effects by trial history revisited JF - Memory & cognition KW - Additive and interactive effects KW - Effects of trial history KW - Lexical decision KW - Data transformation KW - Linear mixed models Y1 - 2017 U6 - https://doi.org/10.3758/s13421-016-0666-z SN - 0090-502X SN - 1532-5946 VL - 45 SP - 480 EP - 492 PB - Springer CY - New York ER - TY - JOUR A1 - Matuschek, Hannes A1 - Kliegl, Reinhold T1 - On the ambiguity of interaction and nonlinear main effects in a regime of dependent covariates JF - Behavior research methods : a journal of the Psychonomic Society N2 - The analysis of large experimental datasets frequently reveals significant interactions that are difficult to interpret within the theoretical framework guiding the research. Some of these interactions actually arise from the presence of unspecified nonlinear main effects and statistically dependent covariates in the statistical model. Importantly, such nonlinear main effects may be compatible (or, at least, not incompatible) with the current theoretical framework. In the present literature, this issue has only been studied in terms of correlated (linearly dependent) covariates. Here we generalize to nonlinear main effects (i.e., main effects of arbitrary shape) and dependent covariates. We propose a novel nonparametric method to test for ambiguous interactions where present parametric methods fail. We illustrate the method with a set of simulations and with reanalyses (a) of effects of parental education on their children’s educational expectations and (b) of effects of word properties on fixation locations during reading of natural sentences, specifically of effects of length and morphological complexity of the word to be fixated next. The resolution of such ambiguities facilitates theoretical progress. KW - Interaction effects KW - Mixed models KW - Additive mixed models KW - Regression splines KW - Non-parametric curve estimation Y1 - 2017 U6 - https://doi.org/10.3758/s13428-017-0956-9 SN - 1554-351X SN - 1554-3528 VL - 50 IS - 5 SP - 1882 EP - 1894 PB - Springer CY - New York ER - TY - JOUR A1 - Baayen, Harald R. A1 - Vasishth, Shravan A1 - Kliegl, Reinhold A1 - Bates, Douglas T1 - The cave of shadows: Addressing the human factor with generalized additive mixed models JF - Journal of memory and language KW - Generalized additive mixed models KW - Within-experiment adaptation KW - Autocorrelation KW - Experimental time series KW - Confirmatory versus exploratory data analysis KW - Model selection Y1 - 2017 U6 - https://doi.org/10.1016/j.jml.2016.11.006 SN - 0749-596X SN - 1096-0821 VL - 94 SP - 206 EP - 234 PB - Elsevier CY - San Diego ER -