TY - JOUR A1 - Nicenboim, Bruno A1 - Vasishth, Shravan A1 - Engelmann, Felix A1 - Suckow, Katja T1 - Exploratory and confirmatory analyses in sentence processing BT - a case study of number interference in German JF - Cognitive science : a multidisciplinary journal of anthropology, artificial intelligence, education, linguistics, neuroscience, philosophy, psychology ; journal of the Cognitive Science Society N2 - Given the replication crisis in cognitive science, it is important to consider what researchers need to do in order to report results that are reliable. We consider three changes in current practice that have the potential to deliver more realistic and robust claims. First, the planned experiment should be divided into two stages, an exploratory stage and a confirmatory stage. This clear separation allows the researcher to check whether any results found in the exploratory stage are robust. The second change is to carry out adequately powered studies. We show that this is imperative if we want to obtain realistic estimates of effects in psycholinguistics. The third change is to use Bayesian data-analytic methods rather than frequentist ones; the Bayesian framework allows us to focus on the best estimates we can obtain of the effect, rather than rejecting a strawman null. As a case study, we investigate number interference effects in German. Number feature interference is predicted by cue-based retrieval models of sentence processing (Van Dyke & Lewis, 2003; Vasishth & Lewis, 2006), but it has shown inconsistent results. We show that by implementing the three changes mentioned, suggestive evidence emerges that is consistent with the predicted number interference effects. KW - Exploratory and confirmatory analyses KW - Sentence processing KW - Bayesian hierarchical modeling KW - Cue-based retrieval KW - Working memory KW - Similarity-based interference KW - Number interference KW - German Y1 - 2018 U6 - https://doi.org/10.1111/cogs.12589 SN - 0364-0213 SN - 1551-6709 VL - 42 SP - 1075 EP - 1100 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - Nicenboim, Bruno A1 - Roettger, Timo B. A1 - Vasishth, Shravan T1 - Using meta-analysis for evidence synthesis BT - the case of incomplete neutralization in German JF - Journal of phonetics N2 - Within quantitative phonetics, it is common practice to draw conclusions based on statistical significance alone Using incomplete neutralization of final devoicing in German as a case study, we illustrate the problems with this approach. If researchers find a significant acoustic difference between voiceless and devoiced obstruents, they conclude that neutralization is incomplete, and if they find no significant difference, they conclude that neutralization is complete. However, such strong claims regarding the existence or absence of an effect based on significant results alone can be misleading. Instead, the totality of available evidence should be brought to bear on the question. Towards this end, we synthesize the evidence from 14 studies on incomplete neutralization in German using a Bayesian random-effects meta-analysis. Our meta-analysis provides evidence in favor of incomplete neutralization. We conclude with some suggestions for improving the quality of future research on phonetic phenomena: ensure that sample sizes allow for high-precision estimates of the effect; avoid the temptation to deploy researcher degrees of freedom when analyzing data; focus on estimates of the parameter of interest and the uncertainty about that parameter; attempt to replicate effects found; and, whenever possible, make both the data and analysis available publicly. (c) 2018 Elsevier Ltd. All rights reserved. KW - Meta-analysis KW - Incomplete neutralization KW - Final devoicing KW - German KW - Bayesian data analysis Y1 - 2018 U6 - https://doi.org/10.1016/j.wocn.2018.06.001 SN - 0095-4470 VL - 70 SP - 39 EP - 55 PB - Elsevier CY - London ER - TY - JOUR A1 - Paape, Dario A1 - Vasishth, Shravan T1 - Local Coherence and Preemptive Digging-in Effects in German JF - Language and speech N2 - SOPARSE predicts so-called local coherence effects: locally plausible but globally impossible parses of substrings can exert a distracting influence during sentence processing. Additionally, it predicts digging-in effects: the longer the parser stays committed to a particular analysis, the harder it becomes to inhibit that analysis. We investigated the interaction of these two predictions using German sentences. Results from a self-paced reading study show that the processing difficulty caused by a local coherence can be reduced by first allowing the globally correct parse to become entrenched, which supports SOPARSE’s assumptions. KW - Local coherence KW - digging-in effects KW - self-paced reading KW - SOPARSE KW - sentence processing KW - German Y1 - 2016 U6 - https://doi.org/10.1177/0023830915608410 SN - 0023-8309 SN - 1756-6053 VL - 59 SP - 387 EP - 403 PB - Sage Publ. CY - London ER - TY - JOUR A1 - Jäger, Lena Ann A1 - Benz, Lena A1 - Roeser, Jens A1 - Dillon, Brian W. A1 - Vasishth, Shravan T1 - Teasing apart retrieval and encoding interference in the processing of anaphors JF - Frontiers in psychology N2 - Two classes of account have been proposed to explain the memory processes subserving the processing of reflexive-antecedent dependencies. Structure-based accounts assume that the retrieval of the antecedent is guided by syntactic tree-configurational information without considering other kinds of information such as gender marking in the case of English reflexives. By contrast, unconstrained cue-based retrieval assumes that all available information is used for retrieving the antecedent. Similarity-based interference effects from structurally illicit distractors which match a non-structural retrieval cue have been interpreted as evidence favoring the unconstrained cue-based retrieval account since cue-based retrieval interference from structurally illicit distractors is incompatible with the structure-based account. However, it has been argued that the observed effects do not necessarily reflect interference occurring at the moment of retrieval but might equally well be accounted for by interference occurring already at the stage of encoding or maintaining the antecedent in memory, in which case they cannot be taken as evidence against the structure-based account. We present three experiments (self-paced reading and eye-tracking) on German reflexives and Swedish reflexive and pronominal possessives in which we pit the predictions of encoding interference and cue-based retrieval interference against each other. We could not find any indication that encoding interference affects the processing ease of the reflexive-antecedent dependency formation. Thus, there is no evidence that encoding interference might be the explanation for the interference effects observed in previous work. We therefore conclude that invoking encoding interference may not be a plausible way to reconcile interference effects with a structure-based account of reflexive processing. KW - anaphors KW - reflexives KW - possessives KW - eye-tracking KW - German KW - Swedish KW - working-memory KW - interference Y1 - 2015 U6 - https://doi.org/10.3389/fpsyg.2015.00506 SN - 1664-1078 VL - 6 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Drenhaus, Heiner A1 - Zimmermann, Malte A1 - Vasishth, Shravan T1 - Exhaustiveness effects in clefts are not truth-functional JF - Journal of neurolinguistics : an international journal for the study of brain function in language behavior and experience N2 - While it is widely acknowledged in the formal semantic literature that both the truth-functional focus particle only and it-clefts convey exhaustiveness, the nature and source of exhaustiveness effects with it-clefts remain contested. We describe a questionnaire study (n = 80) and an event-related brain potentials (ERP) study (n = 16) that investigated the violation of exhaustiveness in German only-foci versus it-clefts. The offline study showed that a violation of exhaustivity with only is less acceptable than the violation with it-clefts, suggesting a difference in the nature of exhaustivity interpretation in the two environments. The ERP-results confirm that this difference can be seen in online processing as well: a violation of exhaustiveness in only-foci elicited a centro-posterior positivity (600-800ms), whereas a violation in it-clefts induced a globally distributed N400 pattern (400-600ms). The positivity can be interpreted as a reanalysis process and more generally as a process of context updating. The N400 effect in it-clefts is interpreted as indexing a cancelation process that is functionally distinct from the only case. The ERP study is, to our knowledge, the first evidence from an online experimental paradigm which shows that the violation of exhaustiveness involves different underlying processes in the two structural environments. KW - ERP KW - It- clefts KW - Only-foci KW - Information structure KW - German Y1 - 2011 U6 - https://doi.org/10.1016/j.jneuroling.2010.10.004 SN - 0911-6044 VL - 24 IS - 3 SP - 320 EP - 337 PB - Elsevier CY - Oxford ER - TY - JOUR A1 - Nicenboim, Bruno A1 - Logacev, Pavel A1 - Gattei, Carolina A1 - Vasishth, Shravan T1 - When High-Capacity Readers Slow Down and Low-Capacity Readers Speed Up BT - Working Memory and Locality Effects JF - Frontiers in psychology N2 - We examined the effects of argument-head distance in SVO and SOV languages (Spanish and German), while taking into account readers' working memory capacity and controlling for expectation (Levy, 2008) and other factors. We predicted only locality effects, that is, a slowdown produced by increased dependency distance (Gibson, 2000; Lewis and Vasishth, 2005). Furthermore, we expected stronger locality effects for readers with low working memory capacity. Contrary to our predictions, low-capacity readers showed faster reading with increased distance, while high-capacity readers showed locality effects. We suggest that while the locality effects are compatible with memory-based explanations, the speedup of low-capacity readers can be explained by an increased probability of retrieval failure. We present a computational model based on ACT-R built under the previous assumptions, which is able to give a qualitative account for the present data and can be tested in future research. Our results suggest that in some cases, interpreting longer RTs as indexing increased processing difficulty and shorter RTs as facilitation may be too simplistic: The same increase in processing difficulty may lead to slowdowns in high-capacity readers and speedups in low-capacity ones. Ignoring individual level capacity differences when investigating locality effects may lead to misleading conclusions. KW - locality KW - working memory capacity KW - individual differences KW - Spanish KW - German KW - ACT-R Y1 - 2016 U6 - https://doi.org/10.3389/fpsyg.2016.00280 SN - 1664-1078 VL - 7 SP - 1 EP - 24 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Jäger, Lena Ann A1 - Benz, Lena A1 - Roeser, Jens A1 - Dillon, Brian W. A1 - Vasishth, Shravan T1 - Teasing apart retrieval and encoding interference in the processing of anaphors JF - Frontiers in psychology N2 - Two classes of account have been proposed to explain the memory processes subserving the processing of reflexive-antecedent dependencies. Structure-based accounts assume that the retrieval of the antecedent is guided by syntactic tree-configurational information without considering other kinds of information such as gender marking in the case of English reflexives. By contrast, unconstrained cue-based retrieval assumes that all available information is used for retrieving the antecedent. Similarity-based interference effects from structurally illicit distractors which match a non-structural retrieval cue have been interpreted as evidence favoring the unconstrained cue-based retrieval account since cue-based retrieval interference from structurally illicit distractors is incompatible with the structure-based account. However, it has been argued that the observed effects do not necessarily reflect interference occurring at the moment of retrieval but might equally well be accounted for by interference occurring already at the stage of encoding or maintaining the antecedent in memory, in which case they cannot be taken as evidence against the structure-based account. We present three experiments (self-paced reading and eye-tracking) on German reflexives and Swedish reflexive and pronominal possessives in which we pit the predictions of encoding interference and cue-based retrieval interference against each other. We could not find any indication that encoding interference affects the processing ease of the reflexive-antecedent dependency formation. Thus, there is no evidence that encoding interference might be the explanation for the interference effects observed in previous work. We therefore conclude that invoking encoding interference may not be a plausible way to reconcile interference effects with a structure-based account of reflexive processing. KW - anaphors KW - reflexives KW - possessives KW - eye-tracking KW - German KW - Swedish KW - working-memory KW - interference Y1 - 2015 U6 - https://doi.org/10.3389/fpsyg.2015.00506 SN - 1664-1078 VL - 6 IS - 506 PB - Frontiers Research Foundation CY - Lausanne ER -