TY - JOUR A1 - Aarts, Alexander A. A1 - Anderson, Joanna E. A1 - Anderson, Christopher J. A1 - Attridge, Peter R. A1 - Attwood, Angela A1 - Axt, Jordan A1 - Babel, Molly A1 - Bahnik, Stepan A1 - Baranski, Erica A1 - Barnett-Cowan, Michael A1 - Bartmess, Elizabeth A1 - Beer, Jennifer A1 - Bell, Raoul A1 - Bentley, Heather A1 - Beyan, Leah A1 - Binion, Grace A1 - Borsboom, Denny A1 - Bosch, Annick A1 - Bosco, Frank A. A1 - Bowman, Sara D. A1 - Brandt, Mark J. A1 - Braswell, Erin A1 - Brohmer, Hilmar A1 - Brown, Benjamin T. A1 - Brown, Kristina A1 - Bruening, Jovita A1 - Calhoun-Sauls, Ann A1 - Callahan, Shannon P. A1 - Chagnon, Elizabeth A1 - Chandler, Jesse A1 - Chartier, Christopher R. A1 - Cheung, Felix A1 - Christopherson, Cody D. A1 - Cillessen, Linda A1 - Clay, Russ A1 - Cleary, Hayley A1 - Cloud, Mark D. A1 - Cohn, Michael A1 - Cohoon, Johanna A1 - Columbus, Simon A1 - Cordes, Andreas A1 - Costantini, Giulio A1 - Alvarez, Leslie D. Cramblet A1 - Cremata, Ed A1 - Crusius, Jan A1 - DeCoster, Jamie A1 - DeGaetano, Michelle A. A1 - Della Penna, Nicolas A1 - den Bezemer, Bobby A1 - Deserno, Marie K. A1 - Devitt, Olivia A1 - Dewitte, Laura A1 - Dobolyi, David G. A1 - Dodson, Geneva T. A1 - Donnellan, M. Brent A1 - Donohue, Ryan A1 - Dore, Rebecca A. A1 - Dorrough, Angela A1 - Dreber, Anna A1 - Dugas, Michelle A1 - Dunn, Elizabeth W. A1 - Easey, Kayleigh A1 - Eboigbe, Sylvia A1 - Eggleston, Casey A1 - Embley, Jo A1 - Epskamp, Sacha A1 - Errington, Timothy M. A1 - Estel, Vivien A1 - Farach, Frank J. A1 - Feather, Jenelle A1 - Fedor, Anna A1 - Fernandez-Castilla, Belen A1 - Fiedler, Susann A1 - Field, James G. A1 - Fitneva, Stanka A. A1 - Flagan, Taru A1 - Forest, Amanda L. A1 - Forsell, Eskil A1 - Foster, Joshua D. A1 - Frank, Michael C. A1 - Frazier, Rebecca S. A1 - Fuchs, Heather A1 - Gable, Philip A1 - Galak, Jeff A1 - Galliani, Elisa Maria A1 - Gampa, Anup A1 - Garcia, Sara A1 - Gazarian, Douglas A1 - Gilbert, Elizabeth A1 - Giner-Sorolla, Roger A1 - Glöckner, Andreas A1 - Göllner, Lars A1 - Goh, Jin X. A1 - Goldberg, Rebecca A1 - Goodbourn, Patrick T. A1 - Gordon-McKeon, Shauna A1 - Gorges, Bryan A1 - Gorges, Jessie A1 - Goss, Justin A1 - Graham, Jesse A1 - Grange, James A. A1 - Gray, Jeremy A1 - Hartgerink, Chris A1 - Hartshorne, Joshua A1 - Hasselman, Fred A1 - Hayes, Timothy A1 - Heikensten, Emma A1 - Henninger, Felix A1 - Hodsoll, John A1 - Holubar, Taylor A1 - Hoogendoorn, Gea A1 - Humphries, Denise J. A1 - Hung, Cathy O. -Y. A1 - Immelman, Nathali A1 - Irsik, Vanessa C. A1 - Jahn, Georg A1 - Jaekel, Frank A1 - Jekel, Marc A1 - Johannesson, Magnus A1 - Johnson, Larissa G. A1 - Johnson, David J. A1 - Johnson, Kate M. A1 - Johnston, William J. A1 - Jonas, Kai A1 - Joy-Gaba, Jennifer A. A1 - Kappes, Heather Barry A1 - Kelso, Kim A1 - Kidwell, Mallory C. A1 - Kim, Seung Kyung A1 - Kirkhart, Matthew A1 - Kleinberg, Bennett A1 - Knezevic, Goran A1 - Kolorz, Franziska Maria A1 - Kossakowski, Jolanda J. A1 - Krause, Robert Wilhelm A1 - Krijnen, Job A1 - Kuhlmann, Tim A1 - Kunkels, Yoram K. A1 - Kyc, Megan M. A1 - Lai, Calvin K. A1 - Laique, Aamir A1 - Lakens, Daniel A1 - Lane, Kristin A. A1 - Lassetter, Bethany A1 - Lazarevic, Ljiljana B. A1 - LeBel, Etienne P. A1 - Lee, Key Jung A1 - Lee, Minha A1 - Lemm, Kristi A1 - Levitan, Carmel A. A1 - Lewis, Melissa A1 - Lin, Lin A1 - Lin, Stephanie A1 - Lippold, Matthias A1 - Loureiro, Darren A1 - Luteijn, Ilse A1 - Mackinnon, Sean A1 - Mainard, Heather N. A1 - Marigold, Denise C. A1 - Martin, Daniel P. A1 - Martinez, Tylar A1 - Masicampo, E. J. A1 - Matacotta, Josh A1 - Mathur, Maya A1 - May, Michael A1 - Mechin, Nicole A1 - Mehta, Pranjal A1 - Meixner, Johannes A1 - Melinger, Alissa A1 - Miller, Jeremy K. A1 - Miller, Mallorie A1 - Moore, Katherine A1 - Möschl, Marcus A1 - Motyl, Matt A1 - Müller, Stephanie M. A1 - Munafo, Marcus A1 - Neijenhuijs, Koen I. A1 - Nervi, Taylor A1 - Nicolas, Gandalf A1 - Nilsonne, Gustav A1 - Nosek, Brian A. A1 - Nuijten, Michele B. A1 - Olsson, Catherine A1 - Osborne, Colleen A1 - Ostkamp, Lutz A1 - Pavel, Misha A1 - Penton-Voak, Ian S. A1 - Perna, Olivia A1 - Pernet, Cyril A1 - Perugini, Marco A1 - Pipitone, R. Nathan A1 - Pitts, Michael A1 - Plessow, Franziska A1 - Prenoveau, Jason M. A1 - Rahal, Rima-Maria A1 - Ratliff, Kate A. A1 - Reinhard, David A1 - Renkewitz, Frank A1 - Ricker, Ashley A. A1 - Rigney, Anastasia A1 - Rivers, Andrew M. A1 - Roebke, Mark A1 - Rutchick, Abraham M. A1 - Ryan, Robert S. A1 - Sahin, Onur A1 - Saide, Anondah A1 - Sandstrom, Gillian M. A1 - Santos, David A1 - Saxe, Rebecca A1 - Schlegelmilch, Rene A1 - Schmidt, Kathleen A1 - Scholz, Sabine A1 - Seibel, Larissa A1 - Selterman, Dylan Faulkner A1 - Shaki, Samuel A1 - Simpson, William B. A1 - Sinclair, H. Colleen A1 - Skorinko, Jeanine L. M. A1 - Slowik, Agnieszka A1 - Snyder, Joel S. A1 - Soderberg, Courtney A1 - Sonnleitner, Carina A1 - Spencer, Nick A1 - Spies, Jeffrey R. A1 - Steegen, Sara A1 - Stieger, Stefan A1 - Strohminger, Nina A1 - Sullivan, Gavin B. A1 - Talhelm, Thomas A1 - Tapia, Megan A1 - te Dorsthorst, Anniek A1 - Thomae, Manuela A1 - Thomas, Sarah L. A1 - Tio, Pia A1 - Traets, Frits A1 - Tsang, Steve A1 - Tuerlinckx, Francis A1 - Turchan, Paul A1 - Valasek, Milan A1 - Van Aert, Robbie A1 - van Assen, Marcel A1 - van Bork, Riet A1 - van de Ven, Mathijs A1 - van den Bergh, Don A1 - van der Hulst, Marije A1 - van Dooren, Roel A1 - van Doorn, Johnny A1 - van Renswoude, Daan R. A1 - van Rijn, Hedderik A1 - Vanpaemel, Wolf A1 - Echeverria, Alejandro Vasquez A1 - Vazquez, Melissa A1 - Velez, Natalia A1 - Vermue, Marieke A1 - Verschoor, Mark A1 - Vianello, Michelangelo A1 - Voracek, Martin A1 - Vuu, Gina A1 - Wagenmakers, Eric-Jan A1 - Weerdmeester, Joanneke A1 - Welsh, Ashlee A1 - Westgate, Erin C. A1 - Wissink, Joeri A1 - Wood, Michael A1 - Woods, Andy A1 - Wright, Emily A1 - Wu, Sining A1 - Zeelenberg, Marcel A1 - Zuni, Kellylynn T1 - Estimating the reproducibility of psychological science JF - Science N2 - Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered designs and original materials when available. Replication effects were half the magnitude of original effects, representing a substantial decline. Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results; 47% of original effect sizes were in the 95% confidence interval of the replication effect size; 39% of effects were subjectively rated to have replicated the original result; and if no bias in original results is assumed, combining original and replication results left 68% with statistically significant effects. Correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams. Y1 - 2015 U6 - https://doi.org/10.1126/science.aac4716 SN - 1095-9203 SN - 0036-8075 VL - 349 IS - 6251 PB - American Assoc. for the Advancement of Science CY - Washington ER - TY - JOUR A1 - Miller, Jeff A1 - Schwarz, Wolfgang T1 - Implications of Individual Differences in On-Average Null Effects JF - Journal of experimental psychology : General N2 - Most psychological models are intended to describe processes that operate within each individual. In many research areas, however, models are tested by looking at results averaged across many individuals, despite the fact that such averaged results may give a misleading picture of what is true for each one. We consider this conundrum with respect to the interpretation of on-average null effects. Specifically, even though an experimental manipulation might have no effect on average across individuals, it might still have demonstrable effects-albeit in opposite directions-for many or all of the individuals tested. We discuss several examples of research questions for which it would be theoretically crucial to determine whether manipulations really have no effect at the individual level, and we present a method of testing for individual-level effects. KW - null effects KW - individual differences KW - hypothesis testing KW - psychological models Y1 - 2018 U6 - https://doi.org/10.1037/xge0000367 SN - 0096-3445 SN - 1939-2222 VL - 147 IS - 3 SP - 377 EP - 397 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Miller, Jeff A1 - Schwarz, Wolfgang T1 - Dissociations between reaction times and temporal order judgments : a diffusion model approach N2 - A diffusion model for simple reaction time (RT) and temporal order judgment (TOJ) tasks was developed to account for a commonly observed dissociation between these 2 tasks: Most stimulus manipulations (e.g., intensity) have larger effects in RT tasks than in TOJ tasks. The model assumes that a detection criterion determines the level of sensory evidence needed to conclude that a stimulus has been presented. Analysis of the performance that would be achieved with different possible criterion settings revealed that performance was optimal with a lower criterion setting for the TOJ task than for the RT task. In addition, the model predicts that effects of stimulus manipulations should increase with the size of the detection criterion. Thus, the model suggests that commonly observed dissociations between RT and TOJ tasks may simply be due to performance optimization in the face of conflicting task demands Y1 - 2006 UR - http://www.apa.org/pubs/journals/xhp/ U6 - https://doi.org/10.1037/0096-1523.32.2.394 ER - TY - JOUR A1 - Miller, Jeff A1 - Schwarz, Wolfgang T1 - Delta plots for conflict tasks BT - an activation-suppression race model JF - Psychonomic bulletin & review : a journal of the Psychonomic Society N2 - We describe a mathematically simple yet precise model of activation suppression that can explain the negative-going delta plots often observed in standard Simon tasks. The model postulates a race between the identification of the relevant stimulus attribute and the suppression of irrelevant location-based activation, with the irrelevant activation only having an effect if the irrelevant activation is still present at the moment when central processing of the relevant attribute starts. The model can be fitted by maximum likelihood to observed distributions of RTs in congruent and incongruent trials, and it provides good fits to two previously-reported data sets with plausible parameter values. R and MATLAB software for use with the model is provided. KW - Delta plots KW - RT models KW - Simon effect KW - Activation suppression model Y1 - 2021 U6 - https://doi.org/10.3758/s13423-021-01900-5 SN - 1069-9384 SN - 1531-5320 VL - 28 IS - 6 SP - 1776 EP - 1795 PB - Springer CY - New York ER - TY - JOUR A1 - Miller, Jeff A1 - Ulrich, Rolf A1 - Schwarz, Wolfgang T1 - Why jackknifing yields good latency estimates N2 - We compared individual-participant and jackknife-based methods for scoring the onset latencies of event-related potential (ERP) components using a diffusion process as a model for an ERP. We studied "ramp-like" components in which the true ERP increases or decreases monotonically, except for noise. If the growth rates of such components vary across participants, the jackknife-based measure can easily have only 10%-20% as much error variance as the traditional method, and this advantage is magnified with more participants. We also studied boolean AND-shaped or "bump-like" components. Jackknifing generally yielded smaller error variances with these components too, especially when the component's peak amplitude varied across participants, but less so if the component's peak latency varied. These results help illuminate the reasons for the superiority of jackknife-based onset latency measures over traditional measures in recent simulations. Y1 - 2009 UR - http://www3.interscience.wiley.com/cgi-bin/issn?DESCRIPTOR=PRINTISSN&VALUE=0048-5772 U6 - https://doi.org/10.1111/j.1469-8986.2008.00761.x SN - 0048-5772 ER - TY - JOUR A1 - Schwarz, Wolfgang A1 - Miller, Jeff O. T1 - Locking the Wiener process to its level-crossing time N2 - We consider the specific transformation of a Wiener process {X(t), t >= 0} in the presence of an absorbing barrier a that results when this process is "time-locked" with respect to its first passage time T-a through a criterion level a, and the evolution of X(t) is considered backwards ( retrospectively) from T-a. Formally, we study the random variables defined by Y(t) = X(T-a - t) and derive explicit results for their density and mean, and also for their asymptotic forms. We discuss how our results can aid interpretations of time series "response-locked" to their times of crossing a criterion level. Y1 - 2010 UR - http://www.informaworld.com/smpp/section?content=a917389654&fulltext=713240928 U6 - https://doi.org/10.1080/03610920902755821 SN - 0361-0926 ER - TY - INPR A1 - Schwarz, Wolfgang A1 - Miller, Jeff O. T1 - When less equals more: probability summation without sensitivity improvement T2 - Journal of experimental psychology : Human perception and performance N2 - Many perceptual and cognitive tasks permit or require the integrated cooperation of specialized sensory channels, detectors, or other functionally separate units. In compound detection or discrimination tasks, 1 prominent general mechanism to model the combination of the output of different processing channels is probability summation. The classical example is the binocular summation model of Pirenne (1943), according to which a weak visual stimulus is detected if at least 1 of the 2 eyes detects this stimulus; as we review briefly, exactly the same reasoning is applied in numerous other fields. It is generally accepted that this mechanism necessarily predicts performance based on 2 (or more) channels to be superior to single channel performance, because 2 separate channels provide "2 chances" to succeed with the task. We argue that this reasoning is misleading because it neglects the increased opportunity with 2 channels not just for hits but also for false alarms and that there may well be no redundancy gain at all when performance is measured in terms of receiver operating characteristic curves. We illustrate and support these arguments with a visual detection experiment involving different spatial uncertainty conditions. Our arguments and findings have important implications for all models that, in one way or another, rest on, or incorporate, the notion of probability summation for the analysis of detection tasks, 2-alternative forced-choice tasks, and psychometric functions. KW - probability summation KW - compound detection or discrimination KW - redundancy gain KW - ROC curve KW - 2AFC KW - psychometric functions Y1 - 2014 U6 - https://doi.org/10.1037/a0037548 SN - 0096-1523 SN - 1939-1277 VL - 40 IS - 5 SP - 2091 EP - 2100 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Miller, Jeff A1 - Schwarz, Wolfgang T1 - Brain signals do not demonstrate unconscious decision making: An interpretation based on graded conscious awareness JF - Consciousness and cognition N2 - Neuroscientific studies have shown that brain activity correlated with a decision to move can be observed before a person reports being consciously aware of having made that decision (e.g., Libet, Gleason, Wright, & Pearl, 1983; Soon, Brass, Heinze, & Haynes, 2008). Given that a later event (i.e., conscious awareness) cannot cause an earlier one (i.e., decision-related brain activity), such results have been interpreted as evidence that decisions are made unconsciously (e.g., Libet, 1985). We argue that this interpretation depends upon an all-or-none view of consciousness, and we offer an alternative interpretation of the early decision-related brain activity based on models in which conscious awareness of the decision to move develops gradually up to the level of a reporting criterion. Under this interpretation, the early brain activity reflects sub-criterion levels of awareness rather than complete absence of awareness and thus does not suggest that decisions are made unconsciously. KW - Neuroscience KW - Consciousness KW - Decision making KW - Libet Y1 - 2014 U6 - https://doi.org/10.1016/j.concog.2013.12.004 SN - 1053-8100 SN - 1090-2376 VL - 24 SP - 12 EP - 21 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Schwarz, Wolfgang A1 - Miller, Jeff T1 - Response time models of delta plots with negative-going slopes JF - Psychonomic bulletin & review : a journal of the Psychonomic Society N2 - Delta plots (DPs) graphically compare reaction time (RT) quantiles obtained under two experimental conditions. In some research areas (e.g., Simon effects), decreasing delta plots (nDPs) have consistently been found, indicating that the experimental effect is largest at low quantiles and decreases for higher quantiles. nDPs are unusual and intriguing: They imply that RT in the faster condition is more variable, a pattern predicted by few standard RT models. We describe and analyze five classes of well-established latency mechanisms that are consistent with nDPs-exhaustive processing models, correlated stage models, mixture models, cascade models, and parallel channels models-and discuss the implications of our analyses for the interpretation of DPs. DPs generally do not imply any specific processing model; therefore, it is more fruitful to start from a specific quantitative model and to compare the DP it predicts with empirical data. KW - Delta plot KW - RT models KW - Simon effect KW - Activation suppression model Y1 - 2012 U6 - https://doi.org/10.3758/s13423-012-0254-6 SN - 1069-9384 VL - 19 IS - 4 SP - 555 EP - 574 PB - Springer CY - New York ER - TY - JOUR A1 - Miller, Jeff A1 - Schwarz, Wolfgang T1 - Aggregate and individual replication probability within an explicit model of the research process JF - Psychological methods N2 - We study a model of the research process in which the true effect size, the replication jitter due to changes in experimental procedure, and the statistical error of effect size measurement are all normally distributed random variables. Within this model, we analyze the probability of successfully replicating an initial experimental result by obtaining either a statistically significant result in the same direction or any effect in that direction. We analyze both the probability of successfully replicating a particular experimental effect (i.e., the individual replication probability) and the average probability of successful replication across different studies within some research context (i.e., the aggregate replication probability), and we identify the conditions under which the latter can be approximated using the formulas of Killeen (2005a, 2007). We show how both of these probabilities depend on parameters of the research context that would rarely be known in practice. In addition, we show that the statistical uncertainty associated with the size of an initial observed effect would often prevent accurate estimation of the desired individual replication probability even if these research context parameters were known exactly. We conclude that accurate estimates of replication probability are generally unattainable. KW - probability of replication KW - posterior statistical power KW - Bayesian inference KW - random-effects model KW - statistical estimation Y1 - 2011 U6 - https://doi.org/10.1037/a0023347 SN - 1082-989X VL - 16 IS - 3 SP - 337 EP - 360 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Schwarz, Wolfgang A1 - Miller, Jeff T1 - GSDT: An Integrative Model of Visual Search JF - Journal of experimental psychology : Human perception and performance N2 - We present a new quantitative process model (GSDT) of visual search that seeks to integrate various processing mechanisms suggested by previous studies within a single, coherent conceptual frame. It incorporates and combines 4 distinct model components: guidance (G), a serial (S) item inspection process, diffusion (D) modeling of individual item inspections, and a strategic termination (T) rule. For this model, we derive explicit closed-form results for response probability and mean search time (reaction time [RT]) as a function of display size and target presence/absence. The fit of the model is compared in detail to data from 4 visual search experiments in which the effects of target/distractor discriminability and of target prevalence on performance (present/absent display size functions for mean RT and error rate) are studied. We describe how GSDT accounts for various detailed features of our results such as the probabilities of hits and correct rejections and their mean RTs; we also apply the model to explain further aspects of the data, such as RT variance and mean miss RT. KW - visual search KW - signal prevalence KW - strategic termination KW - diffusion model KW - display size effect Y1 - 2016 U6 - https://doi.org/10.1037/xhp0000247 SN - 0096-1523 SN - 1939-1277 VL - 42 SP - 1654 EP - 1671 PB - American Psychological Association CY - Washington ER -