TY - JOUR A1 - Brunner, Martin A1 - Keller, Lena A1 - Stallasch, Sophie E. A1 - Kretschmann, Julia A1 - Hasl, Andrea A1 - Preckel, Franzis A1 - Luedtke, Oliver A1 - Hedges, Larry T1 - Meta-analyzing individual participant data from studies with complex survey designs BT - a tutorial on using the two-stage approach for data from educational large-scale assessments JF - Research synthesis methods N2 - Descriptive analyses of socially important or theoretically interesting phenomena and trends are a vital component of research in the behavioral, social, economic, and health sciences. Such analyses yield reliable results when using representative individual participant data (IPD) from studies with complex survey designs, including educational large-scale assessments (ELSAs) or social, health, and economic survey and panel studies. The meta-analytic integration of these results offers unique and novel research opportunities to provide strong empirical evidence of the consistency and generalizability of important phenomena and trends. Using ELSAs as an example, this tutorial offers methodological guidance on how to use the two-stage approach to IPD meta-analysis to account for the statistical challenges of complex survey designs (e.g., sampling weights, clustered and missing IPD), first, to conduct descriptive analyses (Stage 1), and second, to integrate results with three-level meta-analytic and meta-regression models to take into account dependencies among effect sizes (Stage 2). The two-stage approach is illustrated with IPD on reading achievement from the Programme for International Student Assessment (PISA). We demonstrate how to analyze and integrate standardized mean differences (e.g., gender differences), correlations (e.g., with students' socioeconomic status [SES]), and interactions between individual characteristics at the participant level (e.g., the interaction between gender and SES) across several PISA cycles. All the datafiles and R scripts we used are available online. Because complex social, health, or economic survey and panel studies share many methodological features with ELSAs, the guidance offered in this tutorial is also helpful for synthesizing research evidence from these studies. KW - complex survey designs KW - educational large-scale assessments KW - individual KW - participant data KW - meta-analysis KW - Programme for International Student KW - Assessment Y1 - 2022 U6 - https://doi.org/10.1002/jrsm.1584 SN - 1759-2879 SN - 1759-2887 VL - 14 IS - 1 SP - 5 EP - 35 PB - Wiley CY - Hoboken ER - TY - JOUR A1 - Rjosk, Camilla A1 - Richter, Dirk A1 - Luedtke, Oliver A1 - Eccles, Jacquelynne Sue T1 - Ethnic Composition and Heterogeneity in the Classroom: Their Measurement and Relationship With Student Outcomes JF - The journal of educational psychology N2 - This study explores various measures of the ethnic makeup in a classroom and their relationship with student outcomes. We examine whether measures of ethnic diversity are related to achievement (mathematics, reading) and feeling of belonging with one’s peers over and above commonly investigated composition characteristics. Multilevel analyses were based on data from a representative sample of 18,762 elementary school students in 903 classrooms. The proportion of minority students and diversity measures showed negative associations with student outcomes in separate models. Including diversity measures and the proportion of minority students, diversity of minority students mostly lost its significance. However, the results suggest that diversity measures may provide additional information over and above other classroom characteristics for some student outcomes. The various measures of diversity led to comparable results. (PsycINFO Database Record (c) 2017 APA, all rights reserved) KW - ethnic composition KW - diversity KW - multilevel analysis KW - academic achievement KW - classroom Y1 - 2017 U6 - https://doi.org/10.1037/edu0000185 SN - 0022-0663 SN - 1939-2176 VL - 109 SP - 1188 EP - 1204 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Kretschmann, Julia A1 - Vock, Miriam A1 - Luedtke, Oliver A1 - Gronostaj, Anna T1 - psychosocial development after early acceleration JF - Contemporary educational psychology N2 - Whereas studies that have analyzed factors that affect academic achievement have predominantly revealed positive effects of skipping a grade, controversial results have been found for students’ social-emotional and motivational development. Therefore, the aim of this study was to examine the effects of skipping a whole grade on students’ school satisfaction, peer relations, school anxiety, and academic self-concept. Moreover, we conducted moderation analyses to investigate whether skipping a grade affects boys and girls differently. Data were obtained from N = 4926 German students who were repeatedly surveyed once a year in Grades 4, 5, and 6. A total of N = 96 students from this sample had skipped a grade in elementary school. We applied full matching separately for male and female students in order to minimize selection bias. When analyzing motivational variables, we added class-mean achievement scores as covariates within the matching process. Equally for boys and girls, the results showed no significant effect of skipping on school satisfaction, yet we found a negative effect on peer relations that persisted across the 3 years of measurement. However, after skipping a grade girls were significantly disadvantaged compared to boys on some motivational dimensions. KW - Grade skipping KW - Psychosocial development KW - Propensity score matching KW - Acceleration KW - Moderation analysis Y1 - 2016 U6 - https://doi.org/10.1016/j.cedpsych.2016.06.001 SN - 0361-476X SN - 1090-2384 VL - 46 SP - 195 EP - 207 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Kretschmann, Julia A1 - Vock, Miriam A1 - Luedtke, Oliver T1 - Acceleration in elementary school: using propensity score matching to estimate the effects on academic achievement JF - The journal of educational psychology N2 - Using German data, we examined the effects of one specific type of acceleration-grade skipping-on academic performance. Prior research on the effects of acceleration has suffered from methodological restrictions, especially due to a lack of appropriate comparison groups and a priori measurements. For this reason, propensity score matching was applied in this analysis to minimize selection bias due to observed confounding variables. Various types of matching were attempted, and, in consideration of balancing the covariates, full matching was the final choice. We used data from the Berlin ELEMENT Study, analyzing, after matching, the information of 81 students who had skipped a grade over the course of elementary school and up to 1,668 nonaccelerated students who attended the same grade level as the accelerated students. Measurements took place 3 times between the 4th and 6th grades, including the assessment of reading, spelling, and mathematics performance. After matching, the results of between-group comparisons regarding performance indices showed no significant effects of skipping a grade, other than a small positive effect found on spelling performance. Theoretical implications and methodological limitations are discussed. KW - grade skipping KW - academic performance KW - propensity score matching KW - acceleration KW - elementary school Y1 - 2014 U6 - https://doi.org/10.1037/a0036631 SN - 0022-0663 SN - 1939-2176 VL - 106 IS - 4 SP - 1080 EP - 1095 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Kramer, Jochen A1 - Nagy, Gabriel A1 - Trautwein, Ulrich A1 - Luedtke, Oliver A1 - Jonkmann, Kathrin A1 - Maaz, Kai A1 - Treptow, Rainer T1 - High class students in the universities, the rest in the other institutions of higher education JF - Zeitschrift für Erziehungswissenschaft N2 - In Germany, different types of university-level institutions are available for tertiary education: traditional universities (Universitaten) and-since the 1970s-universities of applied science (Fachhochschulen) as well as universities of cooperative education (Berufsakademien). The present study investigates differences in key areas related to students' academic choices and success: do students at different types of university differ significantly in terms of cognitive performance, personality or social background? We compared N = 1.230 students at traditional universities, universities of applied science, and universities of cooperative education (Baden-Wurttemberg Cooperative State University) on the basis of a large scale longitudinal study in the German federal state of Baden-Wurttemberg. Students of the different university types differed significantly in all three key areas (cognitive performance, personality, and social background) within the fields of technical sciences and economics. We determine the relative importance of these key areas for differences between university types and we discuss the implications of our findings. KW - Personality KW - School performance KW - Social background KW - Types of university and college Y1 - 2011 U6 - https://doi.org/10.1007/s11618-011-0213-4 SN - 1434-663X VL - 14 IS - 3 SP - 465 EP - 487 PB - Springer CY - Wiesbaden ER -