TY - JOUR A1 - Wulff, Peter A1 - Buschhüter, David A1 - Westphal, Andrea A1 - Mientus, Lukas A1 - Nowak, Anna A1 - Borowski, Andreas T1 - Bridging the gap between qualitative and quantitative assessment in science education research with machine learning BT - a case for pretrained language models-based clustering JF - Journal of science education and technology N2 - Science education researchers typically face a trade-off between more quantitatively oriented confirmatory testing of hypotheses, or more qualitatively oriented exploration of novel hypotheses. More recently, open-ended, constructed response items were used to combine both approaches and advance assessment of complex science-related skills and competencies. For example, research in assessing science teachers' noticing and attention to classroom events benefitted from more open-ended response formats because teachers can present their own accounts. Then, open-ended responses are typically analyzed with some form of content analysis. However, language is noisy, ambiguous, and unsegmented and thus open-ended, constructed responses are complex to analyze. Uncovering patterns in these responses would benefit from more principled and systematic analysis tools. Consequently, computer-based methods with the help of machine learning and natural language processing were argued to be promising means to enhance assessment of noticing skills with constructed response formats. In particular, pretrained language models recently advanced the study of linguistic phenomena and thus could well advance assessment of complex constructs through constructed response items. This study examines potentials and challenges of a pretrained language model-based clustering approach to assess preservice physics teachers' attention to classroom events as elicited through open-ended written descriptions. It was examined to what extent the clustering approach could identify meaningful patterns in the constructed responses, and in what ways textual organization of the responses could be analyzed with the clusters. Preservice physics teachers (N = 75) were instructed to describe a standardized, video-recorded teaching situation in physics. The clustering approach was used to group related sentences. Results indicate that the pretrained language model-based clustering approach yields well-interpretable, specific, and robust clusters, which could be mapped to physics-specific and more general contents. Furthermore, the clusters facilitate advanced analysis of the textual organization of the constructed responses. Hence, we argue that machine learning and natural language processing provide science education researchers means to combine exploratory capabilities of qualitative research methods with the systematicity of quantitative methods. KW - Attention to classroom events KW - Noticing KW - NLP KW - ML Y1 - 2022 U6 - https://doi.org/10.1007/s10956-022-09969-w SN - 1059-0145 SN - 1573-1839 VL - 31 IS - 4 SP - 490 EP - 513 PB - Springer CY - Dordrecht ER - TY - JOUR A1 - Vock, Miriam A1 - Gronostaj, Anna A1 - Kretschmann, Julia A1 - Westphal, Andrea T1 - Wie bewerten begabte und leistungsstarke Jugendliche in separaten Spezialklassen ihren Unterricht? BT - Unterrichtsqualität in Deutsch und Mathematik in der Sekundarstufe BT - Teaching quality in German and Mathematics in secondary education JF - Zeitschrift für Erziehungswissenschaft N2 - Leistungsstarke und besonders begabte Schüler*innen werden im Unterricht oft nicht genügend gefordert. In speziellen Klassen für besonders Leistungsstarke und Begabte kann der Unterricht stärker auf die Lernmöglichkeiten dieser Gruppe zugeschnitten werden. Spezialklassen gelten insgesamt als leistungsförderlich, Studien zur Unterrichtsqualität sind bisher jedoch rar. In dieser Studie wird untersucht, wie Schüler*innen der Leistungs- und Begabungsklassen (LuBK) im Land Brandenburg die Qualität ihres Unterrichts in Deutsch und Mathematik im Vergleich zu Schüler*innen von Regelklassen einschätzen. Die Datenbasis bilden N = 3371 Schüler*innen der 8. und 10. Jahrgangsstufe aus 33 Schulen. Mittels Fragebögen wurden Merkmale der Unterrichtsqualität nach dem QuAIT-Modell erfragt; die Datenanalyse erfolgte mit regressionsanalytischen Mehrebenenmodellen. Die Schüler*innen der LuBK bewerten die Qualität ihres Unterrichts überwiegend positiver als die Schüler*innen der Regelklassen, Defizite zeigen sich jedoch in beiden Klassentypen bei den Qualitätsmerkmalen der inneren Differenzierung und der Mitsprache bei Unterrichtsthemen. N2 - High-performing and gifted students are often not sufficiently challenged in class. In special classes for high-achievers and gifted students, instruction can be tailored more closely to the learning opportunities of this group. Special classes are generally considered to be conducive to achievement, but studies on the quality of instruction have been scarce. This study examines how students in special classes for the gifted and talented in the state of Brandenburg rate the quality of their instruction in German and mathematics compared to students in regular classes. The data basis is constituted by N = 3371 students in the 8th and 10th grades from 33 schools. Questionnaires were used to assess characteristics of teaching quality according to the QuAIT model; data analysis was conducted using regression-analytical multilevel models. The students of the LuBK evaluate the quality of their teaching mainly more positively than the students of the regular classes, however, deficits are evident in both class types with regard to the quality characteristics of internal differentiation and having a say in the topics of instruction. T2 - How do gifted and high achieving adolescents in separate special classes evaluate their lessons? KW - Giftedness KW - Quality of instruction KW - QuAIT model KW - Special classes KW - Talented students KW - Unterrichtsqualität KW - QuAIT-Modell KW - Leistungsstarke Schüler*innen KW - Hochbegabung KW - Spezialklassen Y1 - 2022 U6 - https://doi.org/10.1007/s11618-022-01118-8 SN - 1434-663X SN - 1862-5215 VL - 25 SP - 1151 EP - 1173 PB - Springer CY - Wiesbaden ER - TY - JOUR A1 - Kalinowski, Eva A1 - Jurczok, Anne A1 - Westphal, Andrea A1 - Vock, Miriam T1 - Welche individuellen und institutionellen Faktoren begünstigen die Kooperation von Grundschullehrkräften? JF - Zeitschrift für Erziehungswissenschaft N2 - Der Kooperation von Lehrkräften wird für die Bewältigung der komplexen Anforderungen des Schulalltags großes Potenzial zugeschrieben. Dennoch ist Kooperation in vielen Lehrkräftekollegien nicht selbstverständlich. Auf Basis einer Befragung von N = 489 Grundschullehrkräften untersucht dieser Beitrag in einem querschnittlichen Design die kollegiale Kooperation in Schulen in Deutschland. Mit einer Regression wurde unter Berücksichtigung der Mehrebenenstruktur der Daten geprüft, in welchem Ausmaß personale, kompetenzbezogene und institutionelle Merkmale die Umsetzung verschiedener Kooperationsformen wahrscheinlicher machen. Die Ergebnisse zeigen, dass die Kooperationsform „Austausch“ in der Arbeit der Lehrkräfte ausgeprägt wahrgenommen wurde, die Kooperationsform „Kokonstruktion“ weniger. Zudem zeigen sich Gemeinsamkeiten, aber auch Unterschiede in den begünstigenden Faktoren. Während sich für beide Kooperationsformen die Wahrnehmung kollektiver Selbstwirksamkeit und das Zusammenspiel zwischen organisatorischen und räumlichen Rahmenbedingungen als prädiktiv erwiesen, spielte der Enthusiasmus lediglich für den Austausch und die Unterrichtserfahrung nur für die Kokonstruktion eine Rolle. N2 - Collaboration between teachers is seen as having great potential for dealing with the complex everyday challenges that arise in schools. But collaboration is not something that is necessarily implemented in schools. In a cross-sectional study, this paper investigates collaboration among colleagues in German schools, based on a questionnaire of N = 489 primary school teachers. Using a linear regression allowing for the multilevel structure of the data, we explored the extent to which different demographic, competence-related, and institutional characteristics make the implementation of specific forms of collaboration more likely. The results show that the teachers experienced the collaboration forms "exchange" and "co-construction" at different levels, with "exchange" being more prevalent. There are similarities, but also differences, in the predictive factors for each form of collaboration. While the perception of collective self-efficacy and the interplay of organisational framework and the set-up of working spaces proved to be predictive for both forms, enthusiasm only played a role in "exchange" and teaching experience was only predictive for "co-construction". T2 - Which individual and institutional factors facilitate collaboration between teachers in primary schools? KW - Collaboration KW - Co-construction KW - Exchange KW - Primary school KW - Teachers KW - Kooperation KW - Kokonstruktion KW - Austausch KW - Grundschule KW - Lehrkräfte Y1 - 2022 U6 - https://doi.org/10.1007/s11618-022-01081-4 SN - 1434-663X SN - 1862-5215 VL - 25 SP - 999 EP - 1029 PB - Springer CY - Wiesbaden ER - TY - JOUR A1 - Westphal, Andrea A1 - Kalinowski, Eva A1 - Hoferichter, Clara Josepha A1 - Vock, Miriam T1 - K-12 teachers' stress and burnout during the COVID-19 pandemic BT - a systematic review JF - Frontiers in psychology N2 - We present the first systematic literature review on stress and burnout in K-12 teachers during the COVID-19 pandemic. Based on a systematic literature search, we identified 17 studies that included 9,874 K-12 teachers from around the world. These studies showed some indication that burnout did increase during the COVID-19 pandemic. There were, however, almost no differences in the levels of stress and burnout experienced by K-12 teachers compared to individuals employed in other occupational fields. School principals' leadership styles emerged as an organizational characteristic that is highly relevant for K-12 teachers' levels of stress and burnout. Individual teacher characteristics associated with burnout were K-12 teachers' personality, self-efficacy in online teaching, and perceived vulnerability to COVID-19. In order to reduce stress, there was an indication that stress-management training in combination with training in technology use for teaching may be superior to stress-management training alone. Future research needs to adopt more longitudinal designs and examine the interplay between individual and organizational characteristics in the development of teacher stress and burnout during the COVID-19 pandemic and beyond. KW - burnout KW - stress KW - COVID-19 KW - pandemic KW - K-12 teachers KW - remote teaching Y1 - 2022 U6 - https://doi.org/10.3389/fpsyg.2022.920326 SN - 1664-1078 VL - 13 PB - Frontiers Media CY - Lausanne ER - TY - JOUR A1 - Westphal, Andrea A1 - Zawacki-Richter, Olaf T1 - Von der allgemeinen Erziehungswissenschaft zur empirischen Bildungsforschung? BT - eine Analyse von Beiträgen der Zeitschrift für Erziehungswissenschaft BT - an analysis of contributions to the journal JF - Zeitschrift für Erziehungswissenschaft : ZfE N2 - The present study examines articles published in Zeitschrift fur Erziehungswissenschaft (ZfE-Journal of Educational Sciences) between 1998 and 2017, to discover whether the thematic focus of the articles it published during this period changed over time. To do this, we scrutinized articles in four consecutive five-year periods: 1998-2002, 2003-2007, 2008-2012, 2013-2017. Using the titles and abstracts of 821 articles published between 1998 and 2017, we conducted a quantitative text analysis and identified the most frequent and most characteristic bigrams that emerged during these periods. In addition, we looked at whether specific word stems (e.g., "erziehungswissenschaft", "bildungsforsch", "didakt") began to occur more frequently over the two decades under study. Finally, we used the text mining tool Leximancer (TM) to construct concept maps that point to the semantic structure of the topics and key concepts in the analyzed articles. The results indicate that, over the course of this twenty-year period, the ZfE predominantly published empirical articles with a focus on the social aspects of education, but that its focus on research into general pedagogy decreased in frequency. N2 - er vorliegende Beitrag beschäftigt sich mit den Publikationen, die in der Zeitschrift für Erziehungswissenschaft (ZfE) in den Jahren 1998–2017 veröffentlicht wurden. Angesichts der Veränderungen in der erziehungswissenschaftlichen Forschungslandschaft in der jüngeren Vergangenheit untersuchen wir, inwiefern sich eine veränderte Schwerpunktsetzung auch in den Beiträgen der ZfE nachweisen lassen. Dazu führen wir zunächst eine quantitative Textanalyse durch und identifizieren die häufigsten sowie die charakteristischen Bigramme (Zweiwortsequenzen) in vier aufeinanderfolgenden Fünfjahres-Abschnitten (1998–2002, 2003–2007, 2008–2012, 2013–2017). Zudem prüfen wir, inwiefern bestimmte Wortstämme (bspw. „erziehungswissenschaft“, „bildungsforsch“, „didakt“) über die Jahre hinweg häufiger auftreten. Schließlich erstellen wir mit dem Textmining Tool Leximancer™ concept maps, die Hinweise auf die semantische Struktur der Themengebiete und Schlüsselkonzepte geben. Die Ergebnisse deuten darauf hin, dass im gesamten Zeitraum mehrheitlich Beiträge mit empirischem Fokus publiziert wurden, ein inhaltlicher Fokus auf sozialen Aspekten von Bildung lag und die Beschäftigung mit der allgemeinen Erziehungswissenschaft abnahm. T2 - From general pedagogy to empirical educational research? KW - Content analysis KW - Journal analysis KW - Quantitative text analysis KW - Science KW - studies KW - Zeitschriftenanalyse KW - Wissenschaftsforschung KW - Inhaltsanalyse KW - Quantitative Textanalyse KW - Empirische Wendung Y1 - 2021 U6 - https://doi.org/10.1007/s11618-021-01008-5 SN - 1434-663X SN - 1862-5215 VL - 24 IS - 3 SP - 641 EP - 669 PB - Springer VS/Springer Fachmedien Wiesbaden GmbH CY - Wiesbaden ER - TY - JOUR A1 - Börnert-Ringleb, Moritz A1 - Westphal, Andrea A1 - Zaruba, Nicole A1 - Gutmann, Franziska A1 - Vock, Miriam T1 - The relationship between attitudes toward inclusion, beliefs about teaching and learning, and subsequent automatic evaluations amongst student teachers JF - Frontiers in education N2 - Teachers' attitudes toward inclusion are frequently cited as being an important predictor of how successfully a given inclusive school system is implemented. At the same time, beliefs about the nature of teaching and learning are discussed as a possible predictor of attitudes toward inclusion. However, more recent research emphasizes the need of considering implicit processes, such as automatic evaluations, when describing attitudes and beliefs. Previous evidence on the association of attitudes toward inclusion and beliefs about teaching and learning is solely based on explicit reports. Therefore, this study aims to examine the relationship between attitudes toward inclusion, beliefs about teaching and learning, and the subsequent automatic evaluations of pre-service teachers (N = 197). The results revealed differences between pre-service teachers' explicit attitudes/beliefs and their subsequent automatic evaluations. Differences in the relationship between attitudes toward inclusion and beliefs about teaching and learning occur when teachers focus either on explicit measures or automatic evaluations. These differences might be due to different facets of the same attitude object being represented. Relying solely on either explicit measures or automatic evaluations at the exclusion of the other might lead to erroneous assumptions about the relation of attitudes toward inclusion and beliefs about teaching and learning. KW - inclusion KW - attitudes KW - teaching KW - automatic evaluation KW - beliefs KW - implicit Y1 - 2020 U6 - https://doi.org/10.3389/feduc.2020.584464 SN - 2504-284X VL - 5 PB - Frontiers Media CY - Lausanne ER - TY - JOUR A1 - Westphal, Andrea A1 - Vock, Miriam A1 - Lazarides, Rebecca T1 - Are more conscientious seventh- and ninth-graders less likely to be retained? BT - effects of big five personality traits on grade retention in two different age cohorts JF - Journal of applied developmental psychology : an internat. multidisciplinary N2 - Previous research has identified students' personality traits, especially conscientiousness, as highly relevant predictors of academic success. Less is known about the role of Big Five personality traits in students when it comes to teachers' decisions about students' educational trajectories and whether personality traits differentially affect these decisions by teachers in different grade levels. This study examines to what extent students' Big Five personality traits affect teacher decisions on grade retention, looking at two cohorts of 12,146 ninth-grade and 6002 seventh-grade students from the German National Educational Panel Study. In both grade levels, multilevel logistic mediation models show that students' conscientiousness indirectly predicts grade retention through the assignment of grades by teachers. In the ninth-grade sample, students' conscientiousness was additionally a direct predictor of retention, distinct from teacher-assigned grades. We discuss potential underlying mechanisms and explore whether teachers base their decisions on different indicators when retaining seventh-grade students or ninth-grade students. KW - grade retention KW - personality KW - gender KW - socioeconomic status KW - educational KW - large-scale study KW - educational achievement Y1 - 2019 U6 - https://doi.org/10.1016/j.appdev.2019.101088 SN - 0193-3973 VL - 66 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Kücholl, Denise A1 - Lazarides, Rebecca A1 - Westphal, Andrea T1 - Förderung von Beratungskompetenz bei Lehramtsstudierenden im Bachelorstudium BT - Entwicklung eines Seminarkonzepts und Anwendung des aktiven Zuhörens in den Schulpraktischen Übungen JF - Professionalisierung in Praxisphasen : Ergebnisse der Lehrerbildungsforschung an der Universität Potsdam (Potsdamer Beiträge zur Lehrerbildung und Bildungsforschung ; 2) N2 - Die Fähigkeit zu beraten gilt als ein wichtiger Aspekt professioneller Kompetenz von Lehrkräften. Lehrveranstaltungskonzepte, die theoretisches Beratungswissen vermitteln und gleichzeitig praktische Erfahrungen im Beraten ermöglichen, sind daher hochrelevant für die Entwicklung berufsspezifischer Fähigkeiten. Angelehnt an ein vierdimensionales Modell der Beratungskompetenz wurde an der Universität Potsdam ein Seminarkonzept für angehende Lehrkräfte entwickelt. Es bietet Lerngelegenheiten, um Beratungswissen zu Kommunikations-, Diagnostik-, Problemlöse- und Bewältigungs-Skills zu erwerben und dieses Wissen in konstruierten Beratungssituationen im Seminar anzuwenden, die klassisch für die berufliche Schulpraxis sind. Darüber hinaus wurden die Lehramtsstudierenden motiviert, spezifische Beratungskompetenzen – konkret das aktive Zuhören – im Rahmen der Schulpraktischen Übungen anzuwenden. Erste Erkenntnisse der Analyse der durchgeführten Unterrichtsstunden werden dargestellt. N2 - Counseling in school is an important aspect of professionalization and an important fact of teachers’ professional competence. Courses which deal with theoretical knowledge and offer opportunities for practical experiences are extremely important for developing professional competence. In this overview, we present a training for pre-service teachers that aims to enhance counseling skills at schools and to practice specific counseling skills and abilities. Following a four-dimensional model of counseling competence, we developed a concept to train communication-skills, diagnostic-skills, problem-solving-skills and coping-skills. In the course, pre-service teachers train their skills using case studies and practical experiences. We discuss the didactic conceptualization of the course and present first results of our evaluative feedback process that involved participating pre-service teachers. Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-570765 SN - 978-3-86956-508-8 SN - 2626-3556 SN - 2626-4722 IS - 2 SP - 145 EP - 168 PB - Universitätsverlag Potsdam CY - Potsdam ER - TY - JOUR A1 - Wulff, Peter A1 - Buschhüter, David A1 - Westphal, Andrea A1 - Nowak, Anna A1 - Becker, Lisa A1 - Robalino, Hugo A1 - Stede, Manfred A1 - Borowski, Andreas T1 - Computer-based classification of preservice physics teachers’ written reflections JF - Journal of science education and technology N2 - Reflecting in written form on one's teaching enactments has been considered a facilitator for teachers' professional growth in university-based preservice teacher education. Writing a structured reflection can be facilitated through external feedback. However, researchers noted that feedback in preservice teacher education often relies on holistic, rather than more content-based, analytic feedback because educators oftentimes lack resources (e.g., time) to provide more analytic feedback. To overcome this impediment to feedback for written reflection, advances in computer technology can be of use. Hence, this study sought to utilize techniques of natural language processing and machine learning to train a computer-based classifier that classifies preservice physics teachers' written reflections on their teaching enactments in a German university teacher education program. To do so, a reflection model was adapted to physics education. It was then tested to what extent the computer-based classifier could accurately classify the elements of the reflection model in segments of preservice physics teachers' written reflections. Multinomial logistic regression using word count as a predictor was found to yield acceptable average human-computer agreement (F1-score on held-out test dataset of 0.56) so that it might fuel further development towards an automated feedback tool that supplements existing holistic feedback for written reflections with data-based, analytic feedback. KW - reflection KW - teacher professional development KW - hatural language KW - processing KW - machine learning Y1 - 2020 U6 - https://doi.org/10.1007/s10956-020-09865-1 SN - 1059-0145 SN - 1573-1839 VL - 30 IS - 1 SP - 1 EP - 15 PB - Springer CY - Dordrecht ER - TY - JOUR A1 - Kretschmann, Julia A1 - Westphal, Andrea A1 - Vock, Miriam T1 - Does it pay to be one of the oldest in class? BT - Relative age effects on academic self-concept, peer relations, and teacher judgments in German primary schools JF - Learning and instruction : the journal of the European Association for Research on Learning and Instruction N2 - Several studies have revealed that older students in a year group reach higher achievement scores than younger students in that group. But less is known about how students' relative age in class relates to their self-perception of academic achievement, their social acceptance in class and to how teachers judge their abilities. Therefore, we examined relative age effects within class on students' academic self-concept, peer relations, grades, and teachers' secondary school recommendation. Analyses were based on a sample of N = 18,956 German fourth graders, who had never been retained or accelerated. We applied multilevel regression to control for covariates at the individual and classroom level. There were no substantial relative age effects within class across any of the outcomes, except for a small advantage for the youngest in their reading self-concept. Our findings therefore contradict the common assumption that younger students in class are disadvantaged compared to their older classmates. KW - Relative age effects KW - Month of birth KW - Academic self-concept KW - Peer KW - relations KW - Teacher judgments Y1 - 2021 U6 - https://doi.org/10.1016/j.learninstruc.2021.101463 SN - 0959-4752 SN - 1873-3263 VL - 74 PB - Elsevier CY - Amsterdam ER -