English teachers' diagnostic skills in judging their students' competencies on the basis of the Common European Framework of Reference
- The present study addresses diagnostic competence of English language teachers at the end of lower secondary education. The 56 teachers assigned each of their respective students (N = 1 363) to a proficiency level of foreign language use according to the Common European Framework of Reference for Languages (CEFR). The teachers' judgements were compared to CEFR proficiency level assignments estimated using data from a reading comprehension assessment of English as a foreign language. The consistency of proficiency level allocations was evaluated using level, differentiation, and ranking components. Beyond providing a description of diagnostic competence, the present study focuses on the influence of classroom halo effects on teachers' CEFR proficiency level judgements by comparing teacher judgments and students' English marks. A multilevel model of diagnostic competence is presented to assess to what extent the rank and level components are influenced by teachers' familiarity with and use of the CEFR guidelines when judging studentThe present study addresses diagnostic competence of English language teachers at the end of lower secondary education. The 56 teachers assigned each of their respective students (N = 1 363) to a proficiency level of foreign language use according to the Common European Framework of Reference for Languages (CEFR). The teachers' judgements were compared to CEFR proficiency level assignments estimated using data from a reading comprehension assessment of English as a foreign language. The consistency of proficiency level allocations was evaluated using level, differentiation, and ranking components. Beyond providing a description of diagnostic competence, the present study focuses on the influence of classroom halo effects on teachers' CEFR proficiency level judgements by comparing teacher judgments and students' English marks. A multilevel model of diagnostic competence is presented to assess to what extent the rank and level components are influenced by teachers' familiarity with and use of the CEFR guidelines when judging student proficiency.…
Author details: | Michael Leucht, Simon Tiffin-Richards, Miriam VockORCiDGND, Hans Anand Pant, Olaf Koeller |
---|---|
DOI: | https://doi.org/10.1026/0049-8637/a000071 |
ISSN: | 0049-8637 |
Title of parent work (French): | Zeitschrift für Entwicklungspsychologie und pädagogische Psychologie |
Publisher: | Hogrefe |
Place of publishing: | Göttingen |
Publication type: | Article |
Language: | French |
Year of first publication: | 2012 |
Publication year: | 2012 |
Release date: | 2017/03/26 |
Tag: | Common European Framework of Reference for Languages (CEFR); English as a foreign language; diagnostic competence; multilevel analysis |
Volume: | 44 |
Issue: | 4 |
Number of pages: | 15 |
First page: | 163 |
Last Page: | 177 |
Organizational units: | Humanwissenschaftliche Fakultät / Strukturbereich Kognitionswissenschaften / Department Psychologie |
Peer review: | Referiert |
Institution name at the time of the publication: | Humanwissenschaftliche Fakultät / Institut für Psychologie |