Refine
Has Fulltext
- no (2)
Year of publication
- 2019 (2)
Document Type
- Article (2) (remove)
Language
- English (2)
Is part of the Bibliography
- yes (2)
Keywords
- adherence (2) (remove)
Institute
Although the observation and assessment of psychotherapeutic competences are central to training, supervision, patient care, quality control, and life-long practice, structured instruments are used only occasionally. In the current study, an observation-based tool for the Assessment of Core CBT Skills (ACCS) was translated into German and adapted, and its psychometric properties were pilot evaluated. Competence of therapists-in-training was assessed in a random sample of n = 30 videos on cognitive behavioural therapy including patients diagnosed with hypochondriasis. Two of three raters independently assessed the competences demonstrated in the entire, active treatment sessions (n = 60). In our sample, internal consistency was excellent, and interrater reliability was good. Convergent validity (Cognitive Therapy Scale) and discriminant validity (Helping Alliance Questionnaire) were within the expected ranges. The ACCS total score did not significantly predict the reduction of symptoms of hypochondriasis, and a one-factorial structure of the instrument was found. By providing multiple opportunities for feedback, self-reflection, and supervision, the ACCS may complement current tools for the assessment of psychotherapeutic competences and importantly support competence-based training and supervision.
Assessments of psychotherapeutic competencies play a crucial role in research and training. However, research on the reliability and validity of such assessments is sparse. This study aimed to provide an overview of the current evidence and to provide an average interrater reliability (IRR) of psychotherapeutic competence ratings. A systematic review was conducted, and 20 studies reported in 32 publications were collected. These 20 studies were included in a narrative synthesis, and 20 coefficients were entered into the meta-analysis. Most primary studies referred to cognitive-behavioral therapies and the treatment of depression, used the Cognitive Therapy Scale, based ratings on videos, and trained the raters. Our meta-analysis revealed a pooled ICC of 0.82, but at the same time severe heterogeneity. The evidence map highlighted a variety of variables related to competence assessments. Further aspects influencing the reliability of competence ratings and regarding the considerable heterogeneity are discussed in detail throughout the manuscript.