Refine
Language
- English (3) (remove)
Is part of the Bibliography
- yes (3)
Keywords
- Obsessive-compulsive disorder (2)
- Psychodiagnostics (2)
- Psychometric properties (2)
- Screening (2)
- adherence (1)
- assessment (1)
- competency (1)
- psychotherapy (1)
- therapist competence (1)
Institute
Assessments of psychotherapeutic competencies play a crucial role in research and training. However, research on the reliability and validity of such assessments is sparse. This study aimed to provide an overview of the current evidence and to provide an average interrater reliability (IRR) of psychotherapeutic competence ratings. A systematic review was conducted, and 20 studies reported in 32 publications were collected. These 20 studies were included in a narrative synthesis, and 20 coefficients were entered into the meta-analysis. Most primary studies referred to cognitive-behavioral therapies and the treatment of depression, used the Cognitive Therapy Scale, based ratings on videos, and trained the raters. Our meta-analysis revealed a pooled ICC of 0.82, but at the same time severe heterogeneity. The evidence map highlighted a variety of variables related to competence assessments. Further aspects influencing the reliability of competence ratings and regarding the considerable heterogeneity are discussed in detail throughout the manuscript.
Background
Despite the prevalence of obsessive-compulsive disorder (OCD), its precise identification remains challenging. With the Zohar-Fineberg Obsessive-Compulsive Screen (ZF-OCS; 5 or 6 items), a brief instrument is widely available mainly in English. As there is a lack of empirical studies on the ZF-OCS, the aim of the present study was to translate the items into German and investigate the instrument in a nonclinical sample.
Methods
In two consecutive online surveys, n = 304 and n = 51 students participated. Besides the ZF-OCS, they answered established measures on OCD, depression, health anxiety, general anxiety and health-related well-being.
Results
Whereas internal consistency was low (α = .53–.72; ω = .55–.69), retest reliability (rt1,t2 = .89) at two weeks was high. As expected, we found high correlations with other OCD instruments (r > .61; convergent validity), and significantly weaker correlations with measures of depression (r = .39), health anxiety (r = .29), and health-related well-being (r = −.28, divergent validity). Nonetheless, the correlations with general anxiety were somewhere in between (r = .52).
Conclusions
Due to heterogeneous OCD subtypes, the ZF-OCS asks diverse questions which probably resulted in the present internal consistency. Nevertheless, the results on retest reliability and validity were promising. As for other OCD instruments, divergent validity regarding general anxiety seems problematic to establish. Even so, the ZF-OCS seems valuable for screening purposes, as it is short and easy to administer, and may facilitate initiating subsequent clinical assessment. Further studies should determine the instrument’s diagnostic accuracy.
Background
Despite the prevalence of obsessive-compulsive disorder (OCD), its precise identification remains challenging. With the Zohar-Fineberg Obsessive-Compulsive Screen (ZF-OCS; 5 or 6 items), a brief instrument is widely available mainly in English. As there is a lack of empirical studies on the ZF-OCS, the aim of the present study was to translate the items into German and investigate the instrument in a nonclinical sample.
Methods
In two consecutive online surveys, n = 304 and n = 51 students participated. Besides the ZF-OCS, they answered established measures on OCD, depression, health anxiety, general anxiety and health-related well-being.
Results
Whereas internal consistency was low (α = .53–.72; ω = .55–.69), retest reliability (rt1,t2 = .89) at two weeks was high. As expected, we found high correlations with other OCD instruments (r > .61; convergent validity), and significantly weaker correlations with measures of depression (r = .39), health anxiety (r = .29), and health-related well-being (r = −.28, divergent validity). Nonetheless, the correlations with general anxiety were somewhere in between (r = .52).
Conclusions
Due to heterogeneous OCD subtypes, the ZF-OCS asks diverse questions which probably resulted in the present internal consistency. Nevertheless, the results on retest reliability and validity were promising. As for other OCD instruments, divergent validity regarding general anxiety seems problematic to establish. Even so, the ZF-OCS seems valuable for screening purposes, as it is short and easy to administer, and may facilitate initiating subsequent clinical assessment. Further studies should determine the instrument’s diagnostic accuracy.