Date of this Version
Background: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods.
Methods/design: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews.
Discussion: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice.
Trial registration: NCT02820623, June 3rd, 2016.
© The Author(s). 2016
This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
treatment fidelity, evidence-based practice, implementation, cost-effectiveness
Beidas, Rinad S.; Maclean, Johanna C.; Fishman, Jessica; Dorsey, Shannon; Schoenwald, Sonja; Mandell, David S.; Shea, Judy A.; McLeod, Bryce D.; French, Michael T.; Hogue, Aaron; Adams, Danielle R.; Lieberman, Adina E.; Becker-Haimes, Emily M.; and Marcus, Steven C., "A Randomized Trial to Identify Accurate and Cost-Effective Fidelity Measurement Methods for Cognitive-Behavioral Therapy: Project FACTS Study Protocol" (2016). Departmental Papers (Psychiatry). 4.
Date Posted: 15 August 2017
This document has been peer reviewed.