Search results
Publication Relationships between Clinician-Level Attributes and Fidelity-Consistent and Fidelity-Inconsistent Modifications to an Evidence-Based Psychotherapy(2015-01-01) Crits-Christoph, Paul F; Stirman, Shannon W; Gutner, Cassidy A; Evans, Arthur C; Beidas, Rinad S; Edmunds, JulieBackground: Clinicians often modify evidence-based psychotherapies (EBPs) when delivering them in routine care settings. There has been little study of factors associated with or implications of modifications to EBP protocols. This paper differentiates between fidelity-consistent and fidelity-inconsistent modifications and it examines the potential influence of two clinician characteristics, training outcomes, and attitudes toward EBPs on fidelity-consistent and fidelity-inconsistent modifications of cognitive behavioral therapy in a sample of clinicians who had been trained to deliver these treatments for children or adults. Methods: Survey and coded interview data collected 2 years after completion of training programs in cognitive behavioral therapy were used to examine associations between successful or unsuccessful completion of training, clinician attitudes, and modifications. Modifications endorsed by clinicians were categorized as fidelity-consistent or fidelity-inconsistent and entered as outcomes into separate regression models, with training success and attitudes entered as independent variables. Results: Successful completion of a training program was associated with subsequent fidelity-inconsistent modifications but not fidelity-consistent modifications. Therapists who reported greater openness to using EBPs prior to training reported more fidelity-consistent modifications at follow-up, and those who reported greater willingness to adopt EBPs if they found them appealing were more likely to make fidelity-inconsistent modifications. Conclusions: Implications of these findings for training, implementation, EBP sustainment, and future studies are discussed. Research on contextual and protocol-related factors that may impact decisions to modify EBPs will be an important future direction of study to complement to this research.Publication Predictors of Community Therapists' Use of Therapy Techniques in a Large Public Mental Health System(2015-04-01) Beidas, Rinad S; Marcus, Steven C; Evans, Arthur C; Hurford, Matthew O; Hadley, Trevor; Barg, Frances K; Aarons, Gregory; Hoagwood, Kimberly; Schoenwald, Sonja; Mandell, David S; Walsh, Lucia M; Adams, Danielle RImportance Few studies have examined the effects of individual and organizational characteristics on the use of evidence-based practices in mental health care. Improved understanding of these factors could guide future implementation efforts to ensure effective adoption, implementation, and sustainment of evidence-based practices. Objective To estimate the relative contribution of individual and organizational factors on therapist self-reported use of cognitive-behavioral, family, and psychodynamic therapy techniques within the context of a large-scale effort to increase use of evidence-based practices in an urban public mental health system serving youth and families. Design, Setting, and Participants In this observational, cross-sectional study of 23 organizations, data were collected from March 1 through July 25, 2013. We used purposive sampling to recruit the 29 largest child-serving agencies, which together serve approximately 80% of youth receiving publically funded mental health care. The final sample included 19 agencies with 23 sites, 130 therapists, 36 supervisors, and 22 executive administrators. Main Outcomes and Measures Therapist self-reported use of cognitive-behavioral, family, and psychodynamic therapy techniques, as measured by the Therapist Procedures Checklist–Family Revised. Results Individual factors accounted for the following percentages of the overall variation: cognitive-behavioral therapy techniques, 16%; family therapy techniques, 7%; and psychodynamic therapy techniques, 20%. Organizational factors accounted for the following percentages of the overall variation: cognitive-behavioral therapy techniques, 23%; family therapy techniques, 19%; and psychodynamic therapy techniques, 7%. Older therapists and therapists with more open attitudes were more likely to endorse use of cognitive-behavioral therapy techniques, as were those in organizations that had spent fewer years participating in evidence-based practice initiatives, had more resistant cultures, and had more functional climates. Women were more likely to endorse use of family therapy techniques, as were those in organizations employing more fee-for-service staff and with more stressful climates. Therapists with more divergent attitudes and less knowledge about evidence-based practices were more likely to use psychodynamic therapy techniques. Conclusions and Relevance This study suggests that individual and organizational factors are important in explaining therapist behavior and use of evidence-based practices, but the relative importance varies by therapeutic technique.Publication Contextual Influences and Strategies for Dissemination and Implementation in Mental Health(2015-01-01) Wolk, Courtney L B; Powell, Byron J; Beidas, Rinad SImplementation science has emerged to bridge the gap between research and practice. A number of conceptual frameworks have been developed to advance implementation research and illuminate the contextual influences that can facilitate or impede the implementation of evidence-based practices. Contextual factors that may be important in the dissemination and implementation of evidence-based practice may occur at the system-, organizational-, and provider-levels. System-level barriers may include external policies, incentives, and peer pressure. Organizational-level factors that are important in implementation include organizational culture and climate and implementation climate. At the individual provider-level, barriers may occur around provider attitudes, knowledge, and self-efficacy. Finally, additional barriers such as client-level that can be used to overcome contextual barriers when attempting to implement evidence-based practices into new settings. Several exemplar implementation strategies are discussed, including the Availability, Responsiveness, and Continuity intervention, Community Development Team model, and Interagency Collaborative Team Model.Publication Study Protocol: Implementation of a Computer-Assisted Intervention for Autism in Schools: A Hybrid Type II Cluster Randomized Effectiveness-Implementation Trial(2016-01-01) Pellecchia, Melanie; Beidas, Rinad S; Marcus, Steven C; Fishman, Jessica; Kimberly, John R.; Cannuscio, Carolyn C; Reisinger, Erica M; Rump, Keiran; Mandell, David SBackground: The number of children diagnosed with autism has rapidly outpaced the capacities of many public school systems to serve them, especially under-resourced, urban school districts. The intensive nature of evidence-based autism interventions, which rely heavily on one-to-one delivery, has caused schools to turn to computer-assisted interventions (CAI). There is little evidence regarding the feasibility, effectiveness, and implementation of CAI in public schools. While CAI has the potential to increase instructional time for students with autism, it may also result in unintended consequences such as reduction in the amount of interpersonal (as opposed to computerized) instruction students receive. The purpose of this study is to test the effectiveness of one such CAI—TeachTown—its implementation, and its effects on teachers’ use of other evidence-based practices. Methods:This study protocol describes a type II hybrid cluster randomized effectiveness-implementation trial. We will train and coach 70 teachers in autism support classrooms in one large school district in the use of evidence-based practices for students with autism. Half of the teachers then will be randomly selected to receive training and access to TeachTown: Basics, a CAI for students with autism, for the students in their classrooms. The study examines: (1) the effectiveness of TeachTown for students with autism; (2) the extent to which teachers implement TeachTown the way it was designed (i.e., fidelity); and (3) whether its uptake increases or reduces the use of other evidence-based practices. Discussion: This study will examine the implementation of new technology for children with ASD in public schools and will be the first to measure the effectiveness of CAI. As importantly, the study will investigate whether adding a new technology on top of existing practices increases or decreases their use. This study presents a unique method to studying both the implementation and exnovation of evidence-based practices for children with autism in school settings. Trial registration: NCT02695693. Retrospectively registered on July 8, 2016.Publication A Mixed Methods Study of Individual and Organizational Factors that Affect Implementation of Interventions for Children with Autism in Public Schools(2016-01-01) Beidas, Rinad S; Marcus, Steven C; Locke, Jill; Cannuscio, Carolyn C; Barg, Frances K; Stahmer, Aubyn; Aarons, Gregory; Mandell, David S; Lyon, Aaron R; Dorsey, ShannonBackground: The significant lifelong impairments associated with autism spectrum disorder (ASD), combined with the growing number of children diagnosed with ASD, have created urgency in improving school-based quality of care. Although many interventions have shown efficacy in university-based research, few have been effectively implemented and sustained in schools, the primary setting in which children with ASD receive services. Individual- and organizational-level factors have been shown to predict the implementation of evidence-based interventions (EBIs) for the prevention and treatment of other mental disorders in schools, and may be potential targets for implementation strategies in the successful use of autism EBIs in schools. The purpose of this study is to examine the individual- and organizational-level factors associated with the implementation of EBIs for children with ASD in public schools. Methods: We will apply the Domitrovich and colleagues (2008) framework that examines the influence of contextual factors (i.e., individual- and organizational-level factors) on intervention implementation in schools. We utilize mixed methods to quantitatively test whether the factors identified in the Domitrovich and colleagues (2008) framework are associated with the implementation of autism EBIs, and use qualitative methods to provide a more comprehensive understanding of the factors associated with successful implementation and sustainment of these interventions with the goal of tailoring implementation strategies. Discussion: The results of this study will provide an in-depth understanding of individual- and organizational-level factors that influence the successful implementation of EBIs for children with ASD in public schools. These data will inform potential implementation targets and tailoring of strategies that will help schools overcome barriers to implementation and ultimately improve the services and outcomes for children with ASD.Publication A Randomized Trial to Identify Accurate and Cost-Effective Fidelity Measurement Methods for Cognitive-Behavioral Therapy: Project FACTS Study Protocol(2016-01-01) Beidas, Rinad S; Fishman, Jessica; Mandell, David S; Shea, Judy A; Maclean, Johanna C; Dorsey, Shannon; Schoenwald, Sonja; Lieberman, Adina E; Becker-Haimes, Emily M; Marcus, Steven C; McLeod, Bryce D; French, Michael T; Hogue, Aaron; Adams, Danielle RBackground: This randomized trial will compare three methods of assessing fidelity to cognitive-behavioral therapy (CBT) for youth to identify the most accurate and cost-effective method. The three methods include self-report (i.e., therapist completes a self-report measure on the CBT interventions used in session while circumventing some of the typical barriers to self-report), chart-stimulated recall (i.e., therapist reports on the CBT interventions used in session via an interview with a trained rater, and with the chart to assist him/her) and behavioral rehearsal (i.e., therapist demonstrates the CBT interventions used in session via a role-play with a trained rater). Direct observation will be used as the gold-standard comparison for each of the three methods. Methods/design: This trial will recruit 135 therapists in approximately 12 community agencies in the City of Philadelphia. Therapists will be randomized to one of the three conditions. Each therapist will provide data from three unique sessions, for a total of 405 sessions. All sessions will be audio-recorded and coded using the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale. This will enable comparison of each measurement approach to direct observation of therapist session behavior to determine which most accurately assesses fidelity. Cost data associated with each method will be gathered. To gather stakeholder perspectives of each measurement method, we will use purposive sampling to recruit 12 therapists from each condition (total of 36 therapists) and 12 supervisors to participate in semi-structured qualitative interviews. Discussion: Results will provide needed information on how to accurately and cost-effectively measure therapist fidelity to CBT for youth, as well as important information about stakeholder perspectives with regard to each measurement method. Findings will inform fidelity measurement practices in future implementation studies as well as in clinical practice. Trial registration: NCT02820623, June 3rd, 2016.Publication Are General and Strategic Measures of Organizational Context and Leadership Associated with Knowledge and Attitudes toward Evidence-Based Practices in Public Behavioral Health Settings? A Cross-Sectional Observational Study(2017-01-01) Powell, Byron J; Mandell, David S; Hadley, Trevor; Evans, Arthur C; Hurford, Matthew O; Beidas, Rinad S; Rubin, Ronnie MBackground: Examining the role of modifiable barriers and facilitators is a necessary step toward developing effective implementation strategies. This study examines whether both general (organizational culture, organizational climate, and transformational leadership) and strategic (implementation climate and implementation leadership) organizational-level factors predict therapist-level determinants of implementation (knowledge of and attitudes toward evidence-based practices). Methods: Within the context of a system-wide effort to increase the use of evidence-based practices (EBPs) and recovery-oriented care, we conducted an observational, cross-sectional study of 19 child-serving agencies in the City of Philadelphia, including 23 sites, 130 therapists, 36 supervisors, and 22 executive administrators. Organizational variables included characteristics such as EBP initiative participation, program size, and proportion of independent contractor therapists; general factors such as organizational culture and climate (Organizational Social Context Measurement System) and transformational leadership (Multifactor Leadership Questionnaire); and strategic factors such as implementation climate (Implementation Climate Scale) and implementation leadership (Implementation Leadership Scale). Therapist-level variables included demographics, attitudes toward EBPs (Evidence-Based Practice Attitudes Scale), and knowledge of EBPs (Knowledge of Evidence-Based Services Questionnaire). We used linear mixed-effects regression models to estimate the associations between the predictor (organizational characteristics, general and strategic factors) and dependent (knowledge of and attitudes toward EBPs) variables. Results: Several variables were associated with therapists’ knowledge of EBPs. Clinicians in organizations with more proficient cultures or higher levels of transformational leadership (idealized influence) had greater knowledge of EBPs; conversely, clinicians in organizations with more resistant cultures, more functional organizational climates, and implementation climates characterized by higher levels of financial reward for EBPs had less knowledge of EBPs. A number of organizational factors were associated with the therapists’ attitudes toward EBPs. For example, more engaged organizational cultures, implementation climates characterized by higher levels of educational support, and more proactive implementation leadership were all associated with more positive attitudes toward EBPs. Conclusions: This study provides evidence for the importance of both general and strategic organizational determinants as predictors of knowledge of and attitudes toward EBPs. The findings highlight the need for longitudinal and mixed-methods studies that examine the influence of organizational factors on implementation.Publication Cognitive-Behavioral Treatment of Anxious Youth with Comorbid School Refusal: Clinical Presentation and Treatment Response(2010-01-01) Beidas, Rinad S; Crawley, Sarah A; Mychailyszyn, Matthew P; Comer, Jonathan S; Kendall, Phillip CThe present study investigated the effectiveness of cognitive-behavioral therapy in youth (N = 27) diagnosed with a principal anxiety disorder and school refusal (SR; denial to attend school or difficulty remaining in school). Scant research examines the effectiveness of cognitive-behavioral therapy for treatment-seeking youth with a primary anxiety disorder and comorbid SR. Effects for youth who completed treatment (N = 12) ranged from d = .61 to 2.27 based on youth- and parent-reported anxiety and depressive symptoms, as well as independently rated global functioning. A discussion of treatment drop-out, a case illustration, and treatment recommendations are provided.Publication Non-Participants in Policy Efforts to Promote Evidence-Based Practices in a Large Behavioral Health System(2017-01-01) Stewart, Rebecca E; Mandell, David S; Nangia, Gayari; Evans, Arthur C; Adams, Danielle R; Hadley, Trevor; Beidas, Rinad S; Shaffer, Lauren; Rubin, Ronnie M; Weaver, Shawna LBackground: System-wide training initiatives to support and implement evidence-based practices (EBPs) in behavioral health systems have become increasingly widespread. Understanding more about organizations who do not participate in EBP training initiatives is a critical piece of the dissemination and implementation puzzle if we endeavor to increase access in community settings. Methods: We conducted 30 1-h semi-structured interviews with leaders in non-participating agencies who did not formally participate in system-wide training initiatives to implement EBPs in the City of Philadelphia, with the goal to understand why they did not participate. Results: We found that despite not participating in training initiatives, most agencies were adopting (and self-financing) some EBP implementation. Leadership from agencies that were implementing EBPs reported relying on previously trained staff to implement EBPs and acknowledged a lack of emphasis on fidelity. Most leaders at agencies not adopting EBPs did not have a clear understanding of what EBP is. Those familiar with EBPs in agencies not adopting EBPs reported philosophical objections to EBPs. When asked about quality assurance and treatment selection, leaders reported being guided by system audits. Conclusions: While it is highly encouraging that many agencies are adopting EBPs on their own, significant questions about fidelity and implementation success more broadly remain.Publication Training as Usual: Can Therapist Behavior Change After Reading a Manual and Attending a Brief Workship on Cognitive Behavioral Therapy for Youth Anxiety?(2009-06-01) Beidas, Rinad S; Barmish, Andrea J; Kendall, Phillip CThere exists an ongoing movement to transport empirically supported treatments (ESTs), developed and evaluated in research clinics, to service providing clinics. ESTs refer to psychological interventions that have been evaluated scientifically (e.g., randomized controlled trial; RCT) and satisfy the Chambless and Hollon (1998) criteria (Kendall & Beidas, 2007). Dissemination research encompasses both dissemination (purposeful distribution of relevant information and materials to clinicians) and implementation (adoption and integration of EST in clinical practice) of ESTs (Lomas, 1993). However, for a variety of reasons (Addis & Krasnow, 2000; Riley, Schuman, Forman-Hoffman, Mihm, Applegate, & Asif, 2007), resistance to dissemination and implementation exists. We focus on training therapists in ESTs (i.e., dissemination). Thus, a key question arises: Do current training efforts practice in the community (i.e., reading a manual and attending a brief training workshop) effectively influence therapist behavior in those who are naïve to fundamental principles of an EST?