The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.201800220

Abstract

Reports on the behavioral health workforce highlight the need to enhance evidence-based capacity; evidence-based interventions incorporated into pre-service graduate curricula (coursework and fieldwork) are needed to meet this goal. Improving educational practices across pre-service settings will require understanding of and careful attention to the contextual factors that exert pressure on curricula. The authors believe efforts to change educational practices can be enhanced by application of implementation science principles. This Open Forum delineates the key contextual factors that influence pre-service education, highlights gaps in the literature, and proposes an agenda for future research at the intersection of behavioral health workforce development and implementation science.

Equipping the behavioral health workforce to deliver evidence-based interventions (EBIs; i.e., interventions with empirical support for their efficacy) is a critical public health need (1). EBIs are often not delivered with high fidelity in community mental health settings (2), and treatment often fails to promote meaningful symptom reduction (3). To date, most efforts to increase rates of EBI use target clinicians after they enter the service sector (4), and significant gaps remain (1). Given the challenges faced in training providers to deliver EBIs after they enter the workforce, reports on the needs of the behavioral health workforce highlight the importance of incorporating EBI training into pre-service graduate curricula (coursework and practicum) to achieve the goal of enhancing the quality of mental health care in the community (57).

Pre-service training, particularly in terminal master’s degree programs, is an ideal intervention point for improving EBI use in clinical care settings. Master’s degrees represent the typical level needed to practice independently, and graduates of these programs (e.g., marriage and family therapy, social work, and counseling) are most representative of usual care settings (5). However, master’s-level providers come from diverse educational backgrounds and theoretical orientations (5), which complicates translating broad calls to improve pre-service training into practice. Graduate curricula exist within large educational systems that have competing forces exerting pressure on curriculum content (e.g., faculty philosophies and training, accreditation standards, licensure, and state regulatory requirements). Improving or changing educational practices across these diverse settings requires the understanding of and careful attention to these contextual factors. Furthermore, virtually no systematic research exists on what kind of pre-service education strategies best prepares trainees to enter the behavioral health workforce equipped to deliver high-quality care. Nonetheless, trainees are entering work settings that increasingly expect them to do so.

Changing educational practices requires identifying and addressing contextual barriers to system change; therefore, these efforts might borrow from principles of implementation science (IS), which is the scientific study of how to disseminate and integrate EBIs into routine clinical settings. Reforming pre-service education to improve clinicians’ use of EBIs after workforce entry is also aligned with the goal of IS to increase EBI use in community settings. We demonstrate how IS principles can be applied to the pre-service context and propose an agenda for future research at the intersection of workforce development and IS in behavioral health.

Understanding the Pre-service Context

Implementation theories underscore the need to understand the settings in which change is to take place across ecological levels (8). Current understanding of facilitators and barriers to EBI inclusion in master’s degree programs comes from large surveys that provide broad contextual overviews but little nuanced detail (9, 10). While research suggests that master’s program directors recognize the advantages of EBI training (911), EBIs are inconsistently incorporated into curricula (9). Pre-service education typically includes a combination of didactic instruction and experiential learning via classwork and clinical “fieldwork.” Ideal skill acquisition is theorized to occur when classroom learning about EBIs is reinforced by supervised clinical field experiences (12). However, little is known regarding the nature of EBIs taught across different programs in classrooms and fieldwork or the educational strategies used to deliver this content (e.g., didactic or experiential learning, or both). For example, while cognitive–behavioral therapy is the most common EBI taught in social work programs (9), we do not know which intervention protocols are taught or for what presenting concerns.

Furthermore, contextual factors both within and external to individual graduate institutions influence curricula. Within institutions, faculty and fieldwork supervisors vary in their knowledge of, attitudes toward, and experience with EBIs (10). Lack of faculty to lead course development is a primary barrier to EBI training (10), and programs vary in how faculty make decisions about which intervention models are taught (13). Teaching is also influenced by structural factors (e.g., proportion of coursework taught by adjunct faculty and courses required for graduation) and institutional culture and climate (e.g., perceived value of EBI and/or research within departments and faculty development priorities).

Key external factors in graduate programs include accrediting and licensure bodies for each discipline (7), which exert powerful influences on pre-service educational content. Published accreditation standards show that graduate programs must satisfy many requirements to attain and maintain accreditation, including substantial course content and 500 to 900 hours of fieldwork experience, to be accomplished in only two years, on average. Consistent with this, program directors cite the challenge of providing EBI training alongside other requirements (10). Furthermore, fieldwork supervision may need to be conducted by a discipline-specific supervisor or be demonstrably consistent with the overarching discipline’s philosophy (e.g., marriage and family therapy trainees must receive relationally oriented fieldwork supervision). This leaves little space to provide training in multiple EBIs within the confines of course and practica requirements.

Efforts to increase EBI-based curricula in pre-service settings must consider these contextual influences. There are two interrelated questions that should guide work in this area: how IS can inform EBI integration into pre-service settings and how programs should prioritize which EBIs are taught.

How IS Can Inform EBI Integration Into Pre-service Settings

Leverage IS frameworks to understand the pre-service context and guide change.

Many implementation frameworks are available to identify and organize key contextual factors influencing EBI curricula and guide change processes. We offer two that are well suited for implementation efforts in the pre-service context. First, the Consolidated Framework for Implementation Research (CFIR) model synthesizes contextual factors that may influence EBI curriculum interventions (8); many of the contextual factors thought to influence EBI curricula fit clearly into the CFIR model (e.g., accreditation standards represent an “outer setting” factor influencing EBI curricula). Second, the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework delineates four phases of change that should occur within implementation efforts (14).

Partner with pre-service stakeholders and learn from champion programs.

Process models of implementation, such as the EPIS framework, highlight the importance of partnered approaches to understanding context and implementing innovations (14). Successful integration of EBI content into curricula will depend on an in-depth understanding of how well an EBI aligns with a program’s philosophy, and how complementary fieldwork can reinforce students’ experiential learning of that intervention. Efforts should include partnering among training directors, academic faculty, community fieldwork supervisors, and representatives from accreditation/licensure boards. Mixed-methods research to identify and learn from champion programs that successfully integrate EBIs in their curricula could provide insight into factors that will facilitate scale-up across other programs.

Develop and evaluate education implementation strategies for the pre-service setting.

Emerging work suggests the benefit of shaping trainees’ attitudes toward EBIs in graduate fieldwork (12). More research is needed to develop and systematically evaluate novel education strategies (classroom and fieldwork based) that best prepare clinicians for successful EBI delivery (e.g., flipped classroom models, standardized patients, technology-assisted trainings, standardized fieldwork supervision). Ultimately, comparative effectiveness studies, conducted with input from adult learning theory and education experts, should examine the effects of a range of educational strategies on clinician EBI knowledge and skill acquisition to determine which strategies best prepare clinicians for sustainable EBI use after workforce entry.

Develop and evaluate multilevel implementation strategies to sustain and scale up effective educational implementation strategies.

Once effective educational strategies are identified, identifying factors that facilitate or impede their sustainability and developing plans to continually refine, evaluate, disseminate, and implement proven educational strategies across behavioral health pre-service settings will be important next steps.

Identify outcomes of successful implementation.

Short-term evaluation of efforts to integrate EBIs should include outcomes across contextual levels. Studies of educational strategies to improve clinician EBI use should examine outcomes in both classroom and fieldwork settings, as well as EBI attitudes, knowledge, and self-efficacy of key stakeholders (e.g., trainees, faculty, fieldwork supervisors). Long-term outcomes should address the sustainability of curricular changes, the impact on clinician EBI use after workforce entry, student perceptions of their level of EBI preparedness for entering practice, and faculty and fieldwork supervisors’ perceptions of EBI educational strategies.

Deciding Which EBIs Should Be Prioritized for Implementation in Pre-service Settings

Programs seeking to include EBIs in their curricula have an overwhelming number of interventions from which to choose (15). Most psychosocial EBIs are complex and require access to an expert supervisor to optimally support trainee knowledge and skill acquisition. No single EBI addresses all the clinical concerns a trainee will treat over their career. Furthermore, clinical interventions that are evidence-based today will likely be supplanted by new treatment approaches in the future. Encouraging graduate programs to teach EBIs that achieve current standards of evidence is important, but the longer term challenge is to ensure that curricula keep pace with scientific progress.

To ensure that graduates are equipped to deliver EBIs sustainably over the course of their career, pre-service education must provide fundamental skills to learn about and practice new interventions throughout their careers. This is the “hardware” a clinician needs to effectively deliver new EBIs (update his or her “software”) as science advances. Given the proliferation of treatment manuals in existence, some have argued for teaching a “common elements” therapeutic approach in graduate programs (6). However, alternative EBI models and frameworks exist, including transdiagnostic interventions, evidence-based principles, and measurement-based care (15). While empirical work is ultimately needed to determine which approach best prepares clinicians for evidence-based practice, we argue that interventions that best approximate the idea of a clinician “hardware”—such as intervention strategies that can support a variety of specific EBIs, like measurement-based care—should be prioritized for pre-service implementation, rather than specific treatments.

Conclusions

Improving EBI training in pre-service settings is an area ripe with potential to yield a powerful public health impact. While these benefits cannot be understated, efforts in this area are unlikely to succeed without effective partnerships among key stakeholders in graduate education. IS offers strategies to approach research in this area to maximize the likelihood of success.

Department of Psychiatry (Becker-Haimes, Beidas) and Department of Medical Ethics and Health Policy (Beidas), University of Pennsylvania, Philadelphia; Hawai’i Department of Health Child and Adolescent Mental Health Division, Honolulu (Okamura); Department of Pediatrics, University of Rochester Medical Center, Rochester, New York (Baldwin); Department of Education and Counseling, Villanova University, Villanova, Pennsylvania (Wahesh, Schmidt).
Send correspondence to Dr. Becker-Haimes ().

Dr. Beidas receives royalties from Oxford University Press and has served as a consultant to Merck. The other authors report no financial relationships with commercial interests.

References

1 Kazdin AE: Addressing the treatment gap: a key challenge for extending evidence-based psychosocial interventions. Behav Res Ther 2017; 88:7–18Crossref, MedlineGoogle Scholar

2 Garland AF, Bickman L, Chorpita BF: Change what? Identifying quality improvement targets by investigating usual mental health care. Adm Policy Ment Health 2010; 37:15–26 Crossref, MedlineGoogle Scholar

3 Smith AM, Jensen-Doss A: Youth psychotherapy outcomes in usual care and predictors of outcome group membership. Psychological Services 2017; 14:66–76 Crossref, MedlineGoogle Scholar

4 McHugh RK, Barlow DH: The dissemination and implementation of evidence-based psychological treatments: a review of current efforts. Am Psychol 2010; 65:73–84 Crossref, MedlineGoogle Scholar

5 Hoge MA, Stuart GW, Morris JA, et al.: Behavioral health workforce development in the United States; in Workforce Development Theory and Practice in the Mental Health Sector. Edited by Smith M, Jury A. Hershey, PA, IGI Global, 2017CrossrefGoogle Scholar

6 Shernoff ES, Bearman SK, Kratochwill TR: Training the next generation of school psychologists to deliver evidence-based mental health practices: current challenges and future directions. School Psych Rev 2017; 46:219–232CrossrefGoogle Scholar

7 Proctor EK: Implementing evidence-based practice in social work education: principles, strategies, and partnerships. Res Soc Work Pract 2007; 17:583–591CrossrefGoogle Scholar

8 Damschroder LJ, Aron DC, Keith RE, et al.: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 4:50, 2009Crossref, MedlineGoogle Scholar

9 Weissman MM, Verdeli H, Gameroff MJ, et al.: National survey of psychotherapy training in psychiatry, psychology, and social work. Arch Gen Psychiatry 2006; 63:925–934 Crossref, MedlineGoogle Scholar

10 Bertram RM, Charnin LA, Kerns SE, et al.: Evidence-based practices in North American MSW curricula. Res Soc Work Pract 2015; 25:737–748CrossrefGoogle Scholar

11 Barwick M: Master’s level clinician competencies in child and youth behavioral health care. Emotional & Behavioral Disorders in Youth 2011; 11:29–58Google Scholar

12 Tennille J, Solomon P, Brusilovskiy E, et al.: Field Instructors Extending EBP Learning in Dyads (FIELD): results of a pilot randomized controlled trial. Journal of the Society for Social Work and Research 2016; 7:1–22CrossrefGoogle Scholar

13 Grady MD, Rozas LW, Bledsoe SE: Are curriculum decisions based on the evidence? How social work faculty members make choices in curriculum decisions. J Evid Based Soc Work 2010; 7:466–480 Crossref, MedlineGoogle Scholar

14 Aarons GA, Hurlburt M, Horwitz SM: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health 2011; 38:4–23Crossref, MedlineGoogle Scholar

15 Ng MY, Weisz JR: Annual research review: building a science of personalized intervention for youth mental health. J Child Psychol Psychiatry 2016; 57:216–236 Crossref, MedlineGoogle Scholar