1
|
Albright J, Shinall JA, Tomczuk L, Stewart RE, Mandell DS, Stahmer AC, Beidas RS, Pellecchia M. A multi-constituent qualitative examination of facilitators and barriers to caregiver coaching for autistic children in publicly funded early intervention. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2024:13623613241272993. [PMID: 39171756 DOI: 10.1177/13623613241272993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/23/2024]
Abstract
LAY ABSTRACT Caregiver coaching is an evidence-based practice for young autistic children, but it is not widely used in community-based early intervention services. Previous research has explored why caregiver coaching is not widespread in early intervention, but only from the perspective of early intervention providers. Caregivers, providers, and administrators are all involved in the decision of whether to use caregiver coaching in early intervention. Therefore, it is important to include all perspectives in research regarding this practice. In this study we interviewed 20 caregivers of autistic children, 36 early intervention providers, and 6 administrators from early intervention agencies and asked questions about their perspectives regarding the use of caregiver coaching in early intervention. We did this to figure out what factors help and hinder the use of caregiver coaching in this setting and to see how caregivers, providers, and administrators agreed or disagreed on these factors. All participants agreed that caregivers' attitudes and expectations can influence whether caregiver coaching is used. In addition, all participants agreed that when caregivers and providers collaborate and have a strong working relationship, it can facilitate the use of caregiver coaching in early intervention. Other factors, such as caregiver stress and provider flexibility were also discussed. Based on these findings, we suggest strategies that can be used to possibly increase the use of caregiver coaching in early intervention for autistic children and their families.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Rinad S Beidas
- Northwestern University Feinberg School of Medicine, USA
| | | |
Collapse
|
2
|
Tignanelli CJ, Shah S, Vock D, Siegel L, Serrano C, Haut E, Switzer S, Martin CL, Rizvi R, Peta V, Jenkins PC, Lemke N, Thyvalikakath T, Osheroff JA, Torres D, Vawdrey D, Callcut RA, Butler M, Melton GB. A pragmatic, stepped-wedge, hybrid type II trial of interoperable clinical decision support to improve venous thromboembolism prophylaxis for patients with traumatic brain injury. Implement Sci 2024; 19:57. [PMID: 39103955 DOI: 10.1186/s13012-024-01386-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2024] [Accepted: 07/14/2024] [Indexed: 08/07/2024] Open
Abstract
BACKGROUND Venous thromboembolism (VTE) is a preventable medical condition which has substantial impact on patient morbidity, mortality, and disability. Unfortunately, adherence to the published best practices for VTE prevention, based on patient centered outcomes research (PCOR), is highly variable across U.S. hospitals, which represents a gap between current evidence and clinical practice leading to adverse patient outcomes. This gap is especially large in the case of traumatic brain injury (TBI), where reluctance to initiate VTE prevention due to concerns for potentially increasing the rates of intracranial bleeding drives poor rates of VTE prophylaxis. This is despite research which has shown early initiation of VTE prophylaxis to be safe in TBI without increased risk of delayed neurosurgical intervention or death. Clinical decision support (CDS) is an indispensable solution to close this practice gap; however, design and implementation barriers hinder CDS adoption and successful scaling across health systems. Clinical practice guidelines (CPGs) informed by PCOR evidence can be deployed using CDS systems to improve the evidence to practice gap. In the Scaling AcceptabLE cDs (SCALED) study, we will implement a VTE prevention CPG within an interoperable CDS system and evaluate both CPG effectiveness (improved clinical outcomes) and CDS implementation. METHODS The SCALED trial is a hybrid type 2 randomized stepped wedge effectiveness-implementation trial to scale the CDS across 4 heterogeneous healthcare systems. Trial outcomes will be assessed using the RE2-AIM planning and evaluation framework. Efforts will be made to ensure implementation consistency. Nonetheless, it is expected that CDS adoption will vary across each site. To assess these differences, we will evaluate implementation processes across trial sites using the Exploration, Preparation, Implementation, and Sustainment (EPIS) implementation framework (a determinant framework) using mixed-methods. Finally, it is critical that PCOR CPGs are maintained as evidence evolves. To date, an accepted process for evidence maintenance does not exist. We will pilot a "Living Guideline" process model for the VTE prevention CDS system. DISCUSSION The stepped wedge hybrid type 2 trial will provide evidence regarding the effectiveness of CDS based on the Berne-Norwood criteria for VTE prevention in patients with TBI. Additionally, it will provide evidence regarding a successful strategy to scale interoperable CDS systems across U.S. healthcare systems, advancing both the fields of implementation science and health informatics. TRIAL REGISTRATION Clinicaltrials.gov - NCT05628207. Prospectively registered 11/28/2022, https://classic. CLINICALTRIALS gov/ct2/show/NCT05628207 .
Collapse
Affiliation(s)
- Christopher J Tignanelli
- Department of Surgery, University of Minnesota, 420 Delaware St SE, MMC 195, Minneapolis, MN, 55455, USA.
- Institute for Health Informatics, University of Minnesota, Minneapolis, MN, USA.
- Center for Learning Health Systems Science, University of Minnesota, Minneapolis, MN, USA.
- Center for Quality Outcomes, Discovery and Evaluation, University of Minnesota, Minneapolis, MN, USA.
| | - Surbhi Shah
- Department of Medicine, Mayo Clinic, Scottsdale, AZ, USA
| | - David Vock
- Division of Biostatistics and Health Data Science, University of Minnesota, Minneapolis, MN, USA
| | - Lianne Siegel
- Division of Biostatistics and Health Data Science, University of Minnesota, Minneapolis, MN, USA
| | - Carlos Serrano
- Division of Biostatistics and Health Data Science, University of Minnesota, Minneapolis, MN, USA
| | - Elliott Haut
- Department of Surgery, Johns Hopkins University, Baltimore, MD, USA
| | | | | | - Rubina Rizvi
- Institute for Health Informatics, University of Minnesota, Minneapolis, MN, USA
- Center for Learning Health Systems Science, University of Minnesota, Minneapolis, MN, USA
| | - Vincent Peta
- Department of Surgery, University of Minnesota, 420 Delaware St SE, MMC 195, Minneapolis, MN, 55455, USA
| | - Peter C Jenkins
- Department of Surgery, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Nicholas Lemke
- Department of Surgery, University of Minnesota, 420 Delaware St SE, MMC 195, Minneapolis, MN, 55455, USA
| | - Thankam Thyvalikakath
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, USA
- Indiana University School of Dentistry, Indianapolis, IN, USA
| | | | - Denise Torres
- Department of Surgery, Geisinger Health, Danville, PA, USA
| | - David Vawdrey
- Department of Biomedical Informatics, Geisinger Health, Danville, PA, USA
| | - Rachael A Callcut
- Department of Surgery, UC Davis School of Medicine, Sacramento, CA, USA
| | - Mary Butler
- Center for Learning Health Systems Science, University of Minnesota, Minneapolis, MN, USA
- School of Publish Health, University of Minnesota, Minneapolis, MN, USA
| | - Genevieve B Melton
- Department of Surgery, University of Minnesota, 420 Delaware St SE, MMC 195, Minneapolis, MN, 55455, USA
- Institute for Health Informatics, University of Minnesota, Minneapolis, MN, USA
- Center for Learning Health Systems Science, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
3
|
Stewart RE, Cardamone NC, Shen L, Dallard N, Comeau C, Mandell DS, Bowen J, Rothbard A. Effect of Providing Evidence-Based Mental Health Treatment on Retention in Care Among Medicaid-Enrolled Youths. Psychiatr Serv 2024:appips20240066. [PMID: 39091172 DOI: 10.1176/appi.ps.20240066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/04/2024]
Abstract
OBJECTIVE Youths who start behavioral health treatment often stop before completing a therapeutic course of care. To increase treatment engagement and quality of care, the Evidence-Based Practice and Innovation Center in Philadelphia has incentivized use of evidence-based practices (EBPs) for mental health care of youths. The authors aimed to compare treatment outcomes between youths who received EBP care and those who did not. METHODS Using EBP-specific billing codes and propensity score matching, the authors compared treatment retention among youths who received trauma-focused cognitive-behavioral therapy (TF-CBT; N=413) or parent-child interaction therapy (PCIT; N=90) relative to matched samples of youths in standard outpatient therapy (N=503). RESULTS Youths with a minimum of one session of TF-CBT or PCIT attended a second session at higher rates than did youths in the matched control group (TF-CBT: 96% vs. 68%, p<0.01; PCIT: 94% vs. 69%, respectively, p<0.01). On average, these returning youths attended more sessions in the EBP groups than in the control group (TF-CBT: 15.9 vs. 11.5 sessions, p<0.01; PCIT: 11.2 vs. 6.9 sessions, p<0.01). CONCLUSIONS These findings indicate that, in addition to improving quality of care, EBP implementation helps address the major challenge that most youths who engage with treatment are not retained long enough for care to have therapeutic effects. Future research should examine the mechanisms through which EBPs can improve treatment retention.
Collapse
Affiliation(s)
- Rebecca E Stewart
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| | - Nicholas C Cardamone
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| | - Lisa Shen
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| | - Natalie Dallard
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| | - Carrie Comeau
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| | - David S Mandell
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| | - Jill Bowen
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| | - Aileen Rothbard
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia (Stewart, Cardamone, Shen, Mandell, Rothbard); Community Behavioral Health, Philadelphia (Dallard, Comeau); Department of Behavioral Health and Intellectual disAbility Services, Philadelphia (Bowen)
| |
Collapse
|
4
|
Marriott BR, Andrews JH, Cho E, Tugendrajch SK, Hawley KM. Mental Health Provider Reach and Engagement in a Countywide Training Initiative. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024; 51:530-542. [PMID: 38351412 DOI: 10.1007/s10488-024-01345-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/12/2024] [Indexed: 06/25/2024]
Abstract
Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.
Collapse
Affiliation(s)
- Brigid R Marriott
- Indiana University School of Medicine, Indianapolis, IN, USA.
- Department of Psychiatry, Indiana University School of Medicine, Indianapolis, IN, 46202, USA.
| | | | | | | | - Kristin M Hawley
- University of Missouri, Columbia, MO, USA.
- Department of Psychological Sciences, University of Missouri, Columbia, MO, 65211, USA.
| |
Collapse
|
5
|
Mora Ringle VA, Calloway A, Reich D, Oziel R, Walzer A, O'Connor S, Venti A, Comeau C, Williams T, Creed TA. What Really Matters in the Implementation of Evidence-based Practices in Community Mental Health? Insight and Recommendations from Experts, Providers, and Clients. Community Ment Health J 2024:10.1007/s10597-024-01307-1. [PMID: 38907842 DOI: 10.1007/s10597-024-01307-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Accepted: 06/02/2024] [Indexed: 06/24/2024]
Abstract
Perceptions of evidence-based practices (EBPs) and implementation are inherent drivers of implementation outcomes. Most studies on implementation perceptions have focused on direct service providers, but clients and EBP experts may offer additional meaningful information about implementing EBPs in community settings. EBP providers (n = 21), EBP experts (n = 12), and clients who received EBPs (n = 6) participated in focus groups to ascertain their perceptions of and experiences with EBP implementation, as part of a program evaluation. Thematic analysis indicated that provider and expert perceptions of EBP implementation in community settings converged around themes of implementation supports and training and client outcomes, along with several subthemes. Client perceptions centered on themes regarding the importance of their personal experiences, their impressions of EBPs, as well as their recommendation for increasing public awareness and use of EBPs. Findings suggest that the perspectives of EBP providers and experts are closely aligned, focusing on system-level, individual-level, and training issues that impact EBP implementation within a public mental health system. The themes that were important to clients were primarily related to their experiences as recipients of an EBP which produced insightful recommendations for promoting EBPs in the community.
Collapse
Affiliation(s)
| | - Amber Calloway
- Penn Collaborative for CBT and Implementation Science, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Danielle Reich
- Penn Collaborative for CBT and Implementation Science, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Rebecca Oziel
- Penn Collaborative for CBT and Implementation Science, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- King's College London, London, UK
| | - Arielle Walzer
- Penn Collaborative for CBT and Implementation Science, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Sydne O'Connor
- Penn Collaborative for CBT and Implementation Science, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Department of Neuro-Oncology, Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | - Amberlee Venti
- Community Behavioral Health (a division of Department of Behavioral Health and Intellectual disAbility Services), Philadelphia, PA, USA
| | - Carrie Comeau
- Community Behavioral Health (a division of Department of Behavioral Health and Intellectual disAbility Services), Philadelphia, PA, USA
| | - Tamra Williams
- Community Behavioral Health (a division of Department of Behavioral Health and Intellectual disAbility Services), Philadelphia, PA, USA
| | - Torrey A Creed
- Penn Collaborative for CBT and Implementation Science, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
6
|
Marshall CA, Cooke A, Gewurtz R, Barbic S, Roy L, Ross C, Becker A, Lysaght R, Kirsh B. Bridging the transition from homelessness: Developing an occupational therapy framework. Scand J Occup Ther 2023; 30:953-969. [PMID: 34582719 DOI: 10.1080/11038128.2021.1962970] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 06/10/2021] [Accepted: 07/27/2021] [Indexed: 10/20/2022]
Abstract
BACKGROUND Occupational therapists support individuals experiencing homelessness in traditional roles, and occupational therapy positions focussed specifically on homelessness appear to be growing. OBJECTIVES To develop and refine a framework to guide occupational therapy practice and research in homelessness. METHOD We developed a framework and refined it through a stakeholder consultation process conducted with 17 international occupational therapy experts using an online survey. In this survey, we presented an initial framework and requested qualitative feedback. We analyzed this qualitative data using content analysis. RESULTS Stakeholder feedback was categorized into eight recommendations: (1) Revision to the 'four processes'; (2) Emphasizing social justice and systems-level advocacy; (3) Reflecting intersectionality; (4) Emphasizing meaningful activity; (5) Emphasizing peer support; (6) Incorporating a focus on independent living skills; (7) Increasing a focus on an activity for addressing substance misuse; and (8) Acknowledging cognitive and physical health. Each of these recommendations was incorporated into a refined version of this framework. These recommendations and a refined version of the framework are presented in this paper. CONCLUSIONS We have developed and refined a framework aimed at guiding practice and research in occupational therapy in homelessness that will be evaluated in future research. SIGNIFICANCE Though a range of frameworks exists for guiding the practice of occupational therapists more generally, this framework represents the first that is focussed specifically on guiding occupational therapy practice and research with individuals who experience homelessness. Research and practice implications are discussed.
Collapse
Affiliation(s)
- Carrie Anne Marshall
- School of Occupational Therapy, Social Justice in Mental Health Research Lab, Faculty of Health Sciences, Western University, London, ON, Canada
| | - Abrial Cooke
- School of Occupational Therapy, Social Justice in Mental Health Research Lab, Faculty of Health Sciences, Western University, London, ON, Canada
| | - Rebecca Gewurtz
- School of Rehabilitation Sciences, McMaster University, Hamilton, Canada
| | - Skye Barbic
- Occupational Science & Occupational Therapy, Faculty of Medicine, Vancouver, Canada
| | - Laurence Roy
- School of Physical and Occupational Therapy, McGill University, Montreal, Canada
| | - Caitlin Ross
- Community Mental Health Services, Vancouver Island Health Authority, Victoria, Canada
| | - Alyssa Becker
- School of Occupational Therapy, Queens University, Dhaka, Bangladesh
- VHA Home Healthcare London, Canada
| | - Rosemary Lysaght
- School of Rehabilitation Therapy, Queen's University, Kingston, Canada
| | - Bonnie Kirsh
- Department of Occupational Science & Occupational Therapy, University of Toronto, Toronto, Canada
| |
Collapse
|
7
|
Frank HE, Rifkin LS, Sheehan K, Becker-Haimes E, Crane ME, Phillips KE, Palitz SA, Kemp J, Benito K, Kendall PC. Therapist perceptions of experiential training for exposure therapy. Behav Cogn Psychother 2023; 51:214-229. [PMID: 36805734 PMCID: PMC11006093 DOI: 10.1017/s1352465822000728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2023]
Abstract
BACKGROUND Despite evidence for its efficacy, exposure therapy for anxiety is rarely used in routine care settings. Efforts to address one major barrier to its use - therapists' negative beliefs about exposure - have included therapist-level implementation strategies, such as training and consultation. Experiential training, in which therapists themselves undergo exposures, has recently demonstrated feasibility, acceptability and preliminary effectiveness for increasing exposure use. AIMS This study aimed to assess: (1) therapists' perceptions of experiential training and (2) barriers and facilitators to implementing exposure following training. METHOD Therapists who underwent experiential training (n=12) completed qualitative interviews and quantitative questionnaires. Interviews were coded using an integrated approach, combining both inductive and deductive approaches. Mixed methods analyses examined how themes varied by practice setting (community mental health versus private practice) and exposure use. RESULTS Results highlight how therapist-level factors, such as clinician self-efficacy, interact with inner- and outer-setting factors. Participants reported positive perceptions of exposure after training; they noted that directly addressing myths about exposure and experiencing exposures themselves improved their attitudes toward exposure. Consistent with prior literature, issues such as insufficient supervisory support, organizational constraints, and client characteristics made it challenging to implement exposures. DISCUSSION Results highlight the benefits of experiential training, while also highlighting the need to consider contextual determinants. Differences in responses across practice settings highlight areas for intervention and the importance of tailoring implementation strategies. Barriers that were specific to therapists who did not use exposure (e.g. hesitancy about its appropriateness for most clients) point to directions for future implementation efforts.
Collapse
Affiliation(s)
- Hannah E. Frank
- Department of Psychiatry and Human Behavior, The Warren Alpert Medical School of Brown University
- Bradley Hospital, Lifespan Health System
- Department of Psychology, Temple University
| | | | - Kate Sheehan
- Department of Psychiatry and Human Behavior, The Warren Alpert Medical School of Brown University
- Bradley Hospital, Lifespan Health System
| | - Emily Becker-Haimes
- Department of Psychiatry, University of Pennsylvania
- Hall Mercer Community Mental Health, University of Pennsylvania Health System
| | | | | | | | - Joshua Kemp
- Department of Psychiatry and Human Behavior, The Warren Alpert Medical School of Brown University
- Bradley Hospital, Lifespan Health System
| | - Kristen Benito
- Department of Psychiatry and Human Behavior, The Warren Alpert Medical School of Brown University
- Bradley Hospital, Lifespan Health System
| | | |
Collapse
|
8
|
Quiroz-Saavedra R, Alfaro J, Rodríguez-Rivas ME. Perceptions of professionals about factors affecting the implementation of early childhood support systems: A case study evaluation from an ecological perspective. EVALUATION AND PROGRAM PLANNING 2023; 97:102210. [PMID: 36571969 DOI: 10.1016/j.evalprogplan.2022.102210] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Revised: 04/30/2022] [Accepted: 12/18/2022] [Indexed: 06/17/2023]
Abstract
This evaluation research looked at factors affecting collaboration across the various levels of implementation of early childhood support systems. An ecological conceptual framework was used to examine barriers and facilitators to implementing social and health care services from the perspective of the professionals involved at the national, state, and local level of government. A single case study following a qualitative research strategy was conducted with a total of 29 professionals from social development and health ministries, one municipality and a family health center responsible for implementing the Chile Grows with You system. The results show that at the national level, the main factors include socio-political aspects, funding, and the empathy that professional employees hold for peers who are at lower rungs in the hierarchy. At the state level workplace conditions play a key role. For the local level those factors include information system management and the political support of the local government. The discussion section emphasizes the relevance of considering the interdependence of such factors that influence implementation outcomes and the need to move away from a single program evaluation to a multilevel implementation analysis of public policy.
Collapse
Affiliation(s)
- Rodrigo Quiroz-Saavedra
- Universidad del Desarrollo, Faculty of Psychology, Av. Plaza 680, San Carlos de Apoquindo, Las Condes, Santiago 7610658, Chile.
| | - Jaime Alfaro
- Universidad del Desarrollo, Faculty of Psychology, Av. Plaza 680, San Carlos de Apoquindo, Las Condes, Santiago 7610658, Chile
| | - Matías E Rodríguez-Rivas
- Universidad del Desarrollo, Faculty of Psychology, Av. Plaza 680, San Carlos de Apoquindo, Las Condes, Santiago 7610658, Chile
| |
Collapse
|
9
|
Kendall PC, Maxwell CA, Jakubovic RJ, Ney JS, McKnight DS, Baker S. CBT for Youth Anxiety: How Does It Fit Within Community Mental Health? Curr Psychiatry Rep 2023; 25:13-18. [PMID: 36484914 DOI: 10.1007/s11920-022-01403-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/13/2022] [Indexed: 12/13/2022]
Abstract
PURPOSE OF REVIEW We review (1) the empirical literature for cognitive behavioral therapy (CBT) for youth anxiety delivered in community settings, (2) the use of online delivery methods in this process, and (3) identified barriers and facilitators to implementation of CBT for youth anxiety in community mental health clinics (CMHCs). We provide suggestions for future work. RECENT FINDINGS Meta-analytic reviews of effectiveness studies suggest that outcomes comparable to those of efficacy studies can be achieved in community settings, particularly when in-session exposures occur. Several online programs support delivery of these services, with an evidence base that is promising. The notable barrier to the implementation of services is the cost of implementation and sustainability. Organizational factors such as leadership, culture, and climate are consistently identified as barriers and facilitators depending on their valence and appear to be related to implementation outcomes (e.g., on provider attitudes). The current findings need to be integrated into future studies, with a focus on further identifying facilitators (e.g., champions and online programs) of implementation. There is also the need for efforts to address organizational and individual barriers and to compare ways to reduce costs.
Collapse
Affiliation(s)
- Philip C Kendall
- Department of Psychology and Neuroscience, Temple University, 1701 N. 13thStreet, Philadelphia, PA, 19122, USA.
| | - Colleen A Maxwell
- Department of Psychology and Neuroscience, Temple University, 1701 N. 13thStreet, Philadelphia, PA, 19122, USA
| | - Rafaella J Jakubovic
- Department of Psychology and Neuroscience, Temple University, 1701 N. 13thStreet, Philadelphia, PA, 19122, USA
| | - Julia S Ney
- Department of Psychology and Neuroscience, Temple University, 1701 N. 13thStreet, Philadelphia, PA, 19122, USA
| | - Dominique S McKnight
- Department of Psychology and Neuroscience, Temple University, 1701 N. 13thStreet, Philadelphia, PA, 19122, USA
| | - Samantha Baker
- Department of Clinical Psychology, Philadelphia College of Osteopathic Medicine, 4170 City Avenue, Philadelphia, PA, 19131, USA
| |
Collapse
|
10
|
Last BS, Johnson C, Dallard N, Fernandez-Marcote S, Zinny A, Jackson K, Cliggitt L, Rudd BN, Mills C, Beidas RS. Implementing trauma-focused cognitive behavioral therapy in Philadelphia: A 10-year evaluation. IMPLEMENTATION RESEARCH AND PRACTICE 2023; 4:26334895231199467. [PMID: 37790185 PMCID: PMC10496473 DOI: 10.1177/26334895231199467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/05/2023] Open
Abstract
Background: In 2012, Philadelphia's Department of Behavioral Health and Intellectual disAbility Services (DBHIDS) developed an initiative to implement an evidence-based treatment for posttraumatic stress disorder (PTSD), trauma-focused cognitive behavioral therapy (TF-CBT), across the city's behavioral health system. This report evaluates the initiative's 10-year implementation and effectiveness outcomes. Method: The Exploration, Preparation, Implementation, and Sustainment framework guided our implementation evaluation. The implementation outcomes include adoption, reach, and sustainment; these were obtained during regular evaluation data collection from publicly funded behavioral health agencies participating in the TF-CBT initiative. We analyze effectiveness outcomes (i.e., changes in PTSD symptoms) from a subset of patients receiving TF-CBT, which were collected in 6-month intervals by our research team between 2013 and 2021. Results: From 2012 to 2021, DBHIDS trained 478 clinicians in TF-CBT across 20 behavioral health agencies. During this time, 23,401 youths were screened for potentially traumatic events and PTSD symptoms, and 7,550 youths received TF-CBT. Through the TF-CBT initiative, the city expanded the network of TF-CBT providers from 3 to 20 agencies. DBHIDS sustained this network by maintaining the participation of 16 behavioral health agencies over the course of a decade. The subset of 202 youths who were evaluated to assess TF-CBT effectiveness was drawn from 94 therapists and 20 agencies across Philadelphia. All participating youths completed a baseline assessment, and 151 (75%) completed at least one follow-up assessment. Linear mixed-effects models accounting for observations nested within participants and nested within clinicians found that treatment significantly reduced PTSD symptoms. Conclusion: Between 2012 and 2021, DBHIDS successfully implemented and sustained TF-CBT across the city's behavioral health system. Adoption, reach, and sustainment of TF-CBT were high. Despite the considerable adverse experiences faced by youths seeking treatment in Philadelphia's behavioral health system, TF-CBT was effective. Future directions to improve TF-CBT implementation in the next iteration of the initiative are described.
Collapse
Affiliation(s)
- Briana S. Last
- Department of Psychology, Stony Brook University, Stony Brook, NY, USA
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Christina Johnson
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Natalie Dallard
- Community Behavioral Health, Philadelphia Department of Behavioral Health and Intellectual disAbility Services, Philadelphia, PA, USA
| | - Sara Fernandez-Marcote
- Community Behavioral Health, Philadelphia Department of Behavioral Health and Intellectual disAbility Services, Philadelphia, PA, USA
| | - Arturo Zinny
- Community Behavioral Health, Philadelphia Department of Behavioral Health and Intellectual disAbility Services, Philadelphia, PA, USA
- Center for Nonviolence and Social Justice, Dornsife School of Public Health, Drexel University, Philadelphia, PA, USA
| | - Kamilah Jackson
- Community Behavioral Health, Philadelphia Department of Behavioral Health and Intellectual disAbility Services, Philadelphia, PA, USA
- Talawa International Consultants, Philadelphia, PA, USA
| | - Lauren Cliggitt
- Hall-Mercer Community Mental Health Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Brittany N. Rudd
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA
| | - Chynna Mills
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Rinad S. Beidas
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| |
Collapse
|
11
|
Stakeholder engagement to inform evidence-based treatment implementation for children’s mental health: a scoping review. Implement Sci Commun 2022; 3:82. [PMID: 35906675 PMCID: PMC9338493 DOI: 10.1186/s43058-022-00327-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Accepted: 07/10/2022] [Indexed: 11/28/2022] Open
Abstract
Background There is a pervasive mental health treatment gap for children across the globe. Engaging stakeholders in child mental health evidence-based treatment (EBT) implementation projects may increase the likelihood of successful EBT implementation, thereby better addressing the treatment gap. However, little is known about the extent of stakeholder engagement to inform the implementation of child mental health EBTs. Methods We conducted a scoping review to characterize stakeholder engagement in child mental health EBT implementation projects, including what stakeholders are engaged, how they are engaged, when they are engaged, where they are engaged (i.e., location of projects), why they are engaged, and the reported impacts of stakeholder engagement. We searched seven databases: MEDLINE, PsycInfo, Embase, ERIC, CINAHL Complete, Scopus, and Web of Science Core Collection. To be included, studies had to report on some form of stakeholder engagement that was undertaken to inform or explain the implementation of a child mental health EBT. We performed data extraction and synthesis to describe key study and stakeholder characteristics, stakeholder engagement methods and rationales, reported impacts of stakeholder engagement, and quality of reporting on stakeholder engagement. Results In total, 122 manuscripts met our inclusion criteria, from which we identified a total of 103 unique child mental health EBT implementation projects. Projects spanned 22 countries, which included low-, lower-middle, upper-middle, and high-income countries. The largest number of projects was in the USA and conducted in public mental health settings. Most projects engaged EBT providers during the active implementation phase and with limited depth, often gathering information from stakeholders without sharing decision-making power in implementation efforts. Across projects, impacts of stakeholder engagement spanned all of Proctor and colleague’s implementation outcomes. Conclusions Given that stakeholder engagement is often shallow and with limited shared decision-making, additional effort should be made to increase engagement to preempt challenges to EBT implementation and ensure implementation success. Such efforts may ensure the just distribution of power in EBT implementation efforts. Trial registration All procedures were pre-registered on the Open Science Framework prior to conducting the literature search (DOI 10.17605/OSF.IO/GR9AP). Supplementary Information The online version contains supplementary material available at 10.1186/s43058-022-00327-w.
Collapse
|
12
|
Implementing the Strengths Model of Case Management: Assessing Practice Three Years After Initial Implementation. Community Ment Health J 2022; 58:1535-1543. [PMID: 35397721 DOI: 10.1007/s10597-022-00968-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/24/2021] [Accepted: 03/17/2022] [Indexed: 01/27/2023]
Abstract
While strengths approaches are important to recovery-oriented practice, implementation can be challenging. This study implemented the strengths model of case management (SMCM) in 11 CM teams and assessed the fidelity of delivery and staff perceptions of the model after 36 months using the SMCM fidelity scale and the Readiness Monitoring Tool. Paired sample t-tests assessed change in fidelity from baseline to 36 months. Adjusted regression analyses compared survey responses of direct and management staff. While fidelity ratings significantly improved across all domains, at 36 months they remained suboptimal in supervision practices and use of model tools. Staff perceptions were generally positive but consistently lower for front-line than management staff. Implementing SMCM into existing case management practice with good fidelity is feasible. However, clear support from management may strengthen staff motivation and delivery. A review of practice later in implementation can flag challenges for sustainability and guide implementation support.
Collapse
|
13
|
Riblet NB, Varela M, Ashby W, Zubkoff L, Shiner B, Pogue J, Stevens SP, Wasserman D, Watts BV. Spreading a Strategy to Prevent Suicide After Psychiatric Hospitalization: Results of a Quality Improvement Spread Initiative. Jt Comm J Qual Patient Saf 2022; 48:503-512. [PMID: 35382976 PMCID: PMC9445104 DOI: 10.1016/j.jcjq.2022.02.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Revised: 02/23/2022] [Accepted: 02/24/2022] [Indexed: 10/18/2022]
Abstract
BACKGROUND Suicide after psychiatric hospitalization is a major concern. Poor treatment engagement may contribute to risk. The World Health Organization Brief Intervention and Contact (BIC) Program is an evidence-based practice shown to prevent suicide after psychiatric discharge in international trials. There have been no efforts to implement BIC into routine practice in US populations. METHODS The authors conducted a 12-month quality improvement (QI) collaborative at six US Department of Veterans Affairs (VA) medical centers serving a large rural population. Sites had low to moderate performance on a VA quality measure of mental health postdischarge care; a measure assessing the proportion of discharged patients who achieve the required number of visits ≤ 30 days. Sites received programmatic support to implement BIC locally. Implementation was assessed using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. RESULTS Overall, teams had high participation in programmatic activities and enrolled 85% of eligible patients that they approached. Among 70 enrolled patients, 81.4% achieved the VA quality measure of mental health postdischarge care, suggesting good treatment engagement. On average, patients rated BIC as excellent. Team members agreed that BIC was easy to use, implementable, possible, and doable. Factors facilitating implementation included standardized operating procedures to standardize processes. Barriers included insufficient staffing and loss to follow-up. Most sites plan to continue to enroll patients and to expand BIC to other areas. CONCLUSION A QI collaborative can facilitate implementation of BIC in six VA facilities that provide inpatient psychiatric treatment. BIC may appeal to patients and providers and may improve treatment engagement.
Collapse
|
14
|
Pincus LE, Brumfield R, Brown LA. Consultation and professional development within the prolonged exposure initiative. JOURNAL OF COMMUNITY PSYCHOLOGY 2022; 50:2845-2856. [PMID: 35098546 DOI: 10.1002/jcop.22800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Revised: 01/04/2022] [Accepted: 01/05/2022] [Indexed: 06/14/2023]
Abstract
Previous studies have identified that ongoing consultation and organizational support are key factors in sustaining evidence-based implementation initiatives in community mental health. Clinician-level factors likely influence implementation but are not well delineated. This study assessed clinician-reported professional development incentives for participating in consultation in prolonged exposure (PE) therapy to guide future evidence-based practice (EBP) initiatives. Providers in the PE initiative (N = 22) completed a survey asking about their motivations to participate, the impact of consultation on the implementation of PE and their professional development goals, and the impact of organizational-level support on their goals and on organizational-level clinician turnover. Of the respondents, 10 had decided to pursue additional training to become PE consultants at their agencies. Providers (response rate = 22/35) reported joining the PE Initiative to learn an evidence-based practice in general (not PE specifically) and increase their skill in treating posttraumatic stress disorder. Providers largely found ongoing consultation helpful and reported that consultation provided the feedback and support necessary to achieve their professional goals. Providers who decided to pursue PE consultant training reported that expanding upon supervision and clinical skills were strong motivators. Providers largely attributed clinician turnover within the PE Initiative to organizational-level factors. Ongoing consultation facilitated providers' professional development goals. The survey identified several areas for further exploration, including how consultation can reduce clinician turnover, and how taking on additional responsibility within implementation initiatives can facilitate provider engagement in the EBP.
Collapse
Affiliation(s)
- Liza E Pincus
- Department of Psychiatry and Behavioral Sciences, Montefiore Medical Center, Bronx, New York, USA
| | - Roz Brumfield
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| | - Lily A Brown
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| |
Collapse
|
15
|
Oliveira P, Stevens E, Barge L, Comyn J, Langley K, Ramchandani P, Wright B, Woolgar M, Kennedy E, Byford S, Shearer J, Scott S, Barlow J, Glaser D, Senior R, Fonagy P, Fearon P. A modified video-feedback intervention for carers of foster children aged 6 years and under with reactive attachment disorder: a feasibility study and pilot RCT. Health Technol Assess 2022; 26:1-106. [PMID: 35959710 DOI: 10.3310/sliz1119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND Looked-after children are at risk of suboptimal attachment patterns and reactive attachment disorder. However, access to interventions varies widely and there are no evidence-based interventions for this disorder. OBJECTIVES (1) To adapt an existing video-feedback intervention to meet the specific needs of foster children in the UK with reactive attachment symptoms, (2) to conduct a case series to road-test the treatment manual and study procedures, (3) to conduct a scoping study of the key hurdles in a pilot trial and (4) to conduct a pilot randomised controlled trial of the adapted intervention to determine the feasibility of a future full-scale trial. DESIGN This was a mixed-methods study. The adapted treatment manual was developed with expert input and tested on a small case series. Qualitative interviews with key stakeholders were used in the scoping study in preparation for the trial and later with foster carers who received the new intervention. The final stage was a feasibility and pilot randomised controlled trial of the new intervention, compared with usual care. Researchers assessing the outcomes were blinded to group assignment. SETTING The study was set in outpatient child and adolescent mental health services and partner social services departments. Sites included urban and rural/semirural areas. PARTICIPANTS Participants were foster carers with children aged ≤ 6 years presenting with difficulties in the domain of reactive attachment disorder. Key stakeholders included children's services managers and mental health service practitioners in the scoping study. Foster carers who received the modified intervention participated in qualitative interviews. INTERVENTION The video-feedback intervention to promote positive parenting and sensitive discipline is an extensively evaluated and effective treatment approach. This intervention was modified (based on the adapted version for foster care in the Netherlands) to suit the needs of young children with reactive attachment symptoms in foster care in the UK and was delivered to improve the sensitive responding of foster carers, foster carer-child relationships and child outcomes. The modified intervention was delivered in-home by trained mental health professionals over a period of 4-6 months. MAIN OUTCOME MEASURE The main outcome was reactive attachment symptom scores on the Disturbances of Attachment Interview. RESULTS A series of minor changes to the intervention programme were introduced, which focused on improving its suitability for the UK foster care context. Challenges in recruitment meant that, despite numerous modifications to the protocol and the inclusion of additional sites, only 30 families (target, n = 40) were recruited to the randomised controlled trial (15 allocated to each group). However, most other trial parameters were deemed feasible and acceptable, particularly the high levels of data and treatment completeness. All randomised families were available for baseline analyses, but two in the treatment arm were not available for post-treatment analyses. The revised intervention was positively received by practitioners and foster carers. LIMITATIONS Only three-quarters of the target sample size was recruited. Furthermore, the sites' own exclusion of potential participants and the low return rates of screening questionnaires raise the possibility of non-randomness of non-responses. CONCLUSION A larger-scale trial may be feasible, but only if recruitment barriers can be overcome. Dedicated resources to support recruitment within local authorities and wider inclusion criteria are recommended. Central resourcing of intervention capacity to supplement NHS staff is also recommended. TRIAL REGISTRATION This trial is registered as ISRCTN18374094. FUNDING This project was funded by the National Institute for Health and Care Research ( NIHR ) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 35. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Paula Oliveira
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.,Anna Freud National Centre for Children and Families, London, UK
| | - Eloise Stevens
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.,Anna Freud National Centre for Children and Families, London, UK
| | - Lydia Barge
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.,Anna Freud National Centre for Children and Families, London, UK
| | - Julie Comyn
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
| | - Kirsty Langley
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
| | | | - Barry Wright
- Department of Health Sciences, University of York, York, UK
| | - Matt Woolgar
- National Adoption & Fostering Service, South London and Maudsley NHS Foundation Trust, London, UK.,Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Eilis Kennedy
- Research and Development Unit, Tavistock and Portman NHS Foundation Trust, London, UK
| | - Sarah Byford
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - James Shearer
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Stephen Scott
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Jane Barlow
- Department of Social Policy and Intervention, University of Oxford, Oxford, UK
| | - Danya Glaser
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
| | - Rob Senior
- Research and Development Unit, Tavistock and Portman NHS Foundation Trust, London, UK
| | - Peter Fonagy
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.,Anna Freud National Centre for Children and Families, London, UK
| | - Pasco Fearon
- Research Department of Clinical, Educational and Health Psychology, University College London, London, UK.,Anna Freud National Centre for Children and Families, London, UK
| |
Collapse
|
16
|
Squires JE, Hutchinson AM, Coughlin M, Bashir K, Curran J, Grimshaw JM, Dorrance K, Aloisio L, Brehaut J, Francis JJ, Ivers N, Lavis J, Michie S, Hillmer M, Noseworthy T, Vine J, Graham ID. Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-Country Analysis. Int J Health Policy Manag 2022; 11:1373-1390. [PMID: 34060269 PMCID: PMC9808341 DOI: 10.34172/ijhpm.2021.32] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Accepted: 03/13/2021] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND Context is recognized as important to successful knowledge translation (KT) in health settings. What is meant by context, however, is poorly understood. The purpose of the current study was to elicit tacit knowledge about what is perceived to constitute context by conducting interviews with a variety of health system stakeholders internationally so as to compile a comprehensive list of contextual attributes and their features relevant to KT in healthcare. METHODS A descriptive qualitative study design was used. Semi-structured interviews were conducted with health system stakeholders (change agents/KT specialists and KT researchers) in four countries: Australia, Canada, the United Kingdom, and the United States. Interview transcripts were analyzed using inductive thematic content analysis in four steps: (1) selection of utterances describing context, (2) coding of features of context, (3) categorizing of features into attributes of context, (4) comparison of attributes and features by: country, KT experience, and role. RESULTS A total of 39 interviews were conducted. We identified 66 unique features of context, categorized into 16 attributes. One attribute, Facility Characteristics, was not represented in previously published KT frameworks. We found instances of all 16 attributes in the interviews irrespective of country, level of experience with KT, and primary role (change agent/KT specialist vs. KT researcher), revealing robustness and transferability of the attributes identified. We also identified 30 new context features (across 13 of the 16 attributes). CONCLUSION The findings from this study represent an important advancement in the KT field; we provide much needed conceptual clarity in context, which is essential to the development of common assessment tools to measure context to determine which context attributes and features are more or less important in different contexts for improving KT success.
Collapse
Affiliation(s)
- Janet E. Squires
- Department of Health Sciences, School of Nursing, University of Ottawa, Ottawa, ON, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Alison M. Hutchinson
- Monash Health, Melbourne, VIC, Australia
- School of Nursing and Midwifery, Centre for Quality and Patient Safety Research, Institute for Health Transformation, Deakin University, Geelong, VIC, Australia
| | - Mary Coughlin
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Kainat Bashir
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| | - Janet Curran
- Faculty of Health, School of Nursing, Dalhousie University, Halifax, NS, Canada
- IWK Health Centre, Halifax, NS, Canada
| | - Jeremy M. Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
- Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
| | | | - Laura Aloisio
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Jamie Brehaut
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
| | - Jill J. Francis
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
- School of Health Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Noah Ivers
- Women’s College Hospital, Toronto, ON, Canada
| | - John Lavis
- McMaster University, Hamilton, ON, Canada
| | | | - Michael Hillmer
- Ontario Ministry of Health and Long-Term Care, Toronto, ON, Canada
| | | | | | - Ian D. Graham
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
| |
Collapse
|
17
|
Lee MJ, Maranda MJ, Magura S, Greenman G. References to Evidence-based Program Registry (EBPR) websites for behavioral health in U.S. state government statutes and regulations. JOURNAL OF APPLIED SOCIAL SCIENCE 2022; 16:442-458. [PMID: 35873708 PMCID: PMC9306327 DOI: 10.1177/19367244221078278] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
BACKGROUND AND AIM U.S. state governments have the responsibility to regulate and license behavioral healthcare interventions, such as for addiction and mental illness, with increasing emphasis on implementing evidence-based programs (EBPs). A serious obstacle to this is lack of clarity or agreement about what constitutes "evidence-based." The study's purpose was to determine the extent to which and in what contexts web-based Evidence-based Program Registries (EBPRs) are referenced in state government statutes and regulations ("mandates") concerning behavioral healthcare. Examples are: What Works Clearinghouse; National Register of Evidence-based Programs and Practices; Cochrane Database of Systematic Reviews. METHODS The study employed the Westlaw Legal Research Database to search for 30 known EBPR websites relevant to behavioral healthcare within the statutes and regulations of all 50 states. RESULTS There was low prevalence of EBPR references in state statutes and regulations pertaining to behavioral healthcare; 20 states had a total of 33 mandates that referenced an EBPR. These mandates usually do not rely on an EBPR as the sole acceptable source for classifying a program or practice as "evidence-based." Instead, EBPRs were named in conjunction with internal state or external sources of information about putative program effectiveness, which may be less valid than EBPRs, to determine what is "evidence-based." CONCLUSION Greater awareness of scientifically - based EBPRs and greater understanding of their advantages need to be fostered among state legislators and regulators charged with making policy to increase or improve the use of evidence-based programs and practices in behavioral healthcare in the U.S.
Collapse
Affiliation(s)
- Miranda J. Lee
- The Evaluation Center at Western Michigan University, Kalamazoo, MI
| | | | - Stephen Magura
- The Evaluation Center at Western Michigan University, Kalamazoo, MI
| | - Gregory Greenman
- The Evaluation Center at Western Michigan University, Kalamazoo, MI
| |
Collapse
|
18
|
Trauma-informed interventions for counselling sex trafficking survivors. INTERNATIONAL JOURNAL FOR THE ADVANCEMENT OF COUNSELLING 2022. [DOI: 10.1007/s10447-022-09465-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
19
|
Vroom EB, Massey OT, Akbari Z, Bristol SC, Cook B, Green AL, Levin BL, Tyson DM, Johnson ME. Exploring perceptions of implementation practice capacity in community-based behavioral health organizations. JOURNAL OF COMMUNITY PSYCHOLOGY 2022; 50:1700-1716. [PMID: 34797922 PMCID: PMC8917074 DOI: 10.1002/jcop.22749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 11/03/2021] [Accepted: 11/06/2021] [Indexed: 06/13/2023]
Abstract
Community-based organizations (CBOs) must have the capacity to adopt, implement, and sustain evidence-based practices (EBPs). However, limited research exists examining CBOs' ability/capacity to implement EBPs. The purpose of this preliminary study was to investigate how staff of CBOs perceive implementation practice capacity, determine factors needed for adequate capacity for implementing EBPs, and examine which perspectives of capacity are shared across organizational levels. Ninety-seven administrators and practitioners of CBOs were surveyed using the Implementation Capacity Survey, which examines perceived importance, presence, and organizational capacity of the CBO in nine implementation practice areas (IPAs) (e.g., leadership). Results revealed participants rated IPAs on the importance scale higher than IPAs on the present scale. Presence and organizational capacity scales were strongly correlated, and results showed significant differences between administrators and practitioners on ratings of presence and organizational capacity. Implications for future research aimed at examining/building implementation practice capacity in community settings will be discussed.
Collapse
Affiliation(s)
- Enya B Vroom
- Department of Epidemiology, College of Public Health and Health Professions and College of Medicine, University of Florida, Gainesville, Florida, USA
| | - Oliver T Massey
- Department of Child and Family Studies, College of Behavioral and Community Sciences, University of South Florida, Tampa, Florida, USA
| | - Zahra Akbari
- Department of Economics, College of Arts and Sciences, University of South Florida, Tampa, Florida, USA
| | - Skye C Bristol
- Department of Mental Health Law and Policy, College of Behavioral and Community Sciences, University of South Florida, Tampa, Florida, USA
| | - Brandi Cook
- Department of Chemistry, Cell Biology, Microbiology, and Molecular Biology, College of Arts and Sciences, University of South Florida, Tampa, Florida, USA
| | - Amy L Green
- Department of Child and Family Studies, College of Behavioral and Community Sciences, University of South Florida, Tampa, Florida, USA
| | - Bruce L Levin
- Department of Child and Family Studies, College of Behavioral and Community Sciences, University of South Florida, Tampa, Florida, USA
- College of Public Health, University of South Florida, Tampa, Florida, USA
| | - Dinorah M Tyson
- College of Public Health, University of South Florida, Tampa, Florida, USA
| | - Micah E Johnson
- Department of Mental Health Law and Policy, College of Behavioral and Community Sciences, University of South Florida, Tampa, Florida, USA
| |
Collapse
|
20
|
Brennan LA, Brady JE, Drummond KL, Wiltsey-Stirman S, Gutner CA, Iverson KM. Mental health clinician perspectives regarding factors impacting implementation of evidence-based psychotherapies in Veterans Health Administration community-based outpatient clinics. Gen Hosp Psychiatry 2022; 75:54-60. [PMID: 35182907 DOI: 10.1016/j.genhosppsych.2022.01.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 12/20/2021] [Accepted: 01/03/2022] [Indexed: 02/06/2023]
Abstract
OBJECTIVE Uptake of Evidence-Based Psychotherapies (EBPs) by mental health (MH) clinicians, especially in community settings, remains highly variable. This formative pilot study aimed to understand the attitudes and practices of Veterans Health Administration community-based MH clinicians regarding EBPs and to identify multi-level factors that enable and hinder EBP implementation in this unique context. METHODS Semi-structured interviews were conducted with MH clinicians (N = 40) working in community-based outpatient clinics (CBOCs) in metro/urban (n = 20) and non-metro/rural (n = 20) locations. Interviews were guided by the Consolidated Framework for Implementation Research and were analyzed using rapid content analysis. Results were organized by system-, clinician-, patient-, and innovation-levels. RESULTS EBPs were consistently perceived as important to delivering quality MH care, with most clinicians having received training in at least one VHA EBP. However, limited EBP training and consultation opportunities, inadequate autonomy to schedule EBP sessions, high and complex caseloads, and feelings of isolation at CBOCs decreased EPB use. Social workers perceived disparities in EBP training access relative to psychologists. Some barriers were more salient in non-metro/rural settings (e.g., patient-level privacy concerns). CONCLUSIONS Increased EBP training opportunities- particularly for social workers-, greater flexibility over schedules and caseloads, and more mechanisms for consultation and professional development may increase EBP uptake in community-based clinics.
Collapse
Affiliation(s)
- Laura A Brennan
- Women's Health Sciences Division, National Center for PTSD, VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, USA.
| | - Julianne E Brady
- Women's Health Sciences Division, National Center for PTSD, VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, USA; Center for Healthcare Organization and Implementation Research (CHOIR), VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, USA
| | - Karen L Drummond
- Center for Mental Healthcare & Outcomes Research, Central Arkansas Veterans Healthcare System (CAVHS), North Little Rock, AR, USA; Department of Psychiatry, University of Arkansas for Medical Sciences, North Little Rock, AR, United States of America
| | - Shannon Wiltsey-Stirman
- Dissemination and Training Division, National Center for PTSD, VA Palo Alto Healthcare System, 795 Willow Road, Menlo Park, CA, USA; Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, 401 Quarry Rd, Stanford, CA, USA
| | - Cassidy A Gutner
- ViiV Healthcare, Innovation & Implementation Science, Research Triangle, NC, USA; Department of Psychiatry, Boston University School of Medicine, 720 Harrison Avenue, Boston, MA, USA
| | - Katherine M Iverson
- Women's Health Sciences Division, National Center for PTSD, VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, USA; Center for Healthcare Organization and Implementation Research (CHOIR), VA Boston Healthcare System, 150 South Huntington Ave, Boston, MA, USA; Department of Psychiatry, Boston University School of Medicine, 720 Harrison Avenue, Boston, MA, USA.
| |
Collapse
|
21
|
Kuhn M, Gonzalez E, Weil L, Izguttinov A, Walker S. Effectiveness of Child-Focused Interventions for Externalizing Behavior: a Rapid Evidence Review. Res Child Adolesc Psychopathol 2022; 50:987-1009. [PMID: 35212851 DOI: 10.1007/s10802-022-00904-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/31/2022] [Indexed: 10/19/2022]
Abstract
Parent behavior management training (BMT) is well established as an effective, evidence-based treatment for children with externalizing behavior. Despite the wealth of data supporting BMT, many community providers use a variety of child-focused and non-directive interventions to target behavior problems. There is lack of clarity as to whether the evidence supporting child-focused externalizing treatments is sufficiently compelling to support offering these treatments rather than or in addition to BMT. This rapid evidence review compares the effectiveness of BMT with several common child-focused interventions for externalizing behavior including cognitive behavioral (CBT), social skill (SS), and play/dynamic (PT) approaches. PubMed, PsychINFO, and Web of Science were searched for English-language articles from year 2000 onwards for each intervention type. Inclusion criteria were child age (12 and under), presence of a child-focused behavioral treatment condition, and externalizing behavior as an outcome variable. A total of 30 studies met inclusion criteria and were coded (13 CBT, 10 SS, 7 PT). Results supported social skills interventions with accompanying BMT as effective in improving externalizing problems, with generally moderate effect sizes. Individual social skills interventions were promising but needing further evaluation compared to treatment as usual. CBT treatments with and without accompanying BMT showed moderate effects over waitlist but produced less consistently significant effects compared to more robust controls. Play therapy approaches showed inconsistent effects and require further evaluation. This review supports social skills plus BMT treatments as a child-focused intervention with probable efficacy for child externalizing problems. Implications for policy and community practice are discussed.
Collapse
Affiliation(s)
- M Kuhn
- Seattle Children's Hospital and Research Institute, Seattle, WA, USA. .,University of Washington Child and Adolescent Psychiatry, Seattle, WA, USA.
| | - E Gonzalez
- Seattle Children's Hospital and Research Institute, Seattle, WA, USA.,University of Washington Child and Adolescent Psychiatry, Seattle, WA, USA
| | - L Weil
- University of Washington Evidence Based Practice Institute, Seattle, WA, USA
| | - A Izguttinov
- University of Washington Evidence Based Practice Institute, Seattle, WA, USA
| | - S Walker
- University of Washington Evidence Based Practice Institute, Seattle, WA, USA
| |
Collapse
|
22
|
Prathivadi P, Buckingham P, Chakraborty S, Hawes L, Saha SK, Barton C, Mazza D, Russell G, Sturgiss E. Implementation science: an introduction for primary care. Fam Pract 2022; 39:219-221. [PMID: 34694348 DOI: 10.1093/fampra/cmab125] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Affiliation(s)
- Pallavi Prathivadi
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Philippa Buckingham
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Samantha Chakraborty
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Lesley Hawes
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.,National Centre for Antimicrobial Stewardship, Doherty Institute, Melbourne, Australia
| | - Sajal K Saha
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.,National Centre for Antimicrobial Stewardship, Doherty Institute, Melbourne, Australia.,Global and Tropical Health Division, Menzies School of Health Research, Charles Darwin University, Darwin, Australia
| | - Christopher Barton
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Danielle Mazza
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia.,National Centre for Antimicrobial Stewardship, Doherty Institute, Melbourne, Australia
| | - Grant Russell
- Department of General Practice, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Elizabeth Sturgiss
- School of Primary and Allied Health Care, Monash University, Melbourne, Australia
| |
Collapse
|
23
|
Lee-Easton MJ, Magura S, Maranda MJ. Utilization of Evidence-based Intervention Criteria in U.S. Federal Grant Funding Announcements for Behavioral Healthcare. INQUIRY: THE JOURNAL OF HEALTH CARE ORGANIZATION, PROVISION, AND FINANCING 2022; 59:469580221126295. [PMID: 36154326 PMCID: PMC9516425 DOI: 10.1177/00469580221126295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Recent U.S. federal government policy has required or recommended the use of evidence-based interventions (EBIs), so that it is important to determine the extent to which this priority is reflected in actual federal solicitations for intervention funding, particularly for behavioral healthcare interventions. Understanding how well such policies are incorporated in federal opportunity announcements (FOAs) for grant funding could improve compliance with policy and increase the societal use of evidence-based interventions for behavioral healthcare. FOAs for discretionary grants (n = 243) in fiscal year 2021 were obtained from the Grants.gov website for 44 federal departments, agencies and sub-agencies that were likely to fund interventions in behavioral health-related areas. FOAs for block/formula grants to states that included behavioral healthcare (n = 17) were obtained from the SAM.gov website. Across both discretionary and block grants, EBIs were required in 60% and recommended in 21% of these FOAs for funding. Numerous different terms were used to signify EBIs by the FOAs, with the greatest variation occurring among the block grants. Lack of adequate elaboration or definition of alternative EBI terms prominently characterized FOAs issued by the Department of Health and Human Services, although less so for those issued by the Departments of Justice and Education. Overall, 43% of FOAs referenced evidence-based program registers on the web, which are scientifically credible sources of EBIs. Otherwise, most of the remaining elaborations of EBI terms in these FOAs were quite brief, often idiosyncratic, and not scientifically vetted. The FOAs generally adhered to federal policy requiring or encouraging the use of EBIs for funding requests. However, an overall pattern showing lack or inadequate elaboration of terms signifying EBIs makes it difficult for applicants to comply with federal policies regarding use of EBIs for behavioral healthcare.
Collapse
Affiliation(s)
| | - Stephen Magura
- Western Michigan University, Kalamazoo,
MI, USA
- Stephen Magura, Western Michigan
University, 1903 W. Michigan Avenue, Kalamazoo, MI 49008, USA.
| | | |
Collapse
|
24
|
Hoffacker CP, Klein M, Becker-Haimes EM, Fishman J, Schoenwald SK, Fugo PB, McLeod BD, Dorsey S, Litke S, Shider L, Lieberman A, Mandell DS, Beidas RS. Stakeholder intention to engage in fidelity measurement methods in community mental health settings: A mixed methods study. IMPLEMENTATION RESEARCH AND PRACTICE 2022; 3:26334895221114664. [PMID: 37091084 PMCID: PMC9924256 DOI: 10.1177/26334895221114664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023] Open
Abstract
Background The current gold standard for measuring fidelity (specifically, adherence) to cognitive behavioral therapy (CBT) is direct observation, a costly, resource-intensive practice that is not feasible for many community organizations to implement regularly. Recent research indicates that behavioral rehearsal (i.e., role-play between clinician and individual with regard to session delivery) and chart-stimulated recall (i.e., brief structured interview between clinician and individual about what they did in session; clinicians use the client chart to prompt memory) may provide accurate and affordable alternatives for measuring adherence to CBT in such settings, with behavioral rehearsal yielding greater correspondence with direct observation. Methods Drawing on established causal theories from social psychology and leading implementation science frameworks, this study evaluates stakeholders’ intention to use behavioral rehearsal and chart-stimulated recall. Specifically, we measured attitudes, self-efficacy, and subjective norms toward using each, and compared these factors across the two methods. We also examined the relationship between attitudes, self-efficacy, subjective norms, and intention to use each method. Finally, using an integrated approach we asked stakeholders to discuss their perception of contextual factors that may influence beliefs about using each method. These data were collected from community-based supervisors ( n = 17) and clinicians ( n = 66). Results Quantitative analyses suggest moderately strong intention to use both methods across stakeholders. There were no differences in supervisors’ or clinicians’ attitudes, self-efficacy, subjective norms, or intention across methods. More positive attitudes and greater reported subjective norms were associated with greater reported intention to use either measure. Qualitative analyses identified participants’ specific beliefs about using each fidelity measure in their organization, and results were organized using the Consolidated Framework for Implementation Research. Conclusions Strategies are warranted to overcome or minimize potential barriers to using fidelity measurement methods and to further increase the strength of intention to use them. Plain Language Summary: The best way to measure fidelity, or how closely a clinician follows the protocol, to Cognitive Behavioral Therapy (CBT) is watching the session. This is an expensive practice that is not feasible for many community organizations to do regularly. Recent research indicates that behavioral rehearsal, or a role-play between the clinician and individual with regard to session delivery, and chart-stimulated recall, or a brief discussion between an individual and the clinician about what they did in session with the clinician having access to the chart to help them remember, may provide accurate and affordable alternatives for measuring fidelity to CBT. We just completed a study demonstrating that both methods are promising, with behavioral rehearsal offering scores that are the most similar to watching the session. Drawing on established theories from social psychology and leading implementation science frameworks, this study evaluates future supervisor and clinician motivation to use these fidelity measurement methods. Specifically, we measured supervisor (n = 17) and clinician (n = 66) attitudes, norms, self-efficacy, intentions, and anticipated barriers and facilitators to using each of these fidelity measurement tools. Quantitative and qualitative analyses suggest similar intention to use both methods, and concerns about barriers to using each method. Further research is warranted to minimize the burden associated with implementing fidelity measurement methods and deploying strategies to increase use.
Collapse
Affiliation(s)
- Carlin P. Hoffacker
- Department of Counseling and Educational Psychology, Indiana University, Bloomington, IN, USA
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
| | - Melanie Klein
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
| | - Emily M. Becker-Haimes
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
- Hall Mercer Community Mental Health, University of Pennsylvania Health System, Philadelphia, PA, USA
| | - Jessica Fishman
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA
- Message Effects Lab, Annenberg School for Communication, University of Pennsylvania, Philadelphia, PA, USA
| | | | - Perrin B. Fugo
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
| | - Bryce D. McLeod
- Department of Psychology, Virginia Commonwealth University, Richmond, VA, USA
| | - Shannon Dorsey
- Department of Psychology, University of Washington, Seattle, WA, USA
| | - Shannon Litke
- Department of Psychology, Drexel University, Philadelphia, PA, USA
| | - Lah’Nasia Shider
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
| | - Adina Lieberman
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
| | - David S. Mandell
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
| | - Rinad S. Beidas
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA
- Department of Medical Ethics and Health Policy, University of Pennsylvania, Philadelphia, PA, USA
- Department of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Penn Implementation Science Center at the Leonard Davis Institute (PISCE@LDI), University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
25
|
Stewart RE, Mandell DS, Beidas RS. Lessons From Maslow: Prioritizing Funding to Improve the Quality of Community Mental Health and Substance Use Services. Psychiatr Serv 2021; 72:1219-1221. [PMID: 33853379 PMCID: PMC8928566 DOI: 10.1176/appi.ps.202000209] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Evidence-based practices (EBPs) are frequently proposed as an approach to close the quality chasm in behavioral health treatment, and many U.S. municipalities are investing in EBPs as a primary way to improve the quality of care delivered to individuals most in need. In this Open Forum, the authors argue that EBPs often cannot be successfully implemented because basic organizational needs are not met in the current fiscal environment. The authors summarize research that supports why EBPs, along with other approaches to improve quality, are likely to fail until there is adequate financing. They also propose a policy and research agenda to ameliorate and address the fiscal challenges inherent in community mental health and substance use services.
Collapse
Affiliation(s)
- Rebecca E Stewart
- Department of Psychiatry, Perelman School of Medicine and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia (all authors); Penn Implementation Science Center at the Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia (Beidas)
| | - David S Mandell
- Department of Psychiatry, Perelman School of Medicine and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia (all authors); Penn Implementation Science Center at the Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia (Beidas)
| | - Rinad S Beidas
- Department of Psychiatry, Perelman School of Medicine and Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia (all authors); Penn Implementation Science Center at the Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia (Beidas)
| |
Collapse
|
26
|
Maxwell CA, Ehrhart MG, Williams NJ, Moore TM, Kendall PC, Beidas RS. The Organizational Financial Context of Publicly-Funded Mental Health Clinics: Development and Preliminary Psychometric Evaluation of the Agency Financial Status Scales. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2021; 48:780-792. [PMID: 33740163 DOI: 10.1007/s10488-021-01128-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/03/2021] [Indexed: 01/08/2023]
Abstract
Funding is a major barrier to implementation of evidence-based practices (EBPs) in publicly-funded community mental health clinics (CMHCs). Understanding how best to deploy implementation strategies that address this barrier requires greater clarity on the financial context within agencies. We developed the Agency Financial Status Scales (AFSS) to assess employee perceptions of the level of three hypothesized and theoretical funding related constructs in organizations: (a) perceptions of financial health, (b) financial attitudes toward EBPs, and (c) strategic financial climate. This investigation serves as a preliminary evaluation of this measure. Participants were 239 therapists and 40 supervisors from 25 publicly-funded CMHCs providing outpatient mental health services for young people. Confirmatory factor analysis was used to investigate the latent trait structure of the items. Internal consistency, interrater agreement, concordance between therapists and supervisors, and convergent validity were also examined. A two-factor model measuring perceptions of financial health and strategic financial climate best fit the data. For both of these scales, alpha reliability was acceptable and agreement statistics provided moderate support for aggregation at the organizational level. Analyses supported the convergent validity of the scales. The development and preliminary evaluation of the AFSS is an important first step in understanding the financial context of publicly-funded CMHCs. Though findings from this investigation are promising, additional development and testing are needed to develop a more thorough understanding of the constructs and to improve the validity and reliability of this measure.
Collapse
Affiliation(s)
| | - Mark G Ehrhart
- Department of Psychology, University of Central Florida, Orlando, USA
| | | | - Tyler M Moore
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd Floor, 3015, Philadelphia, PA, 19104, USA
| | | | - Rinad S Beidas
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd Floor, 3015, Philadelphia, PA, 19104, USA.
- Department of Medical Ethics and Health Policy, University of Pennsylvania Perelman School of Medicine, Philadelphia, USA.
- Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, USA.
- Penn Implementation Science Center At the Leonard Davis Institute of Health Economics (PISCE@LDI), University of Pennsylvania, Philadelphia, USA.
- Center for Health Incentives and Behavioral Economics (CHIBE), University of Pennsylvania Perelman School of Medicine, Philadelphia, USA.
| |
Collapse
|
27
|
Knight D, Becan J, Olson D, Davis NP, Jones J, Wiese A, Carey P, Howell D, Knight K. Justice community opioid innovation network (JCOIN): The TCU research hub. J Subst Abuse Treat 2021; 128:108290. [PMID: 33487517 DOI: 10.1016/j.jsat.2021.108290] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 11/10/2020] [Accepted: 01/12/2021] [Indexed: 02/07/2023]
Abstract
Recognizing the current opioid crisis among justice-involved individuals and the need to intervene at the intersection of justice and community health, the JCOIN TCU hub study explores outcomes associated with a multi-level hybrid implementation approach. The study capitalizes on facilitated collaboration, training, and cross-system data sharing to leverage improvements in criminal justice (CJ) and community behavioral health (CBH) interagency collaboration. The goal is to improve local community public health and safety outcomes for reentering justice-involved individuals who have a history of (or are at risk for) using opioids. The study compares two implementation strategies: one (vertical) in which all units in a community are trained and begin the program simultaneously and another (horizontal) in which one lead-off unit in the community is trained as a prototype of the program, the prototype is tested and refined, and then the lead-off unit helps to train other units within the community. Specific aims are to 1) increase access to and retention in CBH and medications for opioid use disorder services; 2) improve outcomes associated with public health and safety; 3) compare two implementation strategies on systems-level outcomes designed to increase service initiation and receipt of implementation and services; and 4) examine the impact of these strategies on justice-involved individuals' outcomes. The study examines both implementation and implementation-effectiveness, seeking to answer the questions of which implementation strategy is most effective for rapid and sustainable uptake of evidence-based practices and for increasing service linkage and initiation, services retention, and improved opioid-related public health safety outcomes. The study uses a hybrid type 3 study design. The study's primary aim is to compare two implementation strategies and two interventions at two levels (client and system), with a secondary aim to assess client-level outcomes associated with the trial. The study design integrates 2 robust methodologies (stepped wedge and cluster randomized trial), and plans to include 18 research performance sites (communities) located in Texas, New Mexico, and Illinois. The study will contribute to the JCOIN network's effort to establish a national consortium of investigators examining promising strategies to enhance the capabilities and capacity of the justice system to more effectively address the opioid epidemic.
Collapse
|
28
|
Lui JHL, Brookman-Frazee L, Lind T, Le K, Roesch S, Aarons GA, Innes-Gomberg D, Pesanti K, Lau AS. Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children's mental health services. Implement Sci 2021; 16:82. [PMID: 34412666 PMCID: PMC8375074 DOI: 10.1186/s13012-021-01149-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 08/04/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Although there is increasing investment to implement evidence-based practices (EBPs) in public systems across the USA, continued or sustained use of EBPs after initial implementation remains a challenge. The low integration of EBPs in routine practice severely limits their public health impact, highlighting the need to understand factors that affect the return on costly investments in EBP implementation. This study aims to (1) characterize trajectories of EBP delivery volume through a reimbursement-driven implementation and (2) examine impacts of system-level policy regulatory activity and state-level mental health services funding on the implementation reimbursement strategy. METHODS This study involved secondary data analyses. Psychotherapy administrative claims and regulatory site visit data from the Los Angeles County Department of Mental Health and California state mental health expenditures were extracted from 2010 to 2017. Multilevel regression examined EBP claims volume over time with state expenditures and regulatory compliance as predictors. RESULTS EBP claims volume trajectories demonstrated a rapid initial increase, followed by a period of decrease, and a small increase in the final year. State mental health expenditures increased across time reflecting increased funding availability. State mental health expenditures and system regulatory compliance were inversely related to EBP claims volume. CONCLUSIONS The impact of reimbursement-driven EBP implementation strategy is sensitive to multiple outer-context determinants. At the system level, commitment to fidelity of implementation regulations resulted in reduced use of the reimbursement strategy. Alternative reimbursement streams not tied to EBPs coupled with an expanded array of reimbursable services also impacted the use of the reimbursement strategy to implement EBPs.
Collapse
Affiliation(s)
- Joyce H L Lui
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Psychology, University of Maryland, College Park, College Park, MD, USA.
| | - Lauren Brookman-Frazee
- Department of Psychiatry, University of California, San Diego, San Diego, CA, USA
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | - Teresa Lind
- Department of Psychiatry, University of California, San Diego, San Diego, CA, USA
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | - Kenny Le
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Scott Roesch
- Child and Adolescent Services Research Center, San Diego, CA, USA
- Department of Psychology, San Diego State University, San Diego, CA, USA
| | - Gregory A Aarons
- Department of Psychiatry, University of California, San Diego, San Diego, CA, USA
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | | | - Keri Pesanti
- Los Angeles County Department of Mental Health, Los Angeles, CA, USA
| | - Anna S Lau
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
29
|
Applying the Exploration, Preparation, Implementation, Sustainment (EPIS) Framework to Safe Surgery 2020 Implementation in Tanzania's Lake Zone. J Am Coll Surg 2021; 233:177-191.e5. [PMID: 33957259 DOI: 10.1016/j.jamcollsurg.2021.04.006] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 04/06/2021] [Accepted: 04/06/2021] [Indexed: 01/06/2023]
Abstract
BACKGROUND Access to safe, high-quality surgical care in sub-Saharan Africa is a critical gap. Interventions to improve surgical quality have been developed, but research on their implementation is still at a nascent stage. We retrospectively applied the Exploration, Preparation, Implementation, Sustainment framework to characterize the implementation of Safe Surgery 2020, a multicomponent intervention to improve surgical quality. METHODS We used a longitudinal, qualitative research design to examine Safe Surgery 2020 in 10 health facilities in Tanzania's Lake Zone. We used documentation analysis with confirmatory key informant interviews (n = 6) to describe the exploration and preparation phases. We conducted interviews with health facility leaders and surgical team members at 1, 6, and 12 months (n = 101) post initiation to characterize the implementation phase. Data were analyzed using the constant comparison method. RESULTS In the exploration phase, research, expert consultation, and scoping activities revealed the need for a multicomponent intervention to improve surgical quality. In the preparation phase, onsite visits identified priorities and barriers to implementation to adapt the intervention components and curriculum. In the active implementation phase, 4 themes related to the inner organizational context-vision for safe surgery, existing surgical practices, leadership support, and resilience-and 3 themes related to the intervention-innovation-value fit, holistic approach, and buy-in-facilitated or hindered implementation. Interviewees perceived improvements in teamwork and communication and intra- and inter-facility learning, and their need to deliver safe surgery evolved during the implementation period. CONCLUSIONS Examining implementation through the exploration, preparation, implementation, and sustainment phases offers insights into the implementation of interventions to improve surgical quality and promote sustainability.
Collapse
|
30
|
Maranda MJ, Magura S, Gugerty R, Lee MJ, Landsverk JA, Rolls-Reutz J, Green B. State behavioral health agency website references to evidence-based program registers. EVALUATION AND PROGRAM PLANNING 2021; 85:101906. [PMID: 33567376 PMCID: PMC7932747 DOI: 10.1016/j.evalprogplan.2021.101906] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 08/19/2020] [Accepted: 01/18/2021] [Indexed: 05/27/2023]
Abstract
PURPOSE Evidence-based program registers (EBPRs) are important tools for facilitating the use of evidence-based practices or programs (EBPs) by state statutory agencies responsible for behavioral healthcare, broadly defined as substance misuse, mental health, HIV/AIDS prevention, child welfare, and offender rehabilitation. There are currently no data on the purposes for which such state agencies reference EBPRs on their official websites. METHOD A webscraping method was used to identify and classify relevant "hits", defined as a state behavioral health webpage with single or multiple references to a study EBPR. A total of 778 hits (unique combinations of webpage and register) were coded. Up to three codes were applied to each hit for the "reasons for the EBPR reference" (EBPR use) dimension, one code was applied to each hit for the "purpose of the EBPR reference" and "intended audience of the webpage containing the hit" dimensions, and up to two codes were applied to each hit for the "funding mentions" dimension. RESULTS Three EBPRs out of 28 accounted for 73.6% of the hits. The most frequent reason for referencing EBPRs were as a resource for selecting EBPs or validating existing programs and practices. The references tended to appear in reports from the state, in training materials, or guidelines. The references tended to address broad groups of behavioral healthcare professionals. EBPRs were frequently referenced in the context of federal block grants or other federal funding. CONCLUSIONS Increasing state agencies' awareness and use of the entire range of existing EBPRs may improve implementation of EBPs nationally.
Collapse
Affiliation(s)
- Michael J Maranda
- Western Michigan University, 1903 W. Michigan Avenue, Kalamazoo MI 49008, USA
| | - Stephen Magura
- Western Michigan University, 1903 W. Michigan Avenue, Kalamazoo MI 49008, USA.
| | | | - Miranda J Lee
- Western Michigan University, 1903 W. Michigan Avenue, Kalamazoo MI 49008, USA
| | - John A Landsverk
- Oregon Social Learning Center, 10 Shelton McMurphey Blvd, Eugene, OR 97401, USA
| | - Jennifer Rolls-Reutz
- Chadwick Center for Children and Families, 3020 Children's Way-Mailcode 5131, San Diego CA 92123, USA
| | - Brandn Green
- Development Services Group Inc., 7315 Wisconsin Avenue, 800 East Bethesda, MD 20814-3210, USA
| |
Collapse
|
31
|
Triplett NS, Woodard GS, AlRasheed R, Meza RD, Robinson S, Berliner L, Dorsey S. Application of Evidence-Based Treatment in Community Mental Health Settings: Examining EBT Delivery Duration and Client Discharge. J Behav Health Serv Res 2021; 48:617-624. [PMID: 33754288 DOI: 10.1007/s11414-021-09755-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/07/2021] [Indexed: 11/24/2022]
Abstract
Characterizing community mental health (CMH) treatment duration and discharge is an important step toward understanding how to better meet client needs. This report describes patterns of treatment duration and discharge among clinicians participating in a state-funded evidence-based treatment (EBT) training initiative. After training and consultation, clinicians (N = 376) reported on treatment duration and discharge for their "most complete case." On average, clinicians delivered 12.4 sessions (SD = 5.1) of the treatment. After completing treatment, half of clinicians (58.7%) continued with regularly scheduled therapy, either using EBT elements or switching to supportive therapy. Clinicians who continued with regularly scheduled therapy delivered treatment in approximately the same number of sessions. Results revealed that CMH clinicians often do not discontinue therapy after completing a treatment protocol. These findings suggest it may be essential to better understand clinician decision-making around applying EBTs to their caseloads.
Collapse
Affiliation(s)
- Noah S Triplett
- Department of Psychology, University of Washington, 119A Guthrie Hall, Box 351525, Seattle, WA, 98105, USA.
| | - Grace S Woodard
- Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33124, USA
| | - Rashed AlRasheed
- Department of Psychology, University of Washington, 119A Guthrie Hall, Box 351525, Seattle, WA, 98105, USA
| | - Rosemary D Meza
- Department of Psychology, University of Washington, 119A Guthrie Hall, Box 351525, Seattle, WA, 98105, USA
| | - Sophia Robinson
- Department of Psychology, University of Washington, 119A Guthrie Hall, Box 351525, Seattle, WA, 98105, USA
| | - Lucy Berliner
- Harborview Center for Sexual Assault and Traumatic Stress, 401 Broadway, Suite 2027, Seattle, WA, 98122, USA
| | - Shannon Dorsey
- Department of Psychology, University of Washington, 119A Guthrie Hall, Box 351525, Seattle, WA, 98105, USA
| |
Collapse
|
32
|
Bullock HL, Lavis JN, Wilson MG, Mulvale G, Miatello A. Understanding the implementation of evidence-informed policies and practices from a policy perspective: a critical interpretive synthesis. Implement Sci 2021. [PMID: 33588878 DOI: 10.1186/s13012‐021‐01082‐7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
BACKGROUND The fields of implementation science and knowledge translation have evolved somewhat independently from the field of policy implementation research, despite calls for better integration. As a result, implementation theory and empirical work do not often reflect the implementation experience from a policy lens nor benefit from the scholarship in all three fields. This means policymakers, researchers, and practitioners may find it challenging to draw from theory that adequately reflects their implementation efforts. METHODS We developed an integrated theoretical framework of the implementation process from a policy perspective by combining findings from these fields using the critical interpretive synthesis method. We began with the compass question: How is policy currently described in implementation theory and processes and what aspects of policy are important for implementation success? We then searched 12 databases as well as gray literature and supplemented these documents with other sources to fill conceptual gaps. Using a grounded and interpretive approach to analysis, we built the framework constructs, drawing largely from the theoretical literature and then tested and refined the framework using empirical literature. RESULTS A total of 11,434 documents were retrieved and assessed for eligibility and 35 additional documents were identified through other sources. Eighty-six unique documents were ultimately included in the analysis. Our findings indicate that policy is described as (1) the context, (2) a focusing lens, (3) the innovation itself, (4) a lever of influence, (5) an enabler/facilitator or barrier, or (6) an outcome. Policy actors were also identified as important participants or leaders of implementation. Our analysis led to the development of a two-part conceptual framework, including process and determinant components. CONCLUSIONS This framework begins to bridge the divide between disciplines and provides a new perspective about implementation processes at the systems level. It offers researchers, policymakers, and implementers a new way of thinking about implementation that better integrates policy considerations and can be used for planning or evaluating implementation efforts.
Collapse
Affiliation(s)
- Heather L Bullock
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.
| | - John N Lavis
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.,McMaster Health Forum, Hamilton, Canada
| | - Michael G Wilson
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.,McMaster Health Forum, Hamilton, Canada
| | - Gillian Mulvale
- DeGroote School of Business, McMaster University, Burlington, Canada
| | - Ashleigh Miatello
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada
| |
Collapse
|
33
|
Bullock HL, Lavis JN, Wilson MG, Mulvale G, Miatello A. Understanding the implementation of evidence-informed policies and practices from a policy perspective: a critical interpretive synthesis. Implement Sci 2021; 16:18. [PMID: 33588878 PMCID: PMC7885555 DOI: 10.1186/s13012-021-01082-7] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2020] [Accepted: 01/07/2021] [Indexed: 12/19/2022] Open
Abstract
BACKGROUND The fields of implementation science and knowledge translation have evolved somewhat independently from the field of policy implementation research, despite calls for better integration. As a result, implementation theory and empirical work do not often reflect the implementation experience from a policy lens nor benefit from the scholarship in all three fields. This means policymakers, researchers, and practitioners may find it challenging to draw from theory that adequately reflects their implementation efforts. METHODS We developed an integrated theoretical framework of the implementation process from a policy perspective by combining findings from these fields using the critical interpretive synthesis method. We began with the compass question: How is policy currently described in implementation theory and processes and what aspects of policy are important for implementation success? We then searched 12 databases as well as gray literature and supplemented these documents with other sources to fill conceptual gaps. Using a grounded and interpretive approach to analysis, we built the framework constructs, drawing largely from the theoretical literature and then tested and refined the framework using empirical literature. RESULTS A total of 11,434 documents were retrieved and assessed for eligibility and 35 additional documents were identified through other sources. Eighty-six unique documents were ultimately included in the analysis. Our findings indicate that policy is described as (1) the context, (2) a focusing lens, (3) the innovation itself, (4) a lever of influence, (5) an enabler/facilitator or barrier, or (6) an outcome. Policy actors were also identified as important participants or leaders of implementation. Our analysis led to the development of a two-part conceptual framework, including process and determinant components. CONCLUSIONS This framework begins to bridge the divide between disciplines and provides a new perspective about implementation processes at the systems level. It offers researchers, policymakers, and implementers a new way of thinking about implementation that better integrates policy considerations and can be used for planning or evaluating implementation efforts.
Collapse
Affiliation(s)
- Heather L Bullock
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.
| | - John N Lavis
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.,McMaster Health Forum, Hamilton, Canada
| | - Michael G Wilson
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.,McMaster Health Forum, Hamilton, Canada
| | - Gillian Mulvale
- DeGroote School of Business, McMaster University, Burlington, Canada
| | - Ashleigh Miatello
- Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada
| |
Collapse
|
34
|
Implementation of School-Based Behavioral Health Services Over Time: A Longitudinal, Multi-level Qualitative Study. SCHOOL MENTAL HEALTH 2021. [DOI: 10.1007/s12310-020-09407-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
35
|
Abstract
Over the last several decades, significant progress has been made in the discovery of appropriate therapy in the management of infantile spasms (IS). Based on several well-controlled studies, the American Academy of Neurology and the Child Neurology Society have published the current best practice parameters for the treatment of IS. However, dissemination and implementation of evidence-based guidelines remain a significant challenge. Though the number of well-performed controlled trials and systematic reviews is increasing exponentially, the proportion of valuable new information subsequently embedding into the routine clinical care is significantly lower. Planned and systematic implementation of evidence-based interventions in a given health care structure may outstrip the benefits of discovering a new insight, procedure, or drug in another controlled setting. Implementation problems can be broad-ranging to hinder effective, efficient, safe, timely, and patient-centered care without significant variation. The first part of this review article provides a detailed summary of some crucial comparative treatment studies of IS available in the literature. In the second part, practical challenges to mitigate the gap between knowledge and practice to improve outcomes in the management of IS has been explored, and a consolidated framework approach for systematic implementation research methodology has been discussed to implement evidence-based guidelines for the management of IS. Although large multicenter controlled studies will help gather quality evidence in the treatment of IS, a more comprehensive range of scientific methodologies, including qualitative research and mixed research methodologies, will hold the more considerable promise for implementing evidence-based practices in the health care system.
Collapse
Affiliation(s)
- Debopam Samanta
- Child Neurology Section, Department of Pediatrics, University of Arkansas for Medical Sciences, Little Rock, Arkansas, United States
| |
Collapse
|
36
|
Gumport NB, Yu SH, Harvey AG. Implementing a transdiagnostic sleep and circadian intervention in a community mental health setting: A qualitative process evaluation with community stakeholders. Psychiatry Res 2020; 293:113443. [PMID: 32890862 DOI: 10.1016/j.psychres.2020.113443] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 08/27/2020] [Accepted: 08/29/2020] [Indexed: 10/23/2022]
Abstract
The implementation of evidence-based psychological treatments (EBPTs) may be particularly challenging to accomplish in community mental health settings for individuals with severe mental illness (SMI). Transdiagnostic treatments, or treatments that target a mechanism that underpins multiple mental health problems, may be particularly well-suited to community mental health settings. This study examines community stakeholder perspectives (N = 22) of the Transdiagnostic Sleep and Circadian Intervention (TranS-C) implemented in a community mental health setting in the context of a randomized controlled trial of TranS-C for SMI. The present study aimed to identify barriers and facilitators to the implementation of TranS-C for SMI in a community mental health setting using (1) a deductive theory-based process based on the Framework for Dissemination in Health Services Intervention Research and (2) an inductive thematic analysis process. All deductive themes were identified as both barriers and facilitators to the implementation of EBPTs and TranS-C in this community mental health setting. Seven additional themes were identified through the inductive thematic analysis. A discussion of how the findings are related to prior research, other EBPT implementation, and future TranS-C implementation are included.
Collapse
Affiliation(s)
- Nicole B Gumport
- Department of Psychology, University of California, 2121 Berkeley Way #1650, Berkeley, CA, United States
| | - Stephanie H Yu
- Department of Psychology, University of California, 2121 Berkeley Way #1650, Berkeley, CA, United States; Department of Psychology, University of California, Los Angeles, CA, United States
| | - Allison G Harvey
- Department of Psychology, University of California, 2121 Berkeley Way #1650, Berkeley, CA, United States.
| |
Collapse
|
37
|
Lindholm LH, Laitila M, Lassila A, Kampman O. Importance of congruence between communicating and executing implementation programmes: a qualitative study of focus group interviews. Implement Sci Commun 2020; 1:94. [PMID: 33292835 PMCID: PMC7594330 DOI: 10.1186/s43058-020-00090-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2020] [Accepted: 10/19/2020] [Indexed: 11/29/2022] Open
Abstract
Background The Ostrobothnia Depression Programme (ODP) in Finland was intended to implement two evidence-based brief psychotherapy interventions, namely motivational interview and behavioural activation, in several regional psychiatric teams. A simultaneous effectiveness study was conducted. Considerable tension was encountered between these two arms, causing resistance to change. We conducted a qualitative case study to better understand this tension and to discuss how managerial and executive practices may ensure the successful running of a hybrid design programme. Methods We conducted focus group interviews to evaluate the phases of preparation and practical execution of the ODP from the perspectives of management and the programme executives. To gather the data, we applied the revised Socratic approach for health technology assessment and focus group interviews. We analysed the data deductively according to the Normalization Process Theory. Results We identified two main critical issues: (1) The ODP programme plan ignored the team leaders’ crucial role in influencing the implementation climate and mobilizing organizational strategies. The ODP had a simplistic top-down design with minimal and delayed collaboration with its target groups in the preparation phase. (2) Incongruence occurred between what the project group had explicitly communicated about being the spearhead of the ODP and what they then actually enacted. These two issues caused tension between the implementation efforts and the effectiveness study as well as resistance to change among the staff. Conclusion Early, open collaboration with all prospective stakeholders towards a shared understanding about the programme is the first action the programme administrators should take. Agreement on goals and the means to achieve them would lower tension between the two arms of a hybrid design programme, thereby reducing resistance to change. Congruence between the goals communicated and the actual managerial and executive actions is of paramount importance in getting the programme recipients on board. Supplementary Information The online version contains supplementary material available at 10.1186/s43058-020-00090-w.
Collapse
Affiliation(s)
- Lars H Lindholm
- Department of Psychiatry, South Ostrobothnia Hospital District, Hanneksenrinne 7, FI-60220, Seinäjoki, Finland. .,Faculty of Medicine and Health Technology, Tampere University, PO Box 100, FI-33014, Tampere, Finland.
| | - Minna Laitila
- Department of Psychiatry, South Ostrobothnia Hospital District, Hanneksenrinne 7, FI-60220, Seinäjoki, Finland
| | - Antero Lassila
- Department of Psychiatry, South Ostrobothnia Hospital District, Hanneksenrinne 7, FI-60220, Seinäjoki, Finland
| | - Olli Kampman
- Department of Psychiatry, South Ostrobothnia Hospital District, Hanneksenrinne 7, FI-60220, Seinäjoki, Finland.,Faculty of Medicine and Health Technology, Tampere University, PO Box 100, FI-33014, Tampere, Finland.,Department of Psychiatry, Pirkanmaa Hospital District, PO Box 2000, FI-33521, Tampere, Finland
| |
Collapse
|
38
|
Powell BJ, Patel SV, Haley AD, Haines ER, Knocke KE, Chandler S, Katz CC, Seifert HP, Ake G, Amaya-Jackson L, Aarons GA. Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 47:705-719. [PMID: 31813066 PMCID: PMC7275881 DOI: 10.1007/s10488-019-01003-3] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.
Collapse
Affiliation(s)
- Byron J Powell
- Brown School, Washington University in St. Louis, St. Louis, USA.
| | - Sheila V Patel
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
- RTI International, Durham, USA
| | - Amber D Haley
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
| | - Emily R Haines
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
- RTI International, Durham, USA
| | - Kathleen E Knocke
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
| | - Shira Chandler
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
| | - Colleen Cary Katz
- Silberman School of Social Work, Hunter College, City University of New York, New York, USA
| | | | - George Ake
- Duke University School of Medicine, Durham, USA
| | - Lisa Amaya-Jackson
- Center for Child and Family Health, Durham, USA
- Duke University School of Medicine, Durham, USA
| | - Gregory A Aarons
- Child and Adolescent Services Research Center, University of California at San Diego School of Medicine, San Diego, USA
| |
Collapse
|
39
|
Frank HE, Becker-Haimes EM, Kendall PC. Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes. CLINICAL PSYCHOLOGY-SCIENCE AND PRACTICE 2020; 27:e12330. [PMID: 34092941 PMCID: PMC8174802 DOI: 10.1111/cpsp.12330] [Citation(s) in RCA: 69] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2019] [Accepted: 01/07/2020] [Indexed: 12/20/2022]
Abstract
A lack of effective therapist training is a major barrier to evidence-based intervention (EBI) delivery in the community. Systematic reviews published nearly a decade ago suggested that traditional EBI training leads to higher knowledge but not more EBI use, indicating that more work is needed to optimize EBI training and implementation. This systematic review synthesizes the training literature published since 2010 to evaluate how different training models (workshop, workshop with consultation, online training, train-the-trainer, and intensive training) affect therapists' knowledge, beliefs, and behaviors. Results and limitations for each approach are discussed. Findings show that training has advanced beyond provision of manuals and brief workshops; more intensive training models show promise for changing therapist behavior. However, methodological issues persist, limiting conclusions and pointing to important areas for future research.
Collapse
Affiliation(s)
- Hannah E. Frank
- Psychology Department, Temple University, Philadelphia, Pennsylvania
| | - Emily M. Becker-Haimes
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA
- Hall Mercer Community Mental Health, Philadelphia, Pennsylvania
| | - Philip C. Kendall
- Psychology Department, Temple University, Philadelphia, Pennsylvania
| |
Collapse
|
40
|
Leffler JM, D'Angelo EJ. Implementing Evidence-Based Treatments for Youth in Acute and Intensive Treatment Settings. J Cogn Psychother 2020; 34:185-199. [PMID: 32817401 DOI: 10.1891/jcpsy-d-20-00018] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Evidence-based treatments (EBTs) have been well studied in outpatient and research settings to address a myriad of mental health concerns. Research studies have found benefits and challenges when implementing these interventions. However, less is known about the implementation of EBTs in acute and intensive treatment settings such as inpatient psychiatric hospitalization (IPH) units, partial hospitalization programs (PHPs), or intensive outpatient programs (IOPs). As a result, the specific benefits and challenges of providing EBTs in these settings are less clear. For example, challenges of implementing EBTs in IPHs, PHPs, and IOPs can include working within a multi-disciplinary team setting and sustaining trained staff. The current article provides an overview of implementing EBTs in IPHs PHPs, and IOPs. Current PHP, IOP, and IPH models of implementing evidence-based interventions along with strategies for engaging stakeholders, program development and implementation, and measurement are reviewed. Further considerations for sustainability and practice consideration are also provided.
Collapse
Affiliation(s)
| | - Eugene J D'Angelo
- Department of Psychiatry, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
41
|
Dopp AR, Perrine CM, Iovan S, Lantz PM. The Potential of Pay-for-Success as a Financing Strategy for Evidence-Based Practices: An Illustration with Multisystemic Therapy. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 46:629-635. [PMID: 31073967 DOI: 10.1007/s10488-019-00940-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
There is a critical need to identify strategies for financing the implementation of evidence-based practices. We illustrate the potential of pay-for-success financing (PFS)-a strategy in which private investors fund implementation and receive a return on investment from a government payer-using multisystemic therapy as an example. We argue that standard multisystemic therapy (for serious juvenile offenders) and several of its adaptations (for other complex behavioral problems in youth) would be good candidates for PFS in the right contexts. Despite some challenges for policymakers and administrators, PFS has significant potential as a financing strategy for evidence-based practices.
Collapse
Affiliation(s)
- Alex R Dopp
- Department of Psychological Science, University of Arkansas, 216 Memorial Hall, Fayetteville, AR, 72701, USA.
| | - Cameron M Perrine
- Department of Psychological Science, University of Arkansas, 216 Memorial Hall, Fayetteville, AR, 72701, USA
| | - Samantha Iovan
- Gerald R. Ford School of Public Policy, University of Michigan, 735 South State Street, Ann Arbor, MI, 48109, USA
| | - Paula M Lantz
- Gerald R. Ford School of Public Policy, University of Michigan, 735 South State Street, Ann Arbor, MI, 48109, USA
| |
Collapse
|
42
|
Rodriguez A, Kim JJ, Zhan C, Lau AS, Hamilton AB, Palinkas LA, Gellatly R, Brookman-Frazee L. A Mixed-Method Analysis on the Impacts of a System-Driven Implementation of Multiple Child Evidence-Based Practices on Community Mental Health Providers. ACTA ACUST UNITED AC 2020; 52:67-79. [PMID: 34349341 DOI: 10.1037/pro0000353] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Initiatives to scale up evidence-based practices (EBPs) in routine care are likely to have myriad impacts on community providers, but these impacts have not yet been examined in depth. This is especially true within the context of simultaneous implementation of multiple evidence-based practices. The aim of this study was to characterize the multifaceted impacts on community mental health therapists within a system-driven implementation of multiple EBPs for youth and families. Semistructured interview and survey data were gathered from 60 therapists at 11 agencies contracted with the Los Angeles County Department of Mental Health to deliver EBPs within the Prevention and Early Intervention initiative. Therapists' accounts of impacts varied, and were either predominately negative, predominantly positive, or mixed-valence. Mixed-methods analyses using Kruskal-Wallis tests showed therapist valence groups varied on mean levels of self-reported burnout on surveys. Themes from qualitative data revealed several favorable (e.g., increased EBP knowledge, structure) and unfavorable (e.g., distress, feeling constrained by EBPs) impacts of county-contracted EBP implementation. These findings inform the development and implementation of future system-driven EBP initiatives that consider therapist perspective to optimize positive impacts and minimize negative impacts on therapists.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Lauren Brookman-Frazee
- University of California, San Diego and San Diego State University/University of California, San Diego
| |
Collapse
|
43
|
Lengnick-Hall R, Willging C, Hurlburt M, Fenwick K, Aarons GA. Contracting as a bridging factor linking outer and inner contexts during EBP implementation and sustainment: a prospective study across multiple U.S. public sector service systems. Implement Sci 2020; 15:43. [PMID: 32527274 PMCID: PMC7288508 DOI: 10.1186/s13012-020-00999-9] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2019] [Accepted: 05/12/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Bridging factors are relational ties (e.g. partnerships), formal arrangements (e.g. contracts or polices) and processes (e.g. data sharing agreements) linking outer and inner contexts and are a recent evolution of the Exploration-Preparation-Implementation-Sustainment (EPIS) framework. Bridging factor research can elucidate ways that service systems may influence and/or be influenced by organizations providing health services. This study used the EPIS framework and open systems and resource dependence theoretical approaches to examine contracting arrangements in U.S. public sector systems. Contracting arrangements function as bridging factors through which systems communicate, interact, and exchange resources with the organizations operating within them. METHODS The sample included 17 community-based organizations in eight service systems. Longitudinal data is derived from 113 contract documents and 88 qualitative interviews and focus groups involving system and organizational stakeholders. Analyses consisted of a document review using content analysis and focused coding of transcripts from the interviews and focus groups. A multiple case study analysis was conducted to identify patterns across service systems and organizations. The dataset represented service systems that had sustained the same EBP for between 2 and 10 years, which allowed for observation of bridging factors and outer-inner context interactions over time. RESULTS Service systems and organizations influenced each other in a number of ways through contracting arrangements. Service systems influenced organizations when contracting arrangements resulted in changes to organizational functioning, required organizational responses to insufficient funding, and altered interorganizational network relationships. Organizations influenced service systems when contract arrangements prompted organization-driven contract negotiation/tailoring, changes to system-level processes, and interorganizational collaboration. Service systems and organizations were dependent on each other as implementation progressed. Resources beyond funding emerged, including adequate numbers of eligible clients, expertise in the evidence-based practice, and training and coaching capacity. CONCLUSION This study advances implementation science by expanding the range and definition of bridging factors and illustrating specific bi-directional influences between outer context service systems and inner context organizations. This study also identifies bi-directional dependencies over the course of implementation and sustainment. An analysis of influence, dependencies, and resources exchanged through bridging factors has direct implications for selecting and tailoring implementation strategies, especially those that require system-level coordination and change.
Collapse
Affiliation(s)
| | | | - Michael Hurlburt
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles, CA USA
| | - Karissa Fenwick
- VA Greater Los Angeles Healthcare System, Los Angeles, CA USA
| | - Gregory A. Aarons
- Department of Psychiatry, University of California, San Diego, La Jolla, CA USA
- UC San Diego Dissemination and Implementation Science Center (UC San Diego-DISC), La Jolla, CA USA
| |
Collapse
|
44
|
Applying NUDGE to Inform Design of EBP Implementation Strategies in Community Mental Health Settings. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 48:131-142. [PMID: 32430590 DOI: 10.1007/s10488-020-01052-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
We demonstrate the application of NUDGE (Narrow, Understand, Discover, Generate, Evaluate), a behavioral economics approach to systematically identifying behavioral barriers that impede behavior enactment, to the challenge of evidence-based practice (EBP) use in community behavioral health. Drawing on 65 clinician responses to a system-wide crowdsourcing challenge about EBP underutilization, we applied NUDGE to discover, synthesize and validate specific behavioral barriers to EBP utilization that directly inform the design of tailored implementation strategies. To our knowledge, this is the first study to apply behavioral economic insights to clinician-proposed solutions to implementation challenges in order to design implementation strategies. The study demonstrates the successful application of NUDGE to implementation strategy design and provides novel targets for intervention.
Collapse
|
45
|
Flynn D, Joyce M, Gillespie C, Kells M, Swales M, Spillane A, Hurley J, Hayes A, Gallagher E, Arensman E, Weihrauch M. Evaluating the national multisite implementation of dialectical behaviour therapy in a community setting: a mixed methods approach. BMC Psychiatry 2020; 20:235. [PMID: 32410670 PMCID: PMC7227064 DOI: 10.1186/s12888-020-02610-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/30/2019] [Accepted: 04/19/2020] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND The implementation of evidence-based interventions for borderline personality disorder in community settings is important given that individuals with this diagnosis are often extensive users of both inpatient and outpatient mental health services. Although work in this area is limited, previous studies have identified facilitators and barriers to successful DBT implementation. This study seeks to expand on previous work by evaluating a coordinated implementation of DBT in community settings at a national level. The Consolidated Framework for Implementation Research (CFIR) (Damschroder et al., Implementation Sci. 4:50, 2009) provided structural guidance for this national level coordinated implementation. METHODS A mixed methods approach was utilised to explore the national multisite implementation of DBT from the perspective of team leaders and therapists who participated in the coordinated training and subsequent implementation of DBT. Qualitative interviews with DBT team leaders (n = 8) explored their experiences of implementing DBT in their local service and was analysed using content analysis. Quantitative surveys from DBT therapists (n = 74) examined their experience of multiple aspects of the implementation process including orienting the system, and preparations and support for implementation. Frequencies of responses were calculated. Written qualitative feedback was analysed using content analysis. RESULTS Five themes were identified from the interview data: team formation, implementation preparation, client selection, service level challenges and team leader role. Participants identified team size and support for the team leader as key points for consideration in DBT implementation. Key challenges encountered were the lack of system support to facilitate phone coaching and a lack of allocated time to focus on DBT. Implementation facilitators included having dedicated team members and support from management. CONCLUSIONS The barriers and facilitators identified in this study are broadly similar to those reported in previous research. Barriers and facilitators were identified across several domains of the CFIR and are consistent with a recently published DBT implementation Framework (Toms et al., Borderline Personal Disord Emot Dysregul. 6: 2, 2019). Future research should pay particular attention to the domain of characteristics of individuals involved in DBT implementation. The results highlight the importance of a mandated service plan for the coordinated implementation of an evidence-based treatment in a public health service. TRIAL REGISTRATION ClinicalTrials.gov ID: NCT03180541; Registered June 7th 2017 'retrospectively registered'.
Collapse
Affiliation(s)
- Daniel Flynn
- Cork Mental Health Services, Cork Kerry Community Healthcare, Health Service Executive, St Finbarr's Hospital, Cork, Ireland
| | - Mary Joyce
- National Suicide Research Foundation, University College Cork, Western Gateway Building, Cork, Ireland.
| | - Conall Gillespie
- National Suicide Research Foundation, University College Cork, Western Gateway Building, Cork, Ireland
| | - Mary Kells
- Cork Mental Health Services, Cork Kerry Community Healthcare, Health Service Executive, Inniscarraig House, Western Road, Cork, Ireland
| | - Michaela Swales
- Betsi Cadwaladr University Health Board & North Wales Clinical Psychology Programme, School of Psychology, Bangor University, Bangor, Wales
| | - Ailbhe Spillane
- National Suicide Research Foundation, University College Cork, Western Gateway Building, Cork, Ireland
| | - Justina Hurley
- National Suicide Research Foundation, University College Cork, Western Gateway Building, Cork, Ireland
| | - Aoife Hayes
- National Suicide Research Foundation, University College Cork, Western Gateway Building, Cork, Ireland
| | - Edel Gallagher
- National Suicide Research Foundation, University College Cork, Western Gateway Building, Cork, Ireland
| | - Ella Arensman
- National Suicide Research Foundation and School of Public Health, University College Cork, Western Gateway Building, Cork, Ireland
| | - Mareike Weihrauch
- National Suicide Research Foundation, University College Cork, Western Gateway Building, Cork, Ireland
| |
Collapse
|
46
|
Cheron DM, Chiu AAW, Stanick CF, Stern HG, Donaldson AR, Daleiden EL, Chorpita BF. Implementing Evidence Based Practices for Children's Mental Health: A Case Study in Implementing Modular Treatments in Community Mental Health. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 46:391-410. [PMID: 30710173 DOI: 10.1007/s10488-019-00922-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
There is strong enthusiasm for utilizing implementation science in the implementation of evidence-based programs in children's community mental health, but there remains work to be done to improve the process. Despite the proliferation of implementation frameworks, there is limited literature providing case examples of overcoming implementation barriers. This article examines whether the use of three implementations strategies, a structured training and coaching program, the use of professional development portfolios for coaching, and a progress monitoring data system, help to overcome barriers to implementation by facilitating four implementation drivers at a community mental health agency. Results suggest that implementation is a process of recognizing and adapting to both predictable and unpredictable barriers. Furthermore, the use of these implementation strategies is important in improving implementation outcomes.
Collapse
Affiliation(s)
- Daniel M Cheron
- Judge Baker Children's Center, 53 Parker Hill Avenue, Boston, MA, 02120, USA.
| | | | | | - H Gemma Stern
- Judge Baker Children's Center, 53 Parker Hill Avenue, Boston, MA, 02120, USA
| | | | | | | |
Collapse
|
47
|
What Motivates Mental Health Clinicians-in-Training to Implement Evidence-Based Assessment? A Survey of Social Work Trainees. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 46:411-424. [PMID: 30694460 DOI: 10.1007/s10488-019-00923-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Mental health clinicians do not consistently use evidence-based assessment (EBA), a critical component of accurate case conceptualization and treatment planning. The present study used the Unified Theory of Behavior to examine determinants of intentions to use EBA in clinical practice among a sample of Masters' level social work trainees (N = 241). Social norms had the largest effect on intentions to use EBA. Injunctive norms in reference to respected colleagues accounted for the most variance in EBA intentions. Findings differed for respondents over 29 years of age versus younger respondents. Implications for implementation strategies and further research are discussed.
Collapse
|
48
|
Dickson KS, Aarons GA, Anthony LG, Kenworthy L, Crandal BR, Williams K, Brookman-Frazee L. Adaption and pilot implementation of an autism executive functioning intervention in children's mental health services: a mixed-methods study protocol. Pilot Feasibility Stud 2020; 6:55. [PMID: 32699642 PMCID: PMC7371471 DOI: 10.1186/s40814-020-00593-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2019] [Accepted: 04/02/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Youth with autism spectrum disorder (ASD) represent a growing population with significant service needs. Prominent among these needs are high rates of co-occurring psychiatric conditions that contribute to increased functional impairments and often necessitate mental health services. Executive functioning deficits are associated with ASD as well as common co-occurring conditions (e.g., attention-deficit/hyperactivity disorder) and an evidence-based intervention has been developed and tested to address executive functioning within the school context. There is an urgent need to implement indicated evidence-based interventions for youth with ASD receiving care in community mental health settings. Interventions that optimally "fit" the mental health services context as well as the complex and co-occurring mental health needs of these youth have the potential to improve key clinical outcomes for this high priority population. METHODS This mixed-methods developmental study will apply the Exploration, Preparation, Implementation, Sustainment implementation framework and a community-academic partnership approach to systematically adapt and test an evidence-based executive functioning intervention for youth with ASD for delivery in community mental health settings. Specific aims are to (1) conduct a need and context assessment to inform the systematic adaptation an executive functioning evidence-based intervention; (2) systematically adapt the clinical intervention and develop a corresponding implementation plan, together entitled "Executive Functioning for Enhancing Community-based Treatment for ASD," (EFFECT for ASD); and (3) conduct a feasibility pilot test of EFFECT for ASD in community mental health settings. DISCUSSION Tailoring evidence-based interventions for delivery in community-based mental health services for youth with ASD has the potential to increase quality of care and improve child outcomes. Results from the current study will serve as the foundation for large-scale hybrid implementation and effectiveness trials and a generalizable approach for different service systems of care and clinical populations. TRIAL REGISTRATION Clinicaltrials.gov, NCT04295512.
Collapse
Affiliation(s)
- Kelsey S. Dickson
- San Diego State University, San Diego, CA USA
- Child and Adolescent Services Research Center, San Diego, CA USA
| | - Gregory A. Aarons
- Child and Adolescent Services Research Center, San Diego, CA USA
- Department of Psychiatry, University of California San Diego, La Jolla, CA USA
| | - Laura Gutermuth Anthony
- University of Colorado School of Medicine, Aurora, CO USA
- Children’s Hospital of Colorado, Aurora, CO USA
| | - Lauren Kenworthy
- Center for Autism Spectrum Disorders, Children’s National, Washington, DC USA
| | | | - Katherine Williams
- Department of Psychiatry, University of California San Diego, La Jolla, CA USA
- Rady Children’s Hospital-San Diego, San Diego, CA USA
| | - Lauren Brookman-Frazee
- Child and Adolescent Services Research Center, San Diego, CA USA
- Department of Psychiatry, University of California San Diego, La Jolla, CA USA
- Autism Disovery Institute at Rady Children’s Hospital, San Diego, CA USA
| |
Collapse
|
49
|
Smith JD, Rafferty MR, Heinemann AW, Meachum MK, Villamar J, Lieber RL, Brown CH. Pragmatic adaptation of implementation research measures for a novel context and multiple professional roles: a factor analysis study. BMC Health Serv Res 2020; 20:257. [PMID: 32228572 PMCID: PMC7106795 DOI: 10.1186/s12913-020-05118-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Accepted: 03/18/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Although some advances have been made in recent years, the lack of measures remains a major challenge in the field of implementation research. This results in frequent adaptation of implementation measures for different contexts-including different types of respondents or professional roles-than those for which they were originally developed and validated. The psychometric properties of these adapted measures are often not rigorously evaluated or reported. In this study, we examined the internal consistency, factor structure, and structural invariance of four well-validated measures of inner setting factors across four groups of respondents. The items in these measures were adapted as part of an evaluation of a large-scale organizational change in a rehabilitation hospital, which involved transitioning to a new building and a new model of patient care, facilitated by a significant redesign of patient care and research spaces. METHODS Items were tailored for the context and perspective of different respondent groups and shortened for pragmatism. Confirmatory factor analysis was then used to test study hypotheses related to fit, internal consistency, and invariance across groups. RESULTS The survey was administered to approximately 1208 employees; 785 responded (65% response rate) across the roles of clinician, researcher, leader, support staff, or dual clinician and researcher. For each of the four scales, confirmatory factor analysis demonstrated adequate fit that largely replicated the original measure. However, a few items loaded poorly and were removed from the final models. Internal consistencies of the final scales were acceptable. For scales that were administered to multiple professional roles, factor structures were not statistically different across groups, indicating structural invariance. CONCLUSIONS The four inner setting measures were robust for use in this new context and across the multiple stakeholder groups surveyed. Shortening these measures did not significantly impair their measurement properties; however, as this study was cross sectional, future studies are required to evaluate the predictive validity and test-retest reliability of these measures. The successful use of adapted measures across contexts, across and between respondent groups, and with fewer items is encouraging, given the current emphasis on designing pragmatic implementation measures.
Collapse
Affiliation(s)
- Justin D Smith
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA. .,Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, USA. .,Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA. .,Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
| | - Miriam R Rafferty
- Center for Education in Health Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Allen W Heinemann
- Department of Physical Medicine and Rehabilitation, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Mariah K Meachum
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Juan Villamar
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Richard L Lieber
- Shirley Ryan AbilityLab, Chicago, IL, USA.,Departments of Physiology, Biomedical Engineering and Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, USA
| | - C Hendricks Brown
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.,Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
50
|
Factors Associated with Community-Partnered School Behavioral Health Clinicians' Adoption and Implementation of Evidence-Based Practices. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 46:91-104. [PMID: 30244430 DOI: 10.1007/s10488-018-0897-3] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Community-partnered school behavioral health (CP-SBH) is a model whereby schools partner with local community agencies to deliver services. This mixed-methods study examined 80 CP-SBH clinicians' adoption and implementation of evidence-based practice (EBP) approaches following mandated training. Forty-four clinicians were randomly assigned to one of two training conditions for a modular common elements approach to EBPs; 36 clinicians were preselected for training in a non-modular EBP. EBP knowledge improved for all training conditions at 8-month follow-up and practice element familiarity improved for modular approach training conditions, but the modular condition including ongoing consultation did not yield better results. Qualitative interviews (N = 17) highlighted multi-level influences of the CP-SBH service system and individual clinician characteristics on adoption and implementation.
Collapse
|