Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges

Validation of a quantitative instrument measuring critical success factors and acceptance of Casemix system implementation in the total hospital information system in Malaysia

OBJECTIVES

This study aims to address the significant knowledge gap in the literature on the implementation of Casemix system in total hospital information systems (THIS). The research focuses on validating a quantitative instrument to assess medical doctors' acceptance of the Casemix system in Ministry of Health (MOH) Malaysia facilities using THIS.

DESIGNS

A sequential explanatory mixed-methods study was conducted, starting with a cross-sectional quantitative phase using a self-administered online questionnaire that adapted previous instruments to the current setting based on Human, Organisation, Technology-Fit and Technology Acceptance Model frameworks, followed by a qualitative phase using in-depth interviews. However, this article explicitly emphasises the quantitative phase.

SETTING

The study was conducted in five MOH hospitals with THIS technology from five zones.

PARTICIPANTS

Prior to the quantitative field study, rigorous procedures including content, criterion and face validation, translation, pilot testing and exploratory factor analysis (EFA) were undertaken, resulting in a refined questionnaire consisting of 41 items. Confirmatory factor analysis (CFA) was then performed on data collected from 343 respondents selected via stratified random sampling to validate the measurement model.

RESULTS

The study found satisfactory Kaiser-Meyer-Olkin model levels, significant Bartlett's test of sphericity, satisfactory factor loadings (>0.6) and high internal reliability for each item. One item was eliminated during EFA, and organisational characteristics construct was refined into two components. The study confirms unidimensionality, construct validity, convergent validity, discriminant validity and composite reliability through CFA. After the instrument's validity, reliability and normality have been established, the questionnaire is validated and deemed operational.

CONCLUSION

By elucidating critical success factor and acceptance of Casemix, this research informs strategies for enhancing its implementation within the THIS environment. Moving forward, the validated instrument will serve as a valuable tool in future research endeavours aimed at evaluating the adoption of the Casemix system within THIS, addressing a notable gap in current literature.

Applying the dissemination and implementation sciences to allergy and immunology: A Work Group Report from the AAAAI Quality, Adherence, and Outcomes Committee

Translating evidence-based practice (EBP) into real-world clinical settings often takes a considerable amount of time and resources. In allergy and immunology, the dissemination and implementation (D&I) sciences facilitate the study of how variations in knowledge, resources, patient populations, and staffing models lead to differences in the clinical care of asthma, allergic disease, and primary immunodeficiency. Despite the need for validated approaches to study how to best apply EBP in the real world, the D&I sciences are underutilized. To address this gap, an American Academy of Allergy, Asthma & Immunology (AAAAI) work group was convened to provide an overview for the role of the D&I sciences in clinical care and future research within the field. For the D&I sciences to be leveraged effectively, teams should be multidisciplinary and inclusive of community and clinical partners, and multimethods approaches to data collection and analyses should be used. Used appropriately, the D&I sciences provide important tools to promote EBP and health equity as well as optimization of clinical practice in allergy and immunology.

Testing the incremental effectiveness of pay-for-performance to improve implementation of a motivational interviewing brief intervention for substance use disorders in HIV settings: Results of a parallel cluster-randomized type 3 hybrid trial

Background: Substance use disorders (SUDs) have a serious adverse impact on the physical and mental well-being of people with HIV. Previously, using a 39-site dual-randomized type 2 hybrid trial design, findings from the Substance Abuse Treatment to HIV Care Project supported the Implementation and Sustainment Facilitation (ISF) strategy to improve implementation and effectiveness of a motivational interviewing brief intervention (MIBI) for SUD within HIV service settings across the United States (US). Building on this trial, this parallel cluster-randomized type 3 hybrid trial aimed to test the incremental effectiveness of a pay-for-performance (P4P), a form of the "alter incentive/allowance structures" strategy. Methods: Twenty-six HIV service organizations, their staff participants (N=87), and their client participants (N=341) were cluster-randomized to one of two implementation conditions. The control condition included staff-focused training, feedback, and consultation (TFC) and team-focused implementation and sustainment (ISF). The experimental condition included TFC+ISF as well as P4P (TFC+ISF+P4P). P4P used financial incentives to reward MIBI implementation (US$10 per MIBI delivered) and MIBI implementation at or above a pre-defined level of quality (US$10 per demonstration). In addition to these outcomes, past 4-week changes/reductions in client participant's days of primary substance use and anxiety symptoms were examined. Results: The addition of P4P had a large and significant effect on the number of MIBIs implemented ( d =1.30, p<.05) and reduction in anxiety ( d= -1.54), but there was no impact on days of substance use. P4P had large effects on MIBI quality ( d =1.24) and MIBI implementation effectiveness ( d =1.28), but these were not significant ( p <.10). Conclusions: P4P is a form of the "alter incentive/allowance structures" strategy. Its function is to reward the implementation of a clinical innovation. Rewarding implementation is consistent with the theory of implementation effectiveness, which suggests implementation climate (i.e., the extent to which implementation is expected, supported, and rewarded) is a key antecedent of implementation effectiveness (i.e., the consistency and quality of implementation). We found that P4P had a significant, positive impact on MIBI implementation in HIV service settings, but client-level outcomes were mixed. Future research should examine the effectiveness of the P4P strategy to improve implementation and sustainment of other evidence-based innovations. Trial registration: ClinicalTrials.gov: NCT04687917. Registered 12/18/2020.

The Secret Sauce? Taking the Mystery Out of Scaling-Up School-Based Physical Activity Interventions

Over the last 4 decades, physical activity researchers have invested heavily in determining "what works" to promote healthy behaviors in schools. Single and multicomponent school-based interventions that target physical education, active transportation, and/or classroom activity breaks effectively increased physical activity among children and youth. Yet, few of these interventions are ever scaled-up and implemented under real-world conditions and in diverse populations. To achieve population-level health benefits, there is a need to design school-based health-promoting interventions for scalability and to consider key aspects of the scale-up process. In this opinion piece, we aim to identify challenges and advance knowledge and action toward scaling-up school-based physical activity interventions. We highlight the key roles of planning for scale-up at the outset, scale-up pathways, trust among partners and program support, program adaptation, evaluation of scale-up, and barriers and facilitators to scaling-up. We draw upon our experience scaling-up effective school-based interventions and provide a solid foundation from which others can work toward bridging the implementation-to-scale-up gap.

Machine Learning-Based Evaluation of Suicide Risk Assessment in Crisis Counseling Calls

OBJECTIVE

Counselor assessment of suicide risk is one key component of crisis counseling, and standards require risk assessment in every crisis counseling conversation. Efforts to increase risk assessment frequency are limited by quality improvement tools that rely on human evaluation of conversations, which is labor intensive, slow, and impossible to scale. Advances in machine learning (ML) have made possible the development of tools that can automatically and immediately detect the presence of risk assessment in crisis counseling conversations.

METHODS

To train models, a coding team labeled every statement in 476 crisis counseling calls (193,257 statements) for a core element of risk assessment. The authors then fine-tuned a transformer-based ML model with the labeled data, utilizing separate training, validation, and test data sets.

RESULTS

Generally, the evaluated ML model was highly consistent with human raters. For detecting any risk assessment, ML model agreement with human ratings was 98% of human interrater agreement. Across specific labels, average F1 (the harmonic mean of precision and recall) was 0.86 at the call level and 0.66 at the statement level and often varied as a result of a low base rate for some risk labels.

CONCLUSIONS

ML models can reliably detect the presence of suicide risk assessment in crisis counseling conversations, presenting an opportunity to scale quality improvement efforts.

The Reporting Recommendations Intended for Pharmaceutical Risk Minimization Evaluation Studies: Standards for Reporting of Implementation Studies Extension (RIMES-SE)

INTRODUCTION

The Reporting recommendations Intended for pharmaceutical risk Minimization Evaluation Studies (RIMES) was developed to improve the quality of reporting of risk minimization program evaluations. In light of continued inadequacies in study reporting, and high-profile program implementation failures, we updated the RIMES Checklist to incorporate additional concepts from the Standards for Reporting of Implementation studies (StaRI).

METHODS

The development of the updated checklist, the RIMES-StaRI Extension (RIMES-SE), entailed developing a study protocol and drafting an initial pool of items based on a mapping of the RIMES against the StaRI checklist. A modified e-Delphi exercise was then conducted to determine the importance and understandability of items for checklist inclusion. An expert workshop and an online commentary period for additional feedback followed.

RESULTS

The RIMES-SE contains 27 items. It includes two signature features of the StaRI Checklist: 1) a dual strand of items (represented in two columns) describing the risk minimization program (the 'intervention') and the corresponding implementation strategy; and 2) applicable to an array of different research methodologies.

CONCLUSIONS

The RIMES-SE Statement and Checklist extends the reporting guidelines set forth in the original RIMES Checklist via inclusion of key implementation science concepts. It is intended to improve the quality and transparency of reporting of risk minimization evaluation studies so as to advance drug safety science.

Team-based learning in Indonesian midwifery education: Implementation research

AIM

This study aims to implement team-based learning (TBL) and assess the impact on faculty members and students within midwifery education in Indonesia.

METHODS

Proctor's Framework for Implementation Research serves as the guiding approach in investigating the role of implementation strategies in implementing TBL within the context of midwifery education. The RE-AIM (Reach, Efficacy, Adoption, Implementation, and Maintenance) framework was utilized to assess the outcome.

RESULTS

In this study, the implementation of TBL has demonstrated significant reach, with broad participation among both faculty and students in two schools. The efficacy of TBL is evident through enhanced student knowledge, engagement and active learning. Adoption of TBL was observed in both schools, with faculty and students expressing interest and active participation. High levels of implementation fidelity were maintained, even though with challenges related to preparation and implementation. These findings suggest that TBL can be successfully integrated into midwifery education, with positive implications. Regarding maintenance, faculty members have expressed their intention to continue using TBL in various topics for future lectures.

CONCLUSIONS

The implementation of TBL in Indonesian midwifery education has shown substantial reach and efficacy. Faculty and students are highly interested in adopting TBL for future use. Despite some implementation challenges, the study suggests that TBL can be effectively incorporated with minor adjustments, emphasizing its feasibility and potential impact. This research contributes to understanding TBL's applicability in various educational settings, especially in low-resource institutions.

Proactive behaviors and health care workers: A systematic review

BACKGROUND

Proactive behaviors at work refer to discretionary actions among workers that are self-starting, change oriented, and future focused. Proactive behaviors reflect the idiosyncratic actions by individual workers that shape the delivery and experience of professional services, highlight a bottom-up perspective on workers' agency and motivation that can influence organizational practices, and are associated with a variety of employee and organizational outcomes.

PURPOSE

This systematic review aims to understand the various forms of proactive behaviors in health care workers that have been studied, and how these proactive behaviors are associated with employee-level outcomes and quality of care.

METHODS

Systematic review of articles published to date on proactive behaviors in health care workers.

RESULTS

Based on the identification of 40 articles, we find that job crafting, active problem solving, voice, extra-role behaviors, and idiosyncratic deals have been investigated as proactive behaviors among health care workers. Among these, job crafting is the most commonly studied (35% of articles), and it has been conceptualized and measured in the most consistent way, including as individual- and group-level phenomena, and as organizational interventions. Studies on active problem solving, which refers to workers accepting responsibility, exercising control, and taking action around anticipated or experienced problems at work, have not been consistently investigated as a form of proactive behavior but represent 25% of the articles identified in this review. Overall, this review finds that proactive behaviors in health care is a burgeoning area of research, with the majority of studies being cross-sectional in design and published after 2010, and focused on workers' job satisfaction as the outcome.

PRACTICE IMPLICATIONS

Health care workers and managers should consider the distinct influences and contributions of proactive behaviors as ways to improve employee-level outcomes and quality of care.

Mapping implementation strategies to reach community-dwelling older adults in Northwest Switzerland

BACKGROUND

In Northwestern Switzerland, recent legislation tackles the needs of community-dwelling older adults by creating Information and Advice Centers (IACs). IACs are a new service in the community that aims to assess the needs and provide information on age-related issues to community-dwelling older adults and their families. Previous studies reported difficulties in reaching community-dwelling older adults for community-based programs. We aimed to: 1) systematically identify implementation strategies to promote the IAC among community care providers, older adults and informal caregivers; 2) monitor the delivery of these strategies by the IAC management; and 3) describe the impact of those strategies on reach of community-dwelling older adults. This study was conducted as part of the TRANS-SENIOR project.

METHODS

As part of the INSPIRE feasibility assessment, we conducted a pre-test post-test study between March and September 2022. The sample included 8,840 older adults aged 65 + visiting/calling or being referred to the IAC for the first time. Implementation strategies were selected using implementation mapping and organized in bundles for each group of community care providers and older adults/caregivers. Our evaluation included: estimation of fidelity to the delivery of implementation strategies and bundles by the IAC management and their coverage; referral source of older adults to the IAC; and impact of the strategies on reach of the IAC on the 65 + population living in the care region. Adaptations to the strategies were documented using the FRAME-IS. Descriptive statistics were calculated and reported.

RESULTS

Seven implementation strategies were selected and organized in bundles for each community care provider and older adults and their caregivers. The lowest fidelity score was found in implementation strategies selected for nursing homes whereas the highest score corresponded to strategies targeting older adults and caregivers. "Informational visits" was the strategy with the lowest coverage (2.5% for nursing homes and 10.5% for hospitals and specialized clinics). The main referral sources were self-referrals and referrals by caregivers, followed by nursing homes. The IAC reach among the 65 + population was 5.4%.

CONCLUSION

We demonstrated the use of implementation mapping to select implementation strategies to reach community-dwelling older adults. The reach was low suggesting that higher fidelity to the delivery of the strategies, and reflection on the causal pathway of the implementation strategies might be needed.

From Model to Practice: A Qualitative Study on Factors Influencing the Implementation of the Active Recovery Triad (ART) Model in Long-Term Mental Health Care

Background: The Active Recovery Triad (ART) model provides a framework for recovery-oriented care in the long-term mental health setting. The aim of this study is to gain insight into factors influencing the implementation process of the ART model. Methods: Focus groups were conducted with fourteen multidisciplinary teams that were in the process of implementing the ART model. Data were thematically analyzed. Results: Three phases of implementation were identified. In the first phase, getting started, support from both the top of the organization and the care workers, sufficient information to care workers, service users, and significant others, and creating momentum were considered crucial factors. In the second phase, during implementation, a stable team with a good team spirit, leadership and ambassadors, prioritizing goals, sufficient tools and training, and overcoming structural limitations in large organizations were seen as important factors. In the third phase, striving for sustainability, dealing with setbacks, maintaining attention to the ART model, and exchange with other teams and organizations were mentioned as core factors. Conclusions: The findings may support teams in making the shift from traditional care approaches towards recovery-oriented care in long-term mental health care.

Scaling up a brief alcohol intervention to prevent HIV infection in Vietnam: a cluster randomized, implementation trial

BACKGROUND

Evidence-based interventions (EBIs) often address normative behaviors. If a behavior is also common among clinicians, they may be skeptical about the necessity or effectiveness of an EBI. Alternatively, clinicians' attitudes and behaviors may be misaligned, or they may lack the knowledge and self-efficacy to deliver the EBI. Several EBIs address unhealthy alcohol use, a common and often culturally acceptable behavior. But unhealthy alcohol use may be particularly harmful to people with HIV (PWH). Here, we present an implementation trial using an experiential implementation strategy to address clinicians' knowledge, attitudes, and behaviors. Clinicians receive the experiential intervention before they begin delivering an evidence-based brief alcohol intervention (BAI) to PWH with unhealthy alcohol use.

METHODS

Design: In this hybrid type 3 implementation-effectiveness cluster randomized controlled trial, ART clinics (n = 30) will be randomized 1:1 to facilitation, a flexible strategy to address implementation barriers, or facilitation plus the experiential brief alcohol intervention (EBAI). In the EBAI arm, clinicians, irrespective of their alcohol use, will be offered the BAI as experiential learning. EBAI will address clinicians' alcohol-related attitudes and behaviors and increase their knowledge and confidence to deliver the BAI.

PARTICIPANTS

ART clinic staff will be enrolled and assessed at pre-BAI training, post-BAI training, 3, 12, and 24 months. All PWH at the ART clinics who screen positive for unhealthy alcohol use will be offered the BAI. A subset of PWH (n = 810) will be enrolled and assessed at baseline, 3, and 12 months.

OUTCOMES

We will compare implementation outcomes (acceptability, fidelity, penetration, costs, and sustainability) and effectiveness outcomes (viral suppression and alcohol use) between the two arms. We will assess the impact of site-level characteristics on scaling-up the BAI. We will also evaluate how experiencing the BAI affected clinical staff's alcohol use and clinic-level alcohol expectations in the EBAI arm.

DISCUSSION

This trial contributes to implementation science by testing a novel strategy to implement a behavior change intervention in a setting in which clinicians themselves may engage in the behavior. Experiential learning may be useful to address normative and difficult to change lifestyle behaviors that contribute to chronic diseases.

TRIAL REGISTRATION

NCT06358885 (04/10/2024), https://clinicaltrials.gov/study/NCT06358885 .

Perceived acceptability and appropriateness of a web-based program targeting risk for anxiety in young children and their parents

OBJECTIVE

This mixed-methods study examined perceived acceptability and appropriateness of a novel digital mental health program targeting anxiety risk (i.e., perfectionism or error sensitivity) in 5-to-7-year-old children and their parents.

METHODS

Parent-child dyads participated in a modular, web-based cognitive-behavioral program targeting negative overreactions to making mistakes. The program, "Making Mistakes", consisted of a 6-month series of short video clips, journaling activities, and weekly reminders, and modules were delivered to caregivers and children separately. 86 dyads completed self-report measures, 18 of whom participated in semi-structured interviews, following completion of the primary program module. A standard thematic analysis was used to elucidate themes from the parent and child interview content.

RESULTS

Our quantitative and qualitative results were generally aligned. Children and parents viewed the novel digital mental health program as acceptable and appropriate, favoring the cognitive behavioral strategies such as modeling positive reactions to mistakes, responding positively to child mistakes, and emphasizing effort over outcome. Participants also provided helpful feedback related to program content, delivery, and engagement, as well as suggestions to enhance the program.

CONCLUSIONS

Findings have implications for design and content features of parent-based and dyad-based programs, as well as digital mental health programs focused on reducing anxiety risk.

Supporting young women's health through girl-friendly drug vendors in Lake Zone, Tanzania: protocol for the AmbassADDOrs for Health cluster-randomised controlled trial

INTRODUCTION

Adverse sexual and reproductive health (SRH) outcomes, such as unplanned pregnancies and HIV infection, disproportionately affect adolescent girls and young women (AGYW; aged 15-24 years) in east Africa. Increasing uptake of preventive SRH services via innovative, youth-centred interventions is imperative to addressing disparities in SRH outcomes.

METHODS AND ANALYSIS

From 2018 to 2019, we used human-centred design to co-develop a theoretically driven HIV and pregnancy prevention intervention for AGYW at private drug shops called Accredited Drug Dispensing Outlets (ADDOs) in Tanzania. The result, Malkia Klabu (Queen Club), was a customer loyalty programme designed to strengthen ADDOs' role as SRH providers while encouraging uptake of critical SRH prevention products among AGYW. Malkia Klabu members had access to free contraceptives and oral HIV self-test (HIVST) kits and earned punches on a loyalty card for other shop purchases; punches were redeemable for small prizes. Our pilot among 40 shops showed that intervention ADDOs had higher AGYW patronage and distributed more HIVST kits and contraceptives to AGYW relative to business-as-usual (ie, client purchasing) comparison shops. We will conduct a cluster-randomised controlled trial (c-RCT) among 120-140 ADDOs in 40 health catchment areas in Shinyanga and Mwanza Regions (Lake Zone), Tanzania. ADDO shop recruitment includes a 1-month run-in with a tablet-based electronic inventory management system for tracking shop transactions, followed by enrolment, randomisation and a 24-month trial period. Our c-RCT evaluating the human-centred design-derived intervention will assess population impact on the primary outcomes of HIV diagnoses and antenatal care registrations, measured with routine health facility data. We will also assess secondary outcomes focusing on mechanisms of action, evaluate programme exposure and AGYW behaviour change in interviews with AGYW, and assess shop-level implementation strategies and fidelity.

ETHICS AND DISSEMINATION

Ethical approval was granted from both the University of California, San Francisco and the Tanzanian National Institute for Medical Research. Study progress and final outcomes will be posted annually to the National Clinical Trials website; study dissemination will occur at conferences, peer-reviewed manuscripts and local convenings of stakeholders.

TRIAL REGISTRATION NUMBER

NCT05357144.

The Need for Technology-Aided Instruction and Intervention Policy for Autistic Youth

This paper examines current technology-aided instruction and intervention (TAII) available for autistic transition-age youth (TAY) and existing policies that may support or hinder the delivery of these interventions. Specifically, we focus on policies that might influence the delivery of TAII to autistic TAY. After a careful review of the literature, we observed that postsecondary policy guiding the delivery of TAII designed to support autistic TAY is lacking. TAII have demonstrated effectiveness, usability, sustainability, and cost-effectiveness, particularly with this population. We suggest possibilities for future policies to support the development, implementation, and evaluation of TAII for autistic TAY.

The future of psychological treatments: The Marburg Declaration

Although psychological treatments are broadly recognized as evidence-based interventions for various mental disorders, challenges remain. For example, a substantial proportion of patients receiving such treatments do not fully recover, and many obstacles hinder the dissemination, implementation, and training of psychological treatments. These problems require those in our field to rethink some of our basic models of mental disorders and their treatments, and question how research and practice in clinical psychology should progress. To answer these questions, a group of experts of clinical psychology convened at a Think-Tank in Marburg, Germany, in August 2022 to review the evidence and analyze barriers for current and future developments. After this event, an overview of the current state-of-the-art was drafted and suggestions for improvements and specific recommendations for research and practice were integrated. Recommendations arising from our meeting cover further improving psychological interventions through translational approaches, improving clinical research methodology, bridging the gap between more nomothetic (group-oriented) studies and idiographic (person-centered) decisions, using network approaches in addition to selecting single mechanisms to embrace the complexity of clinical reality, making use of scalable digital options for assessments and interventions, improving the training and education of future psychotherapists, and accepting the societal responsibilities that clinical psychology has in improving national and global health care. The objective of the Marburg Declaration is to stimulate a significant change regarding our understanding of mental disorders and their treatments, with the aim to trigger a new era of evidence-based psychological interventions.

Financial barriers, facilitators, and strategies among syringe services programs in the U.S., and their impact on implementation and health outcomes

Syringe Services Programs (SSPs) provide evidence-based services like drug use equipment to prevent infectious disease, overdose prevention education, and naloxone distribution to people who use drugs (PWUD). However, inadequate funding threatens provision of these interventions. This study aimed to document how the current funding landscape impacted determinants of SSP implementation, particularly describing financial and staffing barriers, facilitators, and proposed strategies, using qualitative methods informed by three implementation research frameworks. We interviewed 20 leaders of SSPs in the United States using a semi-structured interview guide. Participants described how structural stigma against PWUD led to insufficient and restrictive funding, and burdensome reporting for SSPs. This resulted in harming program implementation outcomes like reach, fidelity, and sustainability. Inadequate funding also led to insufficient staffing and subsequent staff stress, burnout, and turnover. Taken together, these barriers threatened the implementation of evidence-based interventions that SSPs provided, ultimately harming their ability to effectively address health outcomes like infectious disease transmission and opioid overdose mortality within their communities. Interviewees described how upstream policy strategies like political advocacy might address structural stigma at the federal level. Participants also highlighted state-level efforts like harm reduction-centered funding, technical assistance and capacity-building, and clearinghouse programs that may facilitate better implementation and health outcomes. A more robust understanding of the relationship between financial barriers, facilitators, and strategies on implementation and health outcomes represents a novel and vital area of research within harm reduction literature.

Pain Management Education for Rural Hospice Family Caregivers: A Pilot Study With Embedded Implementation Evaluation

BACKGROUND

Assessing and managing hospice patients' pain is a common source of anxiety among hospice family caregivers (HFCGs), especially caregivers in rural communities who face special challenges including distance, limited access, and concerns about opioid misuse.

OBJECTIVE

To pilot test Ready2Care, a pain management education intervention for rural HFCGs. We sought to determine whether there was a signal of benefit for clinically-relevant outcomes and to identify contextual factors pertinent to conducting a future randomized clinical trial of Ready2Care.

METHODS

We conducted a multi-method, single-arm study, enabling completion of paired t-tests comparing pre- and post-intervention measures of caregiver anxiety, pain management self-efficacy, barriers to pain management, and reports of patient pain intensity and corresponding patient and caregiver distress. We concurrently conducted an embedded implementation evaluation via calculation of descriptive statistics (recruitment and retention data) and directed content analysis of brief caregiver interviews.

RESULTS

Twenty-seven (n = 27) HFCGs participated; 15 completed the study. Among completers, significant improvement was observed in patient pain intensity (average 1.4 points decrease on 0-10 scale) and in overall pain experience. No statistically significant changes were detected in caregiver anxiety, barriers to pain management, or pain management self-efficacy. Facilitators to successful conduct of a future clinical trial included high acceptability of Ready2Care, driven by its perceived clarity and relevance to caregivers' concerns. Barriers included lower-than-anticipated accrual and an attrition rate of nearly 44%.

CONCLUSION

A multisite clinical trial of Ready2Care is warranted; however, its success may require more effective recruitment and retention strategies for rural caregiver participants.

Barriers and facilitators in the implementation of youth and young adult models of mental health care

AIM

It is increasingly recognised that traditional models of mental health (MH) care, with a service transition at age 18 years, may not reflect best practice. The literature supports a move towards youth and young adult focused models of MH care, for young people up to the age of 25, which specifically cater to the unique psychosocial and developmental needs of this population. This service evaluation aimed to explore the facilitators and barriers to the implementation of youth models of MH care across England (UK).

METHODS

Six services participated in separate focus groups pertaining to their experience of implementing youth models of MH care. The interview guide for the focus groups was informed by the Consolidated Framework for Implementation Research (CFIR) and explored barriers and facilitators to implementation and sustainment. The focus groups were recorded, transcribed verbatim and analysed thematically.

RESULTS

Seven key themes relevant to the implementation of youth models of MH care were identified: a clear rationale for doing things differently, for young people by young people, "building those relationships is key", service identity development, resource and infrastructure, leadership at multiple levels, and valuing and developing staff.

CONCLUSIONS

The findings suggest effective communication and leadership, co-production and cross system collaboration contribute to successful implementation of youth models of MH care. The findings will be of interest to those involved in informing and supporting successful implementation and delivery of youth models of mental health care at local and national levels.

Implementation characteristics that may promote sustainability of a rural physical activity initiative: examination of Play Streets through the lens of community implementers

BACKGROUND

Play Streets, which are community-based environmental initiatives where public spaces/streets are temporarily closed to create safe, low-cost physical activity opportunities, have demonstrated feasibility and physical activity benefit in rural US areas. Yet, information is needed to identify implementation characteristics that may promote sustainability. This study examined rural Play Streets implementation characteristics that could impact sustainability from local partners' perspectives.

METHODS

Sixteen Play Streets implementation team members in rural Maryland, North Carolina, Oklahoma, and Texas, USA, participated in interviews. Semi-structured in-person individual and group interviews were conducted in the fall of 2018 (after Play Streets implementation in 2017 and 2018), recorded, and transcribed verbatim. Transcripts were analyzed using iterative, content analyses. Coding frameworks were based on the Public Health Program Capacity for Sustainability Framework, and emergent themes were also identified.

RESULTS

Interviewees' perceived characteristics for facilitating Play Streets implementation aligned with the Public Health Program Capacity for Sustainability Framework: funding stability, political support, partnerships, organizational capacity, program adaption, and communication. Interviewees also noted the importance of cultural alignment/support and the reciprocal impact of community connectedness/engagement.

CONCLUSIONS

Future research should examine the reciprocal role of public health impacts, as both outcomes and factors which may influence sustainability.

Leveraging Implementation Science to Advance Environmental Justice Research and Achieve Health Equity through Neighborhood and Policy Interventions

Environmental justice research is increasingly focused on community-engaged, participatory investigations that test interventions to improve health. Such research is primed for the use of implementation science-informed approaches to optimize the uptake and use of interventions proven to be effective. This review identifies synergies between implementation science and environmental justice with the goal of advancing both disciplines. Specifically, the article synthesizes the literature on neighborhood-, community-, and policy-level interventions in environmental health that address underlying structural determinants (e.g., structural racism) and social determinants of health. Opportunities to facilitate and scale the equitable implementation of evidence-based environmental health interventions are highlighted, using urban greening as an illustrative example. An environmental justice-focused version of the implementation science subway is provided, which highlights these principles: Remember and Reflect, Restore and Reclaim, and Reinvest. The review concludes with existing gaps and future directions to advance the science of implementation to promote environmental justice.

Implementation Science and Practice-Oriented Research: Convergence and Complementarity

Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

Implementation of a 4Ms approach in age-friendly oral health care at an Academic Specialty Care Dental Clinic

BACKGROUND

Implementing the Age-Friendly Health System (AFHS) framework into dental care provides a significant opportunity to link oral health to healthy aging. This project aimed to implement the AFHS 4Ms (what matters, medications, mentation, and mobility) in the provision of oral health care. This article describes the planning, integration, training development, and outcome measurements supporting a 4Ms approach at an academic dental clinic.

METHODS

The Eastman Institute for Oral Health (EIOH) implemented screening instruments based on the 4Ms framework recommended for ambulatory care clinics by the Institute for Health Care Improvement (IHI). These ambulatory instruments were integrated into the workflows of a Specialty Care Clinic through the development of a plan-do-study-act cycle, utilization of available clinic resources, and creation of interdisciplinary collaborations.

RESULTS

This project demonstrated the feasibility of implementing an AFHS checklist and tracking forms in dental practice by integrating available resources and prioritizing the 4Ms elements. This effort necessitated interdisciplinary collaborations between dental, medical, and social service professionals. It also created a new age-friendly focused education and training curriculum for dental residents and faculty.

CONCLUSIONS

This pilot project is the first to establish dental standards for AFHS implementation, adapting the 4Ms assessment and metrics to oral health. This AFHS underscores key oral health processes, including assessment, planning, and personalized oral health care, adapted to the unique needs of the older adult population, especially those with cognitive impairment.

Implementing a Treatment for People with Serious Mental Illness in Jail: A Mixed-Methods Study of Stakeholder Perspectives on Feasibility and Acceptability

People with mental illness are over-represented in the U.S. criminal legal system. Jail presents an optimal opportunity to provide needed mental health care as the entry point to corrections. However, there is a lack of programming available in jails, which may be partly due to limited understanding of how to successfully implement interventions in this complex setting. We implemented a nine-session psychotherapeutic intervention for people with serious mental illness in a county jail. As part of a larger implementation-effectiveness hybrid study, we gathered mixed-methods data from stakeholders (treatment recipients and jail administrators) on the feasibility and acceptability of the intervention's implementation. In focus group discussions and qualitative interviews, treatment recipients (n = 29) provided qualitative and quantitative data on their perceptions of the implementation's feasibility and acceptability. Jail administrators (n = 6) completed two quantitative self-report measures on their perceptions of the treatment's feasibility and acceptability. Qualitative analyses were conducted by two coders using inductive thematic template analysis; seven global themes relating to treatment recipients' perceptions of the assets and hindrances to feasibility and acceptability were developed and are presented with supporting quotations. Quantitatively, all treatment recipients endorsed the intervention's feasibility (100%), and nearly all (97%) endorsed its acceptability. On both self-report measures, jail administrators' mean scores fell above a-priori thresholds indicating feasibility and acceptability. We found qualitative and quantitative support for the use of this intervention in jail from both sets of stakeholders. These results have implications for clinical service and policy in jail, where service providers struggle to meet the considerable demand for mental health services.

Underreporting of implementation strategies and barriers in physical activity interventions for young people at risk of problematic substance use: a brief report

BACKGROUND

Several studies have assessed whether physical activity interventions can reduce substance use in young people at risk of problematic substance use. This report identifies and describes the reporting of implementation characteristics within published studies of physical activity interventions for young people at risk of problematic substance use and provides recommendations for future reporting.

METHODS

Reported implementation strategies (including intervention manualization), barriers, implementation fidelity, and personnel acceptance were extracted from studies of physical activity interventions for young people aged 12-25 years at risk of problematic substance use that were included in a previous systematic review of intervention efficacy.

RESULTS

Implementation strategies were reported in less than half of the included studies (42.9%), implementation barriers in only 10.7% of studies, intervention fidelity in 21.4%, and personnel acceptance in a single study (3.6%).

CONCLUSIONS

Results indicate insufficient reporting of implementation strategies, barriers, fidelity, and personnel acceptance. Consideration of implementation characteristics is essential for implementing physical activity interventions in practice. Inadequate or limited reporting of these characteristics may contribute to delayed uptake and adoption of evidence-based interventions in clinical practice. Recommendations to improve the reporting of implementation information include integrating standards for reporting implementation characteristics into existing reporting guidelines, developing an international taxonomy of implementation strategies, and upskilling intervention researchers in the fundamentals of implementation science.

Exemplar Hospital initiation trial to Enhance Treatment Engagement (EXHIT ENTRE): protocol for CTN-0098B a randomized implementation study to support hospitals in caring for patients with opioid use disorder

BACKGROUND

Hospitalizations involving opioid use disorder (OUD) are increasing. Medications for opioid use disorder (MOUD) reduce mortality and acute care utilization. Hospitalization is a reachable moment for initiating MOUD and arranging for ongoing MOUD engagement following hospital discharge. Despite existing quality metrics for MOUD initiation and engagement, few hospitals provide hospital based opioid treatment (HBOT). This protocol describes a cluster-randomized hybrid type-2 implementation study comparing low-intensity and high-intensity implementation support strategies to help community hospitals implement HBOT.

METHODS

Four state implementation hubs with expertise in initiating HBOT programs will provide implementation support to 24 community hospitals (6 hospitals/hub) interested in starting HBOT. Community hospitals will be randomized to 24-months of either a low-intensity intervention (distribution of an HBOT best-practice manual, a lecture series based on the manual, referral to publicly available resources, and on-demand technical assistance) or a high-intensity intervention (the low-intensity intervention plus funding for a hospital HBOT champion and regular practice facilitation sessions with an expert hub). The primary efficacy outcome, adapted from the National Committee on Quality Assurance, is the proportion of patients engaged in MOUD 34-days following hospital discharge. Secondary and exploratory outcomes include acute care utilization, non-fatal overdose, death, MOUD engagement at various time points, hospital length of stay, and discharges against medical advice. Primary, secondary, and exploratory outcomes will be derived from state Medicaid data. Implementation outcomes, barriers, and facilitators are assessed via longitudinal surveys, qualitative interviews, practice facilitation contact logs, and HBOT sustainability metrics. We hypothesize that the proportion of patients receiving care at hospitals randomized to the high-intensity arm will have greater MOUD engagement following hospital discharge.

DISCUSSION

Initiation of MOUD during hospitalization improves MOUD engagement post hospitalization. Few studies, however, have tested different implementation strategies on HBOT uptake, outcome, and sustainability and only one to date has tested implementation of a specific type of HBOT (addiction consultation services). This cluster-randomized study comparing different intensities of HBOT implementation support will inform hospitals and policymakers in identifying effective strategies for promoting HBOT dissemination and adoption in community hospitals.

TRIAL REGISTRATION

NCT04921787.

Application of 'Readiness for Change' concept within implementation of evidence-based mental health interventions globally: protocol for a scoping review

Background

Concerning the growing burden of mental illnesses globally, there has been an increased investment into the implementation of evidence-based mental health interventions (EBmhIs) in routine care settings. However, the uptake and implementation of these EBmhIs has faced challenges in the real-world context. Among the many barriers and facilitators of implementation of EBmhIs identified by implementation science frameworks, evidence on the role of readiness for change (RFC) remains sparse. RFC constitutes the willingness and perceived capacity of stakeholders across an organization to implement a new practice. Theoretically, RFC has been defined at organizational, group, and individual levels, however, its conceptualization and operationalization across all these levels have differed in studies on the implementation of EBmhIs. By conducting a scoping review, we aim to examine the literature on RFC within the implementation of EBmhIs.

Methods

This scoping review will be conducted following the PRISMA-ScR guidelines. Iterative review stages will include a systematic and comprehensive search through four electronic databases (PubMed, Web of Science, Embase, and PsycINFO), selecting studies, charting data, and synthesizing the results. English-language studies meeting the inclusion criteria will be screened independently by two reviewers.

Discussion

This review will synthesize knowledge on the conceptualization of RFC across organizational, group, and individual levels within the implementation of EBmhIs. In addition, it will identify how RFC has been measured in these studies and summarize the reported evidence on its impact on the implementation of EBmhIs.

Conclusions

This review will assist mental health researchers, implementation scientists, and mental health care providers to gain a better understanding of the state of research on RFC within the implementation of EBmhIs.

Registration

The final protocol was registered with the Open Science Framework on October 21, 2022 ( https://osf.io/rs5n7).

Targeting Caregiver Psychopathology in Parent Management Training for Adolescents: A Scoping Review of Commercially Available Treatment Resources

Background

While parent management training (PMT) has been shown to be an effective treatment for adolescents with externalizing concerns, evidence suggests that effectiveness is not equitable across all types of families. Research suggests that caregiver psychopathology may adversely affect PMT success for adolescents. However, it remains unclear whether research on caregiver psychopathology is integrated within adolescent PMT resources (e.g., treatment manuals).

Objective

A scoping review of commercially available, clinician focused PMT resources was conducted to assess for information on caregiver psychopathology and clinical guidance for addressing caregiver psychopathology.

Methods

A search for commercially available resources was conducted among national treatment databases and book resource websites. Information on caregiver psychopathology was extracted from individual sessions of the PMT resources.

Results

Seven treatment resources met inclusion criteria. The majority of the treatment resources made at least one explicit comment that caregiver psychopathology may impact the course of treatment. There was very limited mention of caregiver psychopathology in skill building sections of the resources.

Conclusions

While most resources mentioned caregiver psychopathology, these comments lacked breadth and depth in providing clinicians with recommendations on how to tailor treatment to caregivers' needs. Recommendations are provided for how PMT programs might be improved in the future to support clinicians when faced with caregiver psychopathology by recognizing inequities and lack of diversity in resource development, using a transdiagnostic perspective (including a transdiagnostic approach to assessment of care-giver psychopathology), and integrating caregiver skill development.

Cognitive-behavioral therapy for patients with post-COVID-19 condition (CBT-PCC): a feasibility trial

BACKGROUND

The post-COVID-19 condition describes the persistence or onset of somatic symptoms (e.g. fatigue) after acute COVID-19. Based on an existing cognitive-behavioral treatment protocol, we developed a specialized group intervention for individuals with post-COVID-19 condition. The present study examines the feasibility, acceptance, and effectiveness of the program for inpatients in a neurological rehabilitation setting.

METHODS

The treatment program comprises eight sessions and includes psychoeducational and experience-based interventions on common psychophysiological mechanisms of persistent somatic symptoms. A feasibility trial was conducted using a one-group design in a naturalistic setting. N = 64 inpatients with a history of mild COVID-19 that fulfilled WHO criteria for post-COVID-19 condition were enrolled. After each session, evaluation forms were completed and psychometric questionnaires on somatic and psychopathological symptom burden were collected pre- and post-intervention.

RESULTS

The treatment program was well received by participants and therapists. Each session was rated as comprehensible and overall satisfaction with the sessions was high. Pre-post effect sizes (of standard rehabilitation incl. new treatment program; intention-to-treat) showed significantly reduced subjective fatigue (p < 0.05, dav = 0.33) and improved disease coping (ps < 0.05, dav = 0.33-0.49).

CONCLUSIONS

Our results support the feasibility and acceptance of the newly developed cognitive-behavioral group intervention for individuals with post-COVID-19 condition. Yet, findings have to be interpreted cautiously due to the lack of a control group and follow-up measurement, the small sample size, and a relatively high drop-out rate.

Advancing Translation of Clinical Research Into Practice and Population Health Impact Through Implementation Science

Translational and implementation sciences aim to prioritize and guide efforts to create greater efficiency and speed of scientific innovation across the translational science continuum to improve patient and population health. Key principles and practices rooted in translational and implementation science may be incorporated into clinical trials research, particularly pragmatic trials, to improve the relevance and impact of scientific innovation. This thematic review intends to raise awareness on the value of translational and implementation science in clinical research and to encourage its use in designing and implementing clinical trials across the translational research continuum. Herein, we describe the gap in translating research findings into clinical practice, introduce translational and implementation science, and describe the principles and practices from implementation science that can be used in clinical trial research across the translational continuum to inform clinical practice, to improve population health impact, and to address health care inequities.

"A strong reason why I enjoy coming to work": Clinician acceptability of a palliative and supportive care intervention (PACT) for older adults with acute myeloid leukemia and their care partners

INTRODUCTION

Studies about clinician acceptability of integrative palliative care interventions in the inpatient and outpatient cancer settings are limited. In this study, we examined clinician acceptability of a NIH-funded interdisciplinary PAlliative and Supportive Care inTervention (PACT) for older adults with acute myeloid leukemia (AML) and their care partners that transcends both inpatient and outpatient settings.

MATERIALS AND METHODS

Data was collected using semi-structured interviews with clinicians who were directly involved in PACT. The domains of the Theoretical Framework of Acceptability were used to guide the qualitative analysis.

RESULTS

The clinicians consisted of occupational therapists (37%), physical therapists (25%), registered nurses (25%), and a clinical rehabilitation manager (13%). Five themes were identified in the thematic analysis: (1) Emotions and affect towards the intervention, (2) Intervention coherence and self-efficacy, (3) Barriers, burden, and opportunity costs of delivering the intervention, (4) Usefulness and effectiveness of the intervention, and (5) Recommendations to improve intervention delivery.

DISCUSSION

All clinicians found the PACT intervention highly acceptable and expressed the positive impact of the intervention on job fulfillment and satisfaction. Our findings provide evidence to inform the delivery and implementation of future large scale integrative palliative care intervention trials.

Lessons From an Implementation Evaluation of a Real-World Multi-City Initiative to Address COVID-19 Vaccination Inequities

Background: The COVID-19 pandemic shed light on stark racial and ethnic inequities in access to care and accurate health information in the U.S. When COVID-19 vaccines became available, communities of color faced multiple barriers that contributed to low vaccine rates. To address this gap, the Equity-First Vaccination Initiative supported community organizations in five demonstration cities to plan and implement hyper-local strategies to increase COVID-19 vaccine access and uptake among communities of color.Purpose: To draw learnings from the experiences of the participating organizations, we applied a framework that integrated implementation science and health equity principles.Design and sample: In this commentary, we describe how we used this framework to guide qualitative interviews with community organizations, focusing on insights across five implementation elements (reach, design, implementation, adaptation, implementation outcomes).Conclusions: Learnings from this evaluation may help guide future implementation of similarly complex initiatives involving multiple organizations and sites to advance health equity during a public health crisis.

eHealth-Enhanced Peer Navigation for Substance Use Treatment and HIV Prevention Service Linkage for Young Adults Surveilled by the Criminal Legal System: Protocol for a Pilot Randomized Trial Study

BACKGROUND

In the United States, the proportion of criminal legal-involved (CLI) adults with a substance use disorder reaches 72%, and ~150,000 persons with HIV pass through a carceral setting annually, which represents 16% of the HIV-infected population nationally. Despite the high need for substance use treatment and HIV prevention services, few carceral settings successfully link CLI individuals to treatment upon release. Young adults represent 41.9% of the adults incarcerated in the United States and have the highest HIV incidence rates nationally. Peer patient navigation has successfully increased community-based care linkage for people living with HIV leaving jail; yet, peer-led navigation for HIV prevention among HIV-negative CLI populations is undeveloped and untested. eHealth approaches to substance use and HIV prevention services hold promise because they improve access to effective intervention services, particularly for younger people.

OBJECTIVE

This paper describes a protocol for a pilot randomized controlled trial that aims to improve linkage to substance use treatment and HIV prevention services using peer navigation and a codeveloped eHealth technology adjunct.

METHODS

The three aims of this study are to (1) adapt an existing evidence-based navigator model and incorporate codeveloped eHealth technology to refer and link young adults (18 to 29 years) surveilled by the criminal legal system to substance use and pre-exposure prophylaxis (PrEP) services; (2) refine and test the intervention with criminal legal-involved young adults (CLI-YAs); and (3) assess the feasibility, acceptability, and impact of the intervention. Data to inform the intervention will be collected via system partner interviews (n=4) and focus groups with CLI-YAs (n=24). Next, an open trial (n=10) will be conducted. The intervention will be refined via interviews with participants and facilitators, and a randomized pilot trial (n=75) will be conducted to assess the feasibility, acceptability, and preliminary impact of the eHealth-enhanced navigation on substance use and PrEP services linkage. Exit interviews conducted with a subsample of intervention participants (n=10), the navigator (n=1), and system partners (n=4) will assess intervention acceptability and suggestions for improvement. A community of practice, a group of system partners with an interest in working toward solutions to common problems, will inform each phase of the study.

RESULTS

The project is currently ongoing. The project was funded in September 2022. Internal review board approval was received on March 21, 2022. The first results from early study aims are expected to be published in 2025.

CONCLUSIONS

This study provides an opportunity to reduce HIV acquisition and improve access to substance use treatment in a systemically marginalized group: young CLI-YAs. The results will contribute to the development and testing of a future multilevel randomized controlled trial.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/54815.

A feasibility, randomised controlled trial of Club Connect: a group-based healthy brain ageing cognitive training program for older adults with major depression within an older people's mental health service

BACKGROUND

Using the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework, we outline steps taken to implement an evidence-based cognitive training program, Club Connect, in older adults with major depressive disorder in an Older People's Mental Health Service in Sydney, Australia. The primary aim was to explore feasibility (or 'reach'), tolerability (or 'implementation'), and acceptability (or 'adoption'). The secondary aim was to explore the most sensitive clinical outcomes and measurement tools (i.e. 'effectiveness') to inform a formal randomised controlled trial, and to explore the healthcare resources used (i.e. costs) to assist decision-making by health care managers and policy-makers in relation to future resource allocation.

METHODS

Using a single blinded feasibility design, 40 participants (mean age: 76.13 years, SD: 7.45, range: 65-95 years) were randomised to either (a) Club Connect, a 10-week group-based multifaceted program, comprising psychoeducation and computer-based cognitive training, or (b) a waitlist control group.

RESULTS

Implementing group-based cognitive training within a clinical setting was feasible, well tolerated and accepted by participants. Further, cognitive training, in comparison to the waiting list control, was associated with moderate to very large effect size improvements in depression, stress and inhibition (ηp2 = 0.115-0.209). We also found moderate effect size improvements on measures of daily functioning, wellbeing and cognitive flexibility. Small effect size improvements for other cognitive and psychosocial outcomes were also observed. The average cost per person participating in in the intervention was AU$607.50.

CONCLUSIONS

Our findings support the feasibility of implementing group-based cognitive training into a specialised clinical (public health) setting. This trial was registered on the Australian and New Zealand Clinical Trial Registry (ACTRN12619000195156, 12/02/2019).

Navigating the field of implementation science towards maturity: challenges and opportunities

BACKGROUND

The field of implementation science has significantly expanded in size and scope over the past two decades, although work related to understanding implementation processes have of course long preceded the more systematic efforts to improve integration of evidence-based interventions into practice settings. While this growth has had significant benefits to research, practice, and policy, there are some clear challenges that this period of adolescence has uncovered.

MAIN BODY

This invited commentary reflects on the development of implementation science, its rapid growth, and milestones in its establishment as a viable component of the biomedical research enterprise. The authors reflect on progress in research and training, and then unpack some of the consequences of rapid growth, as the field has grappled with the competing challenges of legitimacy among the research community set against the necessary integration and engagement with practice and policy partners. The article then enumerates a set of principles for the field's next developmental stage and espouses the aspirational goal of a "big tent" to support the next generation of impactful science.

CONCLUSION

For implementation science to expand its relevance and impact to practice and policy, researchers must not lose sight of the original purpose of the field-to support improvements in health and health care at scale, the importance of building a community of research and practice among key partners, and the balance of rigor, relevance, and societal benefit.

Implementing Dysphagia Outcome Assessments into Clinical Settings: Leveraging Principles of Implementation, Dissemination, and Psychometrics

PURPOSE

Myriad dysphagia assessment tools have been designed, but their application is variable. This is partly due to a lack of implementation and dissemination strategy as well as to limited guidance regarding which instruments are optimally designed and best used for clinical and research applications.

METHOD

This tutorial provides a high-level overview of implementation and dissemination, their interaction with psychometrics and knowledge coproduction, and how these concepts relate to proper development and widespread application of contextually relevant, psychometrically optimized, evidence-based dysphagia assessment instruments.

RESULTS

A review of the literature identified two dysphagia assessment instruments that purposefully integrated implementation and dissemination processes after measurement development. Application of knowledge coproduction was not identified in any papers reporting development and testing of dysphagia assessment instruments. A better understanding of coproduction and psychometrics when developing measures, while simultaneously applying implementation science and dissemination strategies, can result in the development of optimal dysphagia assessment tools that are more consistently adopted into clinical practice.

CONCLUSIONS

Clinicians and researchers should promote the development of psychometrically sound measures, and employ principles of implementation science and effective dissemination strategies to advocate for, and promote the use of, well-designed instruments within their appropriate clinical contexts. Support from governing bodies and funding agencies could enhance future efforts to develop, and encourage widespread uptake of, optimally developed dysphagia assessment tools.

Effectiveness of a WHO self-help psychological intervention to alleviate stress among healthcare workers in the context of COVID-19 in China: a randomised controlled trial

AIMS

To examine the effectiveness of Self-Help Plus (SH+) as an intervention for alleviating stress levels and mental health problems among healthcare workers.

METHODS

This was a prospective, two-arm, unblinded, parallel-designed randomised controlled trial. Participants were recruited at all levels of medical facilities within all municipal districts of Guangzhou. Eligible participants were adult healthcare workers experiencing psychological stress (10-item Perceived Stress Scale scores of ≥15) but without serious mental health problems or active suicidal ideation. A self-help psychological intervention developed by the World Health Organization in alleviating psychological stress and preventing the development of mental health problems. The primary outcome was psychological stress, assessed at the 3-month follow-up. Secondary outcomes were depression symptoms, anxiety symptoms, insomnia, positive affect (PA) and self-kindness assessed at the 3-month follow-up.

RESULTS

Between November 2021 and April 2022, 270 participants were enrolled and randomly assigned to either SH+ (n = 135) or the control group (n = 135). The SH+ group had significantly lower stress at the 3-month follow-up (b = -1.23, 95% CI = -2.36, -0.10, p = 0.033) compared to the control group. The interaction effect indicated that the intervention effect in reducing stress differed over time (b = -0.89, 95% CI = -1.50, -0.27, p = 0.005). Analysis of the secondary outcomes suggested that SH+ led to statistically significant improvements in most of the secondary outcomes, including depression, insomnia, PA and self-kindness.

CONCLUSIONS

This is the first known randomised controlled trial ever conducted to improve stress and mental health problems among healthcare workers experiencing psychological stress in a low-resource setting. SH+ was found to be an effective strategy for alleviating psychological stress and reducing symptoms of common mental problems. SH+ has the potential to be scaled-up as a public health strategy to reduce the burden of mental health problems in healthcare workers exposed to high levels of stress.

Addressing adverse social determinants of health in pediatric primary care: Study protocol for a hybrid type 2 effectiveness-implementation randomized controlled trial in two national pediatric practice-based research networks

BACKGROUND

Growing evidence linking social determinants of health (SDOH) to child health outcomes has prompted widespread recommendations for pediatricians to screen and refer for adverse SDOH at primary care visits. Yet there is little evidence to date demonstrating the effectiveness of practice-based SDOH screening and referral interventions on increasing family engagement with resources. This hybrid type 2 effectiveness-implementation trial aims to demonstrate the non-inferiority of a low-touch implementation strategy in order to facilitate dissemination of an existing SDOH screening and referral system (WE CARE) and demonstrate its effectiveness and sustainability in various pediatric practices.

METHODS

We recruited eighteen pediatric practices in fourteen US states through two pediatric practice-based research networks. For this stepped wedge cluster RCT, practices serve as their own controls during the Usual Care phase and implement WE CARE during the intervention phase via one of two randomized implementation strategies: self-directed, pre-recorded webinar vs. study team-facilitated, live webinar. We collect data at practice, clinician/staff, and parent levels to assess outcomes grounded in the Proctor Conceptual Model of Implementation Research. We use generalized mixed effects models and differences in proportions to compare rates of resource referrals by implementation strategy, and intention-to-treat analysis to compare odds of engagement with new resources among families enrolled in the Usual Care vs. WE CARE phases.

DISCUSSION

Findings from this trial may inform decisions about broader dissemination of SDOH screening systems into a diverse spectrum of pediatric practices across the US and potentially minimize the impact of adverse SDOH on children and families.

The Pathway Building Technique in Implementation Research Using Mixed Methods Design

BACKGROUND

Data integration refers to combining quantitative and qualitative data in mixed methods. It can be achieved through several integration procedures. The building integration procedure can be used for developing quantitative instruments by integrating data from the qualitative phase. There are limited examples of data integration using the building procedure in mixed methods and implementation science.

PURPOSE

The purpose of this article is to illustrate how the pathway building technique can be used to integrate data in mixed methods research through concurrent use of implementation science models and frameworks.

METHODS

This two pathway building technique was developed based on a mixed methods implementation project of developing implementation strategies to promote compassionate nursing care of complex patients.

RESULTS

The first pathway is the integration of qualitative data from the first phase of mixed methods study with implementation models and frameworks to create a quantitative instrument (i.e., a Q-sort survey) for the subsequent phase. The second pathway is the operationalization of the Q-sort survey results (i.e., implementation strategies) using an implementation science specification framework.

CONCLUSION

The pathway technique is valuable for mixed methods research and implementation science as it offers a theory-based innovative method to tackle integration challenge.

What have we learned about constructed response short-answer questions from students and faculty? A multi-institutional study

PURPOSE

The purpose of this study was to enrich understanding about the perceived benefits and drawbacks of constructed response short-answer questions (CR-SAQs) in preclerkship assessment using Norcini's criteria for good assessment as a framework.

METHODS

This multi-institutional study surveyed students and faculty at three institutions. A survey using Likert scale and open-ended questions was developed to evaluate faculty and student perceptions of CR-SAQs using the criteria of good assessment to determine the benefits and drawbacks. Descriptive statistics and Chi-square analyses are presented, and open responses were analyzed using directed content analysis to describe benefits and drawbacks of CR-SAQs.

RESULTS

A total of 260 students (19%) and 57 faculty (48%) completed the survey. Students and faculty report that the benefits of CR-SAQs are authenticity, deeper learning (educational effect), and receiving feedback (catalytic effect). Drawbacks included feasibility, construct validity, and scoring reproducibility. Students and faculty found CR-SAQs to be both acceptable (can show your reasoning, partial credit) and unacceptable (stressful, not USMLE format).

CONCLUSIONS

CR-SAQs are a method of aligning innovative curricula with assessment and could enrich the assessment toolkit for medical educators.

Enhanced Milieu Teaching in resource-constrained settings: Stakeholder-informed adaptation guidelines

BACKGROUND

 Enhanced Milieu Teaching (EMT) is an evidence-based naturalistic developmental behavioural intervention (NDBI) for children with developmental disabilities. Little is known about the EMT's fit or what adaptations might be needed to improve its applicability within a resource-constrained setting.

OBJECTIVES

 To explore stakeholders' perceptions of the contextual fit of EMT for young children with developmental disabilities in a resource-constrained context and to identify adaptations to improve EMT's contextual fit.

METHOD

 We conducted a descriptive qualitative study using semi-structured interviews and focus groups. Participants included 5 speech and language therapists and 11 caregivers of children with developmental disabilities who speak English and Afrikaans or isiXhosa. Using thematic analysis, data were coded into 10 subthemes and grouped according to the Adaptome framework components.

RESULTS

 Overall, stakeholders view EMT as an appropriate intervention in the South African context. They indicated that certain intervention components may need to be modified. Specifically, clinicians may need to adapt intervention materials and activities to be sensitive to families' available resources, preferred activity routines and priorities. From these data, we provide guidelines to improve the fit of EMT in South Africa.

CONCLUSION

 Enhanced Milieu Teaching is an appropriate intervention in the South African context, although some adaptations can enhance its fit.Contribution: This article highlights the importance of engaging with stakeholders to determine the fit of NDBIs, like EMT, as they are implemented in new contexts. Based on these insights, stakeholder-informed adaptation guidelines are provided for improving the contextual fit of EMT in resource-constrained settings.

What do you think it means? Using cognitive interviewing to improve measurement in implementation science: description and case example

Pragmatic measures are essential to evaluate the implementation of evidence-based interventions. Cognitive interviewing, a qualitative method that collects partner feedback throughout measure development, is particularly useful for developing pragmatic implementation measures. Measure developers can use cognitive interviewing to increase a measure's fit within a particular implementation context. However, cognitive interviewing is underused in implementation research, where most measures remain "homegrown" and used for single studies. We provide a rationale for using cognitive interviewing in implementation science studies and illustrate its use through a case example employing cognitive interviewing to inform development of a measurement-based care protocol for implementation in opioid treatment programs. Applications of cognitive interviewing, including developing a common language with partners and collecting multi-level feedback on assessment procedures, to improve measurement in implementation science are discussed.

A Digitally Enabled Combined Lifestyle Intervention for Weight Loss: Pilot Study in a Dutch General Population Cohort

BACKGROUND

Overweight and obesity rates among the general population of the Netherlands keep increasing. Combined lifestyle interventions (CLIs) focused on physical activity, nutrition, sleep, and stress management can be effective in reducing weight and improving health behaviors. Currently available CLIs for weight loss (CLI-WLs) in the Netherlands consist of face-to-face and community-based sessions, which face scalability challenges. A digitally enabled CLI-WL with digital and human components may provide a solution for this challenge; however, the feasibility of such an intervention has not yet been assessed in the Netherlands.

OBJECTIVE

The aim of this study was two-fold: (1) to determine how weight and other secondary cardiometabolic outcomes (lipids and blood pressure) change over time in a Dutch population with overweight or obesity and cardiometabolic risk participating in a pilot digitally enabled CLI-WL and (2) to collect feedback from participants to guide the further development of future iterations of the intervention.

METHODS

Participants followed a 16-week digitally enabled lifestyle coaching program rooted in the Fogg Behavior Model, focused on nutrition, physical activity, and other health behaviors, from January 2020 to December 2021. Participants could access the digital app to register and track health behaviors, weight, and anthropometrics data at any time. We retrospectively analyzed changes in weight, blood pressure, and lipids for remeasured users. Surveys and semistructured interviews were conducted to assess critical positive and improvement points reported by participants and health care professionals.

RESULTS

Of the 420 participants evaluated at baseline, 53 participated in the pilot. Of these, 37 (70%) were classified as overweight and 16 (30%) had obesity. Mean weight loss of 4.2% occurred at a median of 10 months postintervention. The subpopulation with obesity (n=16) showed a 5.6% weight loss on average. Total cholesterol decreased by 10.2% and low-density lipoprotein cholesterol decreased by 12.9% on average. Systolic and diastolic blood pressure decreased by 3.5% and 7.5%, respectively. Participants identified the possibility of setting clear action plans to work toward and the multiple weekly touch points with coaches as two of the most positive and distinctive components of the digitally enabled intervention. Surveys and interviews demonstrated that the digital implementation of a CLI-WL is feasible and well-received by both participants and health care professionals.

CONCLUSIONS

Albeit preliminary, these findings suggest that a behavioral lifestyle program with a digital component can achieve greater weight loss than reported for currently available offline CLI-WLs. Thus, a digitally enabled CLI-WL is feasible and may be a scalable alternative to offline CLI-WL programs. Evidence from future studies in a Dutch population may help elucidate the mechanisms behind the effectiveness of a digitally enabled CLI-WL.

ESSENCE: An Implementation Research Program to Scale Up Depression Care in Rural Communities

BACKGROUND

Task sharing may involve training nonspecialist health workers (NSHWs) to deliver brief mental health interventions. This approach is promising for reducing the global mental health treatment gap. However, capacity is limited for training large cadres of frontline workers in low- and middle-income countries, hindering uptake of these interventions at scale.

METHODS

The ESSENCE (enabling translation of science to service to enhance depression care) project in Madhya Pradesh, India, aims to address these challenges through two sequential randomized controlled trials. First, a training trial will evaluate the effectiveness and cost-effectiveness of digital training, compared with conventional face-to-face training, in achieving clinical competency of NSHWs in delivering an intervention for depression. This initial trial will be followed by an implementation trial aimed at evaluating the effectiveness of a remote enhanced implementation support, compared with routine implementation support, in addressing barriers to delivery of depression care in primary care facilities.

RESULTS

This project involved developing and pilot testing a scalable smartphone-based program for training NSHWs to deliver a brief psychological intervention for depression screening. This initial research guided a randomized trial of a digital training approach with NSHWs to evaluate the effectiveness of this approach. This trial will be followed by a cluster-randomized trial to evaluate the effectiveness of remote implementation support in ensuring efficient delivery of depression care in primary care facilities.

NEXT STEPS

Findings from these trials may inform sustainable training and implementation support models to integrate depression care into primary care for scale-up in resource-constrained settings.

Improving the implementation of KiVa antibullying program with tailored support: Study protocol for a cluster randomized controlled trial

BACKGROUND

There are no evidence-based models to support the implementation of school-based bullying prevention programs. Our primary objective is to examine the impact of tailored support on the implementation of the KiVa antibullying program. Our second objective is to evaluate whether the offered support influences student outcomes (e.g., victimization, bullying perpetration). We also assess the cost-effectiveness of the provided support and conduct a process evaluation.

METHODS

In a cluster randomized control trial (cRCT), we compare program fidelity between schools that receive implementation support and those that do not. Twenty-four (N = 24) schools in Finland were randomized to either the IMPRES condition (receiving support, n = 12) or the control group (KiVa as usual, n = 12). In the IMPRES condition, pre-assessment and staff training were organized, and a selected team of staff members received four mentoring sessions during one academic year. Staff and students answer questionnaires at the end of school year 0, at post-intervention (year 1) and again at the 1-year follow-up (year 2). Our primary outcomes concern two main program components - universal and indicated actions - reflecting program fidelity. As secondary outcomes, we examine the level of bullying victimization and perpetration as well as students' perception of several program fidelity indicators. Finally, we assess several tertiary outcomes, collect resource data and conduct qualitative interviews to perform additional analyses.

CONCLUSION

This trial will inform us of whether implementation support can boost program fidelity and have a distal impact on bullying prevalence.

TRIAL REGISTRATION

ISRCTN15558617 https://doi.org/10.1186/ISRCTN15558617.

Formative Evaluation of a Comprehensive Self-Management Intervention for Irritable Bowel Syndrome, Comorbid Anxiety, and Depression: Mixed Methods Study

BACKGROUND

Irritable bowel syndrome (IBS) is a disorder of the gut-brain interaction that is associated with abdominal pain, altered bowel patterns, and reduced quality of life. Up to 50% of patients with IBS also report anxiety or depressive symptoms. Although effective self-management interventions exist for individuals with IBS, few have been effectively implemented, and most do not consider the unique needs of patients with comorbid IBS and anxiety or depression.

OBJECTIVE

This study aimed to determine the anticipated acceptability, appropriateness, feasibility, and usability of a comprehensive self-management intervention using an implementation science and human-centered design approach among individuals with comorbid IBS and anxiety or depression and health care providers.

METHODS

A convergent mixed methods design was used to elicit feedback on the comprehensive self-management intervention outline and content to identify refinement needs before testing. Patients with IBS and moderate to severe anxiety or depression and health care providers were purposefully sampled from primary care and gastroenterology settings. Participants completed semistructured interviews and surveys on anticipated acceptability, appropriateness, feasibility, and usability.

RESULTS

Patient participants (n=12) were on average 36.8 (SD 12.2) years of age, and 42% (5/12) were currently receiving psychological therapy. Health care providers (n=14) were from primary care (n=7) and gastroenterology (n=7) settings. The mean usability scores (out of 100) were 52.5 (SD 14.5) for patients and 45.6 (SD 11.6) for providers. For patients and providers, qualitative data expanded the quantitative findings for acceptability and appropriateness. Acceptability findings were the comprehensive nature of the intervention and discussion of the gut-brain interaction. For appropriateness, participants reported that the intervention provided structure, accountability, and support. Feasibility was confirmed for patients, but there was a divergence of findings between quantitative and qualitative measures for providers. Patients focused on intervention feasibility, while providers focused on implementation feasibility in the clinic. Identified usability issues to address before implementation included the intervention delivery format, length, and lack of integration into health care settings that, if not addressed, may limit the reach of the intervention.

CONCLUSIONS

Patients and health care providers found the intervention acceptable and appropriate. Several feasibility and usability issues were identified, including intervention delivery methods, length of intervention, and the best methods to implement in the clinic setting. The next steps are to refine the intervention to address the identified issues and test in a pilot study whether addressing usability issues leads to the anticipated improvements in implementation and uptake.

Community implementation of a brief parent mediated intervention for toddlers with probable or confirmed autism spectrum disorder: feasibility, acceptability, and drivers of success (IE Drmic et al.)

Background

Social ABCs is a caregiver-mediated Naturalistic Developmental Behavioral Intervention for toddlers with confirmed/suspected Autism Spectrum Disorder (ASD), with evidence in controlled research settings. Information is lacking on implementation in community settings. We reported on the treatment effectiveness of this program within a community setting, and the current paper describes the implementation phase of this work. Distinguishing between treatment and implementation effectiveness is critical for transporting interventions from laboratory to community.

Objectives

Describe the implementation of Social ABCs through a large public autism service, supported by a research-community partnership.

Methods

We describe this project through the Exploration, Preparation, Implementation, Sustainment (EPIS) framework as it focuses on implementation of evidence-based practices in publicly funded services. We apply this framework to the reporting stage. This project took place in the context of a 3-year government-funded pilot at a hospital-based publicly funded autism service. Participants: Program developers; Autism Service team; toddlers with suspected/confirmed ASD aged 14-34 months (M = 25.18 months) and their caregivers. Training/supervision: Provided by program developers at tapering intensity. Evaluation: Caregivers completed the Caregiver Diary and satisfaction surveys. We explored training processes, intervention uptake, acceptability, adaptations to fit community context, appropriateness, perceived impact, and facilitators/barriers.

Results

Six coaches were trained to fidelity, and three of these were further trained as Site Trainers. 183 clinically referred families enrolled and 89.4% completed the 12-week program. Caregivers reported increases in adherence and competence, high satisfaction and perceived benefits for their children. Coaches reported high satisfaction. Toddlers were appropriately identified to receive the intervention. Referral processes improved, including decreased referral age, and increased family readiness for diagnostic assessment and subsequent services.

Conclusions

Social ABCs was successfully implemented in a community service through a research-community partnership. The program was feasible, acceptable, and appropriate within a community context. Drivers of success included funding, institutional support, shared decision-making, adaptations to fit context, leadership support, perceived positive impact, and commitment to evaluation.

Does a blended learning implementation package enhance HIV index case testing in Malawi? A protocol for a cluster randomised controlled trial

INTRODUCTION

Index case testing (ICT) is an evidence-based approach that efficiently identifies persons in need of HIV treatment and prevention services. In Malawi, delivery of ICT has faced challenges due to limited technical capacity of healthcare workers (HCWs) and clinical coordination. Digitisation of training and quality improvement processes presents an opportunity to address these challenges. We developed an implementation package that combines digital and face-to-face modalities (blended learning) to strengthen HCWs ICT skills and enhance quality improvement mechanisms. This cluster randomised controlled trial will assess the impact of the blended learning implementation package compared with the standard of care (SOC) on implementation, effectiveness and cost-effectiveness outcomes.

METHODS AND ANALYSIS

The study was conducted in 33 clusters in Machinga and Balaka districts, in Southern Malawi from November 2021 to November 2023. Clusters are randomised in a 2:1 ratio to the SOC versus blended learning implementation package. The SOC is composed of: brief face-to-face HCW ICT training and routine face-to-face facility mentorship for HCWs. The blended learning implementation package consists of blended teaching, role-modelling, practising, and providing feedback, and blended quality improvement processes. The primary implementation outcome is HCW fidelity to ICT over 1 year of follow-up. Primary service uptake outcomes include (a) index clients who participate in ICT, (b) contacts elicited, (c) HIV self-test kits provided for secondary distribution, (d) contacts tested and (e) contacts identified as HIV-positive. Service uptake analyses will use a negative binomial mixed-effects model to account for repeated measures within each cluster. Cost-effectiveness will be assessed through incremental cost-effectiveness ratios examining the incremental cost of each person tested.

ETHICS AND DISSEMINATION

The Malawi National Health Science Research Committee, the University of North Carolina and the Baylor College of Medicine Institutional Review Boards approved the trial. Study findings will be disseminated through peer-reviewed journals and conference presentations.

TRIAL REGISTRATION NUMBER

NCT05343390.

The core functions and forms paradigm throughout EPIS: designing and implementing an evidence-based practice with function fidelity

There are numerous frameworks for implementing evidence-based practices (EBPs) in novel settings to achieve "fidelity." However, identifying appropriate referents for fidelity poses a challenge. The Core Functions and Forms paradigm offers a model that can inform adaptation decisions throughout all phases of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. We applied the Core Functions-Forms paradigm throughout the Exploration and Preparation phases of EPIS in the design of two EBPs targeting family protective factors among Latinos in San Diego, as well as describe plans for its use in Implementation and Sustainment. We employed a distinct approach for each intervention element to contrast adaptation decisions that prioritize adherence to either form or function fidelity. We describe our application of the functions-forms paradigm within the EPIS framework, focusing on the Preparation phase. We also provide functions-forms matrices that map out the relationship between individual intervention components (forms) and the essential processes (functions) by which components are theorized to exert their impact. This case study of how the core functions-forms framework can be mapped onto EPIS can support a conceptual shift from prioritizing form fidelity to also focusing on function fidelity. This might allow interventionists to target appropriate fidelity referents when adapting an EBP, rather than defaulting to maintaining fidelity to forms as described in the protocol. We see great promise for using this framework for guiding actions throughout all EPIS phases and informing future applications of this paradigm to foster more robust fidelity to function.

Mental Health Counseling From Conversational Content With Transformer-Based Machine Learning

Importance

Use of asynchronous text-based counseling is rapidly growing as an easy-to-access approach to behavioral health care. Similar to in-person treatment, it is challenging to reliably assess as measures of process and content do not scale.

Objective

To use machine learning to evaluate clinical content and client-reported outcomes in a large sample of text-based counseling episodes of care.

Design, Setting, and Participants

In this quality improvement study, participants received text-based counseling between 2014 and 2019; data analysis was conducted from September 22, 2022, to November 28, 2023. The deidentified content of messages was retained as a part of ongoing quality assurance. Treatment was asynchronous text-based counseling via an online and mobile therapy app (Talkspace). Therapists were licensed to provide mental health treatment and were either independent contractors or employees of the product company. Participants were self-referred via online sign-up and received services via their insurance or self-pay and were assigned a diagnosis from their health care professional.

Exposure

All clients received counseling services from a licensed mental health clinician.

Main Outcomes and Measures

The primary outcomes were client engagement in counseling (number of weeks), treatment satisfaction, and changes in client symptoms, measured via the 8-item version of Patient Health Questionnaire (PHQ-8). A previously trained, transformer-based, deep learning model automatically categorized messages into types of therapist interventions and summaries of clinical content.

Results

The total sample included 166 644 clients treated by 4973 therapists (20 600 274 messages). Participating clients were predominantly female (75.23%), aged 26 to 35 years (55.4%), single (37.88%), earned a bachelor's degree (59.13%), and were White (61.8%). There was substantial variability in intervention use and treatment content across therapists. A series of mixed-effects regressions indicated that collectively, interventions and clinical content were associated with key outcomes: engagement (multiple R = 0.43), satisfaction (multiple R = 0.46), and change in PHQ-8 score (multiple R = 0.13).

Conclusions and Relevance

This quality improvement study found associations between therapist interventions, clinical content, and client-reported outcomes. Consistent with traditional forms of counseling, higher amounts of supportive counseling were associated with improved outcomes. These findings suggest that machine learning-based evaluations of content may increase the scale and specificity of psychotherapy research.