Making sense of implementation theories, models and frameworks

A Narrative Review of Patient-Reported Outcome Measures and Their Application in Recent Pediatric Surgical Research: Advancing Knowledge and Offering New Perspectives to the Field

INTRODUCTION

 Patient-reported outcome measures (PROMs) can be employed in both research and clinical care to enhance our understanding of outcomes that matter to patients. This narrative review aims to describe PROM use in recent pediatric surgical research, identify and describe psychometrically robust PROMs, providing an overview of those derived from pediatric patient input, and make recommendations for future research.

MATERIALS AND METHODS

 A search was conducted to identify articles published from 2021 to August 2023 describing the availability and/or use of at least one valid or reliable PROM in children with conditions including anorectal malformations, biliary atresia, congenital diaphragmatic hernia, duodenal atresia, esophageal atresia, abdominal wall defects, Hirschsprung's disease, sacrococcygeal teratoma, and short bowel syndrome. Articles were categorized based on their objectives in applying PROMs. Psychometrically robust PROMs were identified and described.

RESULTS

 Out of the 345 articles identified, 49 met the inclusion criteria. Seventeen focused on esophageal atresia and 14 on Hirschsprung's disease. Twenty-nine PROMs were identified, with 12 deemed psychometrically robust. Seven psychometrically robust PROMs were developed using patient input in the primary item generation. Most PROMs were applied to advance understanding of conditions and/or treatment and fewer were developed or psychometrically evaluated. No PROMs were assessed for their impact or incorporated into an implementation study.

CONCLUSIONS

 This review reveals gaps in the application of PROMs in recent pediatric surgical research. Emphasis should be placed on the development and utilization of psychometrically robust PROMs, broadening the scope of covered diseases, conducting impact assessments, and evaluating implementation strategies.

Moving toward the Development and Effective Implementation of High-Quality Guidelines in Pediatric Surgery: A Review of the Literature

Applying evidence-based guidelines can enhance the quality of patient care. While robust guideline development methodology ensures credibility and validity, methodological variations can impact guideline quality. Besides methodological rigor, effective implementation is crucial for achieving improved health outcomes. This review provides an overview of recent literature pertaining to the development and implementation of guidelines in pediatric surgery. Literature was reviewed to provide an overview of sound guideline development methodologies and approaches to promote effective guideline implementation. Challenges specific to pediatric surgery were highlighted. A search was performed to identify published guidelines relevant to pediatric surgery from 2018 to June 2023, and their quality was collectively appraised using the AGREE II instrument. High-quality guideline development can be promoted by using methodologically sound tools such as the Guidelines 2.0 checklist, the GRADE system, and the AGREE II instrument. While implementation can be promoted during guideline development and post-publication, its effectiveness may be influenced by various factors. Challenges pertinent to pediatric surgery, such as limited evidence and difficulties with outcome selection and heterogeneity, may impact guideline quality and effective implementation. Fifteen guidelines were identified and collectively appraised as suboptimal, with a mean overall AGREE II score of 58%, with applicability being the lowest scoring domain. There are identified challenges and barriers to the development and effective implementation of high-quality guidelines in pediatric surgery. It is valuable to prioritize the identification of adapted, innovative methodological strategies and the use of implementation science to understand and achieve effective guideline implementation.

Using the consolidated Framework for Implementation Research to integrate innovation recipients' perspectives into the implementation of a digital version of the spinal cord injury health maintenance tool: a qualitative analysis

BACKGROUND

Despite advances in managing secondary health complications after spinal cord injury (SCI), challenges remain in developing targeted community health strategies. In response, the SCI Health Maintenance Tool (SCI-HMT) was developed between 2018 and 2023 in NSW, Australia to support people with SCI and their general practitioners (GPs) to promote better community self-management. Successful implementation of innovations such as the SCI-HMT are determined by a range of contextual factors, including the perspectives of the innovation recipients for whom the innovation is intended to benefit, who are rarely included in the implementation process. During the digitizing of the booklet version of the SCI-HMT into a website and App, we used the Consolidated Framework for Implementation Research (CFIR) as a tool to guide collection and analysis of qualitative data from a range of innovation recipients to promote equity and to inform actionable findings designed to improve the implementation of the SCI-HMT.

METHODS

Data from twenty-three innovation recipients in the development phase of the SCI-HMT were coded to the five CFIR domains to inform a semi-structured interview guide. This interview guide was used to prospectively explore the barriers and facilitators to planned implementation of the digital SCI-HMT with six health professionals and four people with SCI. A team including researchers and innovation recipients then interpreted these data to produce a reflective statement matched to each domain. Each reflective statement prefaced an actionable finding, defined as alterations that can be made to a program to improve its adoption into practice.

RESULTS

Five reflective statements synthesizing all participant data and linked to an actionable finding to improve the implementation plan were created. Using the CFIR to guide our research emphasized how partnership is the key theme connecting all implementation facilitators, for example ensuring that the tone, scope, content and presentation of the SCI-HMT balanced the needs of innovation recipients alongside the provision of evidence-based clinical information.

CONCLUSIONS

Understanding recipient perspectives is an essential contextual factor to consider when developing implementation strategies for healthcare innovations. The revised CFIR provided an effective, systematic method to understand, integrate and value recipient perspectives in the development of an implementation strategy for the SCI-HMT.

TRIAL REGISTRATION

N/A.

Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial

BACKGROUND

Theory and correlational research indicate organizational leadership and climate are important for successful implementation of evidence-based practices (EBPs) in healthcare settings; however, experimental evidence is lacking. We addressed this gap using data from the WISDOM (Working to Implement and Sustain Digital Outcome Measures) hybrid type III effectiveness-implementation trial. Primary outcomes from WISDOM indicated the Leadership and Organizational Change for Implementation (LOCI) strategy improved fidelity to measurement-based care (MBC) in youth mental health services. In this study, we tested LOCI's hypothesized mechanisms of change, namely: (1) LOCI will improve implementation and transformational leadership, which in turn will (2) mediate LOCI's effect on implementation climate, which in turn will (3) mediate LOCI's effect on MBC fidelity.

METHODS

Twenty-one outpatient mental health clinics serving youth were randomly assigned to LOCI plus MBC training and technical assistance or MBC training and technical assistance only. Clinicians rated their leaders' implementation leadership, transformational leadership, and clinic implementation climate for MBC at five time points (baseline, 4-, 8-, 12-, and 18-months post-baseline). MBC fidelity was assessed using electronic metadata for youth outpatients who initiated treatment in the 12 months following MBC training. Hypotheses were tested using longitudinal mixed-effects models and multilevel mediation analyses.

RESULTS

LOCI significantly improved implementation leadership and implementation climate from baseline to follow-up at 4-, 8-, 12-, and 18-month post-baseline (all ps < .01), producing large effects (range of ds = 0.76 to 1.34). LOCI's effects on transformational leadership were small at 4 months (d = 0.31, p = .019) and nonsignificant thereafter (ps > .05). LOCI's improvement of clinic implementation climate from baseline to 12 months was mediated by improvement in implementation leadership from baseline to 4 months (proportion mediated [pm] = 0.82, p = .004). Transformational leadership did not mediate LOCI's effect on implementation climate (p = 0.136). Improvement in clinic implementation climate from baseline to 12 months mediated LOCI's effect on MBC fidelity during the same period (pm = 0.71, p = .045).

CONCLUSIONS

LOCI improved MBC fidelity in youth mental health services by improving clinic implementation climate, which was itself improved by increased implementation leadership. Fidelity to EBPs in healthcare settings can be improved by developing organizational leaders and strong implementation climates.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT04096274. Registered September 18, 2019.

Developing and testing a produce prescription implementation blueprint to improve food security in a clinical setting: a pilot study protocol

BACKGROUND

Food insecurity is common in the United States, especially in Rhode Island, where it affects up to 33% of residents. Food insecurity is associated with adverse health outcomes and disproportionally affects people from minoritized backgrounds. Produce prescription programs, in which healthcare providers write "prescriptions" for free or reduced cost vegetables, have been used to address food insecurity and diet-related chronic disease. Although there is growing evidence for the effectiveness of produce prescription programs in improving food security and diet quality, there have been few efforts to use implementation science methods to improve the adoption of these programs.

METHODS

This two-phase pilot study will examine determinants and preliminary implementation and effectiveness outcomes for an existing produce prescription program. The existing program is funded by an Accountable Care Organization in Rhode Island and delivered in primary care practices. For the first phase, we conducted a formative evaluation, guided by the Consolidated Framework for Implementation Research 2.0, to assess barriers, facilitators, and existing implementation strategies for the produce prescription program. Responses from the formative evaluation were analyzed using a rapid qualitative analytic approach to yield a summary of existing barriers and facilitators. In the second phase, we presented our formative evaluation findings to a community advisory board consisting of primary care staff, Accountable Care Organization staff, and staff who source and deliver the vegetables. The community advisory board used this information to identify and refine a set of implementation strategies to support the adoption of the program via an implementation blueprint. Guided by the implementation blueprint, we will conduct a single-arm pilot study to assess implementation antecedents (i.e., feasibility, acceptability, appropriateness, implementation climate, implementation readiness), implementation outcomes (i.e., adoption), and preliminary program effectiveness (i.e., food and nutrition security). The first phase is complete, and the second phase is ongoing.

DISCUSSION

This study will advance the existing literature on produce prescription programs by formally assessing implementation determinants and developing a tailored set of implementation strategies to address identified barriers. Results from this study will inform a future fully powered hybrid type 3 study that will use the tailored implementation strategies and assess implementation and effectiveness outcomes for a produce prescription program.

TRIAL REGISTRATION

Clinical trials: NCT05941403 , Registered June 9, 2023.

Food is Medicine and implementation science: A recipe for health equity

Diet-related chronic diseases such as Type II diabetes, cardiometabolic diseases, and cancer are among the leading causes of death in the USA. Nutrition security has emerged as a target outcome and a national priority for preventative medicine and the treatment of diet-related chronic diseases. Food is Medicine (FIM) initiatives encompass programs and interventions to meet priority population's needs across food and nutrition security continuums as a mechanism to address persistent food and nutrition inequities. In this position statement, we draw on implementation science, specifically the Exploration, Preparation, Implementation, and Sustainment (EPIS) Framework and health equity principles to provide guidance on FIM initiatives. As the FIM evidence base continues to grow, we encourage the EPIS framework be applied as one lens through which we can improve our understanding of FIM implementation among multiple contexts to understand what works, for whom, and under what circumstances. Ultimately, this position statement aims to call to action the incorporation of implementation science and equity principles into FIM efforts.

Facilitators and barriers for implementation of health programmes with Māori communities

BACKGROUND

Addressing health inequities that Māori (Indigenous peoples) communities face in New Zealand is a key aim of researchers and practitioners. However, there is limited understanding of the implementation processes and outcomes of health programmes for addressing these inequities. The aim of this study was twofold: (a) to identify correlates of implementation outcomes and (b) to identify facilitators and barriers to implementation effectiveness.

METHODS

The study involved a concurrent mixed method approach. Through an online survey, 79 participants with experience in implementing a health programme with a Māori community identified outcomes and processes of the programme. Additionally, nine Māori community providers shared their perceptions and experience of facilitators and barriers to implementation effectiveness through an in-depth interview. The quantitative and qualitative findings were integrated to address the aims of the study.

RESULTS

For the first aim, we identified two key outcomes: overall health impacts and sustainability. Three of the variables had significant and positive bivariate correlations with health impacts: cultural alignment, community engagement, and individual skills. The only significant correlate of sustainability was evidence-based. For the second aim, participants described four facilitators (leadership, whanaungatanga [relationships], sharing information, digestible information) and four barriers (system constraints, lack of funding, cultural constraints, lack of engagement) to effective implementation.

CONCLUSION

Overall, leadership, aligning culture, and building on whanaungatanga, while getting financial resources and systems support, are the core elements to supporting implementation efforts in Māori communities.

Aligning organisational priorities and implementation science for cancer research

BACKGROUND

The challenge of implementing evidence into routine clinical practice is well recognised and implementation science offers theories, models and frameworks to promote investigation into delivery of evidence-based care. Embedding implementation researchers into health systems is a novel approach to ensuring research is situated in day-to-day practice dilemmas. To optimise the value of embedded implementation researchers and resources, the aim of this study was to investigate stakeholders' views on opportunities for implementation science research in a cancer setting that holds potential to impact on care. The research objectives were to: 1) Establish stakeholder and theory informed organisation-level implementation science priorities and 2) Identify and prioritise a test case pilot implementation research project.

METHODS

We undertook a qualitative study using semi-structured interviews. Participants held either a formal leadership role, were research active or a consumer advocate and affiliated with either a specialist cancer hospital or a cancer alliance of ten hospitals. Interview data were summarised and shared with participants prior to undertaking both thematic analysis, to identify priority areas for implementation research, and content analysis, to identify potential pilot implementation research projects. The selected pilot Implementation research project was prioritised using a synthesis of an organisational and implementation prioritisation framework - the organisational priority setting framework and APEASE framework.

RESULTS

Thirty-one people participated between August 2022 and February 2023. Four themes were identified: 1) Integration of services to address organisational priorities e.g., tackling fragmented services; 2) Application of digital health interventions e.g., identifying the potential benefits of digital health interventions; 3) Identification of potential for implementation research, including deimplementation i.e., discontinuing ineffective or low value care and; 4) Focusing on direct patient engagement e.g., wider consumer awareness of the challenges in delivering cancer care. Six potential pilot implementation research projects were identified and the EMBED project, to support clinicians to refer appropriate patients with cancer for genetic testing, was selected using the synthesised prioritisation framework.

CONCLUSIONS

Using a theory informed and structured approach the alignment between strategic organisational priorities and implementation research priorities can be identified. As a result, the implementation research focus can be placed on activities with the highest potential impact.

Study protocol for the ACTIVE SCHOOL study investigating two different strategies of physical activity to improve academic performance in Schoolchildren

BACKGROUND

Previous research has suggested that school-based physical activity (PA) interventions may have a positive impact on academic performance. However, existing literature on school-based interventions encompasses various forms of PA, spanning from vigorous intensity PA outside the academic classes to light intensity PA and movement integrated into academic learning tasks, and results on academic performance are inconclusive. ACTIVE SCHOOL will implement two different PA interventions for one school year and assess the effects on the pupils' academic performance, with math performance as the primary outcome.

METHODS/DESIGN

The ACTIVE SCHOOL project consists of two phases: 1) Development phase and 2) Randomized Controlled Trial (RCT). In phase one, two interventions were developed in collaboration with school staff. The two interventions were tested in an 8-weeks feasibility study. In phase two, a RCT-study with three arms will be conducted in 9-10-year-old children for one school year. The RCT-study will be carried out in two intervention rounds during the school years 2023/2024 and 2024/2025. Schools will be randomized to one of two interventions or control;1) Run, Jump & Fun intervention (4 × 30 min/week of moderate-to-vigorous physical activity; 2) Move & Learn intervention (4 × 30 min/week focusing on embodied learning in math and Danish lessons); or 3) a control condition, consisting of normal teaching practices. Outcome measures include academic performance, PA level, cognitive functions, cardiorespiratory fitness, anthropometry, well-being and school motivation (collected before, during and after the intervention period). A process evaluation will be conducted to assess implementation.

DISCUSSION

The ACTIVE SCHOOL study will expand knowledge regarding the impact of PA on academic performance. The study will have the potential to significantly contribute to future research, as well as the scientific and educational debate on the best way to implement PA to support education and learning.

TRIAL REGISTRATION

The study was registered on the 25th of October 2022 in ClinicalTrials.gov, NCT05602948.

Rethinking Barriers and Enablers in Qualitative Health Research: Limitations, Alternatives, and Enhancements

Explorations of barriers and enablers (or barriers and facilitators) to a desired health practice, implementation process, or intervention outcome have become so prevalent that they seem to be a default in much health services and public health research. In this article, we argue that decisions to frame research questions or analyses using barriers and enablers (B&Es) should not be default. Contrary to the strengths of qualitative research, the B&Es approach often bypasses critical reflexivity and can lead to shallow research findings with poor understanding of the phenomena of interest. The B&Es approach is untheorised, relying on assumptions of linear, unidirectional processes, universally desirable outcomes, and binary thinking which are at odds with the rich understanding of context and complexity needed to respond to the challenges faced by health services and public health. We encourage researchers to develop research questions using informed deliberation that considers a range of approaches and their implications for producing meaningful knowledge. Alternatives and enhancements to the B&Es approach are explored, including using 'whole package' methodologies; theories, conceptual frameworks, and sensitising ideas; and participatory methods. We also consider ways of advancing existing research on B&Es rather than doing 'more of the same': researchers can usefully investigate how a barrier or enabler works in depth; develop and test implementation strategies for addressing B&Es; or synthesise the B&Es literature to develop a new model or theory. Illustrative examples from the literature are provided. We invite further discussion on this topic.

Implementing Dysphagia Outcome Assessments into Clinical Settings: Leveraging Principles of Implementation, Dissemination, and Psychometrics

PURPOSE

Myriad dysphagia assessment tools have been designed, but their application is variable. This is partly due to a lack of implementation and dissemination strategy as well as to limited guidance regarding which instruments are optimally designed and best used for clinical and research applications.

METHOD

This tutorial provides a high-level overview of implementation and dissemination, their interaction with psychometrics and knowledge coproduction, and how these concepts relate to proper development and widespread application of contextually relevant, psychometrically optimized, evidence-based dysphagia assessment instruments.

RESULTS

A review of the literature identified two dysphagia assessment instruments that purposefully integrated implementation and dissemination processes after measurement development. Application of knowledge coproduction was not identified in any papers reporting development and testing of dysphagia assessment instruments. A better understanding of coproduction and psychometrics when developing measures, while simultaneously applying implementation science and dissemination strategies, can result in the development of optimal dysphagia assessment tools that are more consistently adopted into clinical practice.

CONCLUSIONS

Clinicians and researchers should promote the development of psychometrically sound measures, and employ principles of implementation science and effective dissemination strategies to advocate for, and promote the use of, well-designed instruments within their appropriate clinical contexts. Support from governing bodies and funding agencies could enhance future efforts to develop, and encourage widespread uptake of, optimally developed dysphagia assessment tools.

How PrEP delivery was integrated into public ART clinics in central Uganda: A qualitative analysis of implementation processes

Tailored delivery strategies are important for optimizing the benefit and overall reach of PrEP in sub-Saharan Africa. An integrated approach of delivering time-limited PrEP in combination with ART to serodifferent couples encourages PrEP use in the HIV-negative partner as a bridge to sustained ART use. Although PrEP has been delivered in ART clinics for many years, the processes involved in integrating PrEP into ART services are not well understood. The Partners PrEP Program was a stepped-wedge cluster randomized trial of integrated PrEP and ART delivery for HIV serodifferent couples in 12 public health facilities in central Uganda (Clinicaltrials.gov NCT03586128). Using qualitative data, we identified and characterized key implementation processes that explain how PrEP delivery was integrated into existing ART services in the Partners PrEP Program. In-depth interviews were conducted with a purposefully-selected sub-sample of 83 members of 42 participating serodifferent couples, and with 36 health care providers implementing integrated delivery. High quality training, technical supervision, and teamwork were identified as key processes supporting providers to implement PrEP delivery. Interest in the PrEP program was promoted through the numerous ways health care providers made integrated ART and PrEP meaningful for serodifferent couples, including tailored counseling messages, efforts to build confidence in integrated delivery, and strategies to create demand for PrEP. Couples in the qualitative sample responded positively to providers' efforts to promote the integrated strategy. HIV-negative partners initiated PrEP to preserve their relationships, which inspired their partners living with HIV to recommit to ART adherence. Lack of disclosure among couples and poor retention on PrEP were identified as barriers to implementation of the PrEP program. A greater emphasis on understanding the meaning of PrEP for users and its contribution to implementation promises to strengthen future research on PrEP scale up in sub-Saharan Africa.

A qualitative study of the implementation and organization of the national Greenlandic addiction treatment service

Background

Alcohol and cannabis use constitutes the major public health problems in Greenland. Thus, it is important to assess if Allorfik, a new national outpatient addiction treatment service introduced in 2016, was implemented successfully and how it is perceived. Allorfik introduced local treatment centers offering a treatment methodology (motivational interviewing and cognitive therapy) new to addiction treatment in Greenland with limited evidence from Indigenous populations such as the Greenlandic. The present study investigates the implementation of Allorfik from the perspective of those engaged in the process and the field.

Methods

Data consisted of transcribed interviews with 23 individuals from both Allorfik and organizations collaborating with or supposed to collaborate with Allorfik. The theme of the interviews was their perspectives on the implementation process, enablers, and obstacles in the process and how Allorfik was performing at the time of the interview. The interview guide was informed by implementation theory. The transcribed material was analyzed using a general inductive approach.

Results

The analysis resulted in three overall and interconnected themes, namely, implementation, collaborations, and challenges. The implementation was overall considered a success by the interviewees as all components were implemented as planned with a few adaptions, e.g., a treatment guideline update. The collaborations are considered challenging but important to all interviewees. Collaborations seem to rely on personal commitment as opposed to well-defined structures, making it unstable and vulnerable to changes in staff. One of the main challenges highlighted by the interviewees is the number of problems other than addiction among people in treatment, which makes addiction treatment and recovery difficult to achieve. Nevertheless, the high levels of other problems being treated in Allorfik highlights the need for easily accessible therapy as many find that Allorfik is the only place to turn to in times of crisis.

Conclusion

Allorfik seems to have been implemented in accordance with original intentions and plans for addiction treatment service but has also become more than just a service for addiction treatment with easy access in a country with vast distances and limited resources.

Effectiveness of Multifaceted Strategies to Increase Influenza Vaccination Uptake: A Cluster Randomized Trial

Importance

Influenza vaccination rates remain low among primary school students and vary by school in Beijing, China. Theory-informed, multifaceted strategies are needed to improve influenza vaccination uptake.

Objective

To evaluate the effectiveness of multifaceted strategies in improving influenza vaccination uptake among primary school students.

Design, Setting, and Participants

This cluster randomized trial was conducted from September 2022 to May 2023 across primary schools in Beijing, China. Schools were allocated randomly in a 1:1 ratio to multifaceted strategies or usual practice. Schools were deemed eligible if the vaccination rates in the 2019 to 2020 season fell at or below the district-wide average for primary schools. Eligible participants included students in grades 2 and 3 with no medical contraindications for influenza vaccination.

Intervention

The multifaceted strategies intervention involved system-level planning and coordination (eg, developing an implementation blueprint, building social norms, and enhancing supervision), school-level training and educating school implementers (eg, conducting a 1-hour training and developing educational materials), and individual-level educating and reminding students and parents (eg, conducting educational activities and sending 4 reminders about vaccination).

Main Outcomes and Measures

The primary outcomes were influenza vaccination uptake at school reported by school clinicians as well as overall vaccine uptake either at school or outside of school as reported by parents at 3 months. Generalized linear mixed models were used for analysis.

Results

A total of 20 schools were randomized. One intervention school and 2 control schools did not administer vaccination on school grounds due to COVID-19, resulting in a total of 17 schools (9 intervention and 8 control). There was a total of 1691 students aged 7 to 8 years (890 male [52.6%]; 801 female [47.4%]) including 915 in the intervention group and 776 in the control group. Of all participants, 848 (50.1%) were in grade 2, and 1209 (71.5%) were vaccinated in the 2021 to 2022 season. Participants in the intervention and control groups shared similar characteristics. At follow-up, of the 915 students in the intervention group, 679 (74.5%) received a vaccination at school, and of the 776 students in the control group, 556 (71.7%) received a vaccination at school. The overall vaccination rates were 76.0% (695 of 915 students) for the intervention group and 71.3% (553 of 776 students) for the control group. Compared with the control group, there was significant improvement of vaccination uptake at school (odds ratio, 1.40; 95% CI, 1.06-1.85; P = .02) and overall uptake (odds ratio, 1.49; 95% CI, 1.12-1.99; P = .01) for the intervention group.

Conclusions and Relevance

In this study, multifaceted strategies showed modest effectiveness in improving influenza vaccination uptake among primary school students, which provides a basis for the implementation of school-located vaccination programs of other vaccines in China, and in other countries with comparable programs.

Trial registration

Chinese Clinical Trial Registry: ChiCTR2200062449.

Telemedicine Implementation for Safety Net Populations: A Systematic Review

Background: Telemedicine systems were rapidly implemented in response to COVID-19. However, little is known about their effectiveness, acceptability, and sustainability for safety net populations. This study systematically reviewed primary care telemedicine implementation and effectiveness in safety net settings. Methods: We searched PubMed for peer-reviewed articles on telemedicine implementation from 2013 to 2021. The search was done between June and December 2021. Included articles focused on health care organizations that primarily serve low-income and/or rural populations in the United States. We screened 244 articles from an initial search of 343 articles and extracted and analyzed data from N = 45 articles. Results: Nine (20%) of 45 articles were randomized controlled trials. N = 22 reported findings for at least one marginalized group (i.e., racial/ethnic minority, 65 years+, limited English proficiency). Only n = 19 (42%) included African American/Black patients in demographics descriptions, n = 14 (31%) LatinX/Hispanic patients, n = 4 (9%) Asian patients, n = 4 (9%) patients aged 65+ years, and n = 4 (9%) patients with limited English proficiency. Results show telemedicine can provide high-quality primary care that is more accessible and affordable. Fifteen studies assessed barriers and facilitators to telemedicine implementation. Common barriers were billing/administrative workflow disruption (n = 9, 20%), broadband access/quality (n = 5, 11%), and patient preference for in-person care (n = 4, 9%). Facilitators included efficiency gains (n = 6, 13%), patient acceptance (n = 3, 7%), and enhanced access (n = 3, 7%). Conclusions: Telemedicine is an acceptable care modality to deliver primary care in safety net settings. Future studies should compare telemedicine and in-person care quality and test strategies to improve telemedicine implementation in safety net settings.

Coordination of family's care in an evidence-based nurse home visiting program

Interprofessional care coordination within evidence-based prevention programs like Nurse-Family Partnership® (NFP) is necessary to meet family needs and maximize program impact. This study aimed to describe the coordination of families' care in the NFP home visiting context. We used an adapted grounded theory approach and purposively sampled seven NFP sites. We conducted telephone interviews with 95 participants: 51 NFP staff (54%), 39 healthcare providers (41%), and 5 social service providers (5%). All interviews were recorded, transcribed, validated, and analyzed in NVivo11. Many community providers in all sites described their knowledge of the characteristics of the NFP intervention, including the strength of its evidence to achieve outcomes. Care coordination was dynamic and changed over time based on client needs and staff willingness to work together. Effective care coordination in the NFP context from the provider perspective is driven by shared knowledge, integrated systems, mission alignment, and individual champions who value the program.

Core Components and Implementation Determinants of Multilevel Service Delivery Frameworks Across Child Mental Health Service Settings

Multilevel service delivery frameworks are approaches to structuring and organizing a spectrum of evidence-based services and supports, focused on assessment, prevention, and intervention designed for the local context. Exemplar frameworks in child mental health include positive behavioral interventions and supports in education, collaborative care in primary care, and systems of care in community mental health settings. Yet, their high-quality implementation has lagged. This work proposes a conceptual foundation for multilevel service delivery frameworks spanning diverse mental health service settings that can inform development of strategic implementation supports. We draw upon the existing literature for three exemplar multilevel service delivery frameworks in different child mental health service settings to (1) identify core components common to each framework, and (2) to highlight prominent implementation determinants that interface with each core component. Six interrelated components of multilevel service delivery frameworks were identified, including, (1) a systems-level approach, (2) data-driven problem solving and decision-making, (3) multiple levels of service intensity using evidence-based practices, (4) cross-linking service sectors, (5) multiple providers working together, including in teams, and (6) built-in implementation strategies that facilitate delivery of the overall model. Implementation determinants that interface with core components were identified at each contextual level. The conceptual foundation provided in this paper has the potential to facilitate cross-sector knowledge sharing, promote generalization across service settings, and provide direction for researchers, system leaders, and implementation intermediaries/practitioners working to strategically support the high-quality implementation of these frameworks.

Creating a framework for change: transitioning to value-based healthcare in Queensland

Value-based healthcare has been described as the sustainable, equitable and transparent use of healthcare resources to achieve improved experiences and outcomes for people and communities. It is supported by all levels of government in Australia, with recent initiatives championing a shift away from traditional, clinician-centric care delivery to a more contemporary, value-based approach. To date, however, efforts in Queensland have focused on smaller scale siloed models of care and have not extended to the transformational change required to create equitable and sustainable healthcare delivery. The Queensland Health Allied Health Framework for Value-Based Health Care (the Framework) builds on contemporary frameworks with reference to the local context in Queensland and provides a structure and starting point for clinicians and managers to work together with consumers to transform services to focus on preventative health and wellbeing, shifting the focus of care to the community and sustainably improving the quality of care delivered. The Framework outlines key considerations for the design and implementation of new services, including understanding the care pathway, supporting an outcome driven workplace culture, measuring what matters and designing for outcomes. Several key lessons were learnt during the development of the Framework, including the importance of early and sustained consumer partnerships, of establishing a shared definition of value-based healthcare that enables integration across the care pathway and the need for leadership at all levels to actively support the change management process. While developed for Queensland public allied health services, the Framework is intended to be a system-wide tool relevant to all health professionals and services.

N-of-1 medicine

ABSTRACT

The fields of precision and personalised medicine have led to promising advances in tailoring treatment to individual patients. Examples include genome/molecular alteration-guided drug selection, single-patient gene therapy design and synergy-based drug combination development, and these approaches can yield substantially diverse recommendations. Therefore, it is important to define each domain and delineate their commonalities and differences in an effort to develop novel clinical trial designs, streamline workflow development, rethink regulatory considerations, create value in healthcare and economics assessments, and other factors. These and other segments are essential to recognise the diversity within these domains to accelerate their respective workflows towards practice-changing healthcare. To emphasise these points, this article elaborates on the concept of digital health and digital medicine-enabled N-of-1 medicine, which individualises combination regimen and dosing using a patient's own data. We will conclude with recommendations for consideration when developing novel workflows based on emerging digital-based platforms.

Physical activity on prescription in Swedish primary care: a survey on use, views, and implementation determinants amongst general practitioners

INTRODUCTION

Swedish Physical Activity on Prescription (PAP) has been shown to increase physical activity levels, which is known to lead to positive health effects. PAP is being implemented in Swedish healthcare to various extents. However, there is a lack of knowledge about how Swedish general practitioners (GPs) work with PAP and what hinders and facilitates wider implementation.

AIMS

This study aimed to survey GPs' use and views of PAP, identify barriers and facilitators for implementing PAP, and explore associations to gender, practice location, and experience.

METHODS

The study was framed by the Normalization Process Theory. A survey was sent to 463 GPs at 69 different healthcare centres in Region Västra Götaland. Data were analysed using multiple logistic and linear regressions.

RESULTS

A total of 143 GPs completed the survey (response rate 31%). Views on PAP were generally positive amongst respondents, but only 27% reported using PAP regularly. The most prominent reported barriers were insufficient training and resources. Positive views and willingness to collaborate in using PAP were identified as facilitators. Responding GPs in Gothenburg used PAP more often (OR 6.4; 95% CI 2.7-14.8) and were significantly more positive to the method than GPs in other areas of the region. GPs with more than 10 years of practice used PAP more often (OR 2.5; 95% CI 1.1-6.0) than less experienced GPs. Few of the investigated variables were associated with gender.

CONCLUSIONS

The positive views amongst responding GPs are helpful, but more education, training and resources are needed for successful implementation of PAP in Swedish primary health care.

The Pathway Building Technique in Implementation Research Using Mixed Methods Design

BACKGROUND

Data integration refers to combining quantitative and qualitative data in mixed methods. It can be achieved through several integration procedures. The building integration procedure can be used for developing quantitative instruments by integrating data from the qualitative phase. There are limited examples of data integration using the building procedure in mixed methods and implementation science.

PURPOSE

The purpose of this article is to illustrate how the pathway building technique can be used to integrate data in mixed methods research through concurrent use of implementation science models and frameworks.

METHODS

This two pathway building technique was developed based on a mixed methods implementation project of developing implementation strategies to promote compassionate nursing care of complex patients.

RESULTS

The first pathway is the integration of qualitative data from the first phase of mixed methods study with implementation models and frameworks to create a quantitative instrument (i.e., a Q-sort survey) for the subsequent phase. The second pathway is the operationalization of the Q-sort survey results (i.e., implementation strategies) using an implementation science specification framework.

CONCLUSION

The pathway technique is valuable for mixed methods research and implementation science as it offers a theory-based innovative method to tackle integration challenge.

Exploring expectations and readiness for healthy lifestyle promotion in Swedish primary health care: a qualitative analysis of managers, facilitators, and professionals

OBJECTIVE

Prior to a multifaceted implementation strategy for a healthy lifestyle-promoting practice the expectations of primary health care managers, appointed internal facilitators and health care professionals on supporting change was explored.

DESIGN

This study had an explorative qualitative design using data gathered from individual interviews and focus groups. Qualitative content analysis with a deductive category development was applied using the Consolidated Framework for Implementation Research.

SETTING AND PARTICIPANTS

The study was conducted in a primary care setting in central Sweden as a part of the Act in Time research project. Prior to a multifaceted implementation strategy, we held 16 individual interviews with managers and appointed facilitators and five focus groups with 26 health care professionals.

RESULTS

Managers, facilitators, and professionals held similar expectations, where their expressed need for support corresponded to three constructs: Readiness for implementation, Implementation climate, and Engaging. Our findings indicate the need for strong leadership engagement to focus on how the healthy lifestyle-promoting practice can be anchored among the professionals. Managers at all levels should communicate the vision and goals, enable facilitators and professionals to improve their competencies, build inter-professional teams, and jointly plan the new practice.

CONCLUSION

To change to a healthy lifestyle promoting practice professionals request support from their managers, who in turn need support from the middle and top managers. The requested support includes helping to prioritise health promotion and enabling the primary care centres to build competence and take ownership of the implementation.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04799860.

Design of a hybrid implementation effectiveness cluster randomized controlled trial of delivering written exposure therapy for PTSD in underserved primary care settings

INTRODUCTION

Posttraumatic stress disorder (PTSD) results in substantial costs to society. Prevalence of PTSD among adults is high, especially among those presenting to primary care settings. Evidence-based psychotherapies (EBPs) for PTSD are available but dissemination and implementation within primary care settings is challenging. Building Experience for Treating Trauma and Enhancing Resilience (BETTER) examines the effectiveness of integrating Written Exposure Therapy (WET) within primary care collaborative care management (CoCM). WET is a brief exposure-based treatment that has the potential to address many challenges of delivering PTSD EBPs within primary care settings.

METHODS

The study is a hybrid implementation effectiveness cluster-randomized controlled trial in which 12 Federally Qualified Health Centers (FQHCs) will be randomized to either CoCM plus WET (CoCM+WET) or CoCM only with 60 patients within each FQHC. The primary aim is to evaluate the effectiveness of CoCM+WET to improve PTSD and depression symptom severity. Secondary treatment outcomes are mental and physical health functioning. The second study aim is to examine implementation of WET within FQHCs using FQHC process data and staff interviews pre- and post-intervention. Exploratory aims are to examine potential moderators and mediators of the intervention. Assessments occur at baseline, and 3- and 12-month follow-up.

CONCLUSION

The study has the potential to impact practice and improve clinical and public health outcomes. By establishing the effectiveness and feasibility of delivering a brief trauma-focused EBP embedded within CoCM in primary care, the study aims to improve PTSD outcomes for underserved patients.

TRIAL REGISTRATION

(Clinicaltrials.govNCT05330442).

Institutionalizing Innovation: From Pilot to Scale for Co-Packaged Oral Rehydration Salts and Zinc-A Case Study in Zambia

We document the development and institutionalization in Zambia of a health innovation for diarrhea treatment aimed at children aged younger than 5 years: a unique oral rehydration salts and zinc (ORSZ) co-pack. Seven recommendations from the World Health Organization/ExpandNet are used retrospectively to analyze and describe the successful scale-up of this innovation from its concept stage, including in-country expansion and policy, institutional, and regulatory changes. The 7 recommendations comprise using a participatory process, tailoring to the country context, designing research to test the innovation, testing the innovation, identifying success factors, and scaling up. The scale-up of co-packaged ORSZ in Zambia is shown to be sustainable. Five years after donor funding ended in 2018, an independent, local manufacturer continues to supply the private and public sectors on a commercially viable basis. Furthermore, national coverage of ORSZ increased from less than 1% in 2012 to 34% in 2018. A key success factor was the continuous facilitation over 8 years (spanning planning, trial, evaluation, and scale-up) by a learning and steering group chaired by the Ministry of Health, open to all and focused on learning transfer and ongoing alignment with other initiatives. Other success factors included a long lead-in of inclusive initial consultation, ideation, and planning with all key stakeholders to build on and mobilize existing resources, knowledge, structures, and systems; alignment with government policy; thorough testing and radical review of the product and its value chain before scale-up, including manufacture, distribution, policy, and regulatory matters; and adoption by the government of a co-packaging strategy to ensure cases of childhood diarrhea are treated with ORSZ. With appropriate local adaptations, this approach to scale-up could be replicated in other low- and middle-income countries as a strategy to increase coverage of ORSZ and potentially other health products.

Model of multidisciplinary teamwork in hip fracture care: a qualitative interview study

OBJECTIVES

Hip fractures are common injuries in older age with high mortality requiring multidisciplinary clinical care. Despite guidance, there is considerable variation in hip fracture services and patient outcomes; furthermore, little is known about how successful multidisciplinary working can be enabled. This study aimed to characterise professionals' views about the core components of multidisciplinary teamwork in hip fracture care.

DESIGN

The study comprised qualitative interviews with healthcare professionals delivering hip fracture care. Interviews were audio recorded, transcribed and analysed abductively: material was coded inductively and grouped into higher level concepts informed by theories and frameworks relating to teamwork.

SETTING

Four hospitals in England.

PARTICIPANTS

Participants were 40 healthcare professionals including orthopaedic surgeons, orthogeriatricians, physiotherapists and service managers.

RESULTS

Results identified four components of successful multidisciplinary teamwork: (1) defined roles and responsibilities, (2) information transfer processes, (3) shared goals and (4) collaborative leadership. These were underpinned by a single concept: shared responsibility. Defined roles and responsibilities were promoted through formal care pathways, reinforced through induction and training with clear job plans outlining tasks. Information transfer processes facilitated timely information exchange to appropriate individuals. Well-defined common purpose was hindered by complex interdisciplinary professional relationships, particularly between orthogeriatric and orthopaedic staff, and encouraged through multidisciplinary team meetings and training. Clinical service leads were integral to bridging interdisciplinary boundaries. Mutual trust and respect were based on recognition of the value of different professional groups. Teamwork depended on formal clinical leads with facilitative and motivational roles, and on hospital leadership that created an environment supporting collaboration. Shared responsibility for patients was encouraged by joint orthopaedic and orthogeriatric care models. Staff shared responsibility by assisting colleagues when needed.

CONCLUSIONS

Shared responsibility across the multidisciplinary team is fundamental to delivery of hip fracture care. Findings will inform development of clinical practice recommendations and training to build teamworking competencies.

Aligning the planning, development, and implementation of complex interventions to local contexts with an equity focus: application of the PRISM/RE-AIM Framework

For the fields of implementation science and health equity, understanding and being responsive to local contexts is of utmost importance to better inform the development, implementation, and evaluation of healthcare and public health interventions to increase their uptake and sustainment. Contexts are multi-level and include political, historical, economic, and social factors that influence health, as well as organizational characteristics, reflecting the richness of members' views, resources, values, and needs. Poor alignment between solutions and those contextual characteristics could have an impact on inequities. The PRISM (Practical Robust Implementation and Sustainability Model) is a context-based implementation science framework that incorporates RE-AIM outcomes (Reach, Effectiveness, Adoption, Implementation, Maintenance) and offers guidance to researchers, practitioners, and their patient and community partners on how to conceptualize, assess, and address contextual domains with a focus on health equity. Drawing from systems thinking, participatory engagement, and health equity principles, this commentary expands on previous work to 1) offer a novel perspective on how to align an intervention's core functions and forms with the PRISM's contextual domains, and 2) foster an ongoing and iterative engagement process with diverse partners throughout the research and practice process using a co-creation approach. We recommend intervention-to-context alignment through iterative cycles. To that end, we present the RE-AIM Framework's 'outcomes cascade' to illustrate touch points of opportunity and gaps within and across each of the five RE-AIM outcomes to illustrate 'where things go wrong'. We present a case study to illustrate and offer recommendations for research and practice efforts to increase contextual responsiveness, and enhance alignment with context before, during, and after implementation efforts and to ensure equity is being addressed. We strive to make a conceptual contribution to advance the field of pragmatic research and implementation of evidence-based practices through the application of the contextually-based PRISM framework with a focus on health equity.

Determinants of Implementing an Information and Communication Technology Tool for Social Interaction Among Older People: Qualitative Content Analysis of Social Services Personnel Perspectives

BACKGROUND

Older people are particularly vulnerable to social isolation and loneliness, which can lead to ill-health, both mentally and physically. Information and communication technology (ICT) can supplement health and social care and improve health among the vulnerable, older adult population. When ICT is used specifically for communication with others, it is associated with reduced loneliness in older populations. Research is sparse on how the implementation of ICT, used specifically for communication among older people in social services, can be performed. It is recommended to consider the determinants of implementation, that is, barriers to and facilitators of implementation. Determinants related to older people using ICT tools are reported in several studies. To the best of our knowledge, studies investigating the determinants related to the social services perspective are lacking.

OBJECTIVE

This study aims to explore the determinants of implementing the Fik@ room, a new, co-designed, and research-based ICT tool for social interaction among older people, from a social services personnel perspective.

METHODS

This study used an exploratory, qualitative design. An ICT tool called the Fik@ room was tested in an intervention study conducted in 2021 in 2 medium-sized municipalities in Sweden. Informants in this study were municipal social services personnel with experience of implementing this specific ICT tool in social services. We conducted a participatory workshop consisting of 2 parts, with 9 informants divided into 2 groups. We analyzed the data using qualitative content analysis with an inductive approach.

RESULTS

The results included 7 categories of determinants for implementing the ICT tool. Being able to introduce the ICT tool in an appropriate manner concerns the personnel's options for introducing and supporting the ICT tool, including their competencies in using digital equipment. Organizational structure concerns a structure for communication within the organization. Leadership concerns engagement and enthusiasm as driving forces for implementation. The digital maturity of the social services personnel concerns the personnel's skills and attitudes toward using digital equipment. Resources concern time and money. IT support concerns accessibility, and legal liability concerns possibilities to fulfill legal responsibilities.

CONCLUSIONS

The results show that implementation involves an entire organization at varying degrees. Regardless of how much each level within the organization comes into direct contact with the ICT tool, all levels need to be involved to create the necessary conditions for successful implementation. The prerequisites for the implementation of an ICT tool will probably change depending on the digital maturity of future generations. As this study only included 9 informants, the results should be handled with care. The study was performed during the COVID-19 pandemic, which has probably affected the results.

Development and psychometric assessment of Health Action Process Approach (HAPA) in terms of smoking cessation among Chinese smokers

The Health Action Process Approach (HAPA) is a two-stage (pre-intentional and post-intentional) behavioral change model that distinguishes between motivation and volition in behavior change process. This study aims to develop HAPA-based assessments for smoking cessation among current smokers. The HAPA-based measures were developed and the draft measures included nine constructs, namely, risk perception in smoking-induced cancer, risk perception in smoking-induced systemic disease, positive outcome expectancy, negative outcome expectancy, self-efficacy in quitting smoking, self-efficacy in maintaining, self-efficacy in re-initiating, quitting planning and coping planning in smoking cessation, with a total of 26 items. A cross-sectional survey was conducted in China in 2022. Principal Component Analysis was used for Exploratory Factor Analysis (EFA). Cronbach's α coefficient was calculated to evaluate the internal consistency. Variables such as severity of smoking addiction were selected to evaluate the correlation between the HAPA scale and these variables. Of the 928 participants, 76.4% (709/928) were male and the median age was 35 years. Five factors were extracted by EFA. The factor loadings of each item were all greater than 0.60, and the cumulative variance contribution rate was 90.15%. The Cronbach's α coefficient of each HAPA-based subscales was 0.929-0.986. The HAPA-based measurements are comprehensive, reliable and valid in the assessment of smokers' smoking cessation cognition, which can be used to guide the design and implementation of intervention and the development of theory.

Barriers and facilitators for physical fitness training in orthopedic geriatric rehabilitation. A qualitative study

PURPOSE

The aim of this explorative, qualitative study is to identify factors that potentially influence the execution of physical fitness training in inpatient orthopedic geriatric rehabilitation (GR), from the perspectives of patients, their relatives and professionals.

MATERIALS AND METHODS

In GR wards of skilled nursing facilities in the Netherlands, semi-structured interviews were held with triads of patients, their relatives and responsible nurses, and focus groups with members of the multidisciplinary teams. Verbatim reports were analyzed according to the framework method.

RESULTS

We found twelve categories of barriers and facilitators related to characteristics of the patients, their family, staff, training program and organization.

CONCLUSIONS

The barriers and facilitators found largely correspond with those found for participation in exercise in related settings, but also show important differences. This overview of barriers and facilitators enables multidisciplinary teams to design improvements at the level of the organization and interventions, as well as at the level of the individual training program, tailoring it to the patient's circumstances and needs. Further research should focus on weighing these barriers and facilitators to develop a feasible guidance for daily practice, as well as testing their effect on the adherence to existing physical fitness training guidelines.

Implementing a tobacco-free workplace program at a substance use treatment center: a case study

BACKGROUND

People with substance use disorders smoke cigarettes at much higher rates than the general population in the United States and are disproportionately affected by tobacco-related diseases. Many substance use treatment centers do not provide evidence-based tobacco cessation treatment or maintain comprehensive tobacco-free workplace policies. The goal of the current work is to identify barriers and facilitators to a successful and sustainable implementation of a tobacco-free workplace program, which includes a comprehensive tobacco-free policy and evidence-based cessation treatment services, in a substance use treatment center.

METHODS

This study is based on an ethnographic approach and uses a qualitative case study design. Data were collected via interviews with staff (n = 6) and clients (n = 16) at the substance use treatment center and site visits (n = 8). Data were analyzed using thematic analysis guided by the extended Normalization Process Theory designed to inform the implementation of innovations in healthcare practice.

RESULTS

Staff at the substance use treatment center supported the implementation of the program and shared a good understanding of the purpose of the intervention and its potential benefits. However, the study identified significant challenges faced by the center during implementation, including widespread tobacco use among clients, contributing to attitudes among staff that tobacco cessation was a low-priority problem due to a perceived lack of interest in quitting and inability to quit among their clients. We identified several factors that contributed to changing this attitude, including provision of tobacco training to staff, active leadership support, low number of staff members who smoked, and access to material resources, including nicotine replacement products. The implementation and active enforcement of a comprehensive tobacco-free workplace program contributed to a gradual change in attitudes and improved the provision of evidence-based tobacco cessation care at the substance use treatment center.

CONCLUSIONS

Substance use treatment centers can integrate tobacco cessation practices in their daily operations, despite multiple challenges they face due to the complex behavioral health and socioeconomic needs of their clients. With proper support, substance use treatment centers can provide much needed tobacco cessation care to their clients who are disproportionately affected by tobacco-related health conditions and systemic health inequities.

Frameworks for measuring population health: A scoping review

INTRODUCTION

Many regions in the world are using the population health approach and require a means to measure the health of their population of interest. Population health frameworks provide a theoretical grounding for conceptualization of population health and therefore a logical basis for selection of indicators. The aim of this scoping review was to provide an overview and summary of the characteristics of existing population health frameworks that have been used to conceptualize the measurement of population health.

METHODS

We used the Population, Concept and Context (PCC) framework to define eligibility criteria of frameworks. We were interested in frameworks applicable for general populations, that contained components of measurement of health with or without its antecedents and applied at the population level or used a population health approach. Eligible reports of eligible frameworks should include at least domains and subdomains, purpose, or indicators. We searched 5 databases (Pubmed, EMBASE, Web of Science, NYAM Grey Literature Report, and OpenGrey), governmental and organizational sites on Google and websites of selected organizations using keywords from the PCC framework. Characteristics of the frameworks were summarized descriptively and narratively.

RESULTS

Fifty-seven frameworks were included. The majority originated from the US (46%), Europe (23%) and Canada (19%). Apart from 1 framework developed for rural populations and 2 for indigenous populations, the rest were for general urban populations. The numbers of domains, subdomains and indicators were highly variable. Health status and social determinants of health were the most common domains across all frameworks. Different frameworks had different priorities and therefore focus on different domains.

CONCLUSION

Key domains common across frameworks other than health status were social determinants of health, health behaviours and healthcare system performance. The results in this review serve as a useful resource for governments and healthcare organizations for informing their population health measurement efforts.

Protocol for co-producing a framework and integrated resource platform for engaging patients in laboratory-based research

BACKGROUND

Patient engagement in research is the meaningful and collaborative interaction between patients and researchers throughout the research process. Patient engagement can help to ensure patient-oriented values and perspectives are incorporated into the development, conduct, and dissemination of research. While patient engagement is increasingly prevalent in clinical research, it remains relatively unrealized in preclinical laboratory research. This may reflect the nature of preclinical research, in which routine interactions or engagement with patients may be less common. Our team of patient partners and researchers has previously identified few published examples of patient engagement in preclinical laboratory research, as well as a paucity of guidance on this topic. Here we propose the development of a process framework to facilitate patient engagement in preclinical laboratory research.

METHODS

Our team, inclusive of researchers and patient partners, will develop a comprehensive, empirically-derived, and stakeholder-informed process framework for 'patient engagement in preclinical laboratory research.' First, our team will create a 'deliberative knowledge space' to conduct semi-structured discussions that will inform a draft framework for preclinical patient engagement. Over the course of several sessions, we will identify actions, activities, barriers, and enablers (e.g. considerations and motivations for patient engagement in preclinical laboratory research, define roles of key players). The resulting draft process framework will be further populated with examples and refined through an international consensus-building Delphi survey with patients, researchers, and other collaborator organizations. We will then conduct pilot field tests to evaluate the framework with preclinical laboratory research groups paired with patient partners. These results will be used to create a refined framework enriched with real-world examples and considerations. All resources developed will be made available through an online repository.

DISCUSSION

Our proposed process framework will provide guidance, best practices, and standardized procedures to promote patient engagement in preclinical laboratory research. Supporting and facilitating patient engagement in this setting presents an exciting new opportunity to help realize the important impact that patients can make.

Deployment of a human-centred clinical decision support system for pulmonary embolism: evaluation of impact on quality of diagnostic decisions

Pulmonary embolism (PE) is a serious condition that presents a diagnostic challenge for which diagnostic errors often happen. The literature suggests that a gap remains between PE diagnostic guidelines and adherence in healthcare practice. While system-level decision support tools exist, the clinical impact of a human-centred design (HCD) approach of PE diagnostic tool design is unknown.

DESIGN

Before-after (with a preintervention period as non-concurrent control) design study.

SETTING

Inpatient units at two tertiary care hospitals.

PARTICIPANTS

General internal medicine physicians and their patients who underwent PE workups.

INTERVENTION

After a 6-month preintervention period, a clinical decision support system (CDSS) for diagnosis of PE was deployed and evaluated over 6 months. A CDSS technical testing phase separated the two time periods.

MEASUREMENTS

PE workups were identified in both the preintervention and CDSS intervention phases, and data were collected from medical charts. Physician reviewers assessed workup summaries (blinded to the study period) to determine adherence to evidence-based recommendations. Adherence to recommendations was quantified with a score ranging from 0 to 1.0 (the primary study outcome). Diagnostic tests ordered for PE workups were the secondary outcomes of interest.

RESULTS

Overall adherence to diagnostic pathways was 0.63 in the CDSS intervention phase versus 0.60 in the preintervention phase (p=0.18), with fewer workups in the CDSS intervention phase having very low adherence scores. Further, adherence was significantly higher when PE workups included the Wells prediction rule (median adherence score=0.76 vs 0.59, p=0.002). This difference was even more pronounced when the analysis was limited to the CDSS intervention phase only (median adherence score=0.80 when Wells was used vs 0.60 when Wells was not used, p=0.001). For secondary outcomes, using both the D-dimer blood test (42.9% vs 55.7%, p=0.014) and CT pulmonary angiogram imaging (61.9% vs 75.4%, p=0.005) was lower during the CDSS intervention phase.

CONCLUSION

A clinical decision support intervention with an HCD improves some aspects of the diagnostic decision, such as the selection of diagnostic tests and the use of the Wells probabilistic prediction rule for PE.

Influencing factors for the implementation of school-based interventions promoting obesity prevention behaviors in children with low socioeconomic status: a systematic review

BACKGROUND

Health inequity (HI) remains a major challenge in public health. Improving the health of children with low socioeconomic status (SES) can help to reduce overall HI in children. Childhood obesity is a global problem, entailing several adverse health effects. It is crucial to assess the influencing factors for adoption, implementation, and sustainment of interventions. This review aims to identify articles reporting about influencing factors for the implementation of school-based interventions promoting obesity prevention behaviors in children with low SES. It aims to critically appraise the articles' quality, assess influencing factors, categorize and evaluate them, and to discuss possible implications.

METHODS

A systematic search was conducted in 7 databases with the following main inclusion criteria: (1) school-based interventions and (2) target group aged 5-14 years. The Consolidated Framework for Implementation Research, its five domains (intervention characteristics, inner setting, outer setting, characteristics of individuals, process) along with 39 categories within these domains were used as deductive category system for data analysis. We grouped the articles with regard to the characteristics of the interventions in simple and complex interventions. For each domain, and for the groups of simple and complex interventions, the most commonly reported influencing factors are identified.

RESULTS

In total, 8111 articles were screened, and 17 met all eligibility criteria. Included articles applied mixed methods (n=11), qualitative (n=5), and quantitative design (n=1). Of these, six were considered to report simple interventions and eleven were considered to report complex interventions. In total, 301 influencing factors were assessed. Aspects of the inner setting were reported in every study, aspects of the outer setting were the least reported domain. In the inner setting, most reported influencing factors were time (n=8), scheduling (n=6), and communication (n=6).

CONCLUSION

This review found a wide range of influencing factors for implementation and contributes to existing literature regarding health equity as well as implementation science. Including all stakeholders involved in the implementation process and assessing the most important influencing factors in the specific setting, could enhance implementation and intervention effectiveness. More empirical research and practical guidance are needed to promote obesity prevention behaviors among children with low SES.

REGISTRATION

CRD42021281209 (PROSPERO).

Examining associations between school-level determinants and the implementation of physical activity opportunities

School-based physical activity (PA) opportunities can help students engage in greater amounts of daily PA, meet PA guidelines, and lead to improved health and educational outcomes. However, we do not completely understand the organizational challenges to implementing these opportunities successfully. This exploratory study examined associations between school-level determinants and the implementation of school-based PA opportunities. We analyzed cross-sectional survey data from schools (n = 46) participating in the Healthy Zone School Program (HZSP) (Dallas, Texas, USA) during 2019-2020. Respondents completed an electronic survey that included measures of school-level determinants (e.g. culture, leadership, priority) and the implementation of school-based PA opportunities. We used linear regression models to examine associations between determinants and implementation outcomes (number of PA opportunities delivered, perceived overall success of each PA program/activity used). After adjusting for campus type (i.e. elementary, middle, high, K-12), student race/ethnicity, and percentage of economically disadvantaged students, no constructs were associated with the number of PA opportunities implemented. Linear regression models suggest access to knowledge and information (β = 0.39, P = .012, 95% CI = 0.24-1.44) and implementation climate (β = 0.34, P = .045, 95% CI = 0.02-1.59) were positively associated with the success of school-based PA opportunities. Our findings provide suggestive evidence that access to knowledge and information and a supportive school climate may improve the overall success of PA opportunities provided to students. Future research should examine additional school-level determinants to understand their importance to implementation and inform the development of strategies to improve schools' capacity for implementing PA opportunities successfully.

Building a Program Theory of Implementation Using Process Evaluation of a Complex Quality Improvement Trial in Nursing Homes

BACKGROUND AND OBJECTIVES

Significant quality problems exist in long-term care (LTC). Interventions to improve care are complex and often have limited success. Implementation remains a black box. We developed a program theory explaining how implementation of a complex intervention occurs in LTC settings-examining mechanisms of impact, effects of context on implementation, and implementation outcomes such as fidelity.

RESEARCH DESIGN AND METHODS

Concurrent process evaluation of Safer Care for Older Persons in residential Environments (SCOPE)-a frontline worker (care aide) led improvement trial in 31 Canadian LTC homes. Using a mixed-methods exploratory sequential design, qualitative data were analyzed using grounded theory to develop a conceptual model illustrating how teams implemented the intervention and how it produced change. Quantitative analyses (mixed-effects regression) tested aspects of the program theory.

RESULTS

Implementation fidelity was moderate. Implementation is facilitated by (a) care aide engagement with core intervention components; (b) supportive leadership (internal facilitation) to create positive team dynamics and help negotiate competing workplace priorities; (c) shifts in care aide role perceptions and power differentials. Mixed-effects model results suggest intervention acceptability, perceived intervention benefits, and leadership support predict implementation fidelity. When leadership support is high, fidelity is high regardless of intervention acceptability or perceived benefits.

DISCUSSION AND IMPLICATIONS

Our program theory addresses important knowledge gaps regarding implementation of complex interventions in nursing homes. Results can guide scaling of complex interventions and future research.

Health literacy needs and preferences for a technology-based intervention to improve college students' sexual and reproductive health

Objective: To explore health literacy needs and preferences for a technology-based intervention (app) to improve sexual and reproductive health (SRH) among college students. Participants: In Spring 2019, in-depth interviews were conducted with 20 participants (10 male, 10 female) from a large, public university. Methods: Interview guide was developed based on Integrated Model of Health Literacy domains and Diffusion of Innovation constructs. Data were analyzed in MaxQDA using applied thematic analysis. Results: Dominant themes included accessing health information and services, evaluating options to make decisions, intervention utility and characteristics, and the emergent theme of credibility. Specific topics included accessing STI testing, contraceptive decision making, information on human papillomavirus (HPV) and the HPV vaccine, patient-provider communication, app design and function elements, and modifying the app to meet the SRH needs of diverse college students. Conclusions: Findings identified areas where an app could address college students' SRH literacy, ultimately improving SRH outcomes among this population.

Development of a complex intervention to prevent delirium in older hospitalized patients by optimizing discharge and transfer processes and involving caregivers: A multi-method study

BACKGROUND

Delirium is a common yet challenging condition in older hospitalized patients, associated with various adverse outcomes. Environmental factors, such as room changes, may contribute to the development or severity of delirium. Most previous research has focused on preventing and reducing this condition by addressing risk factors and facilitating reorientation during hospital stay.

OBJECTIVE

We aimed to systematically develop a complex intervention to prevent delirium in older hospitalized patients by optimizing discharge and transfer processes and involving caregivers during and after these procedures. The intervention combines stakeholder and expert opinions, evidence, and theory. This article provides guidance and inspiration to research groups in developing complex interventions according to the recommendations in the Medical Research Council framework for complex interventions.

DESIGN AND METHODS

A stepwise multi-method study was conducted. The preparation phase included analysis of the context and current practice via focus groups. Based on these results, an expert workshop was organized, followed by a Delphi survey. Finally, the intervention was modeled and a program theory was developed, including a logic model.

RESULTS

A complex intervention was developed in an iterative process, involving healthcare professionals, delirium experts, researchers, as well as caregiver and patient representatives. The key intervention component is an 8-point-program, which provides caregivers with recommendations for preventing delirium during the transition phase and in the post-discharge period. Information materials (flyers, handbook, videos, posters, defined "Dos and Don'ts", discharge checklist), training for healthcare professionals, and status analyses are used as implementation strategies. In addition, roles were established for gatekeepers to act as leaders, and champions to serve as knowledge multipliers and trainers for the multi-professional team in the hospitals.

CONCLUSIONS

This study serves as an example of how to develop a complex intervention. In an additional step, the intervention and implementation strategies will be investigated for feasibility and acceptability in a pilot study with an accompanying process evaluation.

TWEETABLE ABSTRACT

Delirium prevention can benefit from optimizing discharge and transfer processes and involving caregivers of older patients in these procedures.

STUDY REGISTRATION

DRKS00017828, German Register of Clinical Studies, date of registration 17.09.2019.

Understanding barriers and facilitators to long-term participation needs in children and young people following acquired brain injuries: a qualitative multi-stakeholder study

Background This study focused on exploring the longer-term participation needs of children and young people with acquired brain injury (CYP-ABI) and their families in one region of the UK and identifying the barriers and facilitators of their participation and well-being to inform the development of a behavioural change intervention for clinical implementation. Methods Qualitative interviews were conducted with CYP-ABI and parents. Focus groups were created with health, education, care and charity stakeholders. The International Classification of Functioning, Disability and Health (ICF) and the Behaviour Change Wheel (BCW) were used to map needs, barriers and facilitators. Results A total of 10 CYP/parent dyads (n  = 20) and 17 health, education, care and charity stakeholders were included in this study. Unmet participation needs were mapped to the ICF and barriers/facilitators to the BCW. Significant unmet needs impacting CYP-ABI participation and family well-being were found. Barriers spanned 'Capability', 'Opportunity' and 'Motivation', the greatest being knowledge, skills, social influences, environmental context and resources, social identity and emotion. Facilitators included increasing awareness and understanding, supporting parents, long-term access to specialist assessment and rehabilitation, peer support and integrated collaborative pathways. Conclusion The long-term impact of ABI on CYP and families' participation and well-being were significant, with barriers spanning every sector and level of society. Implementation of collaborative, cross-sector (education, health and social care) accessible and family-centred care pathways is needed to meet the long-term needs of CYP-ABI and their families, ensuring equity of access. Multi-modal, family-centred, needs-led, theory-based interventions should be co-developed with CYP, families and stakeholders to improve the health and well-being outcomes and the lives of CYP-ABI and their families.

Perspectives of key informants before and after implementing UPSIDES peer support in mental health services: qualitative findings from an international multi-site study

BACKGROUND

Peer support is an essential part of recovery-oriented care worldwide. Contextual factors have an impact on the implementation of peer support work. However, research has paid little attention to similarities and differences of implementation factors in settings varying by income-level and cultural values. The aim of this study is to assess the factors influencing the implementation of a peer support intervention across study sites in low-, middle- and high-income countries in line with the Consolidation Framework for Implementation Research (CFIR).

METHOD

6 focus groups with a total of 54 key informants with relevant contextual (organisational) knowledge regarding implementation facilitators and barriers were conducted at six study sites Ulm and Hamburg (Germany), Butabika (Uganda), Dar es Salaam (Tanzania), Be'er Sheva (Israel), and Pune (India) before and 1.5 years after the start of UPSIDES peer support. Transcripts were analysed using qualitative content analysis.

RESULTS

Across study sites key informants reported benefits of peer support for service users and peer support workers as implementation facilitators. At study sites with lower resources, reduced workload for mental health workers and improved access to mental health services through peer support were perceived as implementation facilitators (CFIR Domain 1: Intervention characteristics). The degree of engagement of mental health workers (CFIR Domain 3: Inner Setting/Domain 4: Individuals involved) varied across study sites and was seen either as a barrier (low engagement) or a facilitator (high engagement). Across study sites, adequate training of peer support workers (CFIR Domain 5: Implementation process) was seen as animplementation facilitator, while COVID-19 as well as low resource availability were reported as implementation barriers (CFIR Domain 2: Outer setting).

CONCLUSIONS

This study highlights the importance of considering contextual factors when implementing peer support, including previous experience and perceived benefits. Particular attention should be given to organisational benefits such as workload reduction and the allocation of sufficient resources as key drivers in LMICs. In HICs, the potential of organisational benefits for successful implementation should be further investigated and promoted.

Development of a co-created online self-management program for people with lower limb loss: self-management for amputee rehabilitation using technology (SMART)

PURPOSE

To develop an online self-management program for individuals with recent lower limb loss, called Self-Management for Amputee Rehabilitation using Technology (SMART).

MATERIALS AND METHODS

We used the Intervention Mapping Framework as a blueprint and involved stakeholders throughout the process. A six-step study was conducted including (1) needs assessment using interviews, (2) translating needs to content, (3) applying the content into a prototype using theory-based methods, (4) a usability assessment using think-aloud cognitive testing, (5) planning for future adoption and implementation, and (6) assessing feasibility using mixed-methods to generate a plan to assess the effectiveness on health-outcomes in a randomized controlled trial.

RESULTS

Following interviews with healthcare professionals (n = 31) and people with lower limb loss (n = 26), we determined the content of a prototype version. We then tested usability (n = 9) and feasibility (n = 12) by recruiting individuals with lower limb loss from different pools. We modified SMART to be assessed in a randomized controlled trial. SMART is a six-week online program with weekly contact of a peer mentor with lower limb loss who supported patients with goal-setting and action-planning.

CONCLUSIONS

Intervention mapping facilitated the systematic development of SMART. SMART may improve health outcomes, but this would need to be confirmed in future studies.Implications for rehabilitationLearning new coping strategies and habits are essential after lower limb loss.Given the limitations and inaccessibility of educational and rehabilitation programs, online self-management education can assist patients in their recovery.Self-Management for Amputee Rehabilitation using Technology (SMART) has the potential to augment the self-management behaviors in individuals with lower limb loss through an improvement in access to educational content, skill-based videos, and support of a peer.

The use of implementation science theories, models, and frameworks in implementation research for medicinal products: A scoping review

BACKGROUND

The uptake, adoption and integration of new medicines and treatment regimens within healthcare delivery can take a decade or more. Increasingly, implementation science (IS) research is being used to bridge this gap between the availability of new therapeutic evidence and its actual application in clinical practice. Little is known, however, about the quality of IS research in this area, including the degree to which theories, models and frameworks (TMFs) are being used. The objective of this study was to conduct a scoping review of the use of TMFs in implementation research involving medicinal products.

METHODS

A search was conducted for English language abstracts and manuscripts describing the application of TMFs in IS studies for medicinal products. Eligible publications were those published between 1 January 1974 and 12 December 2022. All records were screened at the title and abstract stage; included full-text papers were abstracted using data extraction tables designed for the study. Study quality was appraised using the Implementation Research Development Tool.

RESULTS

The initial scoping search identified 2697 publications, of which 9 were ultimately eligible for inclusion in the review. Most studies were published after 2020 and varied in their objectives, design and therapeutic area. Most studies had sample sizes of fewer than 50 participants, and all focused on the post-marketing phase of drug development. The TMF most frequently used was the Consolidated Framework for Implementation Research (CFIR). Although most studies applied all TMF domains, TMF use was limited to instrument development and/or qualitative analysis. Quality appraisals indicated the need for engaging patients and other stakeholders in the implementation research, reporting on the cost of implementation strategies, and evaluating the unintended consequences of implementation efforts.

CONCLUSIONS

We found that few IS studies involving medicinal products reported using TMFs. Those that did encompassed a wide variety of therapeutic indications and medicinal products; all were in the post-marketing phase and involved limited application of the TMFs. Researchers should consider conducting IS in earlier phases of drug development and integrating the TMFs throughout the research process. More consistent and in-depth use of TMFs may help advance research in this area.

Adapting an equity-focused implementation process framework with a focus on ethnic health inequities in the Aotearoa New Zealand context

BACKGROUND

Health intervention implementation in Aotearoa New Zealand (NZ), as in many countries globally, usually varies by ethnicity. Māori (the Indigenous peoples of Aotearoa) and Pacific peoples are less likely to receive interventions than other ethnic groups, despite experiencing persistent health inequities. This study aimed to develop an equity-focused implementation framework, appropriate for the Aotearoa NZ context, to support the planning and delivery of equitable implementation pathways for health interventions, with the intention of achieving equitable outcomes for Māori, as well as people originating from the Pacific Islands.

METHODS

A scoping review of the literature to identify existing equity-focused implementation theories, models and frameworks was undertaken. One of these, the Equity-based framework for Implementation Research (EquIR), was selected for adaptation. The adaptation process was undertaken in collaboration with the project's Māori and consumer advisory groups and informed by the expertise of local health equity researchers and stakeholders, as well as the international implementation science literature.

RESULTS

The adapted framework's foundation is the principles of Te Tiriti o Waitangi (the written agreement between Māori rangatira (chiefs) and the British Crown), and its focus is whānau (extended family)-centred implementation that meets the health and wellbeing aspirations, priorities and needs of whānau. The implementation pathway comprises four main steps: implementation planning, pathway design, monitoring, and outcomes and evaluation, all with an equity focus. The pathway is underpinned by the core constructs of equitable implementation in Aotearoa NZ: collaborative design, anti-racism, Māori and priority population expertise, cultural safety and values-based. Additionally, the contextual factors impacting implementation, i.e. the social, economic, commercial and political determinants of health, are included.

CONCLUSIONS

The framework presented in this study is the first equity-focused process-type implementation framework to be adapted for the Aotearoa NZ context. This framework is intended to support and facilitate equity-focused implementation research and health intervention implementation by mainstream health services.

Theories used to develop or evaluate social prescribing in studies: a scoping review

OBJECTIVE

This scoping review aims to provide an overview of how theories were used in the development or evaluation of social prescribing (SP) intervention studies.

BACKGROUND

SP describes a patient pathway where general practitioners (GPs) connect patients with community activities through referrals to link workers. This review seeks to understand the explanations provided for the outcomes and implementation process of SP.

INCLUSION CRITERIA

Studies using a defined theory to develop or evaluate a specific SP intervention in primary care and the community sector.

METHODS

This scoping review was conducted in accordance with JBI methodology. The following databases were searched on 8th of July 2022: PubMed, ASSIA, Cochrane, Cinahl, PsycINFO, Social Care Online, Sociological Abstracts, Scopus, and Web of Science. The search only considered English language texts. Additional literature was identified by searching relevant web pages and by contacting experts. The selection of sources and the data extraction was done by two reviewers independently.

RESULTS

The search resulted in 4240 reports, of which 18 were included in the scoping review. Of these, 16 were conducted in the UK, one in Canada and one in Australia. The majority of reports employed a qualitative approach (11/18). Three were study protocols. 11 distinct theories were applied to explain outcomes (4 theories), differences in outcomes (3 theories), and the implementation of the intervention (4 theories). In terms of practical application, the identified theories were predominantly used to explain and understand qualitative findings. Only one theory was used to define variables for hypothesis testing. All theories were used for the evaluation and none for the development of SP.

CONCLUSION

The theories influenced which outcomes the evaluation assessed, which causal pathway was expected to generate these outcomes, and which methodological approaches were used. All three groups of theories that were identified focus on relevant aspects of SP: fostering positive patient/community outcomes, addressing inequalities by considering the context of someone's individual circumstances, and successfully implementing SP by collaboratively working across professions and institutional boundaries. Additional insight is required regarding the optimal use of theories in practical applications.

Physiotherapists' barriers and facilitators to the implementation of a behaviour change-informed exercise intervention to promote the adoption of regular exercise practice in patients at risk of recurrence of low back pain: a qualitative study

BACKGROUND

Recurrences of low back pain (LBP) are frequent and associated with high levels of disability and medical costs. Regular exercise practice may be an effective strategy to prevent recurrences of LBP, however, the promotion of this behaviour by physiotherapists seems to be challenging. This study aims to explore physiotherapists' perceived barriers and facilitators to the implementation of a behaviour change-informed exercise intervention to promote the adoption of regular exercise practice by patients at risk of recurrence of low back pain.

METHODS

Two focus groups with primary healthcare physiotherapists were conducted, based on a semi-structured interview schedule informed by the Behaviour Change Wheel, including the Capability, Opportunity, Motivation-Behaviour (COM-B) model and the Theoretical Domains Framework (TDF). All focus groups were held through videoconference, audio and video recorded and transcribed verbatim. A deductive content analysis, using a coding matrix based on the COM-B and TDF, was performed by two independent researchers. A third researcher was approached to settle disagreements.

RESULTS

In total, 14 physiotherapists participated in the focus groups. The analysis revealed a total of 13 barriers (4 COM-B components and 7 TDF domains) and 23 facilitators (5 COM-B and 13 TDF) to physiotherapists' implementation of a behaviour change-informed exercise intervention. The most common barriers were the lack of skills and confidence to implement the proposed intervention. These were explained by the fact that it differs from the usual practice of most participants and requires the learning of new skills applied to their contexts. However, for those who had already implemented other similar interventions or whose rationale is aligned with the new intervention, there seemed to exist more positive determinants, such as potential benefits for physiotherapists and the profession, improvement of quality of care and willingness to change clinical practice. For others who did not previously succeed in implementing these types of interventions, more context-related barriers were mentioned, such as lack of time to implement the intervention, schedule incompatibilities and lack of material and human resources.

CONCLUSIONS

This study identified modifiable barriers and facilitators to physiotherapists' implementation of a behaviour change-informed exercise intervention for patients at risk of recurrence of LBP in primary healthcare. The findings of this study will allow the systematic and theory-based development of a behaviour change-informed training programme, aimed at physiotherapists and supporting the successful implementation of the exercise intervention.

Assessing the Implementation Determinants of Pilot Malaria Vaccination Programs in Ghana, Kenya, and Malawi through a Complexity Lens: A Rapid Review Using a Consolidated Framework for Implementation Research

In 2019, national immunization programs in Ghana, Kenya, and Malawi commenced the implementation of RTS,S/AS01 vaccination in large-scale pilot schemes. Understanding the implementation context of this malaria vaccination in the pilot countries can provide useful insights for enhancing implementation outcomes in new countries. There has not yet been a proper synthesis of the implementation determinants of malaria vaccination programs. A rapid review was conducted to identify the implementation determinants of the pilot malaria vaccination programs in Ghana, Kenya, and Malawi, and describe the mechanism by which these determinants interact with each other. A literature search was conducted in November 2023 in PubMed and Google Scholar to identify those studies that described the factors affecting malaria vaccine implementation in Ghana, Kenya, and Malawi. Thirteen studies conducted between 2021 and 2023 were included. A total of 62 implementation determinants of malaria vaccination across all five domains of the consolidated framework for implementation research (CFIR) were identified. A causal loop diagram showed that these factors are interconnected and interrelated, identifying nine reinforcing loops and two balancing loops. As additional countries in Africa prepare for a malaria vaccine roll-out, it is pertinent to ensure that they have access to adequate information about the implementation context of countries that are already implementing malaria vaccination programs so that they understand the potential barriers and facilitators. This information can be used to inform context-specific systems enhancement to maximize implementation success. Going forward, primary implementation studies that incorporate the causal loop diagram should be integrated into the malaria vaccine implementation program to enable immunization program managers and other key stakeholders to identify and respond to emerging implementation barriers in a timely and systematic manner, to improve overall implementation performance.

Employees' experiences of a large-scale implementation in a public care setting: a novel mixed-method approach to content analysis

BACKGROUND

Research for evidence-based interventions and strategies for implementation continues. Yet there is a continued shortage of qualified health care staff while stress and burnout are common. Health care professionals' individual perceptions towards change needs to be considered to succeed in organisational change. It is therefore relevant to investigate how implementation processes affect employees within the health care sector. Challenges to implementation are especially large in the field of disability care. The present study aims to investigate employees' experiences of an ongoing large-scale implementation, and what they perceived as important to succeed in a complex clinical setting.

METHODS

Semi-structured focus group interviews were conducted with a self-selected sample of employees from a large and complex health care organisation responsible for public disability care in a centrally located Swedish region. A mixed-method approach adapted to content analysis was performed in a three-step process. In the first round, each unit of analysis was selected and then colour coded. In a second round, the coloured units were coded according to content analysis, and categories and concepts were compared and adjusted until the two researchers reached consensus. Finally, to further complement the content analysis, a quantitative analysis of the colour categories was made.

RESULTS

In general, employees experienced the implementation as being insufficient, yet opinions of the process of implementation were mixed. Most positive experiences were found in relation to the outcomes that the new method had on work effectiveness and patient care. Closely related topics like time constraints, uncertainties concerning the method and the need for supportive functions reoccurred in several concepts suggesting a relationship between differing contextual factors, implementation activities and fidelity. Also evident in the results were the strain on organisational and social work environment and the importance of managers' active leadership.

CONCLUSIONS

Implementation processes are experienced as challenging for employees. Key facilitators are available support functions, clear leadership and time that is sufficient and kept sacrosanct. Leaders need to communicate how and why employees may experience implementation processes differently. The impact that organisational change has on work environment should be considered.