Implementation research: what it is and how to do it

An Umbrella Review of Systematic Reviews on Trauma Informed Approaches

Trauma and adversity significantly impact on morbidity and mortality. Hence, trauma-informed care is proliferating practice and research contexts. However, the evidence base for organisational wide trauma-informed care is far from conclusive, with the extant literature providing low quality and conflicting evidence. The purpose of this umbrella review of systematic reviews, is to summarise the existing evidence on trauma-informed care implemented at the organisational level. The preferred reporting items for systematic review and meta-analyses (PRISMA) was used to conduct an umbrella review. Six databases were searched; Academic Search Complete, APA Psych Articles, Cochrane Library, Embase, Scopus, and the Web of Science, supplemented with bibliography searches. Articles were included if they were peer reviewed in the English language from inception to 2024 and reported on trauma-informed care with an implementation context. The Joanne Briggs Institute Critical Appraisal Checklist for Systematic Reviews and Research Syntheses was used to assess the quality of the included reviews. Findings are mapped to the 10 trauma-informed care implementation domains described by the Substance Use and Mental Health Service Administration (SAMHSA) and reported using a narrative synthesis. The search strategy yielded 5,297 articles, of which (N = 14) systematic reviews are included. The reviews had a combined study count of (N = 311), with a total sample size of (N = 157,724). Most reviews used a narrative synthesis to report results, with no meta-analyses. Critical appraisal categorised the reviews as 28% high quality, 22% moderate quality, and 50% as low quality. Most reviews (50%), were conducted on youth populations, with school settings being the most studied context. There was a great deal of heterogeneity across the reviews, with 62 different models of trauma informed approaches discussed. The composition of the individual studies included in each systematic review were generally of low quality with mixed findings of effectiveness and implementation. Findings are discussed for moving forward with trauma-informed care implementation. Trauma-informed care is proposed as a system wide intervention to improve outcomes for service users, however the research base is still under scrutiny. Emerging research identifies the benefit of using the 10 trauma-informed implementation domains to shift cultural practices. Further research needs to be undertaken in various contexts with different populations.

Multimethods study to develop tools for competency-based assessments of implementation research training programmes in low and middle-income countries

INTRODUCTION

Methods and validated tools for evaluating the performance of competency-based implementation research (IR) training programmes in low-middle-income countries (LMICs) are lacking. In this study, we developed tools for assessing the performance of IR training programmes based on a framework of IR core competencies in LMICs.

METHODS

We developed self-assessment and objective-assessment tools drawing on the IR competency framework. We used exploratory factor analyses and a one-parameter logistic model to establish construct validity and internal consistency of the tools drawing on a survey conducted in 2020 with 166 trainees before and after an index IR course across five universities and LMICs under the Special Program for Research and Training in Tropical Diseases postgraduate IR training scheme. We conducted key informant interviews (KII) with 20 trainees and five trainers to reflect on the usefulness of the tools and framework for guiding IR training in LMICs.

RESULTS

Two 16-item tools for self-assessment of IR knowledge and self-efficacy and a 40-item objective assessment tool were developed. The factor loadings of items in the self-assessment tools were 0.65-0.87 with Cronbach's alpha (α) of 0.97, and 0.77-0.91 with α of 0.98 for the IR knowledge and self-efficacy tools, respectively. The distribution of item difficulty in the objective-assessment tool was consistent before and after the index IR course. Pearson correlation coefficient (r) between the self-assessed and objectively assessed IR knowledge before the index IR course was low, r=0.27 (p value: <0.01), with slight improvements after the index IR course, r=0.43 (p value: <0.01). All KII respondents reported the assessment tools and framework were valid for assessing IR competencies.

CONCLUSION

The IR competency framework and tools developed for assessing IR competencies and performance of IR training programmes in LMICs are reliable and valid. Self-assessment methods alone may not suffice to yield a valid assessment of performance in these settings.

Performance and acceptability of the STREAM Disinfectant Generator for infection prevention and control practices in primary health care facilities in Uganda

BACKGROUND

Effective infection prevention and control programs can positively influence quality of care, increase patient safety, and protect health care providers. Chlorine, a widely used and effective chemical disinfectant, is recommended for infection prevention and control in health care settings. However, lack of consistent chlorine availability limits its use. Electrolytic chlorine generators can address limited chlorine supply and stockouts by enabling onsite production of readily usable, high-quality chlorine cost-effectively. We report the feasibility (i.e., performance, acceptability, chlorine availability, and cost) of the electrolytic STREAM Disinfectant Generator (Aqua Research, New Mexico, USA) device for infection prevention and control in primary health care facilities in Uganda.

METHODS

We installed STREAM devices in 10 primary health care facilities in central and western Uganda. Commercial chlorine inventory records (stock cards) were reviewed in each facility to calculate average liters of chlorine received and used per month. These values were compared with actual STREAM chlorine production volumes over the study period to determine its impact on chlorine availability. We collected acceptability data from a purposive sample of device users (n = 16), hospital administrators (n = 10), and district health officers (n = 6) who had been directly involved in the operation or supervision of the STREAM device. We descriptively analyzed the acceptability data by user group and evaluated qualitative responses manually using a thematic approach. Cost data were normalized and modeled to determine a break-even and cost-savings analysis across a five-year period (the minimum expected lifespan of the STREAM device).

RESULTS

Chlorine was consistently available without any reported stockouts during the evaluation period. STREAM chlorine production resulted in a 36.9 percent cost-savings over a five-year period compared to commercial chlorine. User acceptability of the STREAM device was high among STREAM operators, hospital administrators, and district health officers, with all respondents reporting that STREAM moderately or significantly improved infection prevention and control practices in the health facility. Overall, 88 percent of device users and 100 percent of hospital administrators wished to continue using the STREAM device instead of commercial chlorine products.

CONCLUSION

The STREAM device has demonstrated significant potential to strengthen infection prevention and control practices in health care facilities in Uganda. Based on the preliminary results, the STREAM device should be considered a promising tool for district hospitals and large health centers facing infection prevention and control challenges in Uganda and elsewhere, provided water and electricity are available. Going forward, implementation of the STREAM device could also be considered in smaller health care facilities in Uganda and elsewhere.

Cluster randomised trial of a health system strengthening approach applying person-centred communication for the prevention of female genital mutilation in Guinea, Kenya and Somalia

INTRODUCTION

There is limited evidence on effective health systems interventions for preventing female genital mutilation (FGM). This study tested a two-level intervention package at primary care applying person-centred communication (PCC) for FGM prevention.

METHODS

A cluster randomised trial was conducted in 2020-2021 in 180 antenatal care (ANC) clinics in Guinea, Kenya and Somalia. At baseline, all clinics received guidance and materials on FGM prevention and care; at month 3, ANC providers at intervention sites received PCC training. Data were collected from clinic managers, ANC providers and clients at baseline, month 3 and month 6 on primary outcomes, including delivery of PCC counselling, utilisation of level one materials, health facility preparedness for FGM prevention and care services and secondary outcomes related to clients' and providers' knowledge and attitudes. Data were analysed using multilevel and single-level logistic regression models.

RESULTS

Providers in the intervention arm were more likely to deliver PCC for FGM prevention compared with those in the control arm, including inquiring about clients' FGM status (adjusted OR (AOR): 8.9, 95% CI: 6.9 to 11.5; p<0.001) and FGM-related beliefs (AOR: 9.7, 95% CI: 7.5 to 12.5; p<0.001) and discussing why (AOR: 9.2, 95% CI: 7.1 to 11.9; p<0.001) or how (AOR: 7.7, 95% CI: 6.0 to 9.9; p<0.001) FGM should be prevented. They were more confident in their FGM-related knowledge (AOR: 7.0, 95% CI: 1.5 to 32.3; p=0.012) and communication skills (AOR: 1.8; 95% CI: 1.0 to 3.2; p=0.035). Intervention clients were less supportive of FGM (AOR: 5.4, 95% CI: 2.4 to 12.4; p<0.001) and had lower intentions of having their daughters undergo FGM (AOR: 0.3, 95% CI: 0.1 to 0.7; p=0.004) or seeking medicalised FGM (AOR: 0.2, 95% CI: 0.1 to 0.5; p<0.001) compared with those in the control arm.

CONCLUSION

This is the first study to provide evidence of an effective FGM prevention intervention that can be delivered in primary care settings in high-prevalence countries.

TRIAL REGISTRATION AND DATE

PACTR201906696419769 (3 June 2019).

[Evidence Register Green List Prevention: Analysis of the listed effectiveness-tested programmes]

BACKGROUND

In the areas of prevention and health promotion, there is a large number of measures for children and adolescents. One way of facilitating evidence-based action for those involved in these taks is by making available online evidence registers with customised, effectiveness-tested measures. The Green List Prevention is such a register and offers an overview of evidence-based programmes in Germany, currently with a focus on psychosocial health.

OBJECTIVE

The aims of this study were (a) to analyse the characteristics of the available and evaluated programmes on the psychosocial health of children and adolescents, (b) to identify priorities and underrepresented areas of the Green List Prevention and (c) to optimise the search functions of the register.

METHOD

The characteristic features were recorded on the basis of the existing upper categories of the register entries which were differentiated into subcategories in an inductive procedure by at least two persons. In addition, deductive categories were added for relevant aspects concerning content and implementation. The upper and lower categories formed were operationalized with characteristic values. All entries were analyzed by using a data sheet and were descriptively evaluated.

RESULTS

The 102 programmes listed (as of 2/2024) addressed not only the primary target group of children and youth, but also secondary target groups (mainly teachers and guardians). Social and life skills programmes as well as trainings for guardians represented a focus. Behavioral prevention programmes on the topics of violence (including bullying) (63.7%), addiction (46.1%) and/or mental health (35.3%) were frequently represented, whereas nutrition and/or physical activity (4.9%) were hardly represented. Most of the programmes (88.2%) could be assigned to the eligibility criteria of the statutory health insurers (§20a SGB V). Potentials digital implementation forms and further implementation aspects were identified.

CONCLUSION

The Green List Prevention bundles a large number of different measures and that there is potential for expansion. Processing knowledge about effective measures in a user-friendly manner can be optimised through expanded search functions, so that resource-conserving, evidence-based action can be facilitated.

Long COVID Definitions and Models of Care : A Scoping Review

BACKGROUND

Definitions of long COVID are evolving, and optimal models of care are uncertain.

PURPOSE

To perform a scoping review on definitions of long COVID and provide an overview of care models, including a proposed framework to describe and distinguish models.

DATA SOURCES

English-language articles from Ovid MEDLINE, PsycINFO, the Cochrane Library, SocINDEX, Scopus, Embase, and CINAHL published between January 2021 and November 2023; gray literature; and discussions with 18 key informants.

STUDY SELECTION

Publications describing long COVID definitions or models of care, supplemented by models described by key informants.

DATA EXTRACTION

Data were extracted by one reviewer and verified for accuracy by another reviewer.

DATA SYNTHESIS

Of 1960 screened citations, 38 were included. Five clinical definitions of long COVID varied with regard to timing since symptom onset and the minimum duration required for diagnosis; 1 additional definition was symptom score-based. Forty-nine long COVID care models were informed by 5 key principles: a core "lead" team, multidisciplinary expertise, comprehensive access to diagnostic and therapeutic services, a patient-centered approach, and providing capacity to meet demand. Seven characteristics provided a framework for distinguishing models: home department or clinical setting, clinical lead, collocation of other specialties, primary care role, population managed, use of teleservices, and whether the model was practice- or systems-based. Using this framework, 10 representative practice-based and 3 systems-based models of care were identified.

LIMITATIONS

Published literature often lacked key model details, data were insufficient to assess model outcomes, and there was overlap between and variability within models.

CONCLUSION

Definitions of long COVID and care models are evolving. Research is needed to optimize models and evaluate outcomes of different models.

PRIMARY FUNDING SOURCE

Agency for Healthcare Research and Quality. (Protocol posted at https://effectivehealthcare.ahrq.gov/products/long-covid-models-care/protocol.).

How does mentoring occupational therapists improve intervention fidelity in a randomised controlled trial? A realist evaluation

BACKGROUND

Integrating complex interventions within healthcare settings can be challenging. Mentoring can be embedded within a randomised controlled trial (RCT) to upskill and support those delivering the intervention. This study aimed to understand, from a realist perspective, how mentoring worked to support implementation fidelity for occupational therapists (OTs) delivering a vocational rehabilitation (VR) intervention within the context of an RCT.

METHODS

A realist evaluation using secondary data (emails, mentoring record forms, interviews) collected as part of an RCT. Three researchers coded the data following content analysis, focused on refining or refuting an initial programme theory by exploring the interactions between context, mechanisms, and outcomes. The research team met to further refine the programme theories.

RESULTS

Data from 584 emails, 184 mentoring record forms, and 25 interviews were analysed following a realist approach. We developed a programme theory consisting of two contexts (trial set-up, ongoing mentoring), nine mechanisms (collective understanding, monitoring, timely support, positive reinforcement, reflective practice, support data completeness, facilitation strategy, shared learning experience, management of research and clinical duties), and three outcomes (improved confidence, improved fidelity, reduced contamination).

CONCLUSIONS

Offering mentoring support to OTs delivering a VR intervention as part of an RCT improves intervention fidelity and reduces the risk of contamination. It improves OTs' understanding of the differences between their clinical and research roles and increases their confidence and competence in trial paperwork completion and identification of potential contamination issues.

Web-based occupational stress prevention in German micro- and small-sized enterprises - process evaluation results of an implementation study

BACKGROUND

Structural and behavioral interventions to manage work-related stress are effective in employees. Nonetheless, they have been implemented insufficiently, particularly in micro- and small-sized enterprises (MSE). Main barriers include a lack of knowledge and limited resources, which could potentially be overcome with simplified web-based alternatives for occupational stress prevention. However, there is a lack of implementation research about web-based prevention in realistic settings of MSE.

OBJECTIVE

The aim of this study is to evaluate the implementation process and success of an integrated web-based platform for occupational stress prevention ("System P") and to identify potential barriers for its uptake and use in MSE in Germany.

METHODS

This study with a mixed-methods approach investigates eight process-related outcomes in a quantitative part I (adoption, reach, penetration, fidelity/dose, costs, acceptability) and a qualitative part II (acceptability, appropriateness and feasibility). Part I has a pre-post design with two measurements (6 months apart) with 98 individual participants and part II consists of 12 semi-structured interviews with managers and intercorporate stakeholders.

RESULTS

Part I revealed shortcomings in the implementation process. Adoption/Reach: Despite extensive marketing efforts, less than 1% of the contacted MSE responded to the offer of System P. A total of 40 MSE registered, 24 of which, characterized by good psychosocial safety climate, adopted System P. Penetration: Within these 24 MSE, 15% of the employees used the system. Fidelity/Dose: 11 MSE started a psychosocial risk-assessment (PRA), and no MSE finished it. The stress-management training (SMT) was started by 25 users and completed by 8.

COSTS

The use of System P was free of charge, but the time required to engage with was an indirect cost. Part II added insights on the perception of the web-based intervention: Acceptance of System P by users and stakeholders was good and it was assessed as appropriate for MSE. Results for feasibility were mixed.

CONCLUSIONS

Although System P was generally perceived as useful and appropriate, only a small number of contacted MSE implemented it as intended. Prior experience and sensitivity for occupational (stress) prevention were mentioned as key facilitators, while (perceived) indirect costs were a key barrier. Enabling MSE to independently manage stress prevention online did not result in successful implementation. Increasing external support could be a solution. ⁺ FULL PROJECT NAME: "PragmatiKK - Pragmatische Lösungen für die Implementation von Maßnahmen zur Stressprävention in Kleinst- und Kleinbetrieben" (= Pragmatic solutions for the implementation of stress prevention interventions in micro and small-sized enterprises).

TRIAL REGISTRATION

German Register of Clinical Studies (DRKS) DRKS00026154, date of registration 2021-09-16.

Usefulness of working with a person-centred intervention in a group: Perspectives from facilitators and persons with mental illness

BACKGROUND

When implementing new interventions into clinical practice, it is of great importance to investigate the implementation process to better understand factors promoting and impeding the implementation to stimulate engagement and sustainability of the intervention. It is essential to consider perspectives both from the health professionals delivering the intervention and those receiving the intervention to be open to their suggestions for enhancing the dissemination and implementation of the intervention. The aim of the study was to evaluate adoption, acceptability and appropriateness of a person-centred group intervention (PCGI) from the perspectives of facilitators and participants with mental illness in mental health outpatient services right after delivery.

METHODS

A qualitative interview study design was used. Interview data from three individual interviews, one group interview with facilitators and 16 individual interviews with participants were analyzed through content analysis.

RESULTS

As described in the following three categories, the facilitators and participants found the PCGI overall useful and meaningful to deliver and receive: (1) application of a PCGI in clinical practice, (2) balancing the facilitator role and (3) establishing and maintaining a safe relationship.

CONCLUSION

Facilitators and participants found the form and structure of the PCGI useful and meaningful. Some participants dropped out as they did not feel comfortable in a group setting. The components in the sessions, questions on cards and reflection sheets together with peer-to-peer interactions provided a safe environment. However, facilitation from facilitators requires appropriate skills and qualifications, which must be provided by the hospital together with supervision and the possibility for peer feedback and exchange of experiences.

Effectiveness of an educational intervention to increase professional nurses' person-centred care competence in long-term care of older people-Quasi-experimental study

BACKGROUND

Based on previous evidence person-centred care (PCC) as a quality indicator is important in long-term care (LTC) settings for older people. Effective ways to increase nurses' person-centred care competence are missing.

AIM

To evaluate the effectiveness of a continuing education (CE) intervention named 'Person First-Please' (PFP) for improving nurses' PPC competence and its connection to PPC climate.

METHODS

Quasi-experimental cluster design with intervention and control groups was carried out in LTC settings for older people. The intervention group (n = 77) received a 10-week CE intervention, with control group (n = 123) working as usual. The primary outcome was professional nurses' PCC competence. Secondary outcome was the PCC climate as perceived by nurses and, residents with their next of kin. Measurements were conducted pre-/post-intervention and after 6 weeks using the validated, Person-centred Care Competence scale and the Person-centred Care Climate questionnaire, staff and patient versions. Data was analysed with descriptive and inferential statistics.

RESULTS

PCC competence was significantly increased in the intervention group and remained after 6 weeks of follow-up. PCC climate increased in the intervention group in total score and also in all sub-scales, across residents with their next of kin. The control group did not show any significant change. Comparisons of PCC competence and PCC climate in time between intervention and control groups confirmed that changes seen between groups were statistically significant in intervention group.

LIMITATIONS

Measurements were self-assessments, which may have been affected by bias, especially in context of competence assessment.

CONCLUSION

The intervention was effective in increasing professional nurses' PCC competence and on person-centred care climate in long-term care settings for older people.

Challenges to the implementation of a multi-level intervention to reduce mistreatment of women during childbirth in Iran: a qualitative study using the Consolidated Framework for Implementation Research

BACKGROUND

Mistreatment during childbirth is a growing concern worldwide, especially in developing countries, such as Iran. In response, we launched a comprehensive implementation research (IR) project to reduce mistreatment during childbirth and enhance positive birth experiences in birth facilities. This study identified the challenges of implementing a multi-level intervention to reduce mistreatment of women during childbirth using the Consolidated Framework for Implementation Research (CFIR).

METHODS

An exploratory qualitative study, involving 30 in-depth interviews, was conducted between July 2022 and February 2023. Participants included a purposive sample of key stakeholders at different levels of the health system (macro: Ministry of Health and Medical Education; meso: universities of medical sciences and health services; and micro: hospitals) with sufficient knowledge, direct experience, and/or collaboration in the implementation of the studied interventions. Interviews were transcribed verbatim and coded using directed qualitative content analysis (CFIR constructs) in MAXQDA 18.

RESULTS

The identified challenges were: (1) individual level (childbirth preparation classes: e.g., adaptability, design quality and packaging, cosmopolitanism; presence of birth companions: e.g., patient needs and resources, structural characteristics, culture); (2) healthcare provider level (integrating respectful maternity care into in-service training: e.g., relative priority, access to knowledge and information, reflecting and evaluating); (3) hospital level (evaluating the performance of maternity healthcare providers: e.g., executing, external policies and incentives); and (4) national health system level (implementation of pain relief during childbirth guidelines: e.g., networks and communications, patient needs and resources, executing, reflecting and evaluating).

CONCLUSIONS

This study provides a clear understanding of the challenges of implementing a multi-level intervention to reduce mistreatment of women during childbirth and highlights potential implications for policy makers and practitioners of maternal health programs. We encourage them to take the lessons learned from this study and revise their current programs and policies regarding the quality of maternity care by focusing on the identified challenges.

Factors influencing adoption of sexual and reproductive health intervention for adolescents in Ebonyi, Nigeria

BACKGROUND

School and Community-embedded reproductive health interventions have been implemented in developing countries, with evidence that they led to improved sexual and reproductive health among adolescents. However, this type of intervention is rarely evaluated for its potential adoption and use. This study evaluated the constraints and enablers of the adoption of a school and community-embedded intervention that used community engagement, capacity building, partnerships and collaborations to deliver sexual and reproductive health services to adolescents.

METHODS

The intervention was implemented between 2019 and 2021 in six local government areas in Ebonyi State. The results on adoption presented here were collected four months into the mid-phase of the project, targeting adolescents, parents, adult family members, healthcare providers, local authorities, and community members. Sixteen in-depth interviews were conducted with policymakers, 14 with health service providers and 18 Focus Group Discussions (FGDs) with parents, community leaders and adolescents who were part of the implementation process. The coding reliability approach, a type of thematic data analysis was used, that involves early theme development and the identification of evidence for the themes.

RESULTS

The adoption of school and community-embedded reproductive health intervention was strong among stakeholders at the early stages of the implementation process. Multi-stakeholder involvement and its multi-component approach made the intervention appealing, thereby enabling its adoption. However, at the later stage, the adoption was constrained by beliefs and norms about sexual and reproductive health (SRH) and the non-incentivisation of stakeholders who acted as advocates at the community level. The sustainability of the intervention may be threatened by the non-incentivisation of stakeholders and the irregular supply of materials and tools to facilitate SRH advocacy at the community level.

CONCLUSIONS

The inclusive community-embedded reproductive health intervention was adopted by stakeholders because of the enablers which include timely stakeholder engagement. However, for it to be sustainable, implementers must address the non-incentivising of community-level advocates which serve as constraints.

Implementation Strategies for Maternal Near-Miss Case Reviews in LICs and LMICs: A scoping review protocol

Background

Maternal mortality remains a persistent public health concern despite significant strides in reduction over the past few decades, with a global maternal mortality ratio (MMR) of 223 deaths per 100,000 live births in 2020, indicating a 34.3% decline over 20 years, with Low income countries (LICs) and Lower Middle-Income Countries (LMICs) bearing the major burden. Effective implementation of facility-based near-miss case reviews (NMCR), endorsed by the World Health Organization (WHO), faces challenges hindering progress, making exploring implementation strategies through a scoping review essential. This scoping review aims to identify and characterize implementation strategies employed in Low and Lower Middle- Income Countries to facilitate the implementation of facility-based NMCR.

Methods

The scoping review will follow Arksey and O'Malley's methodological framework, involving five stages: identifying the research question, selecting relevant studies, selecting data, charting, and summarizing the results. Electronic databases like PubMed, Embase, Web of Science, EBSCOhost - CINAHL Ultimate, and Ovid MEDLINE will be searched, supplemented by citation tracking. Rayyan will be used to screen and remove duplicates, with data charting conducted using Google Sheets. Two independent reviewers will conduct blinded screening, eligibility assessment, and inclusion phases. Reviewers will conduct Systematic data extraction independently using piloted forms, with discrepancies resolved through team discussion and consensus.

Results

The review will identify and characterize implementation strategies employed to facilitate the implementation of facility-based near-miss case reviews in LICs and LMICs.

Conclusions

The findings of this review will contribute to the understanding of implementing strategies for facility-based NMCR in LICs and LMICs. The review can help in designing interventions/programs to reduce maternal mortality and knowledge products.

Particularity, Engagement, Actionable Inferences, Reflexivity, and Legitimation tool for rigor in mixed methods implementation research

BACKGROUND

Implementation science helps generate approaches to expedite the uptake of evidence in practice. Mixed methods are commonly used in implementation research because they allow researchers to integrate distinct qualitative and quantitative methods and data sets to unravel the implementation process and context and design contextual tools for optimizing the implementation. To date, there has been limited discussion on how to ensure rigor in mixed methods implementation research.

PURPOSE

To present Particularity, Engagement, Actionable Inferences, Reflexivity, and Legitimation (PEARL) as a practical tool for understanding various components of rigor in mixed methods implementation research.

DATA SOURCES

This methodological discussion is based on a nurse-led mixed methods implementation study. The PEARL tool was developed based on an interpretive, critical reflection, and purposive reading of selected literature sources drawn from the researchers' knowledge, experiences of designing and conducting mixed methods implementation research, and published methodological papers about mixed methods, implementation science, and research rigor.

CONCLUSION

An exemplar exploratory sequential mixed methods study in nursing is provided to illustrate the application of the PEARL tool. The proposed tool can be a useful and innovative tool for researchers and students intending to use mixed methods in implementation research. The tool offers a straightforward approach to learning the key rigor components of mixed methods implementation research for application in designing and conducting implementation research using mixed methods.

CLINICAL RELEVANCE

Rigorous implementation research is critical for effective uptake of innovations and evidence-based knowledge into practice and policymaking. The proposed tool can be used as the means to establish rigor in mixed methods implementation research in nursing and health sciences.

Systematic Aggression Registration in Forensic Psychiatric Care: A Qualitative Study on Preconditions for Successful Implementation

Available research emphasizes the importance of getting a systematic overview of inpatient aggression in forensic psychiatric care. However, the same research does not focus on how systematic aggression registration should be introduced in clinical practice. To facilitate the use of systematic aggression registration instruments, it is very relevant to gain insight into the perspective of staff members on the introduction of these instruments in daily clinical practice. Additionally, preconditions for achieving a successful implementation can be considered. Therefore, this study aims to gain insight into the perspective of the staff members on the implementation of a systematic aggression registration instrument-that is, the MOAS-in a forensic psychiatric unit. Interviews (n = 8) and a focus group with staff members were carried out. Three main themes: (1) creating the most appropriate context for introduction, (2) choice for the MOAS as relevant instrument, and (3) perpetuating the use of the MOAS in clinical practice are scrutinized. The mentioned preconditions can be used as guidelines when implementing systematic aggression registration in clinical practice. We hope that this paper can inspire other forensic psychiatric facilities to introduce systematic registration of aggressive incidents.

Effectiveness and Implementation of a Text Messaging mHealth Intervention to Prevent Childhood Obesity in Mexico in the COVID-19 Context: Mixed Methods Study

BACKGROUND

Promoting physical activity (PA) and healthy feeding (HF) is crucial to address the alarming increase in obesity rates in developing countries. Leveraging mobile phones for behavior change communication to encourage infant PA and promote HF is particularly significant within the Mexican context.

OBJECTIVE

This study aims to explore the effectiveness and feasibility of mHealth interventions aimed at promoting PA and HF among primary caregivers (PCs) of Mexican children under the age of 5 years. Additionally, the study aims to disseminate insights gained from intervention implementation amidst the COVID-19 pandemic and assess the potential of behavior change mHealth interventions on a broader population scale.

METHODS

NUTRES, an mHealth intervention, underwent an effectiveness-implementation hybrid trial. Over 36 weeks, participants in the intervention group (IG), totaling 230 individuals, received approximately 108 SMS text messages tailored to their children's age. These messages covered topics such as PA and HF and emphasized the significance of proper child nutrition amidst the COVID-19 pandemic. NUTRES participants were recruited from both urban and rural health units across 2 states in Mexico. Given the COVID-19 context, both baseline and follow-up surveys were conducted via mobile or fixed telephone. The evaluation of effectiveness and implementation used a mixed methods approach. Qualitative analysis delved into participants' experiences with NUTRES and various implementation indicators, including acceptance, relevance, and coverage. Grounded theory was used for coding and analysis. Furthermore, difference-in-differences regression models were used to discern disparities between groups (comparison group [CG] versus IG) concerning knowledge and practices pertaining to infant PA and HF.

RESULTS

Of the total 494 PCs enrolled in NUTRES, 334 persisted until the end of the study, accounting for 67.6% (334/494) participation across both groups. A majority of PCs (43/141, 30.5%, always; and 97/141, 68.8%, sometimes) used the SMS text message information. Satisfaction and acceptability toward NUTRES were notably high, reaching 98% (96/98), with respondents expressing that NUTRES was "good," "useful," and "helpful" for enhancing child nutrition. Significant differences after the intervention were observed in PA knowledge, with social interaction favored (CG: 8/135, 5.9% vs IG: 20/137, 14.6%; P=.048), as well as in HF practice knowledge. Notably, sweetened beverage consumption, associated with the development of chronic diseases, showed divergence (CG: 92/157, 58.6% vs IG: 110/145, 75.9%; P=.003). In the difference-in-differences model, a notable increase of 0.03 in knowledge regarding the benefits of PA was observed (CG: mean 0.13, SD 0.10 vs IG: mean 0.16, SD 0.11; P=.02). PCs expressed feeling accompanied and supported, particularly amidst the disruption of routine health care services during the COVID-19 pandemic.

CONCLUSIONS

While NUTRES exhibited a restricted impact on targeted knowledge and behaviors, the SMS text messages functioned effectively as both a reminder and a source of new knowledge for PCs of Mexican children under 5 years of age. The key lessons learned were as follows: mHealth intervention strategies can effectively maintain communication with individuals during emergencies, such as the COVID-19 pandemic; methodological and implementation barriers can constrain the effectiveness of mHealth interventions; and using mixed methods approaches ensures the complementary nature of results. The findings contribute valuable evidence regarding the opportunities and constraints associated with using mobile phones to enhance knowledge and practices concerning PA and HF among PCs of children under 5 years old.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04250896; https://clinicaltrials.gov/ct2/show/NCT04250896.

A meta-analytic review of the implementation characteristics in parenting interventions to promote early child development

This review summarizes the implementation characteristics of parenting interventions to promote early child development (ECD) outcomes from birth to 3 years. We included 134 articles representing 123 parenting trials (PROSPERO record CRD42022285998). Studies were conducted across high-income (62%) and low-and-middle-income (38%) countries. The most frequently used interventions were Reach Up and Learn, Nurse Family Partnership, and Head Start. Half of the interventions were delivered as home visits. The other half used mixed settings and modalities (27%), clinic visits (12%), and community-based group sessions (11%). Due to the lack of data, we were only able to test the moderating role of a few implementation characteristics in intervention impacts on parenting and cognitive outcomes (by country income level) in the meta-analysis. None of the implementation characteristics moderated intervention impacts on cognitive or parenting outcomes in low- and middle-income or high-income countries. There is a significant need in the field of parenting interventions for ECD to consistently collect and report data on key implementation characteristics. These data are needed to advance our understanding of how parenting interventions are implemented and how implementation factors impact outcomes to help inform the scale-up of effective interventions to improve child development.

Putting the Ducks in a Row: Development of a Duck-assisted Green Care Intervention for Persons with Traumatic Brain Injury

Green Care therapies are defined as the engagement of a patient with the nature, exposing patients to a nature based therapeutic setting that may facilitate their recovery. Such therapies became popular at the end of the twentieth century. This therapeutic approach may include therapeutic horticulture, nature therapies, care farming, facilitated exercise, and animal-assisted therapies with farm animals (AATF). This paper describes the processes of planning and creating an AATF-based clinical intervention wherein persons with TBI interacted with ducks (in twice weekly, 1-hour groups) for 12 wk at a TBI rehabilitation facility. The discussion includes site identification, stakeholder engagement, intervention design and human and animal safety procedures. The research methods, theoretical framework, ethical consideration, and risk reduction strategies for human participants and ducks are discussed. Also, description of challenges and blueprints of possible solutions for other researchers interested in developing similar initiatives. This program will serve as a study site for examining effects of AATF-based interventions on self-efficacy, depression, and anxiety in persons with TBI. If the study suggests that AATF interventions with ducks may lead to positive changes, the proposed study will be followed with studies that include larger samples at multiple sites. Findings in this paper may contribute to the implementation science body of knowledge. Because of that, the information in this paper may benefit the researchers outside of the healthcare arena. From that perspective methods described in this paper may help to develop studies that focus on policy development, program expansion, or individual project implementation.

Implementation of activities of daily living retraining for individuals in post-traumatic amnesia

Background Despite evidence of the efficacy of activities of daily living (ADL) retraining during post-traumatic amnesia (PTA) following traumatic brain injury (TBI), utilisation of this intervention in practice is unclear. Utilising an implementation science framework, the Consolidated Framework for Implementation Research, this study explored efforts to translate ADL retraining during PTA into the clinical practice of occupational therapists (OTs) working in TBI rehabilitation settings across Australia. Methods Participants were 44 OTs who attended a day-long training workshop that included knowledge and skill-based content regarding ADL retraining during PTA. Baseline and post-training ratings were completed including evaluation of workshop utility, and skill and knowledge-based competencies relevant to the intervention. Approximately 2 years later, nine trained OTs and two administrators were interviewed to explore the results of implementing the intervention. Results Overall, the training workshop was rated as being helpful and OT ratings of confidence (P  P   Conclusion Multiple barriers were identified in implementation of ADL retraining during PTA and require consideration to facilitate translation and promote best practice.

Process evaluation of the 'Lafiyan Yara' project on enhancing access to HIV testing services using existing community structures in Nigeria

BACKGROUND

The Lafiyan Yara Project aimed to increase demand for HIV counselling, testing, treatment, and prevention services among pregnant women and children in Taraba State, Nigeria. Implemented from 2019 to 2021, the project utilized existing community structures, including traditional birth attendants, village health workers, and patent and proprietary medicine vendors, for mobilization. This study assessed the project's activities, contributors, relevance, effectiveness, and efficiency.

METHODS

The process evaluation was conducted using focus group discussions and key informant interviews with beneficiaries, community leaders, project staff, health facility personnel, and government officials. Data analysis employed framework analysis.

RESULTS

The Lafiyan Yara project was reported to have achieved notable successes, including increased HIV testing rates among children and pregnant women, improved linkage to care services, reduced mother-to-child transmission of HIV, increased HIV/AIDS awareness and knowledge, and enhanced community engagement and support. Challenges identified included insufficient funding for community mobilizers, training needs for health workers, and inadequate availability of test kits at health facilities. Confidentiality and stigma issues arose during community mobilizations. A key lesson learned was the importance of a comprehensive HIV care approach, emphasizing testing and ensuring support for individuals testing positive.

CONCLUSIONS

The project's approach of leveraging community structures to create demand for HIV services among women and children proved effective, provided proper linkage to care for those testing positive. Addressing stigma and involving husbands/fathers in the community approach are crucial for improving outcomes.

TRIAL REGISTRATION

IPHOAU/12/1384.

Barriers and Opportunities for WHO "Best Buys" Non-communicable Disease Policy Adoption and Implementation From a Political Economy Perspective: A Complexity Systematic Review

BACKGROUND

Improving the adoption and implementation of policies to curb non-communicable diseases (NCDs) is a major challenge for better global health. The adoption and implementation of such policies remain deficient in various contexts, with limited insights into the facilitating and inhibiting factors. These policies have traditionally been treated as technical solutions, neglecting the critical influence of political economy dynamics. Moreover, the complex nature of these interventions is often not adequately incorporated into evidence for policy-makers. This study aims to systematically review and evaluate the factors affecting NCD policy adoption and implementation.

METHODS

We conducted a complex systematic review of articles discussing the adoption and implementation of World Health Organization's (WHO's) "best buys" NCD policies. We identified political economy factors and constructed a causal loop diagram (CLD) program theory to elucidate the interplay between factors influencing NCD policy adoption and implementation. A total of 157 papers met the inclusion criteria.

RESULTS

Our CLD highlights a central feedback loop encompassing three vital variables: (1) the ability to define, (re)shape, and pass appropriate policy into law; (2) the ability to implement the policy (linked to the enforceability of the policy and to addressing NCD local burden); and (3) ability to monitor progress, evaluate and correct the course. Insufficient context-specific data impedes the formulation and enactment of suitable policies, particularly in areas facing multiple disease burdens. Multisectoral collaboration plays a pivotal role in both policy adoption and implementation. Effective monitoring and accountability systems significantly impact policy implementation. The commercial determinants of health (CDoH) serve as a major barrier to defining, adopting, and implementing tobacco, alcohol, and diet-related policies.

CONCLUSION

To advance global efforts, we recommend focusing on the development of robust accountability, monitoring, and evaluation systems, ensuring transparency in private sector engagement, supporting context-specific data collection, and effectively managing the CDoH. A system thinking approach can enhance the implementation of complex public health interventions.

Challenge of ending TB in China: tuberculosis control in primary healthcare sectors under integrated TB control model-a systematic review and meta-analysis

BACKGROUND

China has the third-largest burden of tuberculosis (TB) cases in the world with great challenges towards ending TB. Primary health care (PHC) sectors play a critical role in TB prevention and control in communities under the Chinese integrated TB control model. However, there is a lack of comprehensive review of research evidence on TB control in PHC sectors under the integrated TB control model in China.

METHODS

This review was conducted following the PRISMA guidelines. Articles published from 2012 to January 2022 were searched from four international and three Chinese databases. Studies conducted inside mainland China and relevant with TB control service in PHC sectors under the integrated model were included. After study selection, data extraction, and quality assessment, the meta-analysis was performed with RevMan using a random-effect model.When I2 was more than 50%, subgroup analysis was performed to explore possible reasons for heterogeneity. We also conducted a post hoc sensitivity analysis for outcomes after meta-analysis by exclusion of studies with a high risk of bias or classified as low quality.

RESULTS

Forty-three studies from 16 provinces/municipalities in China were included in this review, and most studies included were of medium quality. PHC sectors in East China delivered TB control service better overall than that in West China, especially in tracing of patients and TB case management (TCM). In meta-analyses, both the pooled arrival rate of tracing and pooled TCM rate in East China were higher than those in West China. TB patients had a low degree of willingness to receive TCM provided by healthcare workers in PHC sectors nationwide, especially among migrant TB patients. There were 9 studies reporting factors related to TB control service in PHC sectors, 6 (2 in East and 4 in West China) of which indentified several characteristics of patients as associated factors. The context of PHC sectors was demonstrated to influence delivery of TB control service in PHC sectors in 5 studies (3 in East, 1 in Middle and 1 in West China). Most studies on strategies to promoting TB control services in PHC sectors were conducted in East China and some of these studies identified several online and offline interventions and strategies improving patients' treatment compliance [pooled OR (95% CI): 7.81 (3.08, 19.19] and awareness of TB [pooled OR (95% CI): 6.86 (2.16, 21.72)].

CONCLUSION

It is of urgent need to improve TB control in PHC sector in China, particularly in West China. Formative and implementation research with rigorous design are necessary to develop comprehensive, context-specific, and patient-centered TB control strategies to promote ending TB in China.

Co-designing for behavioural change: understanding barriers and enablers to addressing sexuality after traumatic brain injury and mapping intervention strategies in a multi-disciplinary rehabilitation unit

Background Persistent changes in sexuality often follow traumatic brain injury (TBI). However, health professionals remain reticent about discussing sexuality and have reported barriers including uncertainties around whose role it is and limited educational and institutional support. This study employed a co-design and implementation process, aiming to promote team-wide behavioural change, whereby health professionals at a TBI rehabilitation unit would attempt to address sexuality with patients routinely. Methods Focus group sessions with multidisciplinary health professionals were conducted to identify barriers and enablers to behavioural change, identify areas for development, and co-design intervention options. Implementation deliverables were then finalised and provided to the team. The Theoretical Domains Framework was used to map factors influencing behaviours and the Behaviour Change Wheel was used to map interventions. Thematic analysis was used to further analyse barrier themes. Results Thirty-five barriers and eight enablers falling within 12 theoretical domains to behavioural change were identified. Thematic analysis revealed highly correlated barriers in initiating and sustaining change. Nine co-designed intervention options aligned with five intervention functions of the Behaviour Change Wheel, resulting in six final implementation deliverables. Conclusions Barriers were highly interrelated, influencing the approach to implementation deliverables. Simultaneously addressing multiple barriers could potentially alleviate discomfort associated with discussing sexuality. Concerns around initiating change were related to confidence in achieving sustainable changes. Achieving change requires organisational and team-level environmental restructuring and enablement. The next step involves evaluating the effectiveness of the co-design and implementation process in driving behavioural change and potential impacts on patient satisfaction and sexuality outcomes.

Health promotion intervention delivered by trained community health workers (CHWs) for obesity prevention and control among adult people: a scoping review protocol

INTRODUCTION

Obesity is one of the most common diseases and is the main risk factor for the occurrence of other non-communicable diseases, such as hypertension, diabetes, heart disease and cancer. Obesity can be prevented and controlled, especially by adopting healthy behaviours, such as increased physical activity and healthy dietary patterns. The delivery of health promotion interventions by trained community health workers (CHWs) can be applied to obesity prevention and control based on the culture and local context. Our study aimed to map the health promotion interventions delivered by trained CHWs in the context of obesity prevention and control in community settings.

METHODS

This scoping review (ScR) was conducted using the methodologies introduced by Arksey and O'Malley. The search strategy was conducted on electronic databases, such as MEDLINE via PubMed, Scopus, Cochrane, ProQuest, medRxiv and Clinicaltrial.gov, from 2010 until 2022 by entering the appropriate keywords. Afterwards, the title, abstract and full text were screened independently by two researchers in accordance with the inclusion and exclusion criteria. Then, the data were charted, extracted, collated, summarised and reported.

ETHICS AND DISSEMINATION

In this ScR, research ethics was unnecessary because this work synthesised evidence from pre-existing literature only. The results of this ScR were published in peer-reviewed journals and presented at scientific conferences. We disseminated the results using graphs, images, tables, discussions and a plain language summary.

Implementation Fidelity and Theory-Informed Dose Effects of a Teen Pregnancy Prevention Program for Native American Youth

In 2019, Native youth had the highest rate of teen pregnancy of all racial/ethnic groups. "Respecting the Circle of Life" (RCL) is one of the first evidence-based teen pregnancy prevention programs for Native teens and there is interest in replicating the program across tribal communities. To inform replication, it is important to consider process data including quality, fidelity, and dosage as these may all moderate impact of the program. Participants were Native youth aged 11-19 and a trusted adult. This study includes participants randomized to the RCL program only (N = 266). Data sources include independent observations, facilitator self-assessments, attendance logs, and self-report assessments completed by enrolled youth at baseline and 3 months post assessment. Data was compiled and summed by cohort. Dosage was number of minutes participating in activities separated by theoretical constructs. Linear regression models were utilized to assess moderation of the effects of the intervention dosage on outcomes of interest. Eighteen facilitators delivered RCL. One hundred eighteen independent observations and 320 facilitator self-assessments were collected and entered. Findings indicate RCL was implemented with high fidelity and quality (4.40 to 4.82 out of a 5-point Likert scale; 96.6% of planned activities completed). Dosage was high with an average completion of 7 out of 9 lessons. There was no association between theoretical construct dosage and outcomes of interest. Overall, this study indicates RCL was delivered with high fidelity, quality, and dosage in this trial. This paper informs future replication of RCL and provides support for hiring paraprofessionals from the local community as facilitators, delivering the RCL to peer groups of the same age and sex, delivering the RCL with short duration and high frequency, and encouraging youth to attend all RCL lessons, but continue to serve youth who have missed one or more lessons.

Implementation of a group-based lifestyle intervention programme (Healthy Heart) in general practices in The Netherlands: a mixed-methods study

BACKGROUND

Lifestyle intervention programmes target behavioural risk factors that contribute to cardiovascular diseases (CVDs). Unfortunately, sustainable implementation of these programmes can be challenging. Gaining insights into the barriers and facilitators for successful implementation is important for maximising public health impact of these interventions. The Healthy Heart (HH) programme is an example of a combined lifestyle intervention programme.

AIM

To analyse the reach, adoption, and implementation of the HH programme.

DESIGN & SETTING

A mixed-methods study conducted in a general practice setting in The Netherlands.

METHOD

Quantitative data were collected from the Healthy Heart study (HH study), a non-randomised cluster stepped-wedge trial to assess the effect of the HH programme on patients at high risk of developing CVDs at practice level. Qualitative data were obtained through focus groups.

RESULTS

Out of 73 approached general practices, 55 implemented the HH programme. A total of 1082 patients agreed to participate in the HH study, of whom 64 patients were referred to the HH programme and 41 patients participated. Several barriers for participation were identified such as time investment, lack of risk perception, and being confident in changing lifestyle on their own. Important barriers for healthcare providers (HCPs) to refer a patient were time investment, lack of information to sufficiently inform patients, and preconceived notions regarding which patients the programme was suitable for.

CONCLUSION

This study has offered insights from a patient and HCP perspective regarding barriers and facilitators for implementation of the group-based lifestyle intervention programme. The identified barriers and facilitators, and the suggested improvements, can be used by others who wish to implement a similar programme.

Implementing a chest X-ray artificial intelligence tool to enhance tuberculosis screening in India: Lessons learned

Artificial Intelligence (AI) based chest X-ray (CXR) screening for tuberculosis (TB) is becoming increasingly popular. Still, deploying such AI tools can be challenging due to multiple real-life barriers like software installation, workflow integration, network connectivity constraints, limited human resources available to interpret findings, etc. To understand these challenges, PATH implemented a TB REACH active case-finding program in a resource-limited setting of Nagpur in India, where an AI software device (qXR) intended for TB screening using CXR images was used. Eight private CXR laboratories that fulfilled prerequisites for AI software installation were engaged for this program. Key lessons about operational feasibility and accessibility, along with the strategies adopted to overcome these challenges, were learned during this program. This program also helped to screen 10,481 presumptive TB individuals using informal providers based on clinical history. Among them, 2,303 individuals were flagged as presumptive for TB by a radiologist or by AI based on their CXR interpretation. Approximately 15.8% increase in overall TB yield could be attributed to the presence of AI alone because these additional cases were not deemed presumptive for TB by radiologists, but AI was able to identify them. Successful implementation of AI tools like qXR in resource-limited settings in India will require solving real-life implementation challenges for seamless deployment and workflow integration.

Delivery of Neuropsychological Interventions for Adult and Older Adult Clinical Populations: An Australian Expert Working Group Clinical Guidance Paper

Delivery of neuropsychological interventions addressing the cognitive, psychological, and behavioural consequences of brain conditions is increasingly recognised as an important, if not essential, skill set for clinical neuropsychologists. It has the potential to add substantial value and impact to our role across clinical settings. However, there are numerous approaches to neuropsychological intervention, requiring different sets of skills, and with varying levels of supporting evidence across different diagnostic groups. This clinical guidance paper provides an overview of considerations and recommendations to help guide selection, delivery, and implementation of neuropsychological interventions for adults and older adults. We aimed to provide a useful source of information and guidance for clinicians, health service managers, policy-makers, educators, and researchers regarding the value and impact of such interventions. Considerations and recommendations were developed by an expert working group of neuropsychologists in Australia, based on relevant evidence and consensus opinion in consultation with members of a national clinical neuropsychology body. While the considerations and recommendations sit within the Australian context, many have international relevance. We include (i) principles important for neuropsychological intervention delivery (e.g. being based on biopsychosocial case formulation and person-centred goals); (ii) a description of clinical competencies important for effective intervention delivery; (iii) a summary of relevant evidence in three key cohorts: acquired brain injury, psychiatric disorders, and older adults, focusing on interventions with sound evidence for improving activity and participation outcomes; (iv) an overview of considerations for sustainable implementation of neuropsychological interventions as 'core business'; and finally, (v) a call to action.

Supporting adolescents' participation in muscle-strengthening physical activity: protocol for the 'Resistance Training for Teens' (RT4T) hybrid type III implementation-effectiveness trial

INTRODUCTION

In Australia, only 22% of male and 8% of female adolescents meet the muscle-strengthening physical activity guidelines, and few school-based interventions support participation in resistance training (RT). After promising findings from our effectiveness trial, we conducted a state-wide dissemination of the 'Resistance Training for Teens' (RT4T) intervention from 2015 to 2020. Despite high estimated reach, we found considerable variability in programme delivery and teachers reported numerous barriers to implementation. Supporting schools when they first adopt evidence-based programmes may strengthen programme fidelity, sustainability, and by extension, programme impact. However, the most effective implementation support model for RT4T is unclear.

OBJECTIVE

To compare the effects of three implementation support models on the reach (primary outcome), dose delivered, fidelity, sustainability, impact and cost of RT4T.

METHODS AND ANALYSIS

We will conduct a hybrid type III implementation-effectiveness trial involving grade 9 and 10 (aged 14-16 years) students from 90 secondary schools in New South Wales (NSW), Australia. Schools will be recruited across one cohort in 2023, stratified by school type, socioeconomic status and location, and randomised in a 1:1:1 ratio to receive one of the following levels of implementation support: (1) 'low' (training and resources), (2) 'moderate' (training and resources+external support) or 'high' (training and resources+external support+equipment). Training includes a teacher workshop related to RT4T programme content (theory and practical sessions) and the related resources. Additional support will be provided by trained project officers from five local health districts. Equipment will consist of a pack of semiportable RT equipment (ie, weighted bars, dumbbells, resistance bands and inverted pull up bar stands) valued at ~$A1000 per school. Study outcomes will be assessed at baseline (T0), 6 months (T1) and 18 months (T2). A range of quantitative (teacher logs, observations and teacher surveys) and qualitative (semistructured interviews with teachers) methods will be used to assess primary (reach) and secondary outcomes (dose delivered, fidelity, sustainability, impact and cost of RT4T). Quantitative analyses will use logistic mixed models for dichotomous outcomes, and ordinal or linear mixed effects regression models for continuous outcomes, with alpha levels set at p<0.025 for the outcomes and cost comparisons of the moderate and high support arms against the low support arm.

ETHICS AND DISSEMINATION

Ethics approval has been obtained from the University of Newcastle (H-2021-0418), the NSW Department of Education (SERAP:2022215), Hunter New England Human Research Ethics Committee (2023/ETH00052) and the Catholic Schools Office. The design, conduct and reporting will adhere to the Consolidated Standards of Reporting Trials statement, the Standards for Reporting Implementation Studies statement and the Template for Intervention Description and Replication checklist. Findings will be published in open access peer-reviewed journals, key stakeholders will be provided with a detailed report. We will support ongoing dissemination of RT4T in Australian schools via professional learning for teachers.

TRIAL REGISTRATION NUMBER

ACTRN12622000861752.

Barriers and facilitators of implementing electronic monitors to improve adherence and health outcomes in tuberculosis patients: protocol for a systematic review based on the Consolidated Framework for Implementation Research

BACKGROUND

Tuberculosis (TB) has been regarded as 'a relentless scourge', increasing morbidity and mortality and burdening vulnerable populations. Poor adherence to TB treatment and ineffective traditional interventions hinders TB control. A novel TB approach called 'electronic monitors', equipping medication boxes with daily audio or visual reminders for electronically monitoring medication intake, seems promising in improving adherence and health outcomes and overcoming the weaknesses of traditional interventions. However, no review has systematically examined and synthesized the influencing factors of implementing electronic monitors. Implementation research offers the means to analyse the influencing factors of the implementation and its process, fitting well with the aim of this review. Therefore, the widely recognized Consolidated Framework for Implementation Research (CFIR), which offers a common taxonomy for evaluating intervention implementation, will be adopted to systematically identify barriers and facilitators of the electronic monitors for improving adherence and health outcomes in patients with TB.

METHODS AND ANALYSIS

The systematic review will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Literature research will be conducted in five electronic databases (Ovid MEDLINE, CINAHL, EMBASE, Cochrane Library and Web of Science) to identify the barriers and facilitators of implementing electronic monitors in patients with TB. The CFIR will be used as a guide for categorizing and synthesizing the barriers and facilitators. Study screening, data extraction, quality appraisal and data analysis will be conducted by two independent reviewers. The use of additional reviewers will solve any disagreements between the two reviewers.

DISCUSSION

Given the increased prominence of TB epidemiology and the adherence problem of electronic monitors, there is a solid rationale for synthesizing the existing studies via the CFIR. The findings and conclusion of this review will lay bare the achievements and effectiveness of implementing electronic monitors, as well as the attendant gaps and limitations. Further strategies for facilitating the implementation of electronic monitors will also be explored. This review will be of essential significance for research and practice, supporting future academic research initiatives centred on patients with TB and aiding electronic monitor design in lowering the morbidity and mortality associated with TB disease.

TRIAL REGISTRATION NUMBER

PROSPERO: CRD42023395747.

Leveraging Emotion for Behavior Change: Lessons from Implementation of the "Emo-Demo" Behavior Change Technique in Rural Mozambique

Innovative social behavior change communication (SBCC) can help improve child nutrition, but little is known about the process of implementing innovative nutrition SBCC strategies in resource-poor settings and associated challenges. This research study examines emotional demonstrations (Emo-Demos), interactive game-like group activities that aim to spark behavior change by pulling emotional levers. It seeks to determine whether they are feasible and acceptable for implementers and targeted community members in rural Mozambique, aiming to draw lessons for the application of similar highly interactive SBCC approaches in resource-poor settings-a key equity issue. This is done through a series of structured observations of the approach being delivered in seven communities as well as interviews with facilitators and participants. Results show the Emo-Demos were generally feasible to implement as planned and largely acceptable for both facilitators and participants. However, facilitators did not always understand the theory behind them, the importance of them being interactive, and the exact steps that needed to be followed to do them correctly. Participants universally reported enjoying the sessions and understood the lessons taught, and were able to translate them into potential behavior changes. However, few reported the expected emotional reaction to the sessions, and some had difficulty understanding the symbolic use of props in the exercises. The results underline the importance of strong training of SBCC facilitators, including on underlying theory; adapting approaches to local realities; and considering the incentives for participants to attend. These steps can help ensure high-quality SBCC that functions even in resource-poor settings, increasing intervention equity.

Implementing patient-centred outcome measures in palliative care clinical practice for adults (IMPCOM): Protocol for an update systematic review of facilitators and barriers

Background: Despite the development of patient-centred or patient-reported outcome measures (PCOMs or PROMs) in palliative and end-of-life care over recent years, their routine use in practice faces continuing challenges. Objective: To update a highly cited literature review, identify and synthesise new evidence on facilitators, barriers, lessons learned, PCOMs used, models of implementation, implementation outcomes, costs, and consequences of implementing PCOMs in palliative care clinical practice. Methods: We will search MEDLINE, PsycINFO, CINAHL, Embase, Emcare, SCI-Expanded, SSCI, ESCI, and BNI. The database search will be supplemented by a list of studies from the expert advisory committee, hand-searching of reference lists for included articles, and citations of the original review. We will include primary studies using a PCOM during clinical care of adult patients with advanced disease in palliative care settings and extract data on reported models of implementation, PCOMs, facilitators, barriers, lessons learned, costs, and implementation outcomes. Gough's Weight of Evidence Framework will be used to assess the robustness and relevance of the studies. We will narratively synthesise and tabulate the findings. This review will follow PRISMA, PRISMA-Abstract, PRISMA-P, and PRISMA-Search as the reporting guidelines. Source of funding: Marie Curie. The funder is not involved in designing or conducting this study. Protocol registration: CRD42023398653 (13/02/2023).

Using intervention mapping to develop evidence-based toolkits that support workers on long-term sick leave and their managers

BACKGROUND

Managing long-term sickness absence is challenging in countries where employers and managers have the main responsibility to provide return to work support, particularly for workers with poor mental health. Whilst long-term sick leave and return to work frameworks and guidance exist for employers, there are currently no structured return to work protocols for employers or for their workers encompassing best practice strategies to support a positive and timely return to work outcome.

PURPOSE

To utilise the intervention mapping (IM) protocol as a framework to develop return to work toolkits that are underpinned by relevant behaviour change theory targeting mental health to promote a positive return to work experiensce for workers on long-term sick leave.

METHODS

This paper provides a worked example of intervention mapping (IM) to develop an intervention through a six-step process to combine theory and evidence in the development of two toolkits - one designed for managers and one to be used by workers on long-term sick leave. As part of this process, collaborative planning techniques were used to develop the intervention. A planning group was set up, through which researchers would work alongside employer, worker, and mental health professional representatives to develop the toolkits. Additionally, feedback on the toolkits were sought from the target populations of workers and managers and from wider employer stakeholders (e.g., human resource specialists). The implementation and evaluation of the toolkits as a workplace intervention were also planned.

RESULTS

Two toolkits were designed following the six steps of intervention mapping. Feedback from the planning group (n = 5; psychologist, psychiatrist, person with previous experience of poor mental health, employer and charity worker) and participants (n = 14; employers = 3, wellbeing director = 1; human resources = 2, managers = 2, employees with previous experience of poor mental health = 5) target populations indicated that the toolkits were acceptable and much needed.

CONCLUSIONS

Using IM allowed the development of an evidence-based practical intervention, whilst incorporating the views of all the impacted stakeholder groups. The feasibility and acceptability of the toolkits and their supporting intervention components, implementation process and methods of assessment will be evaluated in a feasibility pilot randomised controlled trial.

Development and Evaluation of eHealth Services Regarding Accessibility: Scoping Literature Review

BACKGROUND

Accessibility is acknowledged as a key to inclusion in the Convention of Rights for People with Disabilities. An inaccessible design can result in exclusion from eHealth and cause disability among people who have impairments.

OBJECTIVE

This scoping literature review aimed to investigate how eHealth services have been developed and evaluated regarding accessibility for people with impairments.

METHODS

In line with Arksey and O'Malley's framework for scoping studies and using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR), we conducted a search in 4 databases (PubMed, Scopus, IEEE, and Web of Science) in October 2020 and an update of the search in June 2022. The search strategy was structured according to the PICO model as follows: Population/Problem, digital accessibility for users with impairment; Intervention, health care delivered by any digital solution; Comparison, not applicable; Outcome, use of and adherence to (1) Web Content Accessibility Guidelines (WCAG), (2) other accessibility guidelines, and (3) other means, for designing or evaluating accessibility in eHealth services. A Boolean search was conducted by combining terms related to accessibility and eHealth. All authors participated in screening abstracts according to the eligibility criteria. Each publication, containing a potentially relevant abstract, was read (full text) and assessed for eligibility by 2 authors independently and pairwise. Publications deemed eligible were read by all authors and discussed for consensus.

RESULTS

A total of 8643 publications were identified. After abstract screening, 131 publications remained for full-text reading. Of those, 116 publications were excluded as they did not meet the eligibility criteria. Fifteen publications involving studies of 12 eHealth services were included in the study. Of the 15 publications, 2 provided a definition of accessibility, 5 provided an explanation of accessibility, and 8 did not provide any explanation. Five publications used the WCAG to evaluate accessibility when developing eHealth services. One publication used International Organization for Standardization (ISO) 29138, ISO 2941, and ISO/International Electrotechnical Commission (IEC) 30071-1 standards together with the Spanish Association for Standardization (UNE) 139803 standard. Eleven publications used other means to address accessibility, including text-level grading; literature review about accessibility; user tests, focus groups, interviews, and design workshops with target groups of patients, relatives, and health care professionals; and comparative analysis of existing technical solutions to provide information about useful requirements.

CONCLUSIONS

Although a clear definition of accessibility can enhance operationalization and thus measurability when evaluating accessibility in eHealth services, accessibility was insufficiently defined in most of the included studies. Further, accessibility guidelines and standards were used to a very limited extent in the development and evaluation of eHealth services. Guidelines for developing complex interventions that include guidance for accessibility are motivated to ensure that accessibility will be considered systematically in eHealth services.

Identifying barriers and facilitators to successful implementation of computerized clinical decision support systems in hospitals: a NASSS framework-informed scoping review

BACKGROUND

Successful implementation and utilization of Computerized Clinical Decision Support Systems (CDSS) in hospitals is complex and challenging. Implementation science, and in particular the Nonadoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) framework, may offer a systematic approach for identifying and addressing these challenges. This review aimed to identify, categorize, and describe barriers and facilitators to CDSS implementation in hospital settings and map them to the NASSS framework. Exploring the applicability of the NASSS framework to CDSS implementation was a secondary aim.

METHODS

Electronic database searches were conducted (21 July 2020; updated 5 April 2022) in Ovid MEDLINE, Embase, Scopus, PyscInfo, and CINAHL. Original research studies reporting on measured or perceived barriers and/or facilitators to implementation and adoption of CDSS in hospital settings, or attitudes of healthcare professionals towards CDSS were included. Articles with a primary focus on CDSS development were excluded. No language or date restrictions were applied. We used qualitative content analysis to identify determinants and organize them into higher-order themes, which were then reflexively mapped to the NASSS framework.

RESULTS

Forty-four publications were included. These comprised a range of study designs, geographic locations, participants, technology types, CDSS functions, and clinical contexts of implementation. A total of 227 individual barriers and 130 individual facilitators were identified across the included studies. The most commonly reported influences on implementation were fit of CDSS with workflows (19 studies), the usefulness of the CDSS output in practice (17 studies), CDSS technical dependencies and design (16 studies), trust of users in the CDSS input data and evidence base (15 studies), and the contextual fit of the CDSS with the user's role or clinical setting (14 studies). Most determinants could be appropriately categorized into domains of the NASSS framework with barriers and facilitators in the "Technology," "Organization," and "Adopters" domains most frequently reported. No determinants were assigned to the "Embedding and Adaptation Over Time" domain.

CONCLUSIONS

This review identified the most common determinants which could be targeted for modification to either remove barriers or facilitate the adoption and use of CDSS within hospitals. Greater adoption of implementation theory should be encouraged to support CDSS implementation.

Evaluation of pharmaceutical care services in the Middle East Countries: a review of studies of 2013-2020

INTRODUCTION

Pharmaceutical care services (PCs) have evolved significantly over the last few decades, with a greater focus on patient's safety and proven effectiveness in a wide range of contexts. Many of the evidence supporting this technique comes from the United States, the evaluation and adoption of (PCs) which differ greatly across the globe.

OBJECTIVE

The goal of this study was to identify and assess the efficacy of pharmaceutical care services in various pharmaceutical aspects throughout seventeen Middle Eastern nations.

METHOD

The Arkesy and O'Malley technique was used to conduct a scoping review. It was conducted using PubMed/Medline, Scopus, Cochrane Library, Springer Link, Clinical Trials, and Web of Science etc. The Van Tulder Scale was utilized in randomized trials research, whereas the dawn and black checklists were used in non-randomized trials research. A descriptive and numerical analysis of selected research was done. The scope of eligible PCs, pharmaceutical implementers, study outcomes, and quality were all identified by a thematic review of research.

RESULTS

There were about 431,753 citations found in this study, and 129 publications were found to be eligible for inclusion after analysing more than 271 full-text papers. The study design was varied, with 43 (33.3%) RCTs and 86 (66.7%) n-RCTs. Thirty-three (25.6%) of the studies were published in 2020. Jordan, Saudi Arabia, and Turkey were home to the majority of the studies (25.6%, 16.3%, and 11.6%) respectively. Thirty-seven studies (19.7%) were concerned with resolving drug related problems (DRPs), whereas 27 (14.4%) were concerned with increasing quality of life (QOL) and 23 (12.2%) with improving drug adherence. Additionally, the research revealed that the average ratings of the activities provided to patients improved every year.

CONCLUSION

Studies in the Middle East continue to provide evidence supporting the positive impact of pharmaceutical care services on both hard and soft outcomes measured in most studies. Yet there was rare focus on the value of the implemented services. Thus, rigorous evaluation of the economic impact of implemented pharmaceutical care services in the Middle East and assessment of their sustainability is must.

Using Shared Decision-Making Resources in Long-Term Care: a Qualitative Study

Background

Shared decision-making (SDM) incorporates people's individual preferences and context into individualized, person-centred decisions. Persons living in long-term care (LTC) should only take medications that are a good fit for them as individuals.

Methods

We conducted a pilot study to understand experiences of two LTC homes in Ontario as they tested implementing SDM resources to support medication decisions. LTC homes conducted two Plan-Do-Study-Act (PDSA) cycles supported by an Advisory Group composed of LTC home representatives and stakeholders involved in resource design. Rapid qualitative analysis of transcripts and field notes from Advisory Group meetings elucidated how SDM resources were used.

Results

Each site was positively engaged but implemented resources differently. The pharmacist and physicians at Site 1 introduced proton-pump inhibitor (PPI) deprescribing as their primary intervention, identifying suitable residents, informing residents and families of the deprescribing process, and providing selected SDM resources to residents, caregivers and staff. Representatives reported limited engagement with SDM resources and difficulty measuring the impact of PPI deprescribing. Representatives from Site 2 disseminated the SDM resources to residents and caregivers for use at care conferences and focused on front-line staff education and involvement. This site reported that some residents/caregivers were interested in participating in SDM and using the resources, while others were not. The impact of the resources on SDM at this site was unclear.

Conclusions

Within the context of LTC, further research is needed to clarify the meaning and importance of SDM in medication decision-making. Implementation of SDM will likely require a multi-faceted approach.

Evaluating a multimodal, clinical and work-directed intervention (RTW-PIA) to support sustainable return to work among employees with mental disorders: study protocol of a multicentre, randomised controlled trial

BACKGROUND

Mental disorders (MDs) are one of the leading causes for workforce sickness absence and disability worldwide. The burden, costs and challenges are enormous for the individuals concerned, employers and society at large. Although most MDs are characterised by a high risk of relapse after treatment or by chronic courses, interventions that link medical-psychotherapeutic approaches with work-directed components to facilitate a sustainable return to work (RTW) are rare. This protocol describes the design of a study to evaluate the (cost-)effectiveness and implementation process of a multimodal, clinical and work-directed intervention, called RTW-PIA, aimed at employees with MDs to achieve sustainable RTW in Germany.

METHODS

The study consists of an effectiveness, a health-economic and a process evaluation, designed as a two-armed, multicentre, randomised controlled trial, conducted in German psychiatric outpatient clinics. Sick-listed employees with MDs will receive either the 18-month RTW-PIA treatment in conjunction with care as usual, or care as usual only. RTW-PIA consists of a face-to-face individual RTW support, RTW aftercare group meetings, and web-based aftercare. Assessments will be conducted at baseline and 6, 12, 18 and 24 months after completion of baseline survey. The primary outcome is the employees´ achievement of sustainable RTW, defined as reporting less than six weeks of working days missed out due to sickness absence within 12 months after first RTW. Secondary outcomes include health-related quality of life, mental functioning, RTW self-efficacy, overall job satisfaction, severity of mental illness and work ability. The health-economic evaluation will be conducted from a societal and public health care perspective, as well as from the employer's perspective in a cost-benefit analysis. The design will be supplemented by a qualitative effect evaluation using pre- and post-interviews, and a multimethod process evaluation examining various predefined key process indicators from different stakeholder perspectives.

DISCUSSION

By applying a comprehensive, multimethodological evaluation design, this study captures various facets of RTW-PIA. In case of promising results for sustainable RTW, RTW-PIA may be integrated into standard care within German psychiatric outpatient clinics.

TRIAL REGISTRATION

The study was prospectively registered with the German Clinical Trials Register ( DRKS00026232 , 1 September 2021).

Service user and stakeholder engagement in maternal and newborn health research in low- and middle-income countries: A systematic review protocol

BACKGROUND

Service user and stakeholder engagement have been widely considered as key aspects in translating knowledge into realistic policies and practices. However, there is a paucity of accumulative evidence about service user and stakeholder engagements in maternal and newborn health (MNH) research in low- and middle-income countries (LMICs). Therefore, we aim to systematically review the existing literature that includes service user and stakeholder engagement in maternal and newborn health research in low- and middle-income countries.

MATERIALS AND METHODS

The design of this protocol is guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA-P) checklist. We will systematically run the search in PubMed/MEDLINE, PsycINFO, Scopus, Science Direct, and CINAHL to obtain relevant peer-reviewed literature published between January 1990 and March 2023. The list of extracted references will be screened by applying the study inclusion criteria, and eligible studies will be processed for further evaluation before being included in the review. The quality of the selected study will be assessed using the critical appraisal skills program (CASP) checklists and the Mixed Method Appraisal Tool (MMAT) checklist. A narrative synthesis will be used to synthesised results from all the included studies.

DISCUSSION AND CONCLUSION

To the best of our knowledge, this systematic review will be the first synthesised evidence on service user and stakeholder engagement in maternal and newborn health research in low- and middle-income countries. The study highlights the importance of service user and stakeholder roles in designing, implementing, and evaluating maternal and newborn health interventions in resource-poor settings. The evidence from this review is expected to be useful for national and international researchers/stakeholders for practising meaningful and effective ways of engaging users and stakeholders in maternal and newborn health research and related activities. The PROSPERO registration number is CRD42022314613.

Integrated Early Childhood Development in Cambodia: Protocol of a Cluster Stepped-Wedge Trial

OBJECTIVES

Limited evidence is available on mechanisms linking integrated, multisector interventions with early childhood development. The Integrated Early Childhood Development program aims to improve children's development by promoting targeted caregiving behaviors beginning prenatally through age 5 years, in partnership with the Royal Government of Cambodia.

METHODS

This cluster stepped-wedge trial is being conducted in Cambodia among 3 cohorts, encompassing 339 villages and 1790 caregivers who are pregnant or caring for a child aged <5 years. The 12- to 15-month intervention is delivered to each cohort using a staggered stepped-wedge design. Among all cohorts, enrollment evaluations will be followed by 3 data collection waves. Targeted caregiving interventions are provided through community, group, and home-visiting platforms. Child development is measured using the Caregiver Reported Early Development Instrument and the Early Childhood Development Index 2030. The evaluation assesses mediation through targeted caregiving behaviors: responsive caregiving, nutrition, health and hygiene, and household stability and support; moderation by household wealth, caregiver education, and child birth weight; and sustainability after the intervention concludes.

CONCLUSIONS

This protocol article describes the plans for a cluster randomized controlled trial to measure the impact of an integrated, multisector intervention on children's development. By partnering with the Royal Government of Cambodia and addressing intervention pathways and moderators, this trial will provide guidance for policies and programs to promote early childhood development using principles of implementation science and equity, including increased investment for vulnerable families.

Acute post-stroke aphasia management: An implementation science study protocol using a behavioural approach to support practice change

BACKGROUND

Evidence should guide decisions in aphasia practice across the continuum of stroke care; however, evidence-practice gaps persist. This is particularly pertinent in the acute setting where 30% of people with stroke will have aphasia, and speech pathologists experience many challenges implementing evidence-based practice. This has important consequences for people with aphasia and their close others, as well as speech pathologists working in acute settings.

AIMS

This study protocol details how we will target practice change using a behavioural approach, with the aim of promoting the uptake of synthesized evidence in aphasia management post-stroke in the acute hospital setting.

METHODS & PROCEDURES

We will conduct a mixed-methods before-and-after study following the Knowledge-to-Action (KTA) framework. Researchers, speech pathologists and people with lived experience of aphasia will collaborate to identify and prioritize practice gaps, and develop and implement changes to clinical practice based on the Theoretical Domains Framework and Behaviour Change Wheel.

DISCUSSION

This study may provide a template for acute stroke services in how to use an implementation science approach to promote the application of synthesized evidence into routine clinical practice to ensure people with aphasia receive high-quality services. Collaboration among researchers, healthcare providers, people with aphasia and their close others ensures that the identification and targeting of practice gaps are driven by theory, lived experience and the local context.

WHAT THIS PAPER ADDS

What is already known on this subject Synthesized evidence, such as clinical guidelines and consensus statements, provides the highest level of evidence to inform clinical practice, yet discrepancies between delivered care and evidence remain. This discrepancy is of note in the acute setting where clinicians report many challenges implementing the best available evidence, combined with a high proportion of people with stroke who will have aphasia (30%). There are many reasons why evidence is not put into practice, and efforts to change clinical practice need to consider these barriers when developing interventions. What this paper adds to existing knowledge This study protocol details an implementation science approach to affect clinical practice change, informed by a collaboration of key stakeholders (researchers, speech pathologists, and people with aphasia and their close others). Protocol papers that focus on bridging the gap between evidence and practice are uncommon in communication disorders; moreover, explicit prioritization of practice gaps is a critical but often overlooked aspect of promoting evidence-based practice. What are the potential or actual clinical implications of this work? This protocol provides insights into how one study site identified and prioritized evidence-practice gaps using a participatory approach. We provide insights into how clinical practice change may occur by describing how we plan to identify priority evidence-practice gaps and develop an intervention to improve the use of aphasia evidence in routine practice. This protocol aims to share an implementation science approach to service improvement that may be replicated across other services.

Institutionalizing the Management of Sick Young Infants: Kenya's Experience in Revising National Guidelines on Integrated Management of Newborn and Childhood Illnesses

INTRODUCTION

In 2015, the World Health Organization (WHO) developed guidelines for the management of sick young infants (SYIs) with possible serious bacterial infection (PSBI) where referral is not feasible. The Ponya Mtoto project was designed as an implementation research project to demonstrate how to adopt the WHO PSBI guidelines in the Kenyan context.

PONYA MTOTO PROJECT DESCRIPTION

Between October 2017 and June 2021, Ponya Mtoto was implemented in 4 Kenyan counties with higher infant and newborn mortality rates than the national mean. A total of 48 health facilities stratified by level of services were selected as study sites.

IMPLEMENTATION APPROACH

The following activities were done to institutionalize the management of SYIs with PSBI where referral is not feasible in Kenya's health system: (1) participating in a cocreation workshop and development of a theory of change; (2) revising the national integrated management of newborn and childhood illnesses guidelines to incorporate the management of PSBI where referral is not feasible; (3) improving availability of essential commodities; (4) strengthening provider confidence in the management of SYIs; (5) strengthening awareness about PSBI services for SYIs at the community level; and (6) harmonizing the national integrated management of newborn and childhood illnesses guidelines to address discrepancies in the content on the management of PSBI. In addition, the project focused on strengthening quality of care for SYIs and using implementation research to track progress in achieving project targets and outcomes.

CONCLUSION

Using an implementation research approach to introduce new WHO guidelines on PSBI where referral is not feasible into Kenya's health care service was critical to fostering engagement of a diverse range of stakeholders, monitoring provider skills and confidence-building, strengthening provision of key commodities for managing SYIs with PSBI, and sustaining community-facility linkages.

New models to support parents to pack healthy lunchboxes: Parents acceptability, feasibility, appropriateness, and adoption of the SWAP IT m-Health program

OBJECTIVES

This report aims to evaluate the acceptability, appropriateness, feasibility, and adoption of a healthy lunchbox program (SWAP IT), from the parent perspective.

METHODS

SWAP IT is an mobile health (m-Health) program aimed to support parents in swapping out discretionary foods for healthier alternatives. Following receipt of the program, parents completed validated scales assessing the Acceptability (AIM), Intervention Appropriateness (IAM), and Feasibility (FIM) via a computer-assisted telephone interview (CATI). Parents were asked about their awareness of strategies in SWAP IT and whether the program supported them to make lunchbox swaps from discretionary to everyday foods.

RESULTS

Of the 679 parents who consented, 413 completed the CATI (61% response rate). Parent's mean AIM score (out of a total score of 5) was 4.22 (SD 0.48); FIM score was 4.27 (SD 0.54); and IAM score was 4.24 (SD 0.54). Most parents reported receiving the lunchbox messages (54%), with 45% reporting opening all 10 messages and 64% of parents reporting the program helped swap out discretionary foods.

CONCLUSION

The m-Health lunchbox program, SWAP IT, is highly acceptable, easy to adopt, appropriate, and feasible to parents.

IMPLICATIONS TO PUBLIC HEALTH

Not only is SWAP IT effective, but favourable implementation factors highlight the potential scalability of the program in improving child nutrition.

Geriatric care for surgical patients: results and reflections from a cross-sectional survey in acute Belgian hospitals

PURPOSE

To explore geriatric care for surgical patients in Belgian hospitals and geriatricians' reflections on current practice.

METHODS

A web-based survey was developed based on literature review and local expertise, and was pretested with 4 participants. In June 2021, the 27-question survey was sent to 91 heads of geriatrics departments. Descriptive statistics and thematic analysis were performed.

RESULTS

Fifty-four surveys were completed, corresponding to a response rate of 59%. Preoperative geriatric risk screening is performed in 25 hospitals and systematically followed by geriatric assessment in 17 hospitals. During the perioperative hospitalisation, 91% of geriatric teams provide non-medical and 82% provide medical advice. To a lesser extent, they provide geriatric protocols, geriatric education and training, and attend multidisciplinary team meetings. Overall, time allocation of geriatric teams goes mainly to postoperative evaluations and interventions, rather than to preoperative assessment and care planning. Most surgical patients are hospitalised on surgical wards, with reactive (73%) or proactive (46%) geriatric consultation. In 36 hospitals, surgical patients are also admitted on geriatric wards, predominantly orthopaedic/trauma, abdominal and vascular surgery. Ninety-eight per cent of geriatricians feel that more geriatric input for surgical patients is needed. The most common reported barriers to further implement geriatric-surgical services are shortage of geriatricians and geriatric nurses, and unadjusted legislation and financing.

CONCLUSION

Geriatric care for surgical patients in Belgian hospitals is mainly reactive, although geriatricians favour more proactive services. The main opportunities and challenges for improvement are to resolve staff shortages in the geriatric work field and to update legislation and financing.

Diagnostic quality model (DQM): an integrated framework for the assessment of diagnostic quality when using AI/ML

BACKGROUND

Laboratory medicine has reached the era where promises of artificial intelligence and machine learning (AI/ML) seem palpable. Currently, the primary responsibility for risk-benefit assessment in clinical practice resides with the medical director. Unfortunately, there is no tool or concept that enables diagnostic quality assessment for the various potential AI/ML applications. Specifically, we noted that an operational definition of laboratory diagnostic quality - for the specific purpose of assessing AI/ML improvements - is currently missing.

METHODS

A session at the 3rd Strategic Conference of the European Federation of Laboratory Medicine in 2022 on "AI in the Laboratory of the Future" prompted an expert roundtable discussion. Here we present a conceptual diagnostic quality framework for the specific purpose of assessing AI/ML implementations.

RESULTS

The presented framework is termed diagnostic quality model (DQM) and distinguishes AI/ML improvements at the test, procedure, laboratory, or healthcare ecosystem level. The operational definition illustrates the nested relationship among these levels. The model can help to define relevant objectives for implementation and how levels come together to form coherent diagnostics. The affected levels are referred to as scope and we provide a rubric to quantify AI/ML improvements while complying with existing, mandated regulatory standards. We present 4 relevant clinical scenarios including multi-modal diagnostics and compare the model to existing quality management systems.

CONCLUSIONS

A diagnostic quality model is essential to navigate the complexities of clinical AI/ML implementations. The presented diagnostic quality framework can help to specify and communicate the key implications of AI/ML solutions in laboratory diagnostics.

Feasibility and usability of a digital health technology system to monitor mobility and assess medication adherence in mild-to-moderate Parkinson's disease

Introduction

Parkinson's disease (PD) is a neurodegenerative disorder which requires complex medication regimens to mitigate motor symptoms. The use of digital health technology systems (DHTSs) to collect mobility and medication data provides an opportunity to objectively quantify the effect of medication on motor performance during day-to-day activities. This insight could inform clinical decision-making, personalise care, and aid self-management. This study investigates the feasibility and usability of a multi-component DHTS to remotely assess self-reported medication adherence and monitor mobility in people with Parkinson's (PwP).

Methods

Thirty participants with PD [Hoehn and Yahr stage I (n = 1) and II (n = 29)] were recruited for this cross-sectional study. Participants were required to wear, and where appropriate, interact with a DHTS (smartwatch, inertial measurement unit, and smartphone) for seven consecutive days to assess medication adherence and monitor digital mobility outcomes and contextual factors. Participants reported their daily motor complications [motor fluctuations and dyskinesias (i.e., involuntary movements)] in a diary. Following the monitoring period, participants completed a questionnaire to gauge the usability of the DHTS. Feasibility was assessed through the percentage of data collected, and usability through analysis of qualitative questionnaire feedback.

Results

Adherence to each device exceeded 70% and ranged from 73 to 97%. Overall, the DHTS was well tolerated with 17/30 participants giving a score &gt; 75% [average score for these participants = 89%, from 0 (worst) to 100 (best)] for its usability. Usability of the DHTS was significantly associated with age (ρ = −0.560, BCa 95% CI [−0.791, −0.207]). This study identified means to improve usability of the DHTS by addressing technical and design issues of the smartwatch. Feasibility, usability and acceptability were identified as key themes from PwP qualitative feedback on the DHTS.

Conclusion

This study highlighted the feasibility and usability of our integrated DHTS to remotely assess medication adherence and monitor mobility in people with mild-to-moderate Parkinson's disease. Further work is necessary to determine whether this DHTS can be implemented for clinical decision-making to optimise management of PwP.