Designing and undertaking randomised implementation trials: guide for researchers

Health And Performance Promotion in Youth (HAPPY) hybrid effectiveness-implementation cluster randomised trial: comparison of two strategies to implement an injury prevention exercise programme in Danish youth handball

OBJECTIVE

To investigate if a combination of an online and onsite implementation strategy was superior to an online-only strategy in enhancing the use of an injury prevention exercise programme (IPEP) and in reducing the risk of shoulder, knee and ankle injuries in youth community handball players (age 11-17) over a handball season.

METHODS

In this 30-week hybrid effectiveness-implementation cluster randomised type 3 study, 20 youth handball clubs were randomly assigned 1:1 to either a combined online and onsite implementation strategy (coach workshop using the health action process approach behaviour change model and health service provider (HSP) support) or an online-only strategy (control group). The primary implementation outcome was coach-reported adherence, measured as the average IPEP exercise usage by the team over 30 weeks. The primary effectiveness outcome was player-reported handball playing time to any new handball-related shoulder, knee and ankle injuries, reported weekly using the Oslo Sports Trauma Research Centre Questionnaire on Health Problems.

RESULTS

We enrolled 63 coaches (27% women) and 945 players (mean age 14.5 years, 55% girls). Intention-to-treat analyses showed no statistically significant difference between implementation strategies in adherence (between-group difference 1.4, 95% CI -0.5 to 3.4) or in cumulative injury risk (between-group difference 5.5% points, 95% CI -2.2 to 13.1).

CONCLUSION

Our findings demonstrate that in youth community handball, a combined online and onsite implementation strategy, including a coach workshop and HSP support, was not superior to an online-only strategy regarding adherence to an IPEP or in reducing shoulder, knee and ankle injury risk.

TRIAL REGISTRATION NUMBER

NCT05294237.

Barriers and enablers to addressing smoking, nutrition, alcohol consumption, physical activity and gestational weight gain (SNAP-W) as part of antenatal care: A mixed methods systematic review

BACKGROUND

International clinical guidelines recommend that smoking, nutrition, alcohol consumption, physical activity and gestational weight gain (SNAP-W) be addressed as part of routine antenatal care throughout pregnancy. However, guideline recommendations are poorly implemented, and few antenatal care recipients routinely receive the recommended care. There is a need to establish the determinants (barriers and enablers) to care delivery to inform strategies to improve implementation. This systematic review aimed to synthesize qualitative and quantitative evidence of the barriers and enablers to the routine delivery of antenatal care targeting SNAP-W health risks.

METHODS

A systematic review was conducted following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Seven databases were searched for relevant studies published between January 2001 and November 2023. Study findings were coded and analysed according to the domains of the Theoretical Domains Framework (TDF).

RESULTS

Forty-nine studies were included in the review, 27 qualitative studies and 22 quantitative studies. The studies were conducted in 14 countries. Data were collected from 7146 antenatal care providers (midwives, Aboriginal health workers, obstetricians, medical officers, general practitioners) and 352 barriers and enablers were identified. Across all SNAP-W health risk and antenatal care provider groups, the predominant TDF domain was 'environmental context and resources', identified in 96% of studies. Barriers within this domain included insufficient time, limited access to and quality of resources, and limited organisational supports. 'Beliefs about consequences' was the second most common TDF domain, reported in 67% of studies, particularly studies of care related to alcohol use, nutrition/ physical activity/ gestational weight gain and those involving midwives, multidisciplinary practitioners and general practitioners. 'Optimism' was the second most common TDF domain for studies of smoking-related care and involving obstetricians, gynaecologists, and other mixed medical professions.

CONCLUSIONS

It is critical that determinants related to environmental context and resources including time, resources and organisational supports are considered in the development of strategies to support the implementation of recommended antenatal care related to SNAP-W risks. Strategies addressing clinician beliefs about consequences and optimism may also be needed to support the implementation of care related to specific health behaviours and by specific antenatal care provider groups.

REGISTRATION

The review protocol was prospectively registered with Prospero: CRD42022353084; 22 October 2022.

Developing a shared language: a proposed guide to frame early implementation science collaboration discussions

Miscommunication between health care practitioners and implementation researchers can lead to a mismatch of expectations and understandings, resulting in wasted research and frustration. Conversely, combining the expertise and knowledge of those working in health care practice and implementation research can deliver context informed research questions and appropriate study designs. Achieving this ambition requires a shared language. We sought to develop a guide to identify a common language to constructively explore nascent implementation research concepts. We set up a working group, comprising of implementation researchers, health care practitioners and operational managers, to work through ideas generation, debate and a consensus process to generate and refine a discussion guide. The resultant guide steps health care practitioners and implementation researchers through a three-phase enquiry - Question 1: What is the implementation question? Question 2: What is the proposed implementation solution? And Question 3: How can the investigation of this idea be resourced? At each step, the health care practitioner and implementation researcher collaborate to include theory and practice and rigorously work through the question to build implementation on evidence and to promote diverse stakeholder engagement. The next steps for this study will be operationalising the discussion guide, as an interactive tool. Future evaluation, to test effectiveness, acceptability and feasibility will be designed with health care practitioners and implementation researchers.

Learning health systems to implement chronic disease prevention programs: A novel framework and perspectives from an Australian health service

Background

Chronic diseases are a considerable burden to health systems, communities, and patients. Much of this burden, however, could be prevented if interventions effective in reducing chronic disease risks were routinely implemented.

Aims

The aim of this paper is to discuss the role of public health agencies in preventing chronic disease through the application of learning health system (LHS) approaches to improve the implementation of evidence-based interventions.

Materials and Methods

We draw on the literature and our experience operating a local LHS in Australia that has achieved rapid improvements in the implementation of chronic disease prevention interventions.

Results

The proposed LHS framework has been adapted to be both implementation and chronic disease prevention focused. The framework describes both broad improvement processes, and the infrastructure and other support (pillars) recommended to support its core functions.

Conclusion

The framework serves as a basis for further exploration of the potentially transformative role LHS's may have in addressing the chronic disease health crisis.

Adoption, Implementation, and Maintenance of Evidence-Based Falls Prevention Programs

We evaluate the implementation of evidence-based falls prevention programs (EBFPPs) of the Administration for Community Living (ACL) Grantees by (1) describing adoption; (2) evaluating implementation through participant adherence; and (3) describing program maintenance. Secondary data analysis of a national data repository included forty-four ACL grantees spanning 31 states who were funded between September 2014 and December 2019 and provided information on over 80,000 older adult participants. Descriptive statistics including frequencies, percentages, and means were used to describe adoption, implementation (adherence), and maintenance of EBFPPs. Senior centers were the most common organizations to adopt EBFPPs. Most programs were maintained at their respective organizational site through repeat offerings, with several programs (60%) being offered greater than 10 times. Information regarding adoption, implementation, and maintenance of EBFPPs is valuable in identifying the best programs suited for different organizations and their clientele, which can inform policy for scaling and sustaining EBFPPs across the nation.

Identification of weight loss interventions for translation among endometrial cancer survivors: A RE-AIM analysis

Interventions for obesity-related cancers that combine nutrition and physical activity for weight loss exist; however, their application to survivors of endometrial cancer is unknown. Furthermore, little is known about pre-implementation perceptions of existing programs from a variety of interested persons (physicians, researchers) who may be part of the implementation team. Adapting an existing intervention rather than developing a new intervention may speed the translational lag time as long as intervention characteristics and fit within the delivery system are considered during the planning phase. To describe the process of determining the core elements of obesity-related interventions for cancer survivors and determine which one might be best delivered by an urban healthcare system that predominantly serves individuals who live in rural areas of Virginia and West Virginia. A pragmatic review of the literature was conducted via PubMed and Google Scholar with broad search terms of cancer survivor AND weight loss AND health intervention. Identified interventions were scored related to the Practical, Robust Implementation and Sustainability Model-which is an extension of RE-AIM framework to guide the understanding of who, what, where, when, and how the intervention was conducted. Intervention characteristics are reported. In addition, ratings from three independent reviewers on the validated 5-point Likert scale of an intervention's acceptability, appropriateness, and feasibility in the intended delivery system were collected and summarized. Twelve interventions were identified with an average sample size of 241(±195) and a range of 48-683 participants. Target populations included survivors of colorectal, breast, and endometrial cancers as well as general cancer survivors and included both men and women or only women. Most participants (74%) identified as white/Caucasian and average age ranged from 47.1 to 65.9 years. Program duration ranged from 4 weeks to 18 months, with an average duration of 32 weeks. Intervention dosage ranged from three times a week to once a month. Intervention acceptability, appropriateness, and feasibility had average and standard deviation ratings of 3.52(±0.46), 3.41(±0.45), and 3.21(±0.46), respectively, out of 5. The four interventions with the highest combined acceptable, appropriate, and feasible scores are being considered for potential use as an obesity-related intervention for survivors of endometrial cancer. Future work is needed to determine relevant adaptations and efficacy among survivors of endometrial cancer with obesity. Our approach may be beneficial for other interventionists aiming to speed intervention development and implementation.

Characteristics and Impact of Randomized Trials on Drugs or Devices in Cardiovascular Medicine

INTRODUCTION

Clinical trials, essential for medical advancement, vary significantly in methodology and regulatory pathways depending on the type of therapeutic intervention (i.e., drugs or devices). This study aimed to determine whether the drug or device intervention types influence the impact of randomized trials in cardiovascular medicine.

METHODS

We analyzed late-breaking randomized controlled trials presented at major cardiology conferences from 2015 to 2021. The primary endpoint was the total number of citations obtained. Secondary endpoints included the number of citations at 1 and 2 years, number of total and 1-year mentions, and several metrics of study conduct and publication. Statistical analysis included tests for comparisons of continuous or categorical variables, based on their distribution, as appropriate. To adjust the results for potential confounders, univariable and multivariable regression models were utilized. Additionally, sensitivity analyses were conducted to explore both the effect of neutral or positive study outcomes on the comparative impact of drug versus device trials and the impact of the coronavirus disease 2019 (COVID-19) pandemic on the primary endpoint.

RESULTS

Of 382 eligible randomized trials, 227 (59.4%) were trials of drugs and 155 (40.6%) were trials of devices. Drug trials had a higher median number of total citations compared to device studies (93 [interquartile range {IQR} 48-137] vs. 82 [IQR 39-192]; p = 0.025). This difference was consistent at 1 and 2 years and was also observed in the number of total mentions and mentions at 1 year. All the metrics of study conduct and publication were similar, except for drug studies being more often stopped prematurely (8.8 vs. 1.9%; p = 0.006). After adjusting for multiple potential confounders, the difference in citations and mentions was no longer statistically significant. However, drug trials remained more likely to be stopped prematurely (adjusted odds ratio = 1.15; 95% confidence interval 1.03-1.28; p = 0.009). Positive study outcomes significantly influenced the number of citations and the likelihood of a trial being stopped prematurely.

CONCLUSIONS

Drug trials are often stopped early and receive more citations and mentions than device trials. However, these differences are mainly due to factors other than the treatment itself. Studies published simultaneously tend to get more attention, and drug trials with positive results are cited more often than those with neutral results.

Particularity, Engagement, Actionable Inferences, Reflexivity, and Legitimation tool for rigor in mixed methods implementation research

BACKGROUND

Implementation science helps generate approaches to expedite the uptake of evidence in practice. Mixed methods are commonly used in implementation research because they allow researchers to integrate distinct qualitative and quantitative methods and data sets to unravel the implementation process and context and design contextual tools for optimizing the implementation. To date, there has been limited discussion on how to ensure rigor in mixed methods implementation research.

PURPOSE

To present Particularity, Engagement, Actionable Inferences, Reflexivity, and Legitimation (PEARL) as a practical tool for understanding various components of rigor in mixed methods implementation research.

DATA SOURCES

This methodological discussion is based on a nurse-led mixed methods implementation study. The PEARL tool was developed based on an interpretive, critical reflection, and purposive reading of selected literature sources drawn from the researchers' knowledge, experiences of designing and conducting mixed methods implementation research, and published methodological papers about mixed methods, implementation science, and research rigor.

CONCLUSION

An exemplar exploratory sequential mixed methods study in nursing is provided to illustrate the application of the PEARL tool. The proposed tool can be a useful and innovative tool for researchers and students intending to use mixed methods in implementation research. The tool offers a straightforward approach to learning the key rigor components of mixed methods implementation research for application in designing and conducting implementation research using mixed methods.

CLINICAL RELEVANCE

Rigorous implementation research is critical for effective uptake of innovations and evidence-based knowledge into practice and policymaking. The proposed tool can be used as the means to establish rigor in mixed methods implementation research in nursing and health sciences.

Characteristics of intervention studies on family-centred care in neonatal intensive care units: a scoping review of randomised controlled trials

BACKGROUND

Different definitions of family-centred care (FCC) exist in the newborn setting, and many FCC interventions have been tested, while a comprehensive review synthesising characteristics of existing intervention studies is still lacking.

OBJECTIVE

This review aims at summarising the characteristics of randomised controlled trials (RCTs) on FCC interventions in neonatal intensive care units.

METHODS

We searched PubMed, Embase, Web of Science and the Cochrane Library up to 31 January 2022, and reference lists of included studies and other reviews. Interventions were grouped into five categories according to a previous Cochrane review: (1) family support, (2) educational, (3) communication, (4) environmental interventions and (5) family-centred policies. Subgroup analyses by time period (RCTs published before vs after 2016) and by country income (based on the World Bank Classification) were conducted.

RESULTS

Out of 6583 retrieved studies, 146 RCTs met the eligibility criteria, with 53 (36.3%) RCTs published after 2016. Overall, 118 (80.8%) RCTs were conducted in high-income countries, 28 (19.1%) in middle-income countries and none in low-income countries. Only two RCTs were multicountry. Although mothers were the most frequent caregiver involved, fathers were included in 41 RCTs (28.1%). Very few studies were conducted in at-term babies (nine RCTs); siblings (two RCTs) and other family members (two RCTs), maternity care units (two RCTs). The role of health professionals was unclear in 65 (44.5%) RCTs. A large variety of intervention combinations was tested, with 52 (35.6%) RCTs testing more than 1 category of interventions, and 24 (16.4%) RCTs including all 5 categories.

CONCLUSION

There is a large and rising number of RCTs on FCC interventions in neonatal intensive care units, with specific research gaps. The large variety of FCC interventions, their high complexity, the need to tailor them to the local context and major gaps in implementation suggest that implementation research is the current priority.

Implementation strategies of cervical cancer screening in South Asia: A systematic review

BACKGROUND

Cervical cancer is a preventable cancer by screening, vaccination and timely management of preinvasive cervical lesions. However, about 90% of the global burden of cervical cancer is reported from developing countries.

OBJECTIVE

This systematic review aimed to analyze the strategies implemented for cervical cancer screening in South Asia.

SEARCH STRATEGY

An electronic search of PubMed/MEDLINE, Scopus and Google Scholar was carried out for articles published in English, evaluating the implementation of cervical cancer screening between December 2000 and June 2023 in South Asia using appropriate search terms.

SELECTION CRITERIA

Cross-sectional studies, randomized control trials (RCTs) or non-randomized controlled trials evaluating different cervical screening strategies were included.

DATA COLLECTION AND ANALYSIS

A three-stage selection process was performed using a validated proforma including the title, author, year of publication, objective, country, study design, screening methods, strategies and outcomes, and results. The systematic review was designed based on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The risk of bias was evaluated with the National Heart, Lung, and Blood Institute's (NHLBI) Quality Assessment Tools.

MAIN RESULTS

Out of the initial 1135 articles reviewed systematically, 23 studies met the inclusion criteria and were included in the qualitative synthesis of results. The implementation outcomes measured were acceptability (n = 23 100%), feasibility (n = 22, 95.7%), fidelity (n = 14, 60.9%), sustainability (n = 7, 30.4%), coverage (n = 4, 17.4%) and cost (n = 1, 4.3%).

CONCLUSION

Cervical cancer screening can be effectively implemented by restructuring the ongoing programs.

Real-time machine learning-assisted sepsis alert enhances the timeliness of antibiotic administration and diagnostic accuracy in emergency department patients with sepsis: a cluster-randomized trial

Machine learning (ML) has been applied in sepsis recognition across different healthcare settings with outstanding diagnostic accuracy. However, the advantage of ML-assisted sepsis alert in expediting clinical decisions leading to enhanced quality for emergency department (ED) patients remains unclear. A cluster-randomized trial was conducted in a tertiary-care hospital. Adult patient data were subjected to an ML model for sepsis alert. Patient visits were assigned into one of two groups. In the intervention cluster, staff received alerts on a display screen if patients met the ML threshold for sepsis diagnosis, while patients in the control cluster followed the regular alert process. The study compared triage-to-antibiotic (TTA) time, length of stay, and mortality rate between the two groups. Additionally, the diagnostic performance of the ML model was assessed. A total of 256 (intervention) and 318 (control) sepsis patients were analyzed. The proportions of patients who received antibiotics within 1 and 3 h were higher in the intervention group than in the control group (in 1 h; 68.4 vs. 60.1%, respectively; P = 0.04, in 3 h; 94.5 vs. 89.0%, respectively; P = 0.02). The median TTA times were marginally shorter in the intervention group (46 vs. 50 min). The area under the receiver operating characteristic curve (AUROC) of ML in early sepsis identification was significantly higher than qSOFA, SIRS, and MEWS. The ML-assisted sepsis alert system may help sepsis ED patients receive antibiotics more rapidly than with the conventional, human-dedicated alert process. The diagnostic performance of ML in prompt sepsis detection was superior to that of the rule-based system.Trial registration Thai Clinical Trials Registry TCTR20230120001. Registered 16 January 2023-Retrospectively registered, https://www.thaiclinicaltrials.org/show/TCTR20230120001 .

Successful and sustained implementation of a behaviour-change informed strategy for emergency nurses: a multicentre implementation evaluation

BACKGROUND

Implementing evidence that changes practice in emergency departments (EDs) is notoriously difficult due to well-established barriers including high levels of uncertainty arising from undifferentiated nature of ED patients, resource shortages, workload unpredictability, high staff turnover, and a constantly changing environment. We developed and implemented a behaviour-change informed strategy to mitigate these barriers for a clinical trial to implement the evidence-based emergency nursing framework HIRAID® (History including Infection risk, Red flags, Assessment, Interventions, Diagnostics, communication, and reassessment) to reduce clinical variation, and increase safety and quality of emergency nursing care.

AIM

To evaluate the behaviour-change-informed HIRAID® implementation strategy on reach, effectiveness, adoption, quality (dose, fidelity) and maintenance (sustainability).

METHODS

An effectiveness-implementation hybrid design including a step-wedge cluster randomised control trial (SW-cRCT) was used to implement HIRAID® with 1300 + emergency nurses across 29 Australian rural, regional, and metropolitan EDs. Evaluation of our behaviour-change informed strategy was informed by the RE-AIM Scoring Instrument and measured using data from (i) a post HIRAID® implementation emergency nurse survey, (ii) HIRAID® Instructor surveys, and (iii) twelve-week and 6-month documentation audits. Quantitative data were analysed using descriptive statistics to determine the level of each component of RE-AIM achieved. Qualitative data were analysed using content analysis and used to understand the 'how' and 'why' of quantitative results.

RESULTS

HIRAID® was implemented in all 29 EDs, with 145 nurses undertaking instructor training and 1123 (82%) completing all four components of provider training at 12 weeks post-implementation. Modifications to the behaviour-change informed strategy were minimal. The strategy was largely used as intended with 100% dose and very high fidelity. We achieved extremely high individual sustainability (95% use of HIRAID® documentation templates) at 6 months and 100% setting sustainability at 3 years.

CONCLUSION

The behaviour-change informed strategy for the emergency nursing framework HIRAID® in rural, regional, and metropolitan Australia was highly successful with extremely high reach and adoption, dose, fidelity, individual and setting sustainability across substantially variable clinical contexts.

TRIAL REGISTRATION

ANZCTR, ACTRN12621001456842 . Registered 25 October 2021.

Demonstration Projects to Test Built Environment Changes: A Systematic Review

CONTEXT

Built environment interventions (pedestrian/bicycle infrastructure and enhanced access) mitigate barriers to physical activity by making the healthy choice the default choice. Demonstration projects (eg, temporary pedestrian lanes or sidewalks marked with tape) are used to test these interventions before making permanent changes. However, it is unknown whether demonstration projects lead to desired built environment changes.

OBJECTIVE

To systematically review the literature to determine outcomes and overall public health impacts of demonstration projects and whether they lead to permanent changes to the built environment.

DESIGN

Systematic review, conducted from March to September 2022 by searching PubMed and EBSCOhost for peer-reviewed literature and Google for gray (non-peer-reviewed) literature. Inclusion criteria were policy, systems, or environmental interventions; temporary implementation; and presence of evaluation data. Exclusion criteria were individual/interpersonal-level interventions, permanent implementation, and absence of evaluation data. Two authors coded for inclusion/exclusion and resolved discrepancies, coded a portion of included sources and resolved discrepancies, refined coding guide definitions, and coded remaining sources.

MAIN OUTCOME MEASURES

Data were extracted based on the expanded RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, which incorporates constructs of the Implementation Outcomes Framework (acceptability, appropriateness, feasibility).

RESULTS

Gray (N = 23) and peer-reviewed (N = 1) sources describing unique demonstration projects (N = 31) met inclusion criteria. Projects tested built environment interventions including traffic calming measures, crosswalks, bike lanes, intersection design, and trails. Sources primarily reported effectiveness (typically improved safety), maintenance, acceptability, and appropriateness. Most sources did not report projects leading to permanent changes to the built environment.

CONCLUSIONS

Based on inconsistent reporting of key outcomes (number of community members reached, changes to physical activity levels), overall impacts are unknown. Most demonstration projects captured community members' feedback, which was typically positive, but it is unknown whether feedback led to long-term changes. We recommend providing improved demonstration project guidance for practitioners to facilitate robust data collection, including suggested evaluation methods and tools.

The Family Talk Intervention Among Families Affected by Severe Illness: Hospital Social Workers' Experiences of Facilitators and Barriers to its Use in Clinical Practice

Hospital social workers (HSW) play an important role in health care, providing psychosocial support to families affected by severe illness, and having palliative care needs involving dependent children. However, there are few evidence-based family interventions for HSWs to apply when supporting these families. The Family Talk intervention (FTI), a psychosocial family-based intervention, was therefore evaluated in an effectiveness-implementation study. Within the study, HSWs were educated and trained in the use of FTI in clinical practice. This study examined HSWs' experiences of barriers and facilitating factors during their initial use of FTI in clinical practice. Altogether, 10 semi-structured focus groups were held with HSWs (n = 38) employed in cancer care and specialized palliative home care for adults, pediatric hospital care, and a children's hospice. Data were analyzed using content analysis. HSWs considered FTI to be a suitable psychosocial intervention for families affected by severe illness with dependent children. However, the way in which the care was organized acted either as a barrier or facilitator to the use of FTI, such as the HSWs' integration in the team and their possibility to organize their own work. The HSWs' work environment also impacted the use of FTI, where time and support from managers was seen as a significant facilitating factor, but which varied between the healthcare contexts. In conclusion, HSWs believed that FTI was a suitable family intervention for families involving dependent children where one family member had a severe illness. For successful initial implementation, strategies should be multi-functional, targeting the care organization and the work environment.

Evaluating the use of the AMBIANCE-Brief measure in clinical settings: Assessing acceptability, feasibility, and utility of the AMBIANCE-Brief

Community agencies and practitioners around the globe seek opportunities to learn various assessment tools and interventions rooted in attachment theory. However, information regarding the feasibility of implementation and sustainability of these tools once participants have been trained to use them, is limited. This study investigated the perceived acceptability, feasibility, utility, relevance, fidelity, and sustainability of the Atypical Maternal Behavior Instrument for Assessment and Classification-Brief (AMBIANCE-Brief) among practitioners who had taken a training. Practitioners (N = 59) who attended a virtual AMBIANCE-Brief training originating from Canada between June 2020 and November 2021 completed an online follow-up survey. Practitioners reported that they primarily used the AMBIANCE-Brief for case conceptualization (68%). Additionally, 95% agreed that the AMBIANCE-Brief was relevant to their clinical practice, 98% agreed it was useful for their clinical work, 76% agreed that it was feasible to implement into their clinical work, and 59% found it easy to incorporate into their treatment planning with clients. Findings suggest that the AMBIANCE-Brief may be acceptable, feasible, and useful for practitioners. Avenues for continuing to evaluate the AMBIANCE-Brief include cross-cultural validity, coder drift, and booster sessions. Additional work clarifying how practitioners integrate the measure into practice would be valuable.

Interventions for improving critical care in low- and middle-income countries: a systematic review

PURPOSE

To systematically review the typology, impact, quality of evidence, barriers, and facilitators to implementation of Quality Improvement (QI) interventions for adult critical care in low- and middle-income countries (LMICs).

METHODS

MEDLINE, EMBASE, Cochrane Library and ClinicalTrials.gov were searched on 1st September 2022. The studies were included if they described the implementation of QI interventions for adult critical care in LMICs, available as full text, in English and published after 2000. The risks of bias were assessed using the ROB 2.0/ROBINS-I tools. Intervention strategies were categorised according to a Knowledge Translation framework. Interventions' effectiveness were synthesised by vote counting and assessed with a binomial test. Barriers and facilitators to implementation were narratively synthesised using the Consolidated Framework for Implementation Research.

RESULTS

78 studies were included. Risk of bias was high. The most common intervention strategies were Education, Audit & Feedback (A&F) and Protocols/Guidelines/Bundles/Checklists (PGBC). Two multifaceted strategies improved both process and outcome measures: Education and A&F (p = 0.008); and PGBC with Education and A&F (p = 0.001, p < 0.001). Facilitators to implementation were stakeholder engagement, organisational readiness for implementation, and adaptability of interventions. Barriers were lack of resources and incompatibility with clinical workflows.

CONCLUSIONS

The evidence for QI in critical care in LMICs is sparse and at high risk of bias but suggests that multifaceted interventions are most effective. Co-designing interventions with and engaging stakeholders, communicating relative advantages, employing local champions and adapting to feedback can improve implementation. Hybrid study designs, process evaluations and adherence to reporting guidelines would improve the evidence base.

Research outcomes informing the selection of public health interventions and strategies to implement them: A cross-sectional survey of Australian policy-maker and practitioner preferences

BACKGROUND

A key role of public health policy-makers and practitioners is to ensure beneficial interventions are implemented effectively enough to yield improvements in public health. The use of evidence to guide public health decision-making to achieve this is recommended. However, few studies have examined the relative value, as reported by policy-makers and practitioners, of different broad research outcomes (that is, measures of cost, acceptability, and effectiveness). To guide the conduct of research and better inform public health policy and practice, this study aimed at describing the research outcomes that Australian policy-makers and practitioners consider important for their decision-making when selecting: (a) public health interventions; (b) strategies to support their implementation; and (c) to assess the differences in research outcome preferences between policy-makers and practitioners.

METHOD

An online value-weighting survey was conducted with Australian public health policy-makers and practitioners working in the field of non-communicable disease prevention. Participants were presented with a list of research outcomes and were asked to select up to five they considered most critical to their decision-making. They then allocated 100 points across these - allocating more points to outcomes perceived as more important. Outcome lists were derived from a review and consolidation of evaluation and outcome frameworks in the fields of public health knowledge translation and implementation. We used descriptive statistics to report relative preferences overall and for policy-makers and practitioners separately.

RESULTS

Of the 186 participants; 90 primarily identified as policy-makers and 96 as public health prevention practitioners. Overall, research outcomes of effectiveness, equity, feasibility, and sustainability were identified as the four most important outcomes when considering either interventions or strategies to implement them. Scores were similar for most outcomes between policy-makers and practitioners.

CONCLUSION

For Australian policy-makers and practitioners working in the field of non-communicable disease prevention, outcomes related to effectiveness, equity, feasibility, and sustainability appear particularly important to their decisions about the interventions they select and the strategies they employ to implement them. The findings suggest researchers should seek to meet these information needs and prioritize the inclusion of such outcomes in their research and dissemination activities. The extent to which these outcomes are critical to informing the decision of policy-makers and practitioners working in other jurisdictions or contexts warrants further investigation.

How can a behavioral economics lens contribute to implementation science?

BACKGROUND

Implementation science in health is an interdisciplinary field with an emphasis on supporting behavior change required when clinicians and other actors implement evidence-based practices within organizational constraints. Behavioral economics has emerged in parallel and works towards developing realistic models of how humans behave and categorizes a wide range of features of choices that can influence behavior. We argue that implementation science can be enhanced by the incorporation of approaches from behavioral economics. Main body First, we provide a general overview of implementation science and ways in which implementation science has been limited to date. Second, we review principles of behavioral economics and describe how concepts from BE have been successfully applied to healthcare including nudges deployed in the electronic health record. For example, de-implementation of low-value prescribing has been supported by changing the default in the electronic health record. We then describe what a behavioral economics lens offers to existing implementation science theories, models and frameworks, including rich and realistic models of human behavior, additional research methods such as pre-mortems and behavioral design, and low-cost and scalable implementation strategies. We argue that insights from behavioral economics can guide the design of implementation strategies and the interpretation of implementation studies. Key objections to incorporating behavioral economics are addressed, including concerns about sustainment and at what level the strategies work.

CONCLUSION

Scholars should consider augmenting implementation science theories, models, and frameworks with relevant insights from behavioral economics. By drawing on these additional insights, implementation scientists have the potential to boost efforts to expand the provision and availability of high quality care.

Barriers and enablers to the implementation of patient-reported outcome and experience measures (PROMs/PREMs): protocol for an umbrella review

BACKGROUND

Patient-reported outcome and experience measures (PROMs and PREMs, respectively) are evidence-based, standardized questionnaires that can be used to capture patients' perspectives of their health and health care. While substantial investments have been made in the implementation of PROMs and PREMs, their use remains fragmented and limited in many settings. Analysis of multi-level barriers and enablers to the implementation of PROMs and PREMs has been hampered by the lack of use of state-of-the-art implementation science frameworks. This umbrella review aims to consolidate available evidence from existing quantitative, qualitative, and mixed-methods systematic and scoping reviews covering factors that influence the implementation of PROMs and PREMs in healthcare settings.

METHODS

An umbrella review of systematic and scoping reviews will be conducted following the guidelines of the Joanna Briggs Institute (JBI). Qualitative, quantitative, and mixed methods reviews of studies focusing on the implementation of PROMs and/or PREMs in all healthcare settings will be considered for inclusion. Eight bibliographical databases will be searched. All review steps will be conducted by two reviewers independently. Included reviews will be appraised and data will be extracted in four steps: (1) assessing the methodological quality of reviews using the JBI Critical Appraisal Checklist; (2) extracting data from included reviews; (3) theory-based coding of barriers and enablers using the Consolidated Framework for Implementation Research (CFIR) 2.0; and (4) identifying the barriers and enablers best supported by reviews using the Grading of Recommendations Assessment, Development and Evaluation-Confidence in the Evidence from Reviews of Qualitative research (GRADE-CERQual) approach. Findings will be presented in diagrammatic and tabular forms in a manner that aligns with the objective and scope of this umbrella review, along with a narrative summary.

DISCUSSION

This umbrella review of quantitative, qualitative, and mixed-methods systematic and scoping reviews will inform policymakers, researchers, managers, and clinicians regarding which factors hamper or enable the adoption and sustained use of PROMs and PREMs in healthcare settings, and the level of confidence in the evidence supporting these factors. Findings will orient the selection and adaptation of implementation strategies tailored to the factors identified.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42023421845.

Can propensity score matching replace randomized controlled trials?

Randomized controlled trials (RCTs) have long been recognized as the gold standard for establishing causal relationships in clinical research. Despite that, various limitations of RCTs prevent its widespread implementation, ranging from the ethicality of withholding potentially-lifesaving treatment from a group to relatively poor external validity due to stringent inclusion criteria, amongst others. However, with the introduction of propensity score matching (PSM) as a retrospective statistical tool, new frontiers in establishing causation in clinical research were opened up. PSM predicts treatment effects using observational data from existing sources such as registries or electronic health records, to create a matched sample of participants who received or did not receive the intervention based on their propensity scores, which takes into account characteristics such as age, gender and comorbidities. Given its retrospective nature and its use of observational data from existing sources, PSM circumvents the aforementioned ethical issues faced by RCTs. Majority of RCTs exclude elderly, pregnant women and young children; thus, evidence of therapy efficacy is rarely proven by robust clinical research for this population. On the other hand, by matching study patient characteristics to that of the population of interest, including the elderly, pregnant women and young children, PSM allows for generalization of results to the wider population and hence greatly increases the external validity. Instead of replacing RCTs with PSM, the synergistic integration of PSM into RCTs stands to provide better research outcomes with both methods complementing each other. For example, in an RCT investigating the impact of mannitol on outcomes among participants of the Intensive Blood Pressure Reduction in Acute Cerebral Hemorrhage Trial, the baseline characteristics of comorbidities and current medications between treatment and control arms were significantly different despite the randomization protocol. Therefore, PSM was incorporated in its analysis to create samples from the treatment and control arms that were matched in terms of these baseline characteristics, thus providing a fairer comparison for the impact of mannitol. This literature review reports the applications, advantages, and considerations of using PSM with RCTs, illustrating its utility in refining randomization, improving external validity, and accounting for non-compliance to protocol. Future research should consider integrating the use of PSM in RCTs to better generalize outcomes to target populations for clinical practice and thereby benefit a wider range of patients, while maintaining the robustness of randomization offered by RCTs.

How PrEP delivery was integrated into public ART clinics in central Uganda: A qualitative analysis of implementation processes

Tailored delivery strategies are important for optimizing the benefit and overall reach of PrEP in sub-Saharan Africa. An integrated approach of delivering time-limited PrEP in combination with ART to serodifferent couples encourages PrEP use in the HIV-negative partner as a bridge to sustained ART use. Although PrEP has been delivered in ART clinics for many years, the processes involved in integrating PrEP into ART services are not well understood. The Partners PrEP Program was a stepped-wedge cluster randomized trial of integrated PrEP and ART delivery for HIV serodifferent couples in 12 public health facilities in central Uganda (Clinicaltrials.gov NCT03586128). Using qualitative data, we identified and characterized key implementation processes that explain how PrEP delivery was integrated into existing ART services in the Partners PrEP Program. In-depth interviews were conducted with a purposefully-selected sub-sample of 83 members of 42 participating serodifferent couples, and with 36 health care providers implementing integrated delivery. High quality training, technical supervision, and teamwork were identified as key processes supporting providers to implement PrEP delivery. Interest in the PrEP program was promoted through the numerous ways health care providers made integrated ART and PrEP meaningful for serodifferent couples, including tailored counseling messages, efforts to build confidence in integrated delivery, and strategies to create demand for PrEP. Couples in the qualitative sample responded positively to providers' efforts to promote the integrated strategy. HIV-negative partners initiated PrEP to preserve their relationships, which inspired their partners living with HIV to recommit to ART adherence. Lack of disclosure among couples and poor retention on PrEP were identified as barriers to implementation of the PrEP program. A greater emphasis on understanding the meaning of PrEP for users and its contribution to implementation promises to strengthen future research on PrEP scale up in sub-Saharan Africa.

The Ethical Obligation for Research During Public Health Emergencies: Insights From the COVID-19 Pandemic

In times of crises, public health leaders may claim that trials of public health interventions are unethical. One reason for this claim can be that equipoise-i.e. a situation of uncertainty and/or disagreement among experts about the evidence regarding an intervention-has been disturbed by a change of collective expert views. Some might claim that equipoise is disturbed if the majority of experts believe that emergency public health interventions are likely to be more beneficial than harmful. However, such beliefs are not always justified: where high quality research has not been conducted, there is often considerable residual uncertainty about whether interventions offer net benefits. In this essay we argue that high-quality research, namely by means of well-designed randomized trials, is ethically obligatory before, during, and after implementing policies in public health emergencies (PHEs). We contend that this standard applies to both pharmaceutical and non-pharmaceutical interventions, and we elaborate an account of equipoise that captures key features of debates in the recent pandemic. We build our case by analyzing research strategies employed during the COVID-19 pandemic regarding drugs, vaccines, and non-pharmaceutical interventions; and by providing responses to possible objections. Finally, we propose a public health policy reform: whenever a policy implemented during a PHE is not grounded in high-quality evidence that expected benefits outweigh harms, there should be a planned approach to generate high-quality evidence, with review of emerging data at preset time points. These preset timepoints guarantee that policymakers pause to review emerging evidence and consider ceasing ineffective or even harmful policies, thereby improving transparency and accountability, as well as permitting the redirection of resources to more effective or beneficial interventions.

Impact and process evaluation of a primary-school Food Education and Sustainability Training (FEAST) program in 10-12-year-old children in Australia: pragmatic cluster non-randomized controlled trial

BACKGROUND

Environmentally sustainable food initiatives accompanying nutrition education, such as the Food Education and Sustainability Training (FEAST) program, have gained traction in school settings. The aim of this trial was to conduct an impact and process evaluation of FEAST, to evaluate its effect on children's fruit and vegetable (F&V) intakes, and secondary outcomes: F&V variety consumed, nutrition knowledge, food preparation/cooking skills, self-efficacy and behaviours, food waste knowledge and behaviours, and food production knowledge.

METHODS

FEAST was a 10-week curriculum-aligned program, designed to educate children about healthy eating, food waste, and sustainability, while teaching cooking skills. It was implemented by classroom teachers, face-to-face and online, during COVID-19 school closures, in Australia in 2021. A custom designed survey was used to collect baseline and post-intervention data from students. Generalised linear mixed models (GLMM) estimated group differences in pre-post changes for primary and secondary outcomes. Surveys were also administered to students and teachers to evaluate intervention implementation.

RESULTS

Twenty schools participated and self-selected to be either intervention schools (n = 10) or wait-list control (WLC) schools (n = 10). A total of 977, 5th and 6th grade children participated in the trial with a mean age of 11.1 years (SD ± 0.7). The FEAST intervention, compared to WLC, did not result in significant increases in primary outcomes nor secondary outcomes. The process evaluation revealed FEAST was well-received by students and teachers, but COVID-19 school closures hindered implementation fidelity with a less intense program delivered under the constraints of pandemic lockdowns.

CONCLUSIONS

This is the first cluster non-randomized controlled trial designed to independently evaluate FEAST in the primary-school setting. No evidence was found for improved F&V intakes in children, nor secondary outcomes. However, the positive process evaluation results suggest that further trials of the program are warranted. If implemented as originally designed (pre-pandemic), with increased duration and complemented by supporting school policies, such programs have the potential to improve children's daily F&V intakes, cooking skills and food waste behaviours. This would support the Australian curriculum and contribute to: health promotion within schools and sustainable schools initiatives, the national agenda to reduce food waste and sustainable development goals. AUSTRALIAN AND NEW ZEALAND CLINICAL TRIALS REGISTRY: [ACTRN12620001347954]- Registered prospectively on 14/12/2020.

Informing the development of the SUCCEED reporting guideline for studies on the scaling of health interventions: A systematic review

BACKGROUND

Quality reporting contributes to effective translation of health research in practice and policy. As an initial step in the development of a reporting guideline for scaling, the Standards for reporting stUdies of sCaling evidenCEd-informED interventions (SUCCEED), we performed a systematic review to identify relevant guidelines and compile a list of potential items.

METHODS

We conducted a systematic review according to Cochrane method guidelines. We searched the following databases: MEDLINE, Embase, PsycINFO, Cochrane Library, CINAHL, Web of Science, from their respective inceptions. We also searched websites of relevant organizations and Google. We included any document that provided instructions or recommendations, e.g., reporting guideline, checklist, guidance, framework, standard; could inform the design or reporting of scaling interventions; and related to the health sector. We extracted characteristics of the included guidelines and assessed their methodological quality using a 3-item internal validity assessment tool. We extracted all items from the guidelines and classified them according to the main sections of reporting guidelines (title, abstract, introduction, methods, results, discussion and other information). We performed a narrative synthesis based on descriptive statistics.

RESULTS

Of 7704 records screened (published between 1999 and 2019), we included 39 guidelines, from which data were extracted from 57 reports. Of the 39 guidelines, 17 were for designing scaling interventions and 22 for reporting implementation interventions. At least one female author was listed in 31 guidelines, and 21 first authors were female. None of the authors belonged to the patient stakeholder group. Only one guideline clearly identified a patient as having participated in the consensus process. More than half the guidelines (56%) had been developed using an evidence-based process. In total, 750 items were extracted from the 39 guidelines and distributed into the 7 main sections.

CONCLUSION

Relevant items identified could inform the development of a reporting guideline for scaling studies of evidence-based health interventions. This and our assessment of guidelines could contribute to better reporting in the science and practice of scaling.

Embedding implementation science in the research pipeline

Clinical and health services researchers seek to discover effective programs, practices, and interventions to improve people's health. The current paradigm for evidence generation is incremental and misaligned to translate evidence-based discoveries into real-world settings. This persistent challenge are "valleys of death" that represent missed opportunities and preventable missteps to actually use scientific advancements in real-world clinical settings where they can improve health and well-being (De Geest S, Zúñiga F, Brunkert T et al. Powering Swiss health care for the future: implementation science to bridge "the valley of death". 2020;150:w20323). Only one in seven of evidence-based interventions is ever implemented. It is after an average of 17 years. We propose embedding the principles of implementation science throughout the research pipeline, from discovery to adoption, to efficiently translate discoveries into real-world contexts (Balas EA, Boren SA. Managing clinical knowledge for health care improvement. 2000;9:65-70). We outline implications for capacity building, including composition of the research team, study design, and competencies that could bolster the value proposition of implementation science. We describe a research paradigm that recognizes scientists' responsibility to ensure their discoveries be translated into real-world settings.

Evaluating Preconception Health and Behaviour Change in Australian Women Planning a Pregnancy: The OptimalMe Program, a Digital Healthy Lifestyle Intervention with Remotely Delivered Coaching

OptimalMe is a digital healthy lifestyle intervention for women planning a pregnancy, with remotely delivered coaching. This follow-up study of Australian women, stratified by coaching delivery mode (phone vs. videoconferencing), assessed alignment to preconception care guidelines and self-reported behaviour change. Overall, 298 women enrolled with a mean (SD) age of 31.8 (4.3) years and mean BMI of 25.7 (6.1) kg/m2. Suboptimal preconception behaviours were reported at baseline, including alcohol consumption (57.2%), infrequent weighing (37.2%) and incomplete cervical cancer screening (15.8%) and prenatal supplementation (38.5). At follow-up (4.5 months) (n = 217), a statistically significant shift towards desired behaviours was reported for alcohol consumption (z = -2.6045, p = 0.00932), preconception supplementation (z = -2.7288, p = 0.00634) and frequent weight monitoring (z = -5.2911, p < 0.00001). An insignificant shift towards adherence to cervical cancer screening (z = -1.8679, p = 0.06148) was observed, with a positive trend towards adherence. Results indicate that women who are actively planning a pregnancy require support to optimise health and lifestyle in preparation for pregnancy and general health and lifestyle improvement. Women demonstrated improvement in lifestyle behaviours and self-monitoring, indicating the uptake of low-intensity, non-prescriptive information provision. Supporting the provision of knowledge-enhancing tools and general healthy lifestyle information combines with skilled health coaching as an effective method for behaviour change and self-management. OptimalMe also shows significant improvements in rates of healthcare engagement, which suggests coaching-based digital health interventions may decrease women's barriers for preconception care and improve engagement in clinical settings.

Implementation and effectiveness of a school-based intervention to increase adherence to national school meal guidelines: a non-randomised controlled trial

OBJECTIVE

Implementation of school meal guidelines is often inadequate, and evidence for effective implementation strategies for school-based nutrition interventions is limited. The aim of the present study was to examine the implementation and effectiveness of a multi-strategy implementation intervention to increase adherence to the Norwegian national school meal guideline.

DESIGN

The study was a school-based hybrid implementation effectiveness trial with a pre-post non-equivalent control group design, testing three implementation strategies: internal facilitation, training and an educational meeting.

SETTING

Primary schools and after-school services in two counties in south-east Norway.

PARTICIPANTS

School principals, after-school leaders and class teachers from thirty-three schools in the intervention county and principals and after-school leaders from thirty-four schools in a comparison county.

RESULTS

There was a significant difference of 4 percentage points in change scores between the intervention and the comparison groups at follow-up, after adjusting for baseline adherence (B = 0·04, seB = 0·01, t = 3·10, P = 0·003). The intervention effect was not associated with the school's socio-economic profile. School-level fidelity was the implementation dimension that was most strongly correlated (r s = 0·48) with the change scores in the intervention group, indicating that principals' support is important for gaining the largest intervention effects.

CONCLUSIONS

A school-based intervention with low intensity, based on trained teachers as internal facilitators, can increase adherence to the national school meal guideline among Norwegian primary schools, irrespective of local socio-economic conditions. Implementation fidelity, at an organisational level, may be a useful predictor for intervention outcomes in schools.

The IDEAL framework for surgical robotics: development, comparative evaluation and long-term monitoring

The next generation of surgical robotics is poised to disrupt healthcare systems worldwide, requiring new frameworks for evaluation. However, evaluation during a surgical robot's development is challenging due to their complex evolving nature, potential for wider system disruption and integration with complementary technologies like artificial intelligence. Comparative clinical studies require attention to intervention context, learning curves and standardized outcomes. Long-term monitoring needs to transition toward collaborative, transparent and inclusive consortiums for real-world data collection. Here, the Idea, Development, Exploration, Assessment and Long-term monitoring (IDEAL) Robotics Colloquium proposes recommendations for evaluation during development, comparative study and clinical monitoring of surgical robots-providing practical recommendations for developers, clinicians, patients and healthcare systems. Multiple perspectives are considered, including economics, surgical training, human factors, ethics, patient perspectives and sustainability. Further work is needed on standardized metrics, health economic assessment models and global applicability of recommendations.

Designing complex interventions: A description of the development of an intervention to reduce inequalities in planned dental visiting

There are multifaceted reasons for a social gradient in planned dental visiting involving various psycho-social variables that interact with each other and the environment. Interventions in this area are therefore inevitably complex interventions. While guidance recommends undertaking theory and modelling work before experimental work is done, there is a shortage of descriptions of how this is done, especially in the field of oral health.

OBJECTIVES

To describe theory, qualitative and public engagement work, and identification of behaviour change techniques (BCTs) to define features of an opportunistic dental visiting intervention for adult users of urgent dental care services.

METHODS

A systematic review and synthesis of theory, qualitative and quantitative work, along with expert input, generated a list of psycho-social determinants linked to planned dental visiting intentions. Modelling involved ethnographic work in urgent dental care settings and work with members of the community from the targeted demographic. This enabled verification, in the context of their idiosyncratic expression for the target population in question, of behavioural determinants (BDs) identified in the theory phase. It also facilitated generating intervention material which was infused with the identity of the end user. BDs identified were then mapped to BCTs using an accepted BCT taxonomy and an intervention prototype developed. The prototype then underwent iterative testing with target users before it was ready for a feasibility trial.

RESULTS

Theory and modelling identified five key intervention focuses: affordable resources (time/ cost), the importance of oral health, trust in dentists, embarrassment of having poor oral health and dental anxiety. Short videos were developed to incorporate role modelling which were well received. Prototype testing resulted in shifting from 'if-then' plans to action planning.

CONCLUSIONS

Complex intervention development involves an iterative rather than sequential process of combining theory, empirical work and user involvement, of which the article provides an example.

Revisiting systematic reviews on deprescribing trials to better inform future practice and research

Deprescribing aims to address the problem of medication overuse in older adults. There has been an increasing number of systematic reviews of 'deprescribing'. We aimed to describe the categories of trials included in recent systematic reviews, and to make recommendations for future research. We categorized 122 trials included in eight recent deprescribing systematic reviews into: discontinuation, deprescribing implementation, medication optimisation (including medication initiation) and non-initiation trials. We identified heterogeneity and inconsistency in the categories of trials included in deprescribing systematic reviews. For example, 39 trials (32.0%) involved medication initiation in addition to the deprescribing component. It is now time for international researchers to develop and validate terminology used for trials involving discontinuation/deprescribing of medications, and to provide recommendations for evidence synthesis that will better inform future research, and translation into practice and policy.

App-Supported Lifestyle Interventions in Pregnancy to Manage Gestational Weight Gain and Prevent Gestational Diabetes: Scoping Review

BACKGROUND

Excessive gestational weight gain (GWG) and gestational diabetes mellitus (GDM) are common pregnancy complications that have been shown to be preventable through the use of lifestyle interventions. However, a significant gap exists between research on pregnancy lifestyle interventions and translation into clinical practice. App-supported interventions might aid in overcoming previous implementation barriers. The current status in this emerging research area is unknown.

OBJECTIVE

This scoping review aims to provide a comprehensive overview of planned, ongoing, and completed studies on eHealth and mobile health (mHealth) app-supported lifestyle interventions in pregnancy to manage GWG and prevent GDM. The review assesses the scope of the literature in the field; describes the population, intervention, control, outcomes, and study design (PICOS) characteristics of included studies as well as the findings on GWG and GDM outcomes; and examines app functionalities.

METHODS

The scoping review was conducted according to a preregistered protocol and followed established frameworks. Four electronic databases and 2 clinical trial registers were systematically searched. All randomized and quasi-randomized controlled trials (RCTs) of app-supported lifestyle interventions in pregnancy and related qualitative and quantitative research across the different study phases were considered for inclusion. Eligible studies and reports of studies were included until June 2022. Extracted data were compiled in descriptive analyses and reported in narrative, tabular, and graphical formats.

RESULTS

This review included 97 reports from 43 lifestyle intervention studies. The number of published reports has steadily increased in recent years; of the 97 included reports, 38 (39%) were trial register entries. Of the 39 identified RCTs, 10 efficacy or effectiveness trials and 8 pilot trials had published results on GWG (18/39, 46%); of these 18 trials, 7 (39%) trials observed significant intervention effects on GWG outcomes. Of all 39 RCTs, 5 (13%) efficacy or effectiveness trials reported GDM results, but none observed significant intervention effects on GDM. The RCTs included in the review were heterogeneous in terms of their PICOS characteristics. Most of the RCTs were conducted in high-income countries, included women with overweight or obesity and from all BMI categories, delivered multicomponent interventions, delivered interventions during pregnancy only, and focused on diet and physical activity. The apps used in the studies were mostly mHealth apps that included features for self-monitoring, feedback, goal setting, prompts, and educational content. Self-monitoring was often supported by wearable activity monitors and Bluetooth-connected weight scales.

CONCLUSIONS

Research in this field is nascent, and the effectiveness and implementability of app-supported interventions have yet to be determined. The complexity and heterogeneity of intervention approaches pose challenges in identifying the most beneficial app features and intervention components and call for consistent and comprehensive intervention and outcome reporting.

Implementation of digital health interventions in rehabilitation: A scoping review

OBJECTIVE

Digital health interventions have potential to enhance rehabilitation services by increasing accessibility, affordability and scalability. However, implementation of digital interventions in rehabilitation is poorly understood. This scoping review aims to map current strategies, research designs, frameworks, outcomes and determinants used to support and evaluate the implementation of digital interventions in rehabilitation.

DATA SOURCES

Comprehensive searches from inception until October 2022 of MEDLINE, CINAHL, PsycINFO, PEDro, SpeechBITE, NeuroBITE, REHABDATA, WHO International Clinical Trial Registry and the Cochrane Library.

METHODS

Two reviewers screened studies against the eligibility criteria. Implementation science taxonomies and methods, including Powell et al.'s compilation of implementation strategies, were used to guide analysis and synthesis of findings.

RESULTS

The search retrieved 13,833 papers and 23 studies were included. Only 4 studies were randomised controlled trials and 9 studies (39%) were feasibility studies. Thirty-seven discrete implementation strategies were reported across studies. Strategies related to training and educating clinicians (91%), providing interactive assistance (61%), and developing stakeholder interrelationships (43%) were most frequently reported. Few studies adequately described implementation strategies and methods for selecting strategies. Almost all studies measured implementation outcomes and determinants; most commonly, acceptability, compatibility and dose delivered of digital interventions.

CONCLUSION

The rigour of implementation methods in the field is currently poor. Digital interventions require carefully planned and tailored implementation to facilitate successful adoption into rehabilitation practice. To keep pace with rapidly advancing technology, future rehabilitation research should prioritise using implementation science methods to explore and evaluate implementation while testing effectiveness of digital interventions.

Key considerations for designing, conducting and analysing a cluster randomized trial

Not only do cluster randomized trials require a larger sample size than individually randomized trials, they also face many additional complexities. The potential for contamination is the most commonly used justification for using cluster randomization, but the risk of contamination should be carefully weighed against the more serious problem of questionable scientific validity in settings with post-randomization identification or recruitment of participants unblinded to the treatment allocation. In this paper we provide some simple guidelines to help researchers conduct cluster trials in a way that minimizes potential biases and maximizes statistical efficiency. The overarching theme of this guidance is that methods that apply to individually randomized trials rarely apply to cluster randomized trials. We recommend that cluster randomization be only used when necessary-balancing the benefits of cluster randomization with its increased risks of bias and increased sample size. Researchers should also randomize at the lowest possible level-balancing the risks of contamination with ensuring an adequate number of randomization units-as well as exploring other options for statistically efficient designs. Clustering should always be allowed for in the sample size calculation; and the use of restricted randomization (and adjustment in the analysis for covariates used in the randomization) should be considered. Where possible, participants should be recruited before randomizing clusters and, when recruiting (or identifying) participants post-randomization, recruiters should be masked to the allocation. In the analysis, the target of inference should align with the research question, and adjustment for clustering and small sample corrections should be used when the trial includes less than about 40 clusters.

Use of routine healthcare data in randomised implementation trials: a methodological mixed-methods systematic review

BACKGROUND

Routine data are increasingly used in randomised controlled trials evaluating healthcare interventions. They can aid participant identification, outcome assessment, and intervention delivery. Randomised implementation trials evaluate the effect of implementation strategies on implementation outcomes. Implementation strategies, such as reminders, are used to increase the uptake of evidence-based interventions into practice, while implementation outcomes, such as adoption, are key measures of the implementation process. The use of routine data in effectiveness trials has been explored; however, there are no reviews on implementation trials. We therefore aimed to describe how routine data have been used in randomised implementation trials and the design characteristics of these trials.

METHODS

We searched MEDLINE (Ovid) and Cochrane Central Register of Controlled Trials from Jan 2000 to Dec 2021 and manually searched protocols from trial registers. We included implementation trials and type II and type III hybrid effectiveness-implementation trials conducted using routine data. We extracted quantitative and qualitative data and narratively synthesised findings.

RESULTS

From 4206 titles, we included 80 trials, of which 22.5% targeted implementation of evidence-based clinical guidelines. Multicomponent implementation strategies were more commonly evaluated (70.0%) than single strategies. Most trials assessed adoption as the primary outcome (65.0%). The majority of trials extracted data from electronic health records (EHRs) (62.5%), and 91.3% used routine data for outcome ascertainment. Reported reasons for using routine data were increasing efficiency, assessing outcomes, reducing research burden, improving quality of care, identifying study samples, confirming findings, and assessing representativeness. Data quality, the EHR system, research governance, and external factors such as government policy could act either as facilitators or barriers.

CONCLUSIONS

Adherence to guidance on designing and reporting implementation studies, and specifically to harmonise the language used in describing implementation strategies and implementation outcomes, would aid identification of studies and data extraction. Routine healthcare data are widely used for participant identification, outcome assessment and intervention delivery. Researchers should familiarise themselves with the barriers and facilitators to using routine data, and efforts could be made to improve data quality to overcome some of the barriers.

REGISTRATION

PROSPERO CRD42022292321.

Factors influencing the quality of acupuncture clinical trials: a qualitative interview of stakeholders

OBJECTIVE

To investigate the influencing factors on the quality of acupuncture clinical trials from the stakeholders, and to provide references for improving the quality of acupuncture clinical trials.

METHODS

A qualitative study based on semi-structured interviews was performed. Experts, acupuncturists, editors, and patients were interviewed. The interview results were thematically analyzed from transcribed audio recordings.

RESULTS

A total of 38 stakeholders were interviewed, including 12 experts, 14 acupuncturists, 2 editors, and 10 patients. There were 25 tree nodes and 106 sub-nodes, with 1141 reference points. The key factors influencing the quality of acupuncture clinical trials could be divided into five core theme frameworks: a) trial design, b) trial conduction, c) research results reporting and publication, d) research evidence dissemination, and e) research evidence transformation and application.

CONCLUSIONS

The results reveal that to improve the quality of acupuncture trials, it should consider each step of trial design, trial conduction, research results reporting and publication, research evidence dissemination, and research evidence transformation and application. A guideline for quality control of the whole process of acupuncture clinical trials is needed.

Perspective on salutogenic approaches to persistent pain with a focus on mindfulness interventions

In this article, we provide a unique perspective on the use of mindfulness interventions in a whole health framework embedded within the theory of salutogenesis and the concept of painogenic environments. We argue that mindfulness is a valuable tool to bridge exploration of inner experiences of bodily pain with socio-ecological influences on thoughts and emotions. We outline research from neuroimaging studies that mindfulness techniques mediate neural processing and neuroplastic changes that alleviate pain and related symptoms. We also review evidence examining behavioural changes associated with mindfulness meditation providing evidence that it promotes self-regulatory activity, including the regulation and control of emotion and catalysation of health behaviour changes; both of which are important in chronic illness. Our viewpoint is that mindfulness could be a core element of salutogenic approaches to promote health and well-being for people living with pain because it rebuilds a fractured sense of cohesion. Mindfulness empowers people in pain to embrace their existence; shifting the focus away from pain and giving their lives meaning. We propose that integrating mindfulness into activities of daily living and individual or community-based activities will promote living well in the modern world, with or without pain; thus, promoting individual potential for fulfilment. Future research should consider the effects of mindfulness on people with pain in real-life settings, considering social, environmental, and economic factors using a broader set of outcomes, including self-efficacy, sense of coherence and quality of life.

What is the role of randomised trials in implementation science?

BACKGROUND

There is a consistent demand for implementation science to inform global efforts to close the gap between evidence and practice. Key evaluation questions for any given implementation strategy concern the assessment and understanding of effects. Randomised trials are generally accepted as offering the most trustworthy design for establishing effectiveness but may be underused in implementation science.

MAIN BODY

There is a continuing debate about the primacy of the place of randomised trials in evaluating implementation strategies, especially given the evolution of more rigorous quasi-experimental designs. Further critiques of trials for implementation science highlight that they cannot provide 'real world' evidence, address urgent and important questions, explain complex interventions nor understand contextual influences. We respond to these critiques of trials and highlight opportunities to enhance their timeliness and relevance through innovative designs, embedding within large-scale improvement programmes and harnessing routine data. Our suggestions for optimising the conditions for randomised trials of implementation strategies include strengthening partnerships with policy-makers and clinical leaders to realise the long-term value of rigorous evaluation and accelerating ethical approvals and decluttering governance procedures for lower risk studies.

CONCLUSION

Policy-makers and researchers should avoid prematurely discarding trial designs when evaluating implementation strategies and work to enhance the conditions for their conduct.

Ten years of implementation outcomes research: a scoping review

BACKGROUND

Proctor and colleagues' 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field's progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes.

METHODS

Arksey and O'Malley's framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome).

RESULTS

Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health.

CONCLUSIONS

Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research.

Connecting the science and practice of implementation - applying the lens of context to inform study design in implementation research

The saying "horses for courses" refers to the idea that different people and things possess different skills or qualities that are appropriate in different situations. In this paper, we apply the analogy of "horses for courses" to stimulate a debate about how and why we need to get better at selecting appropriate implementation research methods that take account of the context in which implementation occurs. To ensure that implementation research achieves its intended purpose of enhancing the uptake of research-informed evidence in policy and practice, we start from a position that implementation research should be explicitly connected to implementation practice. Building on our collective experience as implementation researchers, implementation practitioners (users of implementation research), implementation facilitators and implementation educators and subsequent deliberations with an international, inter-disciplinary group involved in practising and studying implementation, we present a discussion paper with practical suggestions that aim to inform more practice-relevant implementation research.

Implementation of electronic prospective surveillance models in cancer care: a scoping review

BACKGROUND

Electronic prospective surveillance models (ePSMs) for cancer rehabilitation include routine monitoring of the development of treatment toxicities and impairments via electronic patient-reported outcomes. Implementing ePSMs to address the knowledge-to-practice gap between the high incidence of impairments and low uptake of rehabilitation services is a top priority in cancer care.

METHODS

We conducted a scoping review to understand the state of the evidence concerning the implementation of ePSMs in oncology. Seven electronic databases were searched from inception to February 2021. All articles were screened and extracted by two independent reviewers. Data regarding the implementation strategies, outcomes, and determinants were extracted. The Expert Recommendations for Implementing Change taxonomy and the implementation outcomes taxonomy guided the synthesis of the implementation strategies and outcomes, respectively. The Consolidated Framework for Implementation Research guided the synthesis of determinants based on five domains (intervention characteristics, individual characteristics, inner setting, outer setting, and process).

RESULTS

Of the 5122 records identified, 46 interventions met inclusion criteria. The common implementation strategies employed were "conduct educational meetings," "distribute educational materials," "change record systems," and "intervene with patients to enhance uptake and adherence." Feasibility and acceptability were the prominent outcomes used to assess implementation. The complexity, relative advantage, design quality, and packaging were major implementation determinants at the intervention level. Knowledge was key at the individual level. At the inner setting level, major determinants were the implementation climate and readiness for implementation. At the outer setting level, meeting the needs of patients was the primary determinant. Engaging various stakeholders was key at the process level.

CONCLUSIONS

This review provides a comprehensive summary of what is known concerning the implementation of ePSMs. The results can inform future implementation and evaluation of ePSMs, including planning for key determinants, selecting implementation strategies, and considering outcomes alongside local contextual factors to guide the implementation process.

Implementing digital devices to increase mobility training for people receiving inpatient rehabilitation: protocol for a feasibility hybrid type II randomized controlled trial

BACKGROUND

People with mobility limitations can benefit from rehabilitation programs incorporating intensive, repetitive, and task-specific exercises using digital devices such as virtual reality gaming systems, tablet and smartphone applications, and wearable devices. The Activity and MObility UsiNg Technology (AMOUNT) rehabilitation trial (n = 300) showed improvements in mobility in people using these types of digital devices in addition to their usual rehabilitation care when the intervention was provided by an additional study-funded physiotherapist. However, it is not clear if this intervention can be implemented by hospital physiotherapists with a usual clinical load. The AMOUNT Implementation trial aims to explore the feasibility of conducting a large-scale implementation trial.

METHODS

A pragmatic, assessor blinded, feasibility hybrid type II randomized controlled trial will be undertaken at a public hospital in Australia. There will be two phases. Phase I (Implementation phase) will involve implementing the digital devices into physiotherapy practice. Physiotherapists from the rehabilitation ward will receive a multifaceted implementation strategy guided by the Capabilities, Opportunities, Motivation-Behaviour (COM-B) theoretical model. The implementation strategy includes identifying and training a clinical champion; providing digital devices and education and training; facilitating use of the devices through clinical reasoning sessions and journal clubs; and audit and feedback of exercise dosage documentation. Phase II (Trial phase) will involve randomising 30 eligible inpatients from the same ward into either usual care or usual care plus an additional 30 min or more of exercises using digital devices. This intervention will be provided by the physiotherapists who took part in the implementation phase. We will collect data on feasibility, implementation, and patient-level clinical outcomes. The three primary outcome measures are the extent to which physiotherapists document the dosage of exercises provided to participants (feasibility criteria: exercise practice sheets complete for ≥85% of all participants); ability to recruit participants; and fidelity to the protocol of using digital devices to prescribe exercises (feasibility criteria: average of ≥ 30mins per day for > 50% intervention participants).

DISCUSSION

This feasibility study will provide important information to guide the planning and conduct of a future large-scale implementation trial.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trial Registry; ACTRN12621000938808; registered 19/07/2021. Trial sponsor: Prince of Wales Hospital. 320-346 Barker Street, Randwick, NSW, 2031, Australia.

PROTOCOL VERSION

6.2 7th April 2021.

Implementation of an online pain science education for chronic musculoskeletal pain in Brazilian public health system: protocol for a hybrid type III randomised controlled trial with economic evaluation

BACKGROUND

Although clinical practice guidelines recommend pain education as the first-line option for the management of chronic musculoskeletal pain, there is a lack of pain education programmes in healthcare. Thus, digital health programmes can be an effective tool for implementing pain education strategies for public health. This trial will aim to analyse the implementation and effectiveness outcomes of three online pain science education strategies in the Brazilian public health system (SUS) for individuals with chronic musculoskeletal pain.

METHODS

We will conduct a hybrid type III effectiveness-implementation randomised controlled trial with economic evaluation. We will include adult individuals with chronic musculoskeletal pain, recruited from primary healthcare in the city of Guarapuava, Brazil. Individuals will be randomised to three implementation groups receiving a pain science education intervention (EducaDor) but delivered in different modalities: group 1) synchronous online; group 2) asynchronous videos; and group 3) interactive e-book only. Implementation outcomes will include acceptability, appropriateness, feasibility, adoption, fidelity, penetration, sustainability, and costs. We will also assess effectiveness outcomes, such as pain, function, quality of life, sleep, self-efficacy, and adverse effects. Cost-effectiveness and cost-utility analyses will be conducted from the SUS and societal perspectives. The evaluations will be done at baseline, post-intervention (10 weeks), and 6 months.

DISCUSSION

This study will develop and implement a collaborative intervention model involving primary healthcare professionals, secondary-level healthcare providers, and patients to enhance self-management of chronic pain. In addition to promoting better pain management, this study will also contribute to the field of implementation science in public health by generating important insights and recommendations for future interventions.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT05302180; 03/29/2022).

Incomplete reporting of complex interventions: a call to action for journal editors to review their submission guidelines

Reporting of intervention research has been inadequate for many years. The development and promotion of freely available checklists aims to address this problem by providing researchers with a list of items that require reporting to enable study interpretation and replication. In this commentary, we present evidence from a recent systematic review of 51 randomised controlled trials published 2015-2020 that inadequate intervention reporting remains a widespread issue and that checklists are not being used to describe all intervention components. In 2022, we assessed the submission guidelines of 33 journals that published articles included in our review and found that just one at the time encouraged the use of reporting checklists for all intervention components. To drive progress, we contacted the editors of the other 32 journals and requested that they update their submission guidelines in response. We conclude by highlighting the waste associated with current practices and encourage journals from all fields to urgently review their submission guidelines. Only through collective action can we build an evidence base that is fit for purpose.

Interventions to Modify Psychological Well-Being: Progress, Promises, and an Agenda for Future Research

Psychological well-being, characterized by feelings, cognitions, and strategies that are associated with positive functioning (including hedonic and eudaimonic well-being), has been linked with better physical health and greater longevity. Importantly, psychological well-being can be strengthened with interventions, providing a strategy for improving population health. But are the effects of well-being interventions meaningful, durable, and scalable enough to improve health at a population-level? To assess this possibility, a cross-disciplinary group of scholars convened to review current knowledge and develop a research agenda. Here we summarize and build on the key insights from this convening, which were: (1) existing interventions should continue to be adapted to achieve a large-enough effect to result in downstream improvements in psychological functioning and health, (2) research should determine the durability of interventions needed to drive population-level and lasting changes, (3) a shift from individual-level care and treatment to a public-health model of population-level prevention is needed and will require new infrastructure that can deliver interventions at scale, (4) interventions should be accessible and effective in racially, ethnically, and geographically diverse samples. A discussion examining the key future research questions follows.

What works to recruit general practices to trials? A rapid review

Background: Recruitment challenges are a barrier to the conduct of trials in general practice, yet little is known about which recruitment strategies work best to recruit practices for randomised controlled trials (RCTs). We aimed to describe the types of strategies used to recruit general practices for trials and synthesize any available evidence of effectiveness. Methods: We conducted a rapid evidence review in line with guidance from Tricco et al. Eligible studies reported or evaluated any strategy to improve practice recruitment to participate in clinical or implementation RCTs. PubMed, Embase, and Cochrane Central Library were searched from inception to June 22 nd, 2021. Reference lists of included studies were screened. Data were synthesized narratively. Results: Over 9,162 articles were identified, and 19 studies included. Most (n=13, 66.7%) used a single recruitment strategy. The most common strategies were: in-person practice meetings/visits by the research team (n=12, 63.2%); phone calls (n=10, 52.6%); financial incentives (n=9, 47.4%); personalised emails (n=7, 36.8%) or letters (n=6, 52.6%) (as opposed to email 'blasts' or generic letters); targeting practices that participated in previous studies or with which the team had existing links (n=6, 31.6%) or targeting of practices within an existing practice or research network (n=6, 31.6%).  Three studies reporting recruitment rates >80%, used strategies such as invitation letters with a follow-up phone call to non-responders, presentations by the principal investigator and study coordinator, or in-person meetings with practices with an existing affiliation with the University or research team.  Conclusions: Few studies directly compared recruitment approaches making it difficult to draw conclusions about their comparative effectiveness. However, the role of more personalised letter/email, in-person, or phone contact, and capitalising on existing relationships appears important. Further work is needed to standardise how recruitment methods are reported and to directly compare different recruitment strategies within one study . PROSPERO registration: CRD42021268140 (15/08/2021).