Stepped-wedge cluster-randomised trials: level of evidence, feasibility and reporting

Population-based interventions for preventing falls and fall-related injuries in older people

BACKGROUND

Around one-third of older adults aged 65 years or older who live in the community fall each year. Interventions to prevent falls can be designed to target the whole community, rather than selected individuals. These population-level interventions may be facilitated by different healthcare, social care, and community-level agencies. They aim to tackle the determinants that lead to risk of falling in older people, and include components such as community-wide polices for vitamin D supplementation for older adults, reducing fall hazards in the community or people's homes, or providing public health information or implementation of public health programmes that reduce fall risk (e.g. low-cost or free gym membership for older adults to encourage increased physical activity).

OBJECTIVES

To review and synthesise the current evidence on the effects of population-based interventions for preventing falls and fall-related injuries in older people. We defined population-based interventions as community-wide initiatives to change the underlying societal, cultural, or environmental conditions increasing the risk of falling.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, three other databases, and two trials registers in December 2020, and conducted a top-up search of CENTRAL, MEDLINE, and Embase in January 2023.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), cluster RCTs, trials with stepped-wedge designs, and controlled non-randomised studies evaluating population-level interventions for preventing falls and fall-related injuries in adults ≥ 60 years of age. Population-based interventions target entire communities. We excluded studies only targeting people at high risk of falling or with specific comorbidities, or residents living in institutionalised settings.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane, and used GRADE to assess the certainty of the evidence. We prioritised seven outcomes: rate of falls, number of fallers, number of people experiencing one or more fall-related injuries, number of people experiencing one or more fall-related fracture, number of people requiring hospital admission for one or more falls, adverse events, and economic analysis of interventions. Other outcomes of interest were: number of people experiencing one or more falls requiring medical attention, health-related quality of life, fall-related mortality, and concerns about falling.

MAIN RESULTS

We included nine studies: two cluster RCTs and seven non-randomised trials (of which five were controlled before-and-after studies (CBAs), and two were controlled interrupted time series (CITS)). The numbers of older adults in intervention and control regions ranged from 1200 to 137,000 older residents in seven studies. The other two studies reported only total population size rather than numbers of older adults (67,300 and 172,500 residents). Most studies used hospital record systems to collect outcome data, but three only used questionnaire data in a random sample of residents; one study used both methods of data collection. The studies lasted between 14 months and eight years. We used Prevention of Falls Network Europe (ProFaNE) taxonomy to classify the types of interventions. All studies evaluated multicomponent falls prevention interventions. One study (n = 4542) also included a medication and nutrition intervention. We did not pool data owing to lack of consistency in study designs. Medication or nutrition Older people in the intervention area were offered free-of-charge daily supplements of calcium carbonate and vitamin D3. Although female residents exposed to this falls prevention programme had fewer fall-related hospital admissions (with no evidence of a difference for male residents) compared to a control area, we were unsure of this finding because the certainty of evidence was very low. This cluster RCT included high and unclear risks of bias in several domains, and we could not determine levels of imprecision in the effect estimate reported by study authors. Because this evidence is of very low certainty, we have not included quantitative results here. This study reported none of our other review outcomes. Multicomponent interventions Types of interventions included components of exercise, environment modification (home; community; public spaces), staff training, and knowledge and education. Studies included some or all of these components in their programme design. The effectiveness of multicomponent falls prevention interventions for all reported outcomes is uncertain. The two cluster RCTs included high or unclear risk of bias, and we had no reasons to upgrade the certainty of evidence from the non-randomised trial designs (which started as low-certainty evidence). We also noted possible imprecision in some effect estimates and inconsistent findings between studies. Given the very low-certainty evidence for all outcomes, we have not reported quantitative findings here. One cluster RCT reported lower rates of falls in the intervention area than the control area, with fewer people in the intervention area having one or more falls and fall-related injuries, but with little or no difference in the number of people having one or more fall-related fractures. In another cluster RCT (a multi-arm study), study authors reported no evidence of a difference in the number of female or male residents with falls leading to hospital admission after either a multicomponent intervention ("environmental and health programme") or a combination of this programme and the calcium and vitamin D3 programme (above). One CBA reported no difference in rate of falls between intervention and control group areas, and another CBA reported no difference in rate of falls inside or outside the home. Two CBAs found no evidence of a difference in the number of fallers, and another CBA found no evidence of a difference in fall-related injuries. One CITS found no evidence of a difference in the number of people having one or more fall-related fractures. No studies reported adverse events.

AUTHORS' CONCLUSIONS

Given the very low-certainty evidence, we are unsure whether population-based multicomponent or nutrition and medication interventions are effective at reducing falls and fall-related injuries in older adults. Methodologically robust cluster RCTs with sufficiently large communities and numbers of clusters are needed. Establishing a rate of sampling for population-based studies would help in determining the size of communities to include. Interventions should be described in detail to allow investigation of effectiveness of individual components of multicomponent interventions; using the ProFaNE taxonomy for this would improve consistency between studies.

A Multi-component Intervention (NEXpro) Reduces Neck Pain-Related Work Productivity Loss: A Randomized Controlled Trial Among Swiss Office Workers

Purpose Neck pain is common among office workers and leads to work productivity loss. This study aimed to investigate the effect of a multi-component intervention on neck pain-related work productivity loss among Swiss office workers. Methods Office workers, aged 18-65 years, and without serious neck-related health problems were recruited from two organisations for our stepped-wedge cluster randomized controlled trial. The 12-week multi-component intervention included neck exercises, health-promotion information, and workplace ergonomics. The primary outcome of neck pain-related work productivity loss was measured using the Work Productivity and Activity Impairment Questionnaire and expressed as percentages of working time. In addition, we reported the weekly monetary value of neck pain-related work productivity loss. Data was analysed on an intention-to-treat basis using a generalized linear mixed-effects model. Results Data from 120 participants were analysed with 517 observations. At baseline, the mean age was 43.7 years (SD 9.8 years), 71.7% of participants were female (N = 86), about 80% (N = 95) reported mild to moderate neck pain, and neck pain-related work productivity loss was 12% of working time (absenteeism: 1.2%, presenteeism: 10.8%). We found an effect of our multi-component intervention on neck pain-related work productivity loss, with a marginal predicted mean reduction of 2.8 percentage points (b = -0.27; 95% CI: -0.54 to -0.001, p = 0.049). Weekly saved costs were Swiss Francs 27.40 per participant. Conclusions: Our study provides evidence for the effectiveness of a multi-component intervention to reduce neck pain-related work productivity loss with implications for employers, employees, and policy makers.Trial Registration ClinicalTrials.gov, NCT04169646. Registered 15 November 2019-Retrospectively registered, https://clinicaltrials.gov/ct2/show/NCT04169646 .

The MOHMQuit (Midwives and Obstetricians Helping Mothers to Quit Smoking) Trial: protocol for a stepped-wedge implementation trial to improve best practice smoking cessation support in public antenatal care services

BACKGROUND

Smoking during pregnancy is the most important preventable cause of adverse pregnancy outcomes, yet smoking cessation support (SCS) is inconsistently provided. The MOMHQUIT intervention was developed to address this evidence-practice gap, using the Behaviour Change Wheel method by mapping barriers to intervention strategies. MOHMQuit includes systems, leadership and clinician elements. This implementation trial will determine the effectiveness and cost-effectiveness of MOHMQuit in improving smoking cessation rates in pregnant women in public maternity care services in Australia; test the mechanisms of action of the intervention strategies; and examine implementation outcomes.

METHODS

A stepped-wedge cluster-randomised design will be used. Implementation of MOHMQuit will include reinforcing leadership investment in SCS as a clinical priority, strengthening maternity care clinicians' knowledge, skills, confidence and attitudes towards the provision of SCS, and clinicians' documentation of guideline-recommended SCS provided during antenatal care. Approximately, 4000 women who report smoking during pregnancy will be recruited across nine sites. The intervention and its implementation will be evaluated using a mixed methods approach. The primary outcome will be 7-day point prevalence abstinence at the end of pregnancy, among pregnant smokers, verified by salivary cotinine testing. Continuous data collection from electronic medical records and telephone interviews with postpartum women will occur throughout 32 months of the trial to assess changes in cessation rates reported by women, and SCS documented by clinicians and reported by women. Data collection to assess changes in clinicians' knowledge, skills, confidence and attitudes will occur prior to and immediately after the intervention at each site, and again 6 months later. Questionnaires at 3 months following the intervention, and semi-structured interviews at 6 months with maternity service leaders will explore leaders' perceptions of acceptability, adoption, appropriateness, feasibility, adaptations and fidelity of delivery of the MOHMQuit intervention. Structural equation modelling will examine causal linkages between the strategies, mediators and outcomes. Cost-effectiveness analyses will also be undertaken.

DISCUSSION

This study will provide evidence of the effectiveness of a multi-level implementation intervention to support policy decisions; and evidence regarding mechanisms of action of the intervention strategies (how the strategies effected outcomes) to support further theoretical developments in implementation science.

TRIAL REGISTRATION

ACTRN12622000167763, registered February 2nd 2022.

Reducing malaria transmission in forest-going mobile and migrant populations in Lao PDR and Cambodia: protocol for stepped-wedge cluster-randomised controlled trial

Background

Countries of the Greater Mekong Sub-region aim to achieve malaria elimination by 2030. In the region, malaria is concentrated in high-risk areas and populations such as forest-going mobile and migrant populations (MMPs). However, routine protective measures such as long-lasting insecticidal nets do not prevent all infectious bites in these high-risk populations. Evidence for the effectiveness of a personal protection package tailored to forest-going MMPs which is acceptable, feasible, and cost-effective for reducing malaria transmission is required to inform the malaria elimination toolkit in the region.

Methods

A personal protection package consisting of long-lasting insecticidal hammock net, insect repellent and health communication pamphlet was developed in consultation with relevant implementing partners from Cambodia and Lao PDR. An open stepped-wedge cluster-randomised controlled trial will be conducted over a period of 12 months in a minimum of 488 villages (~ 428 in Lao PDR and ~ 60 in Cambodia) to evaluate the effectiveness of the personal protection package. Villages will be randomised into 11 blocks, with blocks transitioned in random order from control to intervention states at monthly intervals, following a 1-month baseline period. The primary outcome of the trial is the prevalence of Plasmodium spp. infection diagnosed by rapid diagnostic test. Difference in prevalence of malaria infection will be estimated across intervention and control periods using generalized linear mixed modelling. Nested within the stepped-wedge cluster-randomised controlled trial is a mixed-methods study to explore the acceptability of the personal protection package, feasibility of implementing a personal protection package as a vector control intervention, and knowledge, attitude and practice of MMPs regarding malaria prevention; and cost-analysis to determine the cost-effectiveness of implementing a personal protection package.

Discussion

This study, using a rigorous design and mixed-methods methodology, will evaluate whether a personal protection package can reduce residual malaria transmission among forest-going MMPs in Cambodia and Lao PDR. It will also measure implementation research outcomes such as effectiveness of the intervention package, cost-effectiveness, acceptability, and feasibility, in order to inform potential national and regional policy.

Trial registration This trial was prospectively registered on ClinicalTrials.gov (NCT05117567) on 11th November 2021

Supplementary Information

The online version contains supplementary material available at 10.1186/s12879-022-07724-5.

Disinvestment in the presence of uncertainty: Description of a novel, multi-group, disinvestment trial design and protocol for an application to reduce or cease use of mobilisation alarms for preventing falls in hospitals

Disinvestment is the removal or reduction of previously provided practices or services, and has typically been undertaken where a practice or service has been clearly shown to be ineffective, inefficient and/or harmful. However, practices and services that have uncertain evidence of effectiveness, efficiency and safety can also be considered as candidates for disinvestment. Disinvestment from these practices and services is risky as they may yet prove to be beneficial if further evidence becomes available. A novel research approach has previously been described for this situation, allowing disinvestment to take place while simultaneously generating evidence previously missing from consideration. In this paper, we describe how this approach can be expanded to situations where three or more conditions are of relevance, and describe the protocol for a trial examining the reduction and elimination of use of mobilisation alarms on hospital wards to prevent patient falls. Our approach utilises a 3-group, concurrent, non-inferiority, stepped wedge, randomised design with an embedded parallel, cluster randomised design. Eighteen hospital wards with high rates of alarm use (≥3%) will be paired within their health service and randomly allocated to a calendar month when they will transition to a “Reduced” (<3%) or “Eliminated” (0%) mobilisation alarm condition. Dynamic randomisation will be used to determine which ward in each pair will be allocated to either the reduced or eliminated condition to promote equivalence between wards for the embedded parallel, cluster randomised component of the design. A project governance committee will set non-inferiority margins. The primary outcome will be rates of falls. Secondary clinical, process, safety, and economic outcomes will be collected and a concurrent economic evaluation undertaken.

Improving caring quality for people with dementia in nursing homes using IPOS-Dem: A stepped-wedge cluster randomized controlled trial protocol

AIMS

We aim to evaluate the effectiveness of the Integrated Palliative Care Outcome Scale for people with dementia-based case studies to improve the caring quality for people with dementia in nursing homes by frontline staff and family members.

BACKGROUND

Swiss nursing homes mostly care for people with dementia. This population is at high risk of receiving little to no palliation for their complex needs. The majority of Swiss frontline healthcare staff do not systematically report on the needs of their residents. Additionally, family members do not routinely participate in assessment processes.

DESIGN

We will conduct a stepped-wedge cluster randomized trial of repeated assessment using the Integrated Palliative Care Outcome Scale for people with dementia (IPOS-Dem) and subsequent case studies. Clusters will consist of Swiss nursing homes randomly assigned to one of three sequential intervention time points.

METHODS

The study population will consist of people with dementia living in nursing homes with and without specialized dementia care facilities. Over 16 months, staff working at the frontline and family members will assess the needs and concerns of people with dementia using IPOS-Dem. Depending on sequence allocation, facilitated case studies will start after 3, 6 or 9 months. The primary outcome will be caring quality measured by QUALIDEM. The secondary outcome will be symptoms and concerns, as indicated by the IPOS-Dem sum-score. The Zürich Ethics Committee approved the study in 2019 (2019-01847).

IMPACT

The results of this study will contribute to improving the effectiveness of person-centred care for people with dementia. Collaboration between healthcare staff and family members will be systematically developed and built upon thorough assessment using the IPOS-Dem and related case studies. The use of IPOS-Dem will offer all frontline staff a systematic approach to have an independent voice within the nursing process, regardless of their qualification or grade.

An individualized decision aid for physicians and patients for total knee replacement in osteoarthritis (Value-based TKR study): study protocol for a multi-center, stepped wedge, cluster randomized controlled trial

Background

Total knee replacement (TKR) is one of the most commonly performed routine procedures in the world. Prognostic studies indicate that the number of TKR will further increase constituting growing burden on healthcare systems. There is also substantial regional heterogeneity in TKR rates within and between countries. Despite the known therapeutic effects, a subset of patients undergoing TKR does not benefit from the procedure as intended. To improve the appropriateness of TKR indication, the EKIT initiative (“evidence and consensus based indication critera for total arthroplasty”) developed a clinical guideline for Germany on the indication of TKR. This guideline is the basis for a digital medical decision aid (EKIT tool) to facilitate shared decision making (SDM) in order to improve decision quality for elective surgery. The aim of this cluster randomized trial is to investigate the effectiveness of the EKIT tool on decision quality.

Methods

The Value-based TKR study is a prospective pragmatic multi-center, stepped wedge, cluster randomized controlled trial (SW-RCT). The EKIT tool provides (1) a systematic presentation of individual patient and disease-specific information (symptoms, expectations), (2) the fulfillment of the indication criteria and (3) health information about safety and effectiveness of TKR. All study sites will follow routine care as control clusters until the start of the intervention. In total, there will be 10 clusters (study sites) and 6 sequential steps over 16 month, with clusters receiving the intervention with a minimum 2 months of standard routine care. The primary outcome is patients’ decision quality measured with the Decision Quality Instrument (DQI)-Knee Osteoarthritis questionnaire. Furthermore, we will collect information on global patient satisfaction, patient reported outcome measures and the fulfilment of the individual expectations 12 months after SDM. The power calculation yielded an estimated power of 89% using robust Poisson regression under the following assumptions: 10 study sites with a total of N=1,080 patients (including a dropout rate of 11%), a 10% increase in decision quality due to the use of the EKIT tool, and a significance level of 5%.

Discussion

There is a high potential for transferring the intervention into routine practice if the evaluation is positive.

Trial registration

ClinicalTrials.gov: NCT04837053. Registered on 08/04/2021.

Falls risk score removal does not impact inpatient falls: A stepped-wedge, cluster-randomised trial

AIMS AND OBJECTIVES

To investigate the impact of removing a falls risk screening tool from an overall falls risk assessment programme on the rate of falls, injurious falls and completion of falls prevention activities by staff.

BACKGROUND

Falls in older patients are common adverse events in hospital settings. Screening and assessing individual patients for risk of falls are a common, but controversial element of falls prevention strategies in hospitals.

DESIGN

A stepped-wedge, cluster-randomised controlled trial using a disinvestment approach.

METHODS

This trial was carried out according to the Consolidated Standards of Reporting Trials (CONSORT). All patients were admitted to 20 health service wards (9 units) over the 10-month study period. The control condition contained a falls risk screening tool element, a full falls risk factor assessment and intervention provision section. In the intervention condition, only the full falls risk factor assessment and intervention provision section was applied, and the falls risk screening tool element was removed. Fall rates were extracted from hospital level data, files were audited for tool completion, and nurses surveyed about tool use.

RESULTS

There did not appear to be an impact on the falls rate per month when the risk screening tool component was removed (incidence rate ratio (IRR) = 0.84-favours intervention, 95%CI = 0.67 to 1.05, p = .14) nor on the falls rate with serious injury (IRR = 0.90, 95%CI = 0.26 to 3.09, p = .87). There was a thirty-six second reduction of time per patient reported by staff to complete paperwork (p < .001). There was no difference in the proportion of patients for whom the tool was completed, nor the number of falls prevention interventions identified for implementation.

CONCLUSION

Removing the falls risk screening tool section did not negatively impact falls and reduced time spent completing falls prevention paperwork.

RELEVANCE TO CLINICAL PRACTICE

Falls prevention is an important issue in health services. Removal of a screening risk tool is unlikely to impact falls. This has the potential to reduce nursing administration time that may be otherwise redirected to individual approaches to falls prevention.

Scale-up of the Stepping On fall prevention program amongst older adults in NSW: Program reach and fall-related health service use

ISSUE ADDRESSED

We describe the reach of the scale-up of Stepping On, a fall prevention program targeting community-dwellers aged ≥65 years in NSW, along with fall-related ambulance service use and fall-related hospitalisations after scale-up.

METHODS

Data on program provision were received from Local Health Districts. Routinely collected fall-related ambulance usage and hospital admissions in NSW residents aged ≥65 years between 2009 and 2015 were compared within Statistical Local Areas prior to and following the implementation of Stepping On using multilevel models.

RESULTS

Between 2009 and 2014 the program was delivered in 1077 sites to 10 096 older adults. Rates of fall-related ambulance use and hospital admissions per 100-person-years were 1-2 in people aged 66-74, 4-5 in people aged 75-84 and 12-13 in people aged ≥85. These rates increased over time (P < .001). The interaction between time and program delivery was not significant for fall-related ambulance use or hospital admissions. The time-related increase in fall-related ambulance usage in people aged 75-84 years may have been moderated by the Stepping On program (rate ratio 0.97, 95% CI 0.93-1.00, P = .045).

CONCLUSIONS

There was no indication of a reduced rate of fall-related ambulance use or hospital admissions across the entire sample. Ambulance call-outs for falls in people aged 75-84 years may have reduced following program participation. SO WHAT?: Program scale-ups need to reach a large proportion of the target population with a focus on those groups contributing most to fall-related health service utilisation. Linking individual participants' health data as part of large-scale evaluations may provide better insights into program outcomes.

Impact of a quality improvement project to reduce the rate of obstetric anal sphincter injury: a multicentre study with a stepped-wedge design

Objective

To evaluate the impact of a care bundle (antenatal information to women, manual perineal protection and mediolateral episiotomy when indicated) on obstetric anal sphincter injury (OASI) rates.

Design

Multicentre stepped‐wedge cluster design.

Setting

Sixteen maternity units located in four regions across England, Scotland and Wales.

Population

Women with singleton live births between October 2016 and March 2018.

Methods

Stepwise region by region roll‐out every 3 months starting January 2017. The four maternity units in a region started at the same time. Multi‐level logistic regression was used to estimate the impact of the care bundle, adjusting for time trend and case‐mix factors (age, ethnicity, body mass index, parity, birthweight and mode of birth).

Main outcome measures

Obstetric anal sphincter injury in singleton live vaginal births.

Results

A total of 55 060 singleton live vaginal births were included (79% spontaneous and 21% operative). Median maternal age was 30 years (interquartile range 26–34 years) and 46% of women were primiparous. The OASI rate decreased from 3.3% before to 3.0% after care bundle implementation (adjusted odds ratio 0.80, 95% CI 0.65–0.98, P = 0.03). There was no evidence that the effect of the care bundle differed according to parity (P = 0.77) or mode of birth (P = 0.31). There were no significant changes in caesarean section (P = 0.19) or episiotomy rates (P = 0.16) during the study period.

Conclusions

The implementation of this care bundle reduced OASI rates without affecting caesarean section rates or episiotomy use. These findings demonstrate its potential for reducing perineal trauma during childbirth.

Tweetable abstract

OASI Care Bundle reduced severe perineal tear rates without affecting caesarean section rates or episiotomy use.

OASI Care Bundle reduced severe perineal tear rates without affecting caesarean section rates or episiotomy use.

Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice?

The stepped-wedge cluster randomized trial (SW-CRT) involves the sequential transition of clusters (such as hospitals, public health units or communities) from control to intervention conditions in a randomized order. The use of the SW-CRT is growing rapidly. Yet the SW-CRT is at greater risks of bias compared with the conventional parallel cluster randomized trial (parallel-CRT). For this reason, the CONSORT extension for SW-CRTs requires that investigators provide a clear justification for the choice of study design. In this paper, we argue that all other things being equal, the SW-CRT is at greater risk of bias due to misspecification of the secular trends at the analysis stage. This is particularly problematic for studies randomizing a small number of heterogeneous clusters. We outline the potential conditions under which an SW-CRT might be an appropriate choice. Potentially appropriate and often overlapping justifications for conducting an SW-CRT include: (i) the SW-CRT provides a means to conduct a randomized evaluation which otherwise would not be possible; (ii) the SW-CRT facilitates cluster recruitment as it enhances the acceptability of a randomized evaluation either to cluster gatekeepers or other stakeholders; (iii) the SW-CRT is the only feasible design due to pragmatic and logistical constraints (for example the roll-out of a scare resource); and (iv) the SW-CRT has increased statistical power over other study designs (which will include situations with a limited number of clusters). As the number of arguments in favour of an SW-CRT increases, the likelihood that the benefits of using the SW-CRT, as opposed to a parallel-CRT, outweigh its risks also increases. We argue that the mere popularity and novelty of the SW-CRT should not be a factor in its adoption. In situations when a conventional parallel-CRT is feasible, it is likely to be the preferred design.

A new model of care and in-house general practitioners for residential aged care facilities: a stepped wedge, cluster randomised trial

OBJECTIVES

To evaluate whether an alternative model of care in aged care facilities, including in-house general practitioners, influenced health outcomes for residents.

DESIGN

Stepped wedge, cluster randomised controlled trial over 90 weeks (31 December 2012 - 21 September 2014), with a 54-week pre-trial retrospective data period (start: 19 December 2011) and a 54-week post-trial prospective data collection period (to 4 October 2015).

PARTICIPANTS, SETTING

Fifteen residential aged care facilities operated by Bupa Aged Care in metropolitan and regional cities in four Australian states.

INTERVENTION

Residential aged care facilities sought to recruit general practitioners as staff members; care staff roles were redefined to allow registered nurses greater involvement in care plan development.

MAIN (PRIMARY) OUTCOME MEASURES

Numbers of falls; numbers of unplanned transfers to hospital; polypharmacy.

RESULTS

The new model of care could be implemented in all facilities, but four could not recruit in-house GPs at any time during the trial period. Intention-to-treat analyses found no statistically significant effect of the intervention on the primary outcome measures. Contamination-adjusted intention-to-treat analyses identified that the presence of an in-house GP was associated with reductions in the numbers of unplanned hospital transfers (incidence rate ratio [IRR], 0.53; 95% CI, 0.43-0.66) and admissions (IRR, 0.52; 95% CI, 0.41-0.64) and of out-of-hours GP call-outs (IRR, 0.54; 95% CI, 0.36-0.80), but also with an increase in the number of reported falls (IRR, 1.37; 95% CI, 1.20-1.58).

CONCLUSIONS

Recruiting GPs to work directly in residential aged care facilities is difficult, but may reduce the burden of unplanned presentations to hospitals and increase the reporting of adverse events.

TRIAL REGISTRATION

Australia New Zealand Clinical Trial Registry, ACTRN12613000218796 (25 February 2013).

Evaluation of the effectiveness of a quality improvement intervention to support integration of maternal, child and HIV care in primary health care facilities in South Africa

Background

Despite policies and guidelines recommending integration of health services in South Africa, provision of maternal and child health services remains fragmented. This study evaluated a rapid, scaleable, quality improvement (QI) intervention to improve integration of maternal and child health and HIV services at a primary health level, in KwaZulu-Natal, South Africa.

Methods

A three-month intervention comprised of six QI mentoring visits, learning sessions with clinic staff to share learnings, and a self-administered checklist aimed to assist health workers monitor and implement an integrated package of health services for mothers and children. The study evaluated 27 clinics in four sub-districts using a stepped-wedge design. Each sub-district received the intervention sequentially in a randomly selected order. Five waves of data collection were conducted in all participating clinics between December 2016–February 2017. A multi-level, mixed effects logistic regression was used to account for random cluster fixed time and group effects using Stata V13.1.

Results

Improvements in some growth monitoring indicators were achieved in intervention clinics compared to control clinics, including measuring the length of the baby (77% vs 63%; p = 0.001) and health workers asking mothers about the child’s feeding (74% vs 67%; p = 0.003), but the proportion of mothers who received feeding advice remained unchanged (38% vs 35%; p = 0.48). Significantly more mothers in the intervention group were asked about their baby’s health (44% vs 36%; p = 0.001), and completeness of record keeping improved (40% vs 26%; I = < 0.0001). Discussions with the mother about some maternal health services improved: significantly more mothers in the intervention group were asked about HIV (26.5% vs 19.5%; p = 0.009) and family planning (33.5% vs 19.5%; p <  0.001), but this did not result in additional services being provided to mothers at the clinic visit.

Conclusion

This robust evaluation shows significant improvements in coverage of some services, but the QI intervention was unable to achieve the substantial changes required to provide a comprehensive package of services to all mothers and children. We suggest the QI process be adapted to complex under-resourced health systems, building on the strengths of this approach, to provide workable health systems strengthening solutions for scalable implementation.

Trial registration

ClinicalTrials.gov NCT04278612. Date of Registration: February 19, 2020. Retrospectively registered.

A minimum evaluation protocol and stepped-wedge cluster randomized trial of ACCESS Open Minds, a large Canadian youth mental health services transformation project

BACKGROUND

Many Canadian adolescents and young adults with mental health problems face delayed detection, long waiting lists, poorly accessible services, care of inconsistent quality and abrupt or absent inter-service transitions. To address these issues, ACCESS Open Minds, a multi-stakeholder network, is implementing and systematically evaluating a transformation of mental health services for youth aged 11 to 25 at 14 sites across Canada. The transformation plan has five key foci: early identification, rapid access, appropriate care, the elimination of age-based transitions between services, and the engagement of youth and families.

METHODS

The ACCESS Open Minds Research Protocol has multiple components including a minimum evaluation protocol and a stepped-wedge cluster randomized trial, that are detailed in this paper. Additional components include qualitative methods and cost-effectiveness analyses. The services transformation is being evaluated at all sites via a minimum evaluation protocol. Six sites are participating in the stepped-wedge trial whereby the intervention (a service transformation along the key foci) was rolled out in three waves, each commencing six months apart. Two sites, one high-population and one low-population, were randomly assigned to each of the three waves, i.e., randomization was stratified by population size. Our primary hypotheses pertain to increased referral numbers, and reduced wait times to initial assessment and to the commencement of appropriate care. Secondary hypotheses pertain to simplified pathways to care; improved clinical, functional and subjective outcomes; and increased satisfaction among youth and families. Quantitative measures addressing these hypotheses are being used to determine the effectiveness of the intervention.

DISCUSSION

Data from our overall research strategy will help test the effectiveness of the ACCESS Open Minds transformation, refine it further, and inform its scale-up. The process by which our research strategy was developed has implications for the practice of research itself in that it highlights the need to actively engage all stakeholder groups and address unique considerations in designing evaluations of complex healthcare interventions in multiple, diverse contexts. Our approach will generate both concrete evidence and nuanced insights, including about the challenges of conducting research in real-world settings. More such innovative approaches are needed to advance youth mental health services research.

TRIAL REGISTRATION NUMBER

Clinicaltrials.gov, ISRCTN23349893 (Retrospectively registered: 16/02/2017).

Effectiveness of a Bundled Intervention Including Adjunctive Corticosteroids on Outcomes of Hospitalized Patients With Community-Acquired Pneumonia: A Stepped-Wedge Randomized Clinical Trial

IMPORTANCE

Community-acquired pneumonia remains a leading cause of hospitalization, mortality, and health care costs worldwide. Randomized clinical trials support the use of adjunctive corticosteroids, early progressive mobilization, antibiotic switching rules, and dietary interventions in improving outcomes. However, it is uncertain whether implementing these interventions will translate into effectiveness under routine health care conditions.

OBJECTIVE

To evaluate the effectiveness of a bundle of evidence-supported treatments under conditions of routine care in a representative population hospitalized for community-acquired pneumonia.

DESIGN, SETTING, AND PARTICIPANTS

A double-blind, stepped-wedge, cluster-randomized clinical trial with 90-day follow-up was conducted between August 1, 2016, and October 29, 2017, in the general internal medicine service at 2 tertiary hospitals in Melbourne, Australia, among a consecutive sample of patients with community-acquired pneumonia. The primary analysis and preparation of results took place between May 14 and November 25, 2018.

INTERVENTIONS

Treating clinical teams were advised to prescribe prednisolone acetate, 50 mg/d, for 7 days (in the absence of any contraindication) and de-escalate from parenteral to oral antibiotics according to standardized criteria. Algorithm-guided early mobilization and malnutrition screening and treatment were also implemented.

MAIN OUTCOMES AND MEASURES

Hospital length of stay, mortality, readmission, and intervention-associated adverse events (eg, gastrointestinal bleeding and hyperglycemia).

RESULTS

A total of 917 patients were screened, and 816 (351 women and 465 men; mean [SD] age, 76 [13] years) were included in the intention-to-treat analysis, with 401 patients receiving the intervention and 415 patients in the control group. An unadjusted geometric mean ratio of 0.95 (95% CI, 0.78-1.16) was observed for the difference in length of stay (days) between the intervention and control groups. Similarly, no significant differences were observed for the secondary outcomes of mortality and readmission, and the results remained unchanged after further adjustment for sex and age. The study reported higher proportions of gastrointestinal bleeding in the intervention group (9 [2.2%]) compared with the controls (3 [0.7%]), with an unadjusted estimated difference in mean proportions of 0.008 (95% CI, 0.005-0.010).

CONCLUSIONS AND RELEVANCE

This bundled intervention including adjunctive corticosteroids demonstrated no evidence of effectiveness and resulted in a higher incidence of gastrointestinal bleeding. Efficacy of individual interventions demonstrated in clinical trials may not necessarily translate into effectiveness when implemented in combination and may even result in net harm.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT02835040.

Introducing the new CONSORT extension for stepped-wedge cluster randomised trials

The use of the stepped-wedge cluster randomised trial (SW-CRT) is on the increase, and although there are still relatively few SW-CRTs currently published its use is bound to show an increase in the near future. An extension of the CONSORT reporting guideline for SW-CRTs has recently been developed. By making reporting guidelines for this innovative design available relatively early in its development, it is possible that the methodological conduct and reporting of future SW-CRTs will not be at the same risk of low-quality of reporting as is the case with many other study designs. We provide a brief overview of this reporting guideline and encourage authors to use it appropriately; and for journal editors to endorse its use.