A novel counterbalanced implementation study design: methodological description and application to implementation research

Electric massage chairs reduce labor pain in nulliparous patients: a randomized crossover trial

BACKGROUND

Labor pain varies significantly among pregnant women, ranging from mild to extremely distressing. Nonpharmacologic pain relief methods during vaginal birth are increasingly popular, either as a complement to pharmacologic agents or, at times, as the primary method of pain relief. Multiple trials have reported that manual or by-hand massage reduces labor pain. The effectiveness of full-body mechanical massage using electric massage chairs on labor pain remains unexplored.

OBJECTIVE

This study aimed to evaluate mechanical massage using an electric massage chair on labor pain in nulliparous women.

STUDY DESIGN

A randomized counterbalanced crossover trial was conducted in a university hospital in Malaysia from August 2022 to February 2023. Eligible nulliparas in labor with a minimum labor pain score of 5 (0-10 numerical rating scale) were enrolled. Participants were randomized to 30 minutes on the massage chair with mechanical massage followed by 30 minutes on the massage chair without mechanical massage or the other way around in the massage sequence. The primary outcome was a change in pain score comparing pain with and without mechanical massage as a paired comparison for the entire trial participants. The secondary outcomes were across arms analyses of maternal and neonatal outcomes. The paired t test, t test, Mann-Whitney U test, chi-square test, and Fisher exact test were used as appropriate for the data.

RESULTS

Overall, 208 women were randomized: 104 to each intervention. Data were available from 204 participants (103 randomized to massage first and 101 to no massage first). The primary outcomes of change in labor pain scores (0-10 numerical rating scale) after massage and no massage (all participants included after crossover, paired t test analysis) were 4.51±2.30 and 5.38±2.10, respectively (mean difference, -0.87; 95% confidence interval, -1.14 to -0.59; P<.001), a significant reduction in pain score after electric chair mechanical massage compared with no massage. On the across randomized arms secondary analyses, labor pain scores after their first massage chair session were 4.35±2.52 (randomized to massage first, received massage as initial intervention) and 5.66±1.73 (randomized to no massage first, received no massage as initial intervention) (mean difference, -1.31; 95% confidence interval, -1.91 to -0.748; P<.001), a significant reduction after mechanical massage. Other distal maternal outcomes (mode of delivery, labor analgesia, duration of labor, and maternal agreement that mechanical massage is effective for labor pain) and neonatal outcomes (Apgar scores at 1 and 5 minutes, cord artery blood pH and base excess, and neonatal admission) were not different across randomized arms.

CONCLUSION

Mechanical massage using an electric massage chair significantly reduced labor pain, offering a potential nonpharmacologic pain management option during labor.

Evidence-based Medication knowledge Brokers in Residential Aged CarE (EMBRACE): protocol for a helix-counterbalanced randomised controlled trial

INTRODUCTION

Clinical practice guidelines recommend against the routine use of psychotropic medications in residential aged care facilities (RACFs). Knowledge brokers are individuals or groups who facilitate the transfer of knowledge into practice. The objective of this trial is to evaluate the effectiveness and cost-effectiveness of using knowledge brokers to translate Australia's new Clinical Practice Guidelines for the Appropriate Use of Psychotropic Medications in People Living with Dementia and in Residential Aged Care.

METHODS AND ANALYSIS

The Evidence-based Medication knowledge Brokers in Residential Aged CarE (EMBRACE) trial is a helix-counterbalanced randomised controlled trial. The 12-month trial will be conducted in up to 19 RACFs operated by four Australian aged care provider organisations in Victoria, New South Wales, Western Australia and Queensland. RACFs will be randomised to receive three levels of implementation strategies (knowledge broker service, pharmacist-led quality use of medications education activities and distribution of the Guidelines and supporting materials) across three medication contexts (antipsychotics, benzodiazepines and antidepressants). Implementation strategies will be delivered by an embedded on-site aged care pharmacist working at a system level across each participating RACF. All RACFs will receive all implementation strategies simultaneously but for different medication contexts. The primary outcome will be a composite dichotomous measure of 6-month RACF-level concordance with Guideline recommendations and good practice statements among people using antipsychotics, benzodiazepines and antidepressants for changed behaviours. Secondary outcomes will include proportion of residents with Guideline concordant use of antipsychotics, benzodiazepines and antidepressants measured at the RACF-level and proportion of residents with psychotropic medication use, hospitalisation, falls, falls with injury, polypharmacy, quality of life, activities of daily living, medication incidents and behavioural incidents measured at the RACF-level.

DISCUSSION

The EMBRACE trial investigates a novel guideline implementation strategy to improve the safe and effective use of psychotropic medications in RACFs. We anticipate that the findings will provide new information on the potential role of knowledge brokers for successful and cost-effective guideline implementation.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12623001141639. Registered 6 November 2023 - retrospectively registered, https://www.anzctr.org.au/TrialSearch.aspx .

Acute effect of moderate and high-intensity interval exercises on asprosin and BDNF levels in inactive normal weight and obese individuals

This study aimed to examine the acute effects of moderate-intensity aerobic and high-intensity interval exercise protocols on Asprosin and Brain-Derived Neurotrophic Factor (BDNF) levels in inactive normal weight and obese individuals. A total of 20 male individuals aged 18-65 years, ten normal weight (NW) (Body Mass Index (BMI): 18.5-24.99 kg/m²) and 10 obese (Ob) (BMI: 24.99-35.00 kg/m²) participated in this study, voluntarily. Moderate aerobic exercise (AE) (main circuit 30 min, between 40 and 59% of Heart Rate Reserve: HRR) and High-Intensity Interval exercise (HIIE) running protocols (main circuit 20 min, between 75 and 90% of the HRR for 1 min*10 times, and 1-min active rest at 30% of the HRR) was applied to the volunteer participants in the morning hours (08.00-10.00 a.m.), following the night fasting (at least 8-10 h) for at least 3 days between each other. Blood samples were collected from the participants before and immediately after each exercise protocol, and serum asprosin and BDNF hormone levels were determined by Enzyme-Linked Immunosorbent Assay" method. Basal serum asprosin was found to be significantly higher in the Ob group compared to the NW group (p < .001), while the basal serum BDNF hormone was found to be lower (p < 0.05). It was observed that the serum asprosin level of both groups decreased significantly after both AE and HIIE protocols (p < 0.05). In addition, there was a significantly higher decrease in serum asprosin level in the Ob group compared to the NW group after HIIE protocol. For the Ob group, serum BDNF level increased considerably after HIIE protocol compared to AE protocol (p < 0.05). Serum asprosin was found to be higher in the Ob group, while the serum BDNF was found to be lower. In addition, the acute exercises of different intensity significantly affected hormones that regulate appetite metabolism. In particular, it was observed that the HIIE protocol had a greater effect on the regulation of appetite (hunger-satiety) in the Ob group. This result can be taken into account when planning training programs for these individuals.

How Can Implementation Science Improve the Care of Familial Hypercholesterolaemia?

PURPOSE OF REVIEW

Describe the application of implementation science to improve the detection and management of familial hypercholesterolaemia.

RECENT FINDINGS

Gaps between evidence and practice, such as underutilization of genetic testing, family cascade testing, failure to achieve LDL-cholesterol goals and low levels of knowledge and awareness, have been identified through clinical registry analyses and clinician surveys. Implementation science theories, models and frameworks have been applied to assess barriers and enablers in the literature specific to local contextual factors (e.g. stages of life). The effect of implementation strategies to overcome these factors has been evaluated; for example, automated identification of individuals with FH or training and education to improve statin adherence. Clinical registries were identified as a key infrastructure to monitor, evaluate and sustain improvements in care. The expansion in evidence supporting the care of familial hypercholesterolaemia requires a similar expansion of efforts to translate new knowledge into clinical practice.

Quality standards for managing children and adolescents with bronchiectasis: an international consensus

The global burden of bronchiectasis in children and adolescents is being recognised increasingly. However, marked inequity exists between, and within, settings and countries for resources and standards of care afforded to children and adolescents with bronchiectasis compared with those with other chronic lung diseases. The European Respiratory Society (ERS) clinical practice guideline for the management of bronchiectasis in children and adolescents was published recently. Here we present an international consensus of quality standards of care for children and adolescents with bronchiectasis based upon this guideline. The panel used a standardised approach that included a Delphi process with 201 respondents from the parents and patients' survey, and 299 physicians (across 54 countries) who care for children and adolescents with bronchiectasis. The seven quality standards of care statements developed by the panel address the current absence of quality standards for clinical care related to paediatric bronchiectasis. These internationally derived, clinician-, parent- and patient-informed, consensus-based quality standards statements can be used by parents and patients to access and advocate for quality care for their children and themselves, respectively. They can also be used by healthcare professionals to advocate for their patients, and by health services as a monitoring tool, to help optimise health outcomes.

Development of the ASSESS tool: a comprehenSive tool to Support rEporting and critical appraiSal of qualitative, quantitative, and mixed methods implementation reSearch outcomes

Background

Several tools to improve reporting of implementation studies for evidence-based decision making have been created; however, no tool for critical appraisal of implementation outcomes exists. Researchers, practitioners, and policy makers lack tools to support the concurrent synthesis and critical assessment of outcomes for implementation research. Our objectives were to develop a comprehensive tool to (1) describe studies focused on implementation that use qualitative, quantitative, and/or mixed methodologies and (2) assess risk of bias of implementation outcomes.

Methods

A hybrid consensus-building approach combining Delphi Group and Nominal Group techniques (NGT) was modeled after comparative methodologies for developing health research reporting guidelines and critical appraisal tools. First, an online modified NGT occurred among a small expert panel (n = 5), consisting of literature review, item generation, round robin with clarification, application of the tool to various study types, voting, and discussion. This was followed by a larger e-consensus meeting and modified Delphi process with implementers and implementation scientists (n = 32). New elements and elements of various existing tools, frameworks, and taxonomies were combined to produce the ASSESS tool.

Results

The 24-item tool is applicable to a broad range of study designs employed in implementation science, including qualitative studies, randomized-control trials, non-randomized quantitative studies, and mixed methods studies. Two key features are a section for assessing bias of the implementation outcomes and sections for describing the implementation strategy and intervention implemented. An accompanying explanation and elaboration document that identifies and describes each of the items, explains the rationale, and provides examples of reporting and appraising practice, as well as templates to allow synthesis of extracted data across studies and an instructional video, has been prepared.

Conclusions

The comprehensive, adaptable tool to support both reporting and critical appraisal of implementation science studies including quantitative, qualitative, and mixed methods assessment of intervention and implementation outcomes has been developed. This tool can be applied to a methodologically diverse and growing body of implementation science literature to support reviews or meta-analyses that inform evidence-based decision-making regarding processes and strategies for implementation.

Effectiveness of knowledge brokering and recommendation dissemination for influencing healthcare resource allocation decisions: A cluster randomised controlled implementation trial

BACKGROUND

Implementing evidence into clinical practice is a key focus of healthcare improvements to reduce unwarranted variation. Dissemination of evidence-based recommendations and knowledge brokering have emerged as potential strategies to achieve evidence implementation by influencing resource allocation decisions. The aim of this study was to determine the effectiveness of these two research implementation strategies to facilitate evidence-informed healthcare management decisions for the provision of inpatient weekend allied health services.

METHODS AND FINDINGS

This multicentre, single-blinded (data collection and analysis), three-group parallel cluster randomised controlled trial with concealed allocation was conducted in Australian and New Zealand hospitals between February 2018 and January 2020. Clustering and randomisation took place at the organisation level where weekend allied health staffing decisions were made (e.g., network of hospitals or single hospital). Hospital wards were nested within these decision-making structures. Three conditions were compared over a 12-month period: (1) usual practice waitlist control; (2) dissemination of written evidence-based practice recommendations; and (3) access to a webinar-based knowledge broker in addition to the recommendations. The primary outcome was the alignment of weekend allied health provision with practice recommendations at the cluster and ward levels, addressing the adoption, penetration, and fidelity to the recommendations. The secondary outcome was mean hospital length of stay at the ward level. Outcomes were collected at baseline and 12 months later. A total of 45 clusters (n = 833 wards) were randomised to either control (n = 15), recommendation (n = 16), or knowledge broker (n = 14) conditions. Four (9%) did not provide follow-up data, and no adverse events were recorded. No significant effect was found with either implementation strategy for the primary outcome at the cluster level (recommendation versus control β 18.11 [95% CI -8,721.81 to 8,758.02] p = 0.997; knowledge broker versus control β 1.24 [95% CI -6,992.60 to 6,995.07] p = 1.000; recommendation versus knowledge broker β -9.12 [95% CI -3,878.39 to 3,860.16] p = 0.996) or ward level (recommendation versus control β 0.01 [95% CI 0.74 to 0.75] p = 0.983; knowledge broker versus control β -0.12 [95% CI -0.54 to 0.30] p = 0.581; recommendation versus knowledge broker β -0.19 [-1.04 to 0.65] p = 0.651). There was no significant effect between strategies for the secondary outcome at ward level (recommendation versus control β 2.19 [95% CI -1.36 to 5.74] p = 0.219; knowledge broker versus control β -0.55 [95% CI -1.16 to 0.06] p = 0.075; recommendation versus knowledge broker β -3.75 [95% CI -8.33 to 0.82] p = 0.102). None of the control or knowledge broker clusters transitioned to partial or full alignment with the recommendations. Three (20%) of the clusters who only received the written recommendations transitioned from nonalignment to partial alignment. Limitations include underpowering at the cluster level sample due to the grouping of multiple geographically distinct hospitals to avoid contamination.

CONCLUSIONS

Owing to a lack of power at the cluster level, this trial was unable to identify a difference between the knowledge broker strategy and dissemination of recommendations compared with usual practice for the promotion of evidence-informed resource allocation to inpatient weekend allied health services. Future research is needed to determine the interactions between different implementation strategies and healthcare contexts when translating evidence into healthcare practice.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12618000029291.

Variation in inpatient allied health service provision in Australian and New Zealand hospitals

OBJECTIVE

To describe the variability of allied health services on weekends, relative to weekdays, throughout Australian and New Zealand hospitals.

METHODS

A prospective, cross-sectional observational study embedded within a cluster randomised control trial. Allied health managers provided administrative data relating to allied health service events.

RESULTS

In one month, there were a total of 243 549 allied health service events recorded from 91 sampled hospitals. The mean difference between weekday and weekend allied health service events (daily, per ward) for physiotherapy was 6.52 (95% CI 5.65 to 7.40), acute wards 12.03 (95% CI 10.25 to 13.82) and for metropolitan hospitals 14.47 (95% CI 12.22 to 16.73), revealing more allied health service events of longer duration on weekdays compared to weekends.

CONCLUSIONS

This research is the first of its kind to describe variation in allied health service provision and potential research to practice gaps across weekday and weekend days in various inpatient settings.

Applying a framework to assess the impact of cardiovascular outcomes improvement research

Background

Health and medical research funding agencies are increasingly interested in measuring the impact of funded research. We present a research impact case study for the first four years of an Australian National Health and Medical Research Council funded Centre of Research Excellence in Cardiovascular Outcomes Improvement (2016–2020). The primary aim of this paper was to explore the application of a research impact matrix to assess the impact of cardiovascular outcomes improvement research.

Methods

We applied a research impact matrix developed from a systematic review of existing methodological frameworks used to measure research impact. This impact matrix was used as a bespoke tool to identify and understand various research impacts over different time frames. Data sources included a review of existing internal documentation from the research centre and publicly available information sources, informal iterative discussions with 10 centre investigators, and confirmation of information from centre grant and scholarship recipients.

Results

By July 2019, the impact on the short-term research domain category included over 41 direct publications, which were cited over 87 times (median journal impact factor of 2.84). There were over 61 conference presentations, seven PhD candidacies, five new academic collaborations, and six new database linkages conducted. The impact on the mid-term research domain category involved contributions towards the development of a national cardiac registry, cardiovascular guidelines, application for a Medicare Benefits Schedule reimbursement item number, introduction of patient-reported outcome measures into several databases, and the establishment of nine new industry collaborations. Evidence of long-term impacts were described as the development and use of contemporary management for aortic stenosis, a cardiovascular risk prediction model and prevention targets in several data registries, and the establishment of cost-effectiveness for stenting compared to surgery.

Conclusions

We considered the research impact matrix a feasible tool to identify evidence of academic and policy impact in the short- to midterm; however, we experienced challenges in capturing long-term impacts. Cost containment and broader economic impacts represented another difficult area of impact to measure.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-021-00710-4.

Implementing large-system, value-based healthcare initiatives: a realist study protocol for seven natural experiments

INTRODUCTION

Value-based healthcare delivery models have emerged to address the unprecedented pressure on long-term health system performance and sustainability and to respond to the changing needs and expectations of patients. Implementing and scaling the benefits from these care delivery models to achieve large-system transformation are challenging and require consideration of complexity and context. Realist studies enable researchers to explore factors beyond 'what works' towards more nuanced understanding of 'what tends to work for whom under which circumstances'. This research proposes a realist study of the implementation approach for seven large-system, value-based healthcare initiatives in New South Wales, Australia, to elucidate how different implementation strategies and processes stimulate the uptake, adoption, fidelity and adherence of initiatives to achieve sustainable impacts across a variety of contexts.

METHODS AND ANALYSIS

This exploratory, sequential, mixed methods realist study followed RAMESES II (Realist And Meta-narrative Evidence Syntheses: Evolving Standards) reporting standards for realist studies. Stage 1 will formulate initial programme theories from review of existing literature, analysis of programme documents and qualitative interviews with programme designers, implementation support staff and evaluators. Stage 2 envisages testing and refining these hypothesised programme theories through qualitative interviews with local hospital network staff running initiatives, and analyses of quantitative data from the programme evaluation, hospital administrative systems and an implementation outcome survey. Stage 3 proposes to produce generalisable middle-range theories by synthesising data from context-mechanism-outcome configurations across initiatives. Qualitative data will be analysed retroductively and quantitative data will be analysed to identify relationships between the implementation strategies and processes, and implementation and programme outcomes. Mixed methods triangulation will be performed.

ETHICS AND DISSEMINATION

Ethical approval has been granted by Macquarie University (Project ID 23816) and Hunter New England (Project ID 2020/ETH02186) Human Research Ethics Committees. The findings will be published in peer-reviewed journals. Results will be fed back to partner organisations and roundtable discussions with other health jurisdictions will be held, to share learnings.

Meta-analysis of randomised controlled trials testing behavioural interventions to promote household action on climate change

No consensus exists regarding which are the most effective mechanisms to promote household action on climate change. We present a meta-analysis of randomised controlled trials comprising 3,092,678 observations, which estimates the effects of behavioural interventions holding other factors constant. Here we show that behavioural interventions promote climate change mitigation to a very small degree while the intervention lasts (d = −0.093 95% CI −0.160, −0.055), with no evidence of sustained positive effects once the intervention ends. With the exception of recycling, most household mitigation behaviours show a low behavioural plasticity. The intervention with the highest average effect size is choice architecture (nudges) but this strategy has been tested in a limited number of behaviours. Our results do not imply behavioural interventions are less effective than alternative strategies such as financial incentives or regulations, nor exclude the possibility that behavioural interventions could have stronger effects when used in combination with alternative strategies.

It is not clear which are the most effective mechanisms to achieve sustainable lifestyle behaviour. Here the authors study the impact of behavioural interventions excluding economic incentives by performing a large-scale meta-analysis and find that these interventions promote sustainable behaviours to a small degree in the short-term with no evidence of sustained positive effects once the intervention is completed.