The quality of reporting in cluster randomised crossover trials: proposal for reporting items and an assessment of reporting quality

Impact of the presence of a mediator on patient violent or uncivil behaviours in emergency departments: a cluster randomised crossover trial

BACKGROUND AND IMPORTANCE

Several studies reported that violent behaviours were committed by patients against healthcare professionals in emergency departments (EDs). The presence of mediators could prevent or resolve situations of tension.

OBJECTIVE

To evaluate whether the presence of mediators in EDs would have an impact on violent behaviours committed by patients or their relatives against healthcare professionals. Design, settings and participants A 6-period cluster randomised crossover trial was performed in 4 EDs during 12 months. Patients aged ≥18 and their relatives were included.

INTERVENTION

In order to prevent or resolve situations of tension and conflict, four mediators were recruited.Outcome measure and analysis Using a logistic regression mixed model, the rate of ED visits in which at least one act of violence was committed by a patient or their relatives, reported by healthcare professionals, was compared between the intervention group and the control group.

RESULTS

A total of 50 429 ED visits were performed in the mediator intervention group and 50 851 in the control group. The mediators reported 1365 interventions; >50% of the interventions were to answer questions about clinical management or waiting time. In the intervention group, 173 acts of violence were committed during 129 ED visits, and there were 145 acts of violence committed during 106 ED visits in the control group. The rate of ED visits in which at least one act of violence was committed, was 0.26% in the intervention group and 0.21% in the control group (OR = 1.23; 95% CI [0.73-2.09]); on a 4-level seriousness scale, 41.6% of the acts of violence were rated level-1 (acts of incivility or rudeness) in the intervention group and 40.0% in the control group.

CONCLUSION

The presence of mediators in the ED was not associated with a reduction in violent or uncivil behaviours committed by patients or their relatives. However, the study highlighted that patients had a major need for information regarding their care; improving communication between patients and healthcare professionals might reduce the violence in EDs.

TRIAL REGISTRATION

Clinicaltrials.gov (NCT03139110).

Impact of two endotracheal tube fixation on the incidence of peri-oral lesions: Elastic adhesive strips versus cord in a protective sheath. Study protocol for a cluster cross-over randomized trial

BACKGROUND

Endotracheal tube fixation in ventilated patients must be appropriate to ensure security during mechanical ventilation and prevent skin lesions. The incidence of endotracheal tube-caused pressure ulcers ranges from 7% to 45%. Various endotracheal tube fixations are used in intensive care units (ICUs) worldwide. By pressure exercised on the skin, these systems could lead to mucosal and skin peri-oral lesions. The main objective of this study is to evaluate the impact of the two fixation systems most commonly used in French ICUs (adhesive elastic band versus fixation cord with PolyVinyl Chloride (PVC) sheath) on the incidence of these peri-oral skin lesions.

METHODS

This studyis a multicenter, open-label, controlled, superiority, cluster cross-over randomized trial. 768 patients will be recruited in the 16 ICUs involved. The inclusion of patients will be carried out over two 12-month periods. Each site begins with one of the evaluated fixation systems: elastic adhesive tape or cord associated with a protective sheath. After a 4-month break, each site switches to the other fixation system. The primary outcome is the development of at least one peri-oral lesion during the first ten days of maintaining an orally inserted endotracheal tube. The presence of lesions is assessed by a blinded adjudication committee using photographs taken daily.

DISCUSSION

This study is the first multicenter, randomized trial designed to evaluate the impact of elastic adhesive tape versus fixation cord with PVC sheath on the incidence of peri-oral lesions. The results will provide data which could change and standardize care practices.

TRIAL REGISTRATION

https://www.clinicaltrials.gov. Reference number: NCT04819425.

An educational intervention to reduce the incidence of postoperative residual curarisation: a cluster randomised crossover trial in patients undergoing general anaesthesia

BACKGROUND

The incidence of postoperative residual curarisation remains unacceptably high. We assessed whether an educational intervention on perioperative neuromuscular block management can reduce it.

METHODS

In this multicentre, cluster randomised crossover trial, centres were allocated to receive an educational intervention either in a first or a second period. The educational intervention consisted of a lecture about neuromuscular management key points, including quantitative neuromuscular monitoring and use of reversal agents. The lecture was streamed to allow repetition. Additionally, memory cards were distributed in each operating theatre. The primary outcome was postoperative residual curarisation in the PACU. Secondary outcomes were frequency of quantitative neuromuscular monitoring, use of reversal agents, and incidence of postoperative pulmonary complications during hospital stay. Measurements were performed before randomisation and after the first and the second period. The effect of the educational intervention was estimated using multivariable mixed effects logistic regression models.

RESULTS

We included 2314 subjects in 34 Spanish centres. Postoperative residual curarisation incidence was not affected by the educational intervention (odds ratio [OR] 0.90 [95% confidence interval {CI}: 0.51-1.58]; P=0.717 and 1.30 [0.73-2.30]; P=0.371] for first and second time-period interaction). The educational intervention increased the quantitative neuromuscular monitor usage (OR 2.04 [95% CI: 1.31-3.19]; P=0.002), the use of reversal agents was unchanged (OR 0.79 [95% CI: 0.50-1.26]; P=0.322), and the incidence of postoperative pulmonary complications decreased (OR 0.19 [95% CI: 0.10-0.35]; P<0.001).

CONCLUSIONS

An educational intervention on perioperative neuromuscular block management did not reduce the incidence of postoperative residual curarisation nor increase reversal, despite increased quantitative neuromuscular monitoring. Sugammadex reversal was associated with reduced postoperative residual curarisation. The educational intervention was associated with a decrease in postoperative pulmonary complications.

CLINICAL TRIAL REGISTRATION

NCT03128151.

Hyperhydration to Improve Kidney Outcomes in Children with Shiga Toxin-Producing E. coli Infection: a multinational embedded cluster crossover randomized trial (the HIKO STEC trial)

BACKGROUND

Shiga toxin-producing E. coli (STEC) infections affect children and adults worldwide, and treatment remain solely supportive. Up to 15-20% of children infected by high-risk STEC (i.e., E. coli that produce Shiga toxin 2) develop hemolytic anemia, thrombocytopenia, and kidney failure (i.e., hemolytic uremic syndrome (HUS)), over half of whom require acute dialysis and 3% die. Although no therapy is widely accepted as being able to prevent the development of HUS and its complications, several observational studies suggest that intravascular volume expansion (hyperhydration) may prevent end organ damage. A randomized trial is needed to confirm or refute this hypothesis.

METHODS

We will conduct a pragmatic, embedded, cluster-randomized, crossover trial in 26 pediatric institutions to determine if hyperhydration, compared to conservative fluid management, improves outcomes in 1040 children with high-risk STEC infections. The primary outcome is major adverse kidney events within 30 days (MAKE30), a composite measure that includes death, initiation of new renal replacement therapy, or persistent kidney dysfunction. Secondary outcomes include life-threatening, extrarenal complications, and development of HUS. Pathway eligible children will be treated per institutional allocation to each pathway. In the hyperhydration pathway, all eligible children are hospitalized and administered 200% maintenance balanced crystalloid fluids up to targets of 10% weight gain and 20% reduction in hematocrit. Sites in the conservative fluid management pathway manage children as in- or outpatients, based on clinician preference, with the pathway focused on close laboratory monitoring, and maintenance of euvolemia. Based on historical data, we estimate that 10% of children in our conservative fluid management pathway will experience the primary outcome. With 26 clusters enrolling a mean of 40 patients each with an intraclass correlation coefficient of 0.11, we will have 90% power to detect a 5% absolute risk reduction.

DISCUSSION

HUS is a devastating illness with no treatment options. This pragmatic study will determine if hyperhydration can reduce morbidity associated with HUS in children with high-risk STEC infection.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05219110 . Registered on February 1, 2022.

Norepinephrine versus phenylephrine for treating hypotension during general anaesthesia in adult patients undergoing major noncardiac surgery: a multicentre, open-label, cluster-randomised, crossover, feasibility, and pilot trial

BACKGROUND

Intraoperative hypotension is associated with postoperative complications. The use of vasopressors is often required to correct hypotension but the best vasopressor is unknown.

METHODS

A multicentre, cluster-randomised, crossover, feasibility and pilot trial was conducted across five hospitals in California. Phenylephrine (PE) vs norepinephrine (NE) infusion as the first-line vasopressor in patients under general anaesthesia alternated monthly at each hospital for 6 months. The primary endpoint was first-line vasopressor administration compliance of 80% or higher. Secondary endpoints were acute kidney injury (AKI), 30-day mortality, myocardial injury after noncardiac surgery (MINS), hospital length of stay, and rehospitalisation within 30 days.

RESULTS

A total of 3626 patients were enrolled over 6 months; 1809 patients were randomised in the NE group, 1817 in the PE group. Overall, 88.2% received the assigned first-line vasopressor. No drug infiltrations requiring treatment were reported in either group. Patients were median 63 yr old, 50% female, and 58% white. Randomisation in the NE group vs PE group did not reduce readmission within 30 days (adjusted odds ratio=0.92; 95% confidence interval, 0.6-1.39), 30-day mortality (1.01; 0.48-2.09), AKI (1.1; 0.92-1.31), or MINS (1.63; 0.84-3.16).

CONCLUSIONS

A large and diverse population undergoing major surgery under general anaesthesia was successfully enrolled and randomised to receive NE or PE infusion. This pilot and feasibility trial was not powered for adverse postoperative outcomes and a follow-up multicentre effectiveness trial is planned.

CLINICAL TRIAL REGISTRATION

NCT04789330 (ClinicalTrials.gov).

Introducing the Library of Guidance for Health Scientists (LIGHTS): A Living Database for Methods Guidance

IMPORTANCE

Improving methodological quality is a priority in the health research community. Finding appropriate methods guidance can be challenging due to heterogeneous terminology, poor indexing in medical databases, and variation in formats. The Library of Guidance for Health Scientists (LIGHTS) is a new searchable database for methods guidance articles.

OBSERVATIONS

Journal articles that aim to provide guidance for performing (including planning, design, conduct, analysis, and interpretation), reporting, and assessing the quality of health-related research involving humans or human populations (ie, excluding basic and animal research) are eligible for LIGHTS. A team of health researchers, information specialists, and methodologists continuously identifies and manually indexes eligible guidance documents. The search strategy includes focused searches of specific journals, specialized databases, and suggestions from researchers. A current limitation is that a keyword-based search of MEDLINE (and other general databases) and manual screening of records were not feasible because of the large number of hits (n = 915 523). As of September 20, 2022, LIGHTS included 1246 articles (336 reporting guidelines, 80 quality assessment tools, and 830 other methods guidance articles). The LIGHTS website provides a user-oriented search interface including filters for study type, specific methodological topic, research context, guidance type, and development process of the guidance. Automated matching of alternative methodological expressions (eg, enter loss to follow-up and find articles indexed with missing data) enhances search queries.

CONCLUSIONS AND RELEVANCE

LIGHTS is a peer-supported initiative that is intended to increase access to and use of methods guidance relevant to health researchers, statisticians, methods consultants, methods developers, ethics boards, peer reviewers, journal editors, and funding bodies.

Methodological review showed that time-to-event outcomes are often inadequately handled in cluster randomized trials

OBJECTIVES

To estimate the prevalence of time-to-event (TTE) outcomes in cluster randomized trials (CRTs) and to examine their statistical management.

STUDY DESIGN AND SETTING

We searched PubMed to identify primary reports of CRTs published in six major general medical journals (2013-2018). Nature of outcomes and, for TTE outcomes, statistical methods for sample size, analysis, and measures of intracluster correlation were extracted.

RESULTS

A TTE analysis was used in 17% of the CRTs (32/184) either as a primary or secondary outcome analysis, or in a sensitivity analysis. Among the five CRTs with a TTE primary outcome, two accounted for both intracluster correlation and the TTE nature of the outcome in sample size calculation; one reported a measure of intracluster correlation in the analysis. Among the 32 CRTs with a least one TTE analysis, 44% (14/32) accounted for clustering in all TTE analyses. We identified 12 additional CRTs in which there was at least one outcome not analyzed as TTE for which a TTE analysis might have been preferred.

CONCLUSION

TTE outcomes are not uncommon in CRTs but appropriate statistical methods are infrequently used. Our results suggest that further methodological development and explicit recommendations for TTE outcomes in CRTs are needed.

Cluster identification, selection, and description in cluster randomized crossover trials: the PREP-IT trials

Background

In cluster randomized crossover (CRXO) trials, groups of participants (i.e., clusters) are randomly allocated to receive a sequence of interventions over time (i.e., cluster periods). CRXO trials are becoming more comment when they are feasible, as they require fewer clusters than parallel group cluster randomized trials. However, CRXO trials have not been frequently used in orthopedic fracture trials and represent a novel methodological application within the field. To disseminate the early knowledge gained from our experience initiating two cluster randomized crossover trials, we describe our process for the identification and selection of the orthopedic practices (i.e., clusters) participating in the PREP-IT program and present data to describe their key characteristics.

Methods

The PREP-IT program comprises two ongoing pragmatic cluster randomized crossover trials (Aqueous-PREP and PREPARE) which compare the effect of iodophor versus chlorhexidine solutions on surgical site infection and unplanned fracture-related reoperations in patients undergoing operative fracture management. We describe the process we used to identify and select orthopedic practices (clusters) for the PREP-IT trials, along with their characteristics.

Results

We identified 58 potential orthopedic practices for inclusion in the PREP-IT trials. After screening each practice for eligibility, we selected 30 practices for participation and randomized each to a sequence of interventions (15 for Aqueous-PREP and 20 for PREPARE). The majority of orthopedic practices included in the Aqueous-PREP and PREPARE trials were situated in level I trauma centers (100% and 87%, respectively). Orthopedic practices in the Aqueous-PREP trial operatively treated a median of 149 open fracture patients per year, included a median of 11 orthopedic surgeons, and had access to a median of 5 infection preventionists. Orthopedic practices in the PREPARE trial treated a median of 142 open fracture and 1090 closed fracture patients per year, included a median of 7.5 orthopedic surgeons, and had access to a median of 6 infection preventionists.

Conclusions

The PREP-IT trials provide an example of how to follow the reporting standards for cluster randomized crossover trials by providing a clear definition of the cluster unit, a thorough description of the cluster identification and selection process, and sufficient description of key cluster characteristics.

Trial registration

Both trials are registered at ClinicalTrials.gov (A-PREP: NCT03385304 December 28, 2017, and PREPARE: NCT03523962 May 14, 2018).

The cluster randomized crossover trial: The effects of attrition in the AB/BA design and how to account for it in sample size calculations

Background/Aims:

This article studies the effect of attrition in the cluster randomized crossover trial. The focus is on the two-treatment two-period AB/BA design where attrition occurs during the washout period. Attrition may occur at either the subject level or the cluster level. In the latter case, clusters drop out entirely and provide no measurements in the second period. Subject attrition can only occur in the cohort design, where each subject receives both treatments. Cluster attrition can also occur in the cross-sectional design, where different subjects are measured in the two time periods. Furthermore, this article explores two different strategies to account for potential levels of attrition: increasing sample size and replacing those subjects who drop out by others.

Methods:

The statistical model that takes into account the nesting of subjects within clusters, and the nesting of repeated measurements within subjects is presented. The effect of attrition is evaluated on the basis of the efficiency of the treatment effect estimator. Matrix algebra is used to derive the relation between efficiency, the degree of attrition, cluster size and the intraclass correlations: the within-cluster within-period correlation, the within-cluster between-period correlation and (in the case of a cohort design) the within-subject correlation. The methodology is implemented in two Shiny Apps.

Results:

Attrition in a cluster randomized crossover trial implies a loss of efficiency. Efficiency decreases with an increase of the attrition rate. The loss of efficiency due to attrition of subjects in a cohort design is largest for small number of subjects per cluster-period, but it may be repaired to a large degree by increasing the number of subjects per cluster-period or by replacing those subjects who drop out by others. Attrition of clusters results in a larger loss of efficiency, but this loss does not depend on the number of subjects per cluster-period. Repairing for this loss requires a large increase in the number of subjects per cluster-period. The methodology of this article is illustrated by an example on the effect of lavender scent on dental patients’ anxiety.

Conclusion:

This article provides the methodology of exploring the effect of attrition in cluster randomized crossover trials, and to repair for attrition. As such, it helps researchers plan their trial in an appropriate way and avoid underpowered trials. To use the methodology, prior estimates of the degree of attrition and intraclass correlation coefficients are needed. It is advocated that researchers clearly report the estimates of these quantities to help facilitate planning future trials.

Issues with data and analyses: Errors, underlying themes, and potential solutions

Some aspects of science, taken at the broadest level, are universal in empirical research. These include collecting, analyzing, and reporting data. In each of these aspects, errors can and do occur. In this work, we first discuss the importance of focusing on statistical and data errors to continually improve the practice of science. We then describe underlying themes of the types of errors and postulate contributing factors. To do so, we describe a case series of relatively severe data and statistical errors coupled with surveys of some types of errors to better characterize the magnitude, frequency, and trends. Having examined these errors, we then discuss the consequences of specific errors or classes of errors. Finally, given the extracted themes, we discuss methodological, cultural, and system-level approaches to reducing the frequency of commonly observed errors. These approaches will plausibly contribute to the self-critical, self-correcting, ever-evolving practice of science, and ultimately to furthering knowledge.

Current practice in methodology and reporting of the sample size calculation in randomised trials of hip and knee osteoarthritis: a protocol for a systematic review

Background

A key aspect of the design of randomised controlled trials (RCTs) is determining the sample size. It is important that the trial sample size is appropriately calculated. The required sample size will differ by clinical area, for instance, due to the prevalence of the condition and the choice of primary outcome. Additionally, it will depend upon the choice of target difference assumed in the calculation. Focussing upon the hip and knee osteoarthritis population, this study aims to systematically review how the trial size was determined for trials of osteoarthritis, on what basis, and how well these aspects are reported.

Methods

Several electronic databases (Medline, Cochrane library, CINAHL, EMBASE, PsycINFO, PEDro and AMED) will be searched to identify articles on RCTs of hip and knee osteoarthritis published in 2016. Articles will be screened for eligibility and data extracted independently by two reviewers. Data will be extracted on study characteristics (design, population, intervention and control treatments), primary outcome, chosen sample size and justification, parameters used to calculate the sample size (including treatment effect in control arm, level of variability in primary outcome, loss to follow-up rates). Data will be summarised across the studies using appropriate summary statistics (e.g. n and %, median and interquartile range). The proportion of studies which report each key component of the sample size calculation will be presented. The reproducibility of the sample size calculation will be tested.

Discussion

The findings of this systematic review will summarise the current practice for sample size calculation in trials of hip and knee osteoarthritis. It will also provide evidence on the completeness of the reporting of the sample size calculation, reproducibility of the chosen sample size and the basis for the values used in the calculation.

Trial registration

As this review was not eligible to be registered on PROSPERO, the summary information was uploaded to Figshare to make it publicly accessible in order to avoid unnecessary duplication amongst other benefits (https://doi.org/10.6084/m9.figshare.5009027.v1); Registered January 17, 2017.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-2209-8) contains supplementary material, which is available to authorized users.

Review of Recent Methodological Developments in Group-Randomized Trials: Part 1-Design

In 2004, Murray et al. reviewed methodological developments in the design and analysis of group-randomized trials (GRTs). We have highlighted the developments of the past 13 years in design with a companion article to focus on developments in analysis. As a pair, these articles update the 2004 review. We have discussed developments in the topics of the earlier review (e.g., clustering, matching, and individually randomized group-treatment trials) and in new topics, including constrained randomization and a range of randomized designs that are alternatives to the standard parallel-arm GRT. These include the stepped-wedge GRT, the pseudocluster randomized trial, and the network-randomized GRT, which, like the parallel-arm GRT, require clustering to be accounted for in both their design and analysis.