How to design a randomised controlled trial

A Clinician's Guide to Critically Appraising Randomized Controlled Trials in the Field of Speech-Language Pathology

PURPOSE

When considering original research articles, randomized controlled trials (RCTs) provide the highest level of research evidence. Given this, RCTS are often used by clinicians performing evidence-based practice to determine the most effective intervention for a specific patient or patient population. Although RCTs represent a high level of research evidence, it is important for clinicians to critically appraise RCTs to determine the validity of the study methods deployed, the statistical and clinical significance of treatment effects, and whether or not the results generalize to a particular patient, patient population, and/or clinical setting. Therefore, this tutorial will provide clinicians with an overview of what an RCT is, the various types of RCTs, when RCTs are appropriate to conduct and/or use to inform clinical practice, and the advantages and limitations of RCTs. Additionally, this tutorial will provide clinicians with practical tools to employ when reading an RCT, including checklists with questions, definitions of important terminology frequently used in RCTs, and demonstrations of how to critically appraise RCTs using literature examples from the speech-language pathology literature.

CONCLUSIONS

Learning how to interpret and apply the results from RCTs to inform clinical practice for purposes of improving patient care is a critical evidence-based practice skill for clinicians to develop. This tutorial will assist clinicians in the field of speech-language pathology by furthering their fundamental knowledge of RCTs and by providing them with pragmatic tools to critically appraise RCTs to inform their clinical practice.

Effectiveness of multi-modal cognitive behavioural therapy in improving mental well-being among caregivers of children with disabilities in urban Uganda: A cluster-randomized controlled trial

Background

In Sub-Saharan Africa, 41 to 58% of the caregivers of children with disabilities experience psychological distress and have poor mental well-being. Cognitive behavioural therapy (CBT) has a moderate effect on improving mental well-being. However, no study has examined its effects among caregivers of children with disabilities at home and in schools. This study evaluated the effectiveness of CBT in improving mental well-being among caregivers of children with disabilities in urban Uganda.

Methods

We conducted a two-arm cluster-randomized controlled trial in 11 schools across the Kampala district of Uganda. The intervention was a multi-modal CBT training program conducted for six months among 392 home and school caregivers of children with disabilities. In the first three months, caregivers received group-based CBT, and in the next three months, they received phone-based CBT. We used generalized linear mixed-effects regression to examine the differences in the mental well-being of caregivers in the control group vs those in the intervention group.

Results

Home caregivers' mental well-being was significantly higher after phone-based CBT (unstandardized coefficient of the estimate (B) = 4.31, 95% CI = 1.18-6.82; P < 0.001, Cohen's D (d) = 0.27). School caregivers' mental well-being was significantly higher after group-based CBT (B = 3.98, 95% CI = 0.22-7.47; P = 0.038, d = 0.25).

Conclusions

Group-based CBT improved mental well-being among school caregivers, and phone-based CBT improved mental well-being among home caregivers. Interventions targeting school caregivers of children with disabilities should employ group settings and those targeting home caregivers should utilize peer-to-peer networks to enhance the caregivers' mental well-being.

Registration

The study protocol was registered with UMIN Clinical Trials Registry (UMIN-CTR). Trial ID: UMIN000040912.

Treatment protocols for claw horn lesions and their impact on lameness recovery, pain sensitivity, and lesion severity in moderately lame primiparous dairy cows

This study aims to investigate the effects of routine treatment protocols for claw horn disruptive lesions (CHDL) on lameness recovery rates, pain sensitivity, and lesion severity in moderately lame primiparous cows. A cohort of first parity cows was recruited from a single commercial dairy herd and randomly allocated to five treatments, comprising four lame groups (LTNB, LTN, LTB, and LT) and a single group non-lame group. Eligibility criteria for the lame cows included a first lameness score (score 3/5), presence of CHDL on a single foot, good body condition score of 3.0 to 3.5, and no history of previous lameness. LTNB received a combination of therapeutic trim, administration of a non-steroidal anti-inflammatory drug (NSAID; Ketoprofen) for 3 days, and hoof block on the healthy claw. Both LTN and LTB received the same treatment as LTNB without hoof block and NSAID, respectively. LT received only a therapeutic trim, whereas non-LT (negative control) received either a therapeutic or preventive trim. Pain sensitivity was assessed using the limb withdrawal reflex while lesion severity was recorded using the International Committee Animal Records (ICAR) Atlas guide. The enrolled cows were observed at weekly intervals, and the primary outcomes were assessed 28 days after treatment. The number (%) of recovered cows was 15 of 20 (75%), 13 of 21 (61.9%), 6 of 14 (42.9%), and 6 of 15 (40%) for LTNB, LTN, LTB, and LT, respectively. LTNB had significantly higher odds of successful treatment (OR = 4.5; 95% 1.1-19.1) compared to LT. Pain sensitivity based on limb withdrawal reflex was absent in a significantly higher number of cows (15/20; 75.0%) in LTNB compared to LTB and LT. LTB had a significantly lower lesion severity score in comparison to LTN. Overall, cows with limb withdrawal at day 28 after treatment were less likely (OR = 0.06; 95% CI 0.01-0.24) to develop a non-lame score. In conclusion, the treatment with therapeutic trim, hoof block, and NSAID led to better recovery and reduced pain sensitivity in moderately lame primiparous cows with good BCS compared to those that received only therapeutic trim. Further research on the changes within the hoof capsule following various treatment protocols is needed to elucidate the clinical benefits observed in this study.

Cost-effectiveness analysis of a chronic back pain multidisciplinary biopsychosocial rehabilitation (MBR) compared to standard care for privately insured in Germany

Background

Multidisciplinary biopsychosocial rehabilitation (MBR) is highly recommended for chronic lower back pain (CLBP) treatment, but its economic benefit remains to be clearly demonstrated. The purpose of this study is to analyse the effect of a 12-month MBR programme of behavioural change coaching and device-supported exercise on direct medical costs, sick leave and health-related quality of life (HRQOL) at 24 months.

Methods

An incremental cost-effectiveness analysis was conducted in Germany from a private health insurance perspective using data from a multi-centre, two-arm randomised controlled trial with parallel-group Zelen's randomisation and 24-month follow-up. After removing dissimilarities in characteristics between MBR and usual care (control) via propensity score matching, treatment effects were calculated using a difference-in-difference approach.

Results

Base-case analysis of the MBR (n=112) and usual care group (n=111) showed an incremental cost-effectiveness ratio (ICER) of €8,296 per quality-adjusted life year (QALY) gained, indicating that the intervention was cost-effective. Compared to the controls, MBR reduced economically unaccounted sick leave due to back pain in the last six months by 17.5 days (p = 0.001) and had a positive effect on health-related quality of life (HRQOL) (0.046, p=0.026). Subgroup analysis of participants with major impairment demonstrated that a dominant intervention was possible, as reflected by an ICER of - €7,302 per QALY. Savings were driven by a - €1,824 reduction in back pain-specific costs. Moreover, sick leave was 27 days (p = 0.006) less in the MBR group.

Conclusions

This first cost-effectiveness study with combined data from a private health insurer and a controlled trial in Germany demonstrated that long term MBR for the treatment of CLBP is cost-effective. Subgroups with major impairment from back pain benefitted more from the intervention than those with minor impairment. MBR significantly reduced sick leave in all participants. Hence, it is a profitable intervention from a societal point of view.

Trial registration

The trial of the evaluation study was retrospectively registered in the German Clinical Trials Register under trial number DRKS00015463 retrospectively (dated 4 Sept 2018).

The participation of Arab women in randomised clinical trials for cardiovascular diseases

INTRODUCTION

Women's enrolment in randomised clinical trials (RCTs) raises the attention of medical personnel and evidence-based medicine researchers to achieve the highest possible quality and transparency of conducted studies. This study aims to demonstrate various patterns and relationships of women's enrolment in cardiovascular RCTs conducted in Arab countries.

MATERIALS AND METHODS

Three databases (PubMed, Web of Science and Scopus) were accessed and searched for randomised clinical trials investigating cardiovascular diseases in Arab countries. Studies were screened, data were extracted and risk of bias of included studies was assessed independently by two sets of authors. The female to male ratio and the participation prevalence ratio (PPR) were calculated for each trial and the association of them with different variables were analysed.

RESULTS AND DISCUSSION

Of the 9071 patients enrolled in the 71 included RCTs, 38.02% were women. Various factors such as age of participants, publication year, therapeutic class, clinical indication, prevention type, and location of trial showed a significant association with the level of women enrolment in cardiovascular randomised clinical trials in Arab countries (P-value < .05). The median female to male ratio of all the trials was 0.55. The median female: male ratio varied by clinical indications (2.33 for valvular heart diseases vs 0.5 for stroke), intervention type (0.46 for surgical procedures vs 0.52 for drugs), prevention type (0.79 for secondary prevention, 0.74 for primary prevention and 0.52 for tertiary prevention), sample size (0.48 for Q1 vs 0.85 for Q2) and by age groups (0.98 for ages ≤50 years old vs 0.47 for 56-60 years old). Women were overrepresented in valvular heart disease trials (PPR = 1.37), and underrepresented in coronary artery disease, stroke and atrial fibrillation trials (PPR = 0.6, 0.63, and 0.71, respectively).

CONCLUSION

As a result of the huge importance of RCTs in the medical field, and to reduce biases arising from inaccurate representation of different study populations, women's enrolment in Arab cardiovascular trials should be pre-planned and based on the percentage of women among the studied disease population.

Obstructive Sleep Apnea compliance: verifications and validations of personalized interventions for PAP therapy

The Positive Airway Pressure (PAP) therapy is the most capable therapy against Obstruction Sleep Apnea (OSA). PAP therapy prevents the narrowing and collapsing of the soft tissues of the upper airway. A patient diagnosed with OSA is expected to use their CPAP machines every night for at least more than 4h for experiencing any clinical improvement. However, for the last two decades, trials were carried out to improve compliance and understand factors impacting compliance, but there were not enough conclusive results. With the advent of big data analytic and real-time monitoring, new opportunities open up to tackle this compliance issue. This paper's significant contribution is a novel framework that blends multiple external verification and validation carried out by different healthcare stakeholders. We provide a systematic verification and validation process to push towards explainable data analytic and automatic learning processes. We also present a complete mHealth solution that includes two mobile applications. The first application is for delivering tailored interventions directly to the patients. The second application is bound to different healthcare stakeholders for the verification and validation process.

Evidence based social science in China paper 2: The quality of social science RCTs published from 2000-2020

OBJECTIVE

This study collected randomized controlled trials (RCTs) published in the social sciences in China and assessed their risk of bias and reporting quality.

STUDY DESIGN AND SETTING

Three databases were systematically searched for publications from January 2000 to June 2020 for RCTs in the social sciences published by Chinese researchers. The risk of bias was assessed using the Cochrane Collaboration Risk of Bias Tool, and reporting quality was assessed using the Consolidated Standards of Reporting Trials for Social and Psychological Interventions (CONSORT-SPI).

RESULTS

A total of 316 RCTs were identified, including 204 articles in English and 112 articles in Chinese. The most frequently researched interventions focused on education (33.9%), and the most frequently studied population were students (32.9%). Eighty-seven percent of RCTs had intermediate reporting quality. Twenty-four of the 43 CONSORT-SPI sub-items had a compliance rate of less than 50%. Most RCTs had an unclear risk of bias for blinding outcome assessors (84.5%), blinding participants and personnel (82.9%), allocation concealment (73.1%), and random sequence generation (68.0%). A low proportion of CONSORT-SPI items were reported and, high proportion of the papers had unclear risk of bias.

CONCLUSION

The quality and reporting of RCTs in the social sciences needs improvement in China, especially for reporting methods and results. Most studies had an unclear risk of bias as they lacked important methodological information.

Effect of open versus closed endotracheal suctioning on intracranial pressure in severe brain-injured children: Study protocol for a randomized controlled trial

AIM

To compare the effects and safety of open and closed endotracheal suction in children with severe brain injury.

DESIGN

A single-blinding, single-centre randomized controlled trial (RCT).

METHODS

The children with severe brain injury admitted to the intensive care unit (ICU) from 1 September 2020-31 August 2022 will be included. And a total of 172 children with severe brain injury are expected to be included. The intracranial pressure, SpO₂ and heart rate before suctioning, at the end of suction, and at 5 and 10 min after suction, the estimated sputum volume for each suction, the incidence of ventilator-associated pneumonia, the duration of mechanical ventilation and the length of ICU stay will be analysed.

RESULTS

This present RCT has been prospectively registered in China Clinical Trial Registry (http://www.chictr.org.cn, ChiCTR2000030963). This present study is expected to provide reliable evidence to the airway management in children with severe brain injury.

A road map for designing and reporting clinical trials in paediatric dentistry

BACKGROUND

Unless clinical trials are well-designed, there is a risk that they will not be usable to improve patient care.

AIM

This paper discusses some factors important in designing clinical trials in paediatric dentistry. It uses the prevention and management of dental caries in children as the lens through which to look at these.

FINDINGS

Amongst the factors to consider are clear research questions and objectives; appropriate outcomes and outcome measures; sample size calculation and the level of randomisation; methods for random allocation; and operator/assessor training. Experts in trial design including statisticians and a trialist should be consulted early in the design process. The aspects of trial design unique to cariology trials such as 'clustering' of data items, mixed dentition issues and those related to trials involving children (communication, consent etc) should be considered. Comprehensive reporting of trial results is essential.

CONCLUSION

There are many readily available resources and tools to help the researcher design a trial of good quality that will yield results useful to the research community and beyond, to those who will implement the findings and ultimately those who will benefit from them.