A simple technique to identify key recruitment issues in randomised controlled trials: Q-QAT - Quanti-Qualitative Appointment Timing

Laparoscopic cholecystectomy versus conservative management for adults with uncomplicated symptomatic gallstones: the C-GALL RCT

Background

Gallstone disease is a common gastrointestinal disorder in industrialised societies. The prevalence of gallstones in the adult population is estimated to be approximately 10-15%, and around 80% remain asymptomatic. At present, cholecystectomy is the default option for people with symptomatic gallstone disease.

Objectives

To assess the clinical and cost-effectiveness of observation/conservative management compared with laparoscopic cholecystectomy for preventing recurrent symptoms and complications in adults presenting with uncomplicated symptomatic gallstones in secondary care.

Design

Parallel group, multicentre patient randomised superiority pragmatic trial with up to 24 months follow-up and embedded qualitative research. Within-trial cost-utility and 10-year Markov model analyses. Development of a core outcome set for uncomplicated symptomatic gallstone disease.

Setting

Secondary care elective settings.

Participants

Adults with symptomatic uncomplicated gallstone disease referred to a secondary care setting were considered for inclusion.

Interventions

Participants were randomised 1: 1 at clinic to receive either laparoscopic cholecystectomy or observation/conservative management.

Main outcome measures

The primary outcome was quality of life measured by area under the curve over 18 months using the Short Form-36 bodily pain domain. Secondary outcomes included the Otago gallstones' condition-specific questionnaire, Short Form-36 domains (excluding bodily pain), area under the curve over 24 months for Short Form-36 bodily pain domain, persistent symptoms, complications and need for further treatment. No outcomes were blinded to allocation.

Results

Between August 2016 and November 2019, 434 participants were randomised (217 in each group) from 20 United Kingdom centres. By 24 months, 64 (29.5%) in the observation/conservative management group and 153 (70.5%) in the laparoscopic cholecystectomy group had received surgery, median time to surgery of 9.0 months (interquartile range, 5.6-15.0) and 4.7 months (interquartile range 2.6-7.9), respectively. At 18 months, the mean Short Form-36 norm-based bodily pain score was 49.4 (standard deviation 11.7) in the observation/conservative management group and 50.4 (standard deviation 11.6) in the laparoscopic cholecystectomy group. The mean area under the curve over 18 months was 46.8 for both groups with no difference: mean difference -0.0, 95% confidence interval (-1.7 to 1.7); p-value 0.996; n = 203 observation/conservative, n = 205 cholecystectomy. There was no evidence of differences in quality of life, complications or need for further treatment at up to 24 months follow-up. Condition-specific quality of life at 24 months favoured cholecystectomy: mean difference 9.0, 95% confidence interval (4.1 to 14.0), p < 0.001 with a similar pattern for the persistent symptoms score. Within-trial cost-utility analysis found observation/conservative management over 24 months was less costly than cholecystectomy (mean difference -£1033). A non-significant quality-adjusted life-year difference of -0.019 favouring cholecystectomy resulted in an incremental cost-effectiveness ratio of £55,235. The Markov model continued to favour observation/conservative management, but some scenarios reversed the findings due to uncertainties in longer-term quality of life. The core outcome set included 11 critically important outcomes from both patients and healthcare professionals.

Conclusions

The results suggested that in the short term (up to 24 months) observation/conservative management may be a cost-effective use of National Health Service resources in selected patients, but subsequent surgeries in the randomised groups and differences in quality of life beyond 24 months could reverse this finding. Future research should focus on longer-term follow-up data and identification of the cohort of patients that should be routinely offered surgery.

Trial registration

This trial is registered as ISRCTN55215960.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 14/192/71) and is published in full in Health Technology Assessment; Vol. 28, No. 26. See the NIHR Funding and Awards website for further award information.

Editor's Choice - Bypass versus Angioplasty for Severe Ischaemia of the Leg (BASIL) Prospective Cohort Study and the Generalisability of the BASIL-2 Randomised Controlled Trial

OBJECTIVE

The Bypass versus Angioplasty in Severe Ischaemia of the Leg-2 (BASIL-2) randomised controlled trial has shown that, for patients with chronic limb threatening ischaemia (CLTI) who require an infrapopliteal (IP) revascularisation a vein bypass (VB) first revascularisation strategy led to a 35% increased risk of major amputation or death when compared with a best endovascular treatment (BET) first revascularisation strategy. The study aims are to place the BASIL-2 trial within the context of the CLTI patient population as a whole and to investigate the generalisability of the BASIL-2 outcome data.

METHODS

This was an observational, single centre prospective cohort study. Between 24 June 2014 and 31 July 2018, the BASIL Prospective Cohort Study (PCS) was performed which used BASIL-2 trial case record forms to document the characteristics, initial and subsequent management, and outcomes of 471 consecutive CLTI patients admitted to an academic vascular centre. Ethical approval was obtained, and all patients provided fully informed written consent. Follow up data were censored on 14 December 2022.

RESULTS

Of the 238 patients who required an infrainguinal revascularisation, 75 (32%) had either IP bypass (39 patients) or IP BET (36 patients) outside BASIL-2. Seventeen patients were initially randomised to BASIL-2. A further three patients who did not have an IP revascularisation as their initial management were later randomised in BASIL-2. Therefore, 95/471 (20%) of patients had IP revascularisation (16% outside, 4% inside BASIL-2). Differences in amputation free survival, overall survival, and limb salvage between IP bypass and IP BET performed outside BASIL-2 were not subject to hypothesis testing due to the small sample size. Reasons for non-randomisation into the trial were numerous, but often due to anatomical and technical considerations.

CONCLUSION

CLTI patients who required an IP revascularisation procedure and were subsequently randomised into BASIL-2 accounted for a small subset of the CLTI population as a whole. For a wide range of patient, limb, anatomical and operational reasons, most patients in this cohort were deemed unsuitable for randomisation in BASIL-2. The results of BASIL-2 should be interpreted in this context.

Proper understanding of recurrent stress urinary incontinence treatment in women (PURSUIT): a randomised controlled trial of endoscopic and surgical treatment

BACKGROUND

Women with stress urinary incontinence (SUI) experience urine leakage with physical activity. Currently, the interventional treatments for SUI are surgical, or endoscopic bulking injection(s). However, these procedures are not always successful, and symptoms can persist or come back after treatment, categorised as recurrent SUI. There are longstanding symptoms and distress associated with a failed primary treatment, and currently, there is no consensus on how best to treat women with recurrent, or persistent, SUI.

METHODS

A two-arm trial, set in at least 20 National Health Service (NHS) urology and urogynaecology referral units in the UK, randomising 250 adult women with recurrent or persistent SUI 1:1 to receive either an endoscopic intervention (endoscopic bulking injections) or a standard NHS surgical intervention, currently colposuspension, autologous fascial sling or artificial urinary sphincter. The aim of the trial is to determine whether surgical treatment is superior to endoscopic bulking injections in terms of symptom severity at 1 year after randomisation. This primary outcome will be measured using the patient-reported International Consultation on Incontinence Questionnaire - Urinary Incontinence - Short Form (ICIQ-UI-SF). Secondary outcomes include assessment of longer-term clinical impact, improvement of symptoms, safety, operative assessments, sexual function, cost-effectiveness and an evaluation of patients' and clinicians' views and experiences of the interventions.

DISCUSSION

There is a lack of high-quality, randomised, scientific evidence for which treatment is best for women presenting with recurrent SUI. The PURSUIT study will benefit healthcare professionals and patients and provide robust evidence to guide further treatment and improve symptoms and quality of life for women with this condition.

TRIAL REGISTRATION

International Standard Randomised Controlled Trials Number (ISRCTN) registry ISRCTN12201059. Registered on 09 January 2020.

Generalizability and reach of a randomized controlled trial to improve oral health among home care recipients: comparing participants and nonparticipants at baseline and during follow-up

Background

The generalizability of randomized controlled trials (RCTs) with a low response can be limited by systematic differences between participants and nonparticipants. This participation bias, however, is rarely investigated because data on nonparticipants is usually not available. The purpose of this article is to compare all participants and nonparticipants of a RCT to improve oral health among home care recipients at baseline and during follow-up using claims data.

Methods

Seven German statutory health and long-term care insurance funds invited 9656 home care recipients to participate in the RCT MundPflege. Claims data for all participants (n = 527, 5.5% response) and nonparticipants (n = 9129) were analyzed. Associations between trial participation and sex, age, care dependency, number of Elixhauser diseases, and dementia, as well as nursing, medical, and dental care utilization at baseline, were investigated using multivariable logistic regression. Associations between trial participation and the probability of (a) moving into a nursing home, (b) being hospitalized, and (c) death during 1 year of follow-up were examined via Cox proportional hazards regressions, controlling for baseline variables.

Results

At baseline, trial participation was positively associated with male sex (odds ratio 1.29 [95% confidence interval 1.08–1.54]), high (vs. low 1.46 [1.15–1.86]) care dependency, receiving occasional in-kind benefits to relieve caring relatives (1.45 [1.15–1.84]), having a referral by a general practitioner to a medical specialist (1.62 [1.21–2.18]), and dental care utilization (2.02 [1.67–2.45]). It was negatively associated with being 75–84 (vs. < 60 0.67 [0.50–0.90]) and 85 + (0.50 [0.37–0.69]) years old. For morbidity, hospitalizations, and formal, respite, short-term, and day or night care, no associations were found. During follow-up, participants were less likely to move into a nursing home than nonparticipants (hazard ratio 0.50 [0.32–0.79]). For hospitalizations and mortality, no associations were found.

Conclusions

For half of the comparisons, differences between participants and nonparticipants were observed. The RCT’s generalizability is limited, but to a smaller extent than one would expect because of the low response. Routine data provide a valuable source for investigating potential differences between trial participants and nonparticipants, which might be used by future RCTs to evaluate the generalizability of their findings.

Trial registration

German Clinical Trials Register DRKS00013517. Retrospectively registered on June 11, 2018.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-022-06470-y.

Patient Information and Informed Consent for Research in the Elderly: Lessons Learned from a Randomized Controlled Trial

The informed consent (IC) of subjects participating in experimental studies is the mainstay to comply with the ethical principle of autonomy to ensure that the participation is voluntary. This experience was performed within the context of a single-center randomized clinical trial in elective prosthetic surgery. Obtaining IC in clinical trials is not without difficulties, and especially in the case of vulnerable populations it can be very challenging. This work aimed to identify the difficulties during the IC process for a clinical trial in subjects older than 65 years old and quantify and describe the use of IC in front of a witness. Methods: This is a mixed methodology study with a qualitative part (focus group with 4 nurses involved in the inclusion of subjects) and a quantitative part describing the characteristics of patients who signed IC forms. Results: The main difficulties identified are related to comprehension, sensory impairments, education level, and time. IC in front of witnesses was used in 20 patients out of 508. Conclusions: The participation of subjects older than 65 years old in clinical trials requires an adaptation of the process. The use of IC in front of a witness should always be considered in studies including elderly subjects.

Arthroscopic hip surgery compared with personalised hip therapy in people over 16 years old with femoroacetabular impingement syndrome: UK FASHIoN RCT

BACKGROUND

Femoroacetabular impingement syndrome is an important cause of hip pain in young adults. It can be treated by arthroscopic hip surgery or with physiotherapist-led conservative care.

OBJECTIVE

To compare the clinical effectiveness and cost-effectiveness of hip arthroscopy with best conservative care.

DESIGN

The UK FASHIoN (full trial of arthroscopic surgery for hip impingement compared with non-operative care) trial was a pragmatic, multicentre, randomised controlled trial that was carried out at 23 NHS hospitals.

PARTICIPANTS

Participants were included if they had femoroacetabular impingement, were aged ≥ 16 years old, had hip pain with radiographic features of cam or pincer morphology (but no osteoarthritis) and were believed to be likely to benefit from hip arthroscopy.

INTERVENTION

Participants were randomly allocated (1 : 1) to receive hip arthroscopy followed by postoperative physiotherapy, or personalised hip therapy (i.e. an individualised physiotherapist-led programme of conservative care). Randomisation was stratified by impingement type and recruiting centre using a central telephone randomisation service. Outcome assessment and analysis were masked.

MAIN OUTCOME MEASURE

The primary outcome was hip-related quality of life, measured by the patient-reported International Hip Outcome Tool (iHOT-33) 12 months after randomisation, and analysed by intention to treat.

RESULTS

Between July 2012 and July 2016, 648 eligible patients were identified and 348 participants were recruited. In total, 171 participants were allocated to receive hip arthroscopy and 177 participants were allocated to receive personalised hip therapy. Three further patients were excluded from the trial after randomisation because they did not meet the eligibility criteria. Follow-up at the primary outcome assessment was 92% (N = 319; hip arthroscopy, n = 157; personalised hip therapy, n = 162). At 12 months, mean International Hip Outcome Tool (iHOT-33) score had improved from 39.2 (standard deviation 20.9) points to 58.8 (standard deviation 27.2) points for participants in the hip arthroscopy group, and from 35.6 (standard deviation 18.2) points to 49.7 (standard deviation 25.5) points for participants in personalised hip therapy group. In the primary analysis, the mean difference in International Hip Outcome Tool scores, adjusted for impingement type, sex, baseline International Hip Outcome Tool score and centre, was 6.8 (95% confidence interval 1.7 to 12.0) points in favour of hip arthroscopy (p = 0.0093). This estimate of treatment effect exceeded the minimum clinically important difference (6.1 points). Five (83%) of six serious adverse events in the hip arthroscopy group were related to treatment and one serious adverse event in the personalised hip therapy group was not. Thirty-eight (24%) personalised hip therapy patients chose to have hip arthroscopy between 1 and 3 years after randomisation. Nineteen (12%) hip arthroscopy patients had a revision arthroscopy. Eleven (7%) personalised hip therapy patients and three (2%) hip arthroscopy patients had a hip replacement within 3 years.

LIMITATIONS

Study participants and treating clinicians were not blinded to the intervention arm. Delays were encountered in participants accessing treatment, particularly surgery. Follow-up lasted for 3 years.

CONCLUSION

Hip arthroscopy and personalised hip therapy both improved hip-related quality of life for patients with femoroacetabular impingement syndrome. Hip arthroscopy led to a greater improvement in quality of life than personalised hip therapy, and this difference was clinically significant at 12 months. This study does not demonstrate cost-effectiveness of hip arthroscopy compared with personalised hip therapy within the first 12 months. Further follow-up will reveal whether or not the clinical benefits of hip arthroscopy are maintained and whether or not it is cost-effective in the long term.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN64081839.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 16. See the NIHR Journals Library website for further project information.

Ondansetron and metoclopramide as second-line antiemetics in women with nausea and vomiting in pregnancy: the EMPOWER pilot factorial RCT

BACKGROUND

Around one-third of pregnant women suffer from moderate to severe nausea and vomiting, causing physical and emotional distress and reducing their quality of life. There is no cure for nausea and vomiting in pregnancy. Management focuses on relieving symptoms and preventing morbidity, and often requires antiemetic therapy. National guidelines make recommendations about first-, second- and third-line antiemetic therapies, although care varies in different hospitals and women report feeling unsupported, dissatisfied and depressed.

OBJECTIVES

To determine whether or not, in addition to intravenous rehydration, ondansetron compared with no ondansetron and metoclopramide compared with no metoclopramide reduced the rate of treatment failure up to 10 days after drug initiation; improved symptom severity at 2, 5 and 10 days after drug initiation; improved quality of life at 10 days after drug initiation; and had an acceptable side effect and safety profile. To estimate the incremental cost per treatment failure avoided and the net monetary benefits from the perspectives of the NHS and women.

DESIGN

This was a multicentre, double-dummy, randomised, double-blinded, dummy-controlled 2 × 2 factorial trial (with an internal pilot phase), with qualitative and health economic evaluations.

PARTICIPANTS

Thirty-three patients (who were < 17 weeks pregnant and who attended hospital with nausea and vomiting after little or no improvement with first-line antiemetic medication) who attended 12 secondary care NHS trusts in England, 22 health-care professionals and 21 women participated in the qualitative evaluation.

INTERVENTIONS

Participants were randomly allocated to one of four treatment groups (1 : 1 : 1: 1 ratio): (1) metoclopramide and dummy ondansetron; (2) ondansetron and dummy metoclopramide; (3) metoclopramide and ondansetron; or (4) double dummy. Trial medication was initially given intravenously and then continued orally once women were able to tolerate oral fluids for a maximum of 10 days of treatment.

MAIN OUTCOME MEASURES

The primary end point was the number of participants who experienced treatment failure, which was defined as the need for further treatment because symptoms had worsened between 12 hours and 10 days post treatment. The main economic outcomes were incremental cost per additional successful treatment and incremental net benefit.

RESULTS

Of the 592 patients screened, 122 were considered eligible and 33 were recruited into the internal pilot (metoclopramide and dummy ondansetron, n = 8; ondansetron and dummy metoclopramide, n = 8; metoclopramide and ondansetron, n = 8; double dummy, n = 9). Owing to slow recruitment, the trial did not progress beyond the pilot. Fifteen out of 30 evaluable participants experienced treatment failure. No statistical analyses were performed. The main reason for ineligibility was prior treatment with trial drugs, reflecting an unpredicted change in prescribing practice at several points along the care pathway. The qualitative evaluation identified the requirements of the study protocol, in relation to guidelines on anti-sickness drugs, and the diversity of pathways to care as key hurdles to recruitment while the role of research staff was a key enabler. No important adverse events or side effects were reported.

LIMITATIONS

The pilot trial failed to achieve the recruitment target owing to unforeseen changes in the provision of care.

CONCLUSIONS

The trial was unable to provide evidence to support clinician decisions about the best choice of second-line antiemetic for nausea and vomiting in pregnancy.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN16924692 and EudraCT 2017-001651-31.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 25, No. 63. See the NIHR Journals Library website for further project information.

The challenge of equipoise in trials with a surgical and non-surgical comparison: a qualitative synthesis using meta-ethnography

BACKGROUND

Randomised controlled trials in surgery can be a challenge to design and conduct, especially when including a non-surgical comparison. As few as half of initiated surgical trials reach their recruitment target, and failure to recruit is cited as the most frequent reason for premature closure of surgical RCTs. The aim of this qualitative evidence synthesis was to identify and synthesise findings from qualitative studies exploring the challenges in the design and conduct of trials directly comparing surgical and non-surgical interventions.

METHODS

A qualitative evidence synthesis using meta-ethnography was conducted. Six electronic bibliographic databases (Medline, Central, Cinahl, Embase and PsycInfo) were searched up to the end of February 2018. Studies that explored patients' and health care professionals' experiences regarding participating in RCTs with a surgical and non-surgical comparison were included. The GRADE-CERQual framework was used to assess confidence in review findings.

RESULTS

In total, 3697 abstracts and 49 full texts were screened and 26 published studies reporting experiences of patients and healthcare professionals were included. The focus of the studies (24/26) was primarily related to the challenge of recruitment. Two studies explored reasons for non-compliance to treatment allocation following randomisation. Five themes related to the challenges to these types of trials were identified: (1) radical choice between treatments; (2) patients' discomfort with randomisation: I want the best treatment for me as an individual; (3) challenge of equipoise: patients' a priori preferences for treatment; (4) challenge of equipoise: clinicians' a priori preferences for treatment and (5) imbalanced presentation of interventions.

CONCLUSION

The marked dichotomy between the surgical and non-surgical interventions was highlighted in this review as making recruitment to these types of trials particularly challenging. This review identified factors that increase our understanding of why patients and clinicians may find equipoise more challenging in these types of trials compared to other trial comparisons. Trialists may wish to consider exploring the balance of potential factors influencing patient and clinician preferences towards treatments before they start recruitment, to enable issues specific to a particular trial to be identified and addressed. This may enable trial teams to make more efficient considered design choices and benefit the delivery of such trials.

Active monitoring, radical prostatectomy and radical radiotherapy in PSA-detected clinically localised prostate cancer: the ProtecT three-arm RCT

BACKGROUND

Prostate cancer is the most common cancer among men in the UK. Prostate-specific antigen testing followed by biopsy leads to overdetection, overtreatment as well as undertreatment of the disease. Evidence of treatment effectiveness has lacked because of the paucity of randomised controlled trials comparing conventional treatments.

OBJECTIVES

To evaluate the effectiveness of conventional treatments for localised prostate cancer (active monitoring, radical prostatectomy and radical radiotherapy) in men aged 50-69 years.

DESIGN

A prospective, multicentre prostate-specific antigen testing programme followed by a randomised trial of treatment, with a comprehensive cohort follow-up.

SETTING

Prostate-specific antigen testing in primary care and treatment in nine urology departments in the UK.

PARTICIPANTS

Between 2001 and 2009, 228,966 men aged 50-69 years received an invitation to attend an appointment for information about the Prostate testing for cancer and Treatment (ProtecT) study and a prostate-specific antigen test; 82,429 men were tested, 2664 were diagnosed with localised prostate cancer, 1643 agreed to randomisation to active monitoring (n = 545), radical prostatectomy (n = 553) or radical radiotherapy (n = 545) and 997 chose a treatment.

INTERVENTIONS

The interventions were active monitoring, radical prostatectomy and radical radiotherapy.

TRIAL PRIMARY OUTCOME MEASURE

Definite or probable disease-specific mortality at the 10-year median follow-up in randomised participants.

SECONDARY OUTCOME MEASURES

Overall mortality, metastases, disease progression, treatment complications, resource utilisation and patient-reported outcomes.

RESULTS

There were no statistically significant differences between the groups for 17 prostate cancer-specific (p = 0.48) and 169 all-cause (p = 0.87) deaths. Eight men died of prostate cancer in the active monitoring group (1.5 per 1000 person-years, 95% confidence interval 0.7 to 3.0); five died of prostate cancer in the radical prostatectomy group (0.9 per 1000 person-years, 95% confidence interval 0.4 to 2.2 per 1000 person years) and four died of prostate cancer in the radical radiotherapy group (0.7 per 1000 person-years, 95% confidence interval 0.3 to 2.0 per 1000 person years). More men developed metastases in the active monitoring group than in the radical prostatectomy and radical radiotherapy groups: active monitoring, n = 33 (6.3 per 1000 person-years, 95% confidence interval 4.5 to 8.8); radical prostatectomy, n = 13 (2.4 per 1000 person-years, 95% confidence interval 1.4 to 4.2 per 1000 person years); and radical radiotherapy, n = 16 (3.0 per 1000 person-years, 95% confidence interval 1.9 to 4.9 per 1000 person-years; p = 0.004). There were higher rates of disease progression in the active monitoring group than in the radical prostatectomy and radical radiotherapy groups: active monitoring (n = 112; 22.9 per 1000 person-years, 95% confidence interval 19.0 to 27.5 per 1000 person years); radical prostatectomy (n = 46; 8.9 per 1000 person-years, 95% confidence interval 6.7 to 11.9 per 1000 person-years); and radical radiotherapy (n = 46; 9.0 per 1000 person-years, 95% confidence interval 6.7 to 12.0 per 1000 person years; p < 0.001). Radical prostatectomy had the greatest impact on sexual function/urinary continence and remained worse than radical radiotherapy and active monitoring. Radical radiotherapy's impact on sexual function was greatest at 6 months, but recovered somewhat in the majority of participants. Sexual and urinary function gradually declined in the active monitoring group. Bowel function was worse with radical radiotherapy at 6 months, but it recovered with the exception of bloody stools. Urinary voiding and nocturia worsened in the radical radiotherapy group at 6 months but recovered. Condition-specific quality-of-life effects mirrored functional changes. No differences in anxiety/depression or generic or cancer-related quality of life were found. At the National Institute for Health and Care Excellence threshold of £20,000 per quality-adjusted life-year, the probabilities that each arm was the most cost-effective option were 58% (radical radiotherapy), 32% (active monitoring) and 10% (radical prostatectomy).

LIMITATIONS

A single prostate-specific antigen test and transrectal ultrasound biopsies were used. There were very few non-white men in the trial. The majority of men had low- and intermediate-risk disease. Longer follow-up is needed.

CONCLUSIONS

At a median follow-up point of 10 years, prostate cancer-specific mortality was low, irrespective of the assigned treatment. Radical prostatectomy and radical radiotherapy reduced disease progression and metastases, but with side effects. Further work is needed to follow up participants at a median of 15 years.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN20141297.

FUNDING

This project was funded by the National Institute for Health Research Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 37. See the National Institute for Health Research Journals Library website for further project information.

Liver resection surgery compared with thermal ablation in high surgical risk patients with colorectal liver metastases: the LAVA international RCT

BACKGROUND

Although surgical resection has been considered the only curative option for colorectal liver metastases, thermal ablation has recently been suggested as an alternative curative treatment. There have been no adequately powered trials comparing surgery with thermal ablation.

OBJECTIVES

Main objective - to compare the clinical effectiveness and cost-effectiveness of thermal ablation versus liver resection surgery in high surgical risk patients who would be eligible for liver resection. Pilot study objectives - to assess the feasibility of recruitment (through qualitative study), to assess the quality of ablations and liver resection surgery to determine acceptable standards for the main trial and to centrally review the reporting of computed tomography scan findings relating to ablation and outcomes and recurrence rate in both arms.

DESIGN

A prospective, international (UK and the Netherlands), multicentre, open, pragmatic, parallel-group, randomised controlled non-inferiority trial with a 1-year internal pilot study.

SETTING

Tertiary liver, pancreatic and gallbladder (hepatopancreatobiliary) centres in the UK and the Netherlands.

PARTICIPANTS

Adults with a specialist multidisciplinary team diagnosis of colorectal liver metastases who are at high surgical risk because of their age, comorbidities or tumour burden and who would be suitable for liver resection or thermal ablation.

INTERVENTIONS

Thermal ablation conducted as per local policy (but centres were encouraged to recruit within Cardiovascular and Interventional Radiological Society of Europe guidelines) versus surgical liver resection performed as per centre protocol.

MAIN OUTCOME MEASURES

Pilot study - patients' and clinicians' acceptability of the trial to assist in optimisation of recruitment. Primary outcome - disease-free survival at 2 years post randomisation. Secondary outcomes - overall survival, timing and site of recurrence, additional therapy after treatment failure, quality of life, complications, length of hospital stay, costs, trial acceptability, and disease-free survival measured from end of intervention. It was planned that 5-year survival data would be documented through record linkage. Randomisation was performed by minimisation incorporating a random element, and this was a non-blinded study.

RESULTS

In the pilot study over 1 year, a total of 366 patients with colorectal liver metastases were screened and 59 were considered eligible. Only nine participants were randomised. The trial was stopped early and none of the planned statistical analyses was performed. The key issues inhibiting recruitment included fewer than anticipated patients eligible for both treatments, misconceptions about the eligibility criteria for the trial, surgeons' preference for one of the treatments ('lack of clinical equipoise' among some of the surgeons in the centre) with unconscious bias towards surgery, patients' preference for one of the treatments, and lack of dedicated research nurses for the trial.

CONCLUSIONS

Recruitment feasibility was not demonstrated during the pilot stage of the trial; therefore, the trial closed early. In future, comparisons involving two very different treatments may benefit from an initial feasibility study or a longer period of internal pilot study to resolve these difficulties. Sufficient time should be allowed to set up arrangements through National Institute for Health Research (NIHR) Research Networks.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN52040363.

FUNDING

This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 21. See the NIHR Journals Library website for further project information.

Nasal Airway Obstruction Study (NAIROS): a phase III, open-label, mixed-methods, multicentre randomised controlled trial of septoplasty versus medical management of a septal deviation with nasal obstruction

BACKGROUND

Septoplasty (surgery to straighten a deviation in the nasal septum) is a frequently performed operation worldwide, with approximately 250,000 performed annually in the US and 22,000 in the UK. Most septoplasties aim to improve diurnal and nocturnal nasal obstruction. The evidence base for septoplasty clinical effectiveness is hitherto very limited.

AIMS

To establish, and inform guidance for, the best management strategy for individuals with nasal obstruction associated with a deviated septum.

METHODS/DESIGN

A multicentre, mixed-methods, open label, randomised controlled trial of septoplasty versus medical management for adults with a deviated septum and a reduced nasal airway. Eligible patients will have septal deflection visible at nasendoscopy and a nasal symptom score ≥ 30 on the NOSE questionnaire. Surgical treatment comprises septoplasty with or without reduction of the inferior nasal turbinate on the anatomically wider side of the nose. Medical management comprises a nasal saline spray followed by a fluorinated steroid spray daily for six months. The recruitment target is 378 patients, recruited from up to 17 sites across Scotland, England and Wales. Randomisation will be on a 1:1 basis, stratified by gender and severity (NOSE score). Participants will be followed up for 12 months post randomisation. The primary outcome measure is the total SNOT-22 score at 6 months. Clinical and economic outcomes will be modelled against baseline severity (NOSE scale) to inform clinical decision-making. The study includes a recruitment enhancement process, and an economic evaluation.

DISCUSSION

The NAIROS trial will evaluate the clinical effectiveness and cost-effectiveness of septoplasty versus medical management for adults with a deviated septum and symptoms of nasal blockage. Identifying those individuals most likely to benefit from surgery should enable more efficient and effective clinical decision-making, and avoid unnecessary operations where there is low likelihood of patient benefit.

TRIAL REGISTRATION

EudraCT: 2017-000893-12, ISRCTN: 16168569. Registered on 24 March 2017.

Intensive Triangulation of Qualitative Research and Quantitative Data to Improve Recruitment to Randomized Trials: The QuinteT Approach

Randomized controlled trials (RCTs) can provide high quality evidence about the comparative effectiveness of health care interventions, but many RCTs struggle with or fail to complete recruitment. RCTs are built on the principles of the experimental method, but their planning, conduct, and interpretation can depend on complex social, behavioral, and cultural factors that may be best understood through qualitative research. Most qualitative studies undertaken alongside RCTs involve interviews that produce data that are used in a supportive or supplicatory role, but there is potential for qualitative research to be more influential. In this article, we describe the research methods underpinning the "QuinteT" (Qualitative Research Integrated Within Trials) approach to understand and address RCT recruitment difficulties. The QuinteT Recruitment Intervention (QRI) brings together multiple qualitative strategies and quantitative data and uses triangulation to understand recruitment issues rapidly. These nuanced understandings are used to inform the implementation of collaborative actions to improve recruitment.

Overcoming difficulties with equipoise to enable recruitment to a randomised controlled trial of partial ablation vs radical prostatectomy for unilateral localised prostate cancer

OBJECTIVE

To describe how clinicians conceptualised equipoise in the PART (Partial prostate Ablation vs Radical prosTatectomy in intermediate-risk unilateral clinically localised prostate cancer) feasibility study and how this affected recruitment.

SUBJECTS AND METHODS

PART included a QuinteT Recruitment Intervention (QRI) to optimise recruitment. Phase I aimed to understand recruitment, and included: scrutinising recruitment data, interviewing the trial management group and recruiters (n = 13), and audio-recording recruitment consultations (n = 64). Data were analysed using qualitative content and thematic analysis methods. In Phase II, strategies to improve recruitment were developed and delivered.

RESULTS

Initially many recruiters found it difficult to maintain a position of equipoise and held preconceptions about which treatment was best for particular patients. They did not feel comfortable about approaching all eligible patients, and when the study was discussed, biases were conveyed through the use of terminology, poorly balanced information, and direct treatment recommendations. Individual and group feedback led to presentations to patients becoming clearer and enabled recruiters to reconsider their sense of equipoise. Although the precise impact of the QRI alone cannot be determined, recruitment increased (from a mean [range] of 1.4 [0-4] to 4.5 [0-12] patients/month) and the feasibility study reached its recruitment target.

CONCLUSION

Although clinicians find it challenging to recruit patients to a trial comparing different contemporary treatments for prostate cancer, training and support can enable recruiters to become more comfortable with conveying equipoise and providing clearer information to patients.

Evaluating the social fitness Programme for older people with cognitive problems and their caregivers: lessons learned from a failed trial

Background

This process evaluation article describes the lessons learned from a failed trial which aimed to assess effectiveness of the tailor-made, multidisciplinary Social Fitness Programme to improve social participation of community-dwelling older people with cognitive problems (clients) and their caregivers (couples).

Methods

A process evaluation was performed to get insight in 1) the implementation of the intervention, 2) the context of intervention delivery from professionals’ point of view, and 3) the potential impact of intervention delivery from participants’ perspectives. Data was gathered using mixed-methods: questionnaires, focus group discussions, interviews, medical records.

Results

1) Implementation. High study decline (65,3%) was mainly caused by a lack of internal motivation to increase social participation expressed by clients. 17 couples participated, however, intervention delivery was insufficient. 2) Context. Barriers during intervention delivery were most often related to client (changing needs), caregiver (increased burden) and health professional factors (delivery of integrated care lacked routine). 3) Impact Qualitative analyses revealed participants to be satisfied with intervention delivery, we were unable to capture these results through our primary outcome measure.

Conclusions

This process evaluation revealed the Social Fitness study did not fit in three ways. First, framing the intervention on social participation promotion was as threatening to clients. The feeling of being unable to adequately contribute to social interactions seemed to be causing embarrassment. Second, the intervention seemed to be too complex to implement in the way it was designed. Third, there is a tension between the offering of a personalised tailor-made intervention and evaluation through a fixed study design.

Trial registration

The trial which is evaluated in this article (the Social Fitness study) is registered with the Dutch Trial Register (NTR), clinical trial number NTR4347.

Electronic supplementary material

The online version of this article (10.1186/s12877-018-0927-8) contains supplementary material, which is available to authorized users.

An observational study showed that explaining randomization using gambling-related metaphors and computer-agency descriptions impeded randomized clinical trial recruitment

OBJECTIVES

To explore how the concept of randomization is described by clinicians and understood by patients in randomized controlled trials (RCTs) and how it contributes to patient understanding and recruitment.

STUDY DESIGN AND SETTING

Qualitative analysis of 73 audio recordings of recruitment consultations from five, multicenter, UK-based RCTs with identified or anticipated recruitment difficulties.

RESULTS

One in 10 appointments did not include any mention of randomization. Most included a description of the method or process of allocation. Descriptions often made reference to gambling-related metaphors or similes, or referred to allocation by a computer. Where reference was made to a computer, some patients assumed that they would receive the treatment that was "best for them". Descriptions of the rationale for randomization were rarely present and often only came about as a consequence of patients questioning the reason for a random allocation.

CONCLUSIONS

The methods and processes of randomization were usually described by recruiters, but often without clarity, which could lead to patient misunderstanding. The rationale for randomization was rarely mentioned. Recruiters should avoid problematic gambling metaphors and illusions of agency in their explanations and instead focus on clearer descriptions of the rationale and method of randomization to ensure patients are better informed about randomization and RCT participation.

Informed consent in randomised controlled trials: development and preliminary evaluation of a measure of Participatory and Informed Consent (PIC)

BACKGROUND

Informed consent (IC) is an ethical and legal prerequisite for trial participation, yet current approaches evaluating participant understanding for IC during recruitment lack consistency. No validated measure has been identified that evaluates participant understanding for IC based on their contributions during consent interactions. This paper outlines the development and formative evaluation of the Participatory and Informed Consent (PIC) measure for application to recorded recruitment appointments. The PIC allows the evaluation of recruiter information provision and evidence of participant understanding.

METHODS

Published guidelines for IC were reviewed to identify potential items for inclusion. Seventeen purposively sampled trial recruitment appointments from three diverse trials were reviewed to identify the presence of items relevant to IC. A developmental version of the measure (DevPICv1) was drafted and applied to six further recruitment appointments from three further diverse trials to evaluate feasibility, validity, stability and inter-rater reliability. Findings guided revision of the measure (DevPICv2) which was applied to six further recruitment appointments as above.

RESULTS

DevPICv1 assessed recruiter information provision (detail and clarity assessed separately) and participant talk (detail and understanding assessed separately) over 20 parameters (or 23 parameters for three-arm trials). Initial application of the measure to six diverse recruitment appointments demonstrated promising stability and inter-rater reliability but a need to simplify the measure to shorten time for completion. The revised measure (DevPICv2) combined assessment of detail and clarity of recruiter information and detail and evidence of participant understanding into two single scales for application to 22 parameters or 25 parameters for three-arm trials. Application of DevPICv2 to six further diverse recruitment appointments showed considerable improvements in feasibility (e.g. time to complete) with good levels of stability (i.e. test-retest reliability) and inter-rater reliability maintained.

CONCLUSIONS

The DevPICv2 provides a measure for application to trial recruitment appointments to evaluate quality of recruiter information provision and evidence of patient understanding and participation during IC discussions. Initial evaluation shows promising feasibility, validity, reliability and ability to discriminate across a range of recruiter practice and evidence of participant understanding. More validation work is needed in new clinical trials to evaluate and refine the measure further.

Enabling recruitment success in bariatric surgical trials: pilot phase of the By-Band-Sleeve study

Background:

Randomized controlled trials (RCTs) involving surgical procedures are challenging for recruitment and infrequent in the specialty of bariatrics. The pilot phase of the By-Band-Sleeve study (gastric bypass versus gastric band versus sleeve gastrectomy) provided the opportunity for an investigation of recruitment using a qualitative research integrated in trials (QuinteT) recruitment intervention (QRI).

Patients/Methods:

The QRI investigated recruitment in two centers in the pilot phase comparing bypass and banding, through the analysis of 12 in-depth staff interviews, 84 audio recordings of patient consultations, 19 non-participant observations of consultations and patient screening data. QRI findings were developed into a plan of action and fed back to centers to improve information provision and recruitment organization.

Results:

Recruitment proved to be extremely difficult with only two patients recruited during the first 2 months. The pivotal issue in Center A was that an effective and established clinical service could not easily adapt to the needs of the RCT. There was little scope to present RCT details or ensure efficient eligibility assessment, and recruiters struggled to convey equipoise. Following presentation of QRI findings, recruitment in Center A increased from 9% in the first 2 months (2/22) to 40% (26/65) in the 4 months thereafter. Center B, commencing recruitment 3 months after Center A, learnt from the emerging issues in Center A and set up a special clinic for trial recruitment. The trial successfully completed pilot recruitment and progressed to the main phase across 11 centers.

Conclusions:

The QRI identified key issues that enabled the integration of the trial into the clinical setting. This contributed to successful recruitment in the By-Band-Sleeve trial—currently the largest in bariatric practice—and offers opportunities to optimize recruitment in other trials in bariatrics.

Conveying Equipoise during Recruitment for Clinical Trials: Qualitative Synthesis of Clinicians' Practices across Six Randomised Controlled Trials

BACKGROUND

Randomised controlled trials (RCTs) are essential for evidence-based medicine and increasingly rely on front-line clinicians to recruit eligible patients. Clinicians' difficulties with negotiating equipoise is assumed to undermine recruitment, although these issues have not yet been empirically investigated in the context of observable events. We aimed to investigate how clinicians conveyed equipoise during RCT recruitment appointments across six RCTs, with a view to (i) identifying practices that supported or hindered equipoise communication and (ii) exploring how clinicians' reported intentions compared with their actual practices.

METHODS AND FINDINGS

Six pragmatic UK-based RCTs were purposefully selected to include several clinical specialties (e.g., oncology, surgery) and types of treatment comparison. The RCTs were all based in secondary-care hospitals (n = 16) around the UK. Clinicians recruiting to the RCTs were interviewed (n = 23) to understand their individual sense of equipoise about the RCT treatments and their intentions for communicating equipoise to patients. Appointments in which these clinicians presented the RCT to trial-eligible patients were audio-recorded (n = 105). The appointments were analysed using thematic and content analysis approaches to identify practices that supported or challenged equipoise communication. A sample of appointments was independently coded by three researchers to optimise reliability in reported findings. Clinicians and patients provided full written consent to be interviewed and have appointments audio-recorded. Interviews revealed that clinicians' sense of equipoise varied: although all were uncertain about which trial treatment was optimal, they expressed different levels of uncertainty, ranging from complete ambivalence to clear beliefs that one treatment was superior. Irrespective of their personal views, all clinicians intended to set their personal biases aside to convey trial treatments neutrally to patients (in accordance with existing evidence). However, equipoise was omitted or compromised in 48/105 (46%) of the recorded appointments. Three commonly recurring practices compromised equipoise communication across the RCTs, irrespective of clinical context. First, equipoise was overridden by clinicians offering treatment recommendations when patients appeared unsure how to proceed or when they asked for the clinician's expert advice. Second, clinicians contradicted equipoise by presenting imbalanced descriptions of trial treatments that conflicted with scientific information stated in the RCT protocols. Third, equipoise was undermined by clinicians disclosing their personal opinions or predictions about trial outcomes, based on their intuition and experience. These broad practices were particularly demonstrated by clinicians who had indicated in interviews that they held less balanced views about trial treatments. A limitation of the study was that clinicians volunteering to take part in the research might have had a particular interest in improving their communication skills. However, the frequency of occurrence of equipoise issues across the RCTs suggests that the findings are likely to be reflective of clinical recruiters' practices more widely.

CONCLUSIONS

Communicating equipoise is a challenging process that is easily disrupted. Clinicians' personal views about trial treatments encroached on their ability to convey equipoise to patients. Clinicians should be encouraged to reflect on personal biases and be mindful of the common ways in which these can arise in their discussions with patients. Common pitfalls that recurred irrespective of RCT context indicate opportunities for specific training in communication skills that would be broadly applicable to a wide clinical audience.

Optimising recruitment and informed consent in randomised controlled trials: the development and implementation of the Quintet Recruitment Intervention (QRI)

Background

Pragmatic randomised controlled trials (RCTs) are considered essential to determine effective interventions for routine clinical practice, but many fail to recruit participants efficiently, and some really important RCTs are not undertaken because recruitment is thought to be too difficult. The ‘QuinteT Recruitment Intervention’ (QRI) aims to facilitate informed decision making by patients about RCT participation and to increase recruitment. This paper presents the development and implementation of the QRI.

Methods

The QRI developed iteratively as a complex intervention. It emerged from the National Institute for Health Research (NIHR) ProtecT trial and has been developed further in 13 RCTs. The final version of the QRI uses a combination of standard and innovative qualitative research methods with some simple quantification to understand recruitment and identify sources of difficulties.

Results

The QRI has two major phases: understanding recruitment as it happens and then developing a plan of action to address identified difficulties and optimise informed consent in collaboration with the RCT chief investigator (CI) and the Clinical Trials Unit (CTU). The plan of action usually includes RCT-specific, as well as generic, aspects. The QRI can be used in two ways: it can be integrated into the feasibility/pilot or main phase of an RCT to prevent difficulties developing and optimise recruitment from the start, or it can be applied to an ongoing RCT experiencing recruitment shortfalls, with a view to rapidly improving recruitment and informed consent or gathering evidence to justify RCT closure.

Conclusions

The QRI provides a flexible way of understanding recruitment difficulties and producing a plan to address them while ensuring engaged and well-informed decision making by patients. It can facilitate recruitment to the most controversial and important RCTs. QRIs are likely to be of interest to the CIs and CTUs developing proposals for ‘difficult’ RCTs or for RCTs with lower than expected recruitment and to the funding bodies wishing to promote efficient recruitment in pragmatic RCTs.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-016-1391-4) contains supplementary material, which is available to authorized users.

A new simple six-step model to promote recruitment to RCTs was developed and successfully implemented

OBJECTIVES

How a randomized controlled trial (RCT) is explained to patients is a key determinant of recruitment to that trial. This study developed and implemented a simple six-step model to fully inform patients and to support them in deciding whether to take part or not.

STUDY DESIGN AND SETTING

Ninety-two consultations with 60 new patients were recorded and analyzed during a pilot RCT comparing surgical and nonsurgical interventions for hip impingement. Recordings were analyzed using techniques of thematic analysis and focused conversation analysis.

RESULTS

Early findings supported the development of a simple six-step model to provide a framework for good recruitment practice. Model steps are as follows: (1) explain the condition, (2) reassure patients about receiving treatment, (3) establish uncertainty, (4) explain the study purpose, (5) give a balanced view of treatments, and (6) Explain study procedures. There are also two elements throughout the consultation: (1) responding to patients' concerns and (2) showing confidence. The pilot study was successful, with 70% (n = 60) of patients approached across nine centers agreeing to take part in the RCT, so that the full-scale trial was funded.

CONCLUSION

The six-step model provides a promising framework for successful recruitment to RCTs. Further testing of the model is now required.