Interventions to improve recruitment and retention in clinical trials: a survey and workshop to assess current practice and future priorities

Development of an online resource for recruitment research in clinical trials to organise and map current literature

Background

Recruiting the target number of participants within the pre-specified time frame agreed with funders remains a common challenge in the completion of a successful clinical trial and addressing this is an important methodological priority. While there is growing research around recruitment, navigating this literature to support an evidence-based approach remains difficult. The Online resource for Recruitment Research in Clinical triAls project aims to create an online searchable database of recruitment research to improve access to existing evidence and to identify gaps for future research.

Methods

MEDLINE (Ovid), Scopus, Cochrane Database of Systematic Reviews and Cochrane Methodology Register, Science Citation Index Expanded and Social Sciences Citation Index within the ISI Web of Science and Education Resources Information Center were searched in January 2015. Search strategy results were screened by title and abstract, and full text obtained for potentially eligible articles. Studies reporting or evaluating strategies, interventions or methods used to recruit patients were included along with case reports and studies exploring reasons for patient participation or non-participation. Eligible articles were categorised as systematic reviews, nested randomised controlled trials and other designs evaluating the effects of recruitment strategies (Level 1); studies that report the use of recruitment strategies without an evaluation of impact (Level 2); or articles reporting factors affecting recruitment without presenting a particular recruitment strategy (Level 3). Articles were also assigned to 1, or more, of 42 predefined recruitment domains grouped under 6 categories.

Results

More than 60,000 records were retrieved by the search, resulting in 56,030 unique titles and abstracts for screening, with a further 23 found through hand searches. A total of 4570 full text articles were checked; 2804 were eligible. Six percent of the included articles evaluated the effectiveness of a recruitment strategy (Level 1), with most of these assessing aspects of participant information, either its method of delivery (33%) or its content and format (28%).

Discussion

Recruitment to clinical trials remains a common challenge and an important area for future research. The online resource for Recruitment Research in Clinical triAls project provides a searchable, online database of research relevant to recruitment. The project has identified the need for researchers to evaluate their recruitment strategies to improve the evidence base and broaden the narrow focus of existing research to help meet the complex challenges faced by those recruiting to clinical trials.

Physiotherapists' and Physiotherapy Students' Perspectives on the Use of Mobile or Wearable Technology in Their Practice

Purpose: Although extensive research has been carried out on the determinants of mobile or wearable health care technology (mHealth), as well as on its acceptance by patients and other health care providers, very little research has been done on physiotherapists' perspectives on the use of mHealth in their current or future practice. The aims of this study were to (1) explore the attitudes of physiotherapists toward mHealth using a modified technology acceptance model questionnaire, (2) understand the applications and delivery paradigms that are most desirable, and (3) assess the content validity of the questionnaire. Method: The questionnaire was administered online. Participants (n=76) were recruited using snowball and convenience sampling. Data were analyzed using factor analysis and partial least-squares path modelling. Results: Results indicate that perceived usefulness and perceived ease of use were related to early adoptive behaviour among participants. We found no evidence that age, gender, experience, or practice setting influenced early adoptive behaviour. Participants demonstrated favourable attitudes toward mHealth tools in clinical practice. Conclusions: This article provides initial insights into factors that are likely to be significant determinants of adoption of mHealth among physiotherapists. Further work, including qualitative research, will help to identify personal and institutional factors that will improve the acceptance of mHealth.

Advancing Innovation in Skilled Nursing Facilities through Academic Collaborations

There is growing recognition that acute hospitalization contributes to marked functional decline in older adult populations. Nearly 20% of all hospitalized older adults in the United States are discharged to skilled nursing facilities (SNFs) to address these functional deficits. However, current approaches to care in SNFs may not adequately restore function, which may contribute to low community discharge rates and high hospital readmission rates. Barriers to rehabilitation innovation in SNFs include management, staff, patient, and researcher-level factors. This clinical commentary builds upon clinical innovation strategies in other health care settings by describing barriers in the context of the SNF environment. Fostering collaboration between academic clinical researchers and SNFs may be the answer to advancing rehabilitation practices and care delivery, thereby improving outcomes in this vulnerable population.

CONSORT-SPI 2018 Explanation and Elaboration: guidance for reporting social and psychological intervention trials

BACKGROUND

The CONSORT (Consolidated Standards of Reporting Trials) Statement was developed to help biomedical researchers report randomised controlled trials (RCTs) transparently. We have developed an extension to the CONSORT 2010 Statement for social and psychological interventions (CONSORT-SPI 2018) to help behavioural and social scientists report these studies transparently.

METHODS

Following a systematic review of existing reporting guidelines, we conducted an online Delphi process to prioritise the list of potential items for the CONSORT-SPI 2018 checklist identified from the systematic review. Of 384 international participants, 321 (84%) participated in both rating rounds. We then held a consensus meeting of 31 scientists, journal editors, and research funders (March 2014) to finalise the content of the CONSORT-SPI 2018 checklist and flow diagram.

RESULTS

CONSORT-SPI 2018 extends 9 items (14 including sub-items) from the CONSORT 2010 checklist, adds a new item (with 3 sub-items) related to stakeholder involvement in trials, and modifies the CONSORT 2010 flow diagram. This Explanation and Elaboration (E&E) document is a user manual to enhance understanding of CONSORT-SPI 2018. It discusses the meaning and rationale for each checklist item and provides examples of complete and transparent reporting.

CONCLUSIONS

The CONSORT-SPI 2018 Extension, this E&E document, and the CONSORT website ( www.consort-statement.org ) are helpful resources for improving the reporting of social and psychological intervention RCTs.

Qualitative study of barriers to clinical trial retention in adults with recently diagnosed type 1 diabetes

OBJECTIVES

Regular physical exercise may preserve β cell function in newly diagnosed adults with type 1 diabetes (T1D). However, clinical trials to test this theory require the recruitment and retention of adults with new-onset T1D, which can be challenging. We sought to determine the overall experiences of newly diagnosed adults with T1D in an exercise study, to understand issues that influence the retention of trial participants in such studies.

DESIGN

Qualitative methodology using individual face-to-face (n=6) and telephone interviews (n=14). Interview transcripts were thematically analysed using the framework method.

SETTING

The study took place at five participating UK hospitals.

PARTICIPANTS

Twenty participants, aged 19-55 years, in the Exercise for Type 1 Diabetes study were interviewed to explore their study experiences and identify motivators and deterrents towards the study. Participants in control and intervention arms were interviewed, as were people with T1D who had completed (n=16) and withdrawn (n=4).

RESULTS

Participants revealed barriers and facilitators to retention; the majority were generalisable to clinical trials of people with newly diagnosed T1D. Coming to terms with a diagnosis of T1D, lack of time, work pressures, level of health professional support, volume, clarity and consistency of information and feedback and a desire for knowledge about their condition were all cited as influencing factors to trial retention.

CONCLUSIONS

To our knowledge, this is the first qualitative study to examine the experience of being involved in an exercise trial by people with T1D. Findings suggest appointments could be shorter, available outside of working hours and planned longer in advance; study information should be clear, consistent and in electronic and paper formats; questionnaires need minimising; healthcare support and feedback needs providing regularly; thought is required around how to support non-exercising arm participants. These considerations may improve participant retention rates in new-onset T1D studies.

Strategies for recruiting a sample of adults with type 2 diabetes from primary care clinics in rural Appalachia: Incorporating cultural competence

BACKGROUND

Recruiting research participants from primary care in rural Appalachia is a major challenge and can be influenced by cultural characteristics, making it critically important to incorporate strategies of cultural competence in the overall design of clinical research.

OBJECTIVES

The purpose of this paper is to describe culturally competent strategies used for recruitment and data collection with a sample of adults with type 2 diabetes from primary care settings in Appalachia.

DESIGN

The Purnell model of cultural competence and relevant literature served as a framework for study design. Four overarching approaches informed the organization of recruitment strategies and development of the data collection plan.

PROCEDURES

The approaches included selection of research sites, establishing collaborations, sustaining collaborative relationships, and enhancing understanding of benefits of participation. Four recruitment sites were selected based on potential to enhance diversification of participants; multiple steps were included in each of the three remaining approaches to build relationships and gain participation. A study log was maintained to provide evaluation data.

RESULTS

Recruitment took 14 months and a sample of 102 subjects provided consent with 101 participants providing complete data. Demographics were representative of the region except that African American participation was higher (6.9%) compared to current north central Appalachia (3%). Over 72% of participants indicated they would be interested in participating in future studies.

CONCLUSIONS

These findings emphasize the importance of employing strategies for cultural competence in study design. Use of concepts from the Purnell model led to enhanced representativeness and potential for subsequent generalizability.

Kinesiology taping reduces the pain of finger osteoarthritis: a pilot single-blinded two-group parallel randomized trial

Objectives

Osteoarthritis (OA) is the most common arthropathy of the hand, and current treatments carry risks of adverse events. Supportive (kinesiology) tape may be analgesic and provide functional improvement, with a low risk of adverse outcomes. We experimented with supportive tape for OA of the proximal interphalangeal joint (PIPJ) of the finger in this pilot randomized trial.

Methods

This two-group parallel randomized trial recruited adults with OA of the PIPJ of the finger. We excluded patients lacking capacity or the ability to safely apply the tape. Participants were randomized to receive kinesiology tape on the dorsum of the finger, blind to grouping. Pain was the primary outcome, which was recorded on a visual analog scale (VAS). Secondary outcomes were hand function and adverse reactions. Bootstrapped between-group analyses are reported.

Results

Ten patients were included and randomized and provided complete data. There was no significant difference in pain between the groups (mean difference of 0.4 VAS units [95% confidence interval {CI} –1.6, 0.7], p=0.4). Overall, the application of kinesiology tape reduced reported pain by 6% (mean reduction of 0.6 VAS units [95% CI 0, 1.2], p=0.04). Taping did not affect hand function or digital range of motion. There were difficulties in recruiting individuals owing to the lack of dedicated research staff.

Conclusion

Kinesiology taping may reduce the pain of OA in the finger; however, whether this is a true effect, placebo effect, Hawthorne phenomenon, or due to a statistical error (ie, type 1 error due to underpowering) is unclear. Hence, further trials are required.

Study protocol for a feasibility study of an internet-administered, guided, CBT-based, self-help intervention (ENGAGE) for parents of children previously treated for cancer

INTRODUCTION

A subgroup of parents of children previously treated for cancer report long-term psychological distress after end of treatment. However, needs for psychological support are commonly unmet and there is a lack of evidence-based treatments tailored to the specific needs of this population. An internet-administered, guided, cognitive-behavioural therapy-based, self-help intervention (ENGAGE) for parents of children previously treated for cancer may provide a solution. The aim is to examine the feasibility and acceptability of the intervention ENGAGE and the study procedures for a future controlled trial.

METHODS AND ANALYSIS

The study has an uncontrolled within-group design with an embedded qualitative and quantitative process evaluation. Potential participants are parents of children previously treated for cancer, living in Sweden, recruited via their child's personal identification number (via the Swedish Childhood Cancer Registry and the Swedish Tax Agency). Parents are invited randomly with information packs sent to home addresses. Further interest in participating can be registered via information on relevant websites. The study aims to recruit 50 parents who will receive the intervention ENGAGE which is designed to be delivered over a 10-week period, and comprises one introductory chapter followed by up to 10 intervention modules addressing key concerns identified for the population. Consistent with feasibility study objectives, primary outcomes relate to recruitment, attrition, data collection, study resources, intervention delivery and acceptability. Clinical outcomes (post-traumatic stress, depression, anxiety, fear of cancer recurrence, psychological inflexibility and experiential avoidance, depressed inactivity, fatigue, quality of life and self-compassion) will be measured at baseline, post-treatment (12 weeks) and 6-month follow-up.

ETHICS AND DISSEMINATION

The Regional Ethical Review Board in Uppsala, Sweden has granted approval for the study (Dnr: 2017/527). Results will be disseminated to relevant healthcare and patient communities, in peer-reviewed and popular science journals, and at scientific and clinical conferences.

TRIAL REGISTRATION NUMBER

ISRCTN57233429; Pre-results.

Recruitment Strategies and Costs Associated With Enrolling People With Insomnia and High Blood Pressure Into an Online Behavioral Sleep Intervention: A Single-Site Pilot Study

BACKGROUND

Recruitment in clinical research is a common challenge and source of study failure. The reporting of recruitment methods and costs in hypertension trials is limited especially for smaller, single-site trials, online intervention trials, and trials using newer online recruitment strategies.

OBJECTIVE

The aims of this study are to describe and examine the feasibility of newer online-e-mail recruitment strategies and traditional recruitment strategies used to enroll participants with insomnia and high blood pressure into an online behavioral sleep intervention study (Sleeping for Heart Health).

METHODS

The 16 online-e-mail-based and traditional recruitment strategies used are described. Recruitment strategy feasibility was examined by study interest and enrollee yields, conversion rates, and costs (direct, remuneration, labor, and cost per enrollee).

RESULTS

From August 2014 to October 2015, 183 people were screened and 58 (31.7%) enrolled in the study (51.1 ± 12.9 years, 63.8% female, 72.4% African American, 136 ± 12/88 ± 7 mm Hg, 87.9% self-reported hypertension, 67.2% self-reported antihypertensive medication use). The recruitment strategies yielding the highest enrollees were the university hospital phone waiting message system (25.4%), Craigslist (22.4%), and flyers (20.3%) at a per enrollee cost of $42.84, $98.90, and $128.27, respectively. The university hospital phone waiting message system (55.6%) and flyers (54.5%) had the highest interested participant to enrolled participant conversion rate of all recruitment strategies.

CONCLUSION

Approximately 70% of all enrolled participants were recruited from the university hospital phone waiting message system, Craigslist, or flyers. Given the recruitment challenges that most researchers face, we encourage the documenting, assessing, and reporting of detailed recruitment strategies and associated recruitment costs so that other researchers may benefit.

Text message intervention to reduce frequency of binge drinking among disadvantaged men: the TRAM RCT

Background

Socially disadvantaged men are more likely to binge drink frequently and to experience high levels of alcohol-related harm.

Objectives

To test the effectiveness and cost-effectiveness of a text message intervention in reducing the frequency of binge drinking among disadvantaged men.

Study design

A four-centre, parallel-group, pragmatic, individually randomised controlled trial was conducted. Randomisation was carried out using a secure remote web-based system. It was stratified by participating centre and recruitment method and restricted using block sizes of randomly varying lengths.

Setting

The study was conducted in the community. Members of the public helped to develop the study methods.

Participants

Participants were men aged 25–44 years who had ≥ 2 episodes of binge drinking (> 8 units of alcohol in a single session) in the preceding 28 days. Men were recruited from areas of high deprivation.

Interventions

An empirically and theoretically based text message intervention was delivered by 112 interactive text messages over a 12-week period. The control group received an attentional control comprising 89 text messages on general health.

Primary outcome measure

The primary outcome measure was the proportion of men consuming > 8 units of alcohol on ≥ 3 occasions (in the previous 28 days) at 12 months post intervention.

Results

The recruitment target of 798 was exceeded and 825 men were randomised. Retention was high and similar in the intervention (84.9%) and control (86.5%) groups. Most men in the intervention group engaged enthusiastically with the text messages: almost all (92%) replied to text messages and over two-thirds (67%) replied more than 10 times. The intervention was estimated to have had a modest, statistically non-significant effect on the primary outcome at the 12-month follow-up [odds ratio 0.79, 95% confidence interval (CI) 0.57 to 1.08]. This corresponds to a net reduction of 5.7% in regular binge drinking. Five secondary outcomes showed small non-significant and inconsistent effects on alcohol consumption, with one suggesting a positive effect and four suggesting an adverse effect. Both the short- and the long-term cost per quality-adjusted life-year (QALY) analysis suggested that the brief intervention was dominated by a ‘do-nothing’ option. The intervention’s impacts on patterns of alcohol consumption, QALYs and downstream costs were inconsistent and uncertain.

Limitations

The study used an active control that, combined with the recruitment procedures and baseline assessments, could have biased the treatment effect towards the null. The measurement of alcohol consumption relied on self-reported drinking.

Conclusions

The trial has demonstrated that it is possible to recruit and retain large numbers of socially disadvantaged men in a research study. The text messages delivered a complex theoretically and empirically based intervention that fostered enthusiastic engagement with the key components of the behaviour change sequence. The intervention produced a modest, statistically non-significant effect on the primary outcome, with wide CIs. Further research is needed to reduce uncertainty about the treatment effect. The methods developed for this study provide a platform for the design and testing of interventions to reduce inequalities in health.

Future work

A future trial could reduce the uncertainty around the treatment effect of the intervention.

Trial registration

Current Controlled Trials ISRCTN07695192.

Funding

This study was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 6, No. 6. See NIHR Journals Library website for further information.

Improving the Patient-Clinician Interface of Clinical Trials through Health Informatics Technologies

The current state of clinical trials underscores a need for timely interventions to reduce the cost and length of the average trial. Newly developed health informatics technologies-including electronic health records, telemedicine systems, and mobile health applications-have recently been employed in a wide range of clinical trials in an effort to improve different aspects of the clinical trial process. The current review will focus on the observed benefits and drawbacks of using such technology to improve various patient-centered aspects of the clinical trial process, namely its potential to improve patient recruitment, patient retention, and data collection. Broad future challenges and opportunities in the field as a whole will also be covered.

A Web-Based Intervention to Reduce Distress After Prostate Cancer Treatment: Development and Feasibility of the Getting Down to Coping Program in Two Different Clinical Settings

Background

Distress after prostate cancer treatment is a substantial burden for up to one-third of men diagnosed. Physical and emotional symptoms and health service use can intensify, yet men are reticent to accept support. To provide accessible support that can be cost effectively integrated into care pathways, we developed a unique, Web-based, self-guided, cognitive-behavior program incorporating filmed and interactive peer support.

Objective

To assess feasibility of the intervention among men experiencing distress after prostate cancer treatment. Demand, acceptability, change in distress and self-efficacy, and challenges for implementation in clinical practice were measured.

Methods

A pre-post, within-participant comparison, mixed-methods research design was followed. Phase I and II were conducted in primary care psychological service and secondary care cancer service, respectively. Men received clinician-generated postal invitations: phase I, 432 men diagnosed <5 years; phase II, 606 men diagnosed <3.5 years. Consent was Web-based. Men with mild and moderate distress were enrolled. Web-based assessment included demographic, disease, treatment characteristics; distress (General Health Questionnaire-28); depression (Patient Health Questionnaire-9); anxiety (General Anxiety Disorder Scale-7); self-efficacy (Self-Efficacy for Symptom Control Inventory); satisfaction (author-generated, Likert-type questionnaire). Uptake and adherence were assessed with reference to the persuasive systems design model. Telephone interviews explored participant experience (phase II, n=10); interviews with health care professionals (n=3) explored implementation issues.

Results

A total of 135 men consented (phase I, 61/432, 14.1%; phase II, 74/606, 12.2%); from 96 eligible men screened for distress, 32% (30/96) entered the intervention (phase I, n=10; phase II, n=20). Twenty-four completed the Web-based program and assessments (phase I, n=8; phase II, n=16). Adherence for phase I and II was module completion rate 63% (mean 2.5, SD 1.9) versus 92% (mean 3.7, SD 1.0); rate of completing cognitive behavior therapy exercises 77% (mean 16.1, SD 6.2) versus 88% (mean 18.6, SD 3.9). Chat room activity occurred among 63% (5/8) and 75% (12/16) of men, respectively. In phase I, 75% (6/8) of men viewed all the films; in phase II, the total number of unique views weekly was 16, 11, 11, and 10, respectively. The phase II mood diary was completed by 100% (16/16) of men. Satisfaction was high for the program and films. Limited efficacy testing indicated improvement in distress baseline to post intervention: phase I, P=.03, r=−.55; phase II, P=.001, r=−.59. Self-efficacy improved for coping P=.02, r=−.41. Service assessment confirmed ease of assimilation into clinical practice and clarified health care practitioner roles.

Conclusions

The Web-based program is acceptable and innovative in clinical practice. It was endorsed by patients and has potential to positively impact the experience of men with distress after prostate cancer treatment. It can potentially be delivered in a stepped model of psychological support in primary or secondary care. Feasibility evidence is compelling, supporting further evaluative research to determine clinical and cost effectiveness.

Factors influencing the enrollment in randomized controlled trials in orthopedics

Background

Low enrollment rates are a threat to the external validity of clinical trials. The purpose of this study was to identify factors associated with lower enrollment rates in randomized controlled trials (RCTs) involving orthopedic procedures.

Methods

We performed a search in PubMed/MEDLINE for RCTs that involved any orthopedic surgical procedure, compared different intraoperative interventions, were published in English in a peer-reviewed journal between 2003 and 2014, and reported the numbers of both enrolled and eligible subjects. The primary outcome was the enrollment rate, defined as the number of enrolled subjects divided by the number of eligible subjects. We used a meta-regression to identify factors associated with lower enrollment rates.

Results

The combined estimate of enrollment rate across all 393 studies meeting inclusion criteria was 90% (95% CI: 89–92%). Trials in North America had significantly lower enrollment rates compared to trials in the rest of the world (80% vs. 92%, p < 0.0001). Trials comparing operative and non-operative treatments had significantly lower enrollment rates than trials comparing two different operative interventions (80% vs. 91%, p < 0.0001). Among trials comparing operative and non-operative interventions, there was a marked difference in enrollment rate by region: 49% in North America and 86% elsewhere (p < 0.0001).

Conclusions

RCTs investigating orthopedic procedures have variable enrollment rates depending on their location and the difference between the interventions being studied. North American trials that compare operative and non-operative interventions have the lowest enrollment rates. Investigators planning RCTs would be well advised to consider these data in planning recruitment efforts.

Challenges in recruiting African-American women for a breast cancer genetics study

Background

African-American women, especially in the southern United States, are underrepresented in cancer genetics research. A study was designed to address this issue by investigating the germline mutation rate in African-American women in Arkansas with a personal and/or family history of breast cancer. Women were tested for these mutations using a large panel of breast cancer susceptibility genes. In this analysis, we discuss the challenges encountered in recruiting African-American women from an existing biorepository to participate in this study.

Methods

We attempted to contact 965 African-American women with a personal and/or family history of breast cancer who participated in Spit for the Cure (SFTC) between 2007 and 2013 and provided consent to be recontacted. The SFTC participants were invited by telephone and email to participate in the genetic study. Enrollment required completion of a phone interview to obtain a family and medical history and return of a signed consent form.

Results

Among eligible SFTC participants, 39.6% (382/965) were able to be contacted with the phone numbers and email addresses they provided. Of these, 174 (45.5%) completed a phone interview and returned a signed consent form. Others were not able to be contacted (n = 583), declined to participate (n = 57), did not keep phone interview appointments (n = 82), completed the phone interview but never returned a signed consent (n = 54), were deceased (n = 13), or were too confused to consent to participate (n = 2).

Conclusions

Recruiting African-American women into our breast cancer genetics study proved challenging primarily due to difficulty establishing contact with potential participants. Given their prior participation in breast cancer research, we anticipated that this would be a highly motivated population. Indeed, when we were able to contact SFTC participants, only 14.9% declined to participate in our study. Innovative communication, retention, and recruitment strategies are needed in future studies to address the recruitment challenges we faced.

Patient-centered recruitment and retention for a randomized controlled study

Background

Recruitment and retention strategies for patient-centered outcomes research are evolving and research on the subject is limited. In this work, we present a conceptual model of patient-centered recruitment and retention, and describe the recruitment and retention activities and related challenges in a patient-centered comparative effectiveness trial.

Methods

This is a multicenter, longitudinal randomized controlled trial in localized prostate cancer patients.

Results

We recruited 743 participants from three sites over 15 months period (January 2014 to March 2015), and followed them for 24 months. At site 1, of the 773 eligible participants, 551 (72%) were enrolled. At site 2, 34 participants were eligible and 23 (68%) enrolled. Of the 434 eligible participants at site 3, 169 (39%) enrolled. We observed that strategies related to the concepts of trust (e.g., physician involvement, ensuring protection of information), communication (e.g., brochures and pamphlets in physicians’ offices, continued contact during regular clinic visits and calling/emailing assessment), attitude (e.g., emphasizing the altruistic value of research, positive attitude of providers and research staff), and expectations (e.g., full disclosure of study requirements and time commitment, update letters) facilitated successful patient recruitment and retention. A stakeholders’ advisory board provided important input for the recruitment and retention activities. Active engagement, reminders at the offices, and personalized update letters helped retention during follow-up. Usefulness of telephone recruitment was site specific and, at one site, the time requirement for telephone recruitment was a challenge.

Conclusions

We have presented multilevel strategies for successful recruitment and retention in a clinical trial using a patient-centered approach. Our strategies were flexible to accommodate site-level requirements. These strategies as well as the challenges can aid recruitment and retention efforts of future large-scale, patient-centered research studies.

Trial registration

Clinicaltrials.gov, ID: NCT02032550. Registered on 22 November 2013.

Feasibility study: assessing the efficacy and social acceptability of using dental hygienist-therapists as front-line clinicians

Background The oral health of the adult population has been improving in the United Kingdom decade upon decade. Over half of dental service activity in the National Health Service (NHS) is limited to a check-up without any further treatment. This raises a question as to whether check-ups could be provided by dental hygienist-therapists, rather than general dental practitioners. The aim of this study was to assess the feasibility of a definitive trial to evaluate the costs and effects of using dental hygienist-therapists to undertake the check-up.Methods/design Adult NHS patients were randomised into three arms in two dental practices: patients who only saw dental hygienist-therapists for a check-up, those that saw the general dental practitioner and dental hygienist-therapist alternatively and a control, where patients only saw the general dental practitioner for their check-up. The study ran for 15 months. The primary outcome measures of the study were patient recruitment, retention and fidelity. A parallel and embedded qualitative study was undertaken which recorded the views of participating patients to determine the social acceptability of the intervention.Results Sixty patients participated in the study. The initial recruitment rate for the study was 33.7%. This figure increased to over 82.1% when telephone calls or face-to-face recruitment was utilised. The retention rates were 60% for both the dental hygienist-therapist only group and the alternate general dental practitioner and dental hygienist-therapist group, compared to 70% for the general dental practitioner only group. Fifteen patients were interviewed in the qualitative study and supported a team approach to the provision of check-ups in the NHS. Conclusion This study demonstrates the feasibility of a definitive trial to evaluate the costs and effects of using dental-hygienist-therapists to undertake the check-up.

Feasibility and Outcomes in a Pilot Randomized Controlled Trial of a Psychosocial Intervention for Adults With Congenital Heart Disease

BACKGROUND

North American adults with congenital heart disease (CHD) are known to be at elevated risk of mood and anxiety disorders. This was the first trial of a group psychosocial intervention targeting this patient population.

METHODS

Within this feasibility study, we conducted a 2-arm pilot randomized controlled trial (RCT) in which patients were randomized to Usual Care or an 8-session group psychosocial intervention (Adult Congenital Heart Disease-Coping and Resilience [ACHD-CARE]). Here, we report feasibility outcomes in accordance with published recommendations: (1) process, (2) resources, (3) management, (4) acceptability of the intervention, and (5) scientific outcomes (for which the primary outcome measures were anxiety and depression symptoms).

RESULTS

Forty-two patients were randomized in the pilot RCT. The study was executable within a realistic timeline and revealed no significant human and data-management problems. The intervention was determined to be acceptable and highly valued by participants who participated in the ACHD-CARE program. The main challenges were practical barriers (eg, transportation, scheduling group sessions in-person given competing schedules) and retention. With regard to scientific outcomes, there were no adverse outcomes, and treatment fidelity was confirmed. Although not powered to test efficacy, there was a medium effect size (in favour of the intervention group) for depression symptoms.

CONCLUSIONS

We determined it would be feasible to conduct a full-scale trial of a psychosocial intervention targeting adults with CHD, although with modifications to address practical barriers to participation. Should this intervention prove effective, a manualized intervention could be made be available.

Training health professionals to recruit into challenging randomized controlled trials improved confidence: the development of the QuinteT randomized controlled trial recruitment training intervention

OBJECTIVES

The objective of this study was to describe and evaluate a training intervention for recruiting patients to randomized controlled trials (RCTs), particularly for those anticipated to be difficult for recruitment.

STUDY DESIGN AND SETTING

One of three training workshops was offered to surgeons and one to research nurses. Self-confidence in recruitment was measured through questionnaires before and up to 3 months after training; perceived impact of training on practice was assessed after. Data were analyzed using two-sample t-tests and supplemented with findings from the content analysis of free-text comments.

RESULTS

Sixty-seven surgeons and 32 nurses attended. Self-confidence scores for all 10 questions increased after training [range of mean scores before 5.1-6.9 and after 6.9-8.2 (scale 0-10, all 95% confidence intervals are above 0 and all P-values <0.05)]. Awareness of hidden challenges of recruitment following training was high-surgeons' mean score 8.8 [standard deviation (SD), 1.2] and nurses' 8.4 (SD, 1.3) (scale 0-10); 50% (19/38) of surgeons and 40% (10/25) of nurses reported on a 4-point Likert scale that training had made "a lot" of difference to their RCT discussions. Analysis of free text revealed this was mostly in relation to how to convey equipoise, explain randomization, and manage treatment preferences.

CONCLUSION

Surgeons and research nurses reported increased self-confidence in discussing RCTs with patients, a raised awareness of hidden challenges and a positive impact on recruitment practice following QuinteT RCT Recruitment Training. Training will be made more available and evaluated in relation to recruitment rates and informed consent.

Identifying trial recruitment uncertainties using a James Lind Alliance Priority Setting Partnership - the PRioRiTy (Prioritising Recruitment in Randomised Trials) study

Background

Despite the problem of inadequate recruitment to randomised trials, there is little evidence to guide researchers on decisions about how people are effectively recruited to take part in trials. The PRioRiTy study aimed to identify and prioritise important unanswered trial recruitment questions for research. The PRioRiTy study - Priority Setting Partnership (PSP) included members of the public approached to take part in a randomised trial or who have represented participants on randomised trial steering committees, health professionals and research staff with experience of recruiting to randomised trials, people who have designed, conducted, analysed or reported on randomised trials and people with experience of randomised trials methodology.

Methods

This partnership was aided by the James Lind Alliance and involved eight stages: (i) identifying a unique, relevant prioritisation area within trial methodology; (ii) establishing a steering group (iii) identifying and engaging with partners and stakeholders; (iv) formulating an initial list of uncertainties; (v) collating the uncertainties into research questions; (vi) confirming that the questions for research are a current recruitment challenge; (vii) shortlisting questions and (viii) final prioritisation through a face-to-face workshop.

Results

A total of 790 survey respondents yielded 1693 open-text answers to 6 questions, from which 1880 potential questions for research were identified. After merging duplicates, the number of questions was reduced to 496. Questions were combined further, and those that were submitted by fewer than 15 people and/or fewer than 6 of the 7 stakeholder groups were excluded from the next round of prioritisation resulting in 31 unique questions for research. All 31 questions were confirmed as being unanswered after checking relevant, up-to-date research evidence. The 10 highest priority questions were ranked at a face-to-face workshop. The number 1 ranked question was “How can randomised trials become part of routine care and best utilise current clinical care pathways?” The top 10 research questions can be viewed at www.priorityresearch.ie.

Conclusion

The prioritised questions call for a collective focus on normalising trials as part of clinical care, enhancing communication, addressing barriers, enablers and motivators around participation and exploring greater public involvement in the research process.

Recruitment of older adults to three preventative lifestyle improvement studies

BACKGROUND

Recruiting isolated older adults to clinical trials is complex, time-consuming and difficult. Previous studies have suggested querying existing databases to identify appropriate potential participants. We aim to compare recruitment techniques (general practitioner (GP) mail-outs, community engagement and clinician referrals) used in three randomised controlled trial (RCT) studies assessing the feasibility or effectiveness of two preventative interventions in isolated older adults (the Lifestyle Matters and Putting Life In Years interventions).

METHODS

During the three studies (the Lifestyle Matters feasibility study, the Lifestyle Matters RCT, the Putting Life In Years RCT) data were collected about how participants were recruited. The number of letters sent by GP surgeries for each study was recorded. In the Lifestyle Matters RCT, we qualitatively interviewed participants and intervention facilitators at 6 months post randomisation to seek their thoughts on the recruitment process.

RESULTS

Referrals were planned to be the main source of recruitment in the Lifestyle Matters feasibility study, but due to a lack of engagement from district nurses, community engagement was the main source of recruitment. District nurse referrals and community engagement were also utilised in the Lifestyle Matters and Putting Life In Years RCTs; both mechanisms yielded few participants. GP mail-outs were the main source of recruitment in both the RCTs, but of those contacted, recruiting yield was low (< 3%). Facilitators of the Lifestyle Matters intervention questioned whether the most appropriate individuals had been recruited. Participants recommended that direct contact with health professionals would be the most beneficial way to recruit.

CONCLUSIONS

Recruitment to the Lifestyle Matters RCT did not mirror recruitment to the feasibility study of the same intervention. Direct district nurse referrals were not effective at recruiting participants. The majority of participants were recruited via GP mail-outs, which may have led to isolated individuals not being recruited to the trials. Further research is required into alternative recruitment techniques, including respondent-driven sampling plus mechanisms which will promote health care professionals to recruit vulnerable populations to research.

TRIAL REGISTRATION

International Standard Randomised Controlled Trial Registry, ID: ISRCTN28645428 (Putting Life In Years RCT). Registered on 11 April 2012; International Standard Randomised Controlled Trial Registry, ID: ISRCTN67209155 (Lifestyle Matters RCT). Registered on 22 March 2012; ClinicalTrials.gov , ID: NCT03054311 (Lifestyle Matters feasibility study). Registered retrospectively on 19 January 2017.

The "Interval Walking in Colorectal Cancer" (I-WALK-CRC) study: Design, methods and recruitment results of a randomized controlled feasibility trial

Background

Low physical activity level is associated with poor prognosis in patients with colorectal cancer (CRC). To increase physical activity, technology-based platforms are emerging and provide intriguing opportunities to prescribe and monitor active lifestyle interventions. The “Interval Walking in Colorectal Cancer“(I-WALK-CRC) study explores the feasibility and efficacy a home-based interval-walking intervention delivered by a smart-phone application in order to improve cardio-metabolic health profile among CRC survivors. The aim of the present report is to describe the design, methods and recruitment results of the I-WALK-CRC study.

Methods/Results: The I-WALK-CRC study is a randomized controlled trial designed to evaluate the feasibility and efficacy of a home-based interval walking intervention compared to a waiting-list control group for physiological and patient-reported outcomes. Patients who had completed surgery for local stage disease and patients who had completed surgery and any adjuvant chemotherapy for locally advanced stage disease were eligible for inclusion. Between October 1st^, 2015, and February 1st^, 2017, 136 inquiries were recorded; 83 patients were eligible for enrollment, and 42 patients accepted participation. Age and employment status were associated with participation, as participants were significantly younger (60.5 vs 70.8 years, P < 0.001) and more likely to be working (OR 5.04; 95%CI 1.96–12.98, P < 0.001) than non-participants.

Conclusion

In the present study, recruitment of CRC survivors was feasible but we aim to better the recruitment rate in future studies. Further, the study clearly favored younger participants. The I-WALK-CRC study will provide important information regarding feasibility and efficacy of a home-based walking exercise program in CRC survivors.

Interventions to improve retention in a surgical, clinical trial: A pragmatic, stakeholder-driven approach

OBJECTIVE

To explore stakeholder perspectives upon participant retention in clinical trials, and to generate strategies to support retention in a surgical, clinical trial.

STUDY DESIGN AND SETTING

The SWIFFT trial is a multicenter study comparing treatments for the fracture of the waist of the scaphoid bone in adults. Here we report upon a multistage, iterative consultative process with SWIFFT stakeholders, these include workshops with members of the public, with nurses involved in data collection, and with consultant clinicians. Structured discussions were digitally recorded and transcribed, data were handled and analyzed following a framework approach to qualitative data analysis.

RESULTS

Removing practical barriers were identified as important factors in supporting retention. Stakeholders also identified that (i) how well a study is understood and (ii) how much it is valued are important factors in an individual's willingness to maintain their involvement. A number of strategies resulted from this consultation, these include: in-clinic data collection, co-ordinated clinical and research appointments, a SWIFFT website, and newsletter.

CONCLUSION

A participatory approach to trial retention might engage all relevant stakeholders in the delivery of a clinical trial, it might also support the generation of specific and contextually relevant solutions to the challenge of participant retention.

'Recruitment, recruitment, recruitment' - the need for more focus on retention: a qualitative study of five trials

Background

Loss to follow-up (attrition) is a frequent problem in clinical trials and can introduce bias or reduce power. So, understanding retention issues and strategies to address these are important. As part of a multi-method project, this qualitative study aimed to explore retention strategies used by trial teams and factors which may influence strategy adoption.

Method

A purposive sample of active trials was selected from the UK NIHR HTA portfolio of ongoing trials in 2014/2015. Semi-structured interviews with several trial team members from each trial and supplementary interviews with experienced trial managers explored strategies in collecting clinical outcome data and retaining participants. Interview data were analysed thematically using techniques of constant comparison.

Results

Twenty-two semi-structured interviews with trial team members including chief investigators, trial managers, nurses and research administrators revealed strategies used to enhance retention. Some were recognised methods and planned from trial outset whilst others were implemented more responsively. Interviewees placed great value on fostering positive relationships with trial participants to enhance retention. However, these strategies took time which was not always appreciated by the wider trial team or funding bodies. The national focus on recruitment targets in networks posed a challenge to staff and was deemed detrimental to retention. The ‘moral compass’ of individual researchers relied on their own beliefs and values and research experience and the factors affected their confidence to pursue participant data during follow-up.

Conclusion

The role of trial staff and their underlying behaviours influence retention practices and, combined with emphasis on recruitment targets, can be detrimental to motivation and retention activities. There is a need to consider how to train and support trial staff involved in retention practices and recognition of retention from funding bodies and oversight organisations.

Interpreting population reach of a large, successful physical activity trial delivered through primary care

Background

Failure to include socio-economically deprived or ethnic minority groups in physical activity (PA) trials may limit representativeness and could lead to implementation of interventions that then increase health inequalities. Randomised intervention trials often have low recruitment rates and rarely assess recruitment bias. A previous trial by the same team using similar methods recruited 30% of the eligible population but was in an affluent setting with few non-white residents and was limited to those over 60 years of age.

Methods

PACE-UP is a large, effective, population-based walking trial in inactive 45-75 year-olds that recruited through seven London general practices. Anonymised practice demographic data were available for all those invited, enabling investigation of inequalities in trial recruitment. Non-participants were invited to complete a questionnaire.

Results

From 10,927 postal invitations, 1150 (10.5%) completed baseline assessment. Participation rate ratios (95% CI), adjusted for age and gender as appropriate, were lower in men 0.59 (0.52, 0.67) than women, in those under 55 compared with those ≥65, 0.60 (0.51, 0.71), in the most deprived quintile compared with the least deprived 0.52 (0.39, 0.70) and in Asian individuals compared with whites 0.62 (0.50, 0.76). Black individuals were equally likely to participate as white individuals. Participation was also associated with having a co-morbidity or some degree of health limitation. The most common reasons for non-participation were considering themselves as being too active or lack of time.

Conclusions

Conducting the trial in this diverse setting reduced overall response, with lower response in socio-economically deprived and Asian sub-groups. Trials with greater reach are likely to be more expensive in terms of recruitment and gains in generalizability need to be balanced with greater costs. Differential uptake of successful trial interventions may increase inequalities in PA levels and should be monitored.

Trial registration

ISRCTN.com ISRCTN98538934. Registered 2nd March 2012.

Recruiting ENT and Audiology patients into pharmaceutical trials: evaluating the multi-centre experience in the UK and USA

OBJECTIVE

Recruiting into clinical trials on time and on target is a major challenge and yet often goes unreported. This study evaluated the adjustment to procedures, recruitment and screening methods in two multi-centre pharmaceutical randomised controlled trials (RCTs) for hearing-related problems in adults.

DESIGN

Recruitment monitoring and subsequent adjustment of various study procedures (e.g. eligibility criteria, increasing recruiting sites and recruitment methods) are reported. Participants were recruited through eight overarching methods: trial registration, posters/flyers, print publications, Internet, social media, radio, databases and referrals. The efficiency of the recruitment was measured by determining the number of people: (1) eligible for screening as a percentage of those who underwent telephone pre-screening and (2) randomised as a percentage of those screened.

STUDY SAMPLE

A total of 584 participants completed the pre-screening steps, 491 screened and 169 participants were randomised.

RESULTS

Both RCTs completed adjustments to the participant eligibility, added new study sites and additional recruitment methods. No single recruitment method was efficient enough to serve as the only route to enrolment.

CONCLUSION

A diverse portfolio of methods, continuous monitoring, mitigation strategy and adequate resourcing were essential for achieving our recruitment goals.

Successful recruitment to trials: findings from the SCIMITAR+ Trial

BACKGROUND

Randomised controlled trials (RCT) can struggle to recruit to target on time. This is especially the case with hard to reach populations such as those with severe mental ill health. The SCIMITAR+ trial, a trial of a bespoke smoking cessation intervention for people with severe mental ill health achieved their recruitment ahead of time and target. This article reports strategies that helped us to achieve this with the aim of aiding others recruiting from similar populations.

METHODS

SCIMITAR+ is a multi-centre pragmatic two-arm parallel-group RCT, which aimed to recruit 400 participants with severe mental ill health who smoke and would like to cut down or quit. The study recruited primarily in secondary care through community mental health teams and psychiatrists with a smaller number of participants recruited through primary care. Recruitment opened in October 2015 and closed in December 2016, by which point 526 participants had been recruited. We gathered information from recruiting sites on strategies which led to the successful recruitment in SCIMITAR+ and in this article present our approach to trial management along with the strategies employed by the recruiting sites.

RESULTS

Alongside having a dedicated trial manager and trial management team, we identified three main themes that led to successful recruitment. These were: clinicians with a positive attitude to research; researchers and clinicians working together; and the use of NHS targets. The overriding theme was the importance of relationships between both the researchers and the recruiting clinicians and the recruiting clinicians and the participants.

CONCLUSIONS

This study makes a significant contribution to the limited evidence base of real-world cases of successful recruitment to RCTs and offers practical guidance to those planning and conducting trials. Building positive relationships between clinicians, researchers and participants is crucial to successful recruitment.

Development of a framework to improve the process of recruitment to randomised controlled trials (RCTs): the SEAR (Screened, Eligible, Approached, Randomised) framework

BACKGROUND

Research has shown that recruitment to trials is a process that stretches from identifying potentially eligible patients, through eligibility assessment, to obtaining informed consent. The length and complexity of this pathway means that many patients do not have the opportunity to consider participation. This article presents the development of a simple framework to document, understand and improve the process of trial recruitment.

METHODS

Eight RCTs integrated a QuinteT Recruitment Intervention (QRI) into the main trial, feasibility or pilot study. Part of the QRI required mapping the patient recruitment pathway using trial-specific screening and recruitment logs. A content analysis compared the logs to identify aspects of the recruitment pathway and process that were useful in monitoring and improving recruitment. Findings were synthesised to develop an optimised simple framework that can be used in a wide range of RCTs.

RESULTS

The eight trials recorded basic information about patients screened for trial participation and randomisation outcome. Three trials systematically recorded reasons why an individual was not enrolled in the trial, and further details why they were not eligible or approached, or declined randomisation. A framework to facilitate clearer recording of the recruitment process and reasons for non-participation was developed: SEAR - Screening, to identify potentially eligible trial participants; Eligibility, assessed against the trial protocol inclusion/exclusion criteria; Approach, the provision of oral and written information and invitation to participate in the trial, and Randomised or not, with the outcome of randomisation or treatment received.

CONCLUSIONS

The SEAR framework encourages the collection of information to identify recruitment obstacles and facilitate improvements to the recruitment process. SEAR can be adapted to monitor recruitment to most RCTs, but is likely to add most value in trials where recruitment problems are anticipated or evident. Further work to test it more widely is recommended.

Clinical trials recruitment planning: A proposed framework from the Clinical Trials Transformation Initiative

Patient recruitment is widely recognized as a key determinant of success for clinical trials. Yet a substantial number of trials fail to reach recruitment goals-a situation that has important scientific, financial, ethical, and policy implications. Further, there are important effects on stakeholders who directly contribute to the trial including investigators, sponsors, and study participants. Despite efforts over multiple decades to identify and address barriers, recruitment challenges persist. To advance a more comprehensive approach to trial recruitment, the Clinical Trials Transformation Initiative (CTTI) convened a project team to examine the challenges and to issue actionable, evidence-based recommendations for improving recruitment planning that extend beyond common study-specific strategies. We describe our multi-stakeholder effort to develop a framework that delineates three areas essential to strategic recruitment planning efforts: (1) trial design and protocol development, (2) trial feasibility and site selection, and (3) communication. Our recommendations propose an upstream approach to recruitment planning that has the potential to produce greater impact and reduce downstream barriers. Additionally, we offer tools to help facilitate adoption of the recommendations. We hope that our framework and recommendations will serve as a guide for initial efforts in clinical trial recruitment planning irrespective of disease or intervention focus, provide a common basis for discussions in this area and generate targets for further analysis and continual improvement.

What are the main inefficiencies in trial conduct: a survey of UKCRC registered clinical trials units in the UK

BACKGROUND

The UK Clinical Research Collaboration (UKCRC) registered Clinical Trials Units (CTUs) Network aims to support high-quality, efficient and sustainable clinical trials research in the UK. To better understand the challenges in efficient trial conduct, and to help prioritise tackling these challenges, we surveyed CTU staff. The aim was to identify important inefficiencies during two key stages of the trial conduct life cycle: (i) from grant award to first participant, (ii) from first participant to reporting of final results.

METHODS

Respondents were asked to list their top three inefficiencies from grant award to recruitment of the first participant, and from recruitment of the first participant to publication of results. Free text space allowed respondents to explain why they thought these were important. The survey was constructed using SurveyMonkey and circulated to the 45 registered CTUs in May 2013. Respondents were asked to name their unit and job title, but were otherwise anonymous. Free-text responses were coded into broad categories.

RESULTS

There were 43 respondents from 25 CTUs. The top inefficiency between grant award and recruitment of first participant was reported as obtaining research and development (R&D) approvals by 23 respondents (53%), contracts by 22 (51%), and other approvals by 13 (30%). The top inefficiency from recruitment of first participant to publication of results was failure to meet recruitment targets, reported by 19 (44%) respondents. A common comment was that this reflected overoptimistic or inaccurate estimates of recruitment at site. Data management, including case report form design and delays in resolving data queries with sites, was reported as an important inefficiency by 11 (26%) respondents, and preparation and submission for publication by 9 (21%).

CONCLUSIONS

Recommendations for improving the efficiency of trial conduct within the CTUs network include: further reducing unnecessary bureaucracy in approvals and contracting; improving training for site staff; realistic recruitment targets and appropriate feasibility; developing training across the network; improving the working relationships between chief investigators and units; encouraging funders to release sufficient funding to allow prompt recruitment of trial staff; and encouraging more research into how to improve the efficiency and quality of trial conduct.

Accrual monitoring in cardiovascular trials

Objective

To provide brief guidance on how to design accrual monitoring activities in a clinical trial protocol.

Setting

Two completed clinical trials that did not achieve the planned sample size, the Cost of Strategies After Myocardial Infarction (COSTAMI) trial and the Biventricular Pacing After Cardiac Surgery (BiPACS) trial.

Design

A Bayesian monitoring tool, the constant accrual model, is applied retrospectively to accrual data from each case study to illustrate how the tool could be used to identify problems with accrual early in the trial period and to frame the conditions in which the approach can be used in practice.

Results

After 312 days and 155 patients enrolled in the COSTAMI trial, accrual could be classified as ‘off target’ on the basis of statistical criteria outlined in the protocol. As for the BiPACS trial, after 2 years, it was already evident that the accrual was ‘considerably off target’.

Conclusions

Prompt awareness of a high risk of accrual failure could trigger different interventions to overcome protocol-related, patient-related or investigator-related barriers to recruitment or ultimately contribute to an early stopping decision due to recruitment futility.

Accrual prediction models should be included as standard tools for routine monitoring activities in cardiovascular research. Among them, methods relying on the Bayesian approach are particularly attractive, as they can naturally update past evidence when actual accrual data becomes available.

Recruitment and retention of a challenging population: Lessons learned and design implications

PURPOSE

The purpose of this article is share the lessons learned from recruiting and retaining adults with type 2 diabetes and solid tumor cancer into a longitudinal study exploring the relationship among chemotherapy, glycemic control, and symptoms.

DESIGN/METHODS

Twelve-week longitudinal study, recruited thirty-four adults 21years or older with pre-existing type 2 diabetes and a solid tumor cancer, from three community based cancer centers who were eligible to receive outpatient chemotherapy.

METHODS

Fisher's Exact Test (categorical variables) and Logistic Regression (continuous variables) were used to evaluate factors associated with participant withdrawal. A dichotomous attrition variable was created to identify those who dropped out of the study before the final week and those who completed.

RESULTS

Thirteen of the 34 participants completed the study. Symptom severity, baseline HbA1c and metastases were all identified as being factors that potentially influenced attrition. Recruitment was improved once recruiters were hired at each of the cancer centers and adjustments made to the inclusion criteria.

CONCLUSIONS/IMPLICATIONS FOR RESEARCH

Several design elements need to be considered to address attrition in future including the use of recruiters, inclusion and exclusion criteria, consent timing, data collection schedules, participant characteristics, participant burden, and support person identification.

Follow-up in patients with a burn-related emergency department visit: a feasibility study

Background

Data on epidemiology, costs, and outcomes of burn-related injuries presenting at emergency departments (EDs) are scarce. To obtain such information, a questionnaire study with an adequate response rate is imperative. There is evidence that optimized strategies can increase patient participation. However, it is unclear whether this applies to burn patients in an ED setting. The objective of this feasibility study was to optimize and evaluate patient recruitment strategy and follow-up methods in patients with burn injuries presenting at EDs.

Methods

In a prospective cohort study with a 6-month follow-up, patients with burn-related injuries attending two large EDs during a 3-month study period were included. Eligible patients were quasi-randomly allocated to a standard or optimized recruitment strategy by week of the ED visit. The standard recruitment strategy consisted of an invitation letter to participate, an informed consent form, a questionnaire, and a franked return envelope. The optimized recruitment strategy was complemented by a stamped returned envelope, monetary incentive, sending a second copy of the questionnaire, and a reminder by telephone in non-responders. Response rates were calculated, and questionnaires were used to assess treatment, costs, and health-related quality of life.

Results

A total of 87 patients were included of which 85 were eligible for the follow-up study. There was a higher response rate at 2 months in the optimized versus the standard recruitment strategy (43.6% vs. 20.0%; OR = 3.1 (95% CI 1.1–8.8)), although overall response is low. Non-response analyses showed no significant differences in patient, burn injury or treatment characteristics between responders versus non-responders.

Conclusions

This study demonstrated that response rates can be increased with an optimized, but more labor-intensive recruitment strategy, although further optimization of recruitment and follow-up is needed. It is feasible to assess epidemiology, treatment, and costs after burn-related ED contacts.

Electronic supplementary material

The online version of this article (10.1186/s41038-017-0100-1) contains supplementary material, which is available to authorized users.

Qualitative study to understand the barriers to recruiting young people with cancer to BRIGHTLIGHT: a national cohort study in England

OBJECTIVES

BRIGHTLIGHT is a national evaluation of cancer services for teenagers and young adults in England. Following challenges with recruitment, our aim was to understand more fully healthcare professionals' perspectives of the challenges of recruiting young people to a low-risk observational study, and to provide guidance for future recruitment processes.

DESIGN

Qualitative.

SETTING

National Health Service (NHS) hospitals in England.

METHODS

Semistructured telephone interviews with a convenience sample of 23 healthcare professionals. Participants included principal investigators/other staff recruiting into the BRIGHTLIGHT study. Data were analysed using framework analysis.

RESULTS

The emergent themes were linked to levels of research organisational management, described using the levels of social network analysis: micro-level (the individual; in this case the target population to be recruited-young people with cancer); meso-level (the organisation; refers to place of recruitment and people responsible for recruitment); and macro-level (the large-scale or global structure; refers to the wider research function of the NHS and associated policies). Study-related issues occurred across all three levels, which were influenced by the context of the study. At the meso-level, professionals' perceptions of young people and communication between professionals generated age/cancer type silos, resulting in recruitment of either children or adults, but not both by the same team, and only in the cancer type the recruiting professional was aligned to. At the macro-level the main barrier was discordant configuration of a research service with a clinical service.

CONCLUSIONS

This study has identified significant barriers to recruitment mainly at the meso-level and macro-level, which are more challenging for research teams to influence. We suggest that interconnected whole-system changes are required to facilitate the success of interventions designed to improve recruitment. Interventions targeted at study design/management and the micro-level only may be less successful. We offer solutions to be considered by those involved at all levels of research for this population.

A pragmatic multicentre randomised controlled trial comparing stapled haemorrhoidopexy with traditional excisional surgery for haemorrhoidal disease: the eTHoS study

BACKGROUND

Haemorrhoids are a benign anorectal condition and are highly prevalent in the UK population. Treatments involve clinic-based procedures and surgery. The surgical procedures available include stapled haemorrhoidopexy (SH) and traditional haemorrhoidectomy (TH), and over 25,000 operations are performed for haemorrhoids annually in the UK. The disease is therefore important both to patients and to health service commissioners. Debate remains as to which of these surgical procedures is the most clinically effective and cost-effective.

OBJECTIVE

The aim of this study was to compare the clinical effectiveness and cost-effectiveness of SH with that of TH.

DESIGN

A large, open two-arm parallel-group pragmatic multicentre randomised controlled trial involving 32 UK hospitals and a within-trial cost-benefit analysis. A discrete choice experiment was conducted to estimate benefits (willingness to pay).

PARTICIPANTS

Patients with grades II-IV haemorrhoids who had not previously undergone SH or TH were included in the study.

INTERVENTIONS

Participants were randomised to receive either SH or TH. Randomisation was minimised at 1 : 1, in accordance with baseline EuroQol-5 Dimensions, three-level version (EQ-5D-3L) score, haemorrhoid grade, sex and centre, via an automated system.

MAIN OUTCOME MEASURES

The primary outcome was area under the quality-of-life curve measured using the EQ-5D-3L descriptive system over 24 months, and the primary economic outcome was the incremental cost-effectiveness ratio. Secondary outcomes included disease-specific quality of life, recurrence, complications, further interventions and costs.

RESULTS

Between January 2011 and August 2014, 777 patients were randomised (389 to receive SH and 388 to receive TH). There were 774 participants included in the analysis as a result of one post-randomisation exclusion in the SH arm and two in the TH arm. SH was less painful than TH in the short term. Surgical complications were similar in both arms. EQ-5D-3L score was higher for the SH arm in the first 6 weeks after surgery, but over 24 months the TH group had significantly better EQ-5D-3L scores (-0.073, 95% confidence interval -0.140 to -0.006; p = 0.0342). Symptoms and further interventions were significantly fewer in the TH arm at 24 months. Continence was better in the TH arm and tenesmus occurred less frequently. The number of serious adverse events reported was 24 out of 337 (7.1%) for participants who received SH and 33 out of 352 (9.4%) for those who received TH. There were two deaths in the SH arm, both unrelated to the eTHoS (either Traditional Haemorrhoidectomy or Stapled haemorrhoidopexy for haemorrhoidal disease) study. Patient preference did not seem to influence the treatment difference. SH was dominated by TH as it cost more and was less effective. The net benefit for the TH arm was higher than that for the SH arm.

LIMITATIONS

Neither the participants nor the assessors were masked to treatment assignment and final recruitment was slightly short of the total target of 800. There were also substantial missing follow-up data.

CONCLUSIONS

While patients who received SH had less short-term pain, after 6 weeks, recurrence rates, symptoms, re-interventions and quality-of-life measures all favoured TH. In addition, TH is cheaper. As part of a tailored management plan for haemorrhoids, TH should be considered over SH as the surgical treatment of choice for haemorrhoids refractory to clinic-based interventions.

FUTURE WORK

Perform an updated meta-analysis incorporating recently conducted European trials [eTHoS, HubBLe (haemorrhoidal artery ligation versus rubber band ligation for the management of symptomatic second-degree and third-degree haemorrhoids) and LingaLongo (Cost-effectiveness of New Surgical Treatments for Haemorrhoidal Disease)].

TRIAL REGISTRATION

Current Controlled Trials ISRCTN80061723.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 70. See the NIHR Journals Library website for further project information.

Lower trial participation by culturally and linguistically diverse (CALD) cancer patients is largely due to language barriers

AIM

Clinical trials play a critical role in advancing cancer care, but international research shows that few cancer patients, particularly culturally and linguistically diverse (CALD) patients, participate in trials. This limits generalizability of trial results and increases health disparities. This study aimed to establish rates and correlates of trial participation among CALD patients in South Western Sydney Local Health District (SWSLHD), a highly culturally diverse area.

METHODS

Data from all cancer patients diagnosed and/or treated in SWSLHD from January 2006 to July 2016 were analyzed retrospectively. The primary outcome was trial enrolment among patients born in non-English speaking countries (CALD) versus English speaking countries (non-CALD). Multivariable logistic regression evaluated CALD status as a predictor of trial participation. Moderators of trial participation by the different CALD groups, namely those whose preferred language was English (CALD-PLE) or was not English (CALD-PLNE), were examined by testing interactions between CALD status and other demographic and clinical variables.

RESULTS

A total of 19 453 patients were analyzed (54.9% non-CALD, 16.5% CALD-PLE, 18.5% CALD-PLNE). Overall, 7.4% of patients were enrolled in a trial. Trial participation was significantly lower in CALD patients than non-CALD patients (5.7% vs 8.4%; odds ratio [OR] = 0.80; 95% confidence interval [CI], 0.69-0.91; P = 0.001). CALD-PLNE patients were less likely to participate in trials than non-CALD (OR = 0.45; 95% CI, 0.36-0.56; P < 0.0001) and CALD-PLE patients (OR = 0.53; 95% CI, 0.67-0.41; P < 0.0001).

CONCLUSIONS

Limited English proficiency seems particularly unfavorable to trial participation. Development and evaluation of strategies to overcome language barriers (e.g. simplified and translated multimedia participant information materials) is needed.

Novel Approach for Maximizing Follow-Up in Cosmetic Surgery Clinical Trials: The Ideal Implant Core Trial Experience

BACKGROUND

High follow-up rates are critical for robust research with minimal bias, and are particularly important for breast implant Core Studies seeking U.S. Food and Drug Administration approval. The Core Study for IDEAL IMPLANT, the most recently U.S. Food and Drug Administration-approved breast implant, used a novel incentive payment model to achieve higher follow-up rates than in previous breast implant trials.

METHODS

At enrollment, $3500 was deposited into an independent, irrevocable trust for each of the 502 subjects and invested in a diversified portfolio. If a follow-up visit is missed, the subject is exited from the study and compensated for completed visits, but the remainder of her share of the funds stay in the trust. At the conclusion of the 10-year study, the trust will be divided among those subjects who completed all required follow-up visits. For primary and revision augmentation cohorts, the U.S. Food and Drug Administration published follow-up rates from Core Studies were compared for all currently available breast implants.

RESULTS

Five-year follow-up rates for the IDEAL IMPLANT Core Study are higher for both primary augmentation and revision augmentation cohorts (94.9 percent and 96.7 percent, respectively) when compared to all other trials that have used U.S. Food and Drug Administration standardized follow-up reporting (MemoryShape, Allergan 410, and Sientra Core Studies).

CONCLUSIONS

This trial demonstrates the utility of a novel incentive strategy to maximize follow-up in cosmetic surgery patients. This strategy may benefit future cosmetic surgery trials and perhaps any prospective research trial by providing more complete data.

CLINICAL QUESTION/LEVEL OF EVIDENCE

Therapeutic, IV.

Supplementing electronic health records through sample collection and patient diaries: A study set within a primary care research database

PURPOSE

To describe a novel observational study that supplemented primary care electronic health record (EHR) data with sample collection and patient diaries.

METHODS

The study was set in primary care in England. A list of 3974 potentially eligible patients was compiled using data from the Clinical Practice Research Datalink. Interested general practices opted into the study then confirmed patient suitability and sent out postal invitations. Participants completed a drug-use diary and provided saliva samples to the research team to combine with EHR data.

RESULTS

Of 252 practices contacted to participate, 66 (26%) mailed invitations to patients. Of the 3974 potentially eligible patients, 859 (22%) were at participating practices, and 526 (13%) were sent invitations. Of those invited, 117 (22%) consented to participate of whom 86 (74%) completed the study.

CONCLUSIONS

We have confirmed the feasibility of supplementing EHR with data collected directly from patients. Although the present study successfully collected essential data from patients, it also underlined the requirement for improved engagement with both patients and general practitioners to support similar studies.

Identifying research priorities for effective retention strategies in clinical trials

BACKGROUND

The failure to retain patients or collect primary-outcome data is a common challenge for trials and reduces the statistical power and potentially introduces bias into the analysis. Identifying strategies to minimise missing data was the second highest methodological research priority in a Delphi survey of the Directors of UK Clinical Trial Units (CTUs) and is important to minimise waste in research. Our aim was to assess the current retention practices within the UK and priorities for future research to evaluate the effectiveness of strategies to reduce attrition.

METHODS

Seventy-five chief investigators of NIHR Health Technology Assessment (HTA)-funded trials starting between 2009 and 2012 were surveyed to elicit their awareness about causes of missing data within their trial and recommended practices for improving retention. Forty-seven CTUs registered within the UKCRC network were surveyed separately to identify approaches and strategies being used to mitigate missing data across trials. Responses from the current practice surveys were used to inform a subsequent two-round Delphi survey with registered CTUs. A consensus list of retention research strategies was produced and ranked by priority.

RESULTS

Fifty out of seventy-five (67%) chief investigators and 33/47 (70%) registered CTUs completed the current practice surveys. Seventy-eight percent of trialists were aware of retention challenges and implemented strategies at trial design. Patient-initiated withdrawal was the most common cause of missing data. Registered CTUs routinely used newsletters, timeline of participant visits, and telephone reminders to mitigate missing data. Whilst 36 out of 59 strategies presented had been formally or informally evaluated, some frequently used strategies, such as site initiation training, have had no research to inform practice. Thirty-five registered CTUs (74%) participated in the Delphi survey. Research into the effectiveness of site initiation training, frequency of patient contact during a trial, the use of routinely collected data, the frequency and timing of reminders, triggered site training and the time needed to complete questionnaires was deemed critical. Research into the effectiveness of Christmas cards for site staff was not of critical importance.

CONCLUSION

The surveys of current practices demonstrates that a variety of strategies are being used to mitigate missing data but with little evidence to support their use. Six retention strategies were deemed critically important within the Delphi survey and should be a primary focus of future retention research.

Discontinuation and non-publication of randomised clinical trials supported by the main public funding body in Switzerland: a retrospective cohort study

OBJECTIVE

The Swiss National Science Foundation (SNSF) promotes academic excellence through competitive selection of study proposals and rigorous evaluation of feasibility, but completion status and publication history of SNSF-supported randomised clinical trials (RCTs) remain unclear. The main objectives were to review all healthcare RCTs supported by the SNSF for trial discontinuation and non-publication, to investigate potential risk factors for trial discontinuation due to poor recruitment and non-publication, and to compare findings to other Swiss RCTs not supported by the SNSF.

DESIGN

We established a retrospective cohort of all SNSF-supported RCTs for which recruitment and funding had ended in 2015 or earlier. For each RCT, two investigators independently searched corresponding publications in electronic databases. In addition, we approached all principal investigators to ask for additional publications and information about trial discontinuation. Teams of two investigators independently extracted details about study design, recruitment of participants, outcomes, analysis and sample size from the original proposal and, if available, from trial registries and publications. We used multivariable regression analysis to explore potential risk factors associated with discontinuation due to poor recruitment and with non-publication, and to compare our results with data from a previous cohort of Swiss RCTs not supported by the SNSF.

RESULTS

We included 101 RCTs supported by the SNSF between 1986 and 2015. Eighty-seven (86%) principal investigators responded to our survey. Overall, 69 (68%) RCTs were completed, 26 (26%) RCTs were prematurely discontinued (all due to slow recruitment) and the completion status remained unclear for 6 (6%) RCTs. For analysing publication status, we excluded 4 RCTs for which follow-up was still ongoing and 9 for which manuscripts were still in preparation. Of the remaining 88 RCTs, 53 (60%) were published as full articles in peer-reviewed journals. Multivariable regression models suggested that discontinued trials were at higher risk for non-publication than completed trials (adjusted OR 7.61; 95% CI 2.44 to 27.09). Compared with other Swiss RCTs, the risk of discontinuation for SNSF-supported RCTs was higher than in industry-initiated RCTs (adjusted OR 3.84; 95% CI 1.68 to 8.74), but not significantly different from investigator-initiated RCTs not supported by the SNSF (adjusted OR 1.05; 95% CI 0.51 to 2.11). We found no evidence that the proportion of discontinued or unpublished RCTs decreased over the last 20 years.

CONCLUSIONS

One out of four SNSF-supported RCTs were prematurely discontinued due to slow recruitment, 40% of all included RCTs and 70% of all discontinued RCTs were not published in peer-reviewed journals. There is a case to reconsider how public funding bodies such as the SNSF could improve their feasibility assessment and promote publication of RCTs irrespective of completion status.

A feasibility study of a novel, task-specific movement training intervention for women with patellofemoral pain

OBJECTIVE

To investigate whether a novel, task-specific training intervention that focused on correcting pain-producing movement patterns was feasible and whether it would improve hip and knee kinematics, pain, and function in women with patellofemoral pain.

DESIGN

Prospective, non-randomized, within-group, double baseline, feasibility intervention study.

SUBJECTS

A total of 25 women with patellofemoral pain were enrolled.

INTERVENTION

The intervention, delivered 2×/week for six weeks, consisted of supervised, high-repetition practice of daily weight-bearing and recreational activities. Activities were selected and progressed based on participants' interest and ability to maintain optimal alignment without increasing pain.

MAIN MEASURES

Primary feasibility outcomes were recruitment, retention, adherence, and treatment credibility (Credibility/Expectancy Questionnaire). Secondary outcomes assessing intervention effects were hip and knee kinematics, pain (visual analog scale: current, average in past week, maximum in past week), and function (Patient-Specific Functional Scale).

RESULTS

A total of 25 participants were recruited and 23 were retained (92% retention). Self-reported average daily adherence was 79% and participants were able to perform their prescribed home program correctly (reduced hip and knee frontal plane angles) by the second intervention visit. On average, treatment credibility was rated 25 (out of 27) and expectancy was rated 22 (out of 27). Hip and knee kinematics, pain, and function improved following the intervention when compared to the control phase.

CONCLUSION

Based on the feasibility outcomes and preliminary intervention effects, this task-specific training intervention warrants further investigation and should be evaluated in a larger, randomized clinical trial.

Informed consent in randomised controlled trials: development and preliminary evaluation of a measure of Participatory and Informed Consent (PIC)

BACKGROUND

Informed consent (IC) is an ethical and legal prerequisite for trial participation, yet current approaches evaluating participant understanding for IC during recruitment lack consistency. No validated measure has been identified that evaluates participant understanding for IC based on their contributions during consent interactions. This paper outlines the development and formative evaluation of the Participatory and Informed Consent (PIC) measure for application to recorded recruitment appointments. The PIC allows the evaluation of recruiter information provision and evidence of participant understanding.

METHODS

Published guidelines for IC were reviewed to identify potential items for inclusion. Seventeen purposively sampled trial recruitment appointments from three diverse trials were reviewed to identify the presence of items relevant to IC. A developmental version of the measure (DevPICv1) was drafted and applied to six further recruitment appointments from three further diverse trials to evaluate feasibility, validity, stability and inter-rater reliability. Findings guided revision of the measure (DevPICv2) which was applied to six further recruitment appointments as above.

RESULTS

DevPICv1 assessed recruiter information provision (detail and clarity assessed separately) and participant talk (detail and understanding assessed separately) over 20 parameters (or 23 parameters for three-arm trials). Initial application of the measure to six diverse recruitment appointments demonstrated promising stability and inter-rater reliability but a need to simplify the measure to shorten time for completion. The revised measure (DevPICv2) combined assessment of detail and clarity of recruiter information and detail and evidence of participant understanding into two single scales for application to 22 parameters or 25 parameters for three-arm trials. Application of DevPICv2 to six further diverse recruitment appointments showed considerable improvements in feasibility (e.g. time to complete) with good levels of stability (i.e. test-retest reliability) and inter-rater reliability maintained.

CONCLUSIONS

The DevPICv2 provides a measure for application to trial recruitment appointments to evaluate quality of recruiter information provision and evidence of patient understanding and participation during IC discussions. Initial evaluation shows promising feasibility, validity, reliability and ability to discriminate across a range of recruiter practice and evidence of participant understanding. More validation work is needed in new clinical trials to evaluate and refine the measure further.

Pilot randomised controlled trial of the ENGAGER collaborative care intervention for prisoners with common mental health problems, near to and after release

Background

Rates of common mental health problems are much higher in prison populations, but access to primary care mental health support falls short of community equivalence. Discontinuity of care on release is the norm and is further complicated by substance use and a range of social problems, e.g. homelessness. To address these problems, we worked with criminal justice, third sector social inclusion services, health services and people with lived experiences (peer researchers), to develop a complex collaborative care intervention aimed at supporting men with common mental health problems near to and following release from prison. This paper describes an external pilot trial to test the feasibility of a full randomised controlled trial.

Methods

Eligible individuals with 4 to 16 weeks left to serve were screened to assess for common mental health problems. Participants were then randomised at a ratio of 2:1 allocation to ENGAGER plus standard care (intervention) or standard care alone (treatment as usual). Participants were followed up at 1 and 3 months’ post release. Success criteria for this pilot trial were to meet the recruitment target sample size of 60 participants, to follow up at least 50% of participants at 3 months’ post release from prison, and to deliver the ENGAGER intervention. Estimates of recruitment and retention rates and 95% confidence intervals (CIs) are reported. Descriptive analyses included summaries (percentages or means) for participant demographics, and baseline characteristics are reported.

Results

Recruitment target was met with 60 participants randomised in 9 months. The average retention rates were 73% at 1 month [95% CI 61 to 83] and 47% at 3 months follow-up [95% CI 35 to 59]. Ninety percent of participants allocated to the intervention successfully engaged with a practitioner before release and 70% engaged following release.

Conclusions

This pilot confirms the feasibility of conducting a randomised trial for prison leavers with common mental health problems. Based on this pilot study and some minor changes to the trial design and intervention, a full two-centre randomised trial assessing the clinical and cost-effectiveness of the ENGAGER intervention is currently underway.

Electronic supplementary material

The online version of this article (doi:10.1186/s40814-017-0163-6) contains supplementary material, which is available to authorized users.

Early termination of cardiovascular trials as a consequence of poor accrual: analysis of ClinicalTrials.gov 2006-2015

OBJECTIVES

To present a snapshot of experimental cardiovascular research with a focus on geographical and temporal patterns of early termination due to poor accrual.

SETTING

The Aggregate Analysis of ClinicalTrials.gov (AACT) database, reflecting ClinicalTrials.gov as of 27 March 2016.

DESIGN

The AACT database was searched for all cardiovascular clinical trials that started from January 2006 up to December 2015.

RESULTS

Thirteen thousand and seven hundred twenty-nine cardiovascular trials were identified. Of these, 8900 (65%) were classified as closed studies. Globally, 11% of closed trials were terminated. This proportion varied from 9.6% to 14% for trials recruiting from Europe and Americas, respectively, with a slightly decreasing trend (p=0.02) over the study period. The most common reason for trials failing to complete was poor accrual (41%). Intercontinental trials exhibited lower figures of poor accrual as the reason for their early stopping, as compared with trials recruiting in a single continent (28% vs 44%, p=0.002).

CONCLUSIONS

Poor accrual significantly challenges the successful completion of cardiovascular clinical trials. Findings are suggestive of a positive effect of globalisation of cardiovascular clinical research on the achievement of enrolment goals within a reasonable time frame.

Developing and evaluating multimedia information resources to improve engagement of children, adolescents, and their parents with trials (TRECA study): Study protocol for a series of linked randomised controlled trials

Background

Randomised controlled trials are widely established as the best method for testing health interventions whilst minimising bias. However, recruitment and subsequent retention of children and adolescents in healthcare trials is challenging. Participant information sheets are often lengthy and difficult to read and understand. Presenting key information using multimedia may help to overcome these limitations and better support young people and their parents in deciding whether to participate in a clinical trial.

Methods

The TRECA (TRials Engagement in Children and Adolescents) study has two phases. The first phase involves a qualitative study with children and adolescents and their parents to inform the development of multimedia information resources and iterative user testing to refine the resources. The second phase will embed the use of the multimedia information resources into six host trials in the United Kingdom. Patients and parents approached to participate in the host trials will be randomly allocated to either use the multimedia information resource in conjunction with standard participant information sheets, the multimedia information resource alone, or the standard participant information sheets alone. The primary outcome will be the effect of the multimedia information resources on recruitment into trials. Other outcomes measured include the effect of multimedia information resources on retention of participants into the host trials and the impact on family members’ decision-making processes, when compared to standard participant information sheets alone.

Discussion

This study will inform whether multimedia information resources, when developed using participatory design principles, are able to increase recruitment and retention of children and adolescents into trials. There is also the potential for patients to make better informed decisions through the use of multimedia information resources. The multimedia information resources also have the potential to assist with providing information on other healthcare decisions outside of clinical trials.

Trial registration

ISRCTN registry: ISRCTN73136092 (doi:10.1186/ISRCTN73136092). Registered on 24 August 2016.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-1962-z) contains supplementary material, which is available to authorized users.

A framework for prospectively defining progression rules for internal pilot studies monitoring recruitment

Just over half of publicly funded trials recruit their target sample size within the planned study duration. When recruitment targets are missed, the funder of a trial is faced with the decision of either committing further resources to the study or risk that a worthwhile treatment effect may be missed by an underpowered final analysis. To avoid this challenging situation, when there is insufficient prior evidence to support predicted recruitment rates, funders now require feasibility assessments to be performed in the early stages of trials. Progression criteria are usually specified and agreed with the funder ahead of time. To date, however, the progression rules used are typically ad hoc. In addition, rules routinely permit adaptations to recruitment strategies but do not stipulate criteria for evaluating their effectiveness. In this paper, we develop a framework for planning and designing internal pilot studies which permit a trial to be stopped early if recruitment is disappointing or to continue to full recruitment if enrolment during the feasibility phase is adequate. This framework enables a progression rule to be pre-specified and agreed upon prior to starting a trial. The novel two-stage designs stipulate that if neither of these situations arises, adaptations to recruitment should be made and subsequently evaluated to establish whether they have been successful. We derive optimal progression rules for internal pilot studies which minimise the expected trial overrun and maintain a high probability of completing the study when the recruitment rate is adequate. The advantages of this procedure are illustrated using a real trial example.

Series: Pragmatic trials and real world evidence: Paper 3. Patient selection challenges and consequences

This paper addresses challenges of identifying, enrolling, and retaining participants in a trial conducted within a routine care setting. All patients who are potential candidates for the treatments in routine clinical practice should be considered eligible for a pragmatic trial. To ensure generalizability, the recruited sample should have a similar distribution of the treatment effect modifiers as the target population. In practice, this can be best achieved by including-within the selected sites-all patients without further selection. If relevant heterogeneity between subgroups is expected, increasing the relative proportion of the subgroup of patients in the heterogeneous trial could be considered (oversampling) or a separate trial in this subgroup can be planned. Selection will nevertheless occur. Low enrollment and loss to follow-up can introduce selection and can jeopardize validity as well as generalizability. Pragmatic trials are conducted in clinical practice rather than in a dedicated research setting, which could reduce recruitment rates. However, if a trial poses a minimal burden to the physician and the patient and routine clinical practice is maximally adhered to, the participation rate may be high and loss to follow-up will not be a specific problem for pragmatic trials.

Premature Discontinuation of Pediatric Randomized Controlled Trials: A Retrospective Cohort Study

OBJECTIVES

To determine the proportion of pediatric randomized controlled trials (RCTs) that are prematurely discontinued, examine the reasons for discontinuation, and compare the risk for recruitment failure in pediatric and adult RCTs.

STUDY DESIGN

A retrospective cohort study of RCTs approved by 1 of 6 Research Ethics Committees (RECs) in Switzerland, Germany, and Canada between 2000 and 2003. We recorded trial characteristics, trial discontinuation, and reasons for discontinuation from protocols, corresponding publications, REC files, and a survey of trialists.

RESULTS

We included 894 RCTs, of which 86 enrolled children and 808 enrolled adults. Forty percent of the pediatric RCTs and 29% of the adult RCTs were discontinued. Slow recruitment accounted for 56% of pediatric RCT discontinuations and 43% of adult RCT discontinuations. Multivariable logistic regression analyses suggested that pediatric RCT was not an independent risk factor for recruitment failure after adjustment for other potential risk factors (aOR, 1.22; 95% CI, 0.57-2.63). Independent risk factors were acute care setting (aOR, 4.00; 95% CI, 1.72-9.31), nonindustry sponsorship (aOR, 4.45; 95% CI, 2.59-7.65), and smaller planned sample size (aOR, 1.05; 95% CI 1.01-1.09, in decrements of 100 participants).

CONCLUSION

Forty percent of pediatric RCTs were discontinued prematurely, owing predominately to slow recruitment. Enrollment of children was not an independent risk factor for recruitment failure.