Barriers and facilitators to patient recruitment to a cluster randomized controlled trial in primary care: lessons for future trials

Barriers and facilitators to conducting randomised controlled trials within routine care of neurorehabilitation centres: a qualitative study

BACKGROUND

Randomised controlled trials (RCTs) are considered the gold standard for generating clinical evidence. The focus on high internal validity in RCTs challenges the external validity and generalisability of findings, potentially hindering their application in routine care. In neurorehabilitation, limited literature addresses conducting RCTs feasibly and efficiently. We investigated barriers and facilitators to conducting RCTs within routine care of neurorehabilitation centres from the perspective of stakeholders in neurorehabilitation in Germany and Austria.

METHODS

We conducted semi-structured interviews with stakeholders in neurorehabilitation from four centres in Germany and Austria, informed by the Theoretical Domains Framework (TDF) and the Capability, Opportunity, Motivation and Behaviour model (COM-B). Employing a hybrid approach, the interview analysis integrated both deductive, theory-driven analysis based on the TDF domains and COM-B model and inductive, reflexive thematic analysis.

RESULTS

Twelve stakeholders (4 physicians, 4 therapy managers, 4 therapists; 5 females, 7 males; with research experience spanning 0-40 years) were interviewed. Key barriers to conducting RCTs in neurological rehabilitation centres include limited financial, human, and time resources, high clinical workloads, and a lack of interest of some therapists. Ineffective leadership, perceived lack of research expertise, and communication issues were also significant barriers. Social influence factors such as lack of employer support and inadequate training access further contributed to the challenges. Additionally, barriers included insufficient research infrastructure, limited space, internal power struggles, and rigid cost bearer specifications. Key facilitators included physicians' and therapists' motivation to advance the field, contribute to knowledge, and to prioritise patient health. Support from supervisors, joint decision-making, and efficient organisation were crucial facilitators. Flexible therapy planning, mutual support, and interdisciplinary collaboration also played important roles.

CONCLUSION

Our results suggest that increasing professional development and understanding, along with providing adequate financial, human, time, and spatial resources to support research endeavours, implementing effective communication strategies to enhance interdisciplinary collaboration and coordination among team members may contribute to increased motivation and facilitate RCTs within the setting of neurorehabilitation centres.

TRIAL REGISTRATION

This study was prospectively registered with the German Clinical Trials Register (08.04.2021 DRKSID DRKS00024982).

The role of mindfulness and resilience in Navy SEAL training

Mindfulness and resilience are thought to be essential qualities of the military's special operations community. Both are tested daily in Special Operations Forces (SOF) assessment and selection efforts to prepare candidates to persist through grueling training and complex combat situations; but these qualities are rarely measured. While military leadership places value on the concepts of mindfulness and resilience, there is minimal empirical research examining the role that they play in the completion of training. This longitudinal study followed three classes of SEAL candidates at Basic Underwater Demolition/SEAL (BUD/S) training over their six-month selection program. We estimated logit models predicting successful completion of BUD/S and specific types of failure in that training environment with indexes of mindfulness and resilience at the start of the program as predictors of completion. The results indicate that (1) mindfulness is unrelated to completion, while (2) resilience is positively related to completion, and (3) The results indicate that mindfulness is generally unrelated to completion, while resilience generally predicts completion.

Utilization of EHRs for clinical trials: a systematic review

BACKGROUND AND OBJECTIVE

Clinical trials are of high importance for medical progress. This study conducted a systematic review to identify the applications of EHRs in supporting and enhancing clinical trials.

MATERIALS AND METHODS

A systematic search of PubMed was conducted on 12/3/2023 to identify relevant studies on the use of EHRs in clinical trials. Studies were included if they (1) were full-text journal articles, (2) were written in English, (3) examined applications of EHR data to support clinical trial processes (e.g. recruitment, screening, data collection). A standardized form was used by two reviewers to extract data on: study design, EHR-enabled process(es), related outcomes, and limitations.

RESULTS

Following full-text review, 19 studies met the predefined eligibility criteria and were included. Overall, included studies consistently demonstrated that EHR data integration improves clinical trial feasibility and efficiency in recruitment, screening, data collection, and trial design.

CONCLUSIONS

According to the results of the present study, the use of Electronic Health Records in conducting clinical trials is very helpful. Therefore, it is better for researchers to use EHR in their studies for easy access to more accurate and comprehensive data. EHRs collects all individual data, including demographic, clinical, diagnostic, and therapeutic data. Moreover, all data is available seamlessly in EHR. In future studies, it is better to consider the cost-effectiveness of using EHR in clinical trials.

Recruiting general practitioners and older patients with multimorbidity to randomized trials

BACKGROUND

Older patients with multimorbidity are under-represented in experimental research.

OBJECTIVE

To explore the barriers and facilitators to general practitioner (GP) and older patient recruitment and retention in a cluster randomized controlled trial (RCT).

METHOD

This descriptive study uses qualitative and quantitative data from a cluster RCT, designed to evaluate the effectiveness of a medicines optimization intervention. The SPPiRE cluster RCT enrolled 51 general practices and 404 patients aged ≥65 years and prescribed ≥15 medicines. Quantitative data were collected from all recruited practices and 32 additional practices who were enrolled, but unable to recruit sufficient participants. Qualitative data were collected from purposive samples of intervention GPs (18/26), patients (27/208), and researcher logs and analysed thematically using inductive coding.

RESULTS

Enrolment rates for practices and patients were 37% and 25%, respectively. Barriers to GP recruitment were lack of resources and to patient recruitment were difficulty understanding trial material and concern about medicines being taken away. GPs' primary motivation was perceived importance of the research question, whereas patients' primary motivation was trust in their GP. All general practices were retained. Thirty-five patients (8.6%) were lost to follow-up for primary outcomes, mainly because they had died and 45% did not return patient-reported outcome measures (PROMs).

CONCLUSION

Patient retention for the primary outcome was high, as it was collected directly from patient records. Patient completion of PROM data was poor, reflecting difficulty in understanding trial material. Recruiting older patients with multimorbidity to clinical trials is possible but requires significant resource and planning.

TRIAL REGISTRATION

ISRCTN Registry ISRCTN12752680.

A multifaceted intervention to reduce antibiotic prescribing among CHIldren with acute COugh and respiratory tract infection: the CHICO cluster RCT

Background

Clinical uncertainty in primary care regarding the prognosis of children with respiratory tract infections contributes to the unnecessary use of antibiotics. Improved identification of children at low risk of future hospitalisation might reduce clinical uncertainty. A National Institute for Health and Care Research-funded 5-year programme (RP-PG-0608-10018) was used to develop and feasibility test an intervention.

Objectives

The aim of the children with acute cough randomised controlled trial was to reduce antibiotic prescribing among children presenting with acute cough and respiratory tract infection without increasing hospital admission.

Design

An efficient, pragmatic open-label, two-arm trial (with embedded qualitative and health economic analyses) using practice-level randomisation using routinely collected data as the primary outcome.

Setting

General practitioner practices in England.

Participants

General practitioner practices using the Egton Medical Information Systems® patient-record system for children aged 0-9 years presenting with a cough or upper respiratory tract infection. Recruited by Clinical Research Networks and Clinical Commissioning Groups.

Intervention

Comprised: (1) elicitation of parental concerns during consultation; (2) a clinician-focused prognostic algorithm to identify children with acute cough and respiratory tract infection at low, average or elevated risk of hospitalisation in the next 30 days accompanied by prescribing guidance, (3) provision of a printout for carers including safety-netting advice.

Main outcome measures

Co-primaries using the practice list-size for children aged 0-9 years as the denominator: rate of dispensed amoxicillin and macrolide items at each practice (superiority comparison) from NHS Business Services Authority ePACT2 and rate of hospital admission for respiratory tract infection (non-inferiority comparison) from Clinical Commissioning Groups, both routinely collected over 12 months.

Results

Of the 310 practices required, 294 (95%) were recruited (144 intervention and 150 controls) with 336,496 registered 0-9-year-olds (5% of all 0-9-year-old children in England) from 47 Clinical Commissioning Groups. Included practices were slightly larger than those not included, had slightly lower baseline dispensing rates and were located in more deprived areas (reflecting the distribution for practice postcodes nationally). Twelve practices (4%) subsequently withdrew (six related to the pandemic). The median number of times the intervention was used was 70 per practice (by a median of 9 clinicians) over 12 months. There was no evidence that the antibiotic dispensing rate in the intervention practices [0.155 (95% confidence interval 0.135 to 0.179)] differed to controls [0.154 (95% confidence interval 0.130 to 0.182), relative risk= 1.011 (95% confidence interval 0.992 to 1.029); p = 0.253]. There was, overall, a reduction in dispensing levels and intervention usage during the pandemic. The rate of hospitalisation for respiratory tract infection in the intervention practices [0.019 (95% confidence interval 0.014 to 0.026)] compared to the controls [0.021 (95% confidence interval 0.014 to 0.029)] was non-inferior [relative risk = 0.952 (95% confidence interval 0.905 to 1.003)]. The qualitative evaluation found the clinicians liked the intervention, used it as a supportive aid, especially with borderline cases but that it, did not always integrate well within the consultation flow and was used less over time. The economic evaluation found no evidence of a difference in mean National Health Service costs between arms; mean difference -£1999 (95% confidence interval -£6627 to 2630).

Conclusions

The intervention was feasible and subjectively useful to practitioners, with no evidence of harm in terms of hospitalisations, but did not impact on antibiotic prescribing rates.

Future work and limitations

Although the intervention does not appear to change prescribing behaviour, elements of the approach may be used in the design of future interventions.

Trial registration

This trial is registered as ISRCTN11405239 (date assigned 20 April 2018) at www.controlled-trials.com (accessed 5 September 2022). Version 4.0 of the protocol is available at: https://www.journalslibrary.nihr.ac.uk/ (accessed 5 September 2022).

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment (NIHR award ref: 16/31/98) programme and is published in full in Health Technology Assessment; Vol. 27, No. 32. See the NIHR Funding and Awards website for further award information.

Structured communication methods for mental health consultations in primary care: a scoping review

BACKGROUND

Majority of people with mental health problems attend primary care for support. Interventions that structure consultations have been found effective for physical health conditions and secondary mental health care. The aim of the review is to identify what tools or interventions exist to structure communication in primary care for appointments related to mental health problems and examine existing evidence for effectiveness for mental health and quality of life outcomes.

METHODS

Quantitative and qualitative studies were eligible for inclusion if staff was based in a primary care setting and the intervention involved bi-directional communication with adult patients. Six databases were searched (MEDLINE, Web of Knowledge, EMBASE, PsycINFO, The Cochrane Library, CINAHL) with no time restriction. Search terms combined four concepts with key words such as "structured" and "interaction" and "mental illness" and "primary care". Reference lists of eligible studies were searched.

RESULTS

After removing duplicates, 3578 records were found and underwent further screening. A total of 16 records were included, representing eight different interventions from five countries. The majority were delivered by primary care doctors and focused on patients experiencing psychological distress. Similarities across interventions' service delivery were that most were created for a broad patient population, used self-report assessments at the start and actions or plans as the end point, and employed group settings and didactic methods for training staff in the intervention. Booster and follow-up trainings were not offered in any of the interventions, and supervision was only part of the process for one. The evidence for effectiveness for mental health and quality of life outcomes was mixed with three out of five RCTs finding a positive effect.

CONCLUSIONS

Although the idea of structuring communication for mental health consultations has been around since the 1980s, relatively few interventions have attempted to structure the conversations within the consultation, rather than modifying pre-visit events. As the evidence-base showed feasibility and acceptability for a number of interventions, there is scope for those interventions to be developed further and tested more rigorously.

Randomized Clinical Trials and Observational Tribulations: Providing Clinical Evidence for Personalized Surgical Pain Management Care Models

Proving clinical superiority of personalized care models in interventional and surgical pain management is challenging. The apparent difficulties may arise from the inability to standardize complex surgical procedures that often involve multiple steps. Ensuring the surgery is performed the same way every time is nearly impossible. Confounding factors, such as the variability of the patient population and selection bias regarding comorbidities and anatomical variations are also difficult to control for. Small sample sizes in study groups comparing iterations of a surgical protocol may amplify bias. It is essentially impossible to conceal the surgical treatment from the surgeon and the operating team. Restrictive inclusion and exclusion criteria may distort the study population to no longer reflect patients seen in daily practice. Hindsight bias is introduced by the inability to effectively blind patient group allocation, which affects clinical result interpretation, particularly if the outcome is already known to the investigators when the outcome analysis is performed (often a long time after the intervention). Randomization is equally problematic, as many patients want to avoid being randomly assigned to a study group, particularly if they perceive their surgeon to be unsure of which treatment will likely render the best clinical outcome for them. Ethical concerns may also exist if the study involves additional and unnecessary risks. Lastly, surgical trials are costly, especially if the tested interventions are complex and require long-term follow-up to assess their benefit. Traditional clinical testing of personalized surgical pain management treatments may be more challenging because individualized solutions tailored to each patient's pain generator can vary extensively. However, high-grade evidence is needed to prompt a protocol change and break with traditional image-based criteria for treatment. In this article, the authors review issues in surgical trials and offer practical solutions.

Factors associated with recruitment to randomised controlled trials in general practice: a systematic mixed studies review

BACKGROUND

A common challenge for randomised controlled trials (RCTs) is recruiting enough participants to be adequately powered to answer the research question. Recruitment has been set as a priority research area in trials to improve recruitment and thereby reduce wasted resources in conducted trials that fail to recruit sufficiently.

METHODS

We conducted a systematic mixed studies review to identify the factors associated with recruitment to RCTs in general practice. On September 8, 2020, English language studies were identified from MEDLINE, EMBASE, Cochrane Database of Systematic Reviews and CENTRAL databases for published studies. NTIS and OpenGrey were searched for grey literature, and BMC Trials was hand searched. A narrative synthesis was conducted for qualitative studies and a thematic synthesis for qualitative studies.

RESULTS

Thirty-seven studies met the inclusion criteria. These were of different study types (10 cross-sectional, 5 non-randomised studies of interventions, 2 RCTs, 10 qualitative and 10 mixed methods). The highest proportion was conducted in the UK (48%). The study quality was generally poor with 24 (65%) studies having major concerns. A complex combination of patient, practitioner or practice factors, and patient, practitioner or practice recruitment were assessed to determine the possible associations. There were more studies of patients than of practices or practitioners.

CONCLUSIONS

For practitioners and patients alike, a trial that is clinically relevant is critical in influencing participation. Competing demands are given as an important reason for declining participation. There are concerns about randomisation relating to its impact on shared decision-making and not knowing which treatment will be assigned. Patients make decisions about whether they are a candidate for the trial even when they objectively fulfil the eligibility criteria. General practice processes, such as difficulties arranging appointments, can hinder recruitment, and a strong pre-existing doctor-patient relationship can improve recruitment. For clinicians, the wish to contribute to the research enterprise itself is seldom an important reason for participating, though clinicians reported being motivated to participate when the research could improve their clinical practice. One of the few experimental findings was that opportunistic recruitment resulted in significantly faster recruitment compared to systematic recruitment. These factors have clear implications for trial design. Methodologically, recruitment research of practices and practitioners should have increased priority. Higher quality studies of recruitment are required to find out what actually works rather than what might work.

TRIAL REGISTRATION

PROSPERO CRD42018100695. Registered on 03 July 2018.

Intentional and actional components of engaged participation in public health research studies: qualitative synthesis of a recruitment and retention process into the theory-informed INTACT-RS framework

BACKGROUND

Ensuring motivated and successful study participation is a key challenge in the design and conduct of health research studies. Previously, recruitment barriers and facilitators have been identified mainly from experience, and rarely based on theoretical approaches. We developed a framework of intentional and actional components of engaged participation in public health research studies (INTACT-RS), informed by psychological behavioral models. We aimed a) to identify precise indicators for each framework component and b) to better understand which components and decision processes are essential for study participants.

METHODS

Within a multicenter research network, we applied various approaches to recruit parents of newborns, pediatricians, and midwives. All recruitment processes were documented from the perspective of both participants and researchers. We used different qualitative and quantitative data material, which we applied in a multistage process according to the basic principles of qualitative content analysis.

RESULTS

INTACT-RS encompasses pre-intentional, intentional and actional phases with a total of n = 15 components covering all aspects of an individual's involvement with a research study. During intention formation, an understanding of efforts and benefits, why participation is valuable beyond contributing to research, and how others perceive the study, were particularly important to (potential) participants. Subsequently (intentional phase), participants consider how and when participation is compatible with their own resources, ability and availability, and hence seek for close communication with, and flexibility and support from the research team. During and after (initial) participation (actional phase), participants' assessment of whether expectations and interests have been met impact crucial further steps, especially the willingness to continue and to recommend participation to others. A strong topic-wise and or supportive participation interest as well as active, continuous exchange with the researchers appeared to be central determinants of study completion and data validity.

CONCLUSIONS

A theoretical framework is now available to plan and conduct recruitment of different target groups, which accounts for essential motivational and volitional decision-making processes. Based on empirically specified constructs, possible barriers can be addressed even before the initial recruitment process. Therefore, recommendations for scientific practice have been formulated.

Clinical trial recruitment in primary care: exploratory factor analysis of a questionnaire to measure barriers and facilitators to primary care providers' involvement

BACKGROUND

Recruitment of sufficient participants for clinical trials remains challenging. Primary care is an important avenue for patient recruitment but is underutilized. We developed and pilot tested a questionnaire to measure relevant barriers and facilitators to primary care providers' involvement in recruiting patients for clinical trials.

METHODS

Prior research informed the development of the questionnaire. The initial instrument was revised using feedback obtained from cognitive interviews. We invited all primary care providers practicing within the University of Utah Health system to complete the revised questionnaire. We used a mixed-mode design to collect paper responses via in-person recruitment and email contacts to collect responses online. Descriptive statistics, exploratory factor analysis, Cronbach's alpha, and multivariable regression analyses were conducted.

RESULTS

Sixty-seven primary care providers participated in the survey. Exploratory factor analysis suggested retaining five factors, representing the importance of clinical trial recruitment in providers' professional identity, clinic-level interventions to facilitate referral, patient-related barriers, concerns about patient health management, and knowledge gaps. The five factors exhibited good or high internal consistency reliability. Professional identity and clinic-level intervention factors were significant predictors of providers' intention to participate in clinical trial recruitment activities.

CONCLUSIONS

Results of this exploratory analysis provide preliminary evidence of the internal structure, internal consistency reliability, and predictive validity of the questionnaire to measure factors relevant to primary care providers' involvement in clinical trial recruitment.

Advancing cluster randomised trials in children’s therapy: a survey of the acceptability of trial behaviours to therapists and parents

Background

Randomised controlled trials of non-pharmacological interventions in children’s therapy are rare. This is, in part, due to the challenges of the acceptability of common trial designs to therapists and service users. This study investigated the acceptability of participation in cluster randomised controlled trials to therapists and service users.

Methods

A national electronic survey of UK occupational therapists, physiotherapists, speech and language therapists, service managers, and parents of children who use their services. Participants were recruited by NHS Trusts sharing a link to an online questionnaire with children’s therapists in their Trust and with parents via Trust social media channels. National professional and parent networks also recruited to the survey. We aimed for a sample size of 325 therapists, 30 service managers, and 60 parents. Trial participation was operationalised as three behaviours undertaken by both therapists and parents: agreeing to take part in a trial, discussing a trial, and sharing information with a research team. Acceptability of the behaviours was measured using an online questionnaire based on the Theoretical Framework of Acceptability constructs: affective attitude, self-efficacy, and burden. The general acceptability of trials was measured using the acceptability constructs of intervention coherence and perceived effectiveness. Data were collected from June to September 2020. Numerical data were analysed using descriptive statistics and textual data by descriptive summary.

Results

A total of 345 survey responses were recorded. Following exclusions, 249 therapists and 40 parents provided data which was 69.6% (289/415) of the target sample size. It was not possible to track the number of people invited to take the survey nor those who viewed, but did not complete, the online questionnaire for calculation of response rates. A completion rate (participants who completed the last page of the survey divided by the participants who completed the first, mandatory, page of the survey) of 42.9% was achieved. Of the three specified trial behaviours, 140/249 (56.2%) therapists were least confident about agreeing to take part in a trial. Therapists (135/249, 52.6%) reported some confidence they could discuss a trial with a parent and child at an appointment. One hundred twenty of 249 (48.2%) therapists reported confidence in sharing information with a research team through questionnaires and interviews or sharing routine health data. Therapists (140/249, 56.2%) felt that taking part in the trial would take a lot of effort and resources. Support and resources, confidence with intervention allocation, and sense of control and professional autonomy over clinical practice were factors that positively affected the acceptability of trials. Of the 40 parents, twelve provided complete data. Most parents (18/40, 45%) agreed that it was clear how trials improve children’s therapies and outcomes and that a cluster randomised trial made sense to them in their therapy situation (12/29, 30%).

Conclusions

Using trials to evaluate therapy interventions is, in principle, acceptable to therapists, but their willingness to participate in trials is variable. The willingness to participate may be particularly influenced by their views related to the burden associated with trials, intervention allocation, and professional autonomy.

Comparing research recruitment strategies to prospectively identify patients presenting with breathlessness in primary care

Two recruitment strategies for research were compared to prospectively identify patients with breathlessness who are awaiting a diagnosis in primary care. The first method utilised searches of the electronic patient record (EPR), the second method involved an electronic template triggered during a consultation. Using an electronic template triggered at the point of consultation increased recruitment to prospective research approximately nine-fold compared with searching for symptom codes and study mailouts.

A multicenter program for electronic health record screening for patients with heart failure with preserved ejection fraction: Lessons from the DELIVER-EHR initiative

Efficiency in clinical trial recruitment and enrollment remains a major challenge in many areas of clinical medicine. In particular, despite the prevalence of heart failure with preserved ejection fraction (HFpEF), identifying patients with HFpEF for clinical trials has proven to be especially challenging. In this manuscript, we review strategies for contemporary clinical trial recruitment and present insights from the results of the DELIVER Electronic Health Record (EHR) Screening Initiative. The DELIVER trial was designed to evaluate the effects of dapagliflozin on clinical outcomes in patients with HFpEF. Within this trial, the multicenter DELIVER EHR Screening Initiative utilized EHR-based techniques in order to improve recruitment at selected sites in the United States. For this initiative, we developed and deployed a computable phenotype from the trial's eligibility criteria along with additional EHR tools at interested sites. Sites were then surveyed at the end of the program regarding lessons learned. Six sites were recruited, trained, and supported to utilize the EHR methodology and computable phenotype. Sites found the initiative to be helpful in identifying eligible patients and cited the individualized expert technical support as a critical factor in utilizing the program effectively. We found that the major challenge of implementation was the process of converting traditional inclusion/exclusion criteria into a computable phenotype within an established and ongoing trial. Other significant challenges noted by sites were the following: impact of the COVID-19 pandemic, engagement/support by local institutions, and limited availability of internal EHR experts/resources to execute programming. The study represents a proof-of-concept in the ability to utilize EHR-based tools in clinical trial recruitment for patients with HFpEF and provides important lessons for future initiatives. ClinicalTrials.gov Identifier: NCT03619213.

A Systematic Review of Interventions that Use Multidisciplinary Team Meetings to Manage Multimorbidity in Primary Care

Introduction

Multidisciplinary team (MDT) meetings could facilitate coordination of care for individuals living with multimorbidity, yet there is limited evidence on their effectiveness. We hence explored the common characteristics of MDT meetings in primary care and assessed the effectiveness of interventions that include such meetings, designed to improve outcomes for adults living with multimorbidity.

Methods

A systematic review of literature was conducted using MEDLINE and EMBASE. A narrative synthesis was performed, extracting study and MDT meeting characteristics, in addition to any outcomes reported.

Results

Four randomised controlled trials that were conducted in the United States of America were identified as eligible, recruiting a total of 3,509 adults living with multimorbidity. Common MDT meeting themes include regular frequency of discussion, the absence of patient involvement and the participation of three or four multiprofessionals. Significant improvements were observed in response to interventions with an MDT component across most measures, yet this trend did not extend to physical health outcomes.

Discussion

It is unclear if the results in this review are sufficient to support the widespread implementation of MDT meetings in primary care, for adults living with multimorbidity. Due to the paucity of studies collated, further research is required to inform widespread implementation.

Applying mixed methods to pilot feasibility studies to inform intervention trials

BACKGROUND

Pilot feasibility studies serve a uniquely important role in preparing for larger scale intervention trials by examining the feasibility and acceptability of interventions and the methods used to test them. Mixed methods (collecting, analyzing, and integrating quantitative and qualitative data and results) can optimize what can be learned from pilot feasibility studies to prepare rigorous intervention trials. Despite increasing use of mixed method designs in intervention trials, there is limited guidance on how to apply these approaches to address pilot feasibility study goals. The purpose of this article is to offer methodological guidance for how investigators can plan to integrate quantitative and qualitative methods within pilot feasibility studies to comprehensively address key research questions.

METHODS

We used an informal consensus-based process informed by key methodological resources and our team's complementary expertise as intervention researchers and mixed methodologists to develop guidance for applying mixed methods to optimize what can be learned from pilot feasibility studies. We developed this methodological guidance as faculty in the Mixed Methods Research Training Program (MMRTP) for the Health Sciences (R25MH104660) funded by the National Institutes of Health through the Office of Behavioral and Social Science Research.

RESULTS

We provide the following guidance for applying mixed methods to optimize pilot feasibility studies: (1) identify feasibility domain(s) that will be examined using mixed methods, (2) align quantitative and qualitative data sources for the domain(s) selected for mixing methods, (3) determine the timing of the quantitative and qualitative data collection within the flow of the pilot study, (4) plan integrative analyses using joint displays to understand feasibility, and (5) prepare to draw meta-inferences about feasibility and implications for the future trial from the integrated data.

CONCLUSIONS

By effectively integrating quantitative and qualitative data within pilot feasibility studies, investigators can harness the potential of mixed methods for developing comprehensive and nuanced understandings about feasibility. Our guidance can help researchers to consider the range of key decisions needed during intervention pilot feasibility testing to achieve a rigorous mixed methods approach generating enhanced insights to inform future intervention trials.

Effect of age, sex, and morbidity count on trial attrition: meta-analysis of individual participant level data from phase 3/4 industry funded clinical trials

Objectives

To estimate the association between individual participant characteristics and attrition from randomised controlled trials.

Design

Meta-analysis of individual participant level data (IPD).

Data sources

Clinical trial repositories (Clinical Study Data Request and Yale University Open Data Access).

Eligibility criteria for selecting studies

Eligible phase 3 or 4 trials identified according to prespecified criteria (PROSPERO CRD42018048202).

Main outcome measures

Association between comorbidity count (identified using medical history or concomitant drug treatment data) and trial attrition (failure for any reason to complete the final trial visit), estimated in logistic regression models and adjusted for age and sex. Estimates were meta-analysed in bayesian linear models, with partial pooling across index conditions and drug classes.

Results

In 92 trials across 20 index conditions and 17 drug classes, the mean comorbidity count ranged from 0.3 to 2.7. Neither age nor sex was clearly associated with attrition (odds ratio 1.04, 95% credible interval 0.98 to 1.11; and 0.99, 0.93 to 1.05, respectively). However, comorbidity count was associated with trial attrition (odds ratio per additional comorbidity 1.11, 95% credible interval 1.07 to 1.14). No evidence of non-linearity (assessed via a second order polynomial) was seen in the association between comorbidity count and trial attrition, with minimal variation across drug classes and index conditions. At a trial level, an increase in participant comorbidity count has a minor impact on attrition: for a notional trial with high level of attrition in individuals without comorbidity, doubling the mean comorbidity count from 1 to 2 translates to an increase in trial attrition from 29% to 31%.

Conclusions

Increased comorbidity count, irrespective of age and sex, is associated with a modest increased odds of participant attrition. The benefit of increased generalisability of including participants with multimorbidity seems likely to outweigh the disadvantages of increased attrition.

Can primary care research be conducted more efficiently using routinely reported practice-level data: a cluster randomised controlled trial conducted in England?

OBJECTIVES

Conducting randomised controlled trials (RCTs) in primary care is challenging; recruiting patients during time-limited or remote consultations can increase selection bias and physical access to patients' notes is costly and time-consuming. We investigated barriers and facilitators to running a more efficient design.

DESIGN

An RCT aiming to reduce antibiotic prescribing among children presenting with acute cough and a respiratory tract infection (RTI) with a clinician-focused intervention, embedded at the practice level. By using aggregate level, routinely collected data for the coprimary outcomes, we removed the need to recruit individual participants.

SETTING

Primary care.

PARTICIPANTS

Baseline data from general practitioner practices and interviews with individuals from Clinical Research Networks (CRNs) in England who helped recruit practices and Clinical Commission Groups (CCGs) who collected outcome data.

INTERVENTION

The intervention included: (1) explicit elicitation of parental concerns, (2) a prognostic algorithm to identify children at low risk of hospitalisation and (3) provision of a printout for carers including safety-netting advice.

COPRIMARY OUTCOMES

For 0-9 years old-(1) Dispensing data for amoxicillin and macrolide antibiotics and (2) hospital admission rate for RTI.

RESULTS

We recruited 294 of the intended 310 practices (95%) representing 336 496 registered 0-9 years old (5% of all 0-9 years old children). Included practices were slightly larger, had slightly lower baseline prescribing rates and were located in more deprived areas reflecting the national distribution. Engagement with CCGs and their understanding of their role in this research was variable. Engagement with CRNs and installation of the intervention was straight-forward although the impact of updates to practice IT systems and lack of familiarity required extended support in some practices. Data on the coprimary outcomes were almost 100%.

CONCLUSIONS

The infrastructure for trials at the practice level using routinely collected data for primary outcomes is viable in England and should be promoted for primary care research where appropriate.

TRIAL REGISTRATION NUMBER

ISRCTN11405239.

Maximising recruitment of research participants into a general practice based randomised controlled trial concerning lung diagnosis—staff insights from an embedded qualitative study

Background

The ELCID Trial was a feasibility randomised controlled trial examining the effect on lung cancer diagnosis of lowering the threshold for referral for urgent chest X-ray for smokers and recent ex-smokers, aged over 60 with new chest symptoms. The qualitative component aimed to explore the feasibility of individually randomising patients to an urgent chest X-ray or not and to investigate any barriers to patient recruitment and participation. This would inform the design of any future definitive trial. This paper explores general practice staff insights into participating in and recruiting to diagnostic trials for possible/suspected lung cancer.

Methods

Qualitative interviews were conducted with 11 general practice staff which included general practitioners, a nurse practitioner, research nurses and practice managers.

Interviews were analysed using a framework approach.

Results

Findings highlight general practice staff motivators to participate in the trial as recruiters, practice staff interactions with patients recruited onto the study, methods of organisation staff used to undertake the trial, the general impact of the trial on practice staff, how the trial research team supported the practices and lastly practice staff suggestions for trial delivery improvement.

Conclusions

The integration of a qualitative component focused on staff experiences participating in a lung diagnostic trial has demonstrated the feasibility to recruit for similar future studies within general practice. Although recruitment into trials can be difficult, results from our study offer suggestions on maximising patient recruitment not just to trials in general but also specifically for a lung diagnosis study.

Trial registration

ClinicalTrials.gov, NCT01344005. Registered on 27 April 2011

Process evaluation of a multicentre randomised clinical trial of substituting surgical excisions of low-risk basal cell carcinomas from secondary to primary care

OBJECTIVES

In 2016, the SKINCATCH Trial, a clustered multi-centre randomised trial, was initiated to assess whether low-risk basal cell carcinomas (BCCs) can be treated by general practitioners (GPs) without loss of quality of care. The trial intervention consisted of a tailored 2-day educational course on skin cancer management. The aim of this process evaluation was to investigate GPs' exposure to the intervention, implementation of the intervention and experiences with the intervention and trial.

RESEARCH DESIGN AND METHODS

Data on exposure to the intervention, implementation and experiences were obtained at several points during the trial. Complementary quantitative components (ie, surveys, database analysis, medical record analysis) and qualitative components (ie, interviews and focus groups) were used. Quantitative data were analysed using descriptive statistics; qualitative data were summarised (barrier interviews) or audiorecorded, transcribed verbatim and thematically analysed using Atlas.Ti (focus groups).

RESULTS

Following a 100% intervention exposure, results concerning the implementation of the trial showed that aside from the low inclusion rate of patients with low-risk BCCs (n=54), even less excisions of low-risk BCCs were performed (n=40). Although the intervention was experienced as highly positive, several barriers were mentioned regarding the trial including administrative challenges, lack of time and high workload of GPs, low volume of BCC patients and patients declining to participate or requesting a referral to a dermatologist.

CONCLUSIONS

Although GPs' participation in the highly valued training was optimal, several barriers may have contributed to the low inclusion and excision rate of low-risk BCCs. While some of the issues were trial-related, other barriers such as low patient-volume and patients requesting referrals are applicable outside the trial setting as well. This may question the feasibility of substitution of surgical excisions of low-risks BCCs from secondary to primary care in the current Dutch setting.

TRIAL REGISTRATION NUMBER

Trial NL5631 (NTR5746).

The influence of intervention complexity on barriers and facilitators in the implementation of professional pharmacy services - A systematic review

BACKGROUND

Community pharmacies increasingly offer professional pharmacy services, whose implementation is often influenced by facilitating or obstructive implementation factors. The occurrence and composition of implementation factors vary among different services with discrete characteristics and complexity of the intervention, making it difficult to foresee potential barriers in implementation.

OBJECTIVE(S)

This paper investigates potential associations between intervention complexity and occurring implementation factors.

METHODS

A systematic literature search on the implementation factors and intervention complexity of professional pharmacy services in the community setting was carried out in electronic databases (PubMed, CINAHL, and PsycINFO) throughout December 2018. Implementation factors were extracted from semi-structured interviews, focus groups, and surveys with community pharmacists and categorized using the Consolidated Framework for Implementation Research (CFIR). The complexity of each service was assessed using the following complexity parameters: (I) number of involved healthcare professions, (II) number of service components such as recruiting of patients, screening intervention, and follow-up, (III) frequency of the service, (IV) expenditure of time per patient (encounter), and (V) workflow distortion, i.e. booking appointments for intervention with the patient. Finally, the association between implementation factors and intervention complexity was analyzed by quantifying implementation factors and by relating them to specific intervention characteristics using Fisher's exact test.

RESULTS

15 studies covering a broad spectrum of professional pharmacy services were included. There was a trend that in services with higher complexity more implementation factors occurred (p = 0.094). Single key complexity parameters can trigger specific implementation factors. For instance, general practitioner and pharmacy technician involvement were significantly associated with interprofessional communication and leadership engagement, respectively.

CONCLUSION

Key implementation factors and associated complexity parameters seem to be of similar or more importance than the total number of implementation factors with regard to successful implementation. By assessing various complexity parameters of an intervention, potential key barriers could be identified and subsequently addressed prior to implementation.

Assessing an Electronic Health Record research platform for identification of clinical trial participants

Electronic health records (EHR) are a potential resource for identification of clinical trial participants. We evaluated how accurately a commercially available EHR Research Platform, InSite, is able to identify potential trial participants from the EHR system of a large tertiary care hospital. Patient counts were compared with results obtained in a conventional manual search performed for a reference study that investigated the associations of atrial fibrillation (AF) and cerebrovascular incidents. The Clinical Data Warehouse (CDW) of Turku University Hospital was used to verify the capabilities of the EHR Research Platform.

The EHR query resulted in a larger patient count than the manual query (EHR Research Platform 5859 patients, manual selection 2166 patients). This was due to the different search logic and some exclusion criteria that were not addressable in structured digital format. The EHR Research Platform (5859 patients) and the CDW search (5840 patients) employed the same search logic. The temporal relationship between the two diagnoses could be identified when they were available in structured format and the time difference was longer than a single hospital visit.

Searching for patients with the EHR Research Platform can help to identify potential trial participants from a hospital's EHR system by limiting the number of records to be manually reviewed. EHR query tools can best be utilized in trials where the selection criteria are expressed in structured digital format.

Selection bias in general practice research: analysis in a cohort of pregnant Danish women

OBJECTIVE

The aim of the present study was to examine selection in a general practice-based pregnancy cohort.

DESIGN

Survey linked to administrative register data.

SETTING AND SUBJECTS

In spring 2015, GPs were recruited from two Danish regions. They were asked to invite all pregnant women in their practice who had their first prenatal care visit before 15 August 2016 to participate in the survey.

OUTCOME MEASURES

The characteristics of GPs and the pregnant women were compared at each step in the recruitment process - the GP's invitation, their agreement to participate, actual GP participation, and the women's participation - with an uncertainty coefficient to quantify the step where the largest selection occurs.

RESULTS

Significant differences were found between participating and non-participating practices with regards to practice characteristics such as the number of patients registered with the practice, the age and sex of doctors, and the type of practice. Despite these differences, the characteristics of the eligible patients differed little between participating and non-participating practices. In participating practices significant differences were, however, observed between recruited and non-recruited patients.

CONCLUSION

The skewed selection of patients was mainly caused by a high number of non-participants within practices that actively took part in the study. We recommend that a focus on the sampling within participating practices be the most important factor in representative sampling of patient populations in general practice. Key points Selection among general practitioners (GPs) is often unavoidable in practice-based studies, and we found significant differences between participating and non-participating practices. These include practice characteristics such as the number of GPs, the number of patients registered with the GP practice, as well as the sex and age of the GPs. •Despite this, only small differences in the characteristics of the eligible patients were observed between participating and non-participating practices. •In participating practices, however, significant differences were observed between recruited and non-recruited patients. •Comprehensive sampling within participating practices may be the best way to generate representative samples of patients.

The Effect of a Personalized Newsletter to Physical Therapists on Patient Recruitment: A Cluster Randomized Trial in Primary Physiotherapy Care

OBJECTIVE

To assess the effect of a personalized newsletter compared with a standard newsletter on patient recruitment in physiotherapy research.

METHODS

We performed a cluster-randomized trial including 120 physiotherapists who recruited patients for a prospective cohort and were randomly assigned to either receiving personalized feedback in a newsletter (intervention group) or a standard newsletter (control group). We calculated the difference in the number of patients included in the study corrected for inclusion time between both groups.

RESULTS

The physiotherapists in the control group (n = 59) included 110 patients (35.4% of the total number of patients included) compared with an inclusion of 200 patients (64.6% of the total number of patients included) by the physiotherapists in the intervention group (n = 61), a difference of 90 patients in favor of the intervention group. However, when corrected for inclusion time and a cluster effect, we found no statistically significant difference between both groups. In addition, therapists who did not include a single patient (inactive therapists) were evenly divided between the 2 groups (n = 29 [49%] in the control group; n = 30 [49%] in the intervention group).

CONCLUSIONS

A personalized newsletter does not significantly increase the number of recruited patients by physiotherapists. However, therapists receiving personalized feedback recruited nearly double the number of patients compared with the ones receiving standard feedback.

Exploring factors influencing recruitment results of nurses recruiting diabetes patients for a randomized controlled trial

BACKGROUND

Effective recruitment of patients by health professionals is challenging but pivotal to the success of clinical trials. Many trials fail to include the required number of participants, which affects the power of the study, generalizability of results, and timely dissemination of positive outcomes. Existing research is inconclusive regarding factors influencing recruitment results, and most research does not focus on perceptions of recruiting health professionals themselves. Therefore, thorough evaluations of recruitment facilitators and barriers in trials are needed in order to optimize future patient recruitment in trials. We observed divergent recruitment results among nurses who recruited diabetes patients to our trial, which examined the effectiveness of an eHealth programme. Therefore, we aimed to describe nurses' recruitment results and related shifts over time, and to qualitatively explore factors influencing nurses' recruitment results.

METHODS

Nurses' recruitment results and related temporal shifts were derived from trial data (NTR6840). Based on their recruitment results, nurses were categorized as non-, low-, medium-, or high-recruiters. Subsequently, a subset of nurses per group participated in an individual semi-structured telephone interview. Interviews were analysed using NVivo software, applying an inductive coding approach.

RESULTS

Ninety-six nurses participated in our trial and recruited on average seven patients (range: 0-32). Fifteen nurses did not recruit any patients. Most patients were recruited close to recruitment onset. Nurses who did not recruit patients close to recruitment onset generally ended up recruiting no patients. Data show a relatively high number of early recruited patients that progressively declined over time. High-recruiters were generally successful throughout the entire recruitment period. Recruitment facilitators and barriers comprised organizational, study, patient, and especially recruiter characteristics. Contrary to non- and low-recruiters, medium- and high-recruiters reported more in-depth knowledge about the study and trial requirements, expressed more personal participation-related benefits and fewer barriers, and incorporated more recruitment activities, reminders, and barrier-focused coping strategies.

CONCLUSION AND IMPLICATIONS

To optimize patient recruitment to clinical trials, suggested intervention targets include the continued inclusion of recruiters after initial recruitment onset and the encouragement of early recruitment success. A personalized approach may aid recruiters to become and remain successful. Primarily, it is important to provide recruiters with sufficient information on trial requirements and to address salient benefits for participation in the trial, both for themselves and for their patients. Finally, teaching recruiters skills on how to overcome barriers may further enhance motivation and recruitment capacities.

Recruitment and reach in a pragmatic behavioral weight loss randomized controlled trial: implications for real-world primary care practice

BACKGROUND

Obesity is a major risk factor behind some of the most common problems encountered in primary care. Although effective models for obesity treatment have been developed, the 'reach' of these interventions is poor and only a small fraction of primary care patients receive evidence-based treatment. The purpose of this study is to identify factors that impact the uptake (reach) of an evidence-based obesity treatment program within the context of a pragmatic cluster randomized controlled trial comparing three models of care delivery.

METHODS

Recruitment and reach were evaluated by the following measures: 1) mailing response rates, 2) referral sources among participants contacting the study team, 3) eligibility rates, 4) participation rates, and 5) representativeness based on demographics, co-morbid conditions, and healthcare utilization of 1432 enrolled participants compared to > 17,000 non-participants from the clinic-based patient populations. Referral sources and participation rates were compared across study arms and level of clinic engagement.

RESULTS

The response rate to clinic-based mailings was 13.2% and accounted for 66% of overall program recruitment. An additional 22% of recruitment came from direct clinic referrals and 11% from media, family, or friends. Of those screened, 87% were eligible; among those eligible, 86% enrolled in the trial. Participation rates did not vary across the three care delivery arms, but were higher at clinics with high compared to low provider involvement. In addition, clinics with high provider involvement had a higher rate of in clinic referrals (33% versus 16%) and a more representative sample with regards to BMI, rurality, and months since last clinic visit. However, across clinics, enrolled participants compared to non-participants were older, more likely to be female, more likely to have had a joint replacement but less likely to have CVD or smoke, and had fewer hospitalizations.

CONCLUSIONS

A combination of direct patient mailings and in-clinic referrals may enhance the reach of primary care behavioral weight loss interventions, although more proactive outreach is likely necessary for men, younger patients, and those at greater medial risk. Strategies are needed to enhance provider engagement in referring patients to behavioral weight loss programs.

TRIAL REGISTRATION

clnicialtrials.gov NCT02456636. Registered May 28, 2015, https://www.clinicaltrials.gov/ct2/results?cond=&term=RE-POWER&cntry=&state=&city=&dist=.

Strategies for recruitment in general practice settings: the iSOLVE fall prevention pragmatic cluster randomised controlled trial

Background

Falls are common among older people, and General Practitioners (GPs) could play an important role in implementing strategies to manage fall risk. Despite this, fall prevention is not a routine activity in general practice settings. The iSOLVE cluster randomised controlled trial aimed to evaluate implementation of a fall prevention decision tool in general practice. This paper sought to describe the strategies used and reflect on the enablers and barriers relevant to successful recruitment of general practices, GPs and their patients.

Methods

Recruitment was conducted within the geographical area of a Primary Health Network in Northern Sydney, Australia. General practices and GPs were engaged via online surveys, mailed invitations to participate, educational workshops, practitioner networks and promotional practice visits. Patients 65 years or older were recruited via mailed invitations, incorporating the practice letterhead and the name(s) of participating GP(s). Observations of recruitment strategies, results and enabling factors were recorded in field notes as descriptive and narrative data, and analysed using mixed-methods.

Results

It took 19 months to complete recruitment of 27 general practices, 75 GPs and 560 patients. The multiple strategies used to engage general practices and GPs were collectively useful in reaching the targeted sample size. Practice visits were valuable in engaging GPs and staff, establishing interest in fall prevention and commitment to the trial. A mix of small, medium and large practices were recruited. While some were recruited as a whole-practice, other practices had few or half of the number of GPs recruited. The importance of preventing falls in older patients, simplicity of research design, provision of resources and logistic facilitation of patient recruitment appealed to GPs. Recruitment of older patients was successfully achieved by mailed invitations which was a strategy that was familiar to practice staff and patients. Patient response rates were above the expected 10% for most practices. Many practices (n = 17) achieved the targeted number of 20 or more patients.

Conclusions

Recruitment in general practice settings can be successfully achieved through multiple recruitment strategies, effective communication and rapport building, ensuring research topic and design suit general practice needs, and using familiar communication strategies to engage patients.

Trial registration

The trial was prospectively registered on 29 April 2015 with the Australian New Zealand Clinical Trial Registry www.anzctr.org.au (trial ID: ACTRN12615000401550).

Approaches to Recruitment of Postmenopausal Women for a Community-Based Study

BACKGROUND

Few researchers have focused on the challenges of recruiting postmenopausal women for community-based research. Researchers have reported that multiple methods may be needed to recruit the required number of subjects. One contemporary approach to recruitment is use of Facebook. More studies are needed examining Facebook as a recruitment strategy.

OBJECTIVE

The aim of the study was to examine which recruitment methods were most successful and cost-effective in recruiting postmenopausal women for a randomized controlled trial on bone loss.

METHODS

Subjects were 276 postmenopausal women who had osteopenia and were within 5 years of menopause. Multiple methods were used to recruit women. To determine which methods were successful, women were asked how they learned about the study. Descriptive data were used to examine recruitment numbers as well as to determine the cost-effectiveness and enrollment efficiency of recruitment methods.

RESULTS

Healthcare provider letters yielded the highest number of enrolled subjects (n = 58), followed by postcard mailings (n = 47), and Facebook posts (n = 44). Eleven subjects were referred by family and friends, five subjects were from newspaper or television, and two were from digital ads. Cost of recruitment per subject enrolled was highest with digital ads and postcard mailings.

DISCUSSION

Recruitment could be more costly and time-consuming than anticipated. Recruitment using direct-targeted mailings, such as provider letters and postcards, was successful in our study and has been effective in previous studies reviewed. Facebook was successful for recruitment in our study and may continue to be useful for recruitment in the future, as the number of women accessing Facebook continues to increase.

Case-finding for common mental disorders in primary care using routinely collected data: a systematic review

PURPOSE

Case-finding for common mental disorders (CMD) in routine data unobtrusively identifies patients for mental health research. There is absence of a review of studies examining CMD-case-finding accuracy in routine primary care data. CMD-case definitions include diagnostic/prescription codes, signs/symptoms, and free text within electronic health records. This systematic review assesses evidence for case-finding accuracy of CMD-case definitions compared to reference standards.

METHODS

PRISMA-DTA checklist guided review. Eligibility criteria were outlined prior to study search; studies compared CMD-case definitions in routine primary care data to diagnostic interviews, screening instruments, or clinician judgement. Studies were quality assessed using QUADAS-2.

RESULTS

Fourteen studies were included, and most were at high risk of bias. Nine studies examined depressive disorders and seven utilised diagnostic interviews as reference standards. Receiver operating characteristic (ROC) planes illustrated overall variable case-finding accuracy across case definitions, quantified by Youden's index. Forest plots demonstrated most case definitions provide high specificity.

CONCLUSION

Case definitions effectively identify cases in a population with good accuracy and few false positives. For 100 anxiety cases, identified using diagnostic codes, between 12 and 20 will be false positives; 0-47 cases will be missed. Sensitivity is more variable and specificity is higher in depressive cases; for 100 cases identified using diagnostic codes, between 0 and 87 will be false positives; 4-18 cases will be missed. Incorporating context to case definitions may improve overall case-finding accuracy. Further research is required for meta-analysis and robust conclusions.

Guideline implementation in the Canadian chiropractic setting: a pilot cluster randomized controlled trial and parallel study

Background

Feasibility and pilot studies are recommended prior to embarking on large-scale costly confirmatory trials. The objectives were to determine the feasibility of conducting a cluster randomized controlled trial (C-RCT) to evaluate a complex knowledge translation (KT) intervention to improve the management of people with neck pain, and to identify challenges and potential solutions to conducting a fully powered C-RCT in the chiropractic setting.

Methods

Pilot C-RCT involving a nationally representative sample of chiropractors and patients. We invited 400 chiropractors and 150 patients to participate. Clinicians were randomized to receive either an online theory-based KT educational and brief action plan (BAP) intervention (intervention group) or a copy of a clinical practice guideline (control group). Study-related challenges were ascertained via mid-study phone interviews and end-of-study feedback questionnaires. Analyses focused on descriptive estimates of likely recruitment, retention, and adherence rates, and documentation of potential barriers.

Results

In total, 47 chiropractors (12%) agreed to participate and were randomized after resampling. Fifteen withdrew from the study, leaving a total of 32 (8%) participants. Eleven chiropractors in the intervention group completed the webinars and e-learning modules, two partially completed them and three did not register. Participating chiropractors recruited a total of 29 patients. Sixty-three percent (n = 7) of intervention and 56% (n = 10) of control group patients completed all outcome measures at both baseline and 3-months follow-up, attended follow-up visits and performed home exercises. Patients in the intervention group reported significant reductions in pain (mean 1.6, 95% CI 0.26–2.94, P = 0.027) and disability scores (9.8, 95% CI 3.68–15.91, P = 0.033) from baseline to 3-month follow-up. Key barriers to participation reported by chiropractors included lack of time, difficulties in recruiting patients, problems with the administration of study questionnaires, concern that the clinician-patient relationship might be jeopardized, and lack of assistance from office staff. Over half (55%) of the respondents in the intervention group encountered some difficulty registering or completing the educational modules.

Conclusion

Recruitment of clinicians and patients for a trial of a complex intervention can be challenging, and retention of participants after enrolment may be low. Future trials of this nature likely require multiple recruitment strategies to achieve desired sample sizes. Moreover, time-constraint issues are perceived particularly by clinicians as a major barrier to both study enrolment before, and protocol adherence during, their actual participation in a trial.

Trial registration

The study was registered at, NCT02483091, on 17th June 2015.

Electronic supplementary material

The online version of this article (10.1186/s12998-019-0253-z) contains supplementary material, which is available to authorized users.

Factors associated with recruitment to randomised controlled trials in general practice: protocol for a systematic review

BACKGROUND

Randomised controlled trials (RCTs) are frequently unable to recruit sufficient numbers of participants. This affects the trial's ability to answer the proposed research question, wastes resources and can be unethical. RCTs within a general practice setting are increasingly common and similarly face recruitment challenges. The aim of the proposed review is to identify factors that are associated with recruitment rates to RCTs in a general practice setting. These results will be used in further research to predict recruitment to RCTs.

METHODS/DESIGN

The electronic databases Medline, EMBASE, Cochrane Database of Systematic Reviews, NTIS and OpenGrey will be searched for relevant articles with no limit on the date of publication. BMC Trials will be manually searched for the past 5 years. Both quantitative and qualitative studies will be included if they have studied recruitment within a general practice RCT. Only English language publications will be included. Screening, quality assessment and data extraction will be conducted by two review authors not blinded to study characteristics. Disagreement will be resolved by discussion and the involvement of a third review author if required. A narrative synthesis of the studies included will be performed.

DISCUSSION

The review will, for the first time, systematically synthesise existing research on factors associated with recruitment rates to RCTs in general practice. By identifying research gaps to be prioritised in further research, it will be of interest to academics. It will also be of value to clinical trialists who are involved in the complex task of improving trial recruitment. Our team will use the findings to inform a prediction model of trial recruitment using machine learning.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO, CRD42018100695 . Registered on 03 July 2018.

A review of the impact of utilising electronic medical records for clinical research recruitment

INTRODUCTION

Recruitment is an important aspect of clinical research, as poor recruitment could undermine the scientific value of a trial or delay the development process of new treatments. The development of electronic medical records provides a new way to identify potential participants for trials by matching the eligibility criteria with patients' data within electronic medical records.

METHODS

A literature search was performed to examine the effectiveness and efficiency of the electronic medical record recruitment method using MEDLINE, PubMed, PubMed Central, CINAHL Plus with Full Text, ScienceDirect and Cochrane Library databases. These searches generated 11 articles that met the eligibility criteria, and handsearching reference lists generated two additional articles bringing the total number of articles to 13. These articles were subjected to critical appraisal utilising the Effective Public Health Practice Project tool.

RESULTS

Out of the 13 included articles, 11 provided quantitative data on recruitment effectiveness while seven articles provided quantitative data on recruitment efficiency. The automation in screening and patient identification by using alerts, a notification system, to notify research staff of a potential participant, was observed to contribute to higher recruitment yield and reduced workload due to its specificity on participant screening. The use of electronic medical record alerts was found to be associated with better recruitment outcomes when they were sent to dedicated research staff rather than physicians. Using electronic medical records for recruitment was found to be effective due to its capability for patient identification outside working hours and fast processing time, which was particularly useful for clinical trials in acute conditions. Several challenges may hinder the impact of the electronic medical record recruitment method, including the lack of conformity of clinical trial eligibility criteria and electronic medical record data structure and missing data. 'Alert fatigue' could also impact on the effectiveness of this method in the long term.

CONCLUSION

The results from this review supports electronic medical record being an effective and efficient method for clinical trial recruitment. Recommendations were made in order to maximise the potential of the electronic medical record recruitment method and also for future research in order to improve the quality of evidence to support this strategy for recruitment.

Engagement of primary care practice in Australia: learnings from a diabetes care project

Effective community-based chronic disease management requires general practice engagement and ongoing improvement in care models. This article outlines a case study on contributing factors to insufficient participant recruitment through general practice for an evidence-based diabetes care pilot project. Key stakeholder semi-structured interviews and focus groups were undertaken at cessation of the pilot project. Participants (15 GPs, five practice nurses, eight diabetes educators) were healthcare providers engaged in patient recruitment. Through descriptive analysis, common themes were identified. Four major themes were identified: (1) low perceived need for intervention; (2) communication of intervention problematic; (3) translation of research into practice not occurring; and (4) the service providing the intervention was not widely viewed as a partner in chronic disease care. Engaging GPs in new initiatives is challenging, and measures facilitating uptake of new innovations are required. Any new intervention needs to: be developed with GPs to meet their needs; have considerable lead-in time to develop rapport with GPs and raise awareness; and ideally, have dedicated support staff within practices to reduce the demand on already-overburdened practice staff. Feasible and effective mechanisms need to be developed to facilitate uptake of new innovations in the general practice setting.

Recruiting general practice patients for large clinical trials: lessons from the Aspirin in Reducing Events in the Elderly (ASPREE) study

OBJECTIVE

To assess the factors that contributed to the successful completion of recruitment for the largest clinical trial ever conducted in Australia, the Aspirin in Reducing Events in the Elderly (ASPREE) study.

DESIGN

Enrolment of GPs; identification of potential participants in general practice databases; screening of participants.

SETTING, PARTICIPANTS

Selected general practices across southeast Australia (Tasmania, Victoria, Australian Capital Territory, New South Wales, South Australia).

MAJOR OUTCOMES

Numbers of patients per GP screened and randomised to participation; geographic and demographic factors that influenced screening and randomising of patients.

RESULTS

2717 of 5833 GPs approached (47%) enrolled to recruit patients for the study; 2053 (76%) recruited at least one randomised participant. The highest randomised participant rate per GP was for Tasmania (median, 5; IQR, 1-11), driven by the high rate of participant inclusion at phone screening. GPs in inner regional (adjusted odds ratio [aOR], 1.45; 95% CI, 1.14-1.84) and outer regional areas (aOR, 1.86; 95% CI, 1.19-2.88) were more likely than GPs in major cities to recruit at least one randomised participant. GPs in areas with a high proportion of people aged 70 years or more were more likely to randomise at least one participant (per percentage point increase: aOR, 1.10; 95% CI, 1.05-1.15). The number of randomised patients declined with time from GP enrolment to first randomisation.

CONCLUSION

General practice can be a rich environment for research when barriers to recruitment are overcome. Including regional GPs and focusing efforts in areas with the highest proportions of potentially eligible participants improves recruitment. The success of ASPREE attests to the clinical importance of its research question for Australian GPs.

Systematic review showed that stepped-wedge cluster randomized trials often did not reach their planned sample size

OBJECTIVE

To determine how often stepped-wedge cluster randomized controlled trials reach their planned sample size, and what reasons are reported for choosing a stepped-wedge trial design.

STUDY DESIGN AND SETTING

We conducted a PubMed literature search (period 2012 to 2017) and included articles describing the results of a stepped-wedge cluster randomized trial. We calculated the percentage of studies reaching their prespecified number of participants and clusters, and we summarized the reasons for choosing the stepped-wedge trial design as well as difficulties during enrollment.

RESULTS

Forty-six individual stepped-wedge studies from a total of 53 articles were included in our review. Of the 35 studies, for which recruitment rate could be calculated, 69% recruited their planned number of participants, with 80% having recruited the planned number of clusters. Ethical reasons were the most common motivation for choosing the stepped-wedge trial design. Most important difficulties during study conduct were dropout of clusters and delayed implementation of the intervention.

CONCLUSION

About half of recently published stepped-wedge trials reached their planned sample size indicating that recruitment is also a major problem in these trials. Still, the stepped-wedge trial design can yield practical, ethical, and methodological advantages.

Barriers and facilitators to participant recruitment to randomised controlled trials: A qualitative perspective

Low recruitment rates for randomised controlled trials (RCTs) are a common issue. Information on barriers and facilitators to recruitment for RCTs may inform researchers on how to improve the recruitment rate. The aim of this qualitative project was to identify barriers and facilitators to participant recruitment for a randomised double-blinded placebo-controlled trial on the clinical effectiveness of aspirin as an adjunct to compression therapy in healing chronic venous leg ulcers. We have conducted interviews with health professionals and project workers to understand their perspective on low recruitment rate, barriers to, and facilitators of recruitment. NVivo 11 software was used for data management and coding. Thematic analysis was applied as a method of data analysis. Although strict recruitment criteria were the main barrier, there were other recruitment barriers that should be considered when planning RCTs. We have further developed a framework of factors influencing the recruitment rate. The main recruitment barriers, including study-related, participant-related, practitioner-related, collaboration-related, ethics-related, practice-related, and health system-related barriers, should be considered for inclusion in the "Other Information" section of Consolidated Standards of Reporting Trials Statement to improve the quality of reporting and ensure the strategic planning of future RCTs.

Barriers and enablers to patient recruitment for randomised controlled trials on treatment of chronic wounds: A systematic review

Randomised controlled trials represent the gold standard in intervention efficacy evaluation. However, suboptimal recruitment affects completion and the power of a therapeutic trial in detecting treatment differences. We conducted a systematic review to examine the barriers and enablers to patient recruitment for randomised controlled trials on chronic wound treatment. Review registration was under PROSPERO 2017:CRD42017062438. We conducted a systematic search of Ovid MEDLINE, EBSCOhost CINAHL, Ovid Cochrane Library, Ovid EMBASE, and Ovid PsycINFO databases in June 2017 for chronic wound treatment randomised controlled trials. Twenty-seven randomised controlled trials or qualitative studies met the inclusion criteria. Among the 24 randomised controlled trials, 21 were assessed as low quality in relation to recruitment, and 3 were assessed as high quality. All 27 studies reported barriers to recruitment in chronic wound randomised controlled trials. The reported barriers to recruitment were: study-related, patient-related, clinician-related, health system-related, and/or operational-related. No study reported recruitment enablers. To enhance randomised controlled trial recruitment, we propose the need for improved integration of research and clinical practice. To alleviate the problems arising from inadequate reporting of randomised controlled trials, the Consolidated Standards of Reporting Trials Statement could include an additional item on recruitment barriers. This approach will allow for increased awareness of the potential barriers to recruitment for Randomised controlled trials (RCTs) in both wound management and other health care research.

Decision making process and factors contributing to research participation among general practitioners: A grounded theory study

INTRODUCTION

The participation of general practitioners (GPs) in primary care research is variable and often poor. We aimed to develop a substantive and empirical theoretical framework to explain GPs' decision-making process to participate in research.

METHODS

We used the grounded theory approach to construct a substantive theory to explain the decision-making process of GPs to participate in research activities. Five in-depth interviews and four focus group discussions were conducted among 21 GPs. Purposeful sampling followed by theoretical sampling were used to attempt saturation of the core category. Data were collected using semi-structured open-ended questions. Interviews were recorded, transcribed verbatim and checked prior to analysis. Open line-by-line coding followed by focus coding were used to arrive at a substantive theory. Memoing was used to help bring concepts to higher abstract levels.

RESULTS

The GPs' decision to participate in research was attributed to their inner drive and appreciation for primary care research and their confidence in managing their social and research environments. The drive and appreciation for research motivated the GPs to undergo research training to enhance their research knowledge, skills and confidence. However, the critical step in the GPs' decision to participate in research was their ability to align their research agenda with priorities in their social environment, which included personal life goals, clinical practice and organisational culture. Perceived support for research, such as funding and technical expertise, facilitated the GPs' participation in research. In addition, prior experiences participating in research also influenced the GPs' confidence in taking part in future research.

CONCLUSIONS

The key to GPs deciding to participate in research is whether the research agenda aligns with the priorities in their social environment. Therefore, research training is important, but should be included in further measures and should comply with GPs' social environments and research support.

Impact of a deferred recruitment model in a randomised controlled trial in primary care (CREAM study)

BACKGROUND

Recruitment of participants is particularly challenging in primary care, with less than a third of randomised controlled trials (RCT) achieving their target within the original time frame. Participant identification, consent, randomisation and data collection can all be time-consuming. Trials recruiting an incident, as opposed to a prevalent, population may be particularly affected. This paper describes the impact of a deferred recruitment model in a RCT of antibiotics for children with infected eczema in primary care, which required the recruitment of cases presenting acutely.

METHODS

Eligible children were identified by participating general practitioners (GPs) and referred to a study research nurse, who then visited them at home. This allowed the consent and recruitment processes to take place outside the general practice setting. Information was recorded about patients who were referred and recruited, or if not, the reasons for non-recruitment. Data on recruitment challenges were collected through semi-structured interviews and questionnaires with a sample of participating GPs. Data were thematically analysed to identify key themes.

RESULTS

Of the children referred to the study 34% (58/171) were not recruited - 48% (28/58) because of difficulties arranging a baseline visit within the defined time frame, 31% (18/58) did not meet the study inclusion criteria at the time of nurse assessment, and 21% (12/58) declined participation. GPs had positive views about the recruitment process, reporting that parents valued and benefitted from additional contact with a nurse. GPs felt that the deferred recruitment model did not negatively impact on the study.

CONCLUSIONS

GPs and parents recognised the benefits of deferred recruitment, but these did not translate into enhanced recruitment of participants. The model resulted in the loss of a third of children who were identified by the GP as eligible, but not subsequently recruited to the study. If the potential for improving outcomes in primary care through complex studies is to be realised, new approaches to recruitment into primary care trials need to be developed and evaluated.

TRIAL REGISTRATION

International Standard Randomised Controlled Trials, ISRCTN96705420 . Registered on 27 June 2012.

Transparency and public accessibility of clinical trial information in Croatia: how it affects patient participation in clinical trials

Introduction

Despite increased visibility of clinical trials through international trial registries, patients often remain uninformed of their existence, especially if they do not have access to adequate information about clinical research, including the language of the information. The aim of this study was to describe the context for transparency of clinical trials in Croatia in relation to countries in Central and Eastern Europe, and to assess how informed Croatian patients are about clinical trials and their accessibility.

Materials and methods

We assessed the transparency of clinical trials from the data available in the public domain. We also conducted an anonymous survey on a convenience sample of 257 patients visiting two family medicine offices or an oncology department in south Croatia, and members of national patients’ associations.

Results

Despite legal provisions for transparency of clinical trials in Croatia, they are still not sufficiently visible in the public domain. Among countries from Central and Eastern Europe, Croatia has the fewest number of registered trials in the EU Clinical Trials Registry. 66% of the patients in the survey were aware of the existence of clinical trials but only 15% were informed about possibilities of participating in a trial. Although 58% of the respondents were willing to try new treatments, only 6% actually participated in a clinical trial. Only 2% of the respondents were aware of publicly available trial registries.

Conclusions

Our study demonstrates that there is low transparency of clinical trials in Croatia, and that Croatian patients are not fully aware of clinical trials and the possibilities of participating in them, despite reported availability of Internet resources and good communication with their physicians. There is a need for active policy measures to increase the awareness of and access to clinical trials to patients in Croatia, particularly in their own language.

Clinical trials: Kids are not just little people

Clinical trials are the backbone of modern evidence-based medicine. They are the vital bridge between research-based discovery and cutting edge patient care. Randomized, controlled clinical trials are the gold standard of medical research, providing a method for evaluation and discovery of novel therapies that improve and even save lives. Despite an increase in the number of pediatric and adult clinical trials over recent decades, this growth has not been equal among these populations. The volume of clinical trials involving children lags substantially behind their adult counterparts. Children are not simply little adults. As a result, extrapolating results from adult clinical trials to the treatment of children may be inappropriate and, possibly, harmful. In this review, we discuss the intricacies of performing clinical trials in all patients and stress the unique distinguishing characteristics of pediatric clinical trials.

The PULSAR primary care protocol: a stepped-wedge cluster randomized controlled trial to test a training intervention for general practitioners in recovery-oriented practice to optimize personal recovery in adult patients

BACKGROUND

General practitioners (GPs) in Australia play a central role in the delivery of mental health care. This article describes the PULSAR (Principles Unite Local Services Assisting Recovery) Primary Care protocol, a novel mixed methods evaluation of a training intervention for GPs in recovery-oriented practice. The aim of the intervention is to optimize personal recovery in patients consulting study GPs for mental health issues.

METHODS

The intervention mixed methods design involves a stepped-wedge cluster randomized controlled trial testing the outcomes of training in recovery-oriented practice, together with an embedded qualitative study to identify the contextual enablers and challenges to implementing recovery-oriented practice. The project is conducted in Victoria, Australia between 2013 and 2017. Eighteen general practices and community health centers are randomly allocated to one of two steps (nine months apart) to start an intervention comprising GP training in the delivery of recovery-oriented practice. Data collection consists of cross-sectional surveys collected from patients of participating GPs at baseline, and again at the end of Steps 1 and 2. The primary outcome is improvement in personal recovery using responses to the Questionnaire about the Process of Recovery. Secondary outcomes are improvements in patient-rated measures of personal recovery and wellbeing, and of the recovery-oriented practice they have received, using the INSPIRE questionnaire, the Warwick-Edinburgh Mental Well-being Scale, and the Kessler Psychological Distress Scale. Participant data will be analyzed in the group that the cluster was assigned to at each study time point. Another per-protocol dataset will contain all data time-stamped according to the date of intervention received at each cluster site. Qualitative interviews with GPs and patients at three and nine months post-training will investigate experiences and challenges related to implementing recovery-oriented practice in primary care.

DISCUSSION

Recovery-oriented practice is gaining increasing prominence in mental health service delivery and the outcomes of such an approach within the primary care sector for the first time will be evaluated in this project. If findings are positive, the intervention has the potential to extend recovery-oriented practice to GPs throughout the community.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trial Registry ( ACTRN12614001312639 ). Registered: 8 August 2014.

A novel drug management system in the Febuxostat versus Allopurinol Streamlined Trial: A description of a pharmacy system designed to supply medications directly to patients within a prospective multicenter randomised clinical trial

Background:

Trials of investigational medicinal products are required to adhere to strict guidelines with regard to the handling and supply of medication. Information technology offers opportunities to approach clinical trial methodology in new ways. This report summarises a novel pharmacy system designed to supply trial medications directly to patients by post in the Febuxostat versus Allopurinol Streamlined Trial.

Method:

A bespoke web-based software package was designed to facilitate the direct supply of trial medications to Febuxostat versus Allopurinol Streamlined Trial participants from a pharmacy based in the Medicines Monitoring Unit, University of Dundee.

Results:

To date, 65,467 packs of medication have been dispensed using the system to 3978 patients. Up to 238 packs per day have been dispensed.

Conclusion:

The Medicines Monitoring Unit Febuxostat versus Allopurinol Streamlined Trial drug management system is an effective method of administering the complex drug supply requirements of a large-scale clinical trial with advantages over existing arrangements. A low rate of loss to follow-up in the Febuxostat versus Allopurinol Streamlined Trial may be attributable to the drug management system.

Study protocol for a randomized clinical trial of a fatherhood intervention for African American non-resident fathers: Can we improve father and child outcomes?

PURPOSE

African American (AA) fathers who live apart from their children face multiple obstacles to consistent and positive involvement with their children. Consequently, significant numbers of children are bereft of their father's positive involvement. Intervention research that is explicitly focused on promoting the positive involvement of non-resident AA fathers with their young children is limited. The purpose of this article is to describe the study protocol of a randomized trial (RCT) designed to test the Building Bridges to Fatherhood program against a financial literacy comparison condition; and discuss early implementation challenges.

METHODS

Fathers (n=180) are recruited to attend 10 group meetings, reimbursed for transportation, given dinner and activity vouchers for spending time with their child, and incentivized with a $40 gift card at each data collection time point. Mothers are incentivized ($40 gift card) at data collection and must be amenable to father child interaction. Intervention targets include father psychological well-being, parenting competence, communication, problem-solving ability; father-mother relationship quality; and child behavioral and emotional/social development.

RESULTS

To date, 57 fathers have been randomized to study condition. Recruitment has been influenced by father and mother hesitancy and the logistics of reaching and maintaining contact with participants. Strategies to surmount challenges to father and mother recruitment and engagement have been developed.

CONCLUSIONS

The prospective benefits of positive father involvement to children, fathers and families outweigh the challenges associated with community-based intervention research. The findings from this RCT can inform the body of knowledge on engaging AA non-resident fathers in culturally relevant fatherhood programming.

The Method of Randomization for Cluster-Randomized Trials: Challenges of Including Patients with Multiple Chronic Conditions

Cluster-randomized clinical trials (CRT) are trials in which the unit of randomization is not a participant but a group (e.g. healthcare systems or community centers). They are suitable when the intervention applies naturally to the cluster (e.g. healthcare policy); when lack of independence among participants may occur (e.g. nursing home hygiene); or when it is most ethical to apply an intervention to all within a group (e.g. school-level immunization). Because participants in the same cluster receive the same intervention, CRT may approximate clinical practice, and may produce generalizable findings. However, when not properly designed or interpreted, CRT may induce biased results. CRT designs have features that add complexity to statistical estimation and inference. Chief among these is the cluster-level correlation in response measurements induced by the randomization. A critical consideration is the experimental unit of inference; often it is desirable to consider intervention effects at the level of the individual rather than the cluster. Finally, given that the number of clusters available may be limited, simple forms of randomization may not achieve balance between intervention and control arms at either the cluster- or participant-level. In non-clustered clinical trials, balance of key factors may be easier to achieve because the sample can be homogenous by exclusion of participants with multiple chronic conditions (MCC). CRTs, which are often pragmatic, may eschew such restrictions. Failure to account for imbalance may induce bias and reducing validity. This article focuses on the complexities of randomization in the design of CRTs, such as the inclusion of patients with MCC, and imbalances in covariate factors across clusters.