Online Patient Recruitment in Clinical Trials: Systematic Review and Meta-Analysis

Promoting equity in clinical research: The role of social determinants of health

OBJECTIVE

This study aims to investigate the association between social determinants of health (SDoH) and clinical research recruitment outcomes and recommends evidence-based strategies to enhance equity.

MATERIALS AND METHODS

Data were collected from the internal clinical study manager database, clinical data warehouse, and clinical research registry. Study characteristics (e.g., study phase) and sociodemographic information were extracted. Median neighborhood income, distance from the study location, and Area Deprivation Index (ADI) were calculated. Mixed effect generalized regression was used for clustering effects and false discovery rate adjustment for multiple testing. A stratified analysis was performed to examine the impact in distinct medical departments.

RESULTS

The study sample consisted of 3,962 individuals, with a mean age of 61.5 years, 53.6 % male, 54.2 % White, and 49.1 % non-Hispanic or Latino. Study characteristics revealed a variety of protocols across different departments, with cardiology having the highest percentage of participants (46.4 %). Industry funding was the most common (74.5 %), and digital advertising and personal outreach were the main recruitment methods (58.9 % and 90.8 %).

DISCUSSION

The analysis demonstrated significant associations between participant characteristics and research participation, including biological sex, age, ethnicity, and language. The stratified analysis revealed other significant associations for recruitment strategies. SDoH is crucial to clinical research recruitment, and this study presents evidence-based solutions for equity and inclusivity. Researchers can tailor recruitment strategies to overcome barriers and increase participant diversity by identifying participant characteristics and research involvement status.

CONCLUSION

The findings highlight the relevance of clinical research inequities and equitable representation of historically underrepresented populations. We need to improve recruitment strategies to promote diversity and inclusivity in research.

Optimizing Clinical Trial Eligibility Design Using Natural Language Processing Models and Real-World Data: Algorithm Development and Validation

BACKGROUND

Clinical trials are vital for developing new therapies but can also delay drug development. Efficient trial data management, optimized trial protocol, and accurate patient identification are critical for reducing trial timelines. Natural language processing (NLP) has the potential to achieve these objectives.

OBJECTIVE

This study aims to assess the feasibility of using data-driven approaches to optimize clinical trial protocol design and identify eligible patients. This involves creating a comprehensive eligibility criteria knowledge base integrated within electronic health records using deep learning-based NLP techniques.

METHODS

We obtained data of 3281 industry-sponsored phase 2 or 3 interventional clinical trials recruiting patients with non-small cell lung cancer, prostate cancer, breast cancer, multiple myeloma, ulcerative colitis, and Crohn disease from ClinicalTrials.gov, spanning the period between 2013 and 2020. A customized bidirectional long short-term memory- and conditional random field-based NLP pipeline was used to extract all eligibility criteria attributes and convert hypernym concepts into computable hyponyms along with their corresponding values. To illustrate the simulation of clinical trial design for optimization purposes, we selected a subset of patients with non-small cell lung cancer (n=2775), curated from the Mount Sinai Health System, as a pilot study.

RESULTS

We manually annotated the clinical trial eligibility corpus (485/3281, 14.78% trials) and constructed an eligibility criteria-specific ontology. Our customized NLP pipeline, developed based on the eligibility criteria-specific ontology that we created through manual annotation, achieved high precision (0.91, range 0.67-1.00) and recall (0.79, range 0.50-1) scores, as well as a high F1-score (0.83, range 0.67-1), enabling the efficient extraction of granular criteria entities and relevant attributes from 3281 clinical trials. A standardized eligibility criteria knowledge base, compatible with electronic health records, was developed by transforming hypernym concepts into machine-interpretable hyponyms along with their corresponding values. In addition, an interface prototype demonstrated the practicality of leveraging real-world data for optimizing clinical trial protocols and identifying eligible patients.

CONCLUSIONS

Our customized NLP pipeline successfully generated a standardized eligibility criteria knowledge base by transforming hypernym criteria into machine-readable hyponyms along with their corresponding values. A prototype interface integrating real-world patient information allows us to assess the impact of each eligibility criterion on the number of patients eligible for the trial. Leveraging NLP and real-world data in a data-driven approach holds promise for streamlining the overall clinical trial process, optimizing processes, and improving efficiency in patient identification.

Email recruitment for chronic pain clinical trials: results from the LAMP trial

BACKGROUND

Recruitment for clinical trials and large-scale studies is challenging, especially for patients with complex conditions like chronic pain. Email recruitment has the potential to increase efficiency, to reduce costs, and to improve access for underrepresented patient populations. The objective of this study was to examine the effectiveness, efficiency, and equitability of email versus postal mail recruitment for the Learning to Apply Mindfulness to Pain (LAMP) study, a three-site clinical trial of mindfulness-based interventions for chronic pain.

METHODS

Patients with chronic pain diagnoses were recruited from three United States Department of Veterans Affairs (VA) facilities using the VA electronic health record (EHR). Recruitment materials were sent using either postal mail (n = 7986) or email (n = 19,333). Patients in the email recruitment group were also mailed introductory postcards before any emails. Mailing addresses and email addresses were obtained from the EHR. Effectiveness was measured by the response rate of patients who logged into the secure LAMP study website. Efficiency was measured by the number of days from when the recruitment materials were sent to when patients logged into the LAMP portal as well as the estimated costs of each recruitment approach. To assess equitability, we examined whether email recruitment was less effective for underrepresented populations, based on demographic information from the EHR.

RESULTS

Effectiveness-unadjusted response rates were greater for email versus postal-mail recruitment (18.9% versus 6.3%), and adjusted response rates were over three times greater for email recruitment (RR = 3.5, 95% CI 3.1-3.8) based on a multivariable analysis controlling for age, gender, race, ethnicity, rurality, and site. Efficiency-email recruitment had a significantly lower mean response time (1 day versus 8 days) and a lower cost. Equity-email recruitment led to higher response rates for all subpopulations, including older, non-White, Hispanic, rural, and female Veterans.

CONCLUSIONS

Email recruitment is an effective, efficient, and equitable way to recruit VA patients to large-scale, chronic pain clinical trials.

TRIAL REGISTRATION

Clinical Trial Registration Number: NCT04526158. Patient enrollment began on December 4, 2020.

Best practices for recruitment in veterinary clinical trials

A successful clinical trial requires participants, but many factors can impede effective study recruitment. To better recruit for quality veterinary clinical trials in client-owned animals that lead to improved evidence-based patient care and outcomes, there is a collective need to share and implement current best practices for recruitment strategies. These strategies should utilize a holistic view of recruitment, encompassing study design and logistics, representative participation, incentives, personnel resources, advertising, and participant retention. Although human clinical trial data and resources can provide guidance, effort also needs to be put into evaluating current practices and opportunities for process improvement that are specific to the conduct of veterinary clinical trials. Considering the power of pets as naturally occurring models of disease and as sentinels, improved conduct of veterinary clinical research has the potential to inform human health outcomes. Continued development of collaborations surrounding best practices and training opportunities in veterinary clinical research will improve the impact of veterinary clinical trials teams, while also promoting workforce development and alternate career paths for veterinary professionals.

Eating disorder symptoms and comorbid mental health risk among teens recruited to a digital intervention research study via two online approaches

INTRODUCTION

It is crucial to identify and evaluate feasible, proactive ways to reach teens with eating disorders (EDs) who may not otherwise have access to screening or treatment. This study aimed to explore the feasibility of recruiting teens with EDs to a digital intervention study via social media and a publicly available online ED screen, and to compare the characteristics of teens recruited by each approach in an exploratory fashion.

METHOD

Teens aged 14-17 years old who screened positive for a clinical/subclinical ED or at risk for an ED and who were not currently in ED treatment completed a baseline survey to assess current ED symptoms, mental health comorbidities, and barriers to treatment. Bivariate analyses were conducted to examine differences between participants recruited via social media and those recruited after completion of a widely available online EDs screen (i.e., National Eating Disorders Association [NEDA] screen).

RESULTS

Recruitment of teens with EDs using the two online approaches was found to be feasible, with 934 screens completed and a total of 134 teens enrolled over 6 months: 77% (n = 103) via social media 23% (n = 31) via the NEDA screen. Mean age of participants (N = 134) was 16 years old, with 49% (n = 66) identifying as non-White, and 70% (n = 94) identifying as a gender and/or sexual minority. Teens from NEDA reported higher ED psychopathology scores (medium effect size) and more frequent self-induced vomiting and driven exercise (small effect sizes). Teens from NEDA also endorsed more barriers to treatment, including not feeling ready for treatment and not knowing where to find a counselor or other resources (small effect sizes).

DISCUSSION

Online recruitment approaches in this study reached a large number of teens with an interest in a digital intervention to support ED recovery, demonstrating the feasibility of these outreach methods. Both approaches reached teens with similar demographic characteristics; however, teens recruited from NEDA reported higher ED symptom severity and barriers to treatment. Findings suggest that proactive assessment and intervention methods should be developed and tailored to meet the needs of each of these groups.

PUBLIC SIGNIFICANCE

This study examined the feasibility of recruiting teens with EDs to a digital intervention research study via social media and NEDA's online screen, and demonstrated differences in ED symptoms among participants by recruitment approach.

Incorporating Dermatologic Clinical Research Into Private Practice: A Review

Clinical research is beneficial for the continued progression of medicine and the larger body of scientific knowledge. Clinical research can be incorporated into a range of settings, ranging from larger learning institutions to small private practices. With the need for continued advancement of the development of pharmaceutical interventions as well as other forms of clinical understanding, it is advantageous to create an environment where smaller, private practices feel comfortable and guided in establishing clinical research. It can be difficult to find the best methods to incorporate in-house clinical research. This review aims to address this gap in the literature, making the establishment of clinical trials, specifically clinical drug trials, more accessible in dermatology for private practices.

Accelerating patient recruitment using social media: Early adopter experience from a good clinical practice-monitored randomized controlled phase I/IIa clinical trial on actinic keratosis

Background

Patient recruitment is a major cause of delays in randomized controlled trials (RCT). Online recruitment is evolving into an alternative to conventional in-clinic recruitment for RCT. The objective of this study was to test the effectiveness of online patient recruitment for an RCT on actinic keratosis (AK).

Methods

In this proof-of-concept study, adults with AK were recruited for a Phase I/IIa RCT (NCT05164393) via social media using targeted advertising Interested users were directed to a landing page to learn about the study, respond to questionnaires, and upload self-obtained smartphone pictures of potential AK. Facebook Analytics was used to track the number of advertisement views, individual users exposed to the advertisement, and advertisement clicks. Following eligibility-review by remote dermatologists, candidates were contacted for an in-clinic visit. A review of pertinent RCTs on AK (2012-2022) was conducted to compare recruitment metrics.

Results

The online campaign served 886,670 views, reached 309,000 users, and generated 27,814 clicks. A total of 556 users underwent eligibility review, leading to 140 pre-evaluated potential study subjects. The RCT's enrollment target of 60 patients (68.8 ± 7.1 years, 43.3 % female) was reached in 53 days after screening 90 participants in-clinic, corresponding to a screen failure rate of 33.3 %. The total cost of this online recruitment campaign was 14,285 USD i.e. 238 USD per randomized patient. Compared to the existing literature (44 RCTs), our online approach resulted in 9 times more time-efficient recruitment per site.

Conclusion

Using targeted advertisements, 60 patients with AK were recruited for a single-center Phase I/IIa RCT in 53 days. Social media appears to be an efficient platform for online recruitment of patients with low-grade AK for RCT.

The development and internal pilot trial of a digital physical activity and emotional well-being intervention (Kidney BEAM) for people with chronic kidney disease

This trial assessed the feasibility and acceptability of Kidney BEAM, a physical activity and emotional well-being self-management digital health intervention (DHI) for people with chronic kidney disease (CKD), which offers live and on-demand physical activity sessions, educational blogs and videos, and peer support. In this mixed-methods, multicentre randomised waitlist-controlled internal pilot, adults with established CKD were recruited from five NHS hospitals and randomised 1:1 to Kidney BEAM or waitlist control. Feasibility outcomes were based upon a priori progression criteria. Acceptability was primarily explored via individual semi-structured interviews (n = 15). Of 763 individuals screened, n = 519 (68%, 95% CI 65 to 71%) were eligible. Of those eligible, n = 303 (58%, 95% CI 54-63%) did not respond to an invitation to participate by the end of the pilot period. Of the 216 responders, 50 (23%, 95% CI 18-29%) consented. Of the 42 randomised, n = 22 (10 (45%) male; 49 ± 16 years; 14 (64%) White British) were allocated to Kidney BEAM and n = 20 (12 (55%) male; 56 ± 11 years; 15 (68%) White British) to the waitlist control group. Overall, n = 15 (30%, 95% CI 18-45%) withdrew during the pilot phase. Participants completed a median of 14 (IQR 5-21) sessions. At baseline, 90-100% of outcome data (patient reported outcome measures and a remotely conducted physical function test) were completed and 62-83% completed at 12 weeks follow-up. Interview data revealed that remote trial procedures were acceptable. Participants' reported that Kidney BEAM increased their opportunity and motivation to be physically active, however, lack of time remained an ongoing barrier to engagement with the DHI. An randomised controlled trial of Kidney BEAM is feasible and acceptable, with adaptations to increase recruitment, retention and engagement.Trial registration NCT04872933. Date of first registration 05/05/2021.

Digital technologies used in clinical trial recruitment and enrollment including application to trial diversity and inclusion: A systematic review

Background

Many clinical trials fail because of poor recruitment and enrollment which can directly impact the success of biomedical and clinical research outcomes. Options to leverage digital technology for improving clinical trial management are expansive, with potential benefits for improving access to clinical trials, encouraging trial diversity and inclusion, and potential cost-savings through enhanced efficiency.

Objectives

This systematic review has two key aims: (1) identify and describe the digital technologies applied in clinical trial recruitment and enrollment and (2) evaluate evidence of these technologies addressing the recruitment and enrollment of racial and ethnic minority groups.

Methods

We conducted a cross-disciplinary review of articles from PubMed, IEEE Xplore, and ACM Digital Library, published in English between January 2012 and July 2022, using MeSH terms and keywords for digital health, clinical trials, and recruitment and enrollment. Articles unrelated to technology in the recruitment/enrollment process or those discussing recruitment/enrollment without technology aspects were excluded.

Results

The review returned 614 results, with 21 articles (four reviews and 17 original research articles) deemed suitable for inclusion after screening and full-text review. To address the first objective, various digital technologies were identified and characterized, which included articles with more than one technology subcategory including (a) multimedia presentations (19%, n = 4); (b) mobile applications (14%, n = 3); (c) social media platforms (29%, n = 6); (d) machine learning and computer algorithms (19%, n = 4); (e) e-consenting (24%, n = 5); (f) blockchain (5%, n = 1); (g) web-based programs (24%, n = 5); and (h) virtual messaging (24%, n = 5). Additionally, subthemes, including specific diseases or conditions addressed, privacy and regulatory concerns, cost/benefit analyses, and ethnic and minority recruitment considerations, were identified and discussed. Limited research was found to support a particular technology's effectiveness in racial and ethnic minority recruitment and enrollment.

Conclusion

Results from this review illustrate that several types of technology are currently being explored and utilized in clinical trial recruitment and enrollment stages. However, evidence supporting the use of digital technologies is varied and requires further research and evaluation to identify the most valuable opportunities for encouraging diversity in clinical trial recruitment and enrollment practices.

Generative artificial intelligence empowers digital twins in drug discovery and clinical trials

INTRODUCTION

The concept of Digital Twins (DTs) translated to drug development and clinical trials describes virtual representations of systems of various complexities, ranging from individual cells to entire humans, and enables in silico simulations and experiments. DTs increase the efficiency of drug discovery and development by digitalizing processes associated with high economic, ethical, or social burden. The impact is multifaceted: DT models sharpen disease understanding, support biomarker discovery and accelerate drug development, thus advancing precision medicine. One way to realize DTs is by generative artificial intelligence (AI), a cutting-edge technology that enables the creation of novel, realistic and complex data with desired properties.

AREAS COVERED

The authors provide a brief introduction to generative AI and describe how it facilitates the modeling of DTs. In addition, they compare existing implementations of generative AI for DTs in drug discovery and clinical trials. Finally, they discuss technical and regulatory challenges that should be addressed before DTs can transform drug discovery and clinical trials.

EXPERT OPINION

The current state of DTs in drug discovery and clinical trials does not exploit the entire power of generative AI yet and is limited to simulation of a small number of characteristics. Nonetheless, generative AI has the potential to transform the field by leveraging recent developments in deep learning and customizing models for the needs of scientists, physicians and patients.

Effectiveness of multimodal participant recruitment in SPARK, a large, online longitudinal research study of autism

Background

SPARK launched in 2016 to build a US cohort of autistic individuals and their family members. Enrollment includes online consent to share data and optional consent to provide saliva for genomic analysis. SPARK's recruitment strategies include social media and support of a nation-wide network of clinical sites. This study evaluates SPARK's recruitment strategies to enroll a core study population.

Methods

Individuals who joined between January 31, 2018, and May 29, 2019 were included in the analysis. Data include sociodemographic characteristics, clinical site referral, the website URL used to join, how the participant heard about SPARK, enrollment completion (online registration, study consents, and returning saliva sample), and completion of the baseline questionnaire. Logistic regressions were performed to evaluate the odds of core participant status (completing enrollment and baseline questionnaire) by recruitment strategy.

Results

In total, 31,715 individuals joined during the study period, including 40% through a clinical site. Overall, 88% completed online registration, 46% returned saliva, and 38% were core participants. Those referred by a clinical site were almost twice as likely to be core participants. Those who directly visited the SPARK website or performed a Google search were more likely to be core participants than those who joined through social media.

Discussion

Being a core participant may be associated with the "personal" connection and support provided by a clinical site and/or site staff, as well as greater motivation to seek research opportunities. Findings from this study underscore the value of adopting a multimodal recruitment approach that combines social media and a physical presence.

Telehealth Experience Among Liver and Kidney Transplant Recipients: A Mixed Methods Study

Telehealth has become widely available to solid organ transplant (SOT) recipients during the COVID-19 pandemic. While evidence suggests that telehealth serves as an acceptable alternative for most SOT recipients, their satisfaction and its context remain unclear. This study used a mixed methods approach to investigate the perspectives of SOT recipients (i.e., liver, kidney, and simultaneous liver-kidney) on the benefits and disadvantages of telehealth. A total of 252 adult SOT recipients completed an online survey that quantitatively assessed telehealth experience and satisfaction. Fifteen of them further shared their perspectives by participating in either a focus group or individual interview. Approximately 70% of online survey participants had previously used telehealth for their transplant care. The quantitative data documented that, while recipients were mostly satisfied with telehealth, especially with its effectiveness and convenience, they were less satisfied with the reliability of navigating the telehealth system. The qualitative data further showed that telehealth could be less effective for SOT recipients who perceived themselves as clinically and/or socially vulnerable, needed urgent care, and were concerned about privacy. These findings suggest that the plan for using telehealth to provide transplant care should prioritize personalization, considering unique needs and preferences of each SOT recipient.

Widening participation - recruitment methods in mental health randomised controlled trials: a qualitative study

BACKGROUND

Barriers to mental health research participation are well documented including distrust of services and research; and stigma surrounding mental health. They can contribute to a lack of diversity amongst participants in mental health research, which threatens the generalisability of knowledge. Given the recent widespread use of the internet in medical research, this study aimed to explore the perspectives of key partners on the use of online (e.g. social media) and offline (e.g. in-person) recruitment as an approach to improving diversity in mental health randomised controlled trials (RCTs).

METHODS

Face-to-face and online interviews/focus groups with researchers working in mental health and Patient and Public Involvement partners in the United Kingdom. Recordings were transcribed and analysed using a combination of inductive and deductive thematic analysis.

RESULTS

Three focus groups and three interviews were conducted with a total N = 23 participants. Four overarching themes were identified: (1) recruitment reach; (2) Demographic factors that affect selection of recruitment method; (3) safety of technology, and; (4) practical challenges. Five main factors were identified that affect the choice of recruitment method: age, complexity of mental health problem and stigma, cultural and ethnicity differences and digital divide. The use of online methods was considered more accessible to people who may feel stigmatised by their mental health condition and with a benefit of reaching a wider population. However, a common view amongst participants was that online methods require closer data monitoring for quality of responders, are not fully secure and less trustworthy compared to offline methods that enable participants to build relationships with health providers. Funding, staff time and experience, organisational support, and technical issues such as spam or phishing emails were highlighted as practical challenges facing online recruitment. All participants agreed that using a hybrid approach tailored to the population under study is paramount.

CONCLUSIONS

This study highlighted the importance of offering a flexible and multifaceted recruitment approach by integrating online with offline methods to support inclusivity and widening participation in mental health research. The findings will be used to develop considerations for researchers designing RCTs to improve recruitment in mental health research.

Impact of caregivers' psychological and caregiving status on recruitment, conversion, and retention in stem cell therapy trials for cerebral palsy: A prospective survey analysis

AIM

To examine specific correlates that may affect retention outcomes of neural stem cell therapy trials in families screened for cerebral palsy.

DESIGN

A prospective correlational study.

METHODS

Primary caregivers completed surveys of psychological resilience, care burden and family caregiver tasks. The overall data and differences between groups were analysed and compared.

RESULTS

Resilience was negatively correlated with the care ability and closely related to the monthly household income and educational level of the caregivers. Factors affecting the final retention rate included the type of disease, number of combined disorders, monthly household income, primary caregivers' education level and resilience.

CONCLUSION

Economic level, literacy and psychological status may affect trial retention. These findings can provide tips for preparing for subsequent screening, identification and intervention in stem cell clinical trials.

IMPLICATION FOR THE PROFESSION AND/OR PATIENT CARE

The study results may provide nursing care tips to make recruitment more efficient, reduce trial costs, support patient-centredness and accelerate trial progress.

NO PATIENT OR PUBLIC CONTRIBUTION

The target population involves the primary caregivers of children living with cerebral palsy. However, neither patients nor the public contributed to the design or conduct of the study, analysis, or interpretation of the data, or preparation of the manuscript.

Clinical research nurse predictions of trial failure, recruitment and retention: a case for their early inclusion in trial design

BACKGROUND

Clinical research nurses are a key part of the clinical trial team but typically get involved later in the trial, usually during recruitment. The purpose of our study was to establish if CRNs who read the trial protocol can predict the performance of the trial.

METHODS

We randomly selected 18 trial protocols with three statuses, terminated, withdrawn, and completed, from ClinicalTrials.gov, between 2014 and 2018 inclusive. We gave the protocols to five CRNs, asked them to make a judgement and provide a reason for that judgement (via a 12-item questionnaire) on the status of the trial (terminated, withdrawn or completed), if the trial met its recruitment target, if it recruited on time, and if it retained its participants. We also asked if it was likely a CRN was involved in the design of the trial. The CRNs were blinded to the study outcomes, did not receive any training on how to read a protocol and were prohibited from using/abstained from using the internet while completing the task.

RESULTS

Twenty-three questionnaires on 23 trial protocols (18 different trials) were completed by 5 CRNs. The CRNs correctly predicted the trial status 48%, 95% CI: 29-67% (11/23) of the time; successful/unsuccessful recruitment 74%, 95% CI: 54-87% (17/23) of the time; on-time recruitment 70%, 95% CI: 49-84% (16/23) of the time; and participant retention 52%, 95% CI: 33-71% (12/23). CRNs identified 100% (sensitivity) of sites that hit their target and 63%, 95% CI: 36-84% (specificity) of sites that missed their target.

CONCLUSIONS

CRNs are very good judges of trial recruitment and site performance issues and are a vital part of the clinical trial team. Taken with the ESP (Estimating Site Performance) study, we have made a strong case for broadening the trial team at the trial design stage. Early engagement of a broad skillset can potentially offset problems of recruitment, retention and trial failure.

The impact of social connection on near-term suicidal ideation

While predominant suicide theories emphasize the role of social connectedness in suicidal thinking, there is a need to better understand (a) how specific aspects of social connection relate to suicidal ideation and (b) the timeframe over which these relationships persist. The current study examined ecological momentary assessment data over a 30-day period from 35 participants with past-year suicidal thoughts or behaviors (mean age = 25.88; 62.9% women; 68.6% White) to address these questions. Results demonstrated that absence of social contact was associated with next timepoint suicidal ideation, even after considering the suicidal ideation autoregressive effect (i.e., concurrent), with effects strongest in the short-term. Findings provide preliminary evidence of the need to assess for the presence of social contact, and for assessments to occur in close proximity (i.e., a few hours), to capture the true dynamics of risk for suicidal ideation. Although needing replication, results suggest importance of just-in-time interventions targeting suicidal ideation.

Innovative Technologies in CNS Trials: Promises and Pitfalls for Recruitment, Retention, and Representativeness

Objective

Recruitment of a sufficiently large and representative patient sample and its retention during central nervous system (CNS) trials presents major challenges for study sponsors. Technological advances are reshaping clinical trial operations to meet these challenges, and the COVID-19 pandemic further accelerated this development.

Method of Research

The International Society for CNS Clinical Trials and Methodology (ISCTM; www.isctm.org) Innovative Technologies for CNS Trials Working Group surveyed the state of technological innovations for improved recruitment and retention and assessed their promises and pitfalls.

Results

Online advertisement and electronic patient registries can enhance recruitment, but challenges with sample representativeness, conversion rates from eligible prescreening to enrolled patients, data privacy and security, and patient identification remain hurdles for optimal use of these technologies. Electronic medical records (EMR) mining with artificial intelligence (AI)/machine learning (ML) methods is promising but awaits translation into trials. During the study treatment phase, technological innovations increasingly support participant retention, including adherence with the investigational treatment. Digital tools for adherence and retention support take many forms, including patient-centric communication channels between researchers and participants, real-time study reminders, and digital behavioral interventions to increase study compliance. However, such tools add technical complexities to trials, and their impact on the generalizability of results are largely unknown.

Conclusion

Overall, the group found a scarcity of systematic data directly assessing the impact of technological innovations on study recruitment and retention in CNS trials, even for strategies with already high adoption, such as online recruitment. Given the added complexity and costs associated with most technological innovations, such data is needed to fully harness technologies for CNS trials and drive further adoption.

Automatic assessment of patient eligibility by utilizing NLP and rule-based analysis

Assessment of patient eligibility is an essential process in the clinical trial but there are a lot of manual processes involved. Natural Language Processing (NLP) is a promising technique to automate analysing of the massive volume of Electronic Medical Records (EMRs) hence it can assist in the assessment of patient eligibility, especially in clinical trials that require complex inclusion/exclusion criteria. In this paper, we proposed a hybrid model which utilized both rule-based and NLP technologies to automate the assessment of patient eligibility. The result showed that the hybrid model had a better trade-off between sensitivity and precision compared to the rule-based model and NLP similarity model. Moreover, the accuracy of the hybrid model was validated on the larger dataset and it reached an accuracy of 87.3%. Therefore, this technique potentially can improve the efficiency of patient recruitment by eliminating the manual processes that involve in the assessment of patient eligibility.

Non-COVID-19 UK clinical trials and the COVID-19 pandemic: impact, challenges and possible solutions

INTRODUCTION

The COVID-19 pandemic impacted the operationalisation of non-COVID-19 clinical trials globally, particularly site and participant recruitment and trial success/stoppage. Trials which anticipate recruitment challenges may embed methods such as the QuinteT Recruitment Intervention (QRI) to help identify and understand the sources of challenges. Such interventions can help shed light on pandemic-related challenges. This paper reports our experience of the impact of the COVID-19 pandemic on conducting clinical trials with an embedded QRI, highlighting how the QRI aided in identifying challenges and potential solutions, particularly related to the site set-up and participant recruitment.

MAIN BODY

We report on 13 UK clinical trials which included a QRI. Information is from QRI data and researchers' experience and reflections. In most trials, recruitment was lower than even the lowest anticipated rates. The flexibility of the QRI facilitated rapid data collection to understand and document, and in some instances respond to, operational challenges. Challenges were mostly logistical, pandemic-related and beyond the control of the site or central trial teams. Specifically: disrupted and variable site opening timelines -often due to local research and development (R&D) delays- shortages of staff to recruit patients; fewer eligible patients or limited access to patients; and intervention-related factors. Almost all trials were affected by pandemic-related staffing issues including redeployment, prioritisation of COVID-19 care and research, and COVID-19-related staff illness and absence. Trials of elective procedures were particularly impacted by the pandemic, which caused changes to care/recruitment pathways, deprioritisation of services, reduced clinical and surgical capacity and longer waiting lists. Attempted solutions included extra engagement with staff and R&D departments, trial protocol changes (primarily moving online) and seeking additional resourcing.

CONCLUSION

We have highlighted wide-ranging, extensive and consistent pandemic-related challenges faced by UK clinical trials, which the QRI helped to identify and, in some cases, address. Many challenges were insurmountable at individual trials or trials unit level. This overview highlights the need to streamline trial regulatory processes, address staffing crises, improve recognition of NHS research staff and for clearer, more nuanced central guidance on the prioritisation of studies and how to deal with the backlog. Pre-emptively embedding qualitative work and stakeholder consultation into trials with anticipated difficulties, moving some processes online, and flexible trial protocols may improve the resilience of trials in the current challenging context.

Rapid Web-Based Recruitment of Patients With Psoriasis: Multinational Cohort Study

BACKGROUND

Wide-ranging patient recruitment not restricted to the location of the investigator will provide a better representation of the patient population in clinical studies.

OBJECTIVE

Our goal was to assess the feasibility of a broad web-based recruitment strategy in an 8-week observational study of 500 study participants with psoriasis and healthy controls from locations remote from the investigator and to assess the cost associated with each participant.

METHODS

A decentralized team in Denmark recruited patients with psoriasis and healthy controls using Google and Facebook advertisements and posts to Facebook groups. All individuals were screened via the internet, and patients diagnosed with psoriasis were included. Questionnaires regarding itch and sleep were completed by both groups at inclusion, week 4, and week 8.

RESULTS

During a 2-week recruitment period, 12,887 unique advertisement views were registered, and 839 participants were enrolled, of which 507 completed the study (220 with psoriasis and 287 healthy controls) with a retention rate of 60.4%. Participants were recruited from 11 different countries on 4 separate continents, mainly from the United States, Canada, and the United Kingdom. The recruitment rate was 59.9 participants per day, and the conversion rate was 57.2%. Recruitment costs were US $13 per enrolled participant and US $22 per participant completing the study.

CONCLUSIONS

It is feasible and rapid to recruit a large number of participants from locations different from the investigator and to retain patients in an observational study with no visits to a clinical site at low costs.

Online randomised trials with children: A scoping review

BACKGROUND

Paediatric trials must contend with many challenges that adult trials face but often bring additional obstacles. Decentralised trials, where some or all trial methods occur away from a centralised location, are a promising strategy to help meet these challenges. This scoping review aims to (a) identify what methods and tools have been used to create and conduct entirely online-decentralised trials with children and (b) determine the gaps in the knowledge in this field. This review will describe the methods used in these trials to identify their facilitators and the gaps in the knowledge.

METHODS

The methods were informed by guidance from the Joanna Briggs Institute and the PRISMA extension for scoping reviews. We systematically searched MEDLINE, CENTRAL, CINAHL, and Embase databases, trial registries, pre-print servers, and the internet. We included randomised and quasi-randomised trials conducted entirely online with participants under 18 published in English. A risk of bias assessment was completed for all included studies.

RESULTS

Twenty-one trials met our inclusion criteria. The average age of participants was 14.6 years. Social media was the most common method of online recruitment. Most trials employed an external host website to store and protect their data. Duration of trials ranged from single-session interventions up to ten weeks. Fourteen trials compensated participants. Eight trials involved children in their trial design process; none reported compensation for this. Most trials had a low risk of bias in "random sequence generation", "selective reporting", and "other". Most trials had a high risk of bias in "blinding participants and personnel", "blinding of outcome assessment", and "incomplete outcome data". "Allocation concealment" was unclear in most studies.

CONCLUSIONS

There was a lack of transparent reporting of the recruitment, randomisation, and retention methods used in many of the trials included in this review. Patient and public involvement (PPI) was not common, and the compensation of PPI partners was not reported in any study. Consent methods and protection against fraudulent entries to trials were creative and thoroughly discussed by some trials and not addressed by others. More work and thorough reporting of how these trials are conducted is needed to increase their reproducibility and quality.

ETHICS AND DISSEMINATION

Ethical approval was not necessary since all data sources used are publicly available.

Understanding potential participation barriers to improve trial design and outcomes: clinical trial simulation in palmoplantar pustulosis as a case study

OBJECTIVES

Evaluate the experiences and perceptions of patients participating in a simulated clinical trial and identify ways to enhance future patient-centric trial designs.

DESIGN

International, multicentre, non-interventional, virtual clinical trial visits with patient debriefs and advisory boards.

SETTING

Virtual clinic visits and accompanying advisory boards.

PARTICIPANTS

Nine patients with palmoplantar pustulosis for simulated trial visits; 14 patients and patient representatives for advisory boards.

MAIN OUTCOME MEASURES

Qualitative responses to trial documentation, visit schedule and logistics, and trial design were collected during patient debriefs. Results were discussed at two virtual advisory board meetings.

RESULTS

Patients identified key barriers to participation and potential difficulties encountered when attending trial visits and completing assessments. They also proposed recommendations to overcome these challenges. Patients recognised the need for comprehensive informed consent forms, but recommended use of non-technical language, brevity and additional support to aid understanding. Other trial documentations should be relevant to the disease and include known efficacy and safety of the study drug. Patients were concerned about receiving placebo, stopping existing medications and being unable to receive the study drug after trial completion; therefore, patients and physicians recommended an open-label extension following trial completion. Trial visits were too numerous (n=20) and too long (3-4 hours each); patients recommended improvements to the design to make best use of their time and reduce unnecessary waiting. They also requested financial and logistical support. Patients expressed a desire for study outcomes that matter to them, related to their ability to undertake normal daily activities and not be a burden to others.

CONCLUSIONS

Simulated trials are an innovative method for assessing trial design and acceptance from a patient-centric perspective, enabling specific improvements to be made prior to trial initiation. Incorporation of recommendations from simulated trials could enhance trial recruitment and retention, and optimise trial outcomes and data quality.

Challenges and adaptations for a cluster-randomized control trial targeting parents of pediatric cancer survivors with obesity during the COVID-19 pandemic

Although the COVID-19 pandemic has increased the importance of digital technology in clinical trial implementation, there is a dearth of literature reporting on challenges and strategies related to multi-site randomized controlled trials (RCTs) among pediatric cancer survivors during the pandemic. This paper discusses challenges faced in the implementation of the NOURISH-T+ trial so far (December 2019-March 2022) and describes adaptations made as a result of these disruptions in the areas of recruitment, data collection, and overall engagement. This reflection is based on a multisite cluster-RCT that aims to examine whether an intervention targeting parents as agents of change to promote healthy eating and physical activity in pediatric cancer survivors, NOURISH-T+ (Nourishing Our Understanding of Role modeling to Improve Support and Health for Healthy Transitions), reduces body mass and improves health behaviors compared to Brief NOURISH-T (Enhanced Usual Care/EUC). The COVID-19 pandemic has created and exacerbated challenges for our trial related to participant recruitment and engagement, technology access and literacy, and data collection and management, as well as COVID-related challenges (e.g., Zoom fatigue). Strategies used to address these challenges might prove helpful in future virtual or hybrid RCTs, including developing trust and rapport with participants, providing support through multiple routes of dissemination, and using data management applications (e.g., REDCap™) for automation and project management. Extra efforts to build families' trust and rapport, offering multiple routes of support, and automating as many tasks as possible are critical to ensuring the continuation of high-quality clinical trials during the COVID-19 pandemic.

Exploring Decentralized Glucose and Behaviometric Monitoring of Persons with Type 2 Diabetes in the Setting of a Clinical Trial

BACKGROUND

Clinical trials often suffer from recruitment barriers and poor adherence, which increases costs and affects trial outcomes.

OBJECTIVE

To investigate the feasibility of Decentralized Clinical Trial (DCT) design elements to recruit, enroll, and engage patients with type 2 diabetes mellitus (T2DM).

METHODS

Patients with T2DM were recruited through a pharmacy and online recruitment using advert on Facebook, to 3 weeks monitoring of glucose and behaviometric parameters. Subjects recruited online could either complete an informed consent conversation in the pharmacy or through live video call managed by the study app.A continuous glucose monitoring (CGM) device to collect glucose data, and a hybrid smartwatch to monitor heart rate, track activity and sleep pattern were delivered by postal service to the participants' home address. The devices were connected to a study specific app on the participant's smartphone also capturing GPS data and questionnaire answers.

RESULTS

Twenty-six subjects (3 pharmacy, 23 online) with T2DM were recruited, 85% preferred online informed consent conversation. All participants were able to self-apply the CGM device, use the smartwatch, and download the app. GPS location was captured more than 100 times for each participant, and more than 90% completed all 3 questionnaires. All the participants felt safe with the informed consent process and they felt confident in participating from home. Three participants dropped-out during the study period leaving a retention rate at 87%.

CONCLUSIONS

Use of DCT design elements to conduct a T2DM study is feasible regarding recruitment, data collection from various electronic devices, and participant engagement.

Recruitment challenges for a prospective telehealth cohort study

Background

The COVID-19 pandemic presents challenges in participant recruitment strategies for clinical research involving people with opioid use disorders recently engaged in treatment. We describe challenges to participant recruitment in a trial comparing virtual buprenorphine treatment platform to office-based buprenorphine treatment.

Methods

The parent study was a cohort trial of telehealth delivered buprenorphine treatment compared to office-based buprenorphine treatment, however, due to the pandemic potential participant recruitment for both arms became virtual. Between 9/27/2021 and 7/11/2022, telephone, email, flyers, and word-of-mouth were used to recruit study participants from each treatment setting. Recruitment tracking documents recorded the primary outcomes: number of outreach attempts and most effective contact methods.

Results

Treatment settings provided contact information for 1485 potential study participants. Information was incorrect or disconnected for 282 (19%) individuals, 695 (47%) did not respond to outreach, and 508 (34%) responded to outreach. Of these responders, 369 were interested in study participation, 259 completed the online informed consent and screening assessment, and 148 met eligibility criteria and enrolled in the study. A total of 3804 virtual outreach attempts across 1485 potential participants were made, resulting in an average of 2.7 attempts per contact and a mean of 25.7 attempts per enrolled participant (n = 148).

Conclusion

Conducting research during the COVID-19 pandemic required shifting from in-person to virtual recruitment strategies to contact and engage potential study participants. Virtual recruitment for this population during a pandemic appears to be less efficient and hindered efforts to meet recruitment goals.

Collaborative development of an innovative virtual research recruitment strategy through an academic/clinical partnership

PURPOSE

Recruitment for research studies is the crucial first step and often the most challenging one. A major shift in recruitment methods for research was necessitated by the onset of the COVID-19 pandemic. Our goal is to describe lessons learned and the success rate of virtual research recruitment compared with other research recruitment strategies employed by our Academic/Clinical Partnership research team.

METHODS

A descriptive design was employed to assess the success of in-person, mailed introductory letters with follow-up telephone calls and virtual recruitment strategies. The potential participants (N = 144) were parents caring for technology-dependent children (e.g., mechanical ventilation, feeding tubes) at home. To meet recruitment goals the Academic/Clinical Partnership research team (academic project team, hospital-based research nurses) collaboratively developed creative recruitment strategies and a framework to assess recruitment strategy success; percentage who agreed to be contacted by the academic partner, total time for recruitment visit, efficiency, and adherence to ethical recruitment principles.

RESULTS

Virtual recruitment via telehealth visits was highly successful meeting all recruitment strategy benchmarks. Importantly, 91.7 % of potential participants that were approached agreed to be contacted for enrollment in a time efficient manner while adhering to ethical recruitment principles. Best practices and lessons learned were identified.

CONCLUSIONS

The transition to virtual study recruitment due to the pandemic was an innovative and successful strategy. An Academic/Clinical Partnership research team benefits both partners: (1) enhances study recruitment by increasing research capacity at the clinical site; and (2) provides mentoring by nurse scientists to facilitate nurse research scholar knowledge and skills.

Recording and reporting of recruitment strategies in trial protocols, registries, and publications was nonexistent

OBJECTIVES

To investigate how trialists record and report their recruitment strategies and the recruiter details in trial protocols, registries, and publications.

STUDY DESIGN AND SETTING

A retrospective study of ovarian cancer (OC) trials between 2010 and 2021. We reviewed 154 trial publications, 30 protocols, 105 registry entries, and 26 trial websites associated with 88 phase III OC trials.

RESULTS

None of the 88 trials reviewed published a recruitment strategy or made reference to an available recruitment strategy for the trial. Only 31% (n = 28) made reference to the recruiter but this was reported only in the protocol so we have no evidence these named recruiters performed the task. None of the trials reviewed which closed early or extended recruitment timelines due to slow accrual, reported measures taken to improve recruitment rates before stoppages or changes took place. There were disparities in the reported target recruitment numbers between the protocol, the publication, and the registry.

CONCLUSION

Recruitment strategies exist, and we are sure most trial centers use recruitment strategies, but they need to be recorded and reported, as part of the supplementary material if not the main publication, so we can evaluate their effectiveness.

Sociodemographic and psychological characteristics influencing patients' willingness to participate in clinical trials

BACKGROUND/AIMS

Clinical trials are fundamental for the development of new medicines and patient participation is based on free consent. Our study sought to identify psychological characteristics that may influence patient willingness to participate in a clinical trial.

METHODS

A total of 100 participants were invited to participate with 80% positive response rate. The psychological characteristics of each patient were evaluated using the following validated psychometric scales: Self-Efficacy Scale, Curiosity, Exploration Inventory-Trait, Social Support Satisfaction, State-Trait Anxiety Inventory and Social Avoidance and Distress, and Fear of Negative Evaluation.

RESULTS

Patients who agreed to participate in the clinical trial were significantly younger than those who refused (p=0.028). There were no differences in sex, lifestyle, employment status, monthly income or education. After adjusting for age and sex, patients who agreed to participate scored significantly higher in the following: self-efficacy total score (p<0.001), effectiveness in adversity (p<0.001), social effectiveness (p<0.001) and initiation and persistence (p<0.001); social support total score (p<0.001), family satisfaction (p=0.015), friendship satisfaction (p<0.001), social activities satisfaction (p=0.002) and intimacy (p<0.001); total curiosity score (p<0.001), absorption (p<0.001) and exploration (p<0.001). Compared with patients who agreed to participate, those who refused scored significantly higher for both state (p<0.001) and trait anxiety (p<0.001), fear of negative evaluation (p<0.001) and social avoidance and distress (p<0.001).

CONCLUSIONS

Patients who were willing to participate in clinical trials exhibited different psychological characteristics to patients who refused. Specifically, they were more curious and self-efficacious, less anxious and reported a higher level of social support than patients who declined to participate. Identifying characteristics that condition the individual's decision to participate in a clinical trial has important implications for the development of patient-focused communication strategies and improved recruitment approaches.

Improving Food-Related Quality of Life in Inflammatory Bowel Disease through a Novel Web Resource: A Feasibility Randomised Controlled Trial

Food-related quality of life (FR-QoL) is impaired in inflammatory bowel disease (IBD) and education and support on food-related issues in IBD is needed. This feasibility trial aimed to investigate the effectiveness and acceptability of a web resource in enhancing FR-QoL in newly diagnosed IBD. Patients diagnosed with Crohn's disease or ulcerative colitis in the preceding 12 months, with an impaired FR-QoL, were recruited and randomised to either receive access to the web resource (covering IBD-specific diet concerns) or no access (control group) for 12 weeks, while receiving usual clinical care. FR-QoL, health-related quality of life, psychological outcomes, and clinical disease activity were assessed. Web resource usage was assessed, and patients' experiences of the web resource were investigated in semi-structured interviews. Of 81 patients screened, 50 participants were randomised, 30 to the web resource and 20 to control. FR-QoL increased more in the web resource (+11.7 SD 18.2) than control group (+1.4 SD 20.4) (p = 0.067), while IBD distress reduced in the web resource (-6.8 SD 26.6) and increased in the control group (+8.3 SD 25.5) (p = 0.052), albeit not statistically significantly. End of trial Crohn's disease clinical activity (PRO-2) was significantly lower in the web resource than control group (p = 0.046). Participants most frequently accessed web resource content discussing dietary management of gut symptoms and in semi-structured interviews, reported the website to contain relevant information. This feasibility study demonstrates potential effectiveness of the web resource on improving FR-QoL and psychological outcomes in IBD. An adequately powered effectiveness RCT is feasible to conduct and is now warranted. NCT03884686.

Which decentralised trial activities are reported in clinical trial protocols of drug trials initiated in 2019-2020? A cross-sectional study in ClinicalTrials.gov

OBJECTIVES

Decentralised clinical trial activities-such as participant recruitment via social media, data collection through wearables and direct-to-participant investigational medicinal product (IMP) supply-have the potential to change the way clinical trials (CTs) are conducted and with that to reduce the participation burden and improve generalisability. In this study, we investigated the decentralised and on-site conduct of trial activities as reported in CT protocols with a trial start date in 2019 or 2020.

DESIGN

We ascertained the decentralised and on-site conduct for the following operational trial activities: participant outreach, prescreening, screening, obtaining informed consent, asynchronous communication, participant training, IMP supply, IMP adherence monitoring, CT monitoring, staff training and data collection. Results were compared for the public versus private sponsors, regions involved, trial phases and four time periods (the first and second half of 2019 and 2020, respectively).

SETTING

Phases 2, 3 and 4 clinical drug trial protocols with a trial start date in 2019 or 2020 available from ClinicalTrials.gov.

OUTCOME MEASURES

The occurrence of decentralised and on-site conduct of the predefined trial activities reported in CT protocols.

RESULTS

For all trial activities, on-site conduct was more frequently reported than decentralised conduct. Decentralised conduct of the individual trial activities was reported in less than 25.6% of the 254 included protocols, except for decentralised data collection, which was reported in 68.9% of the protocols. More specifically, 81.9% of the phase 3 protocols reported decentralised data collection, compared with 73.3% and 47.0% of the phase 2 and 4 protocols, respectively. For several activities, including prescreening, screening and consenting, upward trends in reporting decentralised conduct were visible over time.

CONCLUSIONS

Decentralised methods are used in CTs, mainly for data collection, but less frequently for other activities. Sharing best practices and a detailed description in protocols can drive the adoption of decentralised methods.

Testing the Effectiveness of an Animated Decision Aid to Improve Recruitment of Control Participants in a Case-Control Study: Web-Based Experiment

BACKGROUND

Participation in case-control studies is crucial in epidemiological research. The self-sampling bias, low response rate, and poor recruitment of population representative controls are often reported as limitations of case-control studies with limited strategies to improve participation. With greater use of web-based methods in health research, there is a further need to understand the effectiveness of different tools to enhance informed decision-making and willingness to take part in research.

OBJECTIVE

This study tests whether the inclusion of an animated decision aid in the recruitment page of a study website can increase participants' intentions to volunteer as controls.

METHODS

A total of 1425 women were included in a web-based experiment and randomized to one of two experimental conditions: one in which they were exposed to a simulated website that included the animation (animation; n=693, 48.6%), and one in which they were exposed to the simulated website without the animation (control; n=732, 51.4%). The simulated website was adapted from a real website for a case-control study, which invites people to consider taking part in a study that investigates differences in purchasing behaviors between women with and without ovarian cancer and share their loyalty card data collected through 2 high street retailers with the researchers. After exposure to the experimental manipulation, participants were asked to state (1) their intention to take part in the case-control study, (2) whether they would be willing to share their loyalty card for research, and (3) their willingness to be redirected to the real website after completing the survey. Data were assessed using ordinal and binary logistic regression, reported in percentages (%), adjusted odds ratio (AOR), and 95% confidence intervals.

RESULTS

Including the animation in the simulated website did not increase intentions to participate in the study (AOR 1.09; 95% CI 0.88-1.35) or willingness to visit the real study website after the survey (control 50.5% vs animation 52.6%, AOR 1.08; 95% CI 0.85-1.37). The animation, however, increased the participants' intentions to share the data from their loyalty cards for research in general (control 17.9% vs animation 26%; AOR 1.64; 95% CI 1.23-2.18).

CONCLUSIONS

While the results of this study indicate that the animated decision aid did not lead to greater intention to take part in our web-based case-control study, they show that they can be effective in increasing people's willingness to share sensitive data for health research.

Deployment of an End-to-End Remote, Digitalized Clinical Study Protocol in COVID-19: Process Evaluation

Background

The SARS-CoV-2 (COVID-19) pandemic may accelerate the adoption of digital, decentralized clinical trials. Conceptual recommendations for digitalized and remote clinical studies and technology are available to enable digitalization. Fully remote studies may break down some of the participation barriers in traditional trials. However, they add logistical complexity and offer fewer opportunities to intervene following a technical failure or adverse event.

Objective

Our group designed an end-to-end digitalized clinical study protocol, using the Food and Drug Administration (FDA)–cleared Current Health (CH) remote monitoring platform to collect symptoms and continuous physiological data of individuals recently infected with COVID-19 in the community. The purpose of this work is to provide a detailed example of an end-to-end digitalized protocol implementation based on conceptual recommendations by describing the study setup in detail, evaluating its performance, and identifying points of success and failure.

Methods

Primary recruitment was via social media and word of mouth. Informed consent was obtained during a virtual appointment, and the CH-monitoring kit was shipped directly to the participants. The wearable continuously recorded pulse rate (PR), respiratory rate (RR), oxygen saturation (SpO₂), skin temperature, and step count, while a tablet administered symptom surveys. Data were transmitted in real time to the CH cloud-based platform and displayed in the web-based dashboard, with alerts to the study team if the wearable was not charged or worn. The study duration was up to 30 days. The time to recruit, screen, consent, set up equipment, and collect data was quantified, and advertising engagement was tracked with a web analytics service.

Results

Of 13 different study advertisements, 5 (38.5%) were live on social media at any one time. In total, 38 eligibility forms were completed, and 19 (50%) respondents met the eligibility criteria. Of these, 9 (47.4%) were contactable and 8 (88.9%) provided informed consent. Deployment times ranged from 22 to 110 hours, and participants set up the equipment and started transmitting vital signs within 7.6 (IQR 6.3-10) hours of delivery. The mean wearable adherence was 70% (SD 19%), and the mean daily survey adherence was 88% (SD 21%) for the 8 participants. Vital signs were in normal ranges during study participation, and symptoms decreased over time.

Conclusions

Evaluation of clinical study implementation is important to capture what works and what might need to be modified. A well-calibrated approach to online advertising and enrollment can remove barriers to recruitment and lower costs but remains the most challenging part of research. Equipment was effectively and promptly shipped to participants and removed the risk of illness transmission associated with in-person encounters during a pandemic. Wearable technology incorporating continuous, clinical-grade monitoring offered an unprecedented level of detail and ecological validity. However, study planning, relationship building, and troubleshooting are more complex in the remote setting. The relevance of a study to potential participants remains key to its success.

Changes in key recruitment performance metrics from 2008–2019 in industry-sponsored phase III clinical trials registered at ClinicalTrials.gov

Background

Increasing costs and complexity in clinical trials requires recruitment of more narrowly defined patient populations. However, recruitment for clinical trials remains a considerable challenge.

Aim

Our overall aim was to quantify recruitment performance in industry-sponsored phase III clinical trials conducted globally during 2008–2019 with primary aim to examine development of overall clinical trial measures (number of trials completed, number of participants enrolled, trial duration in months) and key recruitment metrics (recruitment rate, number of sites, number of patients enrolled per site).

Methods

The publicly available AACT database containing data on all trials registered at ClinicalTrials.gov since 2008 was used. The analysis was completed during three time periods from 2008–2019 of 4 years each.

Results and conclusion

Recruitment duration for industry-sponsored phase III clinical trials have increased significantly during the last 12 years from an average recruitment period of 13 months (IQR 7–23) in 2008–2011 to 18 months (IQR 11–28) in 2016–2019 (p = 0.0068). Further, phase III clinical trials have increased the number of registered sites per clinical trial by more than 30% during the last 12 years from a median number 43 sites (IQR 17–84) in 2012–2015 to 64 sites (IQR 30–118) in 2016–2019 (p = 0.025), and concurrently, the number of participants enrolled in clinical research has decreased significantly from 2012–2015 and 2016–2019 (p = 0.046). We believe that these findings indicate that recruitment for phase III clinical trials is less effective today compared to 12 years ago.

Virtual recruitment and participant engagement for substance use research during a pandemic

PURPOSE OF REVIEW

The coronavirus disease 2019 pandemic resulted in cataclysmic changes to the research enterprise, causing a forced shutdown or rapid pivot to virtual methods. Adapting studies to the virtual environment also impacted recruitment and retention strategies. This review elucidated challenges and offered pragmatic recommendations, drawing on published literature and our prior work, to assist researchers in re-evaluating and amending best-practice techniques to bolster inclusive recruitment and study engagement of people using substances, particularly for virtual interviews or focus groups.

RECENT FINDINGS

Ameliorating recruitment strategies and research protocols to better fit virtual methods of recruitment and study administration required careful consideration of ethical and logistical implications. Many procedures to increase enrollment of underrepresented populations, such as building mutually beneficial and respectful community partnerships, recruiting via social media, or providing ambulatory research centers, existed prior to this specific pandemic. However, unprecedented disruptions in resources needed to participate in virtual interviews or focus groups, privacy concerns, and possible deteriorating trust in research necessitated continued adaptation and expansion of these strategies.

SUMMARY

Building upon prepandemic, community-engaged strategies may continue to facilitate diverse recruitment efforts and advance science productivity in the substance use and addiction field during the pandemic and thereafter.

Large multicenter randomized trials in autism: key insights gained from the balovaptan clinical development program

BACKGROUND

Autism spectrum disorder (ASD) is a common and heterogeneous neurodevelopmental condition that is characterized by the core symptoms of social communication difficulties and restricted and repetitive behaviors. At present, there is an unmet medical need for therapies to ameliorate these core symptoms in order to improve quality of life of autistic individuals. However, several challenges are currently faced by the ASD community relating to the development of pharmacotherapies, namely in the conduct of clinical trials. Balovaptan is a V1a receptor antagonist that has been investigated to improve social communication difficulties in individuals with ASD. In this viewpoint, we draw upon our recent first-hand experiences of the balovaptan clinical development program to describe current challenges of ASD trials.

DISCUSSION POINTS

The balovaptan trials were conducted in a wide age range of individuals with ASD with the added complexities associated with international trials. When summarizing all three randomized trials of balovaptan, a placebo response was observed across several outcome measures. Placebo response was predicted by greater baseline symptom severity, online recruitment of participants, and less experienced or non-academic trial sites. We also highlight challenges relating to selection of outcome measures in ASD, the impact of baseline characteristics, and the role of expectation bias in influencing trial results.

CONCLUSION

Taken together, the balovaptan clinical development program has advanced our understanding of the key challenges facing ASD treatment research. The insights gained can be used to inform and improve the design of future clinical trials with the collective aim of developing efficacious therapies to support individuals with ASD.

Potential of Online Recruitment Among 15-25-Year Olds: Feasibility Randomized Controlled Trial

Background

Recruiting young people for health and intervention studies by traditional methods has become increasingly challenging. The widespread access to the internet may offer new strategies for online recruitment.

Objective

This study aims to assess the feasibility of online recruitment for a randomized controlled trial evaluating the effectiveness of Mindhelper, an online national youth mental health promotion service. The target group was young Danes aged 15-25 in need of mental health promotion.

Methods

Advertisements for recruitment were set up on Facebook and Instagram. Browser history was collected for a subsample of participants. We compared basic characteristics of participants who completed the baseline survey and those who did not, as well as of participants who completed the follow-up survey and those who were lost to follow-up. The significance of these differences was tested with the Pearson chi-square test.

Results

A total of 560 Danes aged 15-25 were recruited within 1 month (ie, had completed the baseline survey). Among these participants, 356 (63.6%) were at risk of developing depression or stress. The average advertisement price per participant completing the baseline questionnaire was 31 DKK (approximately €4 [US $4.2]). The follow-up survey was sent to 545 participants, of whom 318 (58.3%) completed the survey. No statistically significant differences were observed in baseline characteristics of participants who completed the follow-up and those who were lost to follow-up in terms of gender (P=.45), age (P=.35), occupation (P=.17), cohabitation (P=.90), mental well-being (P=.26), mental illness (P=.44; impact of the illness, P=.05), or use of the internet when having a hard time (P=.92).

Conclusions

We conclude that it is feasible to recruit young Danes online for a large-scale randomized controlled trial assessing the effectiveness of Mindhelper.

Trial Registration

ClinicalTrials.gov NCT04650906; https://clinicaltrials.gov/ct2/show/NCT04650906

Evaluation of Self-care Activities and Quality of Life in Patients With Type 2 Diabetes Treated With Metformin Using the 2D Matrix Code of Outer Drug Packages as Patient Identifier: the DePRO Proof-of-Concept Observational Study

Background

The use of digital technology to assess patients remotely can reduce clinical study costs. In the European Union, the 2D matrix code on prescription drug packaging serves as a unique identifier of a given package of medication, and thus, also of the patient receiving that medication. Scanning of the 2D matrix code may therefore allow remote patient authentication in clinical studies.

Objective

The aim of the DePRO study was to assess the feasibility of a fully digital data-capture workflow, the authentication of participants via drug packaging 2D matrix codes, in patients with type 2 diabetes mellitus (T2DM) who use metformin. The primary objective was to describe the self-care activities of these patients. Secondary objectives were to evaluate (1) the self-reported health status of these patients, (2) the association of self-care activities with demographics and disease characteristics, and (3) the usability of the my ePRO app.

Methods

DePRO was an observational, multicenter, cross-sectional, digital, and patient-driven study conducted in Germany from June to December 2020. Adult patients prescribed metformin were invited to participate via their pharmacist or a medication tracker app. Participants downloaded the my ePRO app onto their own mobile device, scanned the 2D matrix code on their metformin package for registration and authentication, and provided informed consent via an electronic form. They were then able to complete a study-specific questionnaire on demographics and clinical characteristics, the German version of the Summary of Diabetes Self-Care Activities measure (SDSCA-G), the Diabetes Treatment Satisfaction Questionnaire (DTSQ), and the EQ-5D-5L. The patients conducted the study without support from a health care professional. Statistical analyses were exploratory and descriptive.

Results

In total, 3219 patients were invited to participate. The proportion of patients giving consent was greater among those invited by pharmacists (19/217, 8.8%) than among those invited via the medication tracker app (13/3002, 0.4%). Of the 29 patients eligible for analysis, 28 (97%) completed all study questionnaires. Most of the patients (23/29, 79%) were aged <60 years, and 59% (17/29) were male. The patients spent a mean total of 3.5 (SD 1.3) days out of 7 days on self-care activities (SDSCA-G). Most patients (24/29, 83%) were satisfied to extremely satisfied with their current treatment (DTSQ). Events of perceived hyperglycemia or hypoglycemia were reported by 20 of 29 (69%) patients. The best possible health status (EQ-5D-5L) was reported by 18 of 28 (64%) patients. Age was positively correlated with time spent on general and specific diet (Spearman coefficient 0.390 and 0.434, respectively).

Conclusions

The DePRO study demonstrates the feasibility of fully digital authentication (via 2D matrix codes on drug packaging) and data capture in patients with T2DM. Personal invitations yielded higher recruitment rates than remote invitations via the medication tracker app. A high questionnaire completion rate was realized, based on completion by 28 out of 29 patients.

Trial Registration

ClinicalTrials.gov NCT04383041; https://clinicaltrials.gov/ct2/show/NCT04383041

International Registered Report Identifier (IRRID)

RR2-10.2196/21727

Ethical Issues in Social Media Recruitment for Clinical Studies: Ethical Analysis and Framework

BACKGROUND

Social media recruitment for clinical studies holds the promise of being a cost-effective way of attracting traditionally marginalized populations and promoting patient engagement with researchers and a particular study. However, using social media for recruiting clinical study participants also poses a range of ethical issues.

OBJECTIVE

This study aims to provide a comprehensive overview of the ethical benefits and risks to be considered for social media recruitment in clinical studies and develop practical recommendations on how to implement these considerations.

METHODS

On the basis of established principles of clinical ethics and research ethics, we reviewed the conceptual and empirical literature for ethical benefits and challenges related to social media recruitment. From these, we derived a conceptual framework to evaluate the eligibility of social media use for recruitment for a specific clinical study.

RESULTS

We identified three eligibility criteria for social media recruitment for clinical studies: information and consent, risks for target groups, and recruitment effectiveness. These criteria can be used to evaluate the implementation of a social media recruitment strategy at its planning stage. We have discussed the practical implications of these criteria for researchers.

CONCLUSIONS

The ethical challenges related to social media recruitment are context sensitive. Therefore, social media recruitment should be planned rigorously, taking into account the target group, the appropriateness of social media as a recruitment channel, and the resources available to execute the strategy.

Opportunities and Challenges for Decentralized Clinical Trials: European Regulators' Perspective

Decentralized clinical trials (DCTs) have the potential to improve accessibility, diversity, and retention in clinical trials by moving trial activities to participants’ homes and local surroundings. In this study, we conducted semi‐structured interviews with 20 European regulators to identify regulatory challenges and opportunities for the implementation of DCTs in the European Union. The key opportunities for DCTs that were recognized by regulators include a reduced participation burden, which could facilitate the participation of underserved patients. In addition, regulators indicated that data collected in DCTs are expected to be more representative of the real world. Key challenges recognized by regulators for DCTs include concerns regarding investigator oversight and participants’ safety when physical examinations and face‐to‐face contact are limited. To facilitate future learning, hybrid clinical trials with both on‐site and decentralized elements are proposed by the respondents.

Learning from COVID-19 related trial adaptations to inform efficient trial design-a sequential mixed methods study

BACKGROUND

Many clinical trial procedures were often undertaken in-person prior to the COVID-19 pandemic, which has resulted in adaptations to these procedures to enable trials to continue. The aim of this study was to understand whether the adaptations made to clinical trials by UK Clinical Trials Units (CTUs) during the pandemic have the potential to improve the efficiency of trials post-pandemic.

METHODS

This was a mixed methods study, initially involving an online survey administered to all registered UK CTUs to identify studies that had made adaptations due to the pandemic. Representatives from selected studies were qualitatively interviewed to explore the adaptations made and their potential to improve the efficiency of future trials. A literature review was undertaken to locate published evidence concerning the investigated adaptations. The findings from the interviews were reviewed by a group of CTU and patient representatives within a workshop, where discussions focused on the potential of the adaptations to improve the efficiency of future trials.

RESULTS

Forty studies were identified by the survey. Fourteen studies were selected and fifteen CTU staff were interviewed about the adaptations. The workshop included 15 CTU and 3 patient representatives. Adaptations were not seen as leading to direct efficiency savings for CTUs. However, three adaptations may have the potential to directly improve efficiencies for trial sites and participants beyond the pandemic: a split remote-first eligibility assessment, recruitment outside the NHS via a charity, and remote consent. There was a lack of published evidence to support the former two adaptations, however, remote consent is widely supported in the literature. Other identified adaptations may benefit by improving flexibility for the participant. Barriers to using these adaptations include the impact on scientific validity, limitations in the role of the CTU, and participant's access to technology.

CONCLUSIONS

Three adaptations (a split remote-first eligibility assessment, recruitment outside the NHS via a charity, and remote consent) have the potential to improve clinical trials but only one (remote consent) is supported by evidence. These adaptations could be tested in future co-ordinated 'studies within a trial' (SWAT).

Participant Experiences of a COVID-19 Virtual Clinical Study Using the Current Health Remote Monitoring Platform: A Case Study and Qualitative Analysis (Preprint)

Background

During the COVID-19 pandemic, individuals with a positive viral test were enrolled in a study, within 48 hours, to remotely monitor their vital signs to characterize disease progression and recovery. A virtual trial design was adopted to reduce risks to participants and the research community in a study titled Risk Stratification and Early Alerting Regarding COVID-19 Hospitalization (RiskSEARCH). The Food and Drug Administration–cleared Current Health platform with a wearable device is a continuous remote patient monitoring technology that supports hospital-at-home care and is used as a data collection tool. Enrolled participants wore the Current Health wearable device continuously for up to 30 days and took a daily symptom survey via a tablet that was provided. A qualitative substudy was conducted in parallel to better understand virtual trial implementation, including barriers and facilitators for participants.

Objective

This study aimed to understand the barriers and facilitators of the user experience of interacting with a virtual care platform and research team, while participating in a fully virtual study using qualitative and quantitative data.

Methods

Semistructured interviews were conducted to understand participants’ experience of participating in a virtual study during a global pandemic. The schedule included their experience of enrollment and their interactions with equipment and study staff. A total of 3 RiskSEARCH participants were interviewed over telephone, and transcriptions were inductively coded and analyzed using thematic analysis. Themes were mapped onto the Theoretical Domains Framework (TDF) to identify and describe the factors that influenced study adherence. Quantitative metrics, including adherence to wearable and scheduled tasks collected as part of the RiskSEARCH main study, were paired with the interviews to present an overall picture of participation.

Results

All participants exceeded our definition of a fully adherent participant and reported that participation was feasible and had a low burden. The symptoms progressively resolved during the trial. Inductive thematic analysis identified 13 main themes from the interview data, which were deductively mapped onto 11 of the 14 TDF domains, highlighting barriers and facilitators for each.

Conclusions

Participants in the RiskSEARCH substudy showed high levels of adherence and engagement throughout participation. Although participants experienced some challenges in setting up and maintaining the Current Health kit (eg, charging devices), they reported feeling that the requirements of participation were both reasonable and realistic. We demonstrated that the TDF can be used for inductive thematic analysis. We anticipate expanding this work in future virtual studies and trials to identify barriers and enabling factors for implementation.

Feasibility and Efficacy of Online Strategies to Recruit Parents of Children With Rheumatic Diseases for Research

Objective

We aimed to determine the feasibility and efficacy of online strategies to recruit parents of children with pediatric rheumatic diseases (PRDs) for research and to evaluate the degree to which known features of various rheumatic disease groups were present in the online cohort.

Methods

We studied two cohorts; the first was composed of respondents from a cross‐sectional parental survey of children with PRDs contacted through patient support groups and social media platforms, and the second cohort was composed of participants from the Childhood Arthritis and Rheumatology Research Alliance (CARRA) legacy clinical registry.

Results

In the social media cohort, 712 complete surveys were analyzed. Most (65.9%) were referred from Facebook. The most common rheumatic disease was juvenile idiopathic arthritis (JIA) (27.1%), followed by juvenile dermatomyositis (22.1%). In the CARRA registry cohort, 7985 records were included. JIA was the largest disease group (70.3%), followed by systemic lupus erythematosus (12.0%). The age at disease onset for most PRDs was similar between those in the social media and CARRA registry cohorts (mean difference = 1.3 years).

Conclusion

Recruitment through Facebook was the most fruitful. The clinical characteristics of the social media cohort were similar to those of patients recruited through a clinical registry, suggesting the utility of online recruitment for engaging disease‐relevant cohorts. Parents of children with rare PRDs were overrepresented in the social media cohort, perhaps reflecting the increased need of those parents to find online information and receive emotional support. Social media recruitment for research studies may help expand the number and diversity of participants in clinical research, especially by including those with rare diseases.

Eating disorder related research using Amazon Mechanical Turk (MTurk): Friend or foe?: Commentary on Burnette et al. (2021)

Burnette et al. reported a study that they sought to undertake to validate common eating disorder questionnaires in sexual and gender minorities. The researchers took advantage of the online recruitment platform Amazon Mechanical Turk (MTurk). Contrary to their expectations, the study proved not feasible due to invalid answering. Thus, Burnette et al. raise concerns against the trustworthiness of crowd-sourced data that may be undermined by financial interests and other kinds of motivations. Our commentary highlights the potential of the COVID-19 pandemic to inflate especially those intentions, which are monetary. Against the background of the COVID-19 pandemic, a further problem seems to be that the anonymity of online crowd sourcing platforms might tempt participants to provide inconsistent answers, possibly reflecting tendencies of reactance. The reported pattern of paradoxical responses in Burnette et al.'s work does not reflect malingering; rather we believe that the study might have served some participants as an outlet for negative emotions. We discuss mechanisms of quality control and highlight the lack of interpersonal interaction associated with online data collections.

Strategies for improving recruitment of pregnant women to clinical research: An evaluation of social media versus traditional offline methods

Objectives

To evaluate the recruitment of pregnant women for a clinical trial in Vancouver, Canada, via social media versus offline methods and to explore optimization of social media campaigns.

Methods

Facebook was used to run nine social media campaigns (15 weeks total, CA$675). Offline methods were used concurrently over 64 weeks (printing costs: CA$300). The cost, rate of recruitment and conversion rate in each group was calculated. Performance metrics of social media campaigns (reach, impressions, clicks, inquiries, enrolments) were recorded. Linear regression was used to explore the association between metrics and dollars spent per campaign.

Results

In total, n = 481 inquiries were received: n = 51 (11%) via offline methods and n = 430 (89%) via social media. Enrolees (n = 60 total) included n = 24 (40%) and n = 36 (60%) via offline and social media methods, respectively. Gestational weeks upon inquiry (n = 251; mean ± SD) were not different among groups (offline: 13.3 ± 4.7; social media: 13.2 ± 5.6). Direct cost per enrolee was CA$13 and CA$19 via offline and social media methods, respectively (however, this does not include cost of labour). The rate of recruitment was approximately six times faster via social media. However, the conversion rate was higher via offline methods than social media (47% vs. 8%). The amount spent per campaign was significantly associated with improved clicks and inquiries, but not enrolments.

Conclusions

Social media was more efficient and effective than offline methods. We gained numerous insights for optimization of social media campaigns (dollars spent, attribution setting, photo testing, automatic optimization) to increase clicks and inquiries, however, this does not necessarily increase enrolments, which was more dependent on study-specific factors (e.g. time of year, study design).

Conducting a pediatric randomized clinical trial during a pandemic: A shift to virtual procedures

Background/Objective

Prior to the COVID-19 pandemic, our research group initiated a pediatric practice-based randomized trial for the treatment of childhood obesity in rural communities. Approximately 6 weeks into the originally planned 10-week enrollment period, the trial was forced to pause all study activity due to the COVID-19 pandemic. This pause necessitated a substantial revision in recruitment, enrollment, and other study methods in order to complete the trial using virtual procedures. This descriptive paper outlines methods used to recruit, enroll, and manage clinical trial participants with technology to obtain informed consent, obtain height and weight measurements by video, and maintain participant engagement throughout the duration of the trial.

Methods

The study team reviewed the IRB records, protocol team meeting minutes and records, and surveyed the site teams to document the impact of the COVID-19 shift to virtual procedures on the study. The IRB approved study changes allowed for flexibility between clinical sites given variations in site resources, which was key to success of the implementation.

Results

All study sites faced a variety of logistical challenges unique to their location yet successfully recruited the required number of patients for the trial. Ultimately, virtual procedures enhanced our ability to establish relationships with participants who were previously beyond our reach, but presented several challenges and required additional resources.

Conclusion

Lessons learned from this study can assist other study groups in navigating challenges, especially when recruiting and implementing studies with rural and underserved populations or during challenging events like the pandemic.

A report from the NIHR UK working group on remote trial delivery for the COVID-19 pandemic and beyond

Background

Prior to the COVID-19 pandemic, the majority of clinical trial activity took place face to face within clinical or research units. The COVID-19 pandemic resulted in a significant shift towards trial delivery without in-person face-to-face contact or “Remote Trial Delivery”. The National Institute of Health Research (NIHR) assembled a Remote Trial Delivery Working Group to consider challenges and enablers to this major change in clinical trial delivery and to provide a toolkit for researchers to support the transition to remote delivery.

Methods

The NIHR Remote Trial Delivery Working Group evaluated five key domains of the trial delivery pathway: participant factors, recruitment, intervention delivery, outcome measurement and quality assurance. Independent surveys were disseminated to research professionals, and patients and carers, to ascertain benefits, challenges, pitfalls, enablers and examples of good practice in Remote Trial Delivery. A toolkit was constructed to support researchers, funders and governance structures in moving towards Remote Trial Delivery. The toolkit comprises a website encompassing the key principles of Remote Trial Delivery, and a repository of best practice examples and questions to guide research teams.

Results

The patient and carer survey received 47 respondents, 34 of whom were patients and 13 of whom were carers. The professional survey had 115 examples of remote trial delivery practice entered from across England. Key potential benefits included broader reach and inclusivity, the ability for standardisation and centralisation, and increased efficiency and patient/carer convenience. Challenges included the potential exclusion of participants lacking connectivity or digital skills, the lack of digitally skilled workforce and appropriate infrastructure, and validation requirements. Five key principles of Remote Trial Delivery were proposed: national research standards, inclusivity, validity, cost-effectiveness and evaluation of new methodologies.

Conclusions

The rapid changes towards Remote Trial Delivery catalysed by the COVID-19 pandemic could lead to sustained change in clinical trial delivery. The NIHR Remote Trial Delivery Working Group provide a toolkit for researchers recommending five key principles of Remote Trial Delivery and providing examples of enablers.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05880-8.

A/B design testing of a clinical trial recruitment website: A pilot study to enhance the enrollment of older adults

INTRODUCTION

Online tools are increasingly utilized in clinical trial recruitment. A/B testing is an effective technology used in political campaigns and commercial marketing to improve contributions or sales. However, to our knowledge, A/B has not been described in the context of clinical trial recruitment.

METHODS

Two A/B testing experiments were implemented on the recruitment website of the Study To Understand Fall Reduction and Vitamin D in You (STURDY), a response-adaptive, two-stage, randomized controlled trial. Commercial A/B platforms randomized web-users to different versions of the trial's website landing page; Experiment 1 included two infographic versions and Experiment 2 included three video versions. We compared web-user engagement metrics between each version and the original landing page. We determined the effect of each version compared to the original landing page on the likelihood of a web-user to (1) request more information about the trial, (2) complete a screening visit, or (3) enroll in the trial.

RESULTS

A total of 2605 and 374 web-users visited the trial's website during Experiment 1 and 2, respectively. Response to the online interest form significantly differed by infographic version in Experiment 1. The number of individuals who engaged with website content and pages significantly differed by video in Experiment 2.

CONCLUSION

In a pilot study implementing A/B testing of a clinical trial recruitment website, different versions of the website led to differences in web-user engagement and interest in the trial. A/B testing tools offer a promising approach to test the effectiveness of clinical trial recruitment materials and to optimize recruitment campaigns.

CLINICAL TRIAL REGISTRATION

This trial is registered at ClinicalTrials.gov. The trial registration number is NCT02166333. The URL is: https://clinicaltrials.gov/ct2/show/NCT02166333 Trial Registration Number: NCT02166333 Trial Register: ClinicalTrials.gov.