Recruitment & Retention in Remote Research: Learnings from a Large Decentralized Real-World Study (Preprint)

Strategies to Implement a Community-Based, Longitudinal Cohort Study: The Whole Communities-Whole Health Case Study

This paper discusses the implementation of the Whole Communities-Whole Health (WCWH) initiative, which is a community-based, longitudinal cohort study. WCWH seeks to better understand the impact of location on family health and child development while also providing support for families participating in the study. Implementing a longitudinal study that is both comprehensive in the data it is collecting and inclusive in the population it is representing is what makes WCWH extremely challenging. This paper highlights the learning process the initiative has gone through to identify effective strategies for implementing this type of research study and work toward building a new model for community-engaged research. Through iterative testing following the Plan-Do-Study-Act model, three main strategies for implementation were identified. These strategies are (1) creating a data collection schedule that balances participant burden and maintains temporality across data types; (2) facilitating multiple opportunities for qualitative and quantitative input from faculty, families, and nonparticipant community members; and (3) establishing an open-door policy for data analysis and interpretation. This paper serves as a guide and provides resources for other researchers wanting to implement a multidisciplinary and community-based cohort study.

A scoping review of remote and unsupervised digital cognitive assessments in preclinical Alzheimer's disease

Subtle cognitive changes in preclinical Alzheimer's disease (AD) are difficult to detect using traditional pen-and-paper neuropsychological assessments. Remote and unsupervised digital assessments can improve scalability, measurement reliability, and ecological validity, enabling the detection and monitoring of subtle cognitive change. Here, we evaluate such tools deployed in preclinical AD samples, defined as cognitively unimpaired individuals with abnormal levels of amyloid-β (Aβ), or Aβ and tau. In this scoping review, we screened 1,680 unique reports for studies using remote and unsupervised cognitive assessment tools in preclinical AD samples; 23 tools were found. We describe each tool's usability, validity, and reported metrics of reliability. Construct and criterion validity according to associations with established neuropsychological assessments and measures of Aβ and tau are reported. With this review, we aim to present a necessary update to a rapidly evolving field, following a previous review by Öhman and colleagues (2021; Alzheimers Dement. Diagn. Assess. Dis. Monit) and addressing the open questions of feasibility and reliability of remote testing in the target population. We discuss future directions for using remote and unsupervised digital cognitive assessments in preclinical AD and how such tools may be used for longitudinal monitoring of cognitive function, scalable case finding, and individualized prognostics in both clinical trials and healthcare contexts.

Value of Engagement in Digital Health Technology Research: Evidence Across 6 Unique Cohort Studies

BACKGROUND

Wearable digital health technologies and mobile apps (personal digital health technologies [DHTs]) hold great promise for transforming health research and care. However, engagement in personal DHT research is poor.

OBJECTIVE

The objective of this paper is to describe how participant engagement techniques and different study designs affect participant adherence, retention, and overall engagement in research involving personal DHTs.

METHODS

Quantitative and qualitative analysis of engagement factors are reported across 6 unique personal DHT research studies that adopted aspects of a participant-centric design. Study populations included (1) frontline health care workers; (2) a conception, pregnant, and postpartum population; (3) individuals with Crohn disease; (4) individuals with pancreatic cancer; (5) individuals with central nervous system tumors; and (6) families with a Li-Fraumeni syndrome affected member. All included studies involved the use of a study smartphone app that collected both daily and intermittent passive and active tasks, as well as using multiple wearable devices including smartwatches, smart rings, and smart scales. All studies included a variety of participant-centric engagement strategies centered on working with participants as co-designers and regular check-in phone calls to provide support over study participation. Overall retention, probability of staying in the study, and median adherence to study activities are reported.

RESULTS

The median proportion of participants retained in the study across the 6 studies was 77.2% (IQR 72.6%-88%). The probability of staying in the study stayed above 80% for all studies during the first month of study participation and stayed above 50% for the entire active study period across all studies. Median adherence to study activities varied by study population. Severely ill cancer populations and postpartum mothers showed the lowest adherence to personal DHT research tasks, largely the result of physical, mental, and situational barriers. Except for the cancer and postpartum populations, median adherences for the Oura smart ring, Garmin, and Apple smartwatches were over 80% and 90%, respectively. Median adherence to the scheduled check-in calls was high across all but one cohort (50%, IQR 20%-75%: low-engagement cohort). Median adherence to study-related activities in this low-engagement cohort was lower than in all other included studies.

CONCLUSIONS

Participant-centric engagement strategies aid in participant retention and maintain good adherence in some populations. Primary barriers to engagement were participant burden (task fatigue and inconvenience), physical, mental, and situational barriers (unable to complete tasks), and low perceived benefit (lack of understanding of the value of personal DHTs). More population-specific tailoring of personal DHT designs is needed so that these new tools can be perceived as personally valuable to the end user.

Impact of financial compensation on enrollment and participation in a remote, mobile-app based research study

Background

There is no consensus on how to determine appropriate financial compensation for research recruitment. Selecting incentive amounts that are reasonable and respectful, without undue inducement, remains challenging. Previously, we demonstrated that incentive amount significantly impacts participants' willingness to complete various hypothetical research activities. Here we further explore this relationship in a mock decentralized study.

Methods

Adult ResearchMatch volunteers were invited to join a prospective study where interested individuals were given an opportunity to view details for a study along with participation requirements, then offered a randomly generated compensation amount between $0 and $50 to enroll and participate. Individuals agreeing to participate were then asked to complete tasks using a remote mobile application (MyCap), for two weeks. Tasks included a weekly survey, a daily gratitude journal and daily phone tapping task.

Results

Willingness to participate was 85% across all incentive levels but not significantly impacted by amount. Task completion appeared to increase as a function of compensation until a plateau at $25. While participants described the study as low burden and reported that compensation was moderately important to their decision to join, only 31% completed all study tasks.

Conclusion

While offering compensation in this study did not have a strong effect on enrollment rate, this work provides insight into participant motivation when joining and participating in studies employing mobile applications.

Racial and ethnic differences in the degree of participation and retention in a decentralized cohort study of COVID-19 immunization in patients with inflammatory bowel diseases

Introduction

Disparities in the recruitment of minority populations in research are well-documented. However, the degree of participation and retention of minorities following enrollment is less known, particularly in decentralized studies. Although decentralized clinical research methods may allow researchers to engage broader study populations with less participation burden, they may present different retention challenges. To evaluate racial and ethnic differences in the degree of participation after enrollment in a decentralized study, we analyzed data from a cohort of patients with inflammatory bowel diseases following COVID-19 immunization.

Methods

We compared by race and ethnicity the following post-enrollment participation metrics: response to > 50% of follow-up surveys, donation of a blood sample for antibody testing, consent to use of bio samples for future research, and withdrawal prior to study completion.

Results

Overall, we observed higher levels of post-enrollment study participation among non-Hispanic White (NHW) participants as compared to Black or Hispanic participants: 95% of NHW participants completed follow-up versus 87% of Black participants and 91% of Hispanic participants, 73% of NHW participants provided bio samples versus 64% Black participants and 67% Hispanic participants, and 65% of NHW participants provided consent for future research versus 62% of Black participants and 52% of Hispanic participants.

Conclusions

Our findings demonstrate that the degree of study participation after enrollment in this decentralized study differed by race and ethnicity, indicating that attention to diversity, equity, and inclusion is needed not only in clinical research recruitment but also throughout study administration.

Feasibility study for a fully decentralized clinical trial in participants with functional constipation symptoms

Decentralized clinical trials (DCTs) leverage digital technologies to reduce dependency on study sites and intermediaries. DCT should be balanced with accessibility and data reliability while meeting regulatory requirements. Here, we conducted a pilot study for functional constipation symptoms to investigate the feasibility of DCT. The study was an open, fully remote, randomized clinical trial in participants who had functional constipation symptoms. Electronic consent was obtained remotely, and study volunteers were screened through web-based questionnaires. Subjects were randomized to either receive Lactobacillus and vitamin C supplements or vitamin C alone in a 1:1 ratio, which were delivered directly to subjects. Subjects kept track of bowel diaries daily during the 1-week baseline and 2-week treatment period using mobile applications. Bowel symptoms and the validity of the records were descriptively evaluated. A total of 30 subjects were randomized and completed the study. A total of 26.7% of subjects resided outside of the metropolitan area. Two-week Lactobacillus treatments increased the number of defecations (+0.80 vs. +0.46 times per week) and decreased the defecation time (-3.94 h vs. -1.62 h) compared to the comparator group. Overall, 67.1% of bowel diary records were completed in accordance with the schedule whereas 32.9% were not. Implementation of DCTs can facilitate geographic accessibility but should be guaranteed for data reliability. Prompt detection of errors and response using objective metrics would be required.

Rapid Web-Based Recruitment of Patients With Psoriasis: Multinational Cohort Study

BACKGROUND

Wide-ranging patient recruitment not restricted to the location of the investigator will provide a better representation of the patient population in clinical studies.

OBJECTIVE

Our goal was to assess the feasibility of a broad web-based recruitment strategy in an 8-week observational study of 500 study participants with psoriasis and healthy controls from locations remote from the investigator and to assess the cost associated with each participant.

METHODS

A decentralized team in Denmark recruited patients with psoriasis and healthy controls using Google and Facebook advertisements and posts to Facebook groups. All individuals were screened via the internet, and patients diagnosed with psoriasis were included. Questionnaires regarding itch and sleep were completed by both groups at inclusion, week 4, and week 8.

RESULTS

During a 2-week recruitment period, 12,887 unique advertisement views were registered, and 839 participants were enrolled, of which 507 completed the study (220 with psoriasis and 287 healthy controls) with a retention rate of 60.4%. Participants were recruited from 11 different countries on 4 separate continents, mainly from the United States, Canada, and the United Kingdom. The recruitment rate was 59.9 participants per day, and the conversion rate was 57.2%. Recruitment costs were US $13 per enrolled participant and US $22 per participant completing the study.

CONCLUSIONS

It is feasible and rapid to recruit a large number of participants from locations different from the investigator and to retain patients in an observational study with no visits to a clinical site at low costs.

Long-term participant retention and engagement patterns in an app and wearable-based multinational remote digital depression study

Recent growth in digital technologies has enabled the recruitment and monitoring of large and diverse populations in remote health studies. However, the generalizability of inference drawn from remotely collected health data could be severely impacted by uneven participant engagement and attrition over the course of the study. We report findings on long-term participant retention and engagement patterns in a large multinational observational digital study for depression containing active (surveys) and passive sensor data collected via Android smartphones, and Fitbit devices from 614 participants for up to 2 years. Majority of participants (67.6%) continued to remain engaged in the study after 43 weeks. Unsupervised clustering of participants' study apps and Fitbit usage data showed 3 distinct engagement subgroups for each data stream. We found: (i) the least engaged group had the highest depression severity (4 PHQ8 points higher) across all data streams; (ii) the least engaged group (completed 4 bi-weekly surveys) took significantly longer to respond to survey notifications (3.8 h more) and were 5 years younger compared to the most engaged group (completed 20 bi-weekly surveys); and (iii) a considerable proportion (44.6%) of the participants who stopped completing surveys after 8 weeks continued to share passive Fitbit data for significantly longer (average 42 weeks). Additionally, multivariate survival models showed participants' age, ownership and brand of smartphones, and recruitment sites to be associated with retention in the study. Together these findings could inform the design of future digital health studies to enable equitable and balanced data collection from diverse populations.