Evaluation of data completeness in the electronic health record for the purpose of patient recruitment into clinical trials: a retrospective analysis of element presence

BACKGROUND

Computerized clinical trial recruitment support is one promising field for the application of routine care data for clinical research. The primary task here is to compare the eligibility criteria defined in trial protocols with patient data contained in the electronic health record (EHR). To avoid the implementation of different patient definitions in multi-site trials, all participating research sites should use similar patient data from the EHR. Knowledge of the EHR data elements which are commonly available from most EHRs is required to be able to define a common set of criteria. The objective of this research is to determine for five tertiary care providers the extent of available data compared with the eligibility criteria of randomly selected clinical trials.

METHODS

Each participating study site selected three clinical trials at random. All eligibility criteria sentences were broken up into independent patient characteristics, which were then assigned to one of the 27 semantic categories for eligibility criteria developed by Luo et al. We report on the fraction of patient characteristics with corresponding structured data elements in the EHR and on the fraction of patients with available data for these elements. The completeness of EHR data for the purpose of patient recruitment is calculated for each semantic group.

RESULTS

351 eligibility criteria from 15 clinical trials contained 706 patient characteristics. In average, 55% of these characteristics could be documented in the EHR. Clinical data was available for 64% of all patients, if corresponding data elements were available. The total completeness of EHR data for recruitment purposes is 35%. The best performing semantic groups were 'age' (89%), 'gender' (89%), 'addictive behaviour' (74%), 'disease, symptom and sign' (64%) and 'organ or tissue status' (61%). No data was available for 6 semantic groups.

CONCLUSIONS

There exists a significant gap in structure and content between data documented during patient care and data required for patient eligibility assessment. Nevertheless, EHR data on age and gender of the patient, as well as selected information on his disease can be complete enough to allow for an effective support of the manual screening process with an intelligent preselection of patients and patient data.

Employing computers for the recruitment into clinical trials: a comprehensive systematic review

BACKGROUND

Medical progress depends on the evaluation of new diagnostic and therapeutic interventions within clinical trials. Clinical trial recruitment support systems (CTRSS) aim to improve the recruitment process in terms of effectiveness and efficiency.

OBJECTIVE

The goals were to (1) create an overview of all CTRSS reported until the end of 2013, (2) find and describe similarities in design, (3) theorize on the reasons for different approaches, and (4) examine whether projects were able to illustrate the impact of CTRSS.

METHODS

We searched PubMed titles, abstracts, and keywords for terms related to CTRSS research. Query results were classified according to clinical context, workflow integration, knowledge and data sources, reasoning algorithm, and outcome.

RESULTS

A total of 101 papers on 79 different systems were found. Most lacked details in one or more categories. There were 3 different CTRSS that dominated: (1) systems for the retrospective identification of trial participants based on existing clinical data, typically through Structured Query Language (SQL) queries on relational databases, (2) systems that monitored the appearance of a key event of an existing health information technology component in which the occurrence of the event caused a comprehensive eligibility test for a patient or was directly communicated to the researcher, and (3) independent systems that required a user to enter patient data into an interface to trigger an eligibility assessment. Although the treating physician was required to act for the patient in older systems, it is now becoming increasingly popular to offer this possibility directly to the patient.

CONCLUSIONS

Many CTRSS are designed to fit the existing infrastructure of a clinical care provider or the particularities of a trial. We conclude that the success of a CTRSS depends more on its successful workflow integration than on sophisticated reasoning and data processing algorithms. Furthermore, some of the most recent literature suggest that an increase in recruited patients and improvements in recruitment efficiency can be expected, although the former will depend on the error rate of the recruitment process being replaced. Finally, to increase the quality of future CTRSS reports, we propose a checklist of items that should be included.

Using Facebook for Large-Scale Online Randomized Clinical Trial Recruitment: Effective Advertising Strategies

Targeted Facebook advertising can be an effective strategy to recruit participants for a large-scale online study. Facebook advertising is useful for reaching people in a wide geographic area, matching a specific demographic profile. It can also target people who would be unlikely to search for the information and would thus not be accessible via Google AdWords. It is especially useful when it is desirable not to raise awareness of the study in a demographic group that would be ineligible for the study. This paper describes the use of Facebook advertising to recruit and enroll 1145 women over a 15-month period for a randomized clinical trial to teach support skills to female partners of male smokeless tobacco users. This tutorial shares our study team's experiences, lessons learned, and recommendations to help researchers design Facebook advertising campaigns. Topics covered include designing the study infrastructure to optimize recruitment and enrollment tracking, creating a Facebook presence via a fan page, designing ads that attract potential participants while meeting Facebook's strict requirements, and planning and managing an advertising campaign that accommodates the rapid rate of diminishing returns for each ad.

Using Facebook Advertising to Recruit Representative Samples: Feasibility Assessment of a Cross-Sectional Survey

Background

Facebook has shown promise as an economical means of recruiting participants for health research. However, few studies have evaluated this recruitment method in Canada, fewer still targeting older adults, and, to our knowledge, none specifically in Newfoundland and Labrador (NL).

Objective

This study aimed to assess Facebook advertising as an economical means of recruiting a representative sample of adults aged 35 to 74 years in NL for a cross-sectional health survey.

Methods

Facebook advertising was used to recruit for a Web-based survey on cancer awareness and prevention during April and May 2018; during recruitment, additional advertisements were targeted to increase representation of demographics that we identified as being underrepresented in our sample. Sociodemographic and health characteristics of the study sample were compared with distributions of the underlying population to determine representativeness. Cramer V indicates the magnitude of the difference between the sample and population distributions, interpreted as small (Cramer V=0.10), medium (0.30), and large (0.50). Sample characteristics were considered representative if there was no statistically significant difference in distributions (chi-square P>.01) or if the difference was small (V≤0.10), and practically representative if 0.10<V≤0.20. The cost per recruit of Facebook advertising was compared with a quote for a random digit dialing (RDD)–recruited postal survey to determine if this method was economical.

Results

Facebook advertising is feasible and economical to conduct survey research, reaching 34,012 people, of which 2067 clicked on the ad, for a final sample size of 1048 people at Can $2.18 per recruit versus the quoted Can $23,316.05 for 400 recruits (Can $35.52 per recruit) via RDD. The sample was representative of rural and urban geography (P=.02; V=0.073), practically representative of age (P=.003; V=0.145) and income (P<.001; V=0.188), and over-representative of women (P<.001; V=0.507) and higher levels of education (P<.001; V=0.488). The sample was representative of the proportion of people with a regular health care provider (P=.94; V=0.025), diabetes prevalence (P=.002; V=0.096), and having had a colonoscopy or sigmoidoscopy (P=.27; V=0.034), and it was practically representative of smoking status (P<.001; V=0.14), and body mass index (P<.001; V=0.135). The sample was not representative of arthritis prevalence (P<.001; V=0.573), perceived health (P<.001; V=0.384), or time since last seasonal flu shot (P<.001; V=0.449).

Conclusions

Facebook advertising offers an easy, rapid, and economical means to recruit a partially representative (representative or practically representative of 8 of the 13 characteristics studied) sample of middle-aged and older adults for health survey research. As Facebook uses a nonrandom targeting algorithm, caution is warranted in its applications for certain types of research.

The Use of Facebook Advertising to Recruit Healthy Elderly People for a Clinical Trial: Baseline Metrics

Background

This report provides data on the use of social media advertising as a clinical trial recruitment strategy targeting healthy volunteers aged 60 years and older. The social media advertising campaign focused on enrollment for a Phase 1 clinical trial. Traditional means of recruiting—billboards, newspaper advertising, word of mouth, personal referrals, and direct mail—were not producing enough qualified participants.

Objective

To demonstrate the effectiveness of using targeted advertising on the social networking site Facebook to recruit people aged 60 years and older for volunteer clinical trial participation.

Methods

The trial sponsor used a proactive approach to recruit participants using advertising on social media. The sponsor placed and monitored an Institutional Review Board-approved advertising campaign on Facebook to recruit potential candidates for a Phase 1 clinical trial. The clinical trial required a 10-day residential (overnight) stay at a clinic in Michigan, with one follow-up visit. The sponsor of the clinical trial placed the advertising, which directed interested respondents to a trial-specific landing page controlled by the Contract Research Organization (CRO). The CRO provided all follow-up consenting, prescreening, screening, and enrollment procedures. The campaign was waged over an 8-week period to supplement recruiting by the CRO.

Results

A total of 621 people responded to a Facebook advertising campaign by completing an online form or telephoning the CRO, and the clinical trial was fully enrolled at 45 subjects following an 8-week Facebook advertising campaign.

Conclusions

An 8-week Facebook advertising campaign contributed to 868 inquiries made regarding a Phase 1 clinical trial seeking to enroll healthy elderly subjects. Over the initial 11 weeks of recruitment, 178 inquiries were received using traditional methods of outreach. Respondents to the Facebook advertising campaign described in this report engaged with the sponsored advertising at a higher rate than is typical for social media-based clinical trial recruitment strategies. The older adults’ engagement rate of 4.92% was more than twice as high as click-through rates of younger adults engaged with social media advertising in other clinical trial recruitment studies. Advertising placed on the social media platform Facebook is effective with the healthy volunteer population aged 60 years and older. This approach can quickly and cost-effectively reach qualified candidates for clinical trial recruitment as a supplement to traditional means of recruiting.

Trial Registration

ClinicalTrials.gov: NCT02840279; https://clinicaltrials.gov/ct2/show/NCT02840279 (Archived by WebCite at http://www.webcitation.org/6wamIWXAt)

Using Paid and Free Facebook Methods to Recruit Australian Parents to an Online Survey: An Evaluation

Background

The prevalence of social media makes it a potential alternative to traditional offline methods of recruiting and engaging participants in health research. Despite burgeoning use and interest, few studies have rigorously evaluated its effectiveness and feasibility in terms of recruitment rates and costs, sample representativeness, and retention.

Objective

This study aimed to determine the feasibility of using Facebook to recruit employed Australian parents to an online survey about managing work and family demands, specifically to examine (1) recruitment rates and costs; (2) sample representativeness, compared with a population-based cohort of parents; and (3) retention, including demographic and health characteristics of parents who returned to complete a follow-up survey 6 weeks later.

Methods

Recruitment was conducted using 20 paid Facebook advertising campaigns, supplemented with free advertising approaches such as posts on relevant Facebook pages and requests for professional networks to circulate the survey link via Facebook. Recruitment rates and costs were evaluated using the Checklist for Reporting Results of Internet E-Surveys, including view rate, participation rate, completion rate, cost per consent, and cost per completer. Sample representativeness was evaluated by comparing demographic and outcome variables with a comparable sample from the Longitudinal Study of Australian Children including educational attainment, marital status, country of birth, neighborhood disadvantage, work-family conflict, and psychological distress. Retention was evaluated by comparing the number and demographic characteristics of participants at recruitment and at 6-week follow-up.

Results

Recruitment strategies together resulted in 6653 clicks on the survey link, from which 5378 parents consented to participate and 4665 (86.74%) completed the survey. Of those who completed the survey, 85.94% (4009/4665) agreed to be recontacted, with 57.79% (2317/4009) completing the follow-up survey (ie, 43.08% [2317/5378] of parents who consented to the initial survey). Paid Facebook advertising recruited nearly 75% of the sample at Aus $2.32 per completed survey (Aus $7969 spent, 3440 surveys completed). Compared with a population-based sample, participants at baseline were more likely to be university educated (P<.001), experience greater work-family conflict (P<.001) and psychological distress (P<.001), and were less likely to be born outside Australia (P<.001) or live in a disadvantaged neighborhood (P<.001).

Conclusions

Facebook provided a feasible, rapid method to recruit a large national sample of parents for health research. However, some sample biases were observed and should be considered when recruiting participants via Facebook. Retention of participants at 6- to 8-week follow-up was less than half the initial sample; this may reflect limited ongoing participant engagement for those recruited through social media, compared with face-to-face.

A systematic review of strategies used to increase recruitment of people with cancer or organ failure into clinical trials: implications for palliative care research

CONTEXT

The challenges of palliative care clinical trial recruitment are well documented.

OBJECTIVES

The aim of the study was to review tested strategies to improve recruitment to trials of people with a range of conditions who may access palliative care services but are not explicitly stated to be "palliative."

METHODS

This was a systematic review with narrative description. The Cochrane, Embase, PubMed, PsycINFO, and CINAHL electronic databases were searched (English; January 2002 to February 2014) for quasi-experimental and randomized controlled trials (RCTs) testing the effect of recruitment strategies on accrual to clinical trials of people with organ failure and cancer. Titles, abstracts, and retrieved articles were screened by two researchers and categorized by recruitment challenge: 1) patients with reduced cognition, 2) those requiring emergency treatment, and 3) willingness of patients and clinical staff to contribute to trials.

RESULTS

Of 549 articles identified, 15 were included. Thirteen reported RCTs and two papers reported three quasi-experimental studies. Five were cluster RCTs of recruiting sites/institutions. One was a randomized cluster, crossover, feasibility study. Seven studies recruited patients with cancer. Others included patients with dementia, stroke, cardiovascular disease, diabetes, frail elderly, and bereaved carers. Some interventions improved recruitment: memory aid, contact before arrival, cluster consent, "opt out" consent. Others either reduced recruitment (formal mental capacity assessment) or made no difference (advance research directive; a variety of educational, supportive, and advertising interventions).

CONCLUSION

Successful strategies from other disciplines could be considered by palliative care researchers. Tailored, efficient, evidence-based strategies must be developed, acknowledging that strategies with face validity are not necessarily the most effective.

A successful approach to minimizing attrition in racial/ethnic minority, low-income populations

BACKGROUND

Recruiting and retaining minority participants in clinical trials continue to be major challenges. Although multiple studies document lower minority trial enrollment, much less is known about effective minority retention strategies. Our objectives were to evaluate an innovative approach to high RCT retention of minority children, and identify child/caregiver characteristics predicting attrition.

METHODS

The Kids' HELP trial examined the effects of Parent Mentors on insuring uninsured minority children. We tested a retention strategic framework consisting of: 1) optimizing cultural/linguistic competency; 2) staff training on participant relationships and trust; 3) comprehensive participant contact information; 4) an electronic tracking database; 5) reminders for upcoming outcomes-assessment appointments; 6) frequent, sustained contact attempts for non-respondents; 7) financial incentives; 8) individualized rapid-cycle quality-improvement approaches to non-respondents; 9) reinforcing study importance; and 10) home assessment visits. We compared attrition in Kids' HELP vs. two previous RCTs in similar populations, and conducted bivariate and multivariable analyses of factors associated with Kids' HELP attrition.

RESULTS

Attrition in Kids' HELP was lower than in two similar RCTs, at 10.9% vs. 37% and 40% (P <0.001). After multivariable adjustment, missing the first outcomes follow-up assessment was the only factor significantly associated with attrition (relative risk=1.5; 95% confidence interval, 1.1-2.0).

CONCLUSIONS

A retention strategic framework was successful in minimizing attrition in minority, low-income children. Participants missing first assessment appointments were at highest risk of subsequent attrition. These findings suggest that deploying this framework may help RCT retention of low-income minority children, particularly those at the highest risk of subsequent attrition.

Impact of Recruitment Methods in Subjective Cognitive Decline

BACKGROUND

Recruitment methods can determine sample characteristics in mild cognitive impairment and Alzheimer's disease dementia, but little is known about its influence in subjective cognitive decline (SCD).

OBJECTIVE

To determine the influence of two types of recruitment methods in the characteristics of individuals with SCD.

METHODS

We select and compare clinical and neuropsychological features, and frequency of APOE ɛ4 allele of 326 subjects with SCD from two cohorts: Open House Initiative (OHI) versus Memory Unit (MU). A logistic regression analysis (LRA), using gender and years of education as covariates, was used to examine the neuropsychological variables.

RESULTS

The OHI sample were mostly women (75.9% versus 64.5%, p < 0.05), with higher educational level (12.15 [3.71] versus 10.70 [3.80] years, p = 0.001), and more family history of dementia (138 [62.7%] versus 44 [41.5%], p < 0.001) than the MU sample. Also, the OHI sample showed better overall neuropsychological performance than the MU sample, and after a LRA, this trend continued in automatic response inhibition capacity, abstract reasoning, and recognition memory. We did not find differences in age, depression history, and/or APOE ɛ4 allele frequency.

CONCLUSION

SCD subjects showed different demographic and neuropsychological characteristics depending on the recruitment method, which should be taken into account in the design of research studies with this target population.

Keywords to recruit Spanish- and English-speaking participants: evidence from an online postpartum depression randomized controlled trial

Background

One of the advantages of Internet-based research is the ability to efficiently recruit large, diverse samples of international participants. Currently, there is a dearth of information on the behind-the-scenes process to setting up successful online recruitment tools.

Objective

The objective of the study was to examine the comparative impact of Spanish- and English-language keywords for a Google AdWords campaign to recruit pregnant women to an Internet intervention and to describe the characteristics of those who enrolled in the trial.

Methods

Spanish- and English-language Google AdWords campaigns were created to advertise and recruit pregnant women to a Web-based randomized controlled trial for the prevention of postpartum depression, the Mothers and Babies/Mamás y Bebés Internet Project. Search engine users who clicked on the ads in response to keyword queries (eg, pregnancy, depression and pregnancy) were directed to the fully automated study website. Data on the performance of keywords associated with each Google ad reflect Web user queries from February 2009 to June 2012. Demographic information, self-reported depression symptom scores, major depressive episode status, and Internet use data were collected from enrolled participants before randomization in the intervention study.

Results

The Google ads received high exposure (12,983,196 impressions) and interest (176,295 clicks) from a global sample of Web users; 6745 pregnant women consented to participate and 2575 completed enrollment in the intervention study. Keywords that were descriptive of pregnancy and distress or pregnancy and health resulted in higher consent and enrollment rates (ie, high-performing ads). In both languages, broad keywords (eg, pregnancy) had the highest exposure, more consented participants, and greatest cost per consent (up to US $25.77 per consent). The online ads recruited a predominantly Spanish-speaking sample from Latin America of Mestizo racial identity. The English-speaking sample was also diverse with most participants residing in regions of Asia and Africa. Spanish-speaking participants were significantly more likely to be of Latino ethnic background, not married, completed fewer years of formal education, and were more likely to have accessed the Internet for depression information (P<.001).

Conclusions

The Internet is an effective method for reaching an international sample of pregnant women interested in online interventions to manage changes in their mood during the perinatal period. To increase efficiency, Internet advertisements need to be monitored and tailored to reflect the target population’s conceptualization of health issues being studied.

Trial Registration

ClinicalTrials.gov NCT00816725; http://clinicaltrials.gov/show/NCT00816725 (Archived by WebCite at http://www.webcitation.org/6LumonjZP).

Conducting research with end-of-life populations: overcoming recruitment challenges when working with clinical agencies

Conducting end-of-life (EOL) research can present numerous challenges associated with recruitment and retention of research subjects. Such issues may result from working with a variety of clinical settings or the uniqueness of the patient population. The purposes of this article were to describe recruitment challenges in EOL research when collaborating with different types of clinical agencies and to discuss strategies that are being used to overcome these recruitment issues.

Enhancing Hispanic participation in mental health clinical research: development of a Spanish-speaking depression research site

BACKGROUND

Hispanics, particularly those with limited English proficiency, are underrepresented in psychiatric clinical research studies. We developed a bilingual and bicultural research clinic dedicated to the recruitment and treatment of Spanish-speaking subjects in the Predictors of Remission in Depression to Individual and Combined Treatments (PReDICT) study, a large clinical trial of treatment-naïve subjects with major depressive disorder (MDD).

METHODS

Demographic and clinical data derived from screening evaluations of the first 1,174 subjects presenting for participation were compared between the Spanish-speaking site (N = 275) and the primary English-speaking site (N = 899). Reasons for ineligibility (N = 888) for the PReDICT study were tallied for each site.

RESULTS

Compared to English speakers, Spanish speakers had a lower level of education and were more likely to be female, uninsured, and have uncontrolled medical conditions. Clinically, Spanish speakers demonstrated greater depression severity, with higher mean symptom severity scores, and a greater number of previous suicide attempts. Among the subjects who were not randomized into the PReDICT study, Spanish-speaking subjects were more likely to have an uncontrolled medical condition or refuse participation, whereas English-speaking subjects were more likely to have bipolar disorder or a non-MDD depressive disorder.

CONCLUSION

Recruitment of Hispanic subjects with MDD is feasible and may enhance efforts at signal detection, given the higher severity of depression among Spanish-speaking participants presenting for clinical trials. Specific approaches for the recruitment and retention of Spanish-speaking participants are required.

Exploring the Utility of Web-Based Social Media Advertising to Recruit Adult Heavy-Drinking Smokers for Treatment

Background

Identifying novel ways to recruit smokers for treatment studies is important. In particular, certain subgroups of adult smokers, such as heavy-drinking smokers, are at increased risk for serious medical problems and are less likely to try quitting smoking, so drawing this hard-to-reach population into treatment is important for improving health outcomes.

Objective

This study examined the utility of Facebook advertisements to recruit smokers and heavy-drinking smokers for treatment research and evaluated smoking and alcohol use and current treatment goals among those who responded to the Web-based survey.

Methods

Using Facebook’s advertising program, 3 separate advertisements ran for 2 months targeting smokers who were thinking about quitting. Advertisements were shown to adult (at least 18 years of age), English-speaking Facebook users in the greater New Haven, Connecticut, area. Participants were invited to complete a Web-based survey to determine initial eligibility for a smoking cessation research study.

Results

Advertisements generated 1781 clicks and 272 valid, completed surveys in 2 months, with one advertisement generating the most interest. Facebook advertising was highly cost-effective, averaging $0.27 per click, $1.76 per completed survey, and $4.37 per participant meeting initial screening eligibility. On average, those who completed the Web-based survey were 36.8 (SD 10.4) years old, and 65.8% (179/272) were female. Advertisements were successful in reaching smokers; all respondents reported daily smoking (mean 16.2 [SD 7.0] cigarettes per day). The majority of smokers (254/272, 93.4%) were interested in changing their smoking behavior immediately. Many smokers (161/272, 59.2%) also reported heavy alcohol consumption at least once a month. Among smokers interested in reducing their alcohol use, more were heavy drinkers (45/56, 80.4%) compared to non-heavy drinkers (11/56, 19.6%; χ²[_1,N=272]=13.0, P<.001). Of those who met initial screening eligibility from the Web-based survey, 12.7% (14/110) attended an in-person follow-up appointment.

Conclusions

Social media advertisements designed to target smokers were cost-effective and successful for reaching adult smokers interested in treatment. Additionally, recruiting for smokers reached those who also drink alcohol heavily, many of whom were interested in changing this behavior as well. However, additional social media strategies may be needed to engage individuals into treatment after completion of Web-based screening surveys.

Selectively willing and conditionally able: HIV vaccine trial participation among women at "high risk" of HIV infection

Efficacy studies of investigational HIV vaccines require enrollment of individuals at 'high risk' for HIV. This paper examines participation in HIV vaccine trials among women at 'high risk' for HIV acquisition. In-depth interviews were conducted with 17 African-American women who use crack cocaine and/or exchange sex for money/drugs to elicit attitudes toward medical research and motivators and deterrents to HIV vaccine trial participation. Interviews were digitally recorded and transcribed; data were coded and compiled into themes. Most women expressed favorable attitudes toward medical research in general. Motivators for trial participation included compensation; personal benefits including information, social services, and the possibility that the trial vaccine could prevent HIV; and altruism. Deterrents included: dislike of needles; distrust; concern about future consequences of participating. In addition, contingencies, care-giving responsibilities, and convenience issues constituted barriers which could impede participation. Respondents described varied, complex perspectives, and individual cases illustrate how these themes played out as women contemplated trial participation. Understanding factors which influence vaccine research participation among women at 'high risk' can aid sites to tailor recruitment procedures to local contexts. Concerns about future reactions can be addressed through sustained community education. Convenience barriers can be ameliorated by providing rides to study visits when necessary, and/or conducting study visits in accessible neighborhood locations. Women in this sample thought carefully about enrolling in HIV vaccine trials given the structural constraints within which they lived. Further research is needed regarding structural factors which influence personal agency and individuals' thinking about research participation.

Factors associated with participation in cancer prevention and control studies among rural Appalachian women

Rural Appalachian women bear a disproportionate burden from many types of cancer yet often are underrepresented in cancer research. This article uses 2 case studies to illustrate barriers faced and strategies used when recruiting hard-to-reach rural participants. Recruitment barriers include the population's competing demands and lack of trust of outsiders. Strategies employed include involving insider advocates, highlighting the positive experiences of early participants, spending extensive time in the community, and emphasizing potential community benefits of the study. We suggest recruitment strategies to better involve rural women and others who, by virtue of being "hard-to-reach," often are overlooked.

Experience With Direct-to-Patient Recruitment for Enrollment Into a Clinical Trial in a Rare Disease: A Web-Based Study

Background

The target sample size for clinical trials often necessitates a multicenter (center of excellence, CoE) approach with associated added complexity, cost, and regulatory requirements. Alternative recruitment strategies need to be tested against this standard model.

Objectives

The aim of our study was to test whether a Web-based direct recruitment approach (patient-centric, PC) using social marketing strategies provides a viable option to the CoE recruitment method.

Methods

PC recruitment and Web-based informed consent was compared with CoE recruitment for a randomized controlled trial (RCT) of continuing versus stopping low-dose prednisone for maintenance of remission of patients with granulomatosis with polyangiitis (GPA).

Results

The PC approach was not as successful as the CoE approach. Enrollment of those confirmed eligible by their physician was 10 of 13 (77%) and 49 of 51 (96%) in the PC and CoE arms, respectively (P=.05). The two approaches were not significantly different in terms of eligibility with 34% of potential participants in the CoE found to be ineligible as compared with 22% in the PC arm (P=.11) nor in provider acceptance, 22% versus 26% (P=.78). There was no difference in the understanding of the trial as reflected in the knowledge surveys of individuals in the PC and CoE arms.

Conclusions

PC recruitment was substantially less successful than that achieved by the CoE approach. However, the PC approach was good at confirming eligibility and was as acceptable to providers and as understandable to patients as the CoE approach. The PC approach should be evaluated in other clinical settings to get a better sense of its potential.

Attitudes and beliefs toward biobehavioural research participation: voices and concerns of urban adolescent females receiving outpatient mental health treatment

BACKGROUND

Biobehavioural research methodology can be invasive and burdensome for participants - particularly adolescents with mental illnesses. Human biological researchers should consider how methodological impositions may hinder adolescent research participation. However, literature on adolescent's voices and concerns toward biobehavioural research participation is virtually non-existent.

AIM

This study was designed to determine adolescents' perceptions of participation in research involving the collection of biomarkers via blood, saliva and/or urine samples.

SUBJECTS AND METHODS

Urban adolescent females (aged 12-19) receiving outpatient mental health treatment (n = 37) participated in focus groups with concurrent survey administration to explore attitudes, beliefs and willingness/intentions toward biobehavioural research participation.

RESULTS

Participants had favourable attitudes toward biobehavioural research and were amenable to provide each specimen type. Mistrust for research emerged, however, and concerns related to privacy and confidentiality were expressed.

CONCLUSION

Participant recruitment is a critical component in study design and implementation; this includes knowledge of population-specific recruitment barriers and facilitators. This innovative paper provides a context for the research participants' decision-making process, strategies to allay fears and concerns and concrete areas to target in research-related interventions. Although the findings are from a specific, US-based sample, the implications warrant replication of the research in other geosocial settings.

Facilitators, Challenges, and Messaging Strategies for Hispanic/Latino Populations Participating in Alzheimer's Disease and Related Dementias Clinical Research: A Literature Review

Alzheimer's disease and Alzheimer's disease-related dementias (AD/ADRD) disproportionally affect Hispanic and Latino populations, yet Hispanics/Latinos are substantially underrepresented in AD/ADRD clinical research. Diverse inclusion in trials is an ethical and scientific imperative, as underrepresentation reduces the ability to generalize study findings and treatments across populations most affected by a disease. This paper presents findings from a narrative literature review (N = 210) of the current landscape of Hispanic/Latino participation in clinical research, including the challenges, facilitators, and communication channels to conduct culturally appropriate outreach efforts to increase awareness and participation of Hispanics/Latinos in AD/ADRD clinical research studies. Many challenges identified were systemic in nature: lack of culturally relevant resources; staffing that does not represent participants' cultures/language; eligibility criteria that disproportionately excludes Hispanics/Latinos; and too few studies available in Hispanic/Latino communities. The paper also details facilitators and messaging strategies to improve engagement and interest among Hispanics/Latinos in AD/ADRD research, starting with approaches that recognize and address the heterogeneity of the Hispanic/Latino ethnicity, and then, tailor outreach activities and programs to address their diverse needs and circumstances. The needs identified in this article represent longstanding failures to improve engagement and interest among Hispanics/Latinos in AD/ADRD research; we discuss how the field can move forward learning from the experiences of the COVID-19 pandemic.

An Evaluation of Web- and Print-Based Methods to Attract People to a Physical Activity Intervention

Background

Cost-effective and efficient methods to attract people to Web-based health behavior interventions need to be identified. Traditional print methods including leaflets, posters, and newspaper advertisements remain popular despite the expanding range of Web-based advertising options that have the potential to reach larger numbers at lower cost.

Objective

This study evaluated the effectiveness of multiple Web-based and print-based methods to attract people to a Web-based physical activity intervention.

Methods

A range of print-based (newspaper advertisements, newspaper articles, letterboxing, leaflets, and posters) and Web-based (Facebook advertisements, Google AdWords, and community calendars) methods were applied to attract participants to a Web-based physical activity intervention in Australia. The time investment, cost, number of first time website visits, the number of completed sign-up questionnaires, and the demographics of participants were recorded for each advertising method.

Results

A total of 278 people signed up to participate in the physical activity program. Of the print-based methods, newspaper advertisements totaled AUD $145, letterboxing AUD $135, leaflets AUD $66, posters AUD $52, and newspaper article AUD $3 per sign-up. Of the Web-based methods, Google AdWords totaled AUD $495, non-targeted Facebook advertisements AUD $68, targeted Facebook advertisements AUD $42, and community calendars AUD $12 per sign-up. Although the newspaper article and community calendars cost the least per sign-up, they resulted in only 17 and 6 sign-ups respectively. The targeted Facebook advertisements were the next most cost-effective method and reached a large number of sign-ups (n=184). The newspaper article and the targeted Facebook advertisements required the lowest time investment per sign-up (5 and 7 minutes respectively). People reached through the targeted Facebook advertisements were on average older (60 years vs 50 years, P<.001) and had a higher body mass index (32 vs 30, P<.05) than people reached through the other methods.

Conclusions

Overall, our results demonstrate that targeted Facebook advertising is the most cost-effective and efficient method at attracting moderate numbers to physical activity interventions in comparison to the other methods tested. Newspaper advertisements, letterboxing, and Google AdWords were not effective. The community calendars and newspaper articles may be effective for small community interventions.

ClinicalTrial

Australian New Zealand Clinical Trials Registry: ACTRN12614000339651; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=363570&isReview=true (Archived by WebCite at http://www.webcitation.org/6hMnFTvBt)

Impact of seasonality on recruitment, retention, adherence, and outcomes in a web-based smoking cessation intervention: randomized controlled trial

Background

Seasonal variations in smoking and quitting behaviors have been documented, with many smokers seeking cessation assistance around the start of the New Year. What remains unknown is whether smokers who are recruited to cessation treatment trials during the New Year are as motivated to quit, or as likely to enroll in a research trial, adhere to a research protocol, and benefit from a cessation intervention compared to those who are recruited during other times of the year.

Objective

The objective of this study was to determine whether smokers recruited during the New Year period differ on measures of motivation and desire to quit, recruitment and retention rates, website utilization rates, and short-term cessation outcomes compared to smokers recruited at other times.

Methods

Participants were current smokers who had registered on a free Web-based cessation program (BecomeAnEX.org) and were invited to participate in a clinical trial. The New Year period was defined according to a clear peak and drop in the proportion of visitors who registered on the site, spanning a 15-day period from December 26, 2012 to January 9, 2013. Two other 15-day recruitment periods during summer (July 18, 2012 to August 1, 2012) and fall (November 7, 2012 to November 21, 2012) were selected for comparison. Data were examined from 3 sources: (1) a Web-based clinical trials management system that automated the recruitment and enrollment process, (2) self-report assessments at baseline and 3 months postrandomization, and (3) online tracking software that recorded website utilization during the first 3 months of the trial.

Results

Visitors to BecomeAnEX during the New Year period were more likely to register on the site than smokers who visited during summer or fall (conversion rates: 7.4%, 4.6%, 4.9%, respectively; P<.001), but there were no differences in rates of study acceptance, consent, randomization, 3-month follow-up survey completion, or cessation between the 3 periods. New Year participants were older, more educated, more likely to be employed full time, and more likely to have a relationship partner compared with participants recruited at other times during the year, but did not differ on measures of motivation and desire to quit.

Conclusions

Smokers visiting a Web-based cessation program during the New Year period were more likely to register for treatment and differ on several demographic variables, but showed similar patterns of treatment engagement, retention, follow-up, and short-term cessation outcomes compared with participants who visited the site during other periods of the year. These results allay scientific concerns about recruiting participants during this time frame and are reassuring for researchers conducting Web-based cessation trials.

Trial Registration

ClinicalTrials.gov ID: NCT01544153; http://clinicaltrials.gov/ct2/show/NCT01544153 (Archived by WebCite at http://www.webcitation.org/6KjhmAS9u).

Factors Associated with Lumbar Puncture Participation in Alzheimer's Disease Research

BACKGROUND

Cerebrospinal fluid (CSF) provides insight into the spectrum of Alzheimer's disease (AD) pathology. While lumbar punctures (LPs) for CSF collection are generally considered safe procedures, many participants remain hesitant to participate in research involving LPs.

OBJECTIVE

To explore factors associated with participant willingness to undergo a research LP at baseline and follow-up research study visit.

METHODS

We analyzed data from 700 participants with varying cognition (unimpaired, mild cognitive impairment, and dementia) in the Wisconsin Alzheimer's Disease Research Center. We evaluated the relationship of demographic variables (age, sex, race, ethnicity, and years of education) and clinical variables (waist-to-hip ratio, body mass index, AD parental history, cognitive diagnosis) on decision to undergo baseline LP1. We evaluated the relationship of prior LP1 experience (procedure success and adverse events) with the decision to undergo follow-up LP2. The strongest predictors were incorporated into regression models.

RESULTS

Over half of eligible participants opted into both baseline and follow-up LP. Participants who underwent LP1 had higher mean education than those who declined (p = 0.020). White participants were more likely to choose to undergo LP1 (p < 0.001); 33% of African American participants opted in compared to 65% of white participants. Controlling for age, education, and AD parental history, race was the only significant predictor for LP1 participation. Controlling for LP1 mild adverse events, successful LP1 predicted LP2 participation.

CONCLUSION

Race was the most important predictor of baseline LP participation, and successful prior LP was the most important predictor of follow-up LP participation.

Performance, Cost-Effectiveness, and Representativeness of Facebook Recruitment to Suicide Prevention Research: Online Survey Study

BACKGROUND

Researchers are increasingly using social media advertisements to recruit participants because of their many advantages over traditional methods. Although there is growing evidence for the effectiveness and cost-effectiveness of social media recruitment in the health sciences, no studies have yet examined this in the context of suicide prevention, which remains to be a highly stigmatized and sensitive topic.

OBJECTIVE

This study aims to recruit a general community sample to complete a survey on suicide literacy, stigma, and risk via Facebook advertisements. Specifically, we aim to establish the performance of the advertisements, cost-effectiveness, sample representativeness, and the impact of gender-specific advertising on recruiting men into the study.

METHODS

From June 2017 to March 2019, we released Facebook advertisements targeted at adults 18 years or older, residing in the New South Wales (NSW) trial or control regions, and involved in the LifeSpan suicide prevention trial. Cost-effectiveness was examined descriptively using metrics provided by Facebook. Chi-square analyses were conducted to determine demographic differences between our sample and the general NSW population as well as the impact of gender-specific advertisements on gender engagement.

RESULTS

The 14 Facebook advertisement campaigns reached a total of 675,199 people, yielding 25,993 link clicks and resulting in 9603 individuals initiating the survey (7487 completions) at an overall cost of Aus $2.81 (US $2.01) per participant. There was an overrepresentation of younger (P=.003), female (P=.003), highly educated (P<.001) participants and mental health conditions (P<.001) compared with the total NSW population. The use of male-specific advertisements resulted in a significantly higher proportion of men completing the survey relative to gender-neutral advertisements (38.2% vs 24.6%; P<.001).

CONCLUSIONS

This study demonstrates the potential of Facebook to be an effective, low-cost strategy for recruiting a large sample of general community participants for suicide prevention research. Strategies to improve sample representativeness warrant further investigation in future research.

Are Your Participants Real? Dealing with Fraud in Recruiting Older Adults Online

The internet offers exciting opportunities for quick, cost-efficient, and widespread recruitment and data collection without face-to-face contact. Previous research has demonstrated success in reaching population subgroups not typically included in traditional recruitment methods, yet challenges in data quality protection remain paramount. This article describes using Amazon Mechanical Turk, Facebook groups, and email distribution lists to recruit older adults who live alone for a quantitative study using a cross-sectional online survey. Fraudulent survey takers became a major concern in this study, and a protocol was developed to identify and exclude suspicious data. Of 738 recorded participants, 117 responses were retained in the final sample. The majority of sham responses were collected from Facebook with the fewest number of issues identified in responses collected via targeted emailing. Implications for survey design, data analysis, and future research are discussed.

Recruitment of older African American males for depression research: lessons learned

Depression is projected to become the leading cause of disability and the second leading contributor to the global burden of disease in approximately 10years. Few studies have explored the signs and symptoms of depression experienced by older African American men. Therefore, a pilot study was developed with the goal of addressing this gap in knowledge. Despite a variety of recruitment strategies, the study yielded no participants after 9months of effort. Lessons learned from the recruitment efforts and other researchers' successful techniques and strategies are discussed.

Impact of Baseline Assessment Modality on Enrollment and Retention in a Facebook Smoking Cessation Study

Background

Few studies have addressed enrollment and retention methods in online smoking cessation interventions. Fully automated Web-based trials can yield large numbers of participants rapidly but suffer from high rates of attrition. Personal contact with participants can increase recruitment of smokers into cessation trials and improve participant retention.

Objective

To compare the impact of Web-based (WEB) and phone (PH) baseline assessments on enrollment and retention metrics in the context of a Facebook smoking cessation study.

Methods

Participants were recruited via Facebook and Google ads which were randomly displayed to adult smokers in the United States over 27 days from August to September 2013. On each platform, two identical ads were randomly displayed to users who fit the advertising parameters. Clicking on one of the ads resulted in randomization to WEB, and clicking on the other ad resulted in randomization to PH. Following online eligibility screening and informed consent, participants in the WEB arm completed the baseline survey online whereas PH participants completed the baseline survey by phone with a research assistant. All participants were contacted at 30 days to complete a follow-up survey that assessed use of the cessation intervention and smoking outcomes. Participants were paid $15 for follow-up survey completion.

Results

A total of 4445 people clicked on the WEB ad and 4001 clicked on the PH ad: 12.04% (n=535) of WEB participants and 8.30% (n=332) of PH participants accepted the online study invitation (P<.001). Among the 726 participants who completed online eligibility screening, an equivalent proportion in both arms was eligible and an equivalent proportion of the eligible participants in both arms provided informed consent. There was significant drop-off between consent and completion of the baseline survey in the PH arm, resulting in enrollment rates of 32.7% (35/107) for the PH arm and 67.9% (114/168) for the WEB arm (P<.001). The overall enrollment rate among everyone who clicked on a study ad was 2%. There were no between group differences in the proportion that installed the Facebook app (66/114, 57.9% WEB vs 17/35, 49% PH) or that completed the 30-day follow-up survey (49/114, 43.0% WEB vs 16/35, 46% PH). A total of $6074 was spent on ads, generating 3,834,289 impressions and resulting in 8446 clicks (average cost $0.72 per click). Per participant enrollment costs for advertising alone were $27 WEB and $87 PH.

Conclusions

A more intensive phone baseline assessment protocol yielded a lower rate of enrollment, equivalent follow-up rates, and higher enrollment costs compared to a Web-based assessment protocol. Future research should focus on honing mixed-mode assessment protocols to further optimize enrollment and retention.