Improving recruitment and retention for an online randomized controlled trial: experience from the Youthnet study

Combating Fraudulent Participation in Urban American Indian and Alaska Native Virtual Health Research: Protocol for Increasing Data Integrity in Online Research (PRIOR)

BACKGROUND

While the advantages of using the internet and social media for research recruitment are well documented, the evolving online environment also enhances motivations for misrepresentation to receive incentives or to "troll" research studies. Such fraudulent assaults can compromise data integrity, with substantial losses in project time; money; and especially for vulnerable populations, research trust. With the rapid advent of new technology and ever-evolving social media platforms, it has become easier for misrepresentation to occur within online data collection. This perpetuation can occur by bots or individuals with malintent, but careful planning can help aid in filtering out fraudulent data.

OBJECTIVE

Using an example with urban American Indian and Alaska Native young women, this paper aims to describe PRIOR (Protocol for Increasing Data Integrity in Online Research), which is a 2-step integration protocol for combating fraudulent participation in online survey research.

METHODS

From February 2019 to August 2020, we recruited participants for formative research preparatory to an online randomized control trial of a preconceptual health program. First, we described our initial protocol for preventing fraudulent participation, which proved to be unsuccessful. Then, we described modifications we made in May 2020 to improve the protocol performance and the creation of PRIOR. Changes included transferring data collection platforms, collecting embedded geospatial variables, enabling timing features within the screening survey, creating URL links for each method or platform of data collection, and manually confirming potentially eligible participants' identifying information.

RESULTS

Before the implementation of PRIOR, the project experienced substantial fraudulent attempts at study enrollment, with less than 1% (n=6) of 1300 screened participants being identified as truly eligible. With the modified protocol, of the 461 individuals who completed a screening survey, 381 did not meet the eligibility criteria assessed on the survey. Of the 80 that did, 25 (31%) were identified as ineligible via PRIOR. A total of 55 (69%) were identified as eligible and verified in the protocol and were enrolled in the formative study.

CONCLUSIONS

Fraudulent surveys compromise study integrity, validity of the data, and trust among participant populations. They also deplete scarce research resources including respondent compensation and personnel time. Our approach of PRIOR to prevent online misrepresentation in data was successful. This paper reviews key elements regarding fraudulent data participation in online research and demonstrates why enhanced protocols to prevent fraudulent data collection are crucial for building trust with vulnerable populations.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04376346; https://www.clinicaltrials.gov/study/NCT04376346.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52281.

Utilization of online systems to promote youth participation in research: A methodological study

BACKGROUND

Online surveys can align with youth's increased use of the internet and can be a mechanism for expanding youth participation in research. This is particularly important during the coronavirus disease 2019 (COVID-19) pandemic, when in-person interactions are limited. However, the advantages and drawbacks of online systems used for research need to be carefully considered before utilizing such methodologies.

AIM

To describe and discuss the strengths and limitations of an online system developed to recruit adolescent girls for a sexual health research study and conduct a three-month follow up survey.

METHODS

This methodology paper examines the use of an online system to recruit and follow participants three months after their medical visit to evaluate a mobile sexual and reproductive health application, Health-E You/Salud iTuTM, for adolescent girls attending school-based health centers (SBHCs) across the United States. SBHC staff gave adolescent girls a web link to an online eligibility and consent survey. Participants were then asked to complete two online surveys (baseline and 3-month follow-up). Surveys, reminders, and incentives to complete them were distributed through short message service (SMS) text messages. Upon completing each survey, participants were also sent an email with a link to an electronic gift card as a thank-you for their participation. Barriers to implementing this system were discussed with clinicians and staff at each participating SBHC.

RESULTS

This online recruitment and retention system enabled participant recruitment at 26 different SBHCs in seven states across the United States. Between September 2021 and June 2022, 415 adolescent girls were screened using the Qualtrics online survey platform, and 182 were eligible to participate. Of those eligible, 78.0% (n = 142) completed the baseline survey. Participants were racially, geographically, and linguistically diverse. Most of the participants (89.4%) were non-White, and 40.8% spoke Spanish. A total of 62.0% (n = 88) completed the 3-month follow-up survey. Limitations of this system included reliance on internet access (via Wi-Fi or cell service), which was not universally available or reliable. In addition, an individual unrelated to the study obtained the survey link, filled out multiple surveys, and received multiple gift cards before the research team discovered and stopped this activity. As a result, additional security protocols were instituted.

CONCLUSION

Online systems for health research can increase the reach and diversity of study participants, reduce costs for research personnel time and travel, allow for continued study operation when in-person visits are limited (such as during the COVID-19 pandemic), and connect youth with research using technology. However, there are challenges and limitations to online systems, which include limited internet access, intermittent internet connection, data security concerns, and the potential for fraudulent users. These challenges should be considered prior to using online systems for research.

Methods for Authenticating Participants in Fully Web-Based Mobile App Trials from the iReach Project: Cross-sectional Study

BACKGROUND

Mobile health apps are important interventions that increase the scale and reach of prevention services, including HIV testing and prevention counseling, pre-exposure prophylaxis, condom distribution, and education, of which all are required to decrease HIV incidence rates. The use of these web-based apps as well as fully web-based intervention trials can be challenged by the need to remove fraudulent or duplicate entries and authenticate unique trial participants before randomization to protect the integrity of the sample and trial results. It is critical to ensure that the data collected through this modality are valid and reliable.

OBJECTIVE

The aim of this study is to discuss the electronic and manual authentication strategies for the iReach randomized controlled trial that were used to monitor and prevent fraudulent enrollment.

METHODS

iReach is a randomized controlled trial that focused on same-sex attracted, cisgender males (people assigned male at birth who identify as men) aged 13-18 years in the United States and on enrolling people of color and those in rural communities. The data were evaluated by identifying possible duplications in enrollment, identifying potentially fraudulent or ineligible participants through inconsistencies in the data collected at screening and survey data, and reviewing baseline completion times to avoid enrolling bots and those who did not complete the baseline questionnaire. Electronic systems flagged questionable enrollment. Additional manual reviews included the verification of age, IP addresses, email addresses, social media accounts, and completion times for surveys.

RESULTS

The electronic and manual strategies, including the integration of social media profiles, resulted in the identification and prevention of 624 cases of potential fraudulent, duplicative, or ineligible enrollment. A total of 79% (493/624) of the potentially fraudulent or ineligible cases were identified through electronic strategies, thereby reducing the burden of manual authentication for most cases. A case study with a scenario, resolution, and authentication strategy response was included.

CONCLUSIONS

As web-based trials are becoming more common, methods for handling suspicious enrollments that compromise data quality have become increasingly important for inclusion in protocols.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/10174.

Participant views and experiences of sexual health research: The Contraception Choices online trial

BACKGROUND

Online sexual health research can be convenient, efficient and low cost, but there are debates about the adequacy of online informed consent, privacy, and the acceptability of different methods of follow-up.

OBJECTIVES

To explore women's views and experiences of the Contraception Choices feasibility trial procedures and the place of digital interventions for contraception decision making.

METHODS

We analysed data from two sources: (1) Qualitative interviews. Eighteen interviews were conducted with women who had taken part in the Contraception Choices pre-trial feasibility study, to evaluate recruitment and online trial procedures. (2) Free-text comments. Women in the main Contraception Choices randomised controlled trial were followed up at 3 and 6 months, and asked 'Please tell us what you liked or disliked about the website' and 'Has being in the study had any good or bad effects on your life?' A total of 387 and 414 comments were made at 3 and 6 months respectively. Data were analysed thematically.

RESULTS

Participants liked being involved in a study about contraception, although recruitment from an abortion clinic was less acceptable than in other sexual health settings. Women found the trial procedures straightforward, and expressed no major concerns about online self-registration, informed consent or online data collection. Online survey questions about contraception and fertility were acceptable, and participants liked the convenience of being followed up by email or text.

CONCLUSIONS

Participants appreciated the advantages of the online research design and did not express concerns about consent or privacy. Women would welcome digital interventions for contraception in a variety of settings.

Online Patient Recruitment in Clinical Trials: Systematic Review and Meta-Analysis

Background

Recruitment for clinical trials continues to be a challenge, as patient recruitment is the single biggest cause of trial delays. Around 80% of trials fail to meet the initial enrollment target and timeline, and these delays can result in lost revenue of as much as US $8 million per day for drug developing companies.

Objective

This study aimed to conduct a systematic review and meta-analysis examining the effectiveness of online recruitment of participants for clinical trials compared with traditional in-clinic/offline recruitment methods.

Methods

Data on recruitment rates (the average number of patients enrolled in the study per month and per day of active recruitment) and conversion rates (the percentage of participants screened who proceed to enroll into the clinical trial), as well as study characteristics and patient demographics were collected from the included studies. Differences in online and offline recruitment rates and conversion rates were examined using random effects models. Further, a nonparametric paired Wilcoxon test was used for additional analysis on the cost-effectiveness of online patient recruitment. All data analyses were conducted in R language, and P<.05 was considered significant.

Results

In total, 3861 articles were screened for inclusion. Of these, 61 studies were included in the review, and 23 of these were further included in the meta-analysis. We found online recruitment to be significantly more effective with respect to the recruitment rate for active days of recruitment, where 100% (7/7) of the studies included had a better online recruitment rate compared with offline recruitment (incidence rate ratio [IRR] 4.17, P=.04). When examining the entire recruitment period in months we found that 52% (12/23) of the studies had a better online recruitment rate compared with the offline recruitment rate (IRR 1.11, P=.71). For cost-effectiveness, we found that online recruitment had a significantly lower cost per enrollee compared with offline recruitment (US $72 vs US $199, P=.04). Finally, we found that 69% (9/13) of studies had significantly better offline conversion rates compared with online conversion rates (risk ratio 0.8, P=.02).

Conclusions

Targeting potential participants using online remedies is an effective approach for patient recruitment for clinical research. Online recruitment was both superior in regard to time efficiency and cost-effectiveness compared with offline recruitment. In contrast, offline recruitment outperformed online recruitment with respect to conversion rate.

Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map

BACKGROUND

Recruiting and retaining participants in randomised controlled trials (RCTs) is challenging. Digital tools, such as social media, data mining, email or text-messaging, could improve recruitment or retention, but an overview of this research area is lacking. We aimed to systematically map the characteristics of digital recruitment and retention tools for RCTs, and the features of the comparative studies that have evaluated the effectiveness of these tools during the past 10 years.

METHODS

We searched Medline, Embase, other databases, the Internet, and relevant web sites in July 2018 to identify comparative studies of digital tools for recruiting and/or retaining participants in health RCTs. Two reviewers independently screened references against protocol-specified eligibility criteria. Included studies were coded by one reviewer with 20% checked by a second reviewer, using pre-defined keywords to describe characteristics of the studies, populations and digital tools evaluated.

RESULTS

We identified 9163 potentially relevant references, of which 104 articles reporting 105 comparative studies were included in the systematic map. The number of published studies on digital tools has doubled in the past decade, but most studies evaluated digital tools for recruitment rather than retention. The key health areas investigated were health promotion, cancers, circulatory system diseases and mental health. Few studies focussed on minority or under-served populations, and most studies were observational. The most frequently-studied digital tools were social media, Internet sites, email and tv/radio for recruitment; and email and text-messaging for retention. One quarter of the studies measured efficiency (cost per recruited or retained participant) but few studies have evaluated people's attitudes towards the use of digital tools.

CONCLUSIONS

This systematic map highlights a number of evidence gaps and may help stakeholders to identify and prioritise further research needs. In particular, there is a need for rigorous research on the efficiency of the digital tools and their impact on RCT participants and investigators, perhaps as studies-within-a-trial (SWAT) research. There is also a need for research into how digital tools may improve participant retention in RCTs which is currently underrepresented relative to recruitment research.

REGISTRATION

Not registered; based on a pre-specified protocol, peer-reviewed by the project's Advisory Board.

Efficiency and Cost: E-Recruitment Is a Promising Method in Gynecological Trials

BACKGROUND

Recruitment of participants is crucial to the success of any trial as it can have a major impact on study costs, the duration of the study itself, and, more critically, trial failure. Given that vulvodynia particularly affects young women, the use of social media and e-recruitment could prove efficient for enrollment.

AIM

To compare the efficiency, effectiveness, and cost-effectiveness of three different recruitment methods.

METHODS

The comparison data were collected as part of a bicentric randomized controlled trial evaluating the efficacy of physiotherapy in comparison with topical lidocaine in 212 women suffering from provoked vestibulodynia. The recruitment methods included: (i) conventional methods (eg, posters, leaflets, business cards, newspaper ads); (ii) health professional referrals, and (iii) e-recruitment (eg, Facebook ads and web initiatives). Women interested in participating were screened by telephone for eligibility criteria and were assessed by a gynecologist to confirm their diagnosis. Once included, structured interviews were undertaken to describe their baseline characteristics.

MAIN OUTCOME MEASURES

The outcomes of this study were the recruitment efficiency (the number of patients screened/enrolled), recruitment effectiveness (the number of participants enrolled), cost-effectiveness (cost per enrolled participant), and retention rate, and baseline characteristics of participants were monitored for each method.

RESULTS

The conventional methods (n = 101, 48%) were more effective as they allowed for greater enrollment of participants, followed by e-recruitment (n = 60, 28%) and health professional referrals (n = 33, 16%) (P < 0.007). Recruitment efficiency was found to be similar for e-recruitment and referrals (60/122 and 33/67, 49%, P = 0.055) but lower for conventional methods (101/314, 32%, P < 0.011). Nonsignificant differences were found between the three groups for baseline characteristics (P ≥ 0.189) and retention rate (91%, P ≥ 0.588). The average cost per enrolled participant was fairly similar for e-recruitment ($117) and conventional methods ($110) and lower for referrals ($60).

CLINICAL IMPLICATIONS

Our results suggest that having a variety of recruitment methods is beneficial in promoting clinical trial recruitment without affecting participant characteristics and retention rates.

STRENGTH & LIMITATIONS

Although recruitment methods were used concomitantly, this study gives an excellent insight into the advantages and limitations of recruitment methods owing to a large sample size.

CONCLUSION

The study findings revealed that e-recruitment is a valuable recruitment method because of its comparable efficiency and cost-effectiveness to health professional referrals and conventional methods, respectively.

CLINICAL TRIAL REGISTRATION

ClinicalTrials.gov, number NCT01455350. Benoit-Piau J, Dumoulin C, Carroll MS, et al. Efficiency and Cost: E-Recruitment Is a Promising Method in Gynecological Trials. J Sex Med 2020;17:1304-1311.

A novel approach to conducting clinical trials in the community setting: utilizing patient-driven platforms and social media to drive web-based patient recruitment

Background

Participant recruitment for clinical research studies remains a significant challenge for researchers. Novel approaches to recruitment are necessary to ensure that populations are easier to reach. In the context of rare diseases, social media provides a unique opportunity for connecting with patient groups that have representatively lower diagnosis rates when compared with more common diseases or illness. We describe the implementation of designing a patient-centered approach to message design for the purposes of recruiting patients for clinical research studies for rare disease populations.

Methods

Using an iterative research approach, we analyzed our previous experience of using web-based direct-to-patient recruitment methods to compare these online strategies with traditional center of excellence recruitment strategies. After choosing six research studies for inclusion in the previous study, in-depth, online interviews (n = 37) were conducted with patients represented in each disease category to develop and test recruitment message strategies for social media and a Web-based platform for patients to access study information and pre-screen. Finally, relationships were established with Patient Advocacy Groups representing each rare disease category to ensure further dissemination of recruitment materials via their own social media networks.

Results

Guided by social marketing theory, we created and tested various recruitment message designs. Three key message concepts preferred by patients emerged: (1) infographic; (2) positive emotional messages; and (3) educational information for sharing. A base study website was designed and created based on data from patient interviews. This website includes the option for potential participants to pre-screen and determine their eligibility for the study.

Conclusions

Study participants report wanting to be involved in the design and implementation of recruitment approaches for clinical research studies. The application of the aforementioned methods could aide in the evolution of clinical research practices for the recruitment of both rare and common diseases, where patient-centric approaches can help to create targeted messages designs that participants pre-test and support.

Seeing Is Believing? Unique Capabilities of Internet-Only Studies as a Tool for Implementation Research on HIV Prevention for Men Who Have Sex With Men: A Review of Studies and Methodological Considerations

BACKGROUND

In 2014, Grov et al published a comprehensive review cataloguing both men who have sex with men's (MSM's) sexual behavior transitions in online environments from the 1990s through 2013, as well as researchers' efforts in tandem to use the internet to engage MSM into research, treatment, and prevention.

METHODS

In this article, we discuss historical events and research having occurred in the half decade since the Grov et al publication.

RESULTS

Notable transitions include MSM's expanded use of geosocial networking apps, as well as other forms of social media accessed primarily through mobile devices, as well as the addition of biomedical prevention strategies (eg, pre-exposure prophylaxis and undetectable = untransmittable) to the proverbial HIV prevention toolkit. In tandem, researchers have rapidly expanded their employment of internet-mediated methods for the recruitment and engagement of key populations for HIV research, treatment, and prevention. In this article, we discuss methodological considerations for using the internet to conduct HIV prevention research with MSM: (1) sources of recruitment (eg, geosocial apps, Facebook, crowdsourced online panels); (2) design (eg, cross sectional, longitudinal, diaries); (3) incentives (including disincentivizing fraudulent participants and/or spam bots); (4) confidentiality; and (5) representativeness.

CONCLUSION

We conclude by discussing future directions in HIV prevention research in light of forthcoming technologies such as fifth generation (5G) mobile networks, combined use of self-collected biological data alongside self-report, and the utility of metadata and metaresearch to document, evaluate, and inform best practices.

A Randomized Trial of an Online Risk Reduction Intervention for Young Black MSM

HealthMpowerment.org (HMP), is a mobile optimized, online intervention to reduce sexual risk behaviors among HIV-positive and HIV-negative young Black men who have sex with men (BMSM) by providing information and resources, fostering social support, and including game-based elements. A randomized controlled trial with 474 young BMSM compared HMP to an information-only control website. The rate of self-reported condomless anal intercourse (CAI) at 3-months was 32% lower in the intervention group compared to the control group (IRR 0.68, 95% CI 0.43, 0.93), however this effect was not sustained at 12 months. Among HIV-positive participants, the rate of CAI at 3-month follow-up was 82% lower among participants with detectable viral loads in the intervention group compared to the control group (IRR 0.18, 95% CI 0.04, 0.32). In a secondary analysis, when we limited to those who used HMP for over 60 min during the 3-month intervention period (n = 50, 25.8%), we estimated 4.85 (95% CI 2.15, 7.53) fewer CAI events than we would have expected in control participants, had they used the intervention at the same rate as the intervention group. Findings suggest that exposure to an online intervention can reduce the rate of CAI among young BMSM, at least in the short term. Given the stronger effect seen among those participants who complied with HMP, additional intervention engagement strategies are warranted.

Developing a scale: Adolescents' health choices related rights, duties and responsibilities

BACKGROUND

Adolescents' health choices have been widely researched, but the ethical basis of these choices, namely their rights, duties, and responsibilities, have been disregarded and scale is required to measure these.

OBJECTIVE

To describe the development of a scale that measures adolescents' rights, duties, and responsibilities in relation to health choices and document the preliminary scale testing.

RESEARCH DESIGN

A multi-phase development method was used to construct the Health Rights Duties and Responsibilities (HealthRDR) scale. The concepts and content were defined through document analysis, a systematic literature review, and focus groups. The content validity and clarity of the items were evaluated by expert panel of 23 adolescents, school nurses, and researchers. We calculated the content validity index and the content validity ratio at on item and scale levels. Preliminary testing was conducted with 200 adolescents aged 15-16 years. Descriptive statistics, Cronbach's alpha correlation, and statistics for the item-analysis were calculated.

ETHICAL CONSIDERATIONS

Ethical approval and permission were obtained according to national legislation and responsible research practice was followed. Informed consent was obtained from the participants and the parents were informed about the study.

FINDINGS

The Health Rights Duties and Responsibilities scale comprises of four sub-scales with 148 items: 15 on health choices, 36 on rights, 47 on duties, and 50 on responsibilities. The items had a 0.93 content validity index and a 0.85 content validity ratio. Cronbach's alpha correlation coefficient was 0.99 for the total scale and the individual sub-scales scores were health choices (0.93), rights (0.97), responsibilities (0.99), and duties (0.98).

DISCUSSION

The findings are discussed in light of the ethical concepts and validity and reliability of the developed scale.

CONCLUSION

The Health Rights Duties and Responsibilities scale defines and understands adolescents' rights, duties, and responsibilities in relation to health choices and has good content validity. Further testing and refinement of the concepts are needed.

Feasibility and Acceptability of an Online Positive Affect Intervention for Those Living with Comorbid HIV Depression

Positive affect has unique beneficial effects on psychological and physical health, independent of the effects of negative affect. Interventions that explicitly target positive affect show promise for improving health outcomes in a number of chronic illnesses. In this article, we present pilot data on the acceptability and feasibility of an online intervention to increase positive affect in those living with comorbid human immunodeficiency virus (HIV) and depression. The intervention was rated both acceptable and feasible by participants. Six of nine participants completed the intervention and the subsequent follow-up assessment and a post-intervention phone call. We also present outcomes of planned comparisons of intervention effects on emotion, which indicate that positive affect increased significantly in the intervention group. Based upon results of the current study, future research should continue the development of positive affect interventions for people living with comorbid HIV and depression.

The Men's Safer Sex project: intervention development and feasibility randomised controlled trial of an interactive digital intervention to increase condom use in men

BACKGROUND

This report details the development of the Men's Safer Sex website and the results of a feasibility randomised controlled trial (RCT), health economic assessment and qualitative evaluation.

OBJECTIVES

(1) Develop the Men's Safer Sex website to address barriers to condom use; (2) determine the best design for an online RCT; (3) inform the methods for collecting and analysing health economic data; (4) assess the Sexual Quality of Life (SQoL) questionnaire and European Quality of Life-5 Dimensions, three-level version (EQ-5D-3L) to calculate quality-adjusted life-years (QALYs); and (5) explore clinic staff and men's views of online research methodology.

METHODS

(1) Website development: we combined evidence from research literature and the views of experts (n = 18) and male clinic users (n = 43); (2) feasibility RCT: 159 heterosexually active men were recruited from three sexual health clinics and were randomised by computer to the Men's Safer Sex website plus usual care (n = 84) or usual clinic care only (n = 75). Men were invited to complete online questionnaires at 3, 6, 9 and 12 months, and sexually transmitted infection (STI) diagnoses were recorded from clinic notes at 12 months; (3) health economic evaluation: we investigated the impact of using different questionnaires to calculate utilities and QALYs (the EQ-5D-3L and SQoL questionnaire), and compared different methods to collect resource use; and (4) qualitative evaluation: thematic analysis of interviews with 11 male trial participants and nine clinic staff, as well as free-text comments from online outcome questionnaires.

RESULTS

(1) Software errors and clinic Wi-Fi access presented significant challenges. Response rates for online questionnaires were poor but improved with larger vouchers (from 36% with £10 to 50% with £30). Clinical records were located for 94% of participants for STI diagnoses. There were no group differences in condomless sex with female partners [incidence rate ratio (IRR) 1.01, 95% confidence interval (CI) 0.52 to 1.96]. New STI diagnoses were recorded for 8.8% (7/80) of the intervention group and 13.0% (9/69) of the control group (IRR 0.75, 95% CI 0.29 to 1.89). (2) Health-care resource data were more complete using patient files than questionnaires. The probability that the intervention is cost-effective is sensitive to the source of data used and whether or not data on intended pregnancies are included. (3) The pilot RCT fitted well around clinical activities but 37% of the intervention group did not see the Men's Safer Sex website and technical problems were frustrating. Men's views of the Men's Safer Sex website and research procedures were largely positive.

CONCLUSIONS

It would be feasible to conduct a large-scale RCT using clinic STI diagnoses as a primary outcome; however, technical errors and a poor response rate limited the collection of online self-reported outcomes. The next steps are (1) to optimise software for online trials, (2) to find the best ways to integrate digital health promotion with clinical services, (3) to develop more precise methods for collecting resource use data and (4) to work out how to overcome barriers to digital intervention testing and implementation in the NHS.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN18649610.

FUNDING

This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 20, No. 91. See the NIHR Journals Library website for further project information.

Development of a Tailored HIV Prevention Intervention for Single Young Men Who Have Sex With Men Who Meet Partners Online: Protocol for the myDEx Project

Background

New cases of human immunodeficiency virus (HIV) among young men who have sex with men (YMSM), aged 18 to 24, underscore the importance of developmentally-informed HIV programs for YMSM. We developed an online intervention focused on risk reduction strategies across different sexual partner types. Intervention activities focus on assisting YMSM reflect on their partner-seeking behaviors, develop sexual decision-making rules to reduce their HIV risks, and consider the adoption of HIV prevention behaviors.

Objective

This pilot, randomized controlled trial (RCT) aims to examine the feasibility, acceptability, and preliminary efficacy of a tailored, Web-based HIV prevention intervention for single YMSM.

Methods

We designed a prospective RCT of online-recruited cis-gender men (N=180) who reported recent unprotected anal intercourse, self-report as HIV negative or are unaware of their HIV status, and meet sexual partners through online dating apps. Individuals in the control arm receive an attention-control condition that includes HIV/sexually transmitted infection (STI) information currently available on sex education websites. Individuals in the intervention arm receive a 6-session Web-based program tailored on their demographic information, partner-seeking behaviors and relationship desires, and prior sexual attitudes and behaviors. This tailored content will match HIV prevention messages and safer sex skills with YMSM’s outcome expectancies when meeting new partners and thereby help them consider how to integrate safer sex practices into different partner types. Study assessments are taken at baseline, 30-, 60-, and 90-day follow-ups. Intervention acceptability and preliminary efficacy will be explored in sexual risk behaviors and HIV/STI testing.

Results

The RCT launched in November 2016 and is ongoing. To date, 180 eligible individuals have been enrolled, consented, and randomized. Of the 120 individuals in the intervention arm, 51.7% (62/120) identify as non-Hispanic white and half of the control arm identifies as non-Hispanic white. There were no differences observed by arm for race and/or ethnicity, age, or sexual orientation.

Conclusions

Although there are in-person evidence-based interventions with proven efficacy for YMSM, few HIV/STI prevention interventions delivered online exist. Online interventions may ease access to comprehensive HIV/STI education among YMSM and allow personalized content to be delivered. The online intervention that we developed, myDEx, aims to alleviate the gaps within HIV prevention for YMSM by utilizing tailored, Web-based content with the goal of developing skills for same-sex dating and relationship building, while reducing their risks for HIV/STI.

Trial Registration

ClinicalTrials.gov NCT02842060; https://clinicaltrials.gov/ct2/show/NCT02842060 (Archived by WebCite at http://www.webcitation.org/6rcJdxF9v)

Guided Internet-based Psycho-educational Intervention Using Cognitive Behavioral Therapy and Self-management for Individuals with Chronic Pain: A Feasibility Study

When considering barriers to chronic pain treatment, there is a need to deliver nonpharmacological therapies in a way that is accessible to all individuals who may benefit. To conduct feasibility testing using a guided, Internet-based intervention for individuals with chronic pain, a novel, Internet-based, chronic pain intervention (ICPI) was developed, using concepts proven effective in face-to-face interventions. This study was designed to assess usability of the ICPI and feasibility of conducting larger-scale research, and to collect preliminary data on effectiveness of the intervention. Data were collected at baseline, after each of the six intervention modules, and 12 weeks after intervention completion. Forty-one participants completed baseline questionnaires, and 15 completed the 12-week postintervention questionnaires. At baseline, all participants reported satisfaction with the structure of the intervention and ease of use. Internet-based platforms such as Facebook aided in accrual of participants, making further large-scale study of the ICPI feasible. There is preliminary evidence suggesting that the ICPI improves emotional function but not physical function, with a small but significant decrease in pain intensity and pain interference. Most participants felt they benefited at least minimally as a result of using the ICPI. The ICPI was well received by participants and demonstrated positive outcomes in this preliminary study. Further research with more participants is feasible and necessary to fully assess the effect of this intervention.

Experience With Direct-to-Patient Recruitment for Enrollment Into a Clinical Trial in a Rare Disease: A Web-Based Study

Background

The target sample size for clinical trials often necessitates a multicenter (center of excellence, CoE) approach with associated added complexity, cost, and regulatory requirements. Alternative recruitment strategies need to be tested against this standard model.

Objectives

The aim of our study was to test whether a Web-based direct recruitment approach (patient-centric, PC) using social marketing strategies provides a viable option to the CoE recruitment method.

Methods

PC recruitment and Web-based informed consent was compared with CoE recruitment for a randomized controlled trial (RCT) of continuing versus stopping low-dose prednisone for maintenance of remission of patients with granulomatosis with polyangiitis (GPA).

Results

The PC approach was not as successful as the CoE approach. Enrollment of those confirmed eligible by their physician was 10 of 13 (77%) and 49 of 51 (96%) in the PC and CoE arms, respectively (P=.05). The two approaches were not significantly different in terms of eligibility with 34% of potential participants in the CoE found to be ineligible as compared with 22% in the PC arm (P=.11) nor in provider acceptance, 22% versus 26% (P=.78). There was no difference in the understanding of the trial as reflected in the knowledge surveys of individuals in the PC and CoE arms.

Conclusions

PC recruitment was substantially less successful than that achieved by the CoE approach. However, the PC approach was good at confirming eligibility and was as acceptable to providers and as understandable to patients as the CoE approach. The PC approach should be evaluated in other clinical settings to get a better sense of its potential.

The Men's Safer Sex Trial: A feasibility randomised controlled trial of an interactive digital intervention to increase condom use in men

Objectives

We aimed to determine the feasibility of an online randomised controlled trial (RCT) of the Men’s Safer Sex website, measuring condom use and sexually transmitted infection (STI).

Methods

For this study 159 men aged ≥16 with female sexual partners and recent condomless sex or suspected STI were recruited from three UK sexual health clinics. Participants were randomised to the intervention website plus usual clinic care (n = 84), or usual clinic care only (n = 75). Online outcome data were solicited at 3, 6, and 12 months.

Results

Men were enrolled via tablet computers in clinic waiting rooms. Software errors and clinic Wi-Fi access presented significant challenges, and online questionnaire response rates were poor (36% at 3 months with a £10 voucher; 50% at 12 months with £30). Clinical records (for STI diagnoses) were located for 94% of participants. Some 37% of the intervention group did not see the intervention website (n = 31/84), and (as expected) there was no detectable difference in condomless sex with female partners (IRR = 1.01, 95% CI 0.52 to 1.96). New acute STI diagnoses were recorded for 8.8% (7/80) of the intervention group, and 13.0% (9/69) of the control group over 12 months (IRR = 0.75, 95% CI 0.29 to 1.90).

Conclusion

It is likely to be feasible to conduct a future large-scale RCT to assess the impact of an online intervention using clinic STI diagnoses as a primary outcome. However, practical and technical challenges need to be addressed before the potential of digital media interventions can be realised in sexual health settings.

Trial registration number: ISRCTN18649610

Recruitment Strategies of Indian Men Who Have Sex with Men in the State of Maharashtra Into an Online Survey

In this manuscript, we report lessons learned from our efforts to recruit Indian men and transgender women/hijras who have sex with men into an online cross sectional study. Between September 2013 and May 2014, we implemented a seven-phased recruitment strategy that included the use of online and offline strategies to enroll a total of 449 participants into an online survey about recent sexual behavior and various psychosocial measures. The phases were implemented sequentially and cost-per-eligible participant was calculated. Using social media and collaborating with organizers of community events proved the most effective strategies for recruiting Indian MSM into online research.

Conducting a fully mobile and randomised clinical trial for depression: access, engagement and expense

Importance

Advances in mobile technology have resulted in federal and industry-level initiatives to facilitate large-scale clinical research using smart devices. Although the benefits of technology to expand data collection are obvious, assumptions about the reach of mobile research methods (access), participant willingness to engage in mobile research protocols (engagement), and the cost of this research (cost) remain untested.

Objective

To assess the feasibility of a fully mobile randomised controlled trial using assessments and treatments delivered entirely through mobile devices to depressed individuals.

Design

Using a web-based research portal, adult participants with depression who also owned a smart device were screened, consented and randomised to 1 of 3 mental health apps for treatment. Assessments of self-reported mood and cognitive function were conducted at baseline, 4, 8 and 12 weeks. Physical and social activity was monitored daily using passively collected phone use data. All treatment and assessment tools were housed on each participant's smart phone or tablet.

Interventions

A cognitive training application, an application based on problem-solving therapy, and a mobile-sensing application promoting daily activities.

Results

Access: We screened 2923 people and enrolled 1098 participants in 5 months. The sample characteristics were comparable to the 2013 US census data. Recruitment via Craigslist.org yielded the largest sample. Engagement: Study engagement was high during the first 2 weeks of treatment, falling to 44% adherence by the 4th week. Cost: The total amount spent on for this project, including staff costs and β testing, was $314 264 over 2 years.

Conclusions and relevance

These findings suggest that mobile randomised control trials can recruit large numbers of participants in a short period of time and with minimal cost, but study engagement remains challenging.

Trial registration number

NCT00540865.

Strategies for successful recruitment of young adults to healthy lifestyle programmes for the prevention of weight gain: a systematic review

Recruiting healthy young adults, aged 18-35, to lifestyle programmes for prevention of weight gain is challenging but important given their increasing rates of obesity. This review aimed to examine the success of different recruitment strategies. A systematic literature search identified 26 separate studies using 10 electronic databases. Participant characteristics and efficacy of interventions were well reported in all studies, but reporting of recruitment procedures, costs, times and effectiveness was minimal. Of those reporting recruitment, both active (e.g. face-to-face) and passive (e.g. print-media and mass-mailings) approaches were identified with the latter most frequently employed. Novel strategies such as social media and marketing approaches were identified. Television and radio have potentially high reach but low efficiency with high cost compared with mass-mailings which yield high numbers of participants. Marketing campaigns appeared to be a promising approach. Incentives demonstrated enhanced recruitment. The use of formative research to guide recruitment strategies for interventions is recommended. Reporting of success, cost and timelines for recruitment should be included in reporting of future trials. This first synthesis of recruitment information can be used to inform recruitment frameworks for lifestyle programmes seeking to attract young adults.

Young men who have sex with men's use of social and sexual media and sex-risk associations: cross-sectional, online survey across four countries

OBJECTIVE

There has been an increase in new HIV diagnoses among young men who have sex with men (YMSM) over the past decade in both UK and US contexts, with online sex-seeking implicated in driving this development. This study sought to examine YMSM's use of a variety of social and sexual networking websites and 'apps', and assess sexual risk behaviours.

DESIGN

YMSM were recruited from across four countries in Britain and Ireland, via an online survey using convenience sampling. Data were collected from 2668 men, of whom 702 were aged 18-25 years.

RESULTS

Facebook use was almost ubiquitous and for largely social reasons; sexual media use was common with 52% using gay sexual networking (GSN) websites frequently and 44% using similar apps frequently. We found increased odds of high-risk condomless anal intercourse associated with the length of time users had been using GSN websites and lower levels of education. We found no significant differences across the four countries in sexual risk behaviours.

CONCLUSIONS

YMSM are a heterogeneous population with varied sexual health needs. For young men with digital literacy, individual-level online interventions, targeted and tailored, could be directed towards frequent users with lower levels of education. Variation in demographic characteristics of GSN websites and app users may affect who interventions are likely to reach, depending on where they are targeted. However, interventions, which may catch young men earlier, also provide a major opportunity for reducing sexual health inequalities.

Sexual health promotion for young people delivered via digital media: a scoping review

Background

Young people are at risk of poor sexual health and are, therefore, in need of comprehensive, effective sexual health education. Young people are confident and constant users of digital technology, such as the internet and mobile phones, and there are many innovative possibilities for sexual health education involving these technologies.

Objectives

To summarise evidence on effectiveness, cost-effectiveness and mechanism of action of interactive digital interventions (IDIs) for sexual health; optimal practice for intervention development; contexts for successful implementation; research methods for digital intervention evaluation; and the future potential of sexual health promotion via digital media.

Design

Literature review of evidence on digital interventions for sexual health for young people, integrating the findings with the views of young people, parents and experts in digital media/sexual health. IDIs are defined as digital media programmes that provide health information and tailored decision support, behaviour-change support and/or emotional support. We focus on sexual well-being for young people aged 13–24 years in the UK.

Results

There are many imaginative IDIs for sexual health promotion, but few interventions address issues that are important to young people, such as sexual pleasure and relationships. It is vital to collaborate with young people and to use Behaviour-Change Theory in designing interventions. We located 19 randomised controlled trials of IDIs for sexual health promotion for young people, finding a moderate effect on sexual health knowledge [standardised mean difference (SMD) 0.54, 95% confidence interval (CI) 0.17 to 0.92], a small effect on confidence (self-efficacy) (SMD 0.11, 95% CI 0.02 to 0.20) and a positive effect on sexual behaviour (odds ratio 1.28, 95% CI 1.01 to 1.61), but no significant effects on safer sex intention or biological outcomes. One study suggests that IDIs may be as good as face-to-face interventions for sexual health knowledge and safer sex intention. There are no existing data on the cost-effectiveness of IDIs for sexual health promotion. The impact of an IDI will be determined by the proportion of the target population reached, intervention efficacy, adoption in a setting, how well it is delivered and maintenance/sustainability. All of these elements must be addressed for IDIs to be successful. More collaboration is needed to capitalise on the knowledge of users and stakeholders, the design and software skills of the commercial sector and the theoretical expertise and evaluation skills of academia.

Conclusions

IDIs are effective for knowledge acquisition and sexual behaviour, and could usefully contribute to sexual health education in schools, in clinic settings and online; however, there are obstacles to overcome, such as access to information technology and ensuring the quality and safety of interventions.

Future work

More evidence is needed on the best designs for interventions (e.g. choice of behaviour-change mechanisms and interactive features) and the best models of delivery (e.g. setting, modes of delivery, methods of facilitation and support for engagement) to improve sexual behaviour, biological outcomes and sexual well-being in a cost-effective way.

Funding

The National Institute for Health Research Public Health Research programme.

Recruitment lessons learned from a tailored web-based health intervention Project Y.E.A.H. (Young Adults Eating and Active for Health)

Purpose

– Recruiting college students for research studies can be challenging. The purpose of this paper is to describe the lessons learned in the various recruitment strategies used for enrolling college students in a theory-based, tailored, and web-delivered health intervention at 13 US universities.

Design/methodology/approach

– The community-based participatory research (CBPR) model was used to develop a staged-tailored, web-based, randomized control trial, focussing on eating behavior, physical activity, and stress management. Participant feedback during baseline assessments was used to evaluate recruitment strategies.

Findings

– Findings from this feedback suggest that traditional recruitment strategies, such as newspaper ads and flyers, may not be the best approach for recruiting college students; instead, web-based efforts proved to be a better recruitment strategy.

Research limitations/implications

– This project included results from 13 US universities and thus may not be generalizable: more research is needed to determine successful recruitment methods for 18-24 years old college students.

Originality/value

– This paper lessens the gap regarding successful recruitment strategies for 18-24 years old college students.

Impact of Baseline Assessment Modality on Enrollment and Retention in a Facebook Smoking Cessation Study

Background

Few studies have addressed enrollment and retention methods in online smoking cessation interventions. Fully automated Web-based trials can yield large numbers of participants rapidly but suffer from high rates of attrition. Personal contact with participants can increase recruitment of smokers into cessation trials and improve participant retention.

Objective

To compare the impact of Web-based (WEB) and phone (PH) baseline assessments on enrollment and retention metrics in the context of a Facebook smoking cessation study.

Methods

Participants were recruited via Facebook and Google ads which were randomly displayed to adult smokers in the United States over 27 days from August to September 2013. On each platform, two identical ads were randomly displayed to users who fit the advertising parameters. Clicking on one of the ads resulted in randomization to WEB, and clicking on the other ad resulted in randomization to PH. Following online eligibility screening and informed consent, participants in the WEB arm completed the baseline survey online whereas PH participants completed the baseline survey by phone with a research assistant. All participants were contacted at 30 days to complete a follow-up survey that assessed use of the cessation intervention and smoking outcomes. Participants were paid $15 for follow-up survey completion.

Results

A total of 4445 people clicked on the WEB ad and 4001 clicked on the PH ad: 12.04% (n=535) of WEB participants and 8.30% (n=332) of PH participants accepted the online study invitation (P<.001). Among the 726 participants who completed online eligibility screening, an equivalent proportion in both arms was eligible and an equivalent proportion of the eligible participants in both arms provided informed consent. There was significant drop-off between consent and completion of the baseline survey in the PH arm, resulting in enrollment rates of 32.7% (35/107) for the PH arm and 67.9% (114/168) for the WEB arm (P<.001). The overall enrollment rate among everyone who clicked on a study ad was 2%. There were no between group differences in the proportion that installed the Facebook app (66/114, 57.9% WEB vs 17/35, 49% PH) or that completed the 30-day follow-up survey (49/114, 43.0% WEB vs 16/35, 46% PH). A total of $6074 was spent on ads, generating 3,834,289 impressions and resulting in 8446 clicks (average cost $0.72 per click). Per participant enrollment costs for advertising alone were $27 WEB and $87 PH.

Conclusions

A more intensive phone baseline assessment protocol yielded a lower rate of enrollment, equivalent follow-up rates, and higher enrollment costs compared to a Web-based assessment protocol. Future research should focus on honing mixed-mode assessment protocols to further optimize enrollment and retention.

eMoms: Electronically-mediated weight interventions for pregnant and postpartum women. Study design and baseline characteristics

BACKGROUND

The influence of childbearing in the development of obesity is situated within two different but related contexts: pregnancy-related weight gain and weight gain prevention and control in young adult women. Pregnancy related weight gain contributes to long-term weight retention in childbearing women.

OBJECTIVE

To present the study design, data collection procedures, recruitment challenges, and the baseline characteristics for the eMoms of Rochester study, a randomized clinical trial testing the effect of electronically-mediated behavioral interventions to prevent excessive gestational weight gain (GWG) and postpartum weight retention among women aged 18-35 years of diverse income and racial/ethnic backgrounds in an urban setting.

DESIGN

Randomized double blind clinical trial. A total of 1722 women at or below 20 weeks of gestation were recruited primarily from obstetric practices and randomized to 3 treatment groups: control arm; intervention arm with access to intervention during pregnancy and control at postpartum (e-intervention 1); and intervention arm with access to intervention during pregnancy and postpartum (e-intervention 2). Enrollment and consent were completed via study staff or online. Data were collected via online surveys, medical charts, and measurement of postpartum weights. The primary endpoints are gaining more weight than recommended by the Institution of Medicine guidelines and weight retained at 12 months postpartum.

CONCLUSION

This study will provide evidence on the efficacy of behavioral interventions in the prevention of excessive GWG and postpartum weight retention with potential dissemination to obstetric practices and/or health insurances. ClinicalTrials.gov #NCT01331564.

Facebook as a recruitment tool for adolescent health research: a systematic review

BACKGROUND

Researchers are increasingly using social media to recruit participants to surveys and clinical studies. However, the evidence of the efficacy and validity of adolescent recruitment through Facebook is yet to be established.

OBJECTIVE

To conduct a systematic review of the literature on the use of Facebook to recruit adolescents for health research.

DATA SOURCES

Nine electronic databases and reference lists were searched for articles published between 2004 and 2013.

STUDY ELIGIBILITY CRITERIA

Studies were included in the review if: 1) participants were aged ≥ 10 to ≤ 18 years, 2) studies addressed a physical or mental health issue, 3) Facebook was identified as a recruitment tool, 4) recruitment details using Facebook were outlined in the methods section and considered in the discussion, or information was obtained by contacting the authors, 5) results revealed how many participants were recruited using Facebook, and 6) studies addressed how adolescent consent and/or parental consent was obtained.

STUDY APPRAISALS AND SYNTHESIS METHODS

Titles, abstracts, and keywords were scanned and duplicates removed by 2 reviewers. Full text was evaluated for inclusion criteria, and 2 reviewers independently extracted data.

RESULTS

The search resulted in 587 publications, of which 25 full-text papers were analyzed. Six studies met all the criteria for inclusion in the review. Three recruitment methods using Facebook was identified: 1) paid Facebook advertising, 2) use of the Facebook search tool, and 3) creation and use of a Facebook Page.

CONCLUSIONS

Eligible studies described the use of paid Facebook advertising and Facebook as a search tool as methods to successfully recruit adolescent participants. Online and verbal consent was obtained from participants recruited from Facebook.

Challenging recruitment of youth with type 2 diabetes into clinical trials

PURPOSE

To better understand and overcome difficulties with recruitment of adolescents with type 2 diabetes into clinical trials at three United States institutions, we reviewed recruitment and retention strategies in clinical trials of youth with various chronic conditions. We explored whether similar strategies might be applicable to pediatric patients with type 2 diabetes.

METHODS

We compiled data on recruitment and retention of adolescents with type 2 diabetes at three centers (National Institutes of Health, Bethesda, Maryland; Baylor College of Medicine, Houston, Texas; and Children's National Medical Center, Washington, DC) from January 2009 to December 2011. We also conducted a thorough literature review on recruitment and retention in adolescents with chronic health conditions.

RESULTS

The number of recruited patients was inadequate for timely completion of ongoing trials. Our review of recruitment strategies in adolescents included monetary and material incentives, technology-based advertising, word-of-mouth referral, and continuous patient-research team contact. Cellular or Internet technology appeared promising in improving participation among youths in studies of various chronic conditions and social behaviors.

CONCLUSIONS

Adolescents with type 2 diabetes are particularly difficult to engage in clinical trials. Monetary incentives and use of technology do not represent "magic bullets," but may presently be the most effective tools. Future studies should be conducted to explore motivation in this population. We speculate that (1) recruitment into interventional trials that address the main concerns of the affected youth (e.g., weight loss, body image, and stress management) combined with less tangible outcomes (e.g., blood glucose control) may be more successful; and (2) study participation and retention may be improved by accommodating patients' and caregivers' schedules, by scheduling study visits before and after working hours, and in more convenient locations than in medical facilities.

Systematic literature review of Internet interventions across health behaviors

Purpose: This review examines Internet interventions aiming to change health behaviors in the general population. Methods: Internet health interventions in the USA published between January 2005 and December 2013 were identified through Medline and CINAHL. Keywords used were (Internet or e-health or social media or web) paired with (intervention or program*). A total of 38 articles met all criteria and were reviewed. Results: Studies were analyzed by targeted health behavior interventions: tobacco (5), alcohol (4), weight loss (7), physical activity (PA) (7), nutrition (2), PA and nutrition combined (5), HIV or sexual health (4), and chronic diseases (4). Interventions ranged from one session to 24  weeks (average 6-12 weeks). Common strategies used, including web-based information, tailored feedback, weekly e-mails, goal setting, and self-assessment. Social cognitive theory and the transtheoretical models were the most commonly used frameworks. Recruitment strategies were typically media based varied by settings and populations. Except for the tobacco interventions, the majority studies yielded significant outcomes. Conclusion: This review provides updates and synthesized knowledge on the design and consistent effectiveness of Internet interventions across health behaviors. Results have implications for public health and healthcare professionals, as they play a key role in developing and delivering health promotion interventions as well as in assisting the communities and clients serviced obtaining evidence-based health information.

Recruitment Strategies of Methamphetamine-Using Men Who Have Sex with Men into an Online Survey

Recruiting hidden populations into online research remains challenging. In this manuscript, we report lessons learned from our efforts to recruit methamphetamine-using men who have sex with men. Between July and October 2012, we implemented a four-phase recruitment strategy to enroll a total of 343 methamphetamine-using MSM into an online survey about recent substance use, sexual behavior, and various psychosocial measures. The four phases were implemented sequentially. During phase one, we placed advertisements on mobile applications, and during phase two, we placed advertisements on traditional websites formatted for browsers. During phase three, we used e-mail to initiate snowball recruitment, and during phase four, we used social media for snowball recruitment. Advertisements on mobile devices and websites formatted for browsers proved to be expensive options and resulted in few eligible participants. Our attempts to initiate a snowball through e-mail also proved unsuccessful. The majority (n=320) of observations in our final dataset came from our use of social media. However, participant fraud was a concern, requiring us to implement a strong participant verification protocol. For maximum recruitment and cost-effectiveness, researchers should use social media for recruitment provided they employ strong participant verification protocols.

The Sexunzipped trial: young people's views of participating in an online randomized controlled trial

Background

Incidence of sexually transmitted infections (STIs) among young people in the United Kingdom is increasing. The Internet can be a suitable medium for delivery of sexual health information and sexual health promotion, given its high usage among young people, its potential for creating a sense of anonymity, and ease of access. Online randomized controlled trials (RCTs) are increasingly being used to evaluate online interventions, but while there are many advantages to online methodologies, they can be associated with a number of problems, including poor engagement with online interventions, poor trial retention, and concerns about the validity of data collected through self-report online. We conducted an online feasibility trial that tested the effects of the Sexunzipped website for sexual health compared to an information-only website. This study reports on a qualitative evaluation of the trial procedures, describing participants’ experiences and views of the Sexunzipped online trial including methods of recruitment, incentives, methods of contact, and sexual health outcome measurement.

Objective

Our goal was to determine participants’ views of the acceptability and validity of the online trial methodology used in the pilot RCT of the Sexunzipped intervention.

Methods

We used three qualitative data sources to assess the acceptability and validity of the online pilot RCT methodology: (1) individual interviews with 22 participants from the pilot RCT, (2) 133 emails received by the trial coordinator from trial participants, and (3) 217 free-text comments from the baseline and follow-up questionnaires. Interviews were audio-recorded and transcribed verbatim. An iterative, thematic analysis of all three data sources was conducted to identify common themes related to the acceptability and feasibility of the online trial methodology.

Results

Interview participants found the trial design, including online recruitment via Facebook, online registration, email communication with the researchers, and online completion of sexual health questionnaires to be highly acceptable and preferable to traditional methods. Incentives might assist in recruiting those who would not otherwise participate. Participants generally enjoyed taking part in sexual health research online and found the questionnaire itself thought-provoking. Completing the sexual health questionnaires online encouraged honesty in responding that might not be achieved with other methods. The majority of interview participants also thought that receiving and returning a urine sample for chlamydia testing via post was acceptable.

Conclusions

These findings provide strong support for the use of online research methods for sexual health research, emphasizing the importance of careful planning and execution of all trial procedures including recruitment, respondent validation, trial related communication, and methods to maximize follow-up. Our findings suggest that sexual health outcome measurement might encourage reflection on current behavior, sometimes leading to behavior change.

Trial Registration

International Standard Randomized Controlled Trial Number (ISRCTN): 55651027; http://www.controlled-trials.com/isrctn/pf/55651027 (Archived by WebCite at http://www.webcitation.org/6LbkxdPKf).

The Sexunzipped trial: optimizing the design of online randomized controlled trials

Background

Sexual health problems such as unwanted pregnancy and sexually transmitted infection are important public health concerns and there is huge potential for health promotion using digital interventions. Evaluations of digital interventions are increasingly conducted online. Trial administration and data collection online offers many advantages, but concerns remain over fraudulent registration to obtain compensation, the quality of self-reported data, and high attrition.

Objective

This study addresses the feasibility of several dimensions of online trial design—recruitment, online consent, participant identity verification, randomization and concealment of allocation, online data collection, data quality, and retention at 3-month follow-up.

Methods

Young people aged 16 to 20 years and resident in the United Kingdom were recruited to the “Sexunzipped” online trial between November 2010 and March 2011 (n=2036). Participants filled in baseline demographic and sexual health questionnaires online and were randomized to the Sexunzipped interactive intervention website or to an information-only control website. Participants were also randomly allocated to a postal request (or no request) for a urine sample for genital chlamydia testing and receipt of a lower (£10/US$16) or higher (£20/US$32) value shopping voucher compensation for 3-month outcome data.

Results

The majority of the 2006 valid participants (90.98%, 1825/2006) were aged between 18 and 20 years at enrolment, from all four countries in the United Kingdom. Most were white (89.98%, 1805/2006), most were in school or training (77.48%, 1545/1994), and 62.81% (1260/2006) of the sample were female. In total, 3.88% (79/2036) of registrations appeared to be invalid and another 4.00% (81/2006) of participants gave inconsistent responses within the questionnaire. The higher value compensation (£20/US$32) increased response rates by 6-10%, boosting retention at 3 months to 77.2% (166/215) for submission of online self-reported sexual health outcomes and 47.4% (118/249) for return of chlamydia urine samples by post.

Conclusions

It was quick and efficient to recruit young people to this online trial. Our procedures for obtaining online consent, verifying participant identity, automated randomization, and concealment of allocation worked well. The optimal response rate for the online sexual health outcome measurement was comparable to face-to-face trials. Multiple methods of participant contact, requesting online data only, and higher value compensation increased trial retention at 3-month follow-up.

Trial Registration

International Standard Randomized Controlled Trial Number (ISRCTN): 55651027; http://www.controlled-trials.com/ISRCTN55651027 (Archived by WebCite at http://www.webcitation.org/6LbkxdPKf).

Attrition revisited: adherence and retention in a web-based alcohol trial

Background

Attrition is a noted feature of eHealth interventions and trials. In 2005, Eysenbach published a landmark paper calling for a “science of attrition,” suggesting that the 2 forms of attrition—nonusage attrition (low adherence to the intervention) and dropout attrition (poor retention to follow-up)—may be related and that this potential relationship deserved further study.

Objective

The aim of this paper was to use data from an online alcohol trial to explore Eysenbach’s hypothesis, and to answer 3 research questions: (1) Are adherence and retention related? If so, how, and under which circumstances? (2) Do adherence and retention have similar predictors? Can these predictors adequately explain any relationship between adherence and retention or are there additional, unmeasured predictors impacting on the relationship? (3) If there are additional unmeasured predictors impacting on the relationship, are there data to support Eysenbach’s hypothesis that these are related to overall levels of interest?

Methods

Secondary analysis of data from an online trial of an online intervention to reduce alcohol consumption among heavy drinkers. The 2 outcomes were adherence to the intervention measured by number of log-ins, and retention to the trial measured by provision of follow-up data at 3 months (the primary outcome point). Dependent variables were demographic and alcohol-related data collected at baseline. Predictors of adherence and retention were modeled using logistic regression models.

Results

Data were available on 7932 participants. Adherence and retention were related in a complex fashion. Participants in the intervention group were more likely than those in the control group to log in more than once (42% vs 28%, P<.001) and less likely than those in the control group to respond at 3 months (40% vs 49%, P<.001). Within each randomized group, participants who logged in more frequently were more likely to respond than those who logged in less frequently. Response rates in the intervention group for those who logged in once, twice, or ≥3 times were 34%, 46%, and 51%, respectively (P<.001); response rates in the control group for those who logged in once, twice, or ≥3 times were 44%, 60%, and 67%, respectively (P<.001). Relationships between baseline characteristics and adherence and retention were also complex. Where demographic characteristics predicted adherence, they tended also to predict retention. However, characteristics related to alcohol consumption and intention or confidence in reducing alcohol consumption tended to have opposite effects on adherence and retention, with factors that predicted improved adherence tending to predict reduced retention. The complexity of these relationships suggested the existence of an unmeasured confounder.

Conclusions

In this dataset, adherence and retention were related in a complex fashion. We propose a possible explanatory model for these data.

Trial Registration

International Standard Randomized Controlled Trial Number (ISRCTN): 31070347; http://www.controlled-trials.com/ISRCTN31070347 (Archived by WebCite at http://www.webcitation.org/6IEmNnlCn).

Enhancing retention of an Internet-based cohort study of men who have sex with men (MSM) via text messaging: randomized controlled trial

Background

Black and Hispanic men who have sex with men (MSM) are disproportionately affected by HIV in the United States. The Internet is a promising vehicle for delivery of HIV prevention interventions to these men, but retention of MSM of color in longitudinal Internet-based studies has been problematic. Text message follow-up may enhance retention in these studies.

Objective

To compare retention in a 12-month prospective Internet-based study of HIV-negative MSM randomized to receive bimonthly follow-up surveys either through an Internet browser online or through text messages.

Methods

Internet-using MSM were recruited through banner advertisements on social networking and Internet-dating sites. White, black, and Hispanic men who were ≥18, completed an online baseline survey, and returned an at-home HIV test kit, which tested HIV negative, were eligible. Men were randomized to receive follow-up surveys every 2 months on the Internet or by text message for 12 months (unblinded). We used time-to-event methods to compare the rate of loss-to-follow-up (defined as non-response to a follow-up survey after multiple systematically-delivered contact attempts) in the 2 follow-up groups, overall and by race/ethnicity. Results are reported as hazard ratios (HR) and 95% confidence intervals (CI) of the rate of loss-to-follow-up for men randomized to text message follow-up compared to online follow-up.

Results

Of 1489 eligible and consenting men who started the online baseline survey, 895 (60%) completed the survey and were sent an at-home HIV test kit. Of these, 710 of the 895 (79%) returned the at-home HIV test kit, tested HIV-negative, and were followed prospectively. The study cohort comprised 66% white men (470/710), 15% (106/710) black men, and 19% (134/710) Hispanic men. At 12 months, 77% (282/366) of men randomized to online follow-up were retained in the study, compared to 70% (241/344) men randomized to text message follow-up (HR=1.30, 95% CI 0.97-1.73). The rate of loss-to-follow-up was non-significantly higher in the text message arm compared to the online arm for both white (HR=1.43, 95% CI 0.97-1.73) and Hispanic men (HR=1.71, 95% CI 0.91-3.23); however, loss-to-follow-up among black men was non-significantly lower among those who received text message follow-up compared to online follow-up (HR=0.78, 95% CI 0.41-1.50). In the online arm, black men were significantly more likely to be lost to follow-up compared to white men (HR=2.25, 95% CI 1.36-3.71), but this was not the case in the text message arm (HR=1.23, 95% CI 0.70-2.16).

Conclusions

We retained >70% of MSM enrolled in an online study for 12 months; thus, engaging men in online studies for a sufficient time to assess sustained outcomes is possible. Text message follow-up of an online cohort of MSM is feasible, and may result in higher retention among black MSM.

An online randomized controlled trial evaluating HIV prevention digital media interventions for men who have sex with men

Background

As HIV infection continues unabated, there is a need for effective interventions targeting at-risk men who have sex with men (MSM). Engaging MSM online where they meet sexual partners is critical for HIV prevention efforts.

Methods

A randomized controlled trial (RCT) conducted online among U.S. MSM recruited from several gay sexual networking websites assessed the impact of 2 HIV prevention videos and an HIV prevention webpage compared to a control condition for the study outcomes HIV testing, serostatus disclosure, and unprotected anal intercourse (UAI) at 60-day follow-up. Video conditions were pooled due to reduced power from low retention (53%, n = 1,631). No participant incentives were provided.

Principal Findings

Follow-up was completed by 1,631 (53%) of 3,092 eligible men. In the 60 days after the intervention, men in the pooled video condition were significantly more likely than men in the control to report full serostatus disclosure (‘asked and told’) with their last sexual partner (OR 1.32, 95% CI 1.01–1.74). Comparing baseline to follow-up, HIV-negative men in the pooled video (OR 0.70, 95% CI 0.54–0.91) and webpage condition (OR 0.43, 95% CI 0.25–0.72) significantly reduced UAI at follow-up. HIV-positive men in the pooled video condition significantly reduced UAI (OR 0.38, 95% CI 0.20–0.67) and serodiscordant UAI (OR 0.53, 95% CI 0.28–0.96) at follow-up.

Conclusions/Significance

Findings from this online RCT of MSM recruited from sexual networking websites suggest that a low cost, brief digital media intervention designed to engage critical thinking can increase HIV disclosure to sexual partners and decrease sexual risk. Effective, brief HIV prevention interventions featuring digital media that are made widely available may serve as a complementary part of an overall behavioral and biomedical strategy for reducing sexual risk by addressing the specific needs and circumstances of the target population, and by changing individual knowledge, motivations, and community norms.

Trial Registration

ClinicalTrials.gov NCT00649701

Online advertising to reach and recruit Latino smokers to an internet cessation program: impact and costs

BACKGROUND

Tobacco cessation among Latinos is a public health priority in the United States, particularly given the relatively high growth of this population segment. Although a substantial percentage of American Latinos use the Internet, they have not engaged in Web-based cessation programs as readily as other racial/ethnic subgroups. A lack of culturally specific advertising efforts may partly explain this disparity.

OBJECTIVE

Phase I of this study focused on the development of four Spanish-language online banner advertisements to promote a free Spanish-language smoking cessation website (es.BecomeAnEX.org). Phase II examined the relative effectiveness of the four banner ads in reaching and recruiting Latino smokers to the cessation website.

METHODS

In Phase I, 200 Spanish-speaking Latino smokers completed an online survey to indicate their preference for Spanish-language banner ads that incorporated either the cultural value of family (familismo) or fatalism (fatalismo). Ads included variations on message framing (gain vs loss) and depth of cultural targeting (surface vs deep). In Phase II, a Latin square design evaluated the effectiveness of the four preferred ads from Phase I. Ads were systematically rotated across four popular Latino websites (MySpace Latino, MSN Latino, MiGente, and Yahoo! en Español) over four months from August to November 2009. Tracking software recorded ad clicks and registrants on the cessation website. Negative binomial regression and general linear modeling examined the main and interacting effects of message framing and depth of cultural targeting for four outcomes: number of clicks, click-through rate, number of registrants, and cost per registrant.

RESULTS

In Phase I, smokers preferred the four ads featuring familismo. In Phase II, 24,829,007 impressions were placed, yielding 24,822 clicks, an overall click-through rate of 0.10%, and 500 registrants (2.77% conversion rate). Advertising costs totaled US $104,669.49, resulting in an overall cost per click of US $4.22 and cost per registrant of US $209.34. Website placement predicted all four outcomes (all P values < .01). Yahoo! en Español yielded the highest click-through rate (0.167%) and number of registrants (n = 267). The message framing and cultural targeting interaction was not significant. Contrary to hypotheses, loss-framed ads yielded a higher click-through rate than gain-framed ads (point estimate = 1.08, 95% CI 1.03 1.14, P = 0.004), and surface-targeted ads outperformed deep-targeted ads for clicks (point estimate = 1.20, 95% CI 1.13 1.28, P < .001), click-through rate (point estimate = 1.22, 95% CI 1.16 1.29, P < .001), and number of registrants (point estimate = 2.73, 95% CI 2.14 3.48, P < .001).

CONCLUSIONS

Online advertising can be an effective and cost-efficient strategy to reach and engage Spanish-speaking Latino smokers in an evidence-based Internet cessation program. Cultural targeting and smoking-relevant images may be important factors for banner ad design. Online advertising holds potential for Web-based cessation program implementation and research.

Strategies to retain participants in a long-term HIV prevention randomized controlled trial: lessons from the MINTS-II study

Achieving satisfactory retention in online HIV prevention trials typically has proven difficult, particularly over extended timeframes. The overall aim of this study was to assess factors associated with retention in the Men's INTernet Study II (MINTS-II), a randomized controlled trial of a sexual risk reduction intervention for men who have sex with men. Participants were recruited via e-mails and banner advertisements in December, 2007 to participate in the MINTS-II Sexpulse intervention and followed over a 12-month period. Retention across the treatment and control arms was 85.2% at 12 months. Factors associated with higher retention included: randomization to the control arm, previous participation in a study by the research team, e-mail and telephone reminders to complete a survey once it was available online, and fewer e-mail contacts between surveys. The results provide evidence that achieving satisfactory retention is possible in online HIV prevention trials, and suggest best practices for maximizing retention.

HealthMpowerment.org: feasibility and acceptability of delivering an internet intervention to young Black men who have sex with men

Young Black men who have sex with men (BMSM) are disproportionately affected by HIV/AIDS in the USA and continue to experience rapidly increasing HIV incidence. We designed a tailored, theory-based interactive HIV/STI prevention website for young BMSM, called HealthMpowerment.org (HMP) and conducted a small pilot trial comparing HMP to currently available HIV/STI websites. We present findings demonstrating feasibility and acceptability of delivering the intervention to the target population of young BMSM. Retention rates were 90% and 78% at one- and three-month follow-ups, respectively. Evaluation immediately after the intervention's completion revealed that participants who used the HMP website reported high levels of user satisfaction and interest and low levels of website difficulty and frustration. At the end of the intervention, there was a trend in increased behavioral intentions to use condoms and engage in preparatory condom use behaviors in the intervention group compared to the control group (p=0.10). We observed a reduction in mean scores on the CES-D scale among those in the intervention group that was not seen in the control group at the one-month follow-up, though this was not statistically significant. Feedback from exit interviews with study participants suggested that HMP is relevant to the prevention needs of young BMSM. Overall, the findings support the acceptability and feasibility of delivering this prevention program to a group that has few interventions despite bearing a significant burden of the epidemic. Future trials, combining Internet and mobile phone technologies, are planned to test HMP among larger and more diverse populations of young BMSM.

Finding social phobia patients from the Internet

Patients with social phobia commonly resist face-to-face assessments, and a number of alternative assessment methods based on the Internet are being developed. The aim of this study was to identify patients with social phobia on the Internet and characterize their condition, using the Social Phobia Inventory (SPIN). In Stage I, this study recruited 1307 participants from the Internet, most of whom were well-educated young females, who had remained unmarried and unemployed. The Internet-based SPIN demonstrated excellent internal consistency (Cronbach's α=0.937) and good test-retest reliability (intraclass correlation coefficient=0.942). In Stage II, we examined the discriminant validity of the SPIN via structured telephone interviews. The area under the receiver operating characteristic curve used to discriminate social phobia was 0.871 with an optimal cut-off point of 24 on the total score for the SPIN. According to the SPIN scores, 919 of Stage I participants (70.3%) reached the threshold of social phobia, 531 of which (57.8%) had never sought professional help. These results suggest that the Internet is a potential avenue through which to find untreated patients with social phobia.

Case study: An ethics case study of HIV prevention research on Facebook: the Just/Us study

OBJECTIVE

To consider issues related to research with youth on social networking sites online.

METHODS

Description of the data collection process from 1,588 participants in a randomized controlled trial testing the efficacy of HIV prevention education delivered on Facebook. Using respondent-driven sampling, staff-recruited participants are encouraged to recruit up to three friends to enroll in the study.

RESULTS

Researchers should (a) consider whether an online social networking site is an appropriate place to implement a research study; (b) offer opportunities to review informed consent documents at multiple times and in multiple locations throughout the study; and (c) collect data outside the social networking site and store it behind secure firewalls to ensure it will not be accessible to any person on the social networking site.

CONCLUSIONS

Online social networks are growing in popularity. Conducting research on social media sites requires deliberate attention to consent, confidentiality, and security.

Boys must be men, and men must have sex with women: a qualitative CBPR study to explore sexual risk among African American, Latino, and White gay men and MSM

Men who have sex with men (MSM) continue to be disproportionately affected by HIV and sexually transmitted diseases. This study was designed to explore sexual risk among MSM using community-based participatory research (CBPR). An academic-community partnership conducted nine focus groups with 88 MSM. Participants self-identified as African American/Black (n=28), Hispanic/Latino (n=33), White (n=21), and biracial/ethnic (n=6). The mean age was 27 years (range=18-60 years). Grounded theory was used. Twelve themes related to HIV risk emerged, including low knowledge of HIV and sexually transmitted diseases, particularly among Latino MSM and MSM who use the Internet for sexual networking; stereotyping of African American MSM as sexually "dominant" and Latino MSM as less likely to be HIV infected; and the eroticization of "barebacking." Twelve intervention approaches also were identified, including developing culturally congruent programming using community-identified assets, harnessing social media used by informal networks of MSM, and promoting protection within the context of intimate relationships. A community forum was held to develop recommendations and move these themes to action.

Increased HIV disclosure three months after an online video intervention for men who have sex with men (MSM)

A behavioral intervention for men who have sex with men (MSM) was created for online delivery. The nine-minute video drama "The Morning After" (www.hivbigdeal.org) was designed to promote critical thinking about HIV risk. MSM were recruited for the evaluation through banner ads on a subscription-based gay sexual meeting web site. Participants viewed the intervention online and completed online behavioral questionnaires at enrollment and three month follow-up. Each participant served as his own control. No participant incentives were provided. Follow-up was completed by 522 (54%) of 971 eligible men. Men completing follow-up were similar to those who did not by age and prevalence of unprotected anal intercourse (UAI) but reported more lifetime sex partners. They also differed somewhat by race, education, and HIV testing. In the three months after the intervention, men were significantly more likely to disclose HIV status to partners (odds ratio [OR] = 3.37, p<0.001) and less likely to report a casual partner or UAI in their most recent sexual encounter than at baseline. Of 120 men HIV tested during follow-up, 17 (14%) reported being HIV seropositive. These findings show that MSM at high risk for HIV will participate in a brief online video intervention designed to engage critical thinking and that significant, self-reported increases in HIV disclosure and decreases in risk behavior occurred three months after MSM viewed the video.

Innovation in sexually transmitted disease and HIV prevention: internet and mobile phone delivery vehicles for global diffusion

PURPOSE OF REVIEW

Efficacious behavioral interventions and practices have not been universally accepted, adopted, or diffused by policy makers, administrators, providers, advocates, or consumers. Biomedical innovations for sexually transmitted disease (STD) and HIV prevention have been embraced but their effectiveness is hindered by behavioral factors. Behavioral interventions are required to support providers and consumers for adoption and diffusion of biomedical innovations, protocol adherence, and sustained prevention for other STDs. Information and communication technology such as the Internet and mobile phones can deliver behavioral components for STD/HIV prevention and care to more people at less cost.

RECENT FINDINGS

Recent innovations in STD/HIV prevention with information and communication technology-mediated behavioral supports include STD/HIV testing and partner interventions, behavioral interventions, self-management, and provider care. Computer-based and Internet-based behavioral STD/HIV interventions have demonstrated efficacy comparable to face-to-face interventions. Mobile phone STD/HIV interventions using text-messaging are being broadly utilized but more work is needed to demonstrate efficacy. Electronic health records and care management systems can improve care, but interventions are needed to support adoption.

SUMMARY

Information and communication technology is rapidly diffusing globally. Over the next 5-10 years smart-phones will be broadly disseminated, connecting billions of people to the Internet and enabling lower cost, highly engaging, and ubiquitous STD/HIV prevention and treatment support interventions.

PowerON: the use of instant message counseling and the Internet to facilitate HIV/STD education and prevention

OBJECTIVE

In recent years, Internet-based or online counseling has emerged as an effective way to assess psychological disorders and discuss destructive behaviors with individuals or groups of individuals. This study explores the application of online counseling to HIV/STD risk-taking behavior among men who have sex with men (MSM).

METHODS

PowerON, an organization that provides sexual health information to MSM exclusively online, used instant message technology to counsel MSM in real time through computer-mediated means. A sample of 279 transcripts of instant message exchanges between PowerON counselors and Gay.com users were recorded and qualitatively analyzed.

RESULTS

Approximately 43% of the instant message sessions discussed information about HIV/STD testing. Risk-taking behaviors were addressed in 39% of the sessions. Information about HIV/STDs and general counseling were given in 23% and 18% of the counseling sessions, respectively.

CONCLUSION

The data showed these instant message sessions to be a potentially feasible forum for HIV/STD counseling.

PRACTICE IMPLICATIONS

Information ordinarily disseminated at health clinics could be successfully distributed through the Internet to MSM.

Effects of an Internet-based intervention for HIV prevention: the Youthnet trials

Youth use the Internet and computers in unprecedented numbers. We have yet to identify interventions that can reach and retain large numbers of diverse youth online and demonstrate HIV prevention efficacy. We tested a single session condom promotion Internet intervention for 18-24 year olds in two RCTs: one sample recruited online and one recruited in clinics. All study elements were carried out on the Internet. Using repeated measures structural equation models we analyzed change in proportion of sex acts protected by condoms (PPA) over time. Among sexually active youth in the Internet sample, persons exposed to the intervention had very slight increases in condom norms, and this was the only factor impacting PPA. We saw no intervention effects in the clinic sample. Internet-based interventions need to be more intensive to see greater effects. We need to do more to reach high risk youth online and keep their attention for multiple sessions.