Potential and Challenges in Collecting Social and Behavioral Data on Adolescent Alcohol Norms: Comparing Respondent-Driven Sampling and Web-Based Respondent-Driven Sampling

Combating Fraudulent Participation in Urban American Indian and Alaska Native Virtual Health Research: Protocol for Increasing Data Integrity in Online Research (PRIOR)

BACKGROUND

While the advantages of using the internet and social media for research recruitment are well documented, the evolving online environment also enhances motivations for misrepresentation to receive incentives or to "troll" research studies. Such fraudulent assaults can compromise data integrity, with substantial losses in project time; money; and especially for vulnerable populations, research trust. With the rapid advent of new technology and ever-evolving social media platforms, it has become easier for misrepresentation to occur within online data collection. This perpetuation can occur by bots or individuals with malintent, but careful planning can help aid in filtering out fraudulent data.

OBJECTIVE

Using an example with urban American Indian and Alaska Native young women, this paper aims to describe PRIOR (Protocol for Increasing Data Integrity in Online Research), which is a 2-step integration protocol for combating fraudulent participation in online survey research.

METHODS

From February 2019 to August 2020, we recruited participants for formative research preparatory to an online randomized control trial of a preconceptual health program. First, we described our initial protocol for preventing fraudulent participation, which proved to be unsuccessful. Then, we described modifications we made in May 2020 to improve the protocol performance and the creation of PRIOR. Changes included transferring data collection platforms, collecting embedded geospatial variables, enabling timing features within the screening survey, creating URL links for each method or platform of data collection, and manually confirming potentially eligible participants' identifying information.

RESULTS

Before the implementation of PRIOR, the project experienced substantial fraudulent attempts at study enrollment, with less than 1% (n=6) of 1300 screened participants being identified as truly eligible. With the modified protocol, of the 461 individuals who completed a screening survey, 381 did not meet the eligibility criteria assessed on the survey. Of the 80 that did, 25 (31%) were identified as ineligible via PRIOR. A total of 55 (69%) were identified as eligible and verified in the protocol and were enrolled in the formative study.

CONCLUSIONS

Fraudulent surveys compromise study integrity, validity of the data, and trust among participant populations. They also deplete scarce research resources including respondent compensation and personnel time. Our approach of PRIOR to prevent online misrepresentation in data was successful. This paper reviews key elements regarding fraudulent data participation in online research and demonstrates why enhanced protocols to prevent fraudulent data collection are crucial for building trust with vulnerable populations.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04376346; https://www.clinicaltrials.gov/study/NCT04376346.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52281.

Identifying the Most Effective Recruitment Strategy Using Financial Reimbursements for a Web-Based Peer Network Study With Young People Aged 16-18 Years: Protocol for a Randomized Controlled Trial

BACKGROUND

Peers are an important determinant of health and well-being during late adolescence; however, there is limited quantitative research examining peer influence. Previous peer network research with adolescents faced methodological limitations and difficulties recruiting young people.

OBJECTIVE

This study aims to determine whether a web-based peer network survey is effective at recruiting adolescent peer networks by comparing 2 strategies for reimbursement.

METHODS

This study will use a 2-group randomized trial design to test the effectiveness of reimbursements for peer referral in a web-based cross-sectional peer network survey. Young people aged 16-18 years recruited through Instagram, Snapchat, and a survey panel will be randomized to receive either scaled group reimbursement (the experimental group) or fixed individual reimbursement (the control group). All participants will receive a reimbursement of Aus $5 (US $3.70) for their own survey completion. In the experimental group (scaled group reimbursement), all participants within a peer network will receive an additional Aus $5 (US $3.70) voucher for each referred participant who completes the study, up to a maximum total value of Aus $30 (US $22.20) per participant. In the control group (fixed individual reimbursement), participants will only be reimbursed for their own survey completion. Participants' peer networks are assessed during the survey by asking about their close friends. A unique survey link will be generated to share with the participant's nominated friends for the recruitment of secondary participants. Outcomes are the proportion of a participant's peer network and the number of referred peers who complete the survey. The required sample size is 306 primary participants. Using a multilevel logistic regression model, we will assess the effect of the reimbursement intervention on the proportion of primary participants' close friends who complete the survey. The secondary aim is to determine participant characteristics that are associated with successfully recruiting close friends. Young people aged 16-18 years were involved in the development of the study design through focus groups and interviews (n=26).

RESULTS

Participant recruitment commenced in 2022.

CONCLUSIONS

A longitudinal web-based social network study could provide important data on how social networks and their influence change over time. This trial aims to determine whether scaled group reimbursement can increase the number of peers referred. The outcomes of this trial will improve the recruitment of young people to web-based network studies of sensitive health issues.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/44813.

Design and implementation of a web-based, respondent-driven sampling solution

BACKGROUND

Respondent-driven sampling (RDS) refers both to a chain-referral sampling method and an analytical model for analysing sampled data. Web-based respondent-driven sampling (webRDS) uses internet-based recruitment coupled with an electronic survey to carry out RDS studies; there is currently no commercially available webRDS solution. We designed and developed a webRDS solution to support a research study aimed at estimating conflict-attributable mortality in Yemen. Our webRDS solution is composed of an existing survey platform (i.e. ODK) and a bespoke RDS system. The RDS system is designed to administer and manage an RDS survey cascade and includes: (1) an application programming interface, (2) a study participant client, and (3) an administrator interface. We report here on the design of the webRDS solution and its implementation.

RESULTS

We consulted members of the Yemeni diaspora throughout the development of the solution. Technical obstacles were largely the result of: WhatsApp's policies on bulk messaging and automated messaging behaviour, the inherent constraints of SMS messaging, and SMS filtering behaviour. Language support was straight-forward yet time consuming. Survey uptake was lower than expected. Factors which may have impacted uptake include: our use of consumable survey links, low interest amongst the diaspora population, lack of material incentives, and the length and subject matter of the survey itself. The SMS/WhatsApp messaging integration was relatively complex and limited the information we could send potential participants.

CONCLUSION

Despite lower-than expected survey uptake we believe our webRDS solution provides efficient and flexible means to survey a globally diverse population.

Improving web-based respondent-driven sampling performance among men who have sex with men in the Netherlands

Respondent-driven sampling (RDS) uses the social network of participants to sample people of populations that can be challenging to engage. While in this context RDS offers improvements on standard sampling methods, it does not always generate a sufficiently large sample. In this study we aimed to identify preferences of men who have sex with men (MSM) in the Netherlands regarding surveys and recruitment to studies with the subsequent goal of improving the performance of web-based RDS in MSM. A questionnaire about preferences with respect to various aspects of an web-based RDS study was circulated among participants of the Amsterdam Cohort Studies, a study among MSM. The duration of a survey and the type and amount of participation reward were explored. Participants were also asked about their preferences regarding invitation and recruitment methods. We used multi-level and rank-ordered logistic regression to analyze the data and identify the preferences. The majority of the 98 participants were older than 45 years (59.2%), were born in the Netherlands (84.7%), and had a university degree (77.6%). Participants did not have a preference regarding the type of participation reward, but they preferred to spend less time on a survey and to get a higher monetary reward. Sending a personal email was the preferred option to getting invited or inviting someone to a study, while using Facebook messenger was the least preferred option. There are differences between age groups: monetary rewards were less important to older participants (45+) and younger participants (18-34) more often preferred SMS/WhatsApp to recruit others. When designing a web-based RDS study for MSM, it is important to balance the duration of the survey and the monetary reward. If the study takes more of a participants time, it might be beneficial to provide a higher incentive. To optimize expected participation, the recruitment method should be selected based on the targeted population group.

Incorporating respondent-driven sampling into web-based discrete choice experiments: preferences for COVID-19 mitigation measures

To slow the spread of COVID-19, most countries implemented stay-at-home orders, social distancing, and other nonpharmaceutical mitigation strategies. To understand individual preferences for mitigation strategies, we piloted a web-based Respondent Driven Sampling (RDS) approach to recruit participants from four universities in three countries to complete a computer-based Discrete Choice Experiment (DCE). Use of these methods, in combination, can serve to increase the external validity of a study by enabling recruitment of populations underrepresented in sampling frames, thus allowing preference results to be more generalizable to targeted subpopulations. A total of 99 students or staff members were invited to complete the survey, of which 72% started the survey (n = 71). Sixty-three participants (89% of starters) completed all tasks in the DCE. A rank-ordered mixed logit model was used to estimate preferences for COVID-19 nonpharmaceutical mitigation strategies. The model estimates indicated that participants preferred mitigation strategies that resulted in lower COVID-19 risk (i.e. sheltering-in-place more days a week), financial compensation from the government, fewer health (mental and physical) problems, and fewer financial problems. The high response rate and survey engagement provide proof of concept that RDS and DCE can be implemented as web-based applications, with the potential for scale up to produce nationally-representative preference estimates.

Telephone peer recruitment and interviewing during a respondent-driven sampling (RDS) survey: feasibility and field experience from the first phone-based RDS survey among men who have sex with men in Côte d'Ivoire

Background

Many respondent-driven sampling (RDS) methodologies have been employed to investigate hard-to-reach populations; however, these methodologies present some limits. We describe a minimally investigated RDS methodology in which peer recruitment and interviewing are phone-based. The feasibility of the methodology, field experiences, validity of RDS assumptions and characteristics of the sample obtained are discussed.

Methods

We conducted a phone-based RDS survey among men who have sex with men (MSM) aged 18 or above and living in Côte d’Ivoire. Eight initial MSM across Côte d’Ivoire were selected. Participants were asked to call a hotline to be registered and interviewed by phone. After the participants completed the questionnaire, they were asked to recruit a maximum of 3 MSM from their acquaintances.

Results

During the 9 months of the survey, 576 individuals called the hotline, and 518 MSM completed the questionnaire. The median delay between the invitation to participate and the completion of the questionnaire by peer-recruited MSM was 4 days [IQR: 1–12]. The recruitment process was not constant, with high variation in the number of people who called the hotline during the survey period.

RDS chain convergence to equilibrium was reached within 6 waves for most of the selected variables. For the network size estimation assumption, participants who incorrectly estimated their network size were observed.

Regarding the sample obtained, MSM were recruited from all the regions of Côte d’Ivoire with frequent interregional recruitment; 23.5% of MSM were recruited by someone who does not live in the same region. Compared to the MSM who participated in two other surveys in Côte d’Ivoire, the MSM in our sample were less likely to know about an MSM non-governmental organisation. However, MSM aged 30 years old and above and those with a low level of education were underrepresented in our sample.

Conclusion

We show that phone-based RDS surveys among MSM are feasible in the context of sub-Saharan Africa. Compared to other classical RDS survey methodologies, the phone-based RDS methodology seems to reduce selection bias based on geography and proximity with the MSM community. However, similar to other methodologies, phone-based RDS fails to reach older and less-educated MSM.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-021-01208-x.

Applications and Recruitment Performance of Web-Based Respondent-Driven Sampling: Scoping Review

BACKGROUND

Web-based respondent-driven sampling is a novel sampling method for the recruitment of participants for generating population estimates, studying social network characteristics, and delivering health interventions. However, the application, barriers and facilitators, and recruitment performance of web-based respondent-driven sampling have not yet been systematically investigated.

OBJECTIVE

Our objectives were to provide an overview of published research using web-based respondent-driven sampling and to investigate factors related to the recruitment performance of web-based respondent-driven sampling.

METHODS

We conducted a scoping review on web-based respondent-driven sampling studies published between 2000 and 2019. We used the process evaluation of complex interventions framework to gain insights into how web-based respondent-driven sampling was implemented, what mechanisms of impact drove recruitment, what the role of context was in the study, and how these components together influenced the recruitment performance of web-based respondent-driven sampling.

RESULTS

We included 18 studies from 8 countries (high- and low-middle income countries), in which web-based respondent-driven sampling was used for making population estimates (n=12), studying social network characteristics (n=3), and delivering health-related interventions (n=3). Studies used web-based respondent-driven sampling to recruit between 19 and 3448 participants from a variety of target populations. Studies differed greatly in the number of seeds recruited, the proportion of successfully recruiting participants, the number of recruitment waves, the type of incentives offered to participants, and the duration of data collection. Studies that recruited relatively more seeds, through online platforms, and with less rigorous selection procedures reported relatively low percentages of successfully recruiting seeds. Studies that did not offer at least one guaranteed material incentive reported relatively fewer waves and lower percentages of successfully recruiting participants. The time of data collection was shortest in studies with university students.

CONCLUSIONS

Web-based respondent-driven sampling can be successfully applied to recruit individuals for making population estimates, studying social network characteristics, and delivering health interventions. In general, seed and peer recruitment may be enhanced by rigorously selecting and motivating seeds, offering at least one guaranteed material incentive, and facilitating adequate recruitment options regarding the target population's online connectedness and communication behavior. Potential trade-offs should be taken into account when implementing web-based respondent-driven sampling, such as having less opportunities to implement rigorous seed selection procedures when recruiting many seeds, as well as issues around online rather than physical participation, such as the risk of cheaters participating repeatedly.

Social media recruitment for mental health research: A systematic review

BACKGROUND

Social media holds exciting promise for advancing mental health research recruitment, however, the extent and efficacy to which these platforms are currently in use are underexplored.

OBJECTIVE

A systematic review was conducted to characterize the current use and efficacy of social media in recruiting participants for mental health research.

METHOD

A literature review was performed using MEDLINE, EMBASE, and PsychINFO. Only non-duplicative manuscripts written in the English language and published between 1/1/2004-3/31/2019 were selected for further screening. Data extracted included study type and design, participant inclusion criteria, social media platform, advertising strategy, final recruited sample size, recruitment location, year, monetary incentives, comparison to other recruitment methods if performed, and final cost per participant.

RESULTS

A total of 176 unique studies that used social media for mental health research recruitment were reviewed. The majority of studies were cross-sectional (62.5%) in design and recruited adults. Facebook was overwhelmingly the recruitment platform of choice (92.6%), with the use of paid advertisements being the predominant strategy (60.8%). Of the reviewed studies, substance abuse (43.8%) and mood disorders (15.3%) were the primary subjects of investigation. In 68.3% of studies, social media recruitment performed as well as or better than traditional recruitment methods in the number and cost of final enrolled participants. The majority of studies used Facebook for recruitment at a median cost per final recruited study participant of $19.47. In 55.6% of the studies, social media recruitment was the more cost-effective recruitment method when compared to traditional methods (e.g., referrals, mailing).

CONCLUSION

Social media appears to be an effective and economical recruitment tool for mental health research. The platform raises methodological and privacy concerns not covered in current research regulations that warrant additional consideration.

Influences of club connectedness among young adults in Western Australian community-based sports clubs

BACKGROUND

Along with physical benefits, community-based sport provides opportunities to enhance connectedness, an important protective factor of social and emotional health. However, young Australians participating in sport have been found to drink alcohol at higher levels than their non-sporting peers, and many clubs serve unhealthy food and beverages. This study explored the association between the dependent variable, level of alcohol consumption (AUDIT-C) and connectedness to club and other health behaviours among young people aged 18-30 years who play club sport in Western Australia.

METHODS

An online cross sectional survey measured levels of alcohol consumption (AUDIT-C), alcohol-related harm, connectedness (including volunteering and team cohesion), mental wellbeing, healthy food options and club sponsorship among young adults aged 18-30 years involved in sports clubs in Western Australia (n = 242). Relationships and association between the dependent variable (AUDIT-C) and independent variables were assessed.

RESULTS

Male sportspeople were more likely to drink alcohol at high-risk levels than females (p < .001), and respondents belonging to a club that received alcohol-related sponsorship were more likely to drink at high-risk levels (p = .019). Females were significantly more likely to want healthy food and beverage options provided at their clubs (p = 0.011). When all factors were considered team cohesion (p = 0.02), alcohol expectations (p = < .001), occurrences of experienced alcohol-related harm (p = <.001) and length of club membership (p = 0.18) were significant predictors of high-risk AUDIT-C (R2 = .34, adjusted R2 = .33, F (4, 156) = 20.43, p = <.001). High-risk AUDIT-C and club connectedness predicted strong team cohesion (R2 = .39, adjusted R2 = .39, F (2, 166) = 53.74, p = <.001).

CONCLUSIONS

Findings from this study may inform policy and practice to enhance healthy behaviours among young adults participating in community sports clubs in Australia and other countries.

Evaluation of Different Recruitment Methods: Longitudinal, Web-Based, Pan-European Physical Activity Through Sustainable Transport Approaches (PASTA) Project

Background

Sufficient sample size and minimal sample bias are core requirements for empirical data analyses. Combining opportunistic recruitment with a Web-based survey and data-collection platform yields new benefits over traditional recruitment approaches.

Objective

This paper aims to report the success of different recruitment methods and obtain data on participants’ characteristics, participation behavior, recruitment rates, and representativeness of the sample.

Methods

A longitudinal, Web-based survey was implemented as part of the European PASTA (Physical Activity through Sustainable Transport Approaches) project, between November 2014 and December 2016. During this period, participants were recruited from 7 European cities on a rolling basis. A standardized guide on recruitment strategy was developed for all cities, to reach a sufficient number of adult participants. To make use of the strengths and minimize weakness, a combination of different opportunistic recruitment methods was applied. In addition, the random sampling approach was applied in the city of Örebro. To reduce the attrition rate and improve real-time monitoring, the Web-based platform featured a participant’s and a researchers’ user interface and dashboard.

Results

Overall, 10,691 participants were recruited; most people found out about the survey through their workplace or employer (2300/10691, 21.51%), outreach promotion (2219/10691, 20.76%), and social media (1859/10691, 17.39%). The average number of questionnaires filled in per participant varied significantly between the cities (P<.001), with the highest number in Zurich (11.0, SE 0.33) and the lowest in Örebro (4.8, SE 0.17). Collaboration with local organizations, the use of Facebook and mailing lists, and direct street recruitment were the most effective approaches in reaching a high share of participants (P<.001). Considering the invested working hours, Facebook was one of the most time-efficient methods. Compared with the cities’ census data, the composition of study participants was broadly representative in terms of gender distribution; however, the study included younger and better-educated participants.

Conclusions

We observed that offering a mixed recruitment approach was highly effective in achieving a high participation rate. The highest attrition rate and the lowest average number of questionnaires filled in per participant were observed in Örebro, which also recruited participants through random sampling. These findings suggest that people who are more interested in the topic are more willing to participate and stay in a survey than those who are selected randomly and may not have a strong connection to the research topic. Although direct face-to-face contacts were very effective with respect to the number of recruited participants, recruiting people through social media was not only effective but also very time efficient. The collected data are based on one of the largest recruited longitudinal samples with a common recruitment strategy in different European cities.

Prevalence and correlates of hazardous alcohol consumption and binge drinking among men who have sex with men (MSM) in San Francisco

Objectives

To describe heavy alcohol use patterns and correlates in a diverse sample of MSM.

Methods

We used respondent-driven sampling (RDS) to enroll 252 alcohol-using MSM in San Francisco from March 2015-July 2017. We examined heavy alcohol use patterns and conducted RDS-adjusted multivariable analyses to characterize correlates of hazardous alcohol consumption and binge drinking.

Results

RDS-adjusted prevalence of weekly and at least weekly binge drinking was 24.9% and 19.3%, respectively. Hazardous consumption was common; prevalence of mid- and high-levels of hazardous drinking was 11.4% and 29.9%, respectively. In multivariable analyses, identifying as Hispanic/Latino or mixed/other race; being moderately or extremely interested in reducing alcohol use; ever receiving alcohol treatment; using ecstasy; reporting syphilis diagnosis; and having more than 5 male partners were independently associated with hazardous alcohol consumption. Less hazardous consumption was associated with having a bachelor's degree or completing post-graduate studies; and not being in a relationship. Reporting chlamydia infection; being somewhat, moderately or extremely interested in reducing alcohol use; and having multiple male sex partners were associated with higher odds of at least weekly binge drinking. Lower odds of binge drinking were associated with completing post-graduate studies. Moreover, for the outcomes of hazardous alcohol consumption and binge-drinking, we observed significant interaction effects between race/ethnicity and interest in reducing alcohol, past receipt of alcohol treatment, use of ecstasy, syphilis diagnosis, and number of male partners.

Conclusion

Among alcohol-using MSM in San Francisco, heavy drinking patterns were common and independently associated with greater number of male sexual partners and sexually transmitted infections (STI). Moreover, significant racial/ethnic and socioeconomic disparities related to heavy alcohol use were observed and race/ethnicity modified the effect of the risk factors associated with these outcomes. These findings underscore the need to develop more MSM-specific interventions that jointly address heavy alcohol use and HIV/STI risk, as well as culturally-tailored and targeted strategies to alleviate health disparities.

Predictors of Timely Prenatal Care Initiation and Adequate Utilization in a Sample of Late Adolescent Texas Latinas

INTRODUCTION

Little is known of late adolescent Texas Latinas' prenatal care perceptions or how these perceptions predict timely prenatal care initiation or adequate utilization. Hence, the purpose of this study is to describe and compare these perceptions between participants with timely versus late prenatal care initiation and adequate, intermediate, and inadequate prenatal care utilization; and to determine predictors of timely prenatal care initiation and adequate utilization.

METHODS

Fifty-four postpartum Latinas were recruited through social media. Eligibility criteria were 18 to 21 years old, Texas-born, primiparous, uncomplicated pregnancy/delivery, and English literate. Prenatal care perceptions were measured with the Revised Better Babies Survey and Access Barriers to Care Index.

RESULTS

Participants had favorable views of prenatal care benefits; however, not living with the baby's father predicted inadequate prenatal care, Wald χ²(1) = 4.93, p = .026. Perceived benefits of timely and adequate prenatal care predicted timely prenatal care initiation, χ²(1) = 7.47, p = .006. Self-reported depression during pregnancy predicted timely entry into prenatal care, χ²(1) = 4.73, p = .03.

CONCLUSION

Participants' positive prenatal care perceptions did not predict adequate prenatal care utilization, indicating that barriers serve as powerful obstacles in late adolescent Texas Latinas.