1
|
Diexer S, Teslya A, Buskens V, Matser A, Stein M, Kretzschmar ME. Improving web-based respondent-driven sampling performance among men who have sex with men in the Netherlands. PLOS DIGITAL HEALTH 2023; 2:e0000192. [PMID: 36812647 PMCID: PMC9931300 DOI: 10.1371/journal.pdig.0000192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Accepted: 01/04/2023] [Indexed: 02/11/2023]
Abstract
Respondent-driven sampling (RDS) uses the social network of participants to sample people of populations that can be challenging to engage. While in this context RDS offers improvements on standard sampling methods, it does not always generate a sufficiently large sample. In this study we aimed to identify preferences of men who have sex with men (MSM) in the Netherlands regarding surveys and recruitment to studies with the subsequent goal of improving the performance of web-based RDS in MSM. A questionnaire about preferences with respect to various aspects of an web-based RDS study was circulated among participants of the Amsterdam Cohort Studies, a study among MSM. The duration of a survey and the type and amount of participation reward were explored. Participants were also asked about their preferences regarding invitation and recruitment methods. We used multi-level and rank-ordered logistic regression to analyze the data and identify the preferences. The majority of the 98 participants were older than 45 years (59.2%), were born in the Netherlands (84.7%), and had a university degree (77.6%). Participants did not have a preference regarding the type of participation reward, but they preferred to spend less time on a survey and to get a higher monetary reward. Sending a personal email was the preferred option to getting invited or inviting someone to a study, while using Facebook messenger was the least preferred option. There are differences between age groups: monetary rewards were less important to older participants (45+) and younger participants (18-34) more often preferred SMS/WhatsApp to recruit others. When designing a web-based RDS study for MSM, it is important to balance the duration of the survey and the monetary reward. If the study takes more of a participants time, it might be beneficial to provide a higher incentive. To optimize expected participation, the recruitment method should be selected based on the targeted population group.
Collapse
Affiliation(s)
- Sophie Diexer
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- * E-mail:
| | - Alexandra Teslya
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Vincent Buskens
- Department of Sociology, Utrecht University, Utrecht, The Netherlands
| | - Amy Matser
- Department of Infectious Diseases, Public Health Service (GGD) of Amsterdam, Amsterdam, The Netherlands
- Department of Internal Medicine, Amsterdam Institute for Infection and Immunity, Amsterdam UMC, Academic Medical Center, Amsterdam, The Netherlands
| | - Mart Stein
- National Coordination Centre for Communicable Disease Control, Centre for Infectious Disease Control, National Institute for Public Health and the Environment, Bilthoven, The Netherlands
| | - Mirjam E. Kretzschmar
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
2
|
Reyes-Lacalle A, Carnicer-Pont D, Masvidal MG, Montero-Pons L, Cabedo-Ferreiro R, Falguera-Puig G. Prevalence and Characterization of Undiagnosed Youths at Risk of Chlamydia trachomatis Infection: A Cross-sectional Study. J Low Genit Tract Dis 2022; 26:223-228. [PMID: 35584026 PMCID: PMC9232277 DOI: 10.1097/lgt.0000000000000682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE The aim of this study was to determine the prevalence of Chlamydia trachomatis infection in undiagnosed young people aged between 15 and 24 years. MATERIALS AND METHODS A convenience sample of 623 youths, with a mean (SD) age of 20.1 (2.2) years, was recruited from key spaces in the North Metropolitan area of Barcelona in Catalonia, Spain. Participants completed a 21-item questionnaire and provided a urine sample or vaginal swab for testing. RESULTS The most common age at the first sexual intercourse was 16 years (24.6%), followed by 15 years (21.3%). Only 32.6% reported always use of condoms, 49.2% sometimes, and 15.6% never. A positive test for chlamydia was found in 34 participants (5.5%; 95% CI, 3.8-7.5), with no difference by sex. A positive test was significantly more common among the participants who were working, who had been diagnosed with a sexually transmitted disease (STD) at some point in their life, and who used web pages/apps to find new sexual partners more than once a month. In the multivariate analysis, working status was an independent factor associated with chlamydial infection (adjusted odds ratio[OR], 8.88; 95% CI, 1.71-46.17), whereas not having been previously diagnosed with an STD (OR, 0.34; 95% CI, 0.07-1.49) and never using the Internet to find sexual partners (OR, 0.16; 95% CI, 0.03-080) were protective factors against chlamydial infection. CONCLUSIONS The prevalence of C. trachomatis infection was 5.5%. Working status, a previous diagnosis of STD, and use of the Internet to find new sexual partners were associated with chlamydial test positivity.
Collapse
Affiliation(s)
- Azahara Reyes-Lacalle
- Atenció a la Salut Sexual I Reproductiva Sabadell, Direcció d'Atenció Primària Metropolitana Nord, Institut Catalá de la Salut (ICS), Barcelona, Spain
- Research Group Atenció a la Salut Sexual i Reproductiva (GRASSIR), Institut Universitari d'Investigació en Atenció Primària Jordi Gol (IDIAP Jordi Gol), Barcelona, Spain
| | - Dolors Carnicer-Pont
- Research Group Atenció a la Salut Sexual i Reproductiva (GRASSIR), Institut Universitari d'Investigació en Atenció Primària Jordi Gol (IDIAP Jordi Gol), Barcelona, Spain
- Programa de Prevenció i Control del Cancer, Institut Catalá d'Oncologia/WHO Collaborating Center for Tobacco Control, L'Hospitalet de Llobregat, Barcelona, Spain
| | - Miriam Gómez Masvidal
- Research Group Atenció a la Salut Sexual i Reproductiva (GRASSIR), Institut Universitari d'Investigació en Atenció Primària Jordi Gol (IDIAP Jordi Gol), Barcelona, Spain
- Atenció a la Salut Sexual I Reproductiva Mataról, Direcció d'Atenció Primària Metropolitana Nord, Institut Catalá de la Salut (ICS), Barcelona, Spain
| | - Laura Montero-Pons
- Research Group Atenció a la Salut Sexual i Reproductiva (GRASSIR), Institut Universitari d'Investigació en Atenció Primària Jordi Gol (IDIAP Jordi Gol), Barcelona, Spain
- Atenció a la Salut Sexual I Reproductiva Santa Coloma de Grameenet, Direcció d'Atenció Primària Metropolitana Nord, Institut Catalá de la Salut (ICS), Barcelona, Spain
| | - Rosa Cabedo-Ferreiro
- Research Group Atenció a la Salut Sexual i Reproductiva (GRASSIR), Institut Universitari d'Investigació en Atenció Primària Jordi Gol (IDIAP Jordi Gol), Barcelona, Spain
- Atenció a la Salut Sexual I Reproductiva Granollers, Direcció d'Atenció Primària Metropolitana Nord, Institut Catalá de la Salut (ICS), Barcelona, Spain
| | - Gemma Falguera-Puig
- Research Group Atenció a la Salut Sexual i Reproductiva (GRASSIR), Institut Universitari d'Investigació en Atenció Primària Jordi Gol (IDIAP Jordi Gol), Barcelona, Spain
- Responsable Atenció a la Salut Sexual I Reproductiva, Direcció d'Atenció Primària Metropolitana Nord, Institut Catalá de la Salut (ICS), Barcelona, Spain
| |
Collapse
|
3
|
Leenen J, Hoebe CJPA, Bos AER, Wolffs PFG, van Loo IHM, de Wit JBF, Jonas KJ, Dukers-Muijrers NHTM. Systematic Development of an Intervention to Promote Self-Sampling for HIV and Sexually Transmitted Infections for Men Who Have Sex With Men: An Intervention Mapping Approach. FRONTIERS IN REPRODUCTIVE HEALTH 2021; 3:634032. [DOI: 10.3389/frph.2021.634032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 03/17/2021] [Indexed: 11/13/2022] Open
Abstract
Sexual healthcare aims to reduce HIV and sexually transmitted infections (STIs) by promoting testing and prevention. To better reach men who have sex with men (MSM), additional strategies are needed. Here, we describe development of an intervention, which is part of a broader HIV/STI home-care program, targeted to reach MSM and motivate them to use self-sampling tests. Self-sampling includes blood sampling (finger prick) for HIV, hepatitis B, and syphilis, and a urine sample and oral and anorectal swab samples for chlamydia and gonorrhea. Intervention mapping, a systematic six-step approach, was used to guide the development process: (1) needs assessment including interviews with MSM, (2) create a matrix of change, (3) selection of theory-based methods and practical strategies, (4) intervention development, (5) implementation plan, and (6) evaluation (not included in this paper). Stakeholders were involved to increase program support and feasibility. The needs assessment revealed that testing barriers among MSM related to stigma, time, and privacy concerns. Barriers among healthcare providers related to time, competing priorities, lack of expertise, and guideline restrictions. Included intervention components are designed to overcome these barriers, e.g., engaging role models, with a website with a role model story, and providing tailored information. Methods to reach MSM were a variety of information channels (posters, flyers, and audio-visual displays) and delivery modes, such as advertisements on websites and invitational cards (online and paper) distributed by healthcare providers and MSM themselves (social network testing/peer testing). Our intervention aims to encourage MSM to engage in testing, re-testing, and providing a test to peer MSM. Evidence-based methods to overcome barriers were included to reach and motivate an increased number of MSM. Using intervention mapping stimulated systematic evidence-based decision making and adapting the intervention to the target audience and setting. The next step (step 6) is to implement and evaluate the intervention.
Collapse
|
4
|
Helms YB, Hamdiui N, Kretzschmar MEE, Rocha LEC, van Steenbergen JE, Bengtsson L, Thorson A, Timen A, Stein ML. Applications and Recruitment Performance of Web-Based Respondent-Driven Sampling: Scoping Review. J Med Internet Res 2021; 23:e17564. [PMID: 33448935 PMCID: PMC7846441 DOI: 10.2196/17564] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2019] [Revised: 06/26/2020] [Accepted: 07/19/2020] [Indexed: 11/13/2022] Open
Abstract
Background Web-based respondent-driven sampling is a novel sampling method for the recruitment of participants for generating population estimates, studying social network characteristics, and delivering health interventions. However, the application, barriers and facilitators, and recruitment performance of web-based respondent-driven sampling have not yet been systematically investigated. Objective Our objectives were to provide an overview of published research using web-based respondent-driven sampling and to investigate factors related to the recruitment performance of web-based respondent-driven sampling. Methods We conducted a scoping review on web-based respondent-driven sampling studies published between 2000 and 2019. We used the process evaluation of complex interventions framework to gain insights into how web-based respondent-driven sampling was implemented, what mechanisms of impact drove recruitment, what the role of context was in the study, and how these components together influenced the recruitment performance of web-based respondent-driven sampling. Results We included 18 studies from 8 countries (high- and low-middle income countries), in which web-based respondent-driven sampling was used for making population estimates (n=12), studying social network characteristics (n=3), and delivering health-related interventions (n=3). Studies used web-based respondent-driven sampling to recruit between 19 and 3448 participants from a variety of target populations. Studies differed greatly in the number of seeds recruited, the proportion of successfully recruiting participants, the number of recruitment waves, the type of incentives offered to participants, and the duration of data collection. Studies that recruited relatively more seeds, through online platforms, and with less rigorous selection procedures reported relatively low percentages of successfully recruiting seeds. Studies that did not offer at least one guaranteed material incentive reported relatively fewer waves and lower percentages of successfully recruiting participants. The time of data collection was shortest in studies with university students. Conclusions Web-based respondent-driven sampling can be successfully applied to recruit individuals for making population estimates, studying social network characteristics, and delivering health interventions. In general, seed and peer recruitment may be enhanced by rigorously selecting and motivating seeds, offering at least one guaranteed material incentive, and facilitating adequate recruitment options regarding the target population’s online connectedness and communication behavior. Potential trade-offs should be taken into account when implementing web-based respondent-driven sampling, such as having less opportunities to implement rigorous seed selection procedures when recruiting many seeds, as well as issues around online rather than physical participation, such as the risk of cheaters participating repeatedly.
Collapse
Affiliation(s)
- Yannick B Helms
- National Coordination Centre for Communicable Disease Control, Centre for Infectious Disease Control, National Institute for Public Health and the Environment, Bilthoven, Netherlands.,Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, Netherlands
| | - Nora Hamdiui
- National Coordination Centre for Communicable Disease Control, Centre for Infectious Disease Control, National Institute for Public Health and the Environment, Bilthoven, Netherlands.,Department of Primary and Community Care, Radboud University Medical Center, Radboud Institute for Health Sciences, Nijmegen, Netherlands
| | - Mirjam E E Kretzschmar
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, Netherlands
| | - Luis E C Rocha
- Department of Economics & Department of Physics and Astronomy, Ghent University, Ghent, Belgium
| | - Jim E van Steenbergen
- National Coordination Centre for Communicable Disease Control, Centre for Infectious Disease Control, National Institute for Public Health and the Environment, Bilthoven, Netherlands.,Centre for Infectious Diseases, Leiden University Medical Centre, Leiden, Netherlands
| | | | - Anna Thorson
- Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
| | - Aura Timen
- National Coordination Centre for Communicable Disease Control, Centre for Infectious Disease Control, National Institute for Public Health and the Environment, Bilthoven, Netherlands.,Athena Institute for Research on Innovation and Communication in Health and Life Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Mart L Stein
- National Coordination Centre for Communicable Disease Control, Centre for Infectious Disease Control, National Institute for Public Health and the Environment, Bilthoven, Netherlands
| |
Collapse
|
5
|
Young AM, Ballard AM, Cooper HLF. Novel Recruitment Methods for Research Among Young Adults in Rural Areas Who Use Opioids: Cookouts, Coupons, and Community-Based Staff. Public Health Rep 2020; 135:746-755. [PMID: 32933438 DOI: 10.1177/0033354920954796] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
OBJECTIVES Rural communities in the United States are increasingly becoming epicenters of substance use and related harms. However, best practices for recruiting rural people who use drugs (PWUD) for epidemiologic research are unknown, because such strategies were developed in cities. This study explores the feasibility of web- and community-based strategies to recruit rural, young adult PWUD into epidemiologic research. MATERIALS AND METHODS We recruited PWUD from rural Kentucky to participate in a web-based survey about opioid use using web-based peer referral and community-based strategies, including cookouts, flyers, street outreach, and invitations to PWUD enrolled in a concurrent substance use study. Staff members labeled recruitment materials with unique codes to enable tracking. We assessed eligibility and fraud through online eligibility screening and a fraud detection algorithm, respectively. Eligibility criteria included being aged 18-35, recently using opioids to get high, and residing in the study area. RESULTS Recruitment yielded 410 complete screening entries, of which 234 were eligible and 151 provided complete, nonfraudulent surveys (ie, surveys that passed a fraud-detection algorithm designed to identify duplicate, nonlocal, and/or bot-generated entries). Cookouts and subsequent web-based peer referrals accounted for the highest proportion of screening entries (37.1%, n = 152), but only 29.6% (n = 45) of entries from cookouts and subsequent web-based peer referrals resulted in eligible, nonfraudulent surveys. Recruitment and subsequent web-based peer referral from the concurrent study yielded the second most screening entries (27.8%, n = 114), 77.2% (n = 88) of which resulted in valid surveys. Other recruitment strategies combined to yield 35.1% (n = 144) of screening entries and 11.9% (n = 18) of valid surveys. CONCLUSIONS Web-based methods need to be complemented by context-tailored, street-outreach activities to recruit rural PWUD.
Collapse
Affiliation(s)
- April M Young
- 4530 Department of Epidemiology, University of Kentucky College of Public Health, Lexington, KY, USA.,Center on Drug and Alcohol Research, Department of Behavioral Science, University of Kentucky College of Medicine, Lexington, KY, USA
| | - April M Ballard
- 4530 Department of Epidemiology, University of Kentucky College of Public Health, Lexington, KY, USA.,1371 Gangarosa Department of Environmental Health, Emory University Rollins School of Public Health, Atlanta, GA, USA
| | - Hannah L F Cooper
- Department of Behavioral, Social, and Health Education Sciences, Emory University Rollins School of Public Health, Atlanta, GA, USA
| |
Collapse
|
6
|
Cassidy C, Steenbeek A, Langille D, Martin-Misener R, Curran J. Designing an intervention to improve sexual health service use among university undergraduate students: a mixed methods study guided by the behaviour change wheel. BMC Public Health 2019; 19:1734. [PMID: 31878901 PMCID: PMC6933635 DOI: 10.1186/s12889-019-8059-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2019] [Accepted: 12/11/2019] [Indexed: 11/25/2022] Open
Abstract
Introduction University undergraduate students are within the population at highest risk for acquiring sexually transmitted infections, unplanned pregnancy, and other negative health outcomes. Despite the availability of sexual health services at university health centres, many students delay or avoid seeking care. In this study, we describe how the Behaviour Change Wheel was used as a systematic approach to design an intervention to improve sexual health service use among university undergraduate students. Methods This paper describes the intervention development phase of a three-phased, sequential explanatory mixed methods study. Phases one and two included a quantitative and qualitative study that aimed to better understand students’ use of sexual health services. In phase three, we followed the Behaviour Change Wheel to integrate the quantitative and qualitative findings and conduct stakeholder consultation meetings to select intervention strategies, including intervention functions and behaviour change techniques. Results Key linkages between opportunity and motivation were found to influence students’ access of sexual health services. Stakeholders identified six intervention functions (education, environmental restructuring, enablement, modelling, persuasion, and incentivization) and 15 behaviour change techniques (information about health consequences, information about social and environmental consequences, feedback on behaviour, feedback on outcomes of behaviour, prompts/cues, self-monitoring of behaviour, adding objects to the environment, goal setting, problem solving, action planning, restructuring the social environment, restructuring the physical environment, demonstration of the behaviour, social support, credible source) as relevant to include in a toolbox of intervention strategies to improve sexual health service use. Conclusions This study details the use of the Behaviour Change Wheel to develop an intervention aimed at improving university students’ use of sexual health services. The Behaviour Change Wheel provided a comprehensive framework for integrating multiple sources of data to inform the selection of intervention strategies. Stakeholders can use these strategies to design and implement sexual health service interventions that are feasible within the context of their health centre. Future research is needed to test the effectiveness of the strategies at changing university students’ sexual health behaviour.
Collapse
Affiliation(s)
- Christine Cassidy
- Dalhousie University, School of Nursing, 5869 University Avenue, PO BOX 15000, Halifax, NS, B3H 4R2, Canada.
| | - Audrey Steenbeek
- Dalhousie University, School of Nursing, 5869 University Avenue, PO BOX 15000, Halifax, NS, B3H 4R2, Canada
| | - Donald Langille
- Dalhousie University, Department of Community Health and Epidemiology, Halifax, NS, Canada
| | - Ruth Martin-Misener
- Dalhousie University, School of Nursing, 5869 University Avenue, PO BOX 15000, Halifax, NS, B3H 4R2, Canada
| | - Janet Curran
- Dalhousie University, School of Nursing, 5869 University Avenue, PO BOX 15000, Halifax, NS, B3H 4R2, Canada
| |
Collapse
|
7
|
Ballard AM, Cooper HL, Young AM. Web-Based Eligibility Quizzes to Verify Opioid Use and County Residence Among Rural Young Adults: Eligibility Screening Results from a Feasibility Study. JMIR Res Protoc 2019; 8:e12984. [PMID: 31215520 PMCID: PMC6604504 DOI: 10.2196/12984] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 04/15/2019] [Accepted: 05/02/2019] [Indexed: 12/17/2022] Open
Abstract
Background Web-based methods can be used to collect data from hidden populations, including people who use drugs (PWUD). These methods might be especially advantageous among PWUD in rural areas, where transportation barriers are prevalent, stigma may heighten concerns about confidentiality, and internet access is improving. However, Web-based research with PWUD can be challenging, especially in verifying eligibility. Administering quizzes to verify residential and substance use eligibility could prove valuable in online research among PWUD, yet the utility of this approach is currently unknown. Objective This study describes the implementation of online eligibility quizzes about the local community to verify residence in the target study area along with drug dose, appearance, and price to verify opioid misuse. Methods To be eligible, individuals had to live in 1 of 5 eastern Kentucky counties, report using opioids to get high in the past 30 days, and be 18 to 35 years old. Participants recruited from August 2017 to July 2018 were asked questions about their opioid use followed by a quiz about drug dose, appearance, and price to verify substance use eligibility. Residential eligibility was verified with 5-question quizzes assessing knowledge of the county where they reported living. Questions tested knowledge about towns, festivals, and landmarks; local school mascots and colors; and presence of certain retail stores, restaurants, and facilities (eg, jails). A subsample that reported using opioids in the past 24 hours was randomly selected to complete urine drug testing (UDT). Nonparametric tests were performed to explore differences across demographic subgroups. Results Of the 410 entries assessed for eligibility, 39.3% (161/410) were ineligible as they reported no substance use, being outside the age range, or living outside the study area. Of the remaining 249 who met the eligibility criteria based on age, residency, and opioid misuse, 94.0% (234/249) passed the eligibility quizzes. Among those who passed the heroin quiz, 99.4% (167/168) recognized the image of powdered heroin, 94.6% (159/168) answered the cap size (ie, the purchase unit) question correctly, and 97.0% (163/168) answered the street price question correctly. Among those who passed the drug quiz for prescription opioids, 95% (36/38) answered the dose question correctly, and 82% (31/38) selected the correct image. In a random sample of participants who completed UDT within 3 days of their online screening, 74% (25/34) tested positive for an opioid. Conclusions This study demonstrated the utility of using online eligibility screening quizzes to verify opioid misuse and residence. Participants accurately recognized heroin and prescription opioid doses, prices, and images and correctly answered questions about features of their county. Online quizzes to screen and enroll PWUD hold promise for future research as an alternative to more time- and resource-intensive approaches that could offset the advantages of Web-based methods.
Collapse
Affiliation(s)
- April M Ballard
- Department of Epidemiology, University of Kentucky, Lexington, KY, United States.,Department of Environmental Health, Emory University Rollins School of Public Health, Atlanta, GA, United States
| | - Hannah Lf Cooper
- Department of Behavioral Sciences and Health Education, Emory University Rollins School of Public Health, Atlanta, GA, United States
| | - April M Young
- Department of Epidemiology, University of Kentucky, Lexington, KY, United States.,Center on Drug and Alcohol Research, University of Kentucky, Lexington, KY, United States
| |
Collapse
|
8
|
Ballard AM, Cardwell T, Young AM. Fraud Detection Protocol for Web-Based Research Among Men Who Have Sex With Men: Development and Descriptive Evaluation. JMIR Public Health Surveill 2019; 5:e12344. [PMID: 30714944 PMCID: PMC6378547 DOI: 10.2196/12344] [Citation(s) in RCA: 43] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Revised: 11/02/2018] [Accepted: 11/05/2018] [Indexed: 11/13/2022] Open
Abstract
Background Internet is becoming an increasingly common tool for survey research, particularly among “hidden” or vulnerable populations, such as men who have sex with men (MSM). Web-based research has many advantages for participants and researchers, but fraud can present a significant threat to data integrity. Objective The purpose of this analysis was to evaluate fraud detection strategies in a Web-based survey of young MSM and describe new protocols to improve fraud detection in Web-based survey research. Methods This study involved a cross-sectional Web-based survey that examined individual- and network-level risk factors for HIV transmission and substance use among young MSM residing in 15 counties in Central Kentucky. Each survey entry, which was at least 50% complete, was evaluated by the study staff for fraud using an algorithm involving 8 criteria based on a combination of geolocation data, survey data, and personal information. Entries were classified as fraudulent, potentially fraudulent, or valid. Descriptive analyses were performed to describe each fraud detection criterion among entries. Results Of the 414 survey entries, the final categorization resulted in 119 (28.7%) entries identified as fraud, 42 (10.1%) as potential fraud, and 253 (61.1%) as valid. Geolocation outside of the study area (164/414, 39.6%) was the most frequently violated criterion. However, 33.3% (82/246) of the entries that had ineligible geolocations belonged to participants who were in eligible locations (as verified by their request to mail payment to an address within the study area or participation at a local event). The second most frequently violated criterion was an invalid phone number (94/414, 22.7%), followed by mismatching names within an entry (43/414, 10.4%) and unusual email addresses (37/414, 8.9%). Less than 5% (18/414) of the entries had some combination of personal information items matching that of a previous entry. Conclusions This study suggests that researchers conducting Web-based surveys of MSM should be vigilant about the potential for fraud. Researchers should have a fraud detection algorithm in place prior to data collection and should not rely on the Internet Protocol (IP) address or geolocation alone, but should rather use a combination of indicators.
Collapse
Affiliation(s)
- April M Ballard
- Department of Epidemiology, College of Public Health, University of Kentucky, Lexington, KY, United States.,Department of Environmental Health, Emory University, Atlanta, GA, United States
| | - Trey Cardwell
- Department of Epidemiology, College of Public Health, University of Kentucky, Lexington, KY, United States
| | - April M Young
- Department of Epidemiology, College of Public Health, University of Kentucky, Lexington, KY, United States.,Center on Drug and Alcohol Research, University of Kentucky, Lexington, KY, United States
| |
Collapse
|