1
|
Mayer C, Tryon R, Ricks S, Lane K, Van Hook E, Zayhowski K. Preventing fraudulent research participation: Methodological strategies and ethical impacts. J Genet Couns 2025; 34:e70048. [PMID: 40331685 PMCID: PMC12057331 DOI: 10.1002/jgc4.70048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2024] [Revised: 03/26/2025] [Accepted: 04/22/2025] [Indexed: 05/08/2025]
Abstract
This article addresses a growing issue in genetic counseling research: the participation of individuals who falsify demographic information or experiences to qualify for studies, often motivated by remuneration. This issue is particularly pressing in studies using social media recruitment, where detecting fraudulent participants has become increasingly difficult. The prevalence of inaccurate data raises serious questions about the integrity, reliability, and validity of research findings. We explore potential sources of participant fraud and inconsistency informed by prior, direct experience with fraudulent participants, discussing various strategies to strengthen participant screening, data validation, and interview protocols. We also examine the challenges screening methods pose for marginalized communities, who may already harbor distrust in research or face privacy concerns. We emphasize the need for transparent, responsible approaches to participant verification and advocate for developing standardized guidelines to protect both research quality and participant rights. By promoting trust, inclusivity, and fairness in research practices, we aim to preserve the dignity of participants and ensure that genetic counseling research remains rigorous. Ultimately, we call for collective action to reinforce the integrity of research and enhance its impact on clinical practice, ensuring that evidence-based insights guide patient-centered care.
Collapse
Affiliation(s)
- Cassie Mayer
- Master's Program in Genetic CounselingBoston University Chobanian and Avedisian School of MedicineBostonMassachusettsUSA
| | - Rebecca Tryon
- Division of Pediatric Blood and Marrow TransplantM Health FairviewMinneapolisMinnesotaUSA
- Department of Genetics, Cell Biology, and DevelopmentUniversity of MinnesotaMinneapolisMinnesotaUSA
| | - Sarah Ricks
- Division of Human GeneticsCincinnati Children's Hospital Medical CenterCincinnatiOhioUSA
- College of MedicineUniversity of CincinnatiCincinnatiOhioUSA
| | - Kara Lane
- Department of Genetics, Cell Biology, and DevelopmentUniversity of MinnesotaMinneapolisMinnesotaUSA
| | - Emma Van Hook
- Master's Program in Genetic CounselingBoston University Chobanian and Avedisian School of MedicineBostonMassachusettsUSA
- Department of Cancer Risk and PreventionMaineHealthScarboroughMaineUSA
| | - Kimberly Zayhowski
- Department of Genetics, Cell Biology, and DevelopmentUniversity of MinnesotaMinneapolisMinnesotaUSA
- Department of Obstetrics and GynecologyBoston University Chobanian and Avedisian School of MedicineBostonMassachusettsUSA
| |
Collapse
|
2
|
Law C, Sokolovsky AW, Yap DL, Erblich J, Gunthert K, Behar E. Examining the Reciprocal Association Between Worry and Sleep: Disaggregating Between- and Within-Person Effects. Behav Ther 2025; 56:634-647. [PMID: 40287189 DOI: 10.1016/j.beth.2024.09.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Revised: 08/27/2024] [Accepted: 09/29/2024] [Indexed: 04/29/2025]
Abstract
Studies investigating the reciprocal association between worry and sleep have yielded mixed findings and suffered from methodological limitations. The purpose of this study was to assess the reciprocal association between worry and various indices of sleep (i.e., sleep onset latency [SOL], total sleep duration [TSD], sleep quality [SQ], and morning lingering [ML]). In a longitudinal daily assessment study, participants (N = 182) completed a sleep diary and a measure of worrisome thinking three times per day for 7 days. We used linear mixed effects models to examine worry predicting sleep, and Tobit regression models to examine sleep predicting worry, and controlled for previous day report of the outcome variable and person- and day-level effects. Results indicate that greater person-level worry, but not day-level worry, was significantly associated with longer SOL, worse SQ, and longer ML. Furthermore, greater person-level SOL, TSD, and ML was associated with greater worry, and greater person-level SQ was associated with less worry. Finally, we found that shorter day-level TSD and lower day-level SQ was associated with greater next-day worry. These findings support a reciprocal person-level association between worry and sleep (except for TSD), and a unidirectional day-level association between TSD and SQ as predictors of worry.
Collapse
|
3
|
Camp LN, Babicheva V, Conahan C, Hayes S, Sherburne Hawkins S. Cannabis Use and Disclosure in the Oncology Setting: A Cross-Sectional Survey Exploring Information Needs Among Cancer Survivors. Clin J Oncol Nurs 2025; 29:157-164. [PMID: 40096564 PMCID: PMC12056838 DOI: 10.1188/25.cjon.157-164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Accepted: 10/25/2024] [Indexed: 03/19/2025]
Abstract
BACKGROUND Given the potential positive and negative impacts of cannabis use during cancer care, more information is needed to understand how changes in cannabis legalization and social norms have affected cannabis use and clinical disclosure among cancer survivors. OBJECTIVES The purpose of this research was to explore cannabis behaviors, disclosure, and information needs among cancer survivors. METHODS The study team conducted cross- sectional analyses using descriptive statistics to assess data collected via an online survey distributed through online health communities. FINDINGS This analysis included 719 participants, and most reported currently undergoing treatment. About one-third reported current cannabis use. Cannabis use varied across the cancer care continuum, and most of those using cannabis discussed their use with a healthcare provider and reported interest in receiving more information about cannabis.
Collapse
|
4
|
Craig LS, Evans CL, Taylor BD, Patterson J, Whitfield K, Hill M, Nwagwu M, Mubasher M, Bednarczyk RA, McCray GG, Gaddis CLR, Taylor N, Thompson E, Douglas U, Latimer SK, Spivey SG, Henry Akintobi T, Quarells RC. Challenges and Lessons Learned in Managing Web-Based Survey Fraud for the Garnering Effective Outreach and Research in Georgia for Impact Alliance-Community Engagement Alliance Survey Administrations. JMIR Public Health Surveill 2024; 10:e51786. [PMID: 39718988 DOI: 10.2196/51786] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 10/10/2024] [Accepted: 10/14/2024] [Indexed: 12/26/2024] Open
Abstract
Background Convenience, privacy, and cost-effectiveness associated with web-based data collection have facilitated the recent expansion of web-based survey research. Importantly, however, practical benefits of web-based survey research, to scientists and participants alike, are being overshadowed by the dramatic rise in suspicious and fraudulent survey submissions. Misinformation associated with survey fraud compromises data quality and data integrity with important implications for scientific conclusions, clinical practice, and social benefit. Transparency in reporting on methods used to prevent and manage suspicious and fraudulent submissions is key to protecting the veracity of web-based survey data; yet, there is limited discussion on the use of antideception strategies during all phases of survey research to detect and eliminate low-quality and fraudulent responses. Objective This study aims to contribute to an evolving evidence base on data integrity threats associated with web-based survey research by describing study design strategies and antideception tools used during the web-based administration of the Garnering Effective Outreach and Research in Georgia for Impact Alliance-Community Engagement Alliance (GEORGIA CEAL) Against COVID-19 Disparities project surveys. Methods GEORGIA CEAL was established in response to the COVID-19 pandemic and the need for rapid, yet, valid, community-informed, and community-owned research to guide targeted responses to a dynamic, public health crisis. GEORGIA CEAL Surveys I (April 2021 to June 2021) and II (November 2021 to January 2022) received institutional review board approval from the Morehouse School of Medicine and adhered to the CHERRIES (Checklist for Reporting Results of Internet E-Surveys). Results A total of 4934 and 4905 submissions were received for Surveys I and II, respectively. A small proportion of surveys (Survey I: n=1336, 27.1% and Survey II: n=1024, 20.9%) were excluded due to participant ineligibility, while larger proportions (Survey I: n=1516, 42.1%; Survey II: n=1423, 36.7%) were flagged and removed due to suspicious activity; 2082 (42.2%) and 2458 (50.1%) of GEORGIA CEAL Surveys I and II, respectively, were retained for analysis. Conclusions Suspicious activity during GEORGIA CEAL Survey I administration prompted the inclusion of additional security tools during Survey II design and administration (eg, hidden questions, Completely Automated Public Turing Test to Tell Computers and Humans Apart verification, and security questions), which proved useful in managing and detecting fraud and resulted in a higher retention rate across survey waves. By thorough discussion of experiences, lessons learned, and future directions for web-based survey research, this study outlines challenges and best practices for designing and implementing a robust defense against survey fraud. Finally, we argue that, in addition to greater transparency and discussion, community stakeholders need to be intentionally and mindfully engaged, via approaches grounded in community-based participatory research, around the potential for research to enable scientific discoveries in order to accelerate investment in quality, legitimate survey data.
Collapse
Affiliation(s)
| | - Christina L Evans
- Department of Family Medicine, Morehouse School of Medicine, Atlanta, GA, United States
| | - Brittany D Taylor
- Health Strategies Division, American Heart Association, Atlanta, GA, United States
| | - Jace Patterson
- Department of Modern Language, Ohio University, Athens, OH, United States
| | - Kaleb Whitfield
- Georgia Health Policy Center, Georgia State University, Atlanta, GA, United States
| | - Mekhi Hill
- Community Health and Preventive Medicine, Morehouse School of Medicine, Atlanta, GA, United States
| | - Michelle Nwagwu
- Community Health and Preventive Medicine, Morehouse School of Medicine, Atlanta, GA, United States
| | - Mohamed Mubasher
- Community Health and Preventive Medicine, Morehouse School of Medicine, Atlanta, GA, United States
| | - Robert A Bednarczyk
- Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, GA, United States
| | - Gail G McCray
- Community Health and Preventive Medicine, Morehouse School of Medicine, Atlanta, GA, United States
| | - Cheryl L R Gaddis
- Department of Public Health, Mercer University College of Health Professions, Atlanta, GA, United States
| | | | | | | | - Saundra K Latimer
- Health Assessment and Promotion Department Division of Community Health, DeKalb Public Health, Decatur, GA, United States
| | - Sedessie G Spivey
- Health Assessment and Promotion Department Division of Community Health, DeKalb Public Health, Decatur, GA, United States
| | - Tabia Henry Akintobi
- Community Health and Preventive Medicine, Morehouse School of Medicine, Atlanta, GA, United States
| | - Rakale Collins Quarells
- Community Health and Preventive Medicine, Morehouse School of Medicine, Atlanta, GA, United States
| |
Collapse
|
5
|
Mistry K, Merrick S, Cabecinha M, Daniels S, Ragan J, Epstein M, Lever L, Venables ZC, Levell NJ. Fraudulent Participation in Online Qualitative Studies: Practical Recommendations on an Emerging Phenomenon. QUALITATIVE HEALTH RESEARCH 2024:10497323241288181. [PMID: 39548877 DOI: 10.1177/10497323241288181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2024]
Abstract
Fraudulent participation is defined in the following as participation in research by individuals who, for one reason or another, intentionally provide false responses. Qualitative studies are at an increased risk of fraudulent participation when online recruitment and participation are used, and monetary incentives offered. Fraudulent participation threatens data quality and subsequent evidence-based practice, yet validated guidance on how to tackle it is lacking. This paper offers a critical reflection thereon by three separate qualitative research groups that experienced fraudulent participation in collaboration with a patient representative, a bioethicist, a legal expert, a journal deputy editor, and a chief executive of a national charity. The Prevent FRaudulent Online STudy participation (P-FROST) recommendations provide advice on (1) Study set-up (including team members and study design), (2) Monetary incentives and recruitment, (3) Data collection (screening and interview considerations), and (4) Analysis, reporting, and support. The reflection which balances the diverse perspectives of patients, researchers, funders, ethics boards, and legal teams puts forward the P-FROST recommendations to identify and prevent fraudulent participation throughout the design, ethical approval, and implementation of online qualitative research.
Collapse
Affiliation(s)
- Khaylen Mistry
- Department of Dermatology, Norfolk and Norwich University Hospitals Foundation Trust, Norwich, UK
- Norwich Medical School, University of East Anglia, Norwich, UK
| | - Sophie Merrick
- MRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, UCL, London, UK
| | - Melissa Cabecinha
- Research Department of Primary Care and Population Health, Institute of Epidemiology and Healthcare, UCL, London, UK
| | | | - John Ragan
- Patient and Public Representative, Norwich, UK
| | | | - Louisa Lever
- Legal Services, Norfolk and Norwich University Hospitals Foundation Trust, Norwich, UK
| | - Zoe C Venables
- Department of Dermatology, Norfolk and Norwich University Hospitals Foundation Trust, Norwich, UK
- Norwich Medical School, University of East Anglia, Norwich, UK
| | - Nick J Levell
- Department of Dermatology, Norfolk and Norwich University Hospitals Foundation Trust, Norwich, UK
- Norwich Medical School, University of East Anglia, Norwich, UK
| |
Collapse
|
6
|
French B, Babbage C, Bird K, Marsh L, Pelton M, Patel S, Cassidy S, Rennick-Egglestone S. Data Integrity Issues With Web-Based Studies: An Institutional Example of a Widespread Challenge. JMIR Ment Health 2024; 11:e58432. [PMID: 39284170 PMCID: PMC11443183 DOI: 10.2196/58432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 07/03/2024] [Accepted: 07/13/2024] [Indexed: 10/04/2024] Open
Abstract
This paper reports on the growing issues experienced when conducting web-based-based research. Nongenuine participants, repeat responders, and misrepresentation are common issues in health research posing significant challenges to data integrity. A summary of existing data on the topic and the different impacts on studies is presented. Seven case studies experienced by different teams within our institutions are then reported, primarily focused on mental health research. Finally, strategies to combat these challenges are presented, including protocol development, transparent recruitment practices, and continuous data monitoring. These strategies and challenges impact the entire research cycle and need to be considered prior to, during, and post data collection. With a lack of current clear guidelines on this topic, this report attempts to highlight considerations to be taken to minimize the impact of such challenges on researchers, studies, and wider research. Researchers conducting web-based research must put mitigating strategies in place, and reporting on mitigation efforts should be mandatory in grant applications and publications to uphold the credibility of web-based research.
Collapse
Affiliation(s)
- Blandine French
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Camilla Babbage
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Katherine Bird
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Lauren Marsh
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Mirabel Pelton
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Shireen Patel
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Sarah Cassidy
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | | |
Collapse
|
7
|
Poteat TC, Reisner SL, Wirtz AL, Mayo-Wilson LJ, Brown C, Kornbluh W, Humphrey A, Perrin N. A Microfinance Intervention With or Without Peer Support to Improve Mental Health Among Transgender and Nonbinary Adults (the Creating Access to Resources and Economic Support Study): Protocol for a Randomized Controlled Trial. JMIR Res Protoc 2024; 13:e63656. [PMID: 39186770 PMCID: PMC11384176 DOI: 10.2196/63656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 07/11/2024] [Indexed: 08/28/2024] Open
Abstract
BACKGROUND Transgender and nonbinary (TNB) people experience economic and psychosocial inequities that make them more likely to be subject to financial and mental health harms exacerbated by the COVID-19 pandemic. Sustainable, multilevel interventions are needed to address these harms. The onset of the COVID-19 pandemic galvanized many TNB-led organizations to provide emergency financial and peer support for TNB people negatively impacted by the pandemic. However, the efficacy of these interventions has not been evaluated. The Creating Access to Resources and Economic Support (CARES) study seeks to assess the efficacy of feasible, acceptable, and community-derived interventions to reduce economic and psychological harms experienced by transgender people in the wake of the COVID-19 pandemic. OBJECTIVE The study aims to (1) compare the efficacy of microgrants with peer mentoring with that of microgrants without peer mentoring in reducing psychological distress, (2) examine mechanisms by which microgrants with or without peer mentoring may impact psychological distress, and (3) explore participants' intervention experiences and perceived efficacy. METHODS We will enroll 360 TNB adults into an embedded, mixed methods, 3-arm, and 12-month randomized controlled trial. Participants will be randomized 1:1:1 to arm A (enhanced usual care), which will receive a single microgrant plus monthly financial literacy education, arm B (extended microgrants), which will receive enhanced usual care plus monthly microgrants, or arm C (peer mentoring), which will receive extended microgrants combined with peer mentoring. All intervention arms last for 6 months, and participants complete semiannual, web-based surveys at 0, 6, and 12 months as well as brief process measures at 3 and 6 months. A subset of 36 participants, 12 (33%) per arm, will complete longitudinal in-depth interviews at 3 and 9 months. RESULTS Full recruitment began on January 8, 2024, and, as of July 26, 2024, a total of 138 participants have enrolled. Recruitment is expected to be completed no later than March 31, 2025, and the final study visit will take place in March 2026. CONCLUSIONS This national, web-based study will demonstrate whether an intervention tailored to reduce material hardship and improve peer support among TNB adults will reduce psychological distress. Its equitable, community-academic partnership will ensure the rapid dissemination of study findings. TRIAL REGISTRATION ClinicalTrials.gov NCT05971160; https://clinicaltrials.gov/study/NCT05971160. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/63656.
Collapse
Affiliation(s)
- Tonia C Poteat
- Duke University School of Nursing, Durham, NC, United States
| | - Sari L Reisner
- Department of Epidemiology, University of Michigan School of Public Health, Ann Arbor, MI, United States
- The Fenway Institute, Boston, MA, United States
| | - Andrea L Wirtz
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States
| | - Larissa Jennings Mayo-Wilson
- Department of Health Behavior, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, United States
| | - Carter Brown
- National Black Trans Advocacy Coalition, Carrollton, TX, United States
| | - Wiley Kornbluh
- Duke University School of Nursing, Durham, NC, United States
| | - Ash Humphrey
- Duke University School of Nursing, Durham, NC, United States
| | - Nancy Perrin
- Johns Hopkins School of Nursing, Baltimore, MD, United States
| |
Collapse
|
8
|
Sharma P, McPhail SM, Kularatna S, Senanayake S, Abell B. Navigating the challenges of imposter participants in online qualitative research: lessons learned from a paediatric health services study. BMC Health Serv Res 2024; 24:724. [PMID: 38867177 PMCID: PMC11170877 DOI: 10.1186/s12913-024-11166-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 06/03/2024] [Indexed: 06/14/2024] Open
Abstract
BACKGROUND The growth in online qualitative research and data collection provides several advantages for health service researchers and participants, including convenience and extended geographic reach. However, these online processes can also present unexpected challenges, including instances of participant fraud or scam behaviour. This study describes an incident of participant fraud identified during online focus group discussions and interviews for a PhD health services research project on paediatric neurodevelopmental care. METHODS We aimed to recruit carers of Australian children with neurodevelopmental disorders. Potential participants were recruited via a publicly available social media advert on Facebook offering $50 AUD compensation. Those who expressed interest via email (n = 254) were sent a pre-interview Qualtrics survey to complete. We identified imposters at an early stage via inconsistencies in their self-reported geographical location and that captured by the survey as well as recognition of suspicious actions before, during and after focus group discussions and interviews. RESULTS Interest in participation was unexpectedly high. We determined that all potential participants were likely imposters, posing as multiple individuals and using different IP addresses across Nigeria, Australia, and the United States. In doing so, we were able to characterise several "red flags" for identifying imposter participants, particularly those posing as multiple individuals. These comprise a combination of factors including large volumes and strange timings of email responses, unlikely demographic characteristics, short or vague interviews, a preference for nonvisual participation, fixation on monetary compensation, and inconsistencies in reported geographical location. Additionally, we propose several strategies to combat this issue such as providing proof of location or eligibility during recruitment and data collection, examining email and consent form patterns, and comparing demographic data with regional statistics. CONCLUSIONS The emergent risk of imposter participants is an important consideration for those seeking to conduct health services research using qualitative approaches in online environments. Methodological design choices intended to improve equity and access for the target population may have an unintended consequence of improving access for fraudulent actors unless appropriate risk mitigation strategies are also employed. Lessons learned from this experience are likely to be valuable for novice health service researchers involved in online focus group discussions and interviews.
Collapse
Affiliation(s)
- Pakhi Sharma
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, 60 Musk Avenue, Kelvin Grove, Brisbane, QLD, 4059, Australia.
| | - Steven M McPhail
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, 60 Musk Avenue, Kelvin Grove, Brisbane, QLD, 4059, Australia
- Digital Health and Informatics Directorate, Metro South Health, Brisbane, QLD, Australia
| | - Sanjeewa Kularatna
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, 60 Musk Avenue, Kelvin Grove, Brisbane, QLD, 4059, Australia
- Health Services and Systems Research, Duke-NUS Medical School, Singapore, Singapore
| | - Sameera Senanayake
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, 60 Musk Avenue, Kelvin Grove, Brisbane, QLD, 4059, Australia
- Health Services and Systems Research, Duke-NUS Medical School, Singapore, Singapore
| | - Bridget Abell
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Queensland University of Technology, 60 Musk Avenue, Kelvin Grove, Brisbane, QLD, 4059, Australia
| |
Collapse
|
9
|
Kumarasamy V, Goodfellow N, Ferron EM, Wright AL. Evaluating the Problem of Fraudulent Participants in Health Care Research: Multimethod Pilot Study. JMIR Form Res 2024; 8:e51530. [PMID: 38833292 PMCID: PMC11185910 DOI: 10.2196/51530] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 10/20/2023] [Accepted: 05/02/2024] [Indexed: 06/06/2024] Open
Abstract
BACKGROUND The shift toward online recruitment methods, accelerated by the COVID-19 pandemic, has brought to the forefront the growing concern of encountering fraudulent participants in health care research. The increasing prevalence of this issue poses a serious threat to the reliability and integrity of research data and subsequent findings. OBJECTIVE This study aims to explore the experiences of health care researchers (HCRs) who have encountered fraudulent participants while using online recruitment methods and platforms. The primary objective was to gain insights into how researchers detect and mitigate fraudulent behavior in their work and provide prevention recommendations. METHODS A multimethod sequential design was used for this pilot study, comprising a quantitative arm involving a web-based survey followed by a qualitative arm featuring semistructured interviews. The qualitative description approach framed the qualitative arm of the study. Sample sizes for the quantitative and qualitative arms were based on pragmatic considerations that in part stemmed from encountering fraudulent participants in a concurrent study. Content analysis was used to analyze open-ended survey questions and interview data. RESULTS A total of 37 HCRs participated, with 35% (13/37) of them engaging in qualitative interviews. Online platforms such as Facebook, email, Twitter (subsequently rebranded X), and newsletters were the most used methods for recruitment. A total of 84% (31/37) of participants indicated that fraudulent participation occurred in studies that mentioned incentives in their recruitment communications, with 71% (26/37) of HCRs offering physical or electronic gift cards as incentives. Researchers identified several indicators of suspicious behavior, including email surges, discrepancies in contact or personal information, geographical inconsistencies, and suspicious responses to survey questions. HCRs emphasized the need for a comprehensive screening protocol that extends beyond eligibility checks and is seamlessly integrated into the study protocol, grant applications, and research ethics board submissions. CONCLUSIONS This study sheds light on the intricate and pervasive problem of fraudulent participation in health care research using online recruitment methods. The findings underscore the importance of vigilance and proactivity among HCRs in identifying, preventing, and addressing fraudulent behavior. To effectively tackle this challenge, researchers are encouraged to develop a comprehensive prevention strategy and establish a community of practice, facilitating real-time access to solutions and support and the promotion of ethical research practices. This collaborative approach will enable researchers to effectively address the issue of fraudulent participation, ensuring the conduct of high-quality and ethically sound research in the digital age.
Collapse
Affiliation(s)
- Vithusa Kumarasamy
- Lawrence S Bloomberg Faculty of Nursing, University of Toronto, Toronto, ON, Canada
| | - Nicole Goodfellow
- Lawrence S Bloomberg Faculty of Nursing, University of Toronto, Toronto, ON, Canada
| | - Era Mae Ferron
- Lawrence S Bloomberg Faculty of Nursing, University of Toronto, Toronto, ON, Canada
| | - Amy L Wright
- Lawrence S Bloomberg Faculty of Nursing, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
10
|
Davies MR, Monssen D, Sharpe H, Allen KL, Simms B, Goldsmith KA, Byford S, Lawrence V, Schmidt U. Management of fraudulent participants in online research: Practical recommendations from a randomized controlled feasibility trial. Int J Eat Disord 2024; 57:1311-1321. [PMID: 37921564 DOI: 10.1002/eat.24085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 10/11/2023] [Accepted: 10/11/2023] [Indexed: 11/04/2023]
Abstract
OBJECTIVE Fraudulent participation is an escalating concern for online clinical trials and research studies and can have a significant negative impact on findings. We aim to shed light on the risk and to provide practical recommendations for detecting and managing such instances. METHODS The FREED-Mobile (FREED-M) study is an online, randomized controlled feasibility trial to assess a digital early intervention for young people (aged 16-25) in England or Wales with eating problems. The trial involved baseline (week 0), post-intervention (week 4), and follow-up (week 12) surveys, alongside weekly modules provided over 4 weeks on the study website. Study completers were compensated with £20 shopping vouchers. Despite the complexity of the trial design, two instances of fraudulent sign-ups occurred in January and March 2023. To counter this, we developed a "fraudulent participants protocol" following internal investigations and discussions with collaborators. RESULTS The implementation of prevention measures such as reCAPTCHA updates, IP address review, and changes in reimbursement effectively halted further fraudulent sign-ups. Our protocol facilitated the systematic identification and withdrawal of suspected or clear fraudsters and was demonstrably robust at distinguishing between fraudsters and genuine responders. DISCUSSION All remote, online trials or studies are at risk of fraudulent participation. Drawing from our experience and existing literature, we offer practical recommendations for researchers considering online recruitment and data collection. Vigilance and the integration of deterrents, and data quality checks into the study design from the outset are advised to safeguard research integrity. PUBLIC SIGNIFICANCE Fraudulent participation in digital research can have asignificant impact on research findings, potentially leading to biased resultsand misinformed decisions. We developed an effective protocol for theprevention, identification, and management of fraudulent participants. Bysharing our insights and recommendations, we hope to raise awareness of thisissue and provide other researchers with the knowledge and strategies necessaryto safeguard research integrity moving forward.
Collapse
Affiliation(s)
- Molly R Davies
- Centre for Research in Eating and Weight Disorders (CREW), Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Dina Monssen
- Centre for Research in Eating and Weight Disorders (CREW), Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Helen Sharpe
- Department of Clinical and Health Psychology, School of Health in Social Science, University of Edinburgh, Edinburgh, UK
| | - Karina L Allen
- Centre for Research in Eating and Weight Disorders (CREW), Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- The Eating Disorders Service, Maudsley Hospital, South London and Maudsley NHS Foundation Trust, London, UK
| | - Beki Simms
- Fruitful Studio, The Design Chapel, Hampshire, UK
| | - Kimberley A Goldsmith
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Sarah Byford
- King's Health Economics, Institute of Psychiatry, Psychology, & Neuroscience, King's College London, London, UK
| | - Vanessa Lawrence
- King's Health Economics, Institute of Psychiatry, Psychology, & Neuroscience, King's College London, London, UK
| | - Ulrike Schmidt
- Centre for Research in Eating and Weight Disorders (CREW), Department of Psychological Medicine, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- The Eating Disorders Service, Maudsley Hospital, South London and Maudsley NHS Foundation Trust, London, UK
| |
Collapse
|
11
|
Shatto B, Meyer G. The Challenge of Surveying New Graduate Nurses. J Contin Educ Nurs 2024; 55:145-148. [PMID: 38063796 DOI: 10.3928/00220124-20231130-01] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/02/2024]
Abstract
Random samples are the gold standard when surveying a nationwide population, such as new graduate nurses. The goal of this article is to detail the challenges experienced when sampling and surveying newly licensed RNs who entered the health care environment during the coronavirus disease (COVID-19) pandemic. To create a random sample of this population, all 51 U.S. state boards of nursing were contacted. State boards of nursing are the best resource for this information, but obtaining contact information, soliciting a response, and dealing with privacy laws as well as the cost of the lists reduced the survey frame. Of the 51 state boards, eight provided usable lists of participants. Obtaining a sampling frame was challenging. Once created, other issues arose. Finding ways to obtain random sampling lists of RNs and encouraging nurses to participate in research are key elements of addressing issues in health care today. [J Contin Educ Nurs. 2024;55(3):145-148.].
Collapse
|
12
|
Bonett S, Lin W, Sexton Topper P, Wolfe J, Golinkoff J, Deshpande A, Villarruel A, Bauermeister J. Assessing and Improving Data Integrity in Web-Based Surveys: Comparison of Fraud Detection Systems in a COVID-19 Study. JMIR Form Res 2024; 8:e47091. [PMID: 38214962 PMCID: PMC10818231 DOI: 10.2196/47091] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 11/21/2023] [Accepted: 12/11/2023] [Indexed: 01/13/2024] Open
Abstract
BACKGROUND Web-based surveys increase access to study participation and improve opportunities to reach diverse populations. However, web-based surveys are vulnerable to data quality threats, including fraudulent entries from automated bots and duplicative submissions. Widely used proprietary tools to identify fraud offer little transparency about the methods used, effectiveness, or representativeness of resulting data sets. Robust, reproducible, and context-specific methods of accurately detecting fraudulent responses are needed to ensure integrity and maximize the value of web-based survey research. OBJECTIVE This study aims to describe a multilayered fraud detection system implemented in a large web-based survey about COVID-19 attitudes, beliefs, and behaviors; examine the agreement between this fraud detection system and a proprietary fraud detection system; and compare the resulting study samples from each of the 2 fraud detection methods. METHODS The PhillyCEAL Common Survey is a cross-sectional web-based survey that remotely enrolled residents ages 13 years and older to assess how the COVID-19 pandemic impacted individuals, neighborhoods, and communities in Philadelphia, Pennsylvania. Two fraud detection methods are described and compared: (1) a multilayer fraud detection strategy developed by the research team that combined automated validation of response data and real-time verification of study entries by study personnel and (2) the proprietary fraud detection system used by the Qualtrics (Qualtrics) survey platform. Descriptive statistics were computed for the full sample and for responses classified as valid by 2 different fraud detection methods, and classification tables were created to assess agreement between the methods. The impact of fraud detection methods on the distribution of vaccine confidence by racial or ethnic group was assessed. RESULTS Of 7950 completed surveys, our multilayer fraud detection system identified 3228 (40.60%) cases as valid, while the Qualtrics fraud detection system identified 4389 (55.21%) cases as valid. The 2 methods showed only "fair" or "minimal" agreement in their classifications (κ=0.25; 95% CI 0.23-0.27). The choice of fraud detection method impacted the distribution of vaccine confidence by racial or ethnic group. CONCLUSIONS The selection of a fraud detection method can affect the study's sample composition. The findings of this study, while not conclusive, suggest that a multilayered approach to fraud detection that includes conservative use of automated fraud detection and integration of human review of entries tailored to the study's specific context and its participants may be warranted for future survey research.
Collapse
Affiliation(s)
- Stephen Bonett
- School of Nursing, University of Pennsylvania, Philadelphia, PA, United States
| | - Willey Lin
- School of Nursing, University of Pennsylvania, Philadelphia, PA, United States
| | | | - James Wolfe
- School of Nursing, University of Pennsylvania, Philadelphia, PA, United States
| | - Jesse Golinkoff
- School of Nursing, University of Pennsylvania, Philadelphia, PA, United States
| | | | - Antonia Villarruel
- School of Nursing, University of Pennsylvania, Philadelphia, PA, United States
| | - José Bauermeister
- School of Nursing, University of Pennsylvania, Philadelphia, PA, United States
| |
Collapse
|
13
|
Lenze E, Torous J, Arean P. Digital and precision clinical trials: innovations for testing mental health medications, devices, and psychosocial treatments. Neuropsychopharmacology 2024; 49:205-214. [PMID: 37550438 PMCID: PMC10700595 DOI: 10.1038/s41386-023-01664-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 07/05/2023] [Accepted: 07/10/2023] [Indexed: 08/09/2023]
Abstract
Mental health treatment advances - including neuropsychiatric medications and devices, psychotherapies, and cognitive treatments - lag behind other fields of clinical medicine such as cardiovascular care. One reason for this gap is the traditional techniques used in mental health clinical trials, which slow the pace of progress, produce inequities in care, and undermine precision medicine goals. Newer techniques and methodologies, which we term digital and precision trials, offer solutions. These techniques consist of (1) decentralized (i.e., fully-remote) trials which improve the speed and quality of clinical trials and increase equity of access to research, (2) precision measurement which improves success rate and is essential for precision medicine, and (3) digital interventions, which offer increased reach of, and equity of access to, evidence-based treatments. These techniques and their rationales are described in detail, along with challenges and solutions for their utilization. We conclude with a vignette of a depression clinical trial using these techniques.
Collapse
Affiliation(s)
- Eric Lenze
- Departments of Psychiatry and Anesthesiology, Washington University School of Medicine, St Louis, MO, USA.
| | - John Torous
- Department of Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Patricia Arean
- Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, USA
| |
Collapse
|
14
|
Sefcik JS, Hathaway Z, DiMaria-Ghalili RA. When snowball sampling leads to an avalanche of fraudulent participants in qualitative research. Int J Older People Nurs 2023; 18:e12572. [PMID: 37632269 PMCID: PMC10843676 DOI: 10.1111/opn.12572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 07/31/2023] [Accepted: 08/06/2023] [Indexed: 08/27/2023]
Abstract
BACKGROUND Fraudulent research participants create negative consequences for the rigour and soundness of research. AIMS A case study is presented from a qualitative study where the research team believed several fraudulent participants fabricated information during an interview about being a caregiver for a person living with dementia and chronic wounds. MATERIALS & METHODS Participants were recruited through a free online research registry. Individual semi-structured interviews were held virtually. RESULTS The study was paused after the nurse scientist with qualitative methodology experience identified that participants were giving illogical and repetitive responses across interviews. The team developed a revised screening tool to help reduce fraudulent participants from enrolling in the study. None of the data collected were used for analysis. DISCUSSION Information is provided on how the team dealt with the situation, lessons learned for future studies, and recommendations for gerontological nurse researchers. CONCLUSION Researchers should be aware that some participants are misrepresenting themselves for financial incentives and this can compromise the soundness of findings. Thorough screening tools are one way to identify and prevent fraud.
Collapse
Affiliation(s)
- Justine S Sefcik
- Drexel University College of Nursing and Health Professions, Philadelphia, Pennsylvania, USA
| | - Zachary Hathaway
- Drexel University College of Nursing and Health Professions, Philadelphia, Pennsylvania, USA
| | | |
Collapse
|
15
|
Ruppar T. Sharing Our Recruitment Challenges to Help Each Other. West J Nurs Res 2023; 45:979. [PMID: 37752760 DOI: 10.1177/01939459231205635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/28/2023]
|
16
|
Woodworth EC, Briskin EA, Plys E, Macklin E, Tatar RG, Huberty J, Vranceanu AM. Mindfulness-Based App to Reduce Stress in Caregivers of Persons With Alzheimer Disease and Related Dementias: Protocol for a Single-Blind Feasibility Proof-of-Concept Randomized Controlled Trial. JMIR Res Protoc 2023; 12:e50108. [PMID: 37831492 PMCID: PMC10612010 DOI: 10.2196/50108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 07/11/2023] [Accepted: 07/17/2023] [Indexed: 10/14/2023] Open
Abstract
BACKGROUND Informal caregivers (ie, individuals who provide assistance to a known person with health or functional needs, often unpaid) experience high levels of stress. Caregiver stress is associated with negative outcomes for both caregivers and care recipients. Mindfulness-based interventions (MBIs) show promise for improving stress, emotional distress, and sleep disturbance in caregivers of persons with Alzheimer disease and related dementias (ADRD). Commercially available mobile mindfulness apps can deliver MBIs to caregivers of persons with ADRD in a feasible and cost-effective manner. OBJECTIVE We are conducting a single-blind feasibility proof-of-concept randomized controlled trial (RCT; National Institutes of Health [NIH] stage 1B) comparing 2 free mobile apps: the active intervention Healthy Minds Program (HMP) with within-app text tailored for addressing stress among caregivers of persons with ADRD, versus Wellness App (WA), a time- and dose-matched educational control also tailored for caregivers of persons with ADRD. METHODS We aim to recruit 80 geographically diverse and stressed caregivers of persons with ADRD. Interested caregivers use a link or QR code on a recruitment flyer to complete a web-based eligibility screener. Research assistants conduct enrollment phone calls, during which participants provide informed consent digitally. After participants complete baseline surveys, we randomize them to the mindfulness-based intervention (HMP) or educational control podcast app (WA) and instruct them to listen to prescribed content for 10 minutes per day (70 minutes per week) for 12 weeks. Caregivers are blinded to intervention versus control. The study team checks adherence weekly and contacts participants to promote adherence as needed. Participants complete web-based self-report measures at baseline, posttest, and follow-up; weekly process measures are also completed. Primary outcomes are a priori set feasibility benchmarks. Secondary outcomes are stress, emotional distress, sleep disturbance, caregiver burden, mindfulness, awareness, connection, insight, and purpose. We will calculate 1-sided 95% CI to assess feasibility benchmarks. Effect sizes of change in outcomes will be used to examine the proof of concept. RESULTS Recruitment started on February 20, 2023. We have enrolled 27 caregivers (HMP: n=14; WA: n=13) as of June 2023. Funding began in August 2022, and we plan to finish enrollment by December 2023. Data analysis is expected to begin in May 2024 when all follow-ups are complete; publication of findings will follow. CONCLUSIONS Through this trial, we aim to establish feasibility benchmarks for HMP and WA, as well as establish a proof of concept that HMP improves stress (primary quantitative outcome), emotional distress, sleep, and mindfulness more than WA. Results will inform a future efficacy trial (NIH stage II). HMP has the potential to be a cost-effective solution to reduce stress in caregivers of persons with ADRD, benefiting caregiver health and quality of care as well as patient care. TRIAL REGISTRATION ClinicalTrials.gov NCT05732038; https://clinicaltrials.gov/study/NCT05732038. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/50108.
Collapse
Affiliation(s)
- Emily C Woodworth
- Center for Health Outcomes and Interdisciplinary Research, Massachusetts General Hospital, Boston, MA, United States
| | - Ellie A Briskin
- Center for Health Outcomes and Interdisciplinary Research, Massachusetts General Hospital, Boston, MA, United States
| | - Evan Plys
- Center for Health Outcomes and Interdisciplinary Research, Massachusetts General Hospital, Boston, MA, United States
- Harvard Medical School, Boston, MA, United States
| | - Eric Macklin
- Harvard Medical School, Boston, MA, United States
- Biostatistics Center, Massachusetts General Hospital, Boston, MA, United States
| | | | - Jennifer Huberty
- Department of Medicine, University of Texas Health, San Antonio, TX, United States
| | - Ana-Maria Vranceanu
- Center for Health Outcomes and Interdisciplinary Research, Massachusetts General Hospital, Boston, MA, United States
- Harvard Medical School, Boston, MA, United States
| |
Collapse
|
17
|
Leung T, Coulter RWS, Friedman MR, Thoma B, Switzer GE, Martina J, Egan JE, Primack B. The Influence of Social Media Interactions and Behaviors on Depressive Symptoms Among Sexual and Gender Minority Young Adults in the United States: Protocol for a Mixed Methods Longitudinal Study. JMIR Res Protoc 2023; 12:e43627. [PMID: 36692929 PMCID: PMC9906309 DOI: 10.2196/43627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 11/29/2022] [Accepted: 11/30/2022] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND Sexual and gender minority (SGM; ie, lesbian, gay, bisexual, transgender, and otherwise queer) young adults experience disparities in depression and other internalizing psychopathology. Although social media use is widespread and SGM people have more social media accounts and are more socially active on them than non-SGM individuals, few studies have examined the impact of social media on depression in this group. OBJECTIVE The PRIDE iM study will be the first longitudinal, mixed methods research conducted to determine the impact of social media interactions and behaviors as pathways to depressive symptoms among SGM young adults living in the United States. METHODS PRIDE iM uses a bookends variation of the longitudinal sequential mixed methods design. Participants will be recruited nationally from social media. First, between July 2019 and February 2020, we conducted a qualitative phase (T1) comprising web-based individual interviews (N=58) to inform the building and content of the quantitative survey. Second, from February 2022 to September 2022, we will conduct a series of web-based surveys (N=1000 at baseline) with 4 data points (T2-T5), each one collected every 6 to 8 weeks. Third, from October 2022 to December 2022, we will conduct a second qualitative phase (T6) of web-based interviews using outcome trajectories found in the longitudinal survey analyses to purposively sample survey participants and conduct web-based interviews to contextualize and explain survey findings. Qualitative data from T1 and T6 will be analyzed using a reflexive thematic analysis approach. As we sought to capture change over time in the association between the main predictors (ie, social media interactions and behaviors) and depressive symptoms, we propose analyzing T2 to T5 data using latent growth models with a structural equation modeling framework. Data integration at the method, interpretation, and reporting levels will be achieved through building and connecting and the use of a staged approach and joint displays, respectively. At all stages, we will assess the fit of data integration as recommended by the principles of best practice for mixed methods research in psychology. RESULTS Data collection will be completed by December 2022. Qualitative data analyses will be completed by March 2023, and quantitative analyses of the primary outcome of interest will be completed by June 2023. CONCLUSIONS PRIDE iM will confirm, reject, or uncover the presence of potential relationships between social media interactions and behaviors and depressive symptoms among SGM people. This study represents fundamental groundwork to develop social media-based interventions that target modifiable interactions and behaviors that are most likely to influence mental health outcomes, thus seizing the opportunity to merge the popularity of this medium among SGM people with evidence-based approaches. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/43627.
Collapse
Affiliation(s)
| | - Robert W S Coulter
- Department of Behavioral and Community Health Sciences, School of Public Health, University of Pittsburgh, Pittsburgh, PA, United States
| | - M Reuel Friedman
- Department of Urban-Global Public Health, School of Public Health, Rutgers University, Piscataway, NJ, United States
| | - Brian Thoma
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | - Galen E Switzer
- Division of General Internal Medicine, School of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
| | - Jamie Martina
- Department of Psychiatry, School of Medicine, University of Pittburgh Medical Center, Pittsburgh, PA, United States
| | - James Erin Egan
- Department of Behavioral and Community Health Sciences, School of Public Health, University of Pittsburgh, Pittsburgh, PA, United States
| | - Brian Primack
- Department of Health Promotion and Health Behavior, College of Public Health and Human Sciences, Oregon State University, Corvalis, OR, United States
| |
Collapse
|
18
|
Kukafka R, Skiffington J, Leijser LM, Slater D, Metcalfe A. Social Media Recruitment Strategies to Recruit Pregnant Women Into a Longitudinal Observational Cohort Study: Usability Study. J Med Internet Res 2022; 24:e40298. [PMID: 36508244 PMCID: PMC9793295 DOI: 10.2196/40298] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 09/30/2022] [Accepted: 10/25/2022] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND Use of social media for study recruitment is becoming increasingly common. Previous studies have typically focused on using Facebook; however, there are limited data to support the use of other social media platforms for participant recruitment, notably in the context of a pregnancy study. OBJECTIVE Our study aimed to evaluate the effectiveness of Facebook, Twitter, and Instagram in recruiting a representative sample of pregnant women in a longitudinal pregnancy cohort study in Calgary, Alberta, between September 27, 2021, and April 24, 2022. METHODS Paid advertisements were targeted at 18- to 50-year-old women in Calgary, with interests in pregnancy. Data regarding reach, link clicks, and costs were collected through Facebook Ads Manager (Meta Platforms, Inc) and Twitter Analytics (Twitter, Inc). The feasibility of each platform for recruitment was assessed based on the recruitment rate and cost-effectiveness. The demographic characteristics of the participants recruited through each source were compared using the chi-square test. RESULTS Paid advertisements reached 159,778 social media users, resulting in 2390 link clicks and 324 participants being recruited. Facebook reached and recruited the highest number of participants (153/324, 47.2%), whereas Instagram saw the highest number of link clicks relative to the number of users who saw the advertisement (418/19,764, 2.11%). Facebook and Instagram advertisements were cost-effective, with an average cost-per-click of CAD $0.65 (US $0.84; SD $0.27, US $0.35) and cost-per-completer of CAD $7.89 (US $10.25; SD CAD $4.08, US $5.30). Twitter advertisements were less successful in terms of recruitment and costs. Demographic characteristics of participants did not differ based on recruitment source, except for education and income, where more highly educated and higher-income participants were recruited through Instagram or Twitter. Many issues related to fraudulent responses were encountered throughout the recruitment period. CONCLUSIONS Paid social media advertisements (especially Facebook and Instagram) are feasible and cost-effective methods for recruiting a large sample of pregnant women for survey-based research. However, future research should be aware of the potential for fraudulent responses when using social media for recruitment and consider strategies to mitigate this problem.
Collapse
Affiliation(s)
| | - Janice Skiffington
- Department of Obstetrics and Gynecology, University of Calgary, Calgary, AB, Canada
| | - Lara M Leijser
- Section of Neonatology, Department of Pediatrics, University of Calgary, Calgary, AB, Canada
| | - Donna Slater
- Department of Obstetrics and Gynecology, University of Calgary, Calgary, AB, Canada.,Department of Physiology and Pharmacology, University of Calgary, Calgary, AB, Canada
| | - Amy Metcalfe
- Department of Obstetrics and Gynecology, University of Calgary, Calgary, AB, Canada.,Departments of Community Health Sciences and Medicine, University of Calgary, Calgary, AB, Canada
| |
Collapse
|