1
|
Milliken T, Beiler D, Hoffman S, Olenginski A, Troiani V. Recruitment in Appalachian, Rural and Older Adult Populations in an Artificial Intelligence World: Study Using Human-Mediated Follow-Up. JMIR Form Res 2024; 8:e38189. [PMID: 39173153 PMCID: PMC11377916 DOI: 10.2196/38189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 05/17/2024] [Accepted: 06/15/2024] [Indexed: 08/24/2024] Open
Abstract
BACKGROUND Participant recruitment in rural and hard-to-reach (HTR) populations can present unique challenges. These challenges are further exacerbated by the need for low-cost recruiting, which often leads to use of web-based recruitment methods (eg, email, social media). Despite these challenges, recruitment strategy statistics that support effective enrollment strategies for underserved and HTR populations are underreported. This study highlights how a recruitment strategy that uses email in combination with follow-up, mostly phone calls and email reminders, produced a higher-than-expected enrollment rate that includes a diversity of participants from rural, Appalachian populations in older age brackets and reports recruitment and demographic statistics within a subset of HTR populations. OBJECTIVE This study aims to provide evidence that a recruitment strategy that uses a combination of email, telephonic, and follow-up recruitment strategies increases recruitment rates in various HTR populations, specifically in rural, older, and Appalachian populations. METHODS We evaluated the overall enrollment rate of 1 recruitment arm of a larger study that aims to understand the relationship between genetics and substance use disorders. We evaluated the enrolled population's characteristics to determine recruitment success of a combined email and follow-up recruitment strategy, and the enrollment rate of HTR populations. These characteristics included (1) enrollment rate before versus after follow-up; (2) zip code and county of enrollee to determine rural or urban and Appalachian status; (3) age to verify recruitment in all eligible age brackets; and (4) sex distribution among age brackets and rural or urban status. RESULTS The email and follow-up arm of the study had a 17.4% enrollment rate. Of the enrolled participants, 76.3% (4602/6030) lived in rural counties and 23.7% (1428/6030) lived in urban counties in Pennsylvania. In addition, of patients enrolled, 98.7% (5956/6030) were from Appalachian counties and 1.3% (76/6030) were from non-Appalachian counties. Patients from rural Appalachia made up 76.2% (4603/6030) of the total rural population. Enrolled patients represented all eligible age brackets from ages 20 to 75 years, with the 60-70 years age bracket having the most enrollees. Females made up 72.5% (4371/6030) of the enrolled population and males made up 27.5% (1659/6030) of the population. CONCLUSIONS Results indicate that a web-based recruitment method with participant follow-up, such as a phone call and email follow-up, increases enrollment numbers more than web-based methods alone for rural, Appalachian, and older populations. Adding a humanizing component, such as a live person phone call, may be a key element needed to establish trust and encourage patients from underserved and rural areas to enroll in studies via web-based recruitment methods. Supporting statistics on this recruitment strategy should help researchers identify whether this strategy may be useful in future studies and HTR populations.
Collapse
Affiliation(s)
| | | | | | - Ashlee Olenginski
- Philadelphia College of Osteopathic Medicine, Philadelphia, PA, United States
| | | |
Collapse
|
2
|
Salem M, Pollack L, Zepeda A, Tebb KP. Utilization of online systems to promote youth participation in research: A methodological study. World J Methodol 2023; 13:210-222. [PMID: 37771869 PMCID: PMC10523248 DOI: 10.5662/wjm.v13.i4.210] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 06/09/2023] [Accepted: 07/06/2023] [Indexed: 09/20/2023] Open
Abstract
BACKGROUND Online surveys can align with youth's increased use of the internet and can be a mechanism for expanding youth participation in research. This is particularly important during the coronavirus disease 2019 (COVID-19) pandemic, when in-person interactions are limited. However, the advantages and drawbacks of online systems used for research need to be carefully considered before utilizing such methodologies. AIM To describe and discuss the strengths and limitations of an online system developed to recruit adolescent girls for a sexual health research study and conduct a three-month follow up survey. METHODS This methodology paper examines the use of an online system to recruit and follow participants three months after their medical visit to evaluate a mobile sexual and reproductive health application, Health-E You/Salud iTuTM, for adolescent girls attending school-based health centers (SBHCs) across the United States. SBHC staff gave adolescent girls a web link to an online eligibility and consent survey. Participants were then asked to complete two online surveys (baseline and 3-month follow-up). Surveys, reminders, and incentives to complete them were distributed through short message service (SMS) text messages. Upon completing each survey, participants were also sent an email with a link to an electronic gift card as a thank-you for their participation. Barriers to implementing this system were discussed with clinicians and staff at each participating SBHC. RESULTS This online recruitment and retention system enabled participant recruitment at 26 different SBHCs in seven states across the United States. Between September 2021 and June 2022, 415 adolescent girls were screened using the Qualtrics online survey platform, and 182 were eligible to participate. Of those eligible, 78.0% (n = 142) completed the baseline survey. Participants were racially, geographically, and linguistically diverse. Most of the participants (89.4%) were non-White, and 40.8% spoke Spanish. A total of 62.0% (n = 88) completed the 3-month follow-up survey. Limitations of this system included reliance on internet access (via Wi-Fi or cell service), which was not universally available or reliable. In addition, an individual unrelated to the study obtained the survey link, filled out multiple surveys, and received multiple gift cards before the research team discovered and stopped this activity. As a result, additional security protocols were instituted. CONCLUSION Online systems for health research can increase the reach and diversity of study participants, reduce costs for research personnel time and travel, allow for continued study operation when in-person visits are limited (such as during the COVID-19 pandemic), and connect youth with research using technology. However, there are challenges and limitations to online systems, which include limited internet access, intermittent internet connection, data security concerns, and the potential for fraudulent users. These challenges should be considered prior to using online systems for research.
Collapse
Affiliation(s)
- Marie Salem
- Institute for Health Policy Studies, University of California San Francisco, San Francisco, CA 94158, United States
| | - Lance Pollack
- Division of Prevention Science, University of California San Francisco, San Francisco, CA 94105, United States
| | - Alex Zepeda
- Research, Los Angeles Trust for Children's Health, Los Angeles, CA 90017, United States
| | - Kathleen P Tebb
- Department of Pediatrics, University of California San Francisco, San Francisco, CA 94143, United States
| |
Collapse
|
3
|
Walsh LE, Carter-Bawa L. Using social media to recruit individuals for health-related research: Feasibility and lessons learned. J Health Psychol 2023; 28:599-606. [PMID: 36416197 PMCID: PMC10251309 DOI: 10.1177/13591053221136928] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/01/2023] Open
Abstract
Online recruitment via social media for health-related research is increasing. Metrics regarding social media recruitment may increase its use in this field. This study evaluates the feasibility of recruiting individuals with a smoking history through targeted advertising on Facebook for a randomized study focused on lung cancer screening. Individuals completed eligibility questions and were randomized to one of two groups. We analyzed advertisement reach and response patterns, advertisement cost, data integrity and sample representativeness. The advertisement was active for 34 days and resulted in 2111 unique clicks on the survey link. Four hundred thirty-three eligibility entries were collected, and 61 entries were excluded due to failure to correctly answer the data integrity check. Two hundred eighty-two participants met eligibility criteria and were randomized, 191 participants completed questionnaires and 10 entries were subsequently excluded due to a failed attention check. Recruitment utilizing targeted advertising on Facebook is an effective and efficient strategy for health-related research.
Collapse
Affiliation(s)
- Leah E Walsh
- Memorial Sloan Kettering Cancer Center New York, USA
- Fordham University, USA
| | | |
Collapse
|
4
|
Luo T, Li MS, Williams D, Fritz J, Beiter K, Phillippi S, Yu Q, Kantrow S, Chen L, Chen Y, Tseng TS. A WeChat-based smoking cessation intervention for Chinese smokers: a feasibility study. Transl Behav Med 2022; 12:1018-1027. [PMID: 36130313 DOI: 10.1093/tbm/ibac067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023] Open
Abstract
WeChat is the largest social media platform in China, yet few WeChat-based smoking cessation interventions have been investigated to date. The objective of this study was to develop and test the feasibility of a WeChat-based smoking cessation intervention for smokers in China. Participants were recruited using WeChat and were then randomized into one of three groups: the Standard Group, the Enhanced Group, and the wait-list Control Group. Feasibility indicators including program reach, recruitment rate, recruitment efficiency, cost per person, attrition rate, intervention message exposure, group discussion utilization rate, intervention message engagement, satisfaction, and the likelihood of recommending to others were measured with assessed. Analyses included Chi-square and Fisher exact test, as well as analysis of variance test. A responsive participant is defined as a participant that responded to a certain assessment. A total of 1,132 individuals connected with ("friended") our project on WeChat between July 1 and August 5, 2019. Of these, 403 were eligible to participate, consented, and completed the baseline assessment. As a result, 136, 135, and 132 smokers were randomly assigned to the Standard Group, the Enhanced Group, and the Control Group, respectively. The total program recruitment rate was 35.6% and the attrition rate was 46.4%. The program cost was $0.85 per person. All responsive participants read at least one message during the intervention and engaged with intervention messages 56.8% of the time. Most responsive participants reported being very or somewhat satisfied, highly or somewhat engaged, and were willing to recommend our program to others. This study demonstrated the feasibility of a smoking cessation interventions using WeChat. The program could be expanded to deliver smoking cessation interventions to a large population of smokers.
Collapse
Affiliation(s)
- Ting Luo
- Moores Cancer Center, University of California San Diego, La Jolla, CA 92122, USA.,Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Mirandy S Li
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA.,School of Medicine, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Donna Williams
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Jackson Fritz
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA.,School of Medicine, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Kaylin Beiter
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA.,School of Medicine, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Stephen Phillippi
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Qingzhao Yu
- Biostatistics, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Stephen Kantrow
- School of Medicine, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| | - Liwei Chen
- Department of Epidemiology, Fielding School of Public Health, University of California Los Angeles, Los Angeles, CA 900095, USA
| | - Yongchun Chen
- Department of Clinical Nutrition, Henan Provincial People's Hospital, People's Hospital of Zhengzhou University, Zhengzhou, Henan 450003, China
| | - Tung Sung Tseng
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center-New Orleans, New Orleans, LA 70122, USA
| |
Collapse
|
5
|
Abstract
BACKGROUND Mindfulness-based smoking cessation interventions may aid smoking cessation by teaching individuals to pay attention to, and work mindfully with, negative affective states, cravings, and other symptoms of nicotine withdrawal. Types of mindfulness-based interventions include mindfulness training, which involves training in meditation; acceptance and commitment therapy (ACT); distress tolerance training; and yoga. OBJECTIVES To assess the efficacy of mindfulness-based interventions for smoking cessation among people who smoke, and whether these interventions have an effect on mental health outcomes. SEARCH METHODS We searched the Cochrane Tobacco Addiction Group's specialised register, CENTRAL, MEDLINE, Embase, PsycINFO, and trial registries to 15 April 2021. We also employed an automated search strategy, developed as part of the Human Behaviour Change Project, using Microsoft Academic. SELECTION CRITERIA We included randomised controlled trials (RCTs) and cluster-RCTs that compared a mindfulness-based intervention for smoking cessation with another smoking cessation programme or no treatment, and assessed smoking cessation at six months or longer. We excluded studies that solely recruited pregnant women. DATA COLLECTION AND ANALYSIS We followed standard Cochrane methods. We measured smoking cessation at the longest time point, using the most rigorous definition available, on an intention-to-treat basis. We calculated risk ratios (RRs) and 95% confidence intervals (CIs) for smoking cessation for each study, where possible. We grouped eligible studies according to the type of intervention and type of comparator. We carried out meta-analyses where appropriate, using Mantel-Haenszel random-effects models. We summarised mental health outcomes narratively. MAIN RESULTS We included 21 studies, with 8186 participants. Most recruited adults from the community, and the majority (15 studies) were conducted in the USA. We judged four of the studies to be at low risk of bias, nine at unclear risk, and eight at high risk. Mindfulness-based interventions varied considerably in design and content, as did comparators, therefore, we pooled small groups of relatively comparable studies. We did not detect a clear benefit or harm of mindfulness training interventions on quit rates compared with intensity-matched smoking cessation treatment (RR 0.99, 95% CI 0.67 to 1.46; I2 = 0%; 3 studies, 542 participants; low-certainty evidence), less intensive smoking cessation treatment (RR 1.19, 95% CI 0.65 to 2.19; I2 = 60%; 5 studies, 813 participants; very low-certainty evidence), or no treatment (RR 0.81, 95% CI 0.43 to 1.53; 1 study, 325 participants; low-certainty evidence). In each comparison, the 95% CI encompassed benefit (i.e. higher quit rates), harm (i.e. lower quit rates) and no difference. In one study of mindfulness-based relapse prevention, we did not detect a clear benefit or harm of the intervention over no treatment (RR 1.43, 95% CI 0.56 to 3.67; 86 participants; very low-certainty evidence). We did not detect a clear benefit or harm of ACT on quit rates compared with less intensive behavioural treatments, including nicotine replacement therapy alone (RR 1.27, 95% CI 0.53 to 3.02; 1 study, 102 participants; low-certainty evidence), brief advice (RR 1.27, 95% CI 0.59 to 2.75; 1 study, 144 participants; very low-certainty evidence), or less intensive ACT (RR 1.00, 95% CI 0.50 to 2.01; 1 study, 100 participants; low-certainty evidence). There was a high level of heterogeneity (I2 = 82%) across studies comparing ACT with intensity-matched smoking cessation treatments, meaning it was not appropriate to report a pooled result. We did not detect a clear benefit or harm of distress tolerance training on quit rates compared with intensity-matched smoking cessation treatment (RR 0.87, 95% CI 0.26 to 2.98; 1 study, 69 participants; low-certainty evidence) or less intensive smoking cessation treatment (RR 1.63, 95% CI 0.33 to 8.08; 1 study, 49 participants; low-certainty evidence). We did not detect a clear benefit or harm of yoga on quit rates compared with intensity-matched smoking cessation treatment (RR 1.44, 95% CI 0.40 to 5.16; 1 study, 55 participants; very low-certainty evidence). Excluding studies at high risk of bias did not substantially alter the results, nor did using complete case data as opposed to using data from all participants randomised. Nine studies reported on changes in mental health and well-being, including depression, anxiety, perceived stress, and negative and positive affect. Variation in measures and methodological differences between studies meant we could not meta-analyse these data. One study found a greater reduction in perceived stress in participants who received a face-to-face mindfulness training programme versus an intensity-matched programme. However, the remaining eight studies found no clinically meaningful differences in mental health and well-being between participants who received mindfulness-based treatments and participants who received another treatment or no treatment (very low-certainty evidence). AUTHORS' CONCLUSIONS We did not detect a clear benefit of mindfulness-based smoking cessation interventions for increasing smoking quit rates or changing mental health and well-being. This was the case when compared with intensity-matched smoking cessation treatment, less intensive smoking cessation treatment, or no treatment. However, the evidence was of low and very low certainty due to risk of bias, inconsistency, and imprecision, meaning future evidence may very likely change our interpretation of the results. Further RCTs of mindfulness-based interventions for smoking cessation compared with active comparators are needed. There is also a need for more consistent reporting of mental health and well-being outcomes in studies of mindfulness-based interventions for smoking cessation.
Collapse
Affiliation(s)
- Sarah Jackson
- Department of Behavioural Science and Health, University College London, London, UK
| | - Jamie Brown
- Department of Behavioural Science and Health, University College London, London, UK
| | - Emma Norris
- Health Behaviour Change Research Group, Brunel University London, London, UK
| | | | - Emily Hayes
- Centre for Behaviour Change, University College London, London, UK
| | - Nicola Lindson
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
6
|
Recruiting Cancer Survivors to a Mobile Mindfulness Intervention in the United States: Exploring Online and Face-to-Face Recruitment Strategies. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph181910136. [PMID: 34639439 PMCID: PMC8508107 DOI: 10.3390/ijerph181910136] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/23/2021] [Accepted: 09/23/2021] [Indexed: 01/22/2023]
Abstract
Cancer survivorship research faces several recruitment challenges, such as accrual of a representative sample, as well as participant retention. Our study explores patterns in recruited demographics, patient-reported outcomes (PROs), and retention rates for a randomized controlled trial (RCT) utilizing a mobile mindfulness intervention for the well-being of cancer survivors. In total, 123 participants were recruited using traditional and online strategies. Using the chi-square test of independence, recruitment type was compared with demographic and clinical variables, PROs, and retention at Time 2 and Time 3. Online recruitment resulted in almost double the yield compared to traditional recruitment. Online-recruited participants were more often younger, from the continental U.S., Caucasian, diagnosed and treated less recently, at a later stage of diagnosis, diagnosed with blood cancer, without high blood pressure, and with less reported pain. The recruitment method was not significantly associated with retention. Online recruitment may capture a larger, broader survivor sample, but, similar to traditional recruitment, may also lead to selection biases depending on where efforts are focused. Future research should assess the reasons underlying the higher yield and retention rates of online recruitment and should evaluate how to apply a mix of traditional and online recruitment strategies to efficiently accrue samples that are representative of the survivor population.
Collapse
|
7
|
Sato K, Niimi Y, Ihara R, Suzuki K, Toda T, Iwata A, Iwatsubo T. Efficacy and Cost-effectiveness of Promotion Methods to Recruit Participants to an Online Screening Registry for Alzheimer Disease Prevention Trials: Observational Study. J Med Internet Res 2021; 23:e26284. [PMID: 34292159 PMCID: PMC8367100 DOI: 10.2196/26284] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 02/03/2021] [Accepted: 05/24/2021] [Indexed: 01/29/2023] Open
Abstract
Background Web-based screening may be suitable for identifying individuals with presymptomatic latent diseases for recruitment to clinical studies, as such people do not often visit hospitals in the presymptomatic stage. The promotion of such online screening studies is critical to their success, although it remains uncertain how the effectiveness of such promotion can differ, depending on the different promotion methods, domains of interest, or countries of implementation. Objective The Japanese Trial-Ready Cohort (J-TRC) web study is our ongoing online screening registry to identify individuals with presymptomatic Alzheimer disease (AD), aimed at facilitating the clinical trials for AD prevention. Within the first 9 months of its 2019 launch, the J-TRC web study recruited thousands of online participants via multiple methods of promotion, including press releases, newspaper advertisements, web advertisements, or direct email invitations. Here, we aimed to quantitatively evaluate efficacy and cost-effectiveness of each of these multimodal promotion methods. Methods We applied the vector-autoregression model to assess the degree of contribution of each type of promotion to the following target metrics: number of daily visitors to the J-TRC website, number of daily registrants to the J-TRC web study, daily rate of registration among visitors, daily rate of eligible participants among registrants, and median age of daily registrants. The average cost-effectiveness for each promotion method was also calculated using the total cost and the coefficients in the vector-autoregression model. Results During the first 9 months of the reviewed period from October 31, 2019 to June 17, 2020, there were 48,334 website visitors and 4429 registrations (9.16% of 48,334 visitors), of which 3081 (69.56%) were eligible registrations. Initial press release reports and newspaper advertisements had a marked effect on increasing the number of daily visitors and daily registrants. Web advertisements significantly contributed to the increase in daily visitors (P<.001) but not to the daily registrants, and it also lowered the rate of registrations and the median age of daily registrants. Website visitors from the direct email invitation sent to other cognitive registries seem to have registered with the highest reliability. The calculated average cost-effectiveness for the initial press release was US $24.60 per visitor and US $96.10 per registrant, while the calculated average cost-effectiveness for the newspaper advertisements was US $28.60 per visitor and US $227.90 per registrant. Conclusions Our multivariate time-series analysis showed that each promotion method had different features in their effect of recruiting participants to the J-TRC web study. Under the advertisement condition settings thus far, newspaper advertisements and initial press releases were the most effective promotion methods, with fair cost-effectiveness that was equivalent to earlier online studies. These results can provide important suggestions for future promotions for the recruitment of presymptomatic participants to AD clinical trials in Japan.
Collapse
Affiliation(s)
- Kenichiro Sato
- Department of Neurology, University of Tokyo Hospital, Tokyo, Japan.,Department of Neuropathology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Yoshiki Niimi
- Unit for Early and Exploratory Clinical Development, The University of Tokyo Hospital, Tokyo, Japan
| | - Ryoko Ihara
- Department of Neurology, Tokyo Metropolitan Geriatric Medical Center Hospital, Tokyo, Japan
| | - Kazushi Suzuki
- Division of Neurology, Internal Medicine, National Defense Medical College, Saitama, Japan
| | - Tatsushi Toda
- Department of Neurology, University of Tokyo Hospital, Tokyo, Japan
| | - Atsushi Iwata
- Department of Neurology, Tokyo Metropolitan Geriatric Medical Center Hospital, Tokyo, Japan
| | - Takeshi Iwatsubo
- Department of Neuropathology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
8
|
Harfield S, Elliott S, Ramsey L, Housen T, Ward J. Using social networking sites to recruit participants: methods of an online survey of sexual health, knowledge and behaviour of young South Australians. Aust N Z J Public Health 2021; 45:348-354. [PMID: 34097339 DOI: 10.1111/1753-6405.13117] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Revised: 03/01/2021] [Accepted: 03/01/2021] [Indexed: 01/22/2023] Open
Abstract
OBJECTIVE To describe the methods of recruitment and demographic results of an online sexual health survey using social networking sites (SNS) to recruit people aged 16-29 years in the state of South Australia (SA) during 2019. METHODS A crosssectional online survey titled 'Let's Talk About It' using SNS (Facebook and Instagram) was administered between July and August 2019, targeting Aboriginal and Torres Strait Islander and non-Indigenous young people. The survey comprised questions on demographics information, sexual health knowledge, behaviours and healthcare access. RESULTS During the data collection period, the study team closely monitored the demographics of participants and adjusted SNS messaging through paid advertising to increase the recruitment of under-represented population groups, especially Aboriginal people, males and regional and remote residents of SA. A total of 2,724 people accessed the survey predominately via Facebook during a six-week period between July and August 2019; 2,380 people were eligible and included in the analysis. Conclusions and implications for public health: Even though SNS have been used previously in recruitment for sexual health issues, small adjustments to the study during recruitment were specifically made to include under-represented populations in the final study. Using SNS is an effective method for recruiting survey participants; during recruitment phases, additional strategies may be required to be inclusive of diverse and under-represented populations.
Collapse
Affiliation(s)
- Stephen Harfield
- Wardliparingga Aboriginal Health Equity, South Australian Health and Medical Research Institute, South Australia.,National Centre for Epidemiology & Population Health, The Australian National University, Australian Capital Territory
| | - Salenna Elliott
- Wardliparingga Aboriginal Health Equity, South Australian Health and Medical Research Institute, South Australia
| | - Liam Ramsey
- College of Medicine and Public Health, Flinders University, South Australia
| | - Tambri Housen
- National Centre for Epidemiology & Population Health, The Australian National University, Australian Capital Territory
| | - James Ward
- Wardliparingga Aboriginal Health Equity, South Australian Health and Medical Research Institute, South Australia.,School of Public Health, The University of Queensland.,UQ Poche Centre for Indigenous Health, The University of Queensland
| |
Collapse
|
9
|
Smith R, Alvarez C, Crixell S, Lane MA. The Food, Feelings, and Family Study: comparison of the efficacy of traditional methods, social media, and broadcast email to recruit pregnant women to an observational, longitudinal nutrition study. BMC Pregnancy Childbirth 2021; 21:203. [PMID: 33711946 PMCID: PMC7953646 DOI: 10.1186/s12884-021-03680-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Accepted: 02/28/2021] [Indexed: 11/17/2022] Open
Abstract
Background It is well known that recruitment is a challenging aspect of any study involving human subjects. This challenge is exacerbated when the population sought is reticent to participate in research as is the case with pregnant women and individuals with depression. This paper compares recruitment methods used for the Food, Feelings, and Family Study, an observational, longitudinal pilot study concerning how diet and bisphenol A exposure affect maternal mood and cognitive function during and after pregnancy. Methods Pregnant women were recruited to this study over a period of 15 months using traditional methods, social media including paid and unpaid posts, and emails broadcast to the university community. Contingency analysis using the Pearson’s Chi-square test was used to determine if recruitment method was associated with likelihood of participation. T-tests were used to analyze Facebook advertisement success. ANOVAs and Fisher exact tests were used to determine if recruitment method was related to continuous and categorical demographics, respectively. Results Social media resulted in the largest number of recruits, followed by traditional methods and broadcast email. Women recruited through social media were less likely to participate. In contrast, use of broadcast email resulted in a smaller pool of recruits but these recruits were more likely to be eligible for and complete the study. Most women recruited via social media were the result of unpaid posts to the study’s Facebook page. Paid posts lasting at least 4 days were the most successful. Recruitment method was not associated with participant demographics. Conclusions Social media has the potential to recruit a large pool of potential subjects; however, when studies require a large time investment such as the case here, women recruited through social media are less likely to participate and complete the study than women recruited through other means. Trial registration N/A. This study does not describe a health care intervention. Supplementary Information The online version contains supplementary material available at 10.1186/s12884-021-03680-1.
Collapse
Affiliation(s)
- Rebecca Smith
- Nutrition and Foods Program, School of Family and Consumer Sciences, Texas State University, 601 University Dr., San Marcos, TX, 78666, USA
| | - Crystal Alvarez
- Nutrition and Foods Program, School of Family and Consumer Sciences, Texas State University, 601 University Dr., San Marcos, TX, 78666, USA
| | - Sylvia Crixell
- Nutrition and Foods Program, School of Family and Consumer Sciences, Texas State University, 601 University Dr., San Marcos, TX, 78666, USA
| | - Michelle A Lane
- Nutrition and Foods Program, School of Family and Consumer Sciences, Texas State University, 601 University Dr., San Marcos, TX, 78666, USA.
| |
Collapse
|
10
|
Faro JM, Nagawa CS, Orvek EA, Smith BM, Blok AC, Houston TK, Kamberi A, Allison JJ, Person SD, Sadasivam RS. Comparing recruitment strategies for a digital smoking cessation intervention: Technology-assisted peer recruitment, social media, ResearchMatch, and smokefree.gov. Contemp Clin Trials 2021; 103:106314. [PMID: 33571687 DOI: 10.1016/j.cct.2021.106314] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 01/29/2021] [Accepted: 02/01/2021] [Indexed: 01/08/2023]
Abstract
BACKGROUND Choosing the right recruitment strategy has implications for the successful conduct of a trial. Our objective was to compare a novel peer recruitment strategy to four other recruitment strategies for a large randomized trial testing a digital tobacco intervention. METHODS We compared enrollment rates, demographic and baseline smoking characteristics, and odds of completing the 6-month study by recruitment strategy. Cost of recruitment strategies per retained participant was calculated using staff personnel time and advertisement costs. FINDINGS We enrolled 1487 participants between August 2017 and March 2019 from: Peer recruitment n = 273 (18.4%), Facebook Ads n = 505 (34%), Google Ads = 200 (13.4%), ResearchMatch n = 356 (23.9%) and Smokefree.govn = 153 (10.3%). Mean enrollment rate per active recruitment month: 1) Peer recruitment, n = 13.9, 2) Facebook ads, n = 25.3, 3) Google ads, n = 10.51, 4) Research Match, n = 59.3, and 5) Smokefree.gov, n = 13.9. Peer recruitment recruited the greatest number of males (n = 110, 40.3%), young adults (n = 41, 14.7%), participants with a high school degree or less (n = 24, 12.5%) and smokers within one's social network. Compared to peer recruitment (retention rate = 57%), participants from Facebook were less likely (OR 0.46, p < 0.01, retention rate = 40%), and those from ResearchMatch were more likely to complete the study (OR 1.90, p < 0.01, retention rate = 70%). Peer recruitment was moderate in cost per retained participant ($47.18) and substantially less costly than Facebook ($173.60). CONCLUSIONS Though peer recruitment had lower enrollment than other strategies, it may provide greater access to harder to reach populations and possibly others who smoke within one's social network while being moderately cost-effective. ClinicalTrials.gov: NCT03224520.
Collapse
Affiliation(s)
- Jamie M Faro
- Division of Health Informatics and Implementation Science, Population and Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States.
| | - Catherine S Nagawa
- Division of Health Informatics and Implementation Science, Population and Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States
| | - Elizabeth A Orvek
- Division of Health Informatics and Implementation Science, Population and Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States
| | - Bridget M Smith
- Center of Innovation for Complex Chronic Healthcare (CINCCH), Spinal Cord Injury Quality Enhancement Research Initiative (QUERI), Hines VAMC, Chicago, IL, United States; Department of Pediatrics and Center for Community Health, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Amanda C Blok
- Department of Systems, Populations and Leadership, University of Michigan School of Nursing, Ann Arbor, MI, United States
| | - Thomas K Houston
- Wake Forest University School of Medicine, Medical Center Boulevard, Winston-Salem, NC, United States
| | - Ariana Kamberi
- Division of Health Informatics and Implementation Science, Population and Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States
| | - Jeroan J Allison
- Division of Health Informatics and Implementation Science, Population and Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States
| | - Sharina D Person
- Division of Biostatistics and Health Services Research, Population and Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States
| | - Rajani S Sadasivam
- Division of Health Informatics and Implementation Science, Population and Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States
| |
Collapse
|
11
|
Spahrkäs SS, Looijmans A, Sanderman R, Hagedoorn M. Recruiting participants for an international mHealth study via Facebook Ads: Experiences from the Untire App RCT. Internet Interv 2021; 23:100362. [PMID: 33489782 PMCID: PMC7811041 DOI: 10.1016/j.invent.2021.100362] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Revised: 11/23/2020] [Accepted: 12/29/2020] [Indexed: 02/06/2023] Open
Abstract
INTRODUCTION Social media recruitment via Facebook Ads seems to be a promising method for large-scale international trials examining the effectiveness of mHealth interventions. However, little is known about this method in terms of strategy, reach, and costs in the context of psycho-oncology. This paper presents the results of the recruitment strategy that was applied in the Untire app study and shows how many participants could be reached using advertisements (i.e., Ads) on Facebook, who participated, and what it cost. METHOD The Untire app study is a randomized controlled trial targeted at cancer patients and survivors across four English-speaking countries (i.e., Australia, Canada, the U.K., and the U.S.A.). Reach was assessed by the number of people who were shown the Ads, who clicked on the Ads, and completed study assessments. Demographic characteristics were gathered from Facebook Ads Manager and from online study assessments to describe who was reached. Costs were assessed by the budget spent and the cost per click for Ads, for reaching the study's landing page, and for completing study assessments. To conduct a powered RCT, we needed 164 12-weeks assessments in both the intervention and the control group. RESULTS From March till October 2018, we used 76 Ads, which were presented to 1.2 million people. 37.376 persons clicked on the study link in the Ads, resulting in 755 baseline completers. Most participants were female (92%), middle-aged (55.5 ± 9.79), and came from the U.K. (72%). The total Facebook advertisement costs from March till October 2018 were €17 k, resulting in an average cost of €0.45 per click on the Ads, €5.55 on average for a person reaching the study's landing page, and €14.89 on average per eligible participant. The costs for every baseline and 12-weeks completer were €22.42 and €47.69, respectively. DISCUSSION Reaching participants for international mHealth studies in psycho-oncology via Facebook Ads has potential but is costly. The key to reducing costs lies in constant optimization and testing of Ads and refinement of target audience characteristics.
Collapse
Affiliation(s)
- Simon S. Spahrkäs
- Department of Health Psychology, University of Groningen, University Medical Center Groningen, the Netherlands,Corresponding author at: Department of Health Psychology, University of Groningen, University Medical Center Groningen, Antonius Deusinglaan 1, POB 196, 9700AD Groningen, the Netherlands.
| | - Anne Looijmans
- Department of Health Psychology, University of Groningen, University Medical Center Groningen, the Netherlands
| | - Robbert Sanderman
- Department of Health Psychology, University of Groningen, University Medical Center Groningen, the Netherlands,Department of Psychology, Health & Technology, University of Twente, the Netherlands
| | - Mariët Hagedoorn
- Department of Health Psychology, University of Groningen, University Medical Center Groningen, the Netherlands
| |
Collapse
|
12
|
Brøgger-Mikkelsen M, Ali Z, Zibert JR, Andersen AD, Thomsen SF. Online Patient Recruitment in Clinical Trials: Systematic Review and Meta-Analysis. J Med Internet Res 2020; 22:e22179. [PMID: 33146627 PMCID: PMC7673977 DOI: 10.2196/22179] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Revised: 08/19/2020] [Accepted: 09/15/2020] [Indexed: 12/21/2022] Open
Abstract
Background Recruitment for clinical trials continues to be a challenge, as patient recruitment is the single biggest cause of trial delays. Around 80% of trials fail to meet the initial enrollment target and timeline, and these delays can result in lost revenue of as much as US $8 million per day for drug developing companies. Objective This study aimed to conduct a systematic review and meta-analysis examining the effectiveness of online recruitment of participants for clinical trials compared with traditional in-clinic/offline recruitment methods. Methods Data on recruitment rates (the average number of patients enrolled in the study per month and per day of active recruitment) and conversion rates (the percentage of participants screened who proceed to enroll into the clinical trial), as well as study characteristics and patient demographics were collected from the included studies. Differences in online and offline recruitment rates and conversion rates were examined using random effects models. Further, a nonparametric paired Wilcoxon test was used for additional analysis on the cost-effectiveness of online patient recruitment. All data analyses were conducted in R language, and P<.05 was considered significant. Results In total, 3861 articles were screened for inclusion. Of these, 61 studies were included in the review, and 23 of these were further included in the meta-analysis. We found online recruitment to be significantly more effective with respect to the recruitment rate for active days of recruitment, where 100% (7/7) of the studies included had a better online recruitment rate compared with offline recruitment (incidence rate ratio [IRR] 4.17, P=.04). When examining the entire recruitment period in months we found that 52% (12/23) of the studies had a better online recruitment rate compared with the offline recruitment rate (IRR 1.11, P=.71). For cost-effectiveness, we found that online recruitment had a significantly lower cost per enrollee compared with offline recruitment (US $72 vs US $199, P=.04). Finally, we found that 69% (9/13) of studies had significantly better offline conversion rates compared with online conversion rates (risk ratio 0.8, P=.02). Conclusions Targeting potential participants using online remedies is an effective approach for patient recruitment for clinical research. Online recruitment was both superior in regard to time efficiency and cost-effectiveness compared with offline recruitment. In contrast, offline recruitment outperformed online recruitment with respect to conversion rate.
Collapse
Affiliation(s)
- Mette Brøgger-Mikkelsen
- Department of Dermatology, Bispebjerg Hospital, Copenhagen, Denmark.,Department of Biomedical Sciences, University of Copenhagen, Copenhagen, Denmark.,Studies&Me A/S, LEO Innovation Lab, Copenhagen, Denmark
| | - Zarqa Ali
- Department of Dermatology, Bispebjerg Hospital, Copenhagen, Denmark.,Department of Biomedical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - John R Zibert
- Studies&Me A/S, LEO Innovation Lab, Copenhagen, Denmark
| | | | - Simon Francis Thomsen
- Department of Dermatology, Bispebjerg Hospital, Copenhagen, Denmark.,Department of Biomedical Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
13
|
Sanchez C, Grzenda A, Varias A, Widge AS, Carpenter LL, McDonald WM, Nemeroff CB, Kalin NH, Martin G, Tohen M, Filippou-Frye M, Ramsey D, Linos E, Mangurian C, Rodriguez CI. Social media recruitment for mental health research: A systematic review. Compr Psychiatry 2020; 103:152197. [PMID: 32992073 PMCID: PMC7704547 DOI: 10.1016/j.comppsych.2020.152197] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 07/14/2020] [Accepted: 08/06/2020] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND Social media holds exciting promise for advancing mental health research recruitment, however, the extent and efficacy to which these platforms are currently in use are underexplored. OBJECTIVE A systematic review was conducted to characterize the current use and efficacy of social media in recruiting participants for mental health research. METHOD A literature review was performed using MEDLINE, EMBASE, and PsychINFO. Only non-duplicative manuscripts written in the English language and published between 1/1/2004-3/31/2019 were selected for further screening. Data extracted included study type and design, participant inclusion criteria, social media platform, advertising strategy, final recruited sample size, recruitment location, year, monetary incentives, comparison to other recruitment methods if performed, and final cost per participant. RESULTS A total of 176 unique studies that used social media for mental health research recruitment were reviewed. The majority of studies were cross-sectional (62.5%) in design and recruited adults. Facebook was overwhelmingly the recruitment platform of choice (92.6%), with the use of paid advertisements being the predominant strategy (60.8%). Of the reviewed studies, substance abuse (43.8%) and mood disorders (15.3%) were the primary subjects of investigation. In 68.3% of studies, social media recruitment performed as well as or better than traditional recruitment methods in the number and cost of final enrolled participants. The majority of studies used Facebook for recruitment at a median cost per final recruited study participant of $19.47. In 55.6% of the studies, social media recruitment was the more cost-effective recruitment method when compared to traditional methods (e.g., referrals, mailing). CONCLUSION Social media appears to be an effective and economical recruitment tool for mental health research. The platform raises methodological and privacy concerns not covered in current research regulations that warrant additional consideration.
Collapse
Affiliation(s)
- Catherine Sanchez
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Adrienne Grzenda
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
| | - Andrea Varias
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Alik S Widge
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, MN, USA
| | - Linda L Carpenter
- Department of Psychiatry and Human Behavior, Butler Hospital and Warren Alpert Medical School, Brown University, Providence, RI, USA
| | - William M McDonald
- Department of Psychiatry and Human Behavior, Emory University School of Medicine, Atlanta, GA, USA
| | - Charles B Nemeroff
- Department of Psychiatry, University of Texas at Austin Dell Medical School, Austin, TX, USA
| | - Ned H Kalin
- Department of Psychiatry, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA
| | - Glenn Martin
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Mauricio Tohen
- Department of Psychiatry and Behavioral Sciences, University of New Mexico Health Sciences Center, Albuquerque, NM, USA
| | - Maria Filippou-Frye
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Drew Ramsey
- Department of Psychiatry, Columbia University, New York, NY, USA
| | - Eleni Linos
- Department of Dermatology, Stanford University, Stanford, CA, USA
| | - Christina Mangurian
- Department of Psychiatry, Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA; UCSF Center for Vulnerable Populations, University of California San Francisco, San Francisco, CA, USA; UCSF Philip R. Lee Institute for Health Policy Studies, University of California San Francisco, San Francisco, CA, USA
| | - Carolyn I Rodriguez
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA; Veterans Affairs Palo Alto Health Care System, Palo Alto, CA, USA.
| |
Collapse
|
14
|
Darmawan I, Bakker C, Brockman TA, Patten CA, Eder M. The Role of Social Media in Enhancing Clinical Trial Recruitment: Scoping Review. J Med Internet Res 2020; 22:e22810. [PMID: 33104015 PMCID: PMC7652693 DOI: 10.2196/22810] [Citation(s) in RCA: 62] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 08/31/2020] [Accepted: 09/15/2020] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND Recruiting participants into clinical trials continues to be a challenge, which can result in study delay or termination. Recent studies have used social media to enhance recruitment outcomes. An assessment of the literature on the use of social media for this purpose is required. OBJECTIVE This study aims to answer the following questions: (1) How is the use of social media, in combination with traditional approaches to enhance clinical trial recruitment and enrollment, represented in the literature? and (2) Do the data on recruitment and enrollment outcomes presented in the literature allow for comparison across studies? METHODS We conducted a comprehensive literature search across 7 platforms to identify clinical trials that combined social media and traditional methods to recruit patients. Study and participant characteristics, recruitment methods, and recruitment outcomes were evaluated and compared. RESULTS We identified 2371 titles and abstracts through our systematic search. Of these, we assessed 95 full papers and determined that 33 studies met the inclusion criteria. A total of 17 studies reported enrollment outcomes, of which 9 achieved or exceeded their enrollment target. The proportion of participants enrolled from social media in these studies ranged from 0% to 49%. Across all 33 studies, the proportion of participants recruited and enrolled from social media varied greatly. A total of 9 studies reported higher enrollment rates from social media than any other methods, and 4 studies reported the lowest cost per enrolled participant from social media. CONCLUSIONS While the assessment of the use of social media to improve clinical trial participation is hindered by reporting inconsistencies, preliminary data suggest that social media can increase participation and reduce per-participant cost. The adoption of consistent standards for reporting recruitment and enrollment outcomes is required to advance our understanding and use of social media to support clinical trial success.
Collapse
Affiliation(s)
- Ida Darmawan
- Hubbard School of Journalism and Mass Communication, University of Minnesota, Minneapolis, MN, United States
| | - Caitlin Bakker
- Health Sciences Libraries, University of Minnesota, Minneapolis, MN, United States
| | - Tabetha A Brockman
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
- Center for Clinical and Translational Science, Mayo Clinic, Rochester, MN, United States
| | - Christi A Patten
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
- Center for Clinical and Translational Science, Mayo Clinic, Rochester, MN, United States
| | - Milton Eder
- Department of Family Medicine & Community Health, University of Minnesota, Minneapolis, MN, United States
- Clinical and Translational Science Institute, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
15
|
Frampton GK, Shepherd J, Pickett K, Griffiths G, Wyatt JC. Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map. Trials 2020; 21:478. [PMID: 32498690 PMCID: PMC7273688 DOI: 10.1186/s13063-020-04358-3] [Citation(s) in RCA: 40] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2019] [Accepted: 04/28/2020] [Indexed: 12/14/2022] Open
Abstract
BACKGROUND Recruiting and retaining participants in randomised controlled trials (RCTs) is challenging. Digital tools, such as social media, data mining, email or text-messaging, could improve recruitment or retention, but an overview of this research area is lacking. We aimed to systematically map the characteristics of digital recruitment and retention tools for RCTs, and the features of the comparative studies that have evaluated the effectiveness of these tools during the past 10 years. METHODS We searched Medline, Embase, other databases, the Internet, and relevant web sites in July 2018 to identify comparative studies of digital tools for recruiting and/or retaining participants in health RCTs. Two reviewers independently screened references against protocol-specified eligibility criteria. Included studies were coded by one reviewer with 20% checked by a second reviewer, using pre-defined keywords to describe characteristics of the studies, populations and digital tools evaluated. RESULTS We identified 9163 potentially relevant references, of which 104 articles reporting 105 comparative studies were included in the systematic map. The number of published studies on digital tools has doubled in the past decade, but most studies evaluated digital tools for recruitment rather than retention. The key health areas investigated were health promotion, cancers, circulatory system diseases and mental health. Few studies focussed on minority or under-served populations, and most studies were observational. The most frequently-studied digital tools were social media, Internet sites, email and tv/radio for recruitment; and email and text-messaging for retention. One quarter of the studies measured efficiency (cost per recruited or retained participant) but few studies have evaluated people's attitudes towards the use of digital tools. CONCLUSIONS This systematic map highlights a number of evidence gaps and may help stakeholders to identify and prioritise further research needs. In particular, there is a need for rigorous research on the efficiency of the digital tools and their impact on RCT participants and investigators, perhaps as studies-within-a-trial (SWAT) research. There is also a need for research into how digital tools may improve participant retention in RCTs which is currently underrepresented relative to recruitment research. REGISTRATION Not registered; based on a pre-specified protocol, peer-reviewed by the project's Advisory Board.
Collapse
Affiliation(s)
- Geoff K. Frampton
- Southampton Health Technology Assessments Centre (SHTAC), Wessex Institute, Faculty of Medicine, University of Southampton, Alpha House, Southampton Science Park, Southampton, SO16 7NS UK
- Wessex Institute, Faculty of Medicine, University of Southampton, Alpha House, Southampton Science Park, Southampton, SO16 7NS UK
| | - Jonathan Shepherd
- Southampton Health Technology Assessments Centre (SHTAC), Wessex Institute, Faculty of Medicine, University of Southampton, Alpha House, Southampton Science Park, Southampton, SO16 7NS UK
- Wessex Institute, Faculty of Medicine, University of Southampton, Alpha House, Southampton Science Park, Southampton, SO16 7NS UK
| | - Karen Pickett
- Southampton Health Technology Assessments Centre (SHTAC), Wessex Institute, Faculty of Medicine, University of Southampton, Alpha House, Southampton Science Park, Southampton, SO16 7NS UK
- Wessex Institute, Faculty of Medicine, University of Southampton, Alpha House, Southampton Science Park, Southampton, SO16 7NS UK
| | - Gareth Griffiths
- Southampton Clinical Trials Unit, University of Southampton and Southampton University Hospital NHS Foundation Trust, Southampton General Hospital, Southampton, SO16 6YD UK
| | - Jeremy C. Wyatt
- Wessex Institute, Faculty of Medicine, University of Southampton, Alpha House, Southampton Science Park, Southampton, SO16 7NS UK
| |
Collapse
|
16
|
Applequist J, Burroughs C, Ramirez A, Merkel PA, Rothenberg ME, Trapnell B, Desnick RJ, Sahin M, Krischer JP. A novel approach to conducting clinical trials in the community setting: utilizing patient-driven platforms and social media to drive web-based patient recruitment. BMC Med Res Methodol 2020; 20:58. [PMID: 32169041 PMCID: PMC7069058 DOI: 10.1186/s12874-020-00926-y] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2019] [Accepted: 02/14/2020] [Indexed: 12/16/2022] Open
Abstract
Background Participant recruitment for clinical research studies remains a significant challenge for researchers. Novel approaches to recruitment are necessary to ensure that populations are easier to reach. In the context of rare diseases, social media provides a unique opportunity for connecting with patient groups that have representatively lower diagnosis rates when compared with more common diseases or illness. We describe the implementation of designing a patient-centered approach to message design for the purposes of recruiting patients for clinical research studies for rare disease populations. Methods Using an iterative research approach, we analyzed our previous experience of using web-based direct-to-patient recruitment methods to compare these online strategies with traditional center of excellence recruitment strategies. After choosing six research studies for inclusion in the previous study, in-depth, online interviews (n = 37) were conducted with patients represented in each disease category to develop and test recruitment message strategies for social media and a Web-based platform for patients to access study information and pre-screen. Finally, relationships were established with Patient Advocacy Groups representing each rare disease category to ensure further dissemination of recruitment materials via their own social media networks. Results Guided by social marketing theory, we created and tested various recruitment message designs. Three key message concepts preferred by patients emerged: (1) infographic; (2) positive emotional messages; and (3) educational information for sharing. A base study website was designed and created based on data from patient interviews. This website includes the option for potential participants to pre-screen and determine their eligibility for the study. Conclusions Study participants report wanting to be involved in the design and implementation of recruitment approaches for clinical research studies. The application of the aforementioned methods could aide in the evolution of clinical research practices for the recruitment of both rare and common diseases, where patient-centric approaches can help to create targeted messages designs that participants pre-test and support.
Collapse
Affiliation(s)
- Janelle Applequist
- Zimmerman School of Advertising and Mass Communications, University of South Florida, 4202 E. Fowler Ave., CIS 1040, Tampa, FL, 33620, USA.
| | - Cristina Burroughs
- Health Informatics Institute, University of South Florida, 3650 Spectrum Blvd., Suite 100, Tampa, FL, 33612, USA
| | - Artemio Ramirez
- Zimmerman School of Advertising and Mass Communications, University of South Florida, 4202 E. Fowler Ave., CIS 1040, Tampa, FL, 33620, USA
| | - Peter A Merkel
- Rheumatology Division, University of Pennsylvania, 3400 Spruce St., 5 White, Philadelphia, PA, 19104, USA
| | - Marc E Rothenberg
- Department of Internal Medicine, University of Cincinnati College of Medicine, Medical Science Building, 231 Albert Sabin Way, P.O. Box 670515, Cincinnati, OH, 45257-0515, USA
| | - Bruce Trapnell
- Department of Internal Medicine, University of Cincinnati College of Medicine, Medical Science Building, 231 Albert Sabin Way, P.O. Box 670515, Cincinnati, OH, 45257-0515, USA
| | - Robert J Desnick
- Icahn School of Medicine at Mount Sinai, Icahn (East) Building, Floor 14, Room 14-34, 1425 Madison Ave, New York, NY, 10029, USA
| | - Mustafa Sahin
- F.M. Kirby Neurobiology Center, Boston Children's Hospital, Center for Life Science, Room 14-073, 3 Blackfan Circle, Boston, MA, 02115, USA
| | - Jeffrey P Krischer
- Health Informatics Institute, University of South Florida, 3650 Spectrum Blvd., Suite 100, Tampa, FL, 33612, USA
| |
Collapse
|
17
|
Luo T, Li MS, Williams D, Phillippi S, Yu Q, Kantrow S, Kao YH, Celestin M, Lin WT, Tseng TS. Using social media for smoking cessation interventions: a systematic review. Perspect Public Health 2020; 141:50-63. [DOI: 10.1177/1757913920906845] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Background: Previous studies have shown that smoking tobacco significantly increases both incidence and mortality rates for many diseases. Social media has become one of the most influential platforms for various smoking cessation interventions. However, results from smoking cessation interventions have differed from study to study. Limited studies have summarised cessation outcomes from social media–based interventions. Therefore, the objective of this review is to explore the effectiveness of using social media for smoking cessation. Methods: We searched PubMed, MEDLINE, PsycINFO, and CINAHL for articles between June 2008 and June 2018, and also assessed the references of selected articles. We included studies that used social media as intervention platforms, provided a baseline assessment before the intervention, and provided smoking cessation outcomes after the intervention. Results: We identified 13 original studies that enrolled between 16 and 1698 participants; 7-day Point Prevalence Abstinence (PPA) rate was the most frequently used measure of abstinence, with a range of 7%–75%, regardless of the measurement time, study design, and analysis methods. Social media–based smoking cessation interventions were effective, because (1) smokers reported higher 7-day PPA rates after intervention compared to baseline and (2) smokers reported higher 7-day PPA rates in intervention groups than in control groups. Moreover, at each time point, approximately half of all smokers in studies reporting abstinence were found to be biochemically abstinent. There were no significant differences in the effectiveness of smoking cessation outcomes between those that used existing popular social networking platforms (e.g. Pechmann et al’s studies) and those that used individually designed interactive platforms (e.g. MyLastDip, iQuit system, Quitxt system). Conclusions: This review highlights the effectiveness of social media–based smoking cessation intervention studies. Due to the widespread use of social media, as well as its low cost, we suggest embedding smoking cessation interventions within existing popular social media platforms.
Collapse
Affiliation(s)
- T Luo
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - MS Li
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center, New Orleans, LA, USA
- School of Medicine, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - D Williams
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - S Phillippi
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - Q Yu
- Biostatistics, School of Public Health, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - S Kantrow
- School of Medicine, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - YH Kao
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - M Celestin
- Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center, New Orleans, LA, USA
| | - WT Lin
- Department of Global Community Health and Behavioral Sciences, Tulane University School of Public Health & Tropical Medicine, New Orleans, LA, USA
| | - TS Tseng
- Associate Professor, Behavioral and Community Health Sciences, School of Public Health, Louisiana State University Health Sciences Center, 2020 Gravier Street, Room 213, New Orleans, LA 70112, USA
| |
Collapse
|
18
|
Guthrie KA, Caan B, Diem S, Ensrud KE, Greaves SR, Larson JC, Newton KM, Reed SD, LaCroix AZ. Facebook advertising for recruitment of midlife women with bothersome vaginal symptoms: A pilot study. Clin Trials 2019; 16:476-480. [PMID: 31055949 DOI: 10.1177/1740774519846862] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND The MsFLASH (Menopause Strategies: Finding Lasting Answers for Symptoms and Health) Network recruited into five randomized clinical trials (n = 100-350) through mass mailings. The fifth trial tested two interventions for postmenopausal vulvovaginal symptoms (itching, pain, irritation, dryness, or pain with sex) and thus required a high level of sensitivity to privacy concerns. For this trial, in addition to mass mailings we pilot tested a social media recruitment approach. We aimed to evaluate the feasibility of recruiting healthy midlife women with bothersome vulvovaginal symptoms to participate in the Vaginal Health Trial through Facebook advertising. METHODS As part of a larger advertising campaign that enrolled 302 postmenopausal women for the 12-week randomized, double-blind, placebo-controlled Vaginal Health Trial from April 2016 to February 2017, Facebook advertising was used to recruit 25 participants. The target population for recruitment by mailings and by Facebook ads included women aged 50-70 years and living within 20 miles of study sites in Minneapolis, MN and Seattle, WA. Design of recruitment letters and Facebook advertisements was informed by focus group feedback. Facebook ads were displayed in the "newsfeed" of targeted users and included a link to the study website. Response rates and costs are described for both online ads and mailing. RESULTS Facebook ads ran in Minneapolis for 28 days and in Seattle for 15 days, with ads posted and removed from the site as needed based on clinic flow and a set budget limit. Our estimated Facebook advertising reach was over 200,000 women; 461 women responded and 25 were enrolled at a cost of US$14,813. The response rate per estimated reach was 0.22%; costs were US$32 per response and US$593 per randomized participant. The social media recruitment results varied by site, showing greater effectiveness in Seattle than in Minneapolis. We mailed 277,000 recruitment letters; 2166 women responded and 277 were randomized at a cost of US$98,682. The response rate per letter sent was 0.78%; costs were US$46 per response and US$356 per randomized participant. Results varied little across sites. CONCLUSION Recruitment to a clinical trial testing interventions for postmenopausal vaginal symptoms is feasible through social media advertising. Variability in observed effectiveness and costs may reflect the small sample sizes and limited budget of the pilot recruitment study.
Collapse
Affiliation(s)
- Katherine A Guthrie
- Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, WA, USA
| | - Bette Caan
- Division of Research, Kaiser Permanente of Northern California, Oakland, CA, USA
| | - Susan Diem
- Departments of Medicine and Epidemiology & Community Health, University of Minnesota, Minneapolis, MN, USA
| | - Kristine E Ensrud
- Departments of Medicine and Epidemiology & Community Health, University of Minnesota, Minneapolis, MN, USA.,Department of Medicine, Minneapolis VA Health Care System, Minneapolis, MN, USA
| | - Sharon R Greaves
- Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, WA, USA
| | - Joseph C Larson
- Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, WA, USA
| | - Katherine M Newton
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | - Susan D Reed
- Department of Obstetrics & Gynecology, University of Washington, Seattle, WA, USA
| | - Andrea Z LaCroix
- Department of Family Medicine and Public Health, University of California, San Diego, La Jolla, CA, USA
| |
Collapse
|
19
|
Bunge EL, Taylor LA, Bond M, Stephens TN, Nishimuta K, Barrera AZ, Wickham R, Muñoz RF. Facebook for recruiting Spanish- and English-speaking smokers. Internet Interv 2019; 17:100238. [PMID: 30886827 PMCID: PMC6403078 DOI: 10.1016/j.invent.2019.02.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/16/2018] [Revised: 02/09/2019] [Accepted: 02/13/2019] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND Recruitment for research is usually expensive and time consuming. Facebook (FB) recruitment has become widely utilized in recent years. The main aim of this study was to assess FB as a recruitment tool in a study for Spanish- and English-speaking smokers. Additionally, the study set out to compare performance of ads by language (Spanish vs. English), location (U.S. vs. San Francisco) and content (self-efficacy ad vs. fear appeal ad). METHODS Participants of a one-condition smoking cessation webapp study were recruited utilizing FB ads and posts through two phases: a recruitment-focused phase and an experimental phase comparing language, location and content. RESULTS During the recruitment phase 581 participants in total (U.S. = 540, San Francisco = 41) provided consent. Of the U.S. participants 275 were Spanish-speakers and 265 English-speakers. The cost-per-consent was $25.81 for Spanish-speakers, and $15.49 for English-speakers. During the experimental phase U.S. users performed better (i.e. more clicks, engagement and social reach) than San Francisco users, Spanish-speakers engaged more than English-speakers, and the self-efficacy ad performed better than the fear appeal ad. CONCLUSIONS This study showed that although there were differences in cost-per-consent for Spanish- and English-speakers, recruitment of Spanish-speakers through Facebook is feasible. Furthermore, comparing performance of ads by location, language, and ad content may contribute to developing more efficient campaigns.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Ricardo F. Muñoz
- Corresponding author at: Palo Alto University, 1791 Arastradero Rd., Palo Alto, CA 94304, United States of America.
| |
Collapse
|
20
|
Machado NM, Gomide HP, Bernardino HS, Ronzani TM. Facebook recruitment of smokers: comparing gain- and loss-framed ads for the purposes of an Internet-based smoking cessation intervention. CAD SAUDE PUBLICA 2019; 35:e00151318. [DOI: 10.1590/0102-311x00151318] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2018] [Accepted: 04/30/2019] [Indexed: 11/21/2022] Open
Abstract
Abstract: Gain- and loss-framed messages about smoking behavior have commonly been used to promote cessation. However, there are still no clear conclusions as to what kind of message is more effective for motivating smokers to quit. This study compared the effectiveness of loss- and gain-framed messages in the online recruitment of smokers via Facebook Advertising. Loss- and gain-framed messages about smoking were created and released as Facebook ads. Users who clicked on the ads were automatically redirected to the “Live Without Tobacco” intervention (http://www.vivasemtabaco.com.br). The amount spent on the ads was BRL 647.64. Data were collected from the Facebook Ads platform and from a relational database. Analyses were performed on the 6,350 users who clicked on one of the ads and 1,731 who were successfully redirected to the intervention. Gain-framed ads reached 174,029 people and loss-framed ads reached 180,527. The former received 2,688 clicks, while the latter received 3,662. The cost of the click was BRL 0.12 per gain-framed ad and BRL 0.09 per loss-framed ad. Loss-framed ads reached more users, got more clicks (and website accesses), and led to more accounts and quit plans being created. Loss-framed messages about smoking appear to be more cost-effective for both initial recruitment and intervention engagement. Facebook has proven to be a good outreach and recruitment tool and can be a solution for the difficulty in reaching smokers for cessation interventions.
Collapse
|
21
|
Blumenberg C, Zugna D, Popovic M, Pizzi C, Barros AJD, Richiardi L. Questionnaire Breakoff and Item Nonresponse in Web-Based Questionnaires: Multilevel Analysis of Person-Level and Item Design Factors in a Birth Cohort. J Med Internet Res 2018; 20:e11046. [PMID: 30530454 PMCID: PMC6303736 DOI: 10.2196/11046] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2018] [Revised: 08/22/2018] [Accepted: 08/25/2018] [Indexed: 01/14/2023] Open
Abstract
BACKGROUND Web-based questionnaires are increasingly used in epidemiologic studies, as traditional methods are facing a decrease in response rates and an increase in costs. However, few studies have investigated factors related to the level of completion of internet-based epidemiologic questionnaires. OBJECTIVE Our objective was to identify person-level characteristics and item design factors associated with breakoff (not finishing the questionnaire) and item nonresponse in a Web-based questionnaire. METHODS This study was a cross-sectional analysis of the baseline questionnaire, applied from 2005 to 2016, of the Italian NINFEA (Nascita e Infanzia: gli Effetti dell'Ambiente) birth cohort. The baseline questionnaire was administered to enrolled women, who could register at any time during pregnancy. We used logistic regression to analyze the influence of person-level factors on questionnaire breakoff, and a logistic multilevel model (first level: items of the questionnaire; second level: sections of the questionnaire; third level: study participants) to analyze the influence of person-level and item design factors on item nonresponse. Since the number of applicable items depended on the respondent's characteristics and breakoff, we used inverse probability weighting to deal with missing by design. RESULTS Of 5970 women, 519 (8.69%) did not finish the questionnaire. Older age (adjusted odds ratio 1.40, 95% CI 1.05-1.88), lower educational level (adjusted odds ratio [OR] 1.53, 95% CI 1.23-1.90), and earlier stage of pregnancy (adjusted OR 3.01, 95% CI 2.31-3.92) were positively associated with questionnaire breakoff. Of the 1,062,519 applicable items displayed for the participants, 22,831 were not responded to (overall prevalence of item nonresponse 2.15%). Item nonresponse was positively associated with older age (adjusted OR 1.25, 95% CI 1.14-1.38), being in the first trimester of pregnancy (adjusted OR 1.18, 95% CI 1.06-1.31), and lower educational level (adjusted OR 1.23, 95% CI 1.14-1.33). Dropdown menu items (adjusted OR 1.77, 95% CI 1.56-2.00) and items organized in grids (adjusted OR 1.69, 95% CI 1.49-1.91) were positively associated with item nonresponse. CONCLUSIONS It is important to use targeted strategies to keep participants motivated to respond. Item nonresponse in internet-based questionnaires is affected by person-level and item design factors. Some item types should be limited to reduce item nonresponse.
Collapse
Affiliation(s)
- Cauane Blumenberg
- Center for Epidemiological Research, Post-Graduate Program in Epidemiology, Federal University of Pelotas, Pelotas, Brazil
| | - Daniela Zugna
- Cancer Epidemiology Unit, Department of Medical Sciences, University of Turin, Turin, Italy
| | - Maja Popovic
- Cancer Epidemiology Unit, Department of Medical Sciences, University of Turin, Turin, Italy
| | - Costanza Pizzi
- Cancer Epidemiology Unit, Department of Medical Sciences, University of Turin, Turin, Italy
| | - Aluisio J D Barros
- Center for Epidemiological Research, Post-Graduate Program in Epidemiology, Federal University of Pelotas, Pelotas, Brazil
| | - Lorenzo Richiardi
- Cancer Epidemiology Unit, Department of Medical Sciences, University of Turin, Turin, Italy
| |
Collapse
|
22
|
Pang PCI, Chang S, Verspoor K, Clavisi O. The Use of Web-Based Technologies in Health Research Participation: Qualitative Study of Consumer and Researcher Experiences. J Med Internet Res 2018; 20:e12094. [PMID: 30377139 PMCID: PMC6234342 DOI: 10.2196/12094] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2018] [Revised: 10/08/2018] [Accepted: 10/08/2018] [Indexed: 01/23/2023] Open
Abstract
BACKGROUND Health consumers are often targeted for their involvement in health research including randomized controlled trials, focus groups, interviews, and surveys. However, as reported by many studies, recruitment and engagement of consumers in academic research remains challenging. In addition, there is scarce literature describing what consumers look for and want to achieve by participating in research. OBJECTIVE Understanding and responding to the needs of consumers is crucial to the success of health research projects. In this study, we aim to understand consumers' needs and investigate the opportunities for addressing these needs with Web-based technologies, particularly in the use of Web-based research registers and social networking sites (SNSs). METHODS We undertook a qualitative approach, interviewing both consumer and medical researchers in this study. With the help from an Australian-based organization supporting people with musculoskeletal conditions, we successfully interviewed 23 consumers and 10 researchers. All interviews were transcribed and analyzed with thematic analysis methodology. Data collection was stopped after the data themes reached saturation. RESULTS We found that consumers perceive research as a learning opportunity and, therefore, expect high research transparency and regular updates. They also consider the sources of the information about research projects, the trust between consumers and researchers, and the mobility of consumers before participating in any research. Researchers need to be aware of such needs when designing a campaign for recruitment for their studies. On the other hand, researchers have attempted to establish a rapport with consumer participants, design research for consumers' needs, and use technologies to reach out to consumers. A systematic approach to integrating a variety of technologies is needed. CONCLUSIONS On the basis of the feedback from both consumers and researchers, we propose 3 future directions to use Web-based technologies for addressing consumers' needs and engaging with consumers in health research: (1) researchers can make use of consumer registers and Web-based research portals, (2) SNSs and new media should be frequently used as an aid, and (3) new technologies should be adopted to remotely collect data and reduce administrative work for obtaining consumers' consent.
Collapse
Affiliation(s)
- Patrick Cheong-Iao Pang
- School of Computing and Information Systems, The University of Melbourne, Parkville, Australia
| | - Shanton Chang
- School of Computing and Information Systems, The University of Melbourne, Parkville, Australia
| | - Karin Verspoor
- School of Computing and Information Systems, The University of Melbourne, Parkville, Australia.,Health and Biomedical Informatics Centre, The University of Melbourne, Parkville, Australia
| | - Ornella Clavisi
- Musculoskeletal Australia, Elsternwick, Australia.,Australian and New Zealand Musculoskeletal Trials Network, Melbourne, Australia
| |
Collapse
|
23
|
Recruitment Strategies and Costs Associated With Enrolling People With Insomnia and High Blood Pressure Into an Online Behavioral Sleep Intervention: A Single-Site Pilot Study. J Cardiovasc Nurs 2018; 32:439-447. [PMID: 27685860 DOI: 10.1097/jcn.0000000000000370] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
BACKGROUND Recruitment in clinical research is a common challenge and source of study failure. The reporting of recruitment methods and costs in hypertension trials is limited especially for smaller, single-site trials, online intervention trials, and trials using newer online recruitment strategies. OBJECTIVE The aims of this study are to describe and examine the feasibility of newer online-e-mail recruitment strategies and traditional recruitment strategies used to enroll participants with insomnia and high blood pressure into an online behavioral sleep intervention study (Sleeping for Heart Health). METHODS The 16 online-e-mail-based and traditional recruitment strategies used are described. Recruitment strategy feasibility was examined by study interest and enrollee yields, conversion rates, and costs (direct, remuneration, labor, and cost per enrollee). RESULTS From August 2014 to October 2015, 183 people were screened and 58 (31.7%) enrolled in the study (51.1 ± 12.9 years, 63.8% female, 72.4% African American, 136 ± 12/88 ± 7 mm Hg, 87.9% self-reported hypertension, 67.2% self-reported antihypertensive medication use). The recruitment strategies yielding the highest enrollees were the university hospital phone waiting message system (25.4%), Craigslist (22.4%), and flyers (20.3%) at a per enrollee cost of $42.84, $98.90, and $128.27, respectively. The university hospital phone waiting message system (55.6%) and flyers (54.5%) had the highest interested participant to enrolled participant conversion rate of all recruitment strategies. CONCLUSION Approximately 70% of all enrolled participants were recruited from the university hospital phone waiting message system, Craigslist, or flyers. Given the recruitment challenges that most researchers face, we encourage the documenting, assessing, and reporting of detailed recruitment strategies and associated recruitment costs so that other researchers may benefit.
Collapse
|
24
|
Emery JL, Coleman T, Sutton S, Cooper S, Leonardi-Bee J, Jones M, Naughton F. Uptake of Tailored Text Message Smoking Cessation Support in Pregnancy When Advertised on the Internet (MiQuit): Observational Study. J Med Internet Res 2018; 20:e146. [PMID: 29674308 PMCID: PMC5934538 DOI: 10.2196/jmir.8525] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2017] [Revised: 08/23/2017] [Accepted: 08/23/2017] [Indexed: 11/13/2022] Open
Abstract
Background Smoking in pregnancy is a major public health concern. Pregnant smokers are particularly difficult to reach, with low uptake of support options and few effective interventions. Text message–based self-help is a promising, low-cost intervention for this population, but its real-world uptake is largely unknown. Objective The objective of this study was to explore the uptake and cost-effectiveness of a tailored, theory-guided, text message intervention for pregnant smokers (“MiQuit”) when advertised on the internet. Methods Links to a website providing MiQuit initiation information (texting a short code) were advertised on a cost-per-click basis on 2 websites (Google Search and Facebook; £1000 budget each) and free of charge within smoking-in-pregnancy webpages on 2 noncommercial websites (National Childbirth Trust and NHS Choices). Daily budgets were capped to allow the Google and Facebook adverts to run for 1 and 3 months, respectively. We recorded the number of times adverts were shown and clicked on, the number of MiQuit initiations, the characteristics of those initiating MiQuit, and whether support was discontinued prematurely. For the commercial adverts, we calculated the cost per initiation and, using quit rates obtained from an earlier clinical trial, estimated the cost per additional quitter. Results With equal capped budgets, there were 812 and 1889 advert clicks to the MiQuit website from Google (search-based) and Facebook (banner) adverts, respectively. MiQuit was initiated by 5.2% (42/812) of those clicking via Google (95% CI 3.9%-6.9%) and 2.22% (42/1889) of those clicking via Facebook (95% CI 1.65%-2.99%). Adverts on noncommercial webpages generated 53 clicks over 6 months, with 9 initiations (9/53, 17%; 95% CI 9%-30%). For the commercial websites combined, mean cost per initiation was £24.73; estimated cost per additional quitter, including text delivery costs, was £735.86 (95% CI £227.66-£5223.93). Those initiating MiQuit via Google were typically very early in pregnancy (median gestation 5 weeks, interquartile range 10 weeks); those initiating via Facebook were distributed more evenly across pregnancy (median gestation 16 weeks, interquartile range 14 weeks). Conclusions Commercial online adverts are a feasible, likely cost-effective method for engaging pregnant smokers in digital cessation support and may generate uptake at a faster rate than noncommercial websites. As a strategy for implementing MiQuit, online advertising has large reach potential and can offer support to a hard-to-reach population of smokers.
Collapse
Affiliation(s)
- Joanne L Emery
- Behavioral Science Group, Institute of Public Health, University of Cambridge, Cambridge, United Kingdom
| | - Tim Coleman
- Division of Primary Care, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Stephen Sutton
- Behavioral Science Group, Institute of Public Health, University of Cambridge, Cambridge, United Kingdom
| | - Sue Cooper
- Division of Primary Care, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Jo Leonardi-Bee
- Division of Epidemiology and Public Health, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Matthew Jones
- Division of Primary Care, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Felix Naughton
- School of Health Sciences, University of East Anglia, Norwich, United Kingdom
| |
Collapse
|
25
|
Scheffers-van Schayck T, Otten R, Engels R, Kleinjan M. Evaluation and Implementation of a Proactive Telephone Smoking Cessation Counseling for Parents: A Study Protocol of an Effectiveness Implementation Hybrid Design. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2018; 15:E97. [PMID: 30720774 PMCID: PMC5800196 DOI: 10.3390/ijerph15010097] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/06/2017] [Revised: 12/22/2017] [Accepted: 01/04/2018] [Indexed: 02/01/2023]
Abstract
Detrimental health consequences of smoking for both parents and children stress the importance for parents to quit. A Dutch efficacy trial supported the efficacy of proactive telephone counseling on parents. Still, how this program would function in "real world" conditions and how parents could be optimally reached is unclear. Therefore, this study will use an innovative method to examine the recruitment success of two implementation approaches (i.e., via a healthcare approach and a mass media approach) to test the (cost)effectiveness of the program. A two-arm randomized controlled trial and an implementation study (i.e., process evaluation) are conducted. Parents (N = 158) will be randomly assigned to the intervention (i.e., telephone counseling) or control conditions (i.e., self-help brochure). Primary outcome measure is 7-day point prevalence abstinence at three months post-intervention. Qualitative and quantitative research methods are used for the process evaluation. We expect that parents in the intervention condition have higher cessation rates than parents in the control condition. We also expect that the recruitment of parents via (youth) health care services is a more promising implementation approach compared to mass media. Results will have implications for the effectiveness of a proactive telephone counseling and provide directions for its successful implementation.
Collapse
Affiliation(s)
- Tessa Scheffers-van Schayck
- Trimbos Institute, Netherlands Institute of Mental Health and Addiction, P.O. Box 725, 3500 AS Utrecht, The Netherlands.
- Department of Psychology, Utrecht University, P.O. Box 80140, 3508 TC Utrecht, The Netherlands.
| | - Roy Otten
- Department of Research and Development, Pluryn, P.O. Box 53, 6500 AB Nijmegen, The Netherlands.
- ASU REACH Institute, Department of Psychology, Arizona State University, P.O. Box 876005, Tempe, AZ 85287-6005, USA.
| | - Rutger Engels
- Trimbos Institute, Netherlands Institute of Mental Health and Addiction, P.O. Box 725, 3500 AS Utrecht, The Netherlands.
- Department of Psychology, Utrecht University, P.O. Box 80140, 3508 TC Utrecht, The Netherlands.
| | - Marloes Kleinjan
- Trimbos Institute, Netherlands Institute of Mental Health and Addiction, P.O. Box 725, 3500 AS Utrecht, The Netherlands.
- Department of Cultural Diversity & Youth, Utrecht University, P.O. Box 80140, 3508 TC Utrecht, The Netherlands.
| |
Collapse
|
26
|
Gelinas L, Pierce R, Winkler S, Cohen IG, Lynch HF, Bierer BE. Using Social Media as a Research Recruitment Tool: Ethical Issues and Recommendations. THE AMERICAN JOURNAL OF BIOETHICS : AJOB 2017; 17:3-14. [PMID: 28207365 PMCID: PMC5324729 DOI: 10.1080/15265161.2016.1276644] [Citation(s) in RCA: 188] [Impact Index Per Article: 26.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
The use of social media as a recruitment tool for research with humans is increasing, and likely to continue to grow. Despite this, to date there has been no specific regulatory guidance and there has been little in the bioethics literature to guide investigators and institutional review boards (IRBs) faced with navigating the ethical issues such use raises. We begin to fill this gap by first defending a nonexceptionalist methodology for assessing social media recruitment; second, examining respect for privacy and investigator transparency as key norms governing social media recruitment; and, finally, analyzing three relatively novel aspects of social media recruitment: (i) the ethical significance of compliance with website "terms of use"; (ii) the ethics of recruiting from the online networks of research participants; and (iii) the ethical implications of online communication from and between participants. Two checklists aimed at guiding investigators and IRBs through the ethical issues are included as appendices.
Collapse
Affiliation(s)
| | | | | | - I. Glenn Cohen
- Petrie-Flom Center at Harvard Law School and Harvard Catalyst
| | - Holly Fernandez Lynch
- Petrie-Flom Center at Harvard Law School, Harvard Catalyst, and Center for Bioethics, Harvard Medical School
| | | |
Collapse
|
27
|
Recruiting Diverse Smokers: Enrollment Yields and Cost. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2016; 13:ijerph13121251. [PMID: 27999280 PMCID: PMC5201392 DOI: 10.3390/ijerph13121251] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 10/11/2016] [Revised: 11/21/2016] [Accepted: 11/21/2016] [Indexed: 11/17/2022]
Abstract
To help tobacco control research better include vulnerable populations, we sought to identify effective ways to recruit diverse smokers. In 2014–2015, we recruited 2149 adult cigarette smokers in California and North Carolina, United States, to participate in a randomized trial of pictorial cigarette pack warnings. The most effective means of recruiting smokers were the classified advertising website Craigslist (28% of participants), word of mouth (23%), Facebook (16%), and flyers or postcards (14%). Low-income and African American smokers were more likely to respond to interpersonal contact (including staff in-person recruitment and word of mouth) than were high-income and non-African American smokers (all p < 0.05). Hispanic and gay, lesbian, and bisexual smokers were more likely to be recruited by Craigslist than non-Hispanic and straight smokers (both p < 0.05). Of the recruitment methods requiring cost, the cheapest was Craigslist ($3–7 per smoker). The most expensive methods were newspaper ads in California ($375 per smoker) and staff in-person recruiting in North Carolina ($180 per smoker). Successfully recruiting diverse smokers requires using multiple methods including interpersonal, online, and other media. Craigslist and word of mouth are especially useful and low-cost ways to recruit diverse smokers.
Collapse
|
28
|
Powell J, Newhouse N, Martin A, Jawad S, Yu LM, Davoudianfar M, Locock L, Ziebland S. A novel experience-based internet intervention for smoking cessation: feasibility randomised controlled trial. BMC Public Health 2016; 16:1156. [PMID: 27835953 PMCID: PMC5106834 DOI: 10.1186/s12889-016-3821-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2016] [Accepted: 11/04/2016] [Indexed: 12/04/2022] Open
Abstract
Background The internet is frequently used to share experiences of health and illness, but this phenomenon has not been harnessed as an intervention to achieve health behaviour change. The aim of this study was to determine the feasibility of a randomised trial assessing the effects of a novel, experience-based website as a smoking cessation intervention. The secondary aim was to measure the potential impact on smoking behaviour of both the intervention and a comparator website. Methods A feasibility randomised controlled single-blind trial assessed a novel, experience-based website containing personal accounts of quitting smoking as a cessation intervention, and a comparator website providing factual information. Feasibility measures including recruitment, and usage of the interventions were recorded, and the following participant-reported outcomes were also measured: Smoking Abstinence Self-Efficacy Questionnaire, the single-item Motivation to Stop Scale, self-reported abstinence, quit attempts and health status outcomes. Eligible smokers from two English regions were entered into the trial and given access to their allocated website for two weeks. Results Eighty-seven smokers were randomised, 65 completed follow-up (75 %). Median usage was 15 min for the intervention, and 5 min for the comparator (range 0.5–213 min). Median logins for both sites was 2 (range 1–20). All participant-reported outcomes were similar between groups. Conclusions It was technically feasible to deliver a novel intervention harnessing the online sharing of personal experiences as a tool for smoking cessation, but recruitment was slow and actual use was relatively low, with attrition from the trial. Future work needs to maximize engagement and to understand how best to assess the value of such interventions in everyday use, rather than as an isolated ‘dose of information’. Trial registration ISRCTN29549695 DOI 10.1186/ISRCTN29549695. Registered 17/05/2013.
Collapse
Affiliation(s)
- John Powell
- Health Experiences Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
| | - Nikki Newhouse
- Health Experiences Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Angela Martin
- Health Experiences Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sena Jawad
- Primary Care Clinical Trials Unit, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Ly-Mee Yu
- Primary Care Clinical Trials Unit, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Mina Davoudianfar
- Primary Care Clinical Trials Unit, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Louise Locock
- Health Experiences Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Sue Ziebland
- Health Experiences Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
29
|
Topolovec-Vranic J, Natarajan K. The Use of Social Media in Recruitment for Medical Research Studies: A Scoping Review. J Med Internet Res 2016; 18:e286. [PMID: 27821383 PMCID: PMC5118584 DOI: 10.2196/jmir.5698] [Citation(s) in RCA: 295] [Impact Index Per Article: 36.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2016] [Revised: 06/28/2016] [Accepted: 08/12/2016] [Indexed: 11/16/2022] Open
Abstract
Background Recruiting an adequate number of participants into medical research studies is challenging for many researchers. Over the past 10 years, the use of social media websites has increased in the general population. Consequently, social media websites are a new, powerful method for recruiting participants into such studies. Objective The objective was to answer the following questions: (1) Is the use of social media more effective at research participant recruitment than traditional methods? (2) Does social media recruit a sample of research participants comparable to that recruited via other methods? (3) Is social media more cost-effective at research participant recruitment than traditional methods? Methods Using the MEDLINE, PsycINFO, and EMBASE databases, all medical research studies that used social media and at least one other method for recruitment were identified. These studies were then categorized as either interventional studies or observational studies. For each study, the effectiveness of recruitment, demographic characteristics of the participants, and cost-effectiveness of recruitment using social media were evaluated and compared with that of the other methods used. The social media sites used in recruitment were identified, and if a study stated that the target population was “difficult to reach” as identified by the authors of the study, this was noted. Results Out of 30 studies, 12 found social media to be the most effective recruitment method, 15 did not, and 3 found social media to be equally effective as another recruitment method. Of the 12 studies that found social media to be the best recruitment method, 8 were observational studies while 4 were interventional studies. Of the 15 studies that did not find social media to be the best recruitment method, 7 were interventional studies while 8 were observational studies. In total, 8 studies stated that the target population was “hard-to-reach,” and 6 of these studies found social media to be the most effective recruitment method. Out of 14 studies that reported demographic data for participants, 2 studies found that social media recruited a sample comparable to that recruited via traditional methods and 12 did not. Out of 13 studies that reported cost-effectiveness, 5 studies found social media to be the most cost-effective recruitment method, 7 did not, and 1 study found social media equally cost-effective as compared with other methods. Conclusions Only 12 studies out of 30 found social media to be the most effective recruitment method. There is evidence that social media can be the best recruitment method for hard-to-reach populations and observational studies. With only 30 studies having compared recruitment through social media with other methods, more studies need to be done that report the effectiveness of recruitment for each strategy, demographics of participants recruited, and cost-effectiveness of each method.
Collapse
Affiliation(s)
- Jane Topolovec-Vranic
- Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, ON, Canada.,Department of Occupational Science and Occupational Therapy, University of Toronto, Toronto, ON, Canada
| | - Karthik Natarajan
- Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, ON, Canada
| |
Collapse
|
30
|
Miklavec K, Pravst I, Raats MM, Pohar J. Front of package symbols as a tool to promote healthier food choices in Slovenia: Accompanying explanatory claim can considerably influence the consumer's preferences. Food Res Int 2016; 90:235-243. [PMID: 29195876 DOI: 10.1016/j.foodres.2016.10.052] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2016] [Revised: 10/26/2016] [Accepted: 10/30/2016] [Indexed: 10/20/2022]
Abstract
Many nutrition and/or health symbols were introduced in different countries in the past years and Slovenia is no exception. The objective of our study was to examine familiarity with and perception of the Protective Food symbol (PF symbol) in Slovenia and to investigate consumers' associations related to the symbol, and the influence of symbols' appearance on their preferences. The study was conducted through online questionnaire with incorporated word-association tasks and conjoint analysis; GfK consumer panel and social media (Facebook) were used for recruitment of Slovenian adults (n=1050; 534 men, 516 women). The majority (78%) of the participants reported they had previously seen the PF symbol, and 64% declared familiarity with it. Familiarity was verified using a word-association task in which we analysed the nature of the symbol's description, distinguishing the description of symbol's visual appearance or its meaning. In this task, 73% of the participants described the symbol's meaning with reference to health or a healthy lifestyle, confirming their familiarity with it. Women and those responsible for grocery shopping were significantly more familiar with the symbol. The impact of the symbol's appearance on consumers' preferences was investigated using conjoint analysis consisting of two attributes - three different symbols found on foods in Slovenia (PF symbol, Choices Programme symbol and Keyhole symbol), and accompanying worded claims. Although worded claims had less relative importance (29.5%) than the symbols (70.5%), we show that careful choice of the wording can affect consumers' preferences considerably. The lowest part-worth utility was observed without an accompanying claim, and the highest for the claim directly communicating health ("Protects your health"). The fact that most participants are well familiar with the PF symbol indicates the symbol's potential to promote healthier food choices, which could be further improved by an accompanying worded claim that clearly describes its meaning. In addition, the use of Facebook ads is shown to be a useful alternative recruitment method for research with consumers.
Collapse
Affiliation(s)
| | - Igor Pravst
- Nutrition Institute, Tržaška 40, 1000 Ljubljana, Slovenia.
| | - Monique M Raats
- Food, Consumer Behaviour and Health Research Centre, University of Surrey, Guildford, Surrey GU2 7XH, United Kingdom.
| | - Jure Pohar
- University of Ljubljana, Biotechnical Faculty, Jamnikarjeva 101, 1000 Ljubljana, Slovenia.
| |
Collapse
|
31
|
Laws RA, Litterbach EKV, Denney-Wilson EA, Russell CG, Taki S, Ong KL, Elliott RM, Lymer SJ, Campbell KJ. A Comparison of Recruitment Methods for an mHealth Intervention Targeting Mothers: Lessons from the Growing Healthy Program. J Med Internet Res 2016; 18:e248. [PMID: 27634633 PMCID: PMC5043120 DOI: 10.2196/jmir.5691] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2016] [Revised: 07/18/2016] [Accepted: 07/28/2016] [Indexed: 11/25/2022] Open
Abstract
Background Mobile health (mHealth) programs hold great promise for increasing the reach of public health interventions. However, mHealth is a relatively new field of research, presenting unique challenges for researchers. A key challenge is understanding the relative effectiveness and cost of various methods of recruitment to mHealth programs. Objective The objectives of this study were to (1) compare the effectiveness of various methods of recruitment to an mHealth intervention targeting healthy infant feeding practices, and (2) explore factors influencing practitioner referral to the intervention. Methods The Growing healthy study used a quasi-experimental design with an mHealth intervention group and a concurrent nonrandomized comparison group. Eligibility criteria included: expectant parents (>30 weeks of gestation) or parents with an infant <3 months old, ability to read and understand English, own a mobile phone, ≥18 years old, and living in Australia. Recruitment to the mHealth program consisted of: (1) practitioner-led recruitment through Maternal and Child Health nurses, midwives, and nurses in general practice; (2) face-to-face recruitment by researchers; and (3) online recruitment. Participants’ baseline surveys provided information regarding how participants heard about the study, and their sociodemographic details. Costs per participant recruited were calculated by taking into account direct advertising costs and researcher time/travel costs. Practitioner feedback relating to the recruitment process was obtained through a follow-up survey and qualitative interviews. Results A total of 300 participants were recruited to the mHealth intervention. The cost per participant recruited was lowest for online recruitment (AUD $14) and highest for practice nurse recruitment (AUD $586). Just over half of the intervention group (50.3%, 151/300) were recruited online over a 22-week period compared to practitioner recruitment (29.3%, 88/300 over 46 weeks) and face-to-face recruitment by researchers (7.3%, 22/300 over 18 weeks). No significant differences were observed in participant sociodemographic characteristics between recruitment methods, with the exception that practitioner/face-to-face recruitment resulted in a higher proportion of first-time parents (68% versus 48%, P=.002). Less than half of the practitioners surveyed reported referring to the program often or most of the time. Key barriers to practitioner referral included lack of time, difficulty remembering to refer, staff changes, lack of parental engagement, and practitioner difficulty in accessing the app. Conclusions Online recruitment using parenting-related Facebook pages was the most cost effective and timely method of recruitment to an mHealth intervention targeting parents of young infants. Consideration needs to be given to addressing practitioner barriers to referral, to further explore if this can be a viable method of recruitment.
Collapse
Affiliation(s)
- Rachel A Laws
- Deakin University, Institute for Physical Activity and Nutrition, School of Exercise and Nutrition Science, Geelong, Australia.
| | | | | | | | | | | | | | | | | |
Collapse
|
32
|
Carter-Harris L, Bartlett Ellis R, Warrick A, Rawl S. Beyond Traditional Newspaper Advertisement: Leveraging Facebook-Targeted Advertisement to Recruit Long-Term Smokers for Research. J Med Internet Res 2016; 18:e117. [PMID: 27306780 PMCID: PMC4927805 DOI: 10.2196/jmir.5502] [Citation(s) in RCA: 62] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2016] [Revised: 02/24/2016] [Accepted: 03/21/2016] [Indexed: 12/18/2022] Open
Abstract
Background Smokers are a stigmatized population, but an important population to reach for the purpose of research. Therefore, innovative recruitment methods are needed that are both cost-effective and efficacious in recruiting this population. Objective The aim of the present article was to evaluate the feasibility of Facebook-targeted advertisement to recruit long-term smokers eligible for lung cancer screening for a descriptive, cross-sectional survey. Methods A social media recruitment campaign was launched using Facebook-targeted advertisement to target age and keywords related to tobacco smoking in the Facebook users profile, interests, and likes. A 3-day newspaper advertisement recruitment campaign was used as a comparison. The study that used both recruitment methods aimed to test the psychometric properties of 4 newly developed lung cancer screening health belief scales. Data were collected via cross-sectional survey methodology using an Web-based survey platform. Results The Facebook-targeted advertisements were viewed 56,621 times over an 18-day campaign in 2015 in the United States. The advertisement campaign yielded 1121 unique clicks to the Web-based survey platform at a cost of $1.51 per completed survey. Of those who clicked through to the study survey platform, 423 (37.7%) consented to participate; 92 (8.2%) dropped out during completion of the survey yielding a final study pool of 331 completed surveys. Recruitment by newspaper advertisement yielded a total of 30 participants in response to a 3-day advertisement campaign; recruitment efficacy resulted in 10 participants/day at $40.80 per completed survey. Participants represented current (n=182; 51%) and former smokers (n=178; 49%) with a mean age of 63.4 years (SD 6.0). Cost of the advertisement campaign was $500 total for the 18-day campaign. Conclusions Recruitment by Facebook was more efficacious and cost-effective compared with newspaper advertisement. Facebook offers a new venue for recruitment into research studies that offer the potential for wider reach at a lower cost while providing privacy and flexibility for potential study participants. The study’s findings extend recent work of other researchers who have demonstrated Facebook’s utility with younger smokers, and Facebook is an effective tool to recruit older smokers. Furthermore, Facebook is a cost-effective alternative to traditional newspaper advertisement offering a new, affordable venue to recruit large numbers of older smokers efficiently.
Collapse
|
33
|
Bold KW, Hanrahan TH, O'Malley SS, Fucito LM. Exploring the Utility of Web-Based Social Media Advertising to Recruit Adult Heavy-Drinking Smokers for Treatment. J Med Internet Res 2016; 18:e107. [PMID: 27194456 PMCID: PMC4889869 DOI: 10.2196/jmir.5360] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2015] [Revised: 02/02/2016] [Accepted: 02/20/2016] [Indexed: 11/21/2022] Open
Abstract
Background Identifying novel ways to recruit smokers for treatment studies is important. In particular, certain subgroups of adult smokers, such as heavy-drinking smokers, are at increased risk for serious medical problems and are less likely to try quitting smoking, so drawing this hard-to-reach population into treatment is important for improving health outcomes. Objective This study examined the utility of Facebook advertisements to recruit smokers and heavy-drinking smokers for treatment research and evaluated smoking and alcohol use and current treatment goals among those who responded to the Web-based survey. Methods Using Facebook’s advertising program, 3 separate advertisements ran for 2 months targeting smokers who were thinking about quitting. Advertisements were shown to adult (at least 18 years of age), English-speaking Facebook users in the greater New Haven, Connecticut, area. Participants were invited to complete a Web-based survey to determine initial eligibility for a smoking cessation research study. Results Advertisements generated 1781 clicks and 272 valid, completed surveys in 2 months, with one advertisement generating the most interest. Facebook advertising was highly cost-effective, averaging $0.27 per click, $1.76 per completed survey, and $4.37 per participant meeting initial screening eligibility. On average, those who completed the Web-based survey were 36.8 (SD 10.4) years old, and 65.8% (179/272) were female. Advertisements were successful in reaching smokers; all respondents reported daily smoking (mean 16.2 [SD 7.0] cigarettes per day). The majority of smokers (254/272, 93.4%) were interested in changing their smoking behavior immediately. Many smokers (161/272, 59.2%) also reported heavy alcohol consumption at least once a month. Among smokers interested in reducing their alcohol use, more were heavy drinkers (45/56, 80.4%) compared to non-heavy drinkers (11/56, 19.6%; χ2[1,N=272]=13.0, P<.001). Of those who met initial screening eligibility from the Web-based survey, 12.7% (14/110) attended an in-person follow-up appointment. Conclusions Social media advertisements designed to target smokers were cost-effective and successful for reaching adult smokers interested in treatment. Additionally, recruiting for smokers reached those who also drink alcohol heavily, many of whom were interested in changing this behavior as well. However, additional social media strategies may be needed to engage individuals into treatment after completion of Web-based screening surveys.
Collapse
Affiliation(s)
- Krysten W Bold
- Yale School of Medicine, Department of Psychiatry, New Haven, CT, United States.
| | | | | | | |
Collapse
|
34
|
Thornton L, Batterham PJ, Fassnacht DB, Kay-Lambkin F, Calear AL, Hunt S. Recruiting for health, medical or psychosocial research using Facebook: Systematic review. Internet Interv 2016; 4:72-81. [PMID: 30135792 PMCID: PMC6096238 DOI: 10.1016/j.invent.2016.02.001] [Citation(s) in RCA: 197] [Impact Index Per Article: 24.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2015] [Revised: 01/12/2016] [Accepted: 02/04/2016] [Indexed: 11/24/2022] Open
Abstract
Recruiting participants is a challenge for many health, medical and psychosocial research projects. One tool more frequently being used to improve recruitment is the social networking website Facebook. A systematic review was conducted to identify studies that have used Facebook to recruit participants of all ages, to any psychosocial, health or medical research. 110 unique studies that used Facebook as a recruitment source were included in the review. The majority of studies used a cross-sectional design (80%) and addressed a physical health or disease issue (57%). Half (49%) of the included studies reported specific details of the Facebook recruitment process. Researchers paid between $1.36 and $110 per completing participants (Mean = $17.48, SD = $23.06). Among studies that examined the representativeness of their sample, the majority concluded (86%) their Facebook-recruited samples were similarly representative of samples recruited via traditional methods. These results indicate that Facebook is an effective and cost-efficient recruitment method. Researchers should consider their target group, advertisement wording, offering incentives and no-cost methods of recruitment when considering Facebook as a recruitment source. It is hoped this review will assist researchers to make decisions regarding the use of Facebook as a recruitment tool in future research.
Collapse
Affiliation(s)
- Louise Thornton
- National Drug and Alcohol Research Centre, University of New South Wales, Sydney, Australia
| | - Philip J. Batterham
- National Institute for Mental Health Research, The Australian National University, Canberra, Australia
| | - Daniel B. Fassnacht
- Research School of Psychology, The Australian National University, Canberra, Australia
| | - Frances Kay-Lambkin
- National Drug and Alcohol Research Centre, University of New South Wales, Sydney, Australia
- Centre for Translational Neuroscience and Mental Health, The University of Newcastle, Newcastle, Australia
- Corresponding author at: National Drug and Alcohol Research Centre, University of New South Wales, Sydney, Australia.
| | - Alison L. Calear
- National Institute for Mental Health Research, The Australian National University, Canberra, Australia
| | - Sally Hunt
- National Drug and Alcohol Research Centre, University of New South Wales, Sydney, Australia
- Centre for Translational Neuroscience and Mental Health, The University of Newcastle, Newcastle, Australia
| |
Collapse
|
35
|
Coday M, Richey P, Thomas F, Tran QT, Terrell SB, Tylavsky F, Miro D, Caufield M, Johnson KC. The Recruitment Experience of a Randomized Clinical Trial to Aid Young Adult Smokers to Stop Smoking without Weight Gain with Interactive Technology. Contemp Clin Trials Commun 2016; 2:61-68. [PMID: 26949747 PMCID: PMC4772746 DOI: 10.1016/j.conctc.2015.12.010] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Multiple recruitment strategies are often needed to recruit an adequate number of participants, especially hard to reach groups. Technology-based recruitment methods hold promise as a more robust form of reaching and enrolling historically hard to reach young adults. The TARGIT study is a randomized two-arm clinical trial in young adults using interactive technology testing an efficacious proactive telephone Quitline versus the Quitline plus a behavioral weight management intervention focusing on smoking cessation and weight change. All randomized participants in the TARGIT study were required to be a young adult smoker (18–35 years), who reported smoking at least 10 cigarettes per day, had a BMI < 40 kg/m2, and were willing to stop smoking and not gain weight. Traditional recruitment methods were compared to technology-based strategies using standard descriptive statistics based on counts and proportions to describe the recruitment process from initial pre-screening (PS) to randomization into TARGIT. Participants at PS were majority Black (59.80%), female (52.66%), normal or over weight (combined 62.42%), 29.5 years old, and smoked 18.4 cigarettes per day. There were differences in men and women with respect to reasons for ineligibility during PS (p < 0.001; ignoring gender specific pregnancy-related ineligibility). TARGIT experienced a disproportionate loss of minorities during recruitment as well as a prolonged recruitment period due to either study ineligibility or not completing screening activities. Recruitment into longer term behavioral change intervention trials can be challenging and multiple methods are often required to recruit hard to reach groups. ClinicalTrials.gov Identifier NCT01199185 The NHLBI funded TARGIT as part of a U01 Cooperative Agreement and as such the study design was approved. They did not have input into the data collection, analysis, or the interpretation of the data or in the writing of this report.
Collapse
Affiliation(s)
- Mace Coday
- Department of Preventive Medicine, The University of Tennessee Health Science Center, Memphis, TN
| | - Phyllis Richey
- Department of Preventive Medicine, The University of Tennessee Health Science Center, Memphis, TN
| | - Fridtjof Thomas
- Department of Preventive Medicine, The University of Tennessee Health Science Center, Memphis, TN
| | - Quynh T Tran
- Department of Preventive Medicine, The University of Tennessee Health Science Center, Memphis, TN
| | - Sarah B Terrell
- Department of Epidemiology and Cancer Control, St. Jude Children's Research Hospital, Memphis, TN
| | - Fran Tylavsky
- Department of Preventive Medicine, The University of Tennessee Health Science Center, Memphis, TN
| | - Danielle Miro
- Department of Counseling, Educational Psychology and Research, University of Memphis, Memphis, TN
| | - Margaret Caufield
- Department of Preventive Medicine, The University of Tennessee Health Science Center, Memphis, TN
| | - Karen C Johnson
- Department of Preventive Medicine, The University of Tennessee Health Science Center, Memphis, TN
| |
Collapse
|
36
|
Gioia CJ, Sobell LC, Sobell MB, Agrawal S. Craigslist versus print newspaper advertising for recruiting research participants for alcohol studies: Cost and participant characteristics. Addict Behav 2016; 54:24-32. [PMID: 26675247 DOI: 10.1016/j.addbeh.2015.11.008] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2015] [Revised: 11/03/2015] [Accepted: 11/18/2015] [Indexed: 11/29/2022]
Abstract
INTRODUCTION Technology has transformed our lifestyles in dramatic and significant ways, including new and less expensive options for recruiting study participants. This study examines cost and participant differences between two recruitment sources, Craigslist (CL), and print newspapers (PNs). This paper also reviewed and compared studies involving clinical trials published since 2010 that recruited participants using CL alone or in combination with other methods. METHOD Secondary data analyses from a parent study involving a randomized controlled trial of a mail-based intervention to promote self-change with problem drinkers. RESULTS Significant differences were found between CL and PN participants on most demographic and pretreatment drinking variables. While all participants had AUDIT scores suggestive of an alcohol problem and reported drinking at high-risk levels, CL participants had less severe drinking problem histories, were considerably younger, and had a higher socioeconomic status than PN participants. The total advertising costs for the 65 CL ads ($275) were significantly less than the 69 PN ads ($33, 311). The recruiting cost per eligible participant was vastly less expensive using CL ($1.46) compared to print newspaper ads ($116.88). CONCLUSIONS Using CL is a viable recruitment method for soliciting participants, particularly those that are younger, for alcohol intervention studies. It is also less expensive than newspaper ads. When CL participants were recruited, they reported being slightly more confident to change their drinking than PN participants. Limitations of using CL are discussed, including that some initial ad responders gave inconsistent answers to similar questions and a few tried to enter the study more than once.
Collapse
Affiliation(s)
- Christopher J Gioia
- Department of Psychology, Brogden Hall, University of Wisconsin-Madison, Madison, WI 53706-1611, USA
| | - Linda Carter Sobell
- Nova Southeastern University, College of Psychology, 3301 College Ave., Fort Lauderdale, FL 33314, USA.
| | - Mark B Sobell
- Nova Southeastern University, College of Psychology, 3301 College Ave., Fort Lauderdale, FL 33314, USA
| | | |
Collapse
|
37
|
Du H, Venkatakrishnan A, Youngblood GM, Ram A, Pirolli P. A Group-Based Mobile Application to Increase Adherence in Exercise and Nutrition Programs: A Factorial Design Feasibility Study. JMIR Mhealth Uhealth 2016; 4:e4. [PMID: 26772910 PMCID: PMC4733222 DOI: 10.2196/mhealth.4900] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2015] [Revised: 08/14/2015] [Accepted: 09/22/2015] [Indexed: 01/06/2023] Open
Abstract
Background Novel methods of promoting self-monitoring and social support are needed to ensure long-term maintenance of behavior change. In this paper, we directly investigate the effects of group support in an exercise and nutrition program delivered by an mHealth application called Fittle. Objective Our first specific study aim was to explore whether social support improved adherence in wellness programs. Our second specific study aim was to assess whether media types (ePaper vs mobile) were associated with different levels of compliance and adherence to wellness programs. The third aim was to assess whether the use of an mHealth application led to positive changes to participants’ eating behavior, physical activity, and stress level, compared to traditional paper-based programs. Methods A 2 × 2 (eg, Media: Mobile vs ePaper × Group Type: Team vs Solo) factorial design feasibility study was conducted. A sample of 124 volunteers who were interested in improving eating behavior, increasing physical activity, or reducing stress participated in this study. The study duration was 8 weeks. All groups were self-directed with no ongoing human input from the research team. Results Participants in ePaper conditions had higher attrition rates compared to participants in Mobile conditions, χ32=9.96, P=.02 (N=124). Participants in Mobile conditions reported their compliance with a much higher frequency closer to the time of challenge activity completion (2-sample Kolmogorov-Smirnov test comparing distributions was highly significant—KS=0.33, P<.001 [N=63]). Participants in ePaper conditions had a much higher frequency of guessing while reporting as compared with those in Mobile conditions—χ12=25.25, P<.001 (N=63). Together, these findings suggest that the mobile app allowed a more accurate method to report and track health behaviors over a longer period than traditional ePaper-based diaries or log books. There was a significant difference in the overall compliance score for Mobile-Solo (Mean [SD] 0.30 [0.39]) and Mobile-Team (Mean [SD] 0.49 [0.35]) conditions (t50.82=1.94, P=.05). This suggests that working in a team increased participants’ overall compliance within Fittle. Survival analysis showed that participants assigned to Team conditions are 66% more likely to engage longer with mHealth app-based intervention than those assigned to the Solo condition. Overall, participants across all groups reported some positive changes in eating behavior, physical activity, and stress level; however, participants in the Mobile-Solo condition reported higher perceived stress levels at the end of the study. Conclusions The team-based Fittle app is an acceptable and feasible wellness behavior change intervention and a full randomized controlled trial to investigate the efficacy of such an intervention is warranted.
Collapse
Affiliation(s)
- Honglu Du
- Palo Alto Research Center, Palo Alto, CA, United States.
| | | | | | | | | |
Collapse
|
38
|
Lappalainen P, Langrial S, Oinas-Kukkonen H, Tolvanen A, Lappalainen R. Web-Based Acceptance and Commitment Therapy for Depressive Symptoms With Minimal Support. Behav Modif 2015; 39:805-34. [DOI: 10.1177/0145445515598142] [Citation(s) in RCA: 79] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Low-intensity interventions for people suffering from depressive symptoms are highly desirable. The aim of the present study was to investigate the outcomes of a web-based acceptance and commitment therapy (ACT)–based intervention without face-to-face contact for people suffering from depressive symptoms. Participants ( N = 39) with depressive symptoms were randomly assigned to an Internet-delivered acceptance and commitment therapy (iACT) intervention or a waiting list control condition (WLC). Participants were evaluated with standardized self-reporting measures (Beck Depression Inventory [BDI-II], Symptom Checklist–90 [SCL-90], Acceptance and Action Questionnaire [AAQ-2], Five Facet Mindfulness Questionnaire [FFMQ], Automatic Thoughts Questionnaire [ATQ], and White Bear Suppression Inventory [WBSI]) at pre- and post-measurement. Long-term effects in the iACT group were examined using a 12-month follow-up. The iACT program comprised home assignments, online feedback given by master’s-level students of psychology over a 7-week intervention period, and automated email-based reminders. Significant effects were observed in favor of the iACT group on depression symptomatology (between effect sizes [ESs] at post-treatment, iACT/WLC, g = .83), psychological and physiological symptoms (g = .60), psychological flexibility (g = .67), mindfulness skills (g = .53), and frequency of automatic thoughts (g = .57) as well as thought suppression (g = .53). The treatment effects in the iACT group were maintained over the 12-month follow-up period (within-iACT ES: BDI-II, g = 1.33; SCL-90, g = 1.04; ATQF/B [Frequency/Believability], FFMQ, WBSI, AAQ-II, g = .74-1.08). The iACT participants stated that they would be happy to recommend the same intervention to others with depressive symptoms. We conclude that an ACT-based guided Internet-delivered treatment with minimal contact can be effective for people with depressive symptoms.
Collapse
|
39
|
Lane TS, Armin J, Gordon JS. Online Recruitment Methods for Web-Based and Mobile Health Studies: A Review of the Literature. J Med Internet Res 2015. [PMID: 26202991 PMCID: PMC4527014 DOI: 10.2196/jmir.4359] [Citation(s) in RCA: 127] [Impact Index Per Article: 14.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Background Internet and mobile health (mHealth) apps hold promise for expanding the reach of evidence-based health interventions. Research in this area is rapidly expanding. However, these studies may experience problems with recruitment and retention. Web-based and mHealth studies are in need of a wide-reaching and low-cost method of recruitment that will also effectively retain participants for the duration of the study. Online recruitment may be a low-cost and wide-reaching tool in comparison to traditional recruitment methods, although empirical evidence is limited. Objective This study aims to review the literature on online recruitment for, and retention in, mHealth studies. Methods We conducted a review of the literature of studies examining online recruitment methods as a viable means of obtaining mHealth research participants. The data sources used were PubMed, CINAHL, EbscoHost, PyscINFO, and MEDLINE. Studies reporting at least one method of online recruitment were included. A narrative approach enabled the authors to discuss the variability in recruitment results, as well as in recruitment duration and study design. Results From 550 initial publications, 12 studies were included in this review. The studies reported multiple uses and outcomes for online recruitment methods. Web-based recruitment was the only type of recruitment used in 67% (8/12) of the studies. Online recruitment was used for studies with a variety of health domains: smoking cessation (58%; 7/12) and mental health (17%; 2/12) being the most common. Recruitment duration lasted under a year in 67% (8/12) of the studies, with an average of 5 months spent on recruiting. In those studies that spent over a year (33%; 4/12), an average of 17 months was spent on recruiting. A little less than half (42%; 5/12) of the studies found Facebook ads or newsfeed posts to be an effective method of recruitment, a quarter (25%; 3/12) of the studies found Google ads to be the most effective way to reach participants, and one study showed better outcomes with traditional (eg in-person) methods of recruitment. Only one study recorded retention rates in their results, and half (50%; 6/12) of the studies recorded survey completion rates. Conclusions Although online methods of recruitment may be promising in experimental research, more empirical evidence is needed to make specific recommendations. Several barriers to using online recruitment were identified, including participant retention. These unique challenges of virtual interventions can affect the generalizability and validity of findings from Web-based and mHealth studies. There is a need for additional research to evaluate the effectiveness of online recruitment methods and participant retention in experimental mHealth studies.
Collapse
Affiliation(s)
- Taylor S Lane
- University of Arizona, Department of Family and Community Medicine, Tucson, AZ, United States.
| | | | | |
Collapse
|
40
|
Zeng EY, Vilardaga R, Heffner JL, Mull KE, Bricker JB. Predictors of Utilization of a Novel Smoking Cessation Smartphone App. Telemed J E Health 2015; 21:998-1004. [PMID: 26171733 DOI: 10.1089/tmj.2014.0232] [Citation(s) in RCA: 48] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Understanding the characteristics of high and low utilizers of smartphone applications (apps) for smoking cessation would inform development of more engaging and effective apps, yet no studies to date have addressed this critical question. Informed by prior research on predictors of cessation Web site utilization, this study examines the degree to which baseline demographic factors (gender, age, and education), smoking-related factors (smoking level and friends' smoking), and psychological factors (depression and anxiety) are predictive of utilization of a smartphone app for smoking cessation called SmartQuit. MATERIALS AND METHODS Data came from 98 participants randomized to SmartQuit as part of a pilot trial from March to May 2013. We used negative binomial count regressions to examine the relationship between user characteristics and utilization of the app over an 8-week treatment period. RESULTS Lower education (risk ratio [RR]=0.492; p=0.021), heavier smoking (RR=0.613; p=0.033), and depression (RR=0.958; p=0.017) prospectively predicted lower app utilization. Women (RR=0.320; p=0.022), those with lower education (RR=0.491; p=0.013), and heavier smokers (RR=0.418; p=0.039) had lower utilization of app features known to predict smoking cessation. CONCLUSIONS Many of the predictors of utilization of smoking cessation apps are the same as those of cessation Web sites. App-delivered smoking cessation treatment effectiveness could be enhanced by focusing on increasing engagement of women, those with lower education, heavy smokers, and those with current depressive symptoms.
Collapse
Affiliation(s)
- Emily Y Zeng
- 1 Department of Psychology, University of Washington , Seattle, Washington.,2 Division of Public Health Sciences, Fred Hutchinson Cancer Research Center , Seattle, Washington
| | - Roger Vilardaga
- 2 Division of Public Health Sciences, Fred Hutchinson Cancer Research Center , Seattle, Washington.,3 Department of Psychiatry and Behavioral Sciences, University of Washington , Seattle, Washington
| | - Jaimee L Heffner
- 2 Division of Public Health Sciences, Fred Hutchinson Cancer Research Center , Seattle, Washington
| | - Kristin E Mull
- 2 Division of Public Health Sciences, Fred Hutchinson Cancer Research Center , Seattle, Washington
| | - Jonathan B Bricker
- 1 Department of Psychology, University of Washington , Seattle, Washington.,2 Division of Public Health Sciences, Fred Hutchinson Cancer Research Center , Seattle, Washington
| |
Collapse
|
41
|
Wolvers MD, Bruggeman-Everts FZ, Van der Lee ML, Van de Schoot R, Vollenbroek-Hutten MM. Effectiveness, Mediators, and Effect Predictors of Internet Interventions for Chronic Cancer-Related Fatigue: The Design and an Analysis Plan of a 3-Armed Randomized Controlled Trial. JMIR Res Protoc 2015; 4:e77. [PMID: 26104114 PMCID: PMC4526958 DOI: 10.2196/resprot.4363] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2015] [Revised: 04/22/2015] [Accepted: 04/23/2015] [Indexed: 11/13/2022] Open
Abstract
Background Internet interventions offer advantages that especially cancer survivors who suffer from fatigue could benefit from. Given the growing number of such patients, Internet interventions could supplement and strengthen currently available health care. Objective This paper describes the design and analysis plan that will be used to study 2 Internet interventions aimed at reducing severe fatigue in cancer survivors: a mobile ambulant activity feedback therapy supported through a weekly email by a physiotherapist and a weekly Web- and mindfulness-based cognitive therapy supported online by a psychologist. The data resulting from this trial will be used to (1) investigate the effectiveness, (2) investigate potential mediators of these interventions, and (3) explore participant characteristics that can predict the effect of these interventions. Methods A 3-armed randomized controlled trial is proposed that compares both Internet interventions with an active control condition that solely consists of receiving psycho-educational emails. The intervention period is 9 weeks for all 3 conditions. Six months after baseline, participants in the control condition can choose to follow 1 of the 2 experimental Internet interventions. Outcomes are measured in terms of fatigue severity, mental health, and self-perceived work ability. All are Web-assessed at baseline, 2 weeks after the intervention period, and at 6 and 12 months after baseline. Fatigue severity, mindfulness, physical activity, expectations and credibility of the intervention, therapeutic working alliance, sleep quality, and sense of control over fatigue are assessed 3 times during the intervention period for identifying mediators of the interventions. Recruitment is performed nationally throughout the Netherlands through patient organizations and their websites, newspapers, and by informing various types of health professionals. All participants register at an open-access website. We aim at including 330 cancer survivors who have finished curative-intent cancer treatment at least 3 months previously, and have been suffering from severe fatigue ever since. All cancer types are included. A detailed analysis plan is described to address the research questions, which allows for individual variation, and fully exploits the longitudinal design. Results Recruitment started in April 2013 and will proceed until April 2015. Conclusions This paper describes a systematic trial design for studying 2 different interventions for chronic cancer-related fatigue in order to gain insight into the effectiveness and mediators of the interventions. This design will also be used to identify predictors for the interventions’ effect on fatigue. By publishing our hypotheses and analysis plan before completion of data collection, this paper is a first step in reporting on this trial comprehensively. Trial Registration The Netherlands National Trial Register (NTR3483). (Archived by WebCite at http://www.webcitation.org/6NWZqon3o).
Collapse
Affiliation(s)
- Marije Dj Wolvers
- Roessingh Research and Development, Telemedicine Group, Enschede, Netherlands.
| | | | | | | | | |
Collapse
|
42
|
The Technological Growth in eHealth Services. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:894171. [PMID: 26146515 PMCID: PMC4469784 DOI: 10.1155/2015/894171] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2015] [Accepted: 04/27/2015] [Indexed: 12/31/2022]
Abstract
The infusion of information communication technology (ICT) into health services is emerging as an active area of research. It has several advantages but perhaps the most important one is providing medical benefits to one and all irrespective of geographic boundaries in a cost effective manner, providing global expertise and holistic services, in a time bound manner. This paper provides a systematic review of technological growth in eHealth services. The present study reviews and analyzes the role of four important technologies, namely, satellite, internet, mobile, and cloud for providing health services.
Collapse
|
43
|
Loxton D, Powers J, Anderson AE, Townsend N, Harris ML, Tuckerman R, Pease S, Mishra G, Byles J. Online and Offline Recruitment of Young Women for a Longitudinal Health Survey: Findings From the Australian Longitudinal Study on Women's Health 1989-95 Cohort. J Med Internet Res 2015; 17:e109. [PMID: 25940876 PMCID: PMC4468605 DOI: 10.2196/jmir.4261] [Citation(s) in RCA: 71] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2015] [Revised: 03/02/2015] [Accepted: 03/03/2015] [Indexed: 11/16/2022] Open
Abstract
Background In 2012, we set out to recruit a cohort of at least 10,000 women aged 18-23 from across Australia. With recent research demonstrating the inadequacy of traditional approaches to recruiting women in this age group, we elected to conduct open recruiting. Objective Our aim was to report on the overall success of open recruiting and to evaluate the relative success of a variety of recruitment methods in terms of numbers and demographics. Methods We used referrals, Facebook, formal advertising, and incentives in order to recruit the cohort. Results In all, 17,069 women were recruited for the longitudinal online survey, from 54,685 initiated surveys. Of these women, most (69.94%, n=11,799) who joined the longitudinal cohort were recruited via Facebook, 12.72% (n=2145) via the fashion promotion, 7.02% (n=1184) by referral, 4.9% (n=831) via other Web activities, and 5.4% (n=910) via traditional media. Conclusions Facebook was by far the most successful strategy, enrolling a cohort of women with a similar profile to the population of Australian women in terms of age, area of residence, and relationship status. Women recruited via fashion promotion were the least representative. All strategies underrepresented less educated women—a finding that is consistent with more traditional means of recruiting. In conclusion, flexibility in recruitment design, embracing new and traditional media, adopting a dynamic responsive approach, and monitoring the results of recruiting in terms of sample composition and number recruited led to the successful establishment of a new cohort.
Collapse
Affiliation(s)
- Deborah Loxton
- Priority Research Centre for Gender, Health and Ageing, School of Medicine and Public Health, University of Newcastle, Callaghan, Australia.
| | | | | | | | | | | | | | | | | |
Collapse
|
44
|
Abstract
In the United States, the rate of cigarette smoking has significantly declined over the past 2 decades, but much more work is needed, as almost 20% of adults still smoke and smoking continues to be the leading preventable cause of death. Furthermore, rates of smoking in certain subpopulations have remained relatively stable and have historically been neglected in smoking cessation research. Pharmacotherapy (both prescription and over-the-counter) and behavioral support are known to aid cessation, and their combination is more effective than either alone. There are significant barriers to access, use, and adherence, however, especially with pharmacotherapy. Therefore, the purpose of this review is to provide an update and overview of the numerous behavioral approaches that have been used to enhance smoking cessation. The research described can be classified into the type of approach used, the setting in which it is delivered, and the population targeted. Regardless of the classification, all the approaches attempt to provide smokers with the information, motivation, and behavioral skills thought to be necessary for achieving initial cessation and sustained abstinence. Recommendations for future research on behavioral smoking cessation are also included.
Collapse
Affiliation(s)
- Joseph T. Ciccolo
- Department of Biobehavioral Sciences, Teachers College, Columbia University, New York, New York (JTC)
- Department of Psychiatry and Human Behavior, Centers for Behavioral & Preventive Medicine, Alpert Medical School of Brown University and The Miriam Hospital, Providence, Rhode Island (AMB)
| | - Andrew M. Busch
- Department of Biobehavioral Sciences, Teachers College, Columbia University, New York, New York (JTC)
- Department of Psychiatry and Human Behavior, Centers for Behavioral & Preventive Medicine, Alpert Medical School of Brown University and The Miriam Hospital, Providence, Rhode Island (AMB)
| |
Collapse
|
45
|
Valdez RS, Guterbock TM, Thompson MJ, Reilly JD, Menefee HK, Bennici MS, Williams IC, Rexrode DL. Beyond traditional advertisements: leveraging Facebook's social structures for research recruitment. J Med Internet Res 2014; 16:e243. [PMID: 25348050 PMCID: PMC4259909 DOI: 10.2196/jmir.3786] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2014] [Revised: 09/24/2014] [Accepted: 10/02/2014] [Indexed: 11/20/2022] Open
Abstract
Background Obtaining access to a demographically and geographically diverse sample for health-related research can be costly and time consuming. Previous studies have reported mixed results regarding the potential of using social media-based advertisements to overcome these challenges. Objective Our aim was to develop and assess the feasibility, benefits, and challenges of recruiting for research studies related to consumer health information technology (IT) by leveraging the social structures embedded in the social networking platform, Facebook. Methods Two recruitment strategies that involved direct communication with existing Facebook groups and pages were developed and implemented in two distinct populations. The first recruitment strategy involved posting a survey link directly to consenting groups and pages and was used to recruit Filipino-Americans to a study assessing the perceptions, use of, and preferences for consumer health IT. This study took place between August and December 2013. The second recruitment strategy targeted individuals with type 2 diabetes and involved creating a study-related Facebook group and asking administrators of other groups and pages to publicize our group to their members. Group members were then directly invited to participate in an online pre-study survey. This portion of a larger study to understand existing health management practices as a foundation for consumer health IT design took place between May and June 2014. In executing both recruitment strategies, efforts were made to establish trust and transparency. Recruitment rate, cost, content of interaction, and characteristics of the sample obtained were used to assess the recruitment methods. Results The two recruitment methods yielded 87 and 79 complete responses, respectively. The first recruitment method yielded a rate of study completion proportionate to that of the rate of posts made, whereas recruitment successes of the second recruitment method seemed to follow directly from the actions of a subset of administrators. Excluding personnel time, the first recruitment method resulted in no direct costs, and the second recruitment method resulted in a total direct cost of US $118.17. Messages, posts, and comments received using both recruitment strategies reflected ten themes, including appreciation, assistance, clarification, concerns, encouragement, health information, interest, promotion, solicitations, and support. Both recruitment methods produced mixed results regarding sample representativeness with respect to characteristics such as gender, race, and ethnicity. Conclusions The results of the study demonstrate that leveraging the social structures of Facebook for health-related research was feasible for obtaining small samples appropriate for qualitative research but not for obtaining large samples needed for quantitative research. The content of interactions with members of the target population prompted ethical deliberations concerning suitable target communities and appropriate boundaries between researchers and participants. Widespread replication of this method would benefit from a broad discussion among researchers, social media users, social media companies, and experts in research ethics to address appropriate protocols for such interactions.
Collapse
Affiliation(s)
- Rupa S Valdez
- Department of Public Health Sciences, University of Virginia, Charlottesville, VA, United States.
| | | | | | | | | | | | | | | |
Collapse
|
46
|
Bricker JB, Mull KE, Kientz JA, Vilardaga R, Mercer LD, Akioka KJ, Heffner JL. Randomized, controlled pilot trial of a smartphone app for smoking cessation using acceptance and commitment therapy. Drug Alcohol Depend 2014; 143:87-94. [PMID: 25085225 PMCID: PMC4201179 DOI: 10.1016/j.drugalcdep.2014.07.006] [Citation(s) in RCA: 235] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/02/2014] [Revised: 07/08/2014] [Accepted: 07/08/2014] [Indexed: 10/25/2022]
Abstract
BACKGROUND There is a dual need for (1) innovative theory-based smartphone applications for smoking cessation and (2) controlled trials to evaluate their efficacy. Accordingly, this study tested the feasibility, acceptability, preliminary efficacy, and mechanism of behavioral change of an innovative smartphone-delivered acceptance and commitment therapy (ACT) application for smoking cessation vs. an application following US Clinical Practice Guidelines. METHOD Adult participants were recruited nationally into the double-blind randomized controlled pilot trial (n=196) that compared smartphone-delivered ACT for smoking cessation application (SmartQuit) with the National Cancer Institute's application for smoking cessation (QuitGuide). RESULTS We recruited 196 participants in two months. SmartQuit participants opened their application an average of 37.2 times, as compared to 15.2 times for QuitGuide participants (p<0001). The overall quit rates were 13% in SmartQuit vs. 8% in QuitGuide (OR=2.7; 95% CI=0.8-10.3). Consistent with ACT's theory of change, among those scoring low (below the median) on acceptance of cravings at baseline (n=88), the quit rates were 15% in SmartQuit vs. 8% in QuitGuide (OR=2.9; 95% CI=0.6-20.7). CONCLUSIONS ACT is feasible to deliver by smartphone application and shows higher engagement and promising quit rates compared to an application that follows US Clinical Practice Guidelines. As results were limited by the pilot design (e.g., small sample), a full-scale efficacy trial is now needed.
Collapse
Affiliation(s)
- Jonathan B Bricker
- Fred Hutchinson Cancer Research Center, Division of Public Health Sciences, 1100 Fairview Avenue N., Seattle, WA 98109, USA; University of Washington, Department of Psychology, Box 351525, Seattle, WA 98195, USA.
| | - Kristin E Mull
- Fred Hutchinson Cancer Research Center, Division of Public Health Sciences, 1100 Fairview Avenue N., Seattle, WA 98109, USA
| | - Julie A Kientz
- University of Washington, Department of Human Centered Design and Engineering, Box 352315, Seattle, WA 98195, USA
| | - Roger Vilardaga
- Fred Hutchinson Cancer Research Center, Division of Public Health Sciences, 1100 Fairview Avenue N., Seattle, WA 98109, USA; University of Washington, Department of Psychiatry and Behavioral Sciences, Box 356560, Seattle, WA 98195, USA
| | - Laina D Mercer
- Fred Hutchinson Cancer Research Center, Division of Public Health Sciences, 1100 Fairview Avenue N., Seattle, WA 98109, USA
| | - Katrina J Akioka
- Fred Hutchinson Cancer Research Center, Division of Public Health Sciences, 1100 Fairview Avenue N., Seattle, WA 98109, USA
| | - Jaimee L Heffner
- Fred Hutchinson Cancer Research Center, Division of Public Health Sciences, 1100 Fairview Avenue N., Seattle, WA 98109, USA
| |
Collapse
|
47
|
Lappalainen P, Granlund A, Siltanen S, Ahonen S, Vitikainen M, Tolvanen A, Lappalainen R. ACT Internet-based vs face-to-face? A randomized controlled trial of two ways to deliver Acceptance and Commitment Therapy for depressive symptoms: an 18-month follow-up. Behav Res Ther 2014; 61:43-54. [PMID: 25127179 DOI: 10.1016/j.brat.2014.07.006] [Citation(s) in RCA: 71] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2013] [Revised: 05/13/2014] [Accepted: 07/15/2014] [Indexed: 11/19/2022]
Abstract
The aim of the present study was to investigate two interventions based on Acceptance and Commitment Therapy (ACT) for depressive symptoms: A face-to-face treatment (ACT group) was compared to a guided self-help treatment delivered via the Internet consisting of two assessment sessions (pre and post) and an ACT-based Internet program (iACT). Outpatients experiencing at least mild depressive symptoms were randomized to either approach. The iACT treatment group received access to an ACT-based Internet program and supportive web-based contact over a period of 6 weeks. The face-to-face group received ACT-based treatment once a week over the same period of time. In both groups, the results showed a significant effect on depression symptomatology, and general wellbeing after treatment and at the 18-month follow-up. However, the data indicated that the iACT group changed differently regarding depressive symptoms and wellbeing as compared to the face-to face ACT group. Results showed large pre-treatment to 18-month follow-up within-group effect sizes for all symptom measures in the iACT treatment group (1.59-2.08), and for most outcome measures in the face-to-face ACT group (1.12-1.37). This non-inferiority study provides evidence that guided Internet-delivered ACT intervention can be as effective as ACT-based face-to-face treatment for outpatients reporting depressive symptoms, and it may offer some advantages over a face-to-face intervention.
Collapse
Affiliation(s)
- Päivi Lappalainen
- Department of Psychology, University of Jyväskylä, P. O. Box 35, FIN-40014, Finland.
| | - Anna Granlund
- Department of Psychology, University of Jyväskylä, P. O. Box 35, FIN-40014, Finland
| | - Sari Siltanen
- Department of Psychology, University of Jyväskylä, P. O. Box 35, FIN-40014, Finland
| | - Suvi Ahonen
- Department of Psychology, University of Jyväskylä, P. O. Box 35, FIN-40014, Finland
| | - Minna Vitikainen
- Department of Psychology, University of Jyväskylä, P. O. Box 35, FIN-40014, Finland
| | - Asko Tolvanen
- Department of Psychology, University of Jyväskylä, P. O. Box 35, FIN-40014, Finland
| | - Raimo Lappalainen
- Department of Psychology, University of Jyväskylä, P. O. Box 35, FIN-40014, Finland
| |
Collapse
|
48
|
Gross MS, Liu NH, Contreras O, Muñoz RF, Leykin Y. Using Google AdWords for international multilingual recruitment to health research websites. J Med Internet Res 2014; 16:e18. [PMID: 24446166 PMCID: PMC3906699 DOI: 10.2196/jmir.2986] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2013] [Revised: 12/11/2013] [Accepted: 12/23/2013] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Google AdWords, the placement of sponsored links in Google search results, is a potent method of recruitment to Internet-based health studies and interventions. However, the performance of Google AdWords varies considerably depending on the language and the location of the target audience. OBJECTIVE Our goal was to describe differences in AdWords performance when recruiting participants to the same study conducted in four languages and to determine whether AdWords campaigns can be optimized in order to increase recruitment while decreasing costs. METHODS Google AdWords were used to recruit participants to the Mood Screener, a multilingual online depression screening tool available in English, Russian, Spanish, and Chinese. Two distinct recruitment periods are described: (1) "Unmanaged", a 6-month period in which ads were allowed to run using only the AdWords tool itself, with no human intervention, and (2) "Managed", a separate 7-week period during which we systematically sought to optimize our recruitment campaigns. RESULTS During 6 months of unmanaged recruitment, our ads were shown over 1.3 million times, resulting in over 60,000 site visits. The average click-through rate (ratio of ads clicked to ads displayed) varied from 1.86% for Chinese ads to 8.48% for Russian ads, as did the average cost-per-click (from US $0.20 for Chinese ads to US $0.50 for English ads). Although Chinese speakers' click-through rate was lowest, their rate of consenting to participate was the highest, at 3.62%, with English speakers exhibiting the lowest consent rate (0.97%). The conversion cost (cost to recruit a consenting participant) varied from US $10.80 for Russian speakers to US $51.88 for English speakers. During the 7 weeks of "managed" recruitment, we attempted to improve AdWords' performance in regards to the consent rate and cost by systematically deleting underperforming ads and adjusting keywords. We were able to increase the number of people who consent after coming to the site by 91.8% while also decreasing per-consent cost by 23.3%. CONCLUSIONS Our results illustrate the need to linguistically and culturally adapt Google AdWords campaigns and to manage them carefully to ensure the most cost-effective results.
Collapse
|
49
|
Graham AL, Cha S, Cobb NK, Fang Y, Niaura RS, Mushro A. Impact of seasonality on recruitment, retention, adherence, and outcomes in a web-based smoking cessation intervention: randomized controlled trial. J Med Internet Res 2013; 15:e249. [PMID: 24201304 PMCID: PMC3841362 DOI: 10.2196/jmir.2880] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2013] [Revised: 10/17/2013] [Accepted: 10/21/2013] [Indexed: 11/13/2022] Open
Abstract
Background Seasonal variations in smoking and quitting behaviors have been documented, with many smokers seeking cessation assistance around the start of the New Year. What remains unknown is whether smokers who are recruited to cessation treatment trials during the New Year are as motivated to quit, or as likely to enroll in a research trial, adhere to a research protocol, and benefit from a cessation intervention compared to those who are recruited during other times of the year. Objective The objective of this study was to determine whether smokers recruited during the New Year period differ on measures of motivation and desire to quit, recruitment and retention rates, website utilization rates, and short-term cessation outcomes compared to smokers recruited at other times. Methods Participants were current smokers who had registered on a free Web-based cessation program (BecomeAnEX.org) and were invited to participate in a clinical trial. The New Year period was defined according to a clear peak and drop in the proportion of visitors who registered on the site, spanning a 15-day period from December 26, 2012 to January 9, 2013. Two other 15-day recruitment periods during summer (July 18, 2012 to August 1, 2012) and fall (November 7, 2012 to November 21, 2012) were selected for comparison. Data were examined from 3 sources: (1) a Web-based clinical trials management system that automated the recruitment and enrollment process, (2) self-report assessments at baseline and 3 months postrandomization, and (3) online tracking software that recorded website utilization during the first 3 months of the trial. Results Visitors to BecomeAnEX during the New Year period were more likely to register on the site than smokers who visited during summer or fall (conversion rates: 7.4%, 4.6%, 4.9%, respectively; P<.001), but there were no differences in rates of study acceptance, consent, randomization, 3-month follow-up survey completion, or cessation between the 3 periods. New Year participants were older, more educated, more likely to be employed full time, and more likely to have a relationship partner compared with participants recruited at other times during the year, but did not differ on measures of motivation and desire to quit. Conclusions Smokers visiting a Web-based cessation program during the New Year period were more likely to register for treatment and differ on several demographic variables, but showed similar patterns of treatment engagement, retention, follow-up, and short-term cessation outcomes compared with participants who visited the site during other periods of the year. These results allay scientific concerns about recruiting participants during this time frame and are reassuring for researchers conducting Web-based cessation trials. Trial Registration ClinicalTrials.gov ID: NCT01544153; http://clinicaltrials.gov/ct2/show/NCT01544153 (Archived by WebCite at http://www.webcitation.org/6KjhmAS9u).
Collapse
Affiliation(s)
- Amanda L Graham
- Schroeder Institute for Tobacco Research and Policy Studies, Legacy, Washington, DC, United States.
| | | | | | | | | | | |
Collapse
|