Purposive facebook recruitment endows cost-effective nutrition education program evaluation

Use of Facebook, Instagram, and Twitter for recruiting healthy participants in nutrition-, physical activity-, or obesity-related studies: a systematic review

BACKGROUND

There are limited systematic reviews exploring the use of social media for recruiting participants specifically for nutrition-, physical activity-, and obesity-related studies.

OBJECTIVES

The aim was to conduct a systematic review on the effectiveness of using social media (Facebook, Instagram, and Twitter) for recruiting healthy participants in nutrition-, physical activity-, or obesity-related studies.

METHODS

Studies were identified from 5 databases and included if they reported the number of participants recruited by social media (Facebook, Instagram, or Twitter) vs. traditional (print, e-mail, etc.). The effectiveness of recruitment was compared between methods by study procedures (in-person vs. online procedures). The cost-effectiveness of methods was also explored. The protocol was published in the Prospero database (ID# CRD42020204414).

RESULTS

Twenty-six studies were included. Among studies with both types of recruitment methods, 49% of the sample was reached through traditional methods, 40% through social media, and the rest by other methods. For in-person study procedures, the median number of participants recruited using social media was 19 (range: 3-278) and for online study procedures, it was 298 (range: 3-17,069). Median recruitment cost using social media (n = 14 studies) was $11.90 (range: $0-517) per participant, while this varied considerably for traditional methods depending on how it was calculated ($214, $18.9-$777). The ratio of participants reached vs. recruited was 0.12%; the overall ratio of participants interactions vs. recruited was 21.2%.

CONCLUSIONS

For in-person study procedures, traditional recruitment methods were more effective than social media, but for online study procedures, about half reported that social media was more effective. While more potential participants were reached through social media, only 21.2% of those who interacted with ads were enrolled. With the increased use of social media, their use for recruitment may be more frequent; therefore, future reviews may show different results.

Utilizing Facebook and Automated Telephone Calls to Increase Adoption of a Local Smoke Alarm Installation Program

CONTEXT

Innovative strategies are needed to improve the prevalence of working smoke alarms in homes. To our knowledge, this is the first study to report on the effectiveness of Facebook advertising and automated telephone calls as population-level strategies to encourage an injury prevention behavior.

OBJECTIVE

We examine the effectiveness of Facebook advertising and automated telephone calls as strategies to enroll individuals in Baltimore City's Fire Department's free smoke alarm installation program.

PARTICIPANTS

We directed our advertising efforts toward Facebook users eligible for the Baltimore City Fire Department's free smoke alarm installation program and all homes with a residential phone line included in Baltimore City's automated call system.

DESIGN

The Facebook campaign targeted Baltimore City residents 18 years of age and older. In total, an estimated 300 000 Facebook users met the eligibility criteria. Facebook advertisements were delivered to users' desktop and mobile device newsfeeds. A prerecorded message was sent to all residential landlines listed in the city's automated call system.

RESULTS

By the end of the campaign, the 3 advertisements generated 456 666 impressions reaching 130 264 Facebook users. Of the users reached, 4367 individuals (1.3%) clicked the advertisement. The automated call system included approximately 90 000 residential phone numbers. Participants attributed 25 smoke alarm installation requests to Facebook and 458 to the automated call.

CONCLUSION

Facebook advertisements are a novel approach to promoting smoke alarms and appear to be effective in exposing individuals to injury prevention messages. However, converting Facebook message recipients to users of a smoke alarm installation program occurred infrequently in this study. Residents who participated in the smoke alarm installation program were more likely to cite the automated call as the impetus for their participation. Additional research is needed to understand the circumstances and strategies to effectively use the social networking site as a tool to convert passive users into active participants.

A novel approach to conducting clinical trials in the community setting: utilizing patient-driven platforms and social media to drive web-based patient recruitment

Background

Participant recruitment for clinical research studies remains a significant challenge for researchers. Novel approaches to recruitment are necessary to ensure that populations are easier to reach. In the context of rare diseases, social media provides a unique opportunity for connecting with patient groups that have representatively lower diagnosis rates when compared with more common diseases or illness. We describe the implementation of designing a patient-centered approach to message design for the purposes of recruiting patients for clinical research studies for rare disease populations.

Methods

Using an iterative research approach, we analyzed our previous experience of using web-based direct-to-patient recruitment methods to compare these online strategies with traditional center of excellence recruitment strategies. After choosing six research studies for inclusion in the previous study, in-depth, online interviews (n = 37) were conducted with patients represented in each disease category to develop and test recruitment message strategies for social media and a Web-based platform for patients to access study information and pre-screen. Finally, relationships were established with Patient Advocacy Groups representing each rare disease category to ensure further dissemination of recruitment materials via their own social media networks.

Results

Guided by social marketing theory, we created and tested various recruitment message designs. Three key message concepts preferred by patients emerged: (1) infographic; (2) positive emotional messages; and (3) educational information for sharing. A base study website was designed and created based on data from patient interviews. This website includes the option for potential participants to pre-screen and determine their eligibility for the study.

Conclusions

Study participants report wanting to be involved in the design and implementation of recruitment approaches for clinical research studies. The application of the aforementioned methods could aide in the evolution of clinical research practices for the recruitment of both rare and common diseases, where patient-centric approaches can help to create targeted messages designs that participants pre-test and support.

A systematic evaluation of digital nutrition promotion websites and apps for supporting parents to influence children's nutrition

Background

Globally children’s diet quality is poor. Parents are primary gatekeepers to children’s food intake; however, reaching and engaging parents in nutrition promotion can be challenging. With growth in internet and smartphone use, digital platforms provide potential to disseminate information rapidly to many people. The objectives of this review were to conduct a comprehensive and systematic evaluation of nutrition promotion via websites and apps supporting parents to influence children’s nutrition, from three different perspectives: 1) current evidence base, 2) end user (parent) experience and 3) current commercial offerings.

Methods

Three systematic reviews were undertaken of (1) studies evaluating the effectiveness for digital platforms for improving nutrition in children and parents, (2) studies conducting user-testing of digital tools with parents, (3) websites and apps providing lunch-provision information to parents. Searches were conducted in five databases for reviews one and two, and systematic search of Google and App Store for review three. Randomised controlled trials, cohort and cross-sectional and qualitative studies (study two only) were included if published in English, from 2013, with the intervention targeted at parents and at least 50% of intervention content focused on nutrition. Search results were double screened, with data extracted into standardised spreadsheets and quality appraisal of included search results.

Results

Studies evaluating digital nutrition interventions targeting parents (n = 11) demonstrated effectiveness for improving nutrition outcomes, self-efficacy and knowledge. Six of the included randomised controlled trials reported digital interventions to be equal to, or better than comparison groups. User-testing studies (n = 9) identified that digital platforms should include both informative content and interactive features. Parents wanted evidence-based information from credible sources, practical tools, engaging content and connection with other users and health professionals. Websites targeting lunch provision (n = 15) were developed primarily by credible sources and included information-based content consistent with dietary guidelines and limited interactive features. Lunchbox apps (n = 6), developed mostly by commercial organisations, were more interactive but provided less credible information.

Conclusions

Digital nutrition promotion interventions targeting parents can be effective for improving nutrition-related outcomes in children and parents. As demonstrated from the lunchbox context and user-testing with parents, they need to go beyond just providing information about positive dietary changes, to include the user-desired features supporting interactivity and personalisation.

To end disease tomorrow, begin with trials today: Digital strategies for increased awareness of a clinical trials finder

INTRODUCTION

Individuals experiencing different medical conditions, as well as healthy volunteers, may often be interested in trial participation, and researchers similarly need to find participants to advance medical knowledge. The ResearchMatch (RM) Trials Today clinical trial searching tool leverages clinicaltrials.gov data to enable potential participants to look for trial opportunities relevant to their situation. To facilitate expanded use of this tool, we undertook a national digital public awareness campaign to increase awareness of Trials Today among members of the general public.

METHODS

The awareness campaign promoted Trials Today using Facebook and digital banner messages in 2017, encompassing nine cities across the USA. The digital strategy was complemented by print media in several outlets. We employed descriptive statistics to summarize campaign metrics and site usage data during the campaign.

RESULTS

The campaign was successful in increasing visits to Trials Today, with 142,303 sessions logged during its run, as compared to pre-campaign data indicating 104,688 total sessions during the entire 2-year period since the site's inception. The city-specific click-through rate for all digital impressions, combining Facebook and banner messaging, ranged from 0.50% to 1.09%, resulting in a cost-per-click range of $0.69-$1.15. In addition, visitors conducted 29,697 searches and viewed individual trial records 173,512 times.

CONCLUSION

The public awareness campaign was successful in increasing use of the RM Trials Today clinical trial searching tool. Our findings support the value of digital media messaging as a cost-effective vehicle for promoting clinical trial awareness, especially for chronic ailments.

The Search for Consumers of Web-Based Raw DNA Interpretation Services: Using Social Media to Target Hard-to-Reach Populations

Background

In recent years, there has been a proliferation of third-party Web-based services available to consumers to interpret raw DNA from direct-to-consumer genetic testing companies. Little is known about who uses these services and the downstream health implications. Identifying this hard-to-reach population of consumers for research raised questions about the most effective recruitment methods to undertake. Past studies have found that Web-based social media survey distribution can be cost-effective for targeting hard-to-reach populations, yet comparative efficacy information across platforms is limited.

Objective

The aim of this study was to identify the most effective Web-based strategies to identify and recruit the target population of direct-to-consumer genetic testing users who also made use of third-party interpretation services to analyze their raw genetic data. Web-based survey recruitment methods varying by social media platform and advertising method were compared in terms of cost-effectiveness and demographics of survey respondents.

Methods

A total of 5 Web-based survey distribution conditions were examined: 4 paid advertising services and 1 unpaid service. For the paid services, a 2x2 quasi-experimental design compared social media platforms (Facebook vs Twitter) and advertising tracking metrics (by click vs by conversion). The fifth unpaid comparison method consisted of study postings on the social media platform, Reddit, without any paid advertising. Links to identical Web-based versions of the study questionnaire were posted for 10 to 14 days for each of the distribution conditions, which allowed tracking the number of respondents that entered and completed the questionnaire by distribution condition.

Results

In total, 438 individuals were recruited to the study through all conditions. A nearly equivalent number of participants were recruited from paid campaigns on Facebook (n=159) and Twitter (n=167), with a smaller sample recruited on Reddit (n=112). Significantly more participants were recruited through conversion-tracking (n=222) than through click-tracking campaigns (n=104; Z=6.5, P<.001). Response rates were found to be partially driven by organic sharing of recruitment materials among social media users. Conversion tracking was more cost-effective than click tracking across paid social media platforms. Significant differences in terms of gender and age distributions were noted between the platforms and between the tracking metrics.

Conclusions

Web-based recruitment methods were effective at recruiting participants from a hard-to-reach population in a short time frame. There were significant differences in the effectiveness of various paid advertising techniques. Recruitment through Web-based communities also appeared to perform adequately, yet it may be limited by the number of users accessible in open community groups. Future research should evaluate the impact of organic sharing of recruitment materials because this appeared to play a substantial role in the observed effectiveness of different methods.

Allergens and food additives, including potentially harmful ones, present in food products that are preferred by children and adolescents

INTRODUCTION

The proper development of a child is linked with proper nutrition, including nutritional habits which are formed from childhood.

THE AIM OF THE STUDY

The aim of the study was to establish a list of the most popular food products among children and to develop a register of potentially dangerous substances on a Facebook website.

MATERIALS AND METHODS

A website was created on Facebook. The participants provided lists of favorite dishes or products.

RESULTS

The study involved 264 participants. An inverse correlation was observed with reference to the age of the subjects and the occurrence of sugar syrup in their diet (R=-0.20; p<0.001), glucose-fructose (R= -0.18; p< 0.004), and glucose (R=-0.13; p< 0.039) syrups. The most common potential food allergens are: gluten (R=0.28; p<0.001), eggs (R=0.28; p<0.001), and wheat (R=0.25; p<0.001). The main substances added to food that are present in a child's diet that increase proportionally with reference to the child's age are: salicylates (R=0.37; p<0.001), iron and ammonium sulfates (R=0.21; p<0.001).

CONCLUSION

The choices of favorite products are related to age and sex. Products containing gluten, the consumption of which increases with age, carry a risk of undiagnosed celiac disease and non-celiac gluten sensitivity in people with a genetic predisposition. Facebook has fulfilled its role as an effective tool for gathering information about the food preferences of children and adolescents.

Using Facebook in Recruiting Kidney Transplant Recipients for a REDCap Study

This web-based study recruited kidney transplant recipients from Facebook using three recruiting methods over a 5-week period. Participants completed 125 survey items via REDCap (Research Electronic Data Capture) survey. Facebook recruitment generated 153 eligible participants who completed surveys. The average survey response time was 15.07 min (SD = 6.12; range: 4-43), with a low missing item rate (<5%). Facebook's standard ads were most effective for recruiting subjects (n = 78, 51%), followed by three targeted Facebook kidney transplant support groups (n = 52, 34%) and a pay-to-promote study page (n = 12, 7.8%). The average cost paid for each valid survey was US$2.19 through standard Facebook ads and US$2.92 from the study page. The cost for online survey completion is economically feasible even for those with limited funds. Issues related to online surveys including extreme survey response times and participant misrepresentation were reported in this study.

Using Facebook for Large-Scale Online Randomized Clinical Trial Recruitment: Effective Advertising Strategies

Targeted Facebook advertising can be an effective strategy to recruit participants for a large-scale online study. Facebook advertising is useful for reaching people in a wide geographic area, matching a specific demographic profile. It can also target people who would be unlikely to search for the information and would thus not be accessible via Google AdWords. It is especially useful when it is desirable not to raise awareness of the study in a demographic group that would be ineligible for the study. This paper describes the use of Facebook advertising to recruit and enroll 1145 women over a 15-month period for a randomized clinical trial to teach support skills to female partners of male smokeless tobacco users. This tutorial shares our study team’s experiences, lessons learned, and recommendations to help researchers design Facebook advertising campaigns. Topics covered include designing the study infrastructure to optimize recruitment and enrollment tracking, creating a Facebook presence via a fan page, designing ads that attract potential participants while meeting Facebook’s strict requirements, and planning and managing an advertising campaign that accommodates the rapid rate of diminishing returns for each ad.

The Use of Web-Based Technologies in Health Research Participation: Qualitative Study of Consumer and Researcher Experiences

BACKGROUND

Health consumers are often targeted for their involvement in health research including randomized controlled trials, focus groups, interviews, and surveys. However, as reported by many studies, recruitment and engagement of consumers in academic research remains challenging. In addition, there is scarce literature describing what consumers look for and want to achieve by participating in research.

OBJECTIVE

Understanding and responding to the needs of consumers is crucial to the success of health research projects. In this study, we aim to understand consumers' needs and investigate the opportunities for addressing these needs with Web-based technologies, particularly in the use of Web-based research registers and social networking sites (SNSs).

METHODS

We undertook a qualitative approach, interviewing both consumer and medical researchers in this study. With the help from an Australian-based organization supporting people with musculoskeletal conditions, we successfully interviewed 23 consumers and 10 researchers. All interviews were transcribed and analyzed with thematic analysis methodology. Data collection was stopped after the data themes reached saturation.

RESULTS

We found that consumers perceive research as a learning opportunity and, therefore, expect high research transparency and regular updates. They also consider the sources of the information about research projects, the trust between consumers and researchers, and the mobility of consumers before participating in any research. Researchers need to be aware of such needs when designing a campaign for recruitment for their studies. On the other hand, researchers have attempted to establish a rapport with consumer participants, design research for consumers' needs, and use technologies to reach out to consumers. A systematic approach to integrating a variety of technologies is needed.

CONCLUSIONS

On the basis of the feedback from both consumers and researchers, we propose 3 future directions to use Web-based technologies for addressing consumers' needs and engaging with consumers in health research: (1) researchers can make use of consumer registers and Web-based research portals, (2) SNSs and new media should be frequently used as an aid, and (3) new technologies should be adopted to remotely collect data and reduce administrative work for obtaining consumers' consent.

Facilitator and Participant Use of Facebook in a Community-Based Intervention for Parents: The InFANT Extend Program

BACKGROUND

Social networking sites such as Facebook afford new opportunities for behavior-change interventions. Although often used as a recruitment tool, few studies have reported the use of Facebook as an intervention component to facilitate communication between researchers and participants. The aim of this study was to examine facilitator and participant use of a Facebook component of a community-based intervention for parents.

METHODS

First-time parent groups participating in the intervention arm of the extended Infant Feeding, Activity and Nutrition Trial (InFANT Extend) Program were invited to join their own private Facebook group. Facilitators mediated the Facebook groups, using them to share resources with parents, arrange group sessions, and respond to parent queries. Parents completed process evaluation questionnaires reporting on the usefulness of the Facebook groups.

RESULTS

A total of 150 parents (from 27 first-time parent groups) joined their private Facebook group. There were a mean of 36.9 (standard deviation 11.1) posts/group, with the majority being facilitator posts. Facilitator administration posts (e.g., arranging upcoming group sessions) had the highest average comments (4.0), followed by participant health/behavior questions (3.5). The majority of participants reported that they enjoyed being a part of their Facebook group; however, the frequency of logging on to their groups' page declined over the 36 months of the trial, as did their perceived usefulness of the group.

CONCLUSIONS

Facebook appears to be a useful administrative tool in this context. Parents enjoyed being part of their Facebook group, but their reported use of and engagement with Facebook declined over time.

Recruiting Women to a Mobile Health Smoking Cessation Trial: Low- and No-Cost Strategies

BACKGROUND

Successful recruitment of participants to mobile health (mHealth) studies presents unique challenges over in-person studies. It is important to identify recruitment strategies that maximize the limited recruitment resources available to researchers.

OBJECTIVE

The objective of this study was to describe a case study of a unique recruitment process used in a recent mHealth software app designed to increase smoking cessation among weight-concerned women smokers. The See Me Smoke-Free app was deployed to the Google Play Store (Alphabet, Inc., Google, LLC), where potential participants could download the app and enroll in the study. Users were invited in-app to participate in the study, with no in-person contact. The recruitment activities relied primarily on earned (free) and social media.

METHODS

To determine the relationship between recruitment activities and participant enrollment, the researchers explored trends in earned and social media activity in relation to app installations, examined social media messaging in relation to reach or impressions, and described app users' self-reported referral source. The researchers collected and descriptively analyzed data regarding recruitment activities, social media audience, and app use during the 18-week recruitment period (March 30, 2015-July 31, 2015). Data were collected and aggregated from internal staff activity tracking documents and from Web-based data analytics software such as SumAll, Facebook Insights (Facebook, Inc.), and Google Analytics (Alphabet, Inc., Google, LLC).

RESULTS

Media coverage was documented across 75 publications and radio or television broadcasts, 35 of which were local, 39 national, and 1 international. The research team made 30 Facebook posts and 49 tweets, yielding 1821 reaches and 6336 impressions, respectively. From March 30, 2015 to July 31, 2015, 289 unique users downloaded the app, and 151 participants enrolled in the study.

CONCLUSIONS

Research identifying effective online recruitment methods for mHealth studies remains minimal, and findings are inconsistent. We demonstrated how earned media can be leveraged to recruit women to an mHealth smoking cessation trial at low cost. Using earned media and leveraging social media allowed us to enroll 3 times the number of participants that we anticipated enrolling. The cost of earned media resides in the staff time required to manage it, particularly the regular interaction with social media. We recommend communication and cooperation with university public affairs and social media offices, as well as affiliate programs in journalism and communications, so that earned media can be used as a recruitment strategy for mHealth behavior change interventions. However, press releases are not always picked up by the media and should not be considered as a stand-alone method of recruitment. Careful consideration of an intervention's broad appeal and how that translates into potential media interest is needed when including earned media as part of a comprehensive recruitment plan for mHealth research.

Allergens and food additives, including potentially harmful ones, present in food products that are preferred by children and adolescents

INTRODUCTION

The proper development of a child is linked with proper nutrition, including nutritional habits which are formed from childhood.

THE AIM OF THE STUDY

The aim of the study was to establish a list of the most popular food products among children and to develop a register of potentially dangerous substances on a Facebook website.

MATERIALS AND METHODS

A website was created on Facebook. The participants provided lists of favorite dishes or products.

RESULTS

The study involved 264 participants. An inverse correlation was observed with reference to the age of the subjects and the occurrence of sugar syrup in their diet (R=-0.20; p<0.001), glucose-fructose (R= -0.18; p< 0.004), and glucose (R=-0.13; p< 0.039) syrups. The most common potential food allergens are: gluten (R=0.28; p<0.001), eggs (R=0.28; p<0.001), and wheat (R=0.25; p<0.001). The main substances added to food that are present in a child's diet that increase proportionally with reference to the child's age are: salicylates (R=0.37; p<0.001), iron and ammonium sulfates (R=0.21; p<0.001).

CONCLUSION

The choices of favorite products are related to age and sex. Products containing gluten, the consumption of which increases with age, carry a risk of undiagnosed celiac disease and non-celiac gluten sensitivity in people with a genetic predisposition. Facebook has fulfilled its role as an effective tool for gathering information about the food preferences of children and adolescents.

Costs and Efficiency of Online and Offline Recruitment Methods: A Web-Based Cohort Study

BACKGROUND

The Internet is widely used to conduct research studies on health issues. Many different methods are used to recruit participants for such studies, but little is known about how various recruitment methods compare in terms of efficiency and costs.

OBJECTIVE

The aim of our study was to compare online and offline recruitment methods for Internet-based studies in terms of efficiency (number of recruited participants) and costs per participant.

METHODS

We employed several online and offline recruitment methods to enroll 18- to 45-year-old women in an Internet-based Danish prospective cohort study on fertility. Offline methods included press releases, posters, and flyers. Online methods comprised advertisements placed on five different websites, including Facebook and Netdoktor.dk. We defined seven categories of mutually exclusive recruitment methods and used electronic tracking via unique Uniform Resource Locator (URL) and self-reported data to identify the recruitment method for each participant. For each method, we calculated the average cost per participant and efficiency, that is, the total number of recruited participants.

RESULTS

We recruited 8252 study participants. Of these, 534 were excluded as they could not be assigned to a specific recruitment method. The final study population included 7724 participants, of whom 803 (10.4%) were recruited by offline methods, 3985 (51.6%) by online methods, 2382 (30.8%) by online methods not initiated by us, and 554 (7.2%) by other methods. Overall, the average cost per participant was €6.22 for online methods initiated by us versus €9.06 for offline methods. Costs per participant ranged from €2.74 to €105.53 for online methods and from €0 to €67.50 for offline methods. Lowest average costs per participant were for those recruited from Netdoktor.dk (€2.99) and from Facebook (€3.44).

CONCLUSIONS

In our Internet-based cohort study, online recruitment methods were superior to offline methods in terms of efficiency (total number of participants enrolled). The average cost per recruited participant was also lower for online than for offline methods, although costs varied greatly among both online and offline recruitment methods. We observed a decrease in the efficiency of some online recruitment methods over time, suggesting that it may be optimal to adopt multiple online methods.

Recruitment and retention of young adult veteran drinkers using Facebook

The objective of this study was to describe the feasibility of using Facebook as a platform to recruit and retain young adult veteran drinkers into an online-alcohol use intervention study. Facebook's wide accessibility and popularity among the age group that comprises the majority of veterans from the conflicts in Iraq and Afghanistan make it a compelling resource through which research can extend its reach to this otherwise hard-to-reach group. We developed a series of Facebook advertisement campaigns to reach veteran drinkers not specifically searching for alcohol treatment. In doing so, we recruited 793 valid veteran participants in approximately two weeks for an advertising cost of $4.53 per obtained participant. The study sample consisted primarily of male veterans, between 19 and 34 years of age, who were drinking at moderate to heavy levels. Although about half of the sample reported mental health comorbidity, few had received any mental health or substance use treatment in the past year. Facebook appears to be a valuable mechanism through which to recruit young veterans with unmet behavioral health needs, although more specific efforts may be needed to engage certain types of veterans after initial study enrollment.

A Comparison of Three Online Recruitment Strategies for Engaging Parents

Family scientists can face the challenge of effectively and efficiently recruiting normative samples of parents and families. Utilizing the Internet to recruit parents is a strategic way to find participants where they already are, enabling researchers to overcome many of the barriers to in-person recruitment. The present study was designed to compare three online recruitment strategies for recruiting parents: e-mail Listservs, Facebook, and Amazon Mechanical Turk (MTurk). Analyses revealed differences in the effectiveness and efficiency of data collection. In particular, MTurk resulted in the most demographically diverse sample, in a short period of time, with little cost. Listservs reached a large number of participants and resulted in a comparatively homogeneous sample. Facebook was not successful in recruiting a general sample of parents. Findings provide information that can help family researchers and practitioners be intentional about recruitment strategies and study design.

A Comparison of Recruitment Methods for an mHealth Intervention Targeting Mothers: Lessons from the Growing Healthy Program

Background

Mobile health (mHealth) programs hold great promise for increasing the reach of public health interventions. However, mHealth is a relatively new field of research, presenting unique challenges for researchers. A key challenge is understanding the relative effectiveness and cost of various methods of recruitment to mHealth programs.

Objective

The objectives of this study were to (1) compare the effectiveness of various methods of recruitment to an mHealth intervention targeting healthy infant feeding practices, and (2) explore factors influencing practitioner referral to the intervention.

Methods

The Growing healthy study used a quasi-experimental design with an mHealth intervention group and a concurrent nonrandomized comparison group. Eligibility criteria included: expectant parents (>30 weeks of gestation) or parents with an infant <3 months old, ability to read and understand English, own a mobile phone, ≥18 years old, and living in Australia. Recruitment to the mHealth program consisted of: (1) practitioner-led recruitment through Maternal and Child Health nurses, midwives, and nurses in general practice; (2) face-to-face recruitment by researchers; and (3) online recruitment. Participants’ baseline surveys provided information regarding how participants heard about the study, and their sociodemographic details. Costs per participant recruited were calculated by taking into account direct advertising costs and researcher time/travel costs. Practitioner feedback relating to the recruitment process was obtained through a follow-up survey and qualitative interviews.

Results

A total of 300 participants were recruited to the mHealth intervention. The cost per participant recruited was lowest for online recruitment (AUD $14) and highest for practice nurse recruitment (AUD $586). Just over half of the intervention group (50.3%, 151/300) were recruited online over a 22-week period compared to practitioner recruitment (29.3%, 88/300 over 46 weeks) and face-to-face recruitment by researchers (7.3%, 22/300 over 18 weeks). No significant differences were observed in participant sociodemographic characteristics between recruitment methods, with the exception that practitioner/face-to-face recruitment resulted in a higher proportion of first-time parents (68% versus 48%, P=.002). Less than half of the practitioners surveyed reported referring to the program often or most of the time. Key barriers to practitioner referral included lack of time, difficulty remembering to refer, staff changes, lack of parental engagement, and practitioner difficulty in accessing the app.

Conclusions

Online recruitment using parenting-related Facebook pages was the most cost effective and timely method of recruitment to an mHealth intervention targeting parents of young infants. Consideration needs to be given to addressing practitioner barriers to referral, to further explore if this can be a viable method of recruitment.

Using Facebook for Health-related Research Study Recruitment and Program Delivery

Facebook has become an important tool for recruiting research participants and for program delivery. Given the wide use of Facebook, there is much potential for the site to help with recruitment efforts in both physical and behavioral health care arenas; reaching groups typically difficult to recruit and providing outreach to individuals that may not have received services elsewhere. Health studies using Facebook have generally reported success, including cost-effectiveness, recruitment of samples in brief periods of time, and ability to locate participants for follow-up research. Still, the use of Facebook for research and program delivery is a relatively new area that warrants more research attention and guidance around issues like validity of data, representativeness of samples, and protections of human subjects.

An Evaluation of Web- and Print-Based Methods to Attract People to a Physical Activity Intervention

Background

Cost-effective and efficient methods to attract people to Web-based health behavior interventions need to be identified. Traditional print methods including leaflets, posters, and newspaper advertisements remain popular despite the expanding range of Web-based advertising options that have the potential to reach larger numbers at lower cost.

Objective

This study evaluated the effectiveness of multiple Web-based and print-based methods to attract people to a Web-based physical activity intervention.

Methods

A range of print-based (newspaper advertisements, newspaper articles, letterboxing, leaflets, and posters) and Web-based (Facebook advertisements, Google AdWords, and community calendars) methods were applied to attract participants to a Web-based physical activity intervention in Australia. The time investment, cost, number of first time website visits, the number of completed sign-up questionnaires, and the demographics of participants were recorded for each advertising method.

Results

A total of 278 people signed up to participate in the physical activity program. Of the print-based methods, newspaper advertisements totaled AUD $145, letterboxing AUD $135, leaflets AUD $66, posters AUD $52, and newspaper article AUD $3 per sign-up. Of the Web-based methods, Google AdWords totaled AUD $495, non-targeted Facebook advertisements AUD $68, targeted Facebook advertisements AUD $42, and community calendars AUD $12 per sign-up. Although the newspaper article and community calendars cost the least per sign-up, they resulted in only 17 and 6 sign-ups respectively. The targeted Facebook advertisements were the next most cost-effective method and reached a large number of sign-ups (n=184). The newspaper article and the targeted Facebook advertisements required the lowest time investment per sign-up (5 and 7 minutes respectively). People reached through the targeted Facebook advertisements were on average older (60 years vs 50 years, P<.001) and had a higher body mass index (32 vs 30, P<.05) than people reached through the other methods.

Conclusions

Overall, our results demonstrate that targeted Facebook advertising is the most cost-effective and efficient method at attracting moderate numbers to physical activity interventions in comparison to the other methods tested. Newspaper advertisements, letterboxing, and Google AdWords were not effective. The community calendars and newspaper articles may be effective for small community interventions.

ClinicalTrial

Australian New Zealand Clinical Trials Registry: ACTRN12614000339651; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=363570&isReview=true (Archived by WebCite at http://www.webcitation.org/6hMnFTvBt)

Recruiting for health, medical or psychosocial research using Facebook: Systematic review

Recruiting participants is a challenge for many health, medical and psychosocial research projects. One tool more frequently being used to improve recruitment is the social networking website Facebook. A systematic review was conducted to identify studies that have used Facebook to recruit participants of all ages, to any psychosocial, health or medical research. 110 unique studies that used Facebook as a recruitment source were included in the review. The majority of studies used a cross-sectional design (80%) and addressed a physical health or disease issue (57%). Half (49%) of the included studies reported specific details of the Facebook recruitment process. Researchers paid between $1.36 and $110 per completing participants (Mean = $17.48, SD = $23.06). Among studies that examined the representativeness of their sample, the majority concluded (86%) their Facebook-recruited samples were similarly representative of samples recruited via traditional methods. These results indicate that Facebook is an effective and cost-efficient recruitment method. Researchers should consider their target group, advertisement wording, offering incentives and no-cost methods of recruitment when considering Facebook as a recruitment source. It is hoped this review will assist researchers to make decisions regarding the use of Facebook as a recruitment tool in future research.

Exploring the Feasibility and Potential of Virtual Panels for Soliciting Feedback on Nutrition Education Materials: A Proof-of-Concept Study

Background

A changing and cluttered information landscape has put pressure on health organizations to produce consumer information materials that are not only factual but high quality and engaging to audiences. User-centered design methods can be useful in obtaining feedback from consumers; however, they are labor intensive and slow, which is not responsive to the fast-paced communication landscape influenced by social media. EatRight Ontario (ERO), a provincial nutrition and health support program of Dietitians of Canada, develops evidence-based resources for consumers and sought to increase user-centered design activities by exploring whether the standard approach to feedback could be replicated online. While online feedback has been used in marketing research, few examples are available in health promotion and public health to guide programming and policy.

Objective

This study compared a traditional in-person approach for recruitment and feedback using paper surveys with an Internet-based approach using Facebook as a recruitment tool and collecting user feedback via the Web. The purpose of the proof-of-concept study was to explore the feasibility of the approach and compare an online versus traditional approach in terms of recruitment issues and response.

Methods

An exploratory, two-group comparative trial was conducted using a convenience and purposive sampling. Participants reviewed a handout on healthy eating and then completed an 18-item survey with both forced-choice items and open-ended responses. One group viewed a hard-copy prototype and completed a paper survey and the other viewed a PDF prototype via Web links and completed a Web survey. The total days required to fulfill the sample for each group were used as the primary method of efficiency calculation.

Results

In total, 44 participants (22 per condition) completed the study, consisting of 42 women and 2 men over the age of 18. Few significant differences were detected between the groups. Statistically significant (P≤.05) differences were detected on four attitudinal variables related to the document reviewed and include perceived length of the document, perceived attractiveness, likelihood of contacting ERO for food and nutrition questions in the future, and likelihood of recommending ERO to a friend. In all cases, the responses were more favorable to the document or ERO with the online group. All other variables showed no difference between them. A content review of the qualitative feedback found relative consistency in word use and number of words used, indicating relative parity in the amount of data generated between conditions. The online condition achieved its sampling target in 9 days, while the in-person method took 79 days to achieve the target.

Conclusions

An online process of recruitment through Facebook and solicitation of online feedback is a feasible model that yields comparable response levels to in-person methods for user feedback. The online approach appears to be a faster and less resource-intensive approach than traditional in-person methods for feedback generation.

Strategies for successful recruitment of young adults to healthy lifestyle programmes for the prevention of weight gain: a systematic review

Recruiting healthy young adults, aged 18-35, to lifestyle programmes for prevention of weight gain is challenging but important given their increasing rates of obesity. This review aimed to examine the success of different recruitment strategies. A systematic literature search identified 26 separate studies using 10 electronic databases. Participant characteristics and efficacy of interventions were well reported in all studies, but reporting of recruitment procedures, costs, times and effectiveness was minimal. Of those reporting recruitment, both active (e.g. face-to-face) and passive (e.g. print-media and mass-mailings) approaches were identified with the latter most frequently employed. Novel strategies such as social media and marketing approaches were identified. Television and radio have potentially high reach but low efficiency with high cost compared with mass-mailings which yield high numbers of participants. Marketing campaigns appeared to be a promising approach. Incentives demonstrated enhanced recruitment. The use of formative research to guide recruitment strategies for interventions is recommended. Reporting of success, cost and timelines for recruitment should be included in reporting of future trials. This first synthesis of recruitment information can be used to inform recruitment frameworks for lifestyle programmes seeking to attract young adults.

How to Establish and Follow up a Large Prospective Cohort Study in the 21st Century--Lessons from UK COSMOS

Large-scale prospective cohort studies are invaluable in epidemiology, but they are increasingly difficult and costly to establish and follow-up. More efficient methods for recruitment, data collection and follow-up are essential if such studies are to remain feasible with limited public and research funds. Here, we discuss how these challenges were addressed in the UK COSMOS cohort study where fixed budget and limited time frame necessitated new approaches to consent and recruitment between 2009-2012. Web-based e-consent and data collection should be considered in large scale observational studies, as they offer a streamlined experience which benefits both participants and researchers and save costs. Commercial providers of register and marketing data, smartphones, apps, email, social media, and the internet offer innovative possibilities for identifying, recruiting and following up cohorts. Using examples from UK COSMOS, this article sets out the dos and don’ts for today's cohort studies and provides a guide on how best to take advantage of new technologies and innovative methods to simplify logistics and minimise costs. Thus a more streamlined experience to the benefit of both research participants and researchers becomes achievable.

Effective Strategies to Recruit Young Adults Into the TXT2BFiT mHealth Randomized Controlled Trial for Weight Gain Prevention

Background

Younger adults are difficult to engage in preventive health, yet in Australia they are gaining more weight and increasing in waist circumference faster than middle-to-older adults. A further challenge to engaging 18- to 35-year-olds in interventions is the limited reporting of outcomes of recruitment strategies.

Objective

This paper describes the outcomes of strategies used to recruit young adults to a randomized controlled trial (RCT), healthy lifestyle mHealth program, TXT2BFiT, for prevention of weight gain. The progression from enquiry through eligibility check to randomization into the trial and the costs of recruitment strategies are reported. Factors associated with nonparticipation are explored.

Methods

Participants were recruited either via letters of invitation from general practitioners (GPs) or via electronic or print advertisements, including Facebook and Google—social media and advertising—university electronic newsletters, printed posters, mailbox drops, and newspapers. Participants recruited from GP invitation letters had an appointment booked with their GP for eligibility screening. Those recruited from other methods were sent an information pack to seek approval to participate from their own GP. The total number and source of enquiries were categorized according to eligibility and subsequent completion of steps to enrolment. Cost data and details of recruitment strategies were recorded.

Results

From 1181 enquiries in total from all strategies, 250 (21.17%) participants were randomized. A total of 5311 invitation letters were sent from 12 GP practices—16 participating GPs. A total of 131 patients enquired with 68 participants randomized (68/74 of those eligible, 92%). The other recruitment methods yielded the remaining 182 randomized participants. Enrolment from print media was 26% of enquiries, from electronic media was 20%, and from other methods was 3%. Across all strategies the average cost of recruitment was Australian Dollar (AUD) $139 per person. The least expensive modality was electronic (AUD $37), largely due to a free feature story on one university Web home page, despite Facebook advertising costing AUD $945 per enrolment. The most expensive was print media at AUD $213 and GP letters at AUD $145 per enrolment.

Conclusions

The research indicated that free electronic media was the most cost-effective strategy, with GP letters the least expensive of the paid strategies in comparison to the other strategies. This study is an important contribution for future research into efficacy, translation, and implementation of cost-effective programs for the prevention of weight gain in young adults. Procedural frameworks for recruitment protocols are required, along with systematic reporting of recruitment strategies to reduce unnecessary expenditure and allow for valuable public health prevention programs to go beyond the research setting.

Trial Registration

Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12612000924853; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=362872 (Archived by WebCite at http://www.webcitation.org/6YpNfv1gI).

"Is Your Man Stepping Out?" An Online Pilot Study to Evaluate Acceptability of a Guide-Enhanced HIV Prevention Soap Opera Video Series and Feasibility of Recruitment by Facebook Advertising

Love, Sex, and Choices (LSC) is a 12-episode soap opera video series developed to reduce HIV risk among at-risk Black urban women. We added a video guide commentator to offer insights at critical dramatic moments. An online pilot study evaluated acceptability of the Guide-Enhanced LSC (GELSC) and feasibility of Facebook advertising, streaming to smartphones, and retention. Facebook ads targeted high-HIV-prevalence areas. In 30 days, Facebook ads generated 230 screening interviews: 84 were high risk, 40 watched GELSC, and 39 followed up at 30 days. Recruitment of high-risk participants was 10 per week, compared to seven per week in previous field recruitment. Half the sample was Black; 12% were Latina. Findings suggest GELSC influenced sex scripts and behaviors. It was feasible to recruit young urban women from a large geographic area via Facebook and to retain the sample. We extended the reach to at-risk women by streaming to mobile devices.

Recruitment via the Internet and social networking sites: the 1989-1995 cohort of the Australian Longitudinal Study on Women's Health

Background

Faced with the challenge of recruiting young adults for health studies, researchers have increasingly turned to the Internet and social networking sites, such as Facebook, as part of their recruitment strategy. As yet, few large-scale studies are available that report on the characteristics and representativeness of the sample obtained from such recruitment methods.

Objective

The intent of the study was to describe the sociodemographic and health characteristics of a national sample of young Australian women recruited mainly through the Internet and social networking sites and to discuss the representativeness of their sociodemographic, health, and lifestyle characteristics relative to the population.

Methods

A cohort of 17,069 women (born between 1989 and 1995) was recruited in 2012-13 for the Australian Longitudinal Study on Women’s Health. Sociodemographic characteristics (percentages, means, and 95% confidence intervals) from the online survey data were compared with women aged 18-23 years from the 2011 Australian Census. Sample data were compared by age and education level with data from the 2011-13 Australian Health Survey (AHS).

Results

Compared to the Australian Census data, study participants were broadly representative in terms of geographical distribution across Australia, marital status (95.62%, 16,321/17,069) were never married), and age distribution. A higher percentage had attained university (22.52%, 3844/17,069) and trade/certificate/diploma qualifications (25.94%, 4428/17,069) compared with this age group of women in the national population (9.4% and 21.7% respectively). Among study participants, 22.05% (3721/16,877) were not in paid employment with 35.18% (5931/16,857) studying 16 or more hours a week. A higher percentage of study participants rated their health in the online survey as fair or poor (rather than good, very good, or excellent) compared with those participating in face-to-face interviews in the AHS (18.77%, 3203/17,069 vs 10.1%). A higher percentage of study participants were current smokers (21.78%, 3718/17,069 vs 16.4%) and physically active (59.30%, 10,089/17,014 were classified as sufficiently active vs 48.3%) but alcohol consumption was lower (59.58%, 9865/16,558 reported drinking alcohol at least once per month vs 65.9% in the AHS). Using self-reported height and weight to determine body mass index (BMI, kg/m²), 34.80% (5901/16,956) of the cohort were classified as overweight or obese (BMI of 25 or more), compared with 33.6% respectively using measured height and weight in the AHS.

Conclusions

Findings indicated that using the Internet and social networking sites for an online survey represent a feasible recruitment strategy for a national cohort of young women and result in a broadly representative sample of the Australian population.

Exploring abortion attitudes of US adolescents and young adults using social media

OBJECTIVES

To explore the use of social media for recruitment of adolescents and young adults in the United States and to describe how they learn and feel about abortion.

STUDY DESIGN

Americans 13-29years of age were recruited through web-based social media to complete an online survey about sex and pregnancy-related decision making, including abortion. Descriptive statistics were used to compare the study population's demographics and prevalence of sexual experience to national databases [US Census and National Survey of Family Growth (NSFG)] and to describe abortion attitudes and related topics.

RESULTS

Survey completion rate was 78% and 996 participants' responses were analyzed. The study population appeared diverse with respect to gender, ethnicity, race and geographic distribution with some similarities to the US Census and was sexually active at an earlier age compared to the NSFG. While the majority of participants supported abortion (74%), acceptance of abortion for themselves or their partners varied based on circumstances. The media were the most popular sources of information for learning about sex and abortion (73% and 68%, respectively). Parents had the most influence on individuals' abortion stances compared to other sources.

CONCLUSIONS

Social media recruitment, compared to traditional methods, has the potential to reach a geographically, ethnically and racially diverse group of young people to study sensitive topics in an economical and expedient fashion. Similar to the general population, the study population's abortion views fell on a spectrum with overall supportive attitudes toward abortion. The media served as common sources of information for learning about both sex and abortion.

IMPLICATIONS

Web-based social media offer a novel recruiting strategy to study sensitive topics such as abortion attitudes among difficult-to-reach populations such as adolescents and young adults. The presented findings begin characterizing young people's abortion attitudes, offering a foundation for more in-depth research.

Beyond traditional advertisements: leveraging Facebook's social structures for research recruitment

Background

Obtaining access to a demographically and geographically diverse sample for health-related research can be costly and time consuming. Previous studies have reported mixed results regarding the potential of using social media-based advertisements to overcome these challenges.

Objective

Our aim was to develop and assess the feasibility, benefits, and challenges of recruiting for research studies related to consumer health information technology (IT) by leveraging the social structures embedded in the social networking platform, Facebook.

Methods

Two recruitment strategies that involved direct communication with existing Facebook groups and pages were developed and implemented in two distinct populations. The first recruitment strategy involved posting a survey link directly to consenting groups and pages and was used to recruit Filipino-Americans to a study assessing the perceptions, use of, and preferences for consumer health IT. This study took place between August and December 2013. The second recruitment strategy targeted individuals with type 2 diabetes and involved creating a study-related Facebook group and asking administrators of other groups and pages to publicize our group to their members. Group members were then directly invited to participate in an online pre-study survey. This portion of a larger study to understand existing health management practices as a foundation for consumer health IT design took place between May and June 2014. In executing both recruitment strategies, efforts were made to establish trust and transparency. Recruitment rate, cost, content of interaction, and characteristics of the sample obtained were used to assess the recruitment methods.

Results

The two recruitment methods yielded 87 and 79 complete responses, respectively. The first recruitment method yielded a rate of study completion proportionate to that of the rate of posts made, whereas recruitment successes of the second recruitment method seemed to follow directly from the actions of a subset of administrators. Excluding personnel time, the first recruitment method resulted in no direct costs, and the second recruitment method resulted in a total direct cost of US $118.17. Messages, posts, and comments received using both recruitment strategies reflected ten themes, including appreciation, assistance, clarification, concerns, encouragement, health information, interest, promotion, solicitations, and support. Both recruitment methods produced mixed results regarding sample representativeness with respect to characteristics such as gender, race, and ethnicity.

Conclusions

The results of the study demonstrate that leveraging the social structures of Facebook for health-related research was feasible for obtaining small samples appropriate for qualitative research but not for obtaining large samples needed for quantitative research. The content of interactions with members of the target population prompted ethical deliberations concerning suitable target communities and appropriate boundaries between researchers and participants. Widespread replication of this method would benefit from a broad discussion among researchers, social media users, social media companies, and experts in research ethics to address appropriate protocols for such interactions.

Facebook Recruitment of Young Adult Smokers for a Cessation Trial: Methods, Metrics, and Lessons Learned

Further understanding is needed of the functionalities and efficiency of social media for health intervention research recruitment. Facebook was examined as a mechanism to recruit young adults for a smoking cessation intervention. An ad campaign targeting young adult smokers tested specific messaging based on market theory and successful strategies used to recruit smokers in previous clinical trials (i.e. informative, call to action, scarcity, social norms), previously successful ads, and general messaging. Images were selected to target smokers (e.g., lit cigarette), appeal to the target age, vary demographically, and vary graphically (cartoon, photo, logo). Facebook's Ads Manager was used over 7 weeks (6/10/13 - 7/29/13), targeted by age (18-25), location (U.S.), and language (English), and employed multiple ad types (newsfeed, standard, promoted posts, sponsored stories) and keywords. Ads linked to the online screening survey or study Facebook page. The 36 different ads generated 3,198,373 impressions, 5,895 unique clicks, at an overall cost of $2,024 ($0.34/click). Images of smoking and newsfeed ads had the greatest reach and clicks at the lowest cost. Of 5,895 unique clicks, 586 (10%) were study eligible and 230 (39%) consented. Advertising costs averaged $8.80 per eligible, consented participant. The final study sample (n=79) was largely Caucasian (77%) and male (69%), averaging 11 cigarettes/day (SD=8.3) and 2.7 years smoking (SD=0.7). Facebook is a useful, cost-effective recruitment source for young adult smokers. Ads posted via newsfeed posts were particularly successful, likely because they were viewable via mobile phone. Efforts to engage more ethnic minorities, young women, and smokers motivated to quit are needed.

The good, bad, and ugly of online recruitment of parents for health-related focus groups: lessons learned

Background

We describe our experiences with identifying and recruiting Ontario parents through the Internet, primarily, as well as other modes, for participation in focus groups about adding the influenza vaccine to school-based immunization programs.

Objective

Our objectives were to assess participation rates with and without incentives and software restrictions. We also plan to examine study response patterns of unique and multiple submissions and assess efficiency of each online advertising mode.

Methods

We used social media, deal forum websites, online classified ads, conventional mass media, and email lists to invite parents of school-aged children from Ontario, Canada to complete an online questionnaire to determine eligibility for focus groups. We compared responses and paradata when an incentive was provided and there were no software restrictions to the questionnaire (Period 1) to a period when only a single submission per Internet protocol (IP) address (ie, software restrictions invoked) was permitted and no incentive was provided (Period 2). We also compared the median time to complete a questionnaire, response patterns, and percentage of missing data between questionnaires classified as multiple submissions from the same Internet protocol (IP) address or email versus unique submissions. Efficiency was calculated as the total number of hours study personnel devoted to an advertising mode divided by the resultant number of unique eligible completed questionnaires .

Results

Of 1346 submitted questionnaires, 223 (16.6%) were incomplete and 34 (2.52%) did not meet the initial eligibility criteria. Of the remaining 1089 questionnaires, 246 (22.6%) were not from Ontario based on IP address and postal code, and 469 (43.1%) were submitted from the same IP address or email address (multiple submissions). In Period 2 vs Period 1, a larger proportion of questionnaires were submitted from Ontario (92.8%, 141/152 vs 75.1%, 702/937, P<.001), and a smaller proportion of same IP addresses (7.9%, 12/152 vs 47.1%, 441/937, P<.001) were received. Compared to those who made unique submissions, those who made multiple submissions spent less time per questionnaire (166 vs 215 seconds, P<.001), and had a higher percentage of missing data among their responses (15.0% vs 7.6%, P=.004). Advertisements posted on RedFlagDeals were the most efficient for recruitment (0.03 hours of staff time per questionnaire), whereas those placed on Twitter were the least efficient (3.64 hours of staff time per questionnaire).

Conclusions

Using multiple online advertising strategies was effective for recruiting a large sample of participants in a relatively short period time with minimal resources. However, risks such as multiple submissions and potentially fraudulent information need to be considered. In our study, these problems were associated with providing an incentive for responding, and could have been partially avoided by activating restrictive software features for online questionnaires.