Internal and External Validity of Social Media and Mobile Technology-Driven HPV Vaccination Interventions: Systematic Review Using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) Framework

Social Media as an Effective Provider of Quality-Assured and Accurate Information to Increase Vaccine Rates: Systematic Review

BACKGROUND

Vaccination programs are instrumental in prolonging and improving people's lives by preventing diseases such as measles, diphtheria, tetanus, pertussis, and influenza from escalating into fatal epidemics. Despite the significant impact of these programs, a substantial number of individuals, including 20 million infants annually, lack sufficient access to vaccines. Therefore, it is imperative to raise awareness about vaccination programs.

OBJECTIVE

This study aims to investigate the potential utilization of social media, assessing its scalability and robustness in delivering accurate and reliable information to individuals who are contemplating vaccination decisions for themselves or on behalf of their children.

METHODS

The protocol for this review is registered in PROSPERO (identifier CRD42022304229) and is being carried out in compliance with the Cochrane Handbook for Systematic Reviews of Interventions. Comprehensive searches have been conducted in databases including MEDLINE, Embase, PsycINFO, CINAHL (Cumulative Index to Nursing and Allied Health), CENTRAL (Cochrane Central Register of Controlled Trials), and Google Scholar. Only randomized controlled trials (RCTs) were deemed eligible for inclusion in this study. The target population encompasses the general public, including adults, children, and adolescents. The defined interventions comprise platforms facilitating 2-way communication for sharing information. These interventions were compared against traditional interventions and teaching methods, referred to as the control group. The outcomes assessed in the included studies encompassed days unvaccinated, vaccine acceptance, and the uptake of vaccines compared with baseline. The studies underwent a risk-of-bias assessment utilizing the Cochrane Risk-of-Bias tool for RCTs, and the certainty of evidence was evaluated using the GRADE (Grading of Recommendations Assessment, Development, and Evaluation) assessment.

RESULTS

This review included 10 studies, detailed in 12 articles published between 2012 and 2022, conducted in the United States, China, Jordan, Australia, and Israel. The studies involved platforms such as Facebook, Twitter, WhatsApp, and non-general-purpose social media. The outcomes examined in these studies focused on the uptake of vaccines compared with baseline, vaccine acceptance, and the number of days individuals remained unvaccinated. The overall sample size for this review was 26,286, with individual studies ranging from 58 to 21,592 participants. The effect direction plot derived from articles of good and fair quality indicated a nonsignificant outcome (P=.12).

CONCLUSIONS

The findings suggest that, in a real-world scenario, an equal number of positive and negative results may be expected due to the interventions' impact on the acceptance and uptake of vaccines. Nevertheless, there is a rationale for accumulating experience to optimize the use of social media with the aim of enhancing vaccination rates. Social media can serve as a tool with the potential to disseminate information and boost vaccination rates within a population. However, relying solely on social media is not sufficient, given the complex structures at play in vaccine acceptance. Effectiveness hinges on various factors working in tandem. It is crucial that authorized personnel closely monitor and moderate discussions on social media to ensure responsible and accurate information dissemination.

Optimising the implementation of digital-supported interventions for the secondary prevention of heart disease: a systematic review using the RE-AIM planning and evaluation framework

BACKGROUND

mHealth technologies are now widely utilised to support the delivery of secondary prevention programs in heart disease. Interventions with mHealth included have shown a similar efficacy and safety to conventional programs with improvements in access and adherence. However, questions remain regarding the successful wider implementation of digital-supported programs. By applying the Reach-Effectiveness-Adoption-Implementation-Maintenance (RE-AIM) framework to a systematic review and meta-analysis, this review aims to evaluate the extent to which these programs report on RE-AIM dimensions and associated indicators.

METHODS

This review extends our previous systematic review and meta-analysis that investigated the effectiveness of digital-supported programs for patients with coronary artery disease. Citation searches were performed on the 27 studies of the systematic review to identify linked publications that reported data for RE-AIM dimensions. All included studies and, where relevant, any additional publications, were coded using an adapted RE-AIM extraction tool. Discrepant codes were discussed amongst reviewers to gain consensus. Data were analysed to assess reporting on indicators related to each of the RE-AIM dimensions, and average overall reporting rates for each dimension were calculated.

RESULTS

Searches found an additional nine publications. Across 36 publications that were linked to the 27 studies, 24 (89%) of the studies were interventions solely delivered at home. The average reporting rates for RE-AIM dimensions were highest for effectiveness (75%) and reach (67%), followed by adoption (54%), implementation (36%) and maintenance (11%). Eleven (46%) studies did not describe relevant characteristics of their participants or of staff involved in the intervention; most studies did not describe unanticipated consequences of the intervention; the ongoing cost of intervention implementation and maintenance; information on intervention fidelity; long-term follow-up outcomes, or program adaptation in other settings.

CONCLUSIONS

Through the application of the RE-AIM framework to a systematic review we found most studies failed to report on key indicators. Failing to report these indicators inhibits the ability to address the enablers and barriers required to achieve optimal intervention implementation in wider settings and populations. Future studies should consider alternative hybrid trial designs to enable reporting of implementation indicators to improve the translation of research evidence into routine practice, with special consideration given to the long-term sustainability of program effects as well as corresponding ongoing costs.

REGISTRATION

PROSPERO-CRD42022343030.

Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned

Introduction

The United States Veterans Health Administration (VHA) Office of Rural Health funds Enterprise-Wide Initiatives (system-wide initiatives) to spread promising practices to rural Veterans. The Office requires that evaluations of Enterprise-Wide Initiatives use the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. This presents a unique opportunity to understand the experience of using RE-AIM across a series of evaluations. The authors conducted a study to document the benefits and pitfalls of using RE-AIM, capture the variety of ways that the team captured the elements of RE-AIM, and develop recommendations for the future use of RE-AIM in evaluation.

Materials and methods

The authors first conducted a document review to capture pre-existing information about how RE-AIM was used. They subsequently facilitated two focus groups to gather more detailed information from team members who had used RE-AIM. Finally, they used member-checking throughout the writing process to ensure accurate data representation and interpretation and to gather additional feedback.

Results

Four themes emerged from the document review, focus groups, and member checking. RE-AIM: provides parameters and controls the evaluation scope, "buckets" are logical, plays well with other frameworks, and can foster collaboration or silo within a team. Challenges and attributes for each RE-AIM dimension were also described.

Discussion

Overall, participants reported both strengths and challenges to using RE-AIM as an evaluation framework. The overarching theme around the challenges with RE-AIM dimensions was the importance of context. Many of these benefits and challenges of using RE-AIM may not be unique to RE-AIM and would likely occur when using any prescribed framework. The participants reported on the RE-AIM domains in a variety of ways in their evaluation reports and were not always able capture data as originally planned. Recommendations included: start with an evaluation framework (or frameworks) and revisit it throughout the evaluation, consider applying RE-AIM PRISM (Practical Robust Implementation Framework) to gain a broader perspective, and intentionally integrate quantitative and qualitative team members, regardless of the framework used.

Do social media campaigns foster vaccination adherence? A systematic review of prior intervention-based campaigns on social media

The COVID-19 pandemic has demonstrated the importance of large-scale campaigns to facilitate vaccination adherence. Social media presents unique opportunities to reach broader audiences and reduces the costs of conducting national or global campaigns aimed at achieving herd immunity. Nonetheless, few studies have reviewed the effectiveness of prior social media campaigns for vaccination adherence, and several prior studies have shown that social media campaigns do not increase uptake rates. Hence, our objective is to conduct a systematic review to examine the effectiveness of social media campaigns and to identify the reasons for the mixed results of prior studies. Our methodology began with a search of seven databases, which resulted in the identification of 92 interventions conducted over digital media. Out of these 92 studies, only 15 adopted social media campaigns for immunization. We analyzed these 15 studies, along with a coding scheme we developed based on reviews of both health interventions and social media campaigns. Multiple coders, who were knowledgeable about social media campaigns and healthcare, analyzed the 15 cases and obtained an acceptable level of inter-coder reliability (> .80). The results from our systematic review show that only a few social media campaigns have succeeded in enhancing vaccination adherence. In addition, few campaigns have utilized known critical success factors of social media to induce vaccination adherence. Based on these findings, we discuss a set of research questions that informatics scholars should consider when identifying opportunities for using social media to resolve one of the most resilient challenges in public health. Finally, we conclude by discussing how the insights drawn from our systematic reviews contribute to advancing theories, such as social influence and the health belief model, into the realm of social media-based health interventions.

The impact of HPV vaccine narratives on social media: Testing narrative engagement theory with a diverse sample of young adults

Rates of human papillomavirus (HPV) infection are highest in young adults, who can be vaccinated against HPV if they were not vaccinated as adolescents. Since young adults increasingly access health information on social media, we tested the impact of a social media campaign with narrative-based health information on intentions related to HPV vaccination. We also aimed to understand which ads resonated most with young adults and led to higher survey completion rates. We created social media posts featuring videos promoting HPV vaccination. We launched a sponsored ad campaign on Facebook to reach young women, ages 18–26, across the country. Participants were randomly assigned one of 6 videos and then completed a brief survey about video engagement and intentions to: talk with a health care professional, talk with friends or family, and vaccinate against HPV. A descriptive correlational design and a test for moderation were used to explore hypothesized relationships. Across all ads, 1332 link clicks led to 991 completed surveys that were reduced to 607 surveys (95 % ages 18–26, 63 % non-Caucasian; 58 % sexually active). Higher video engagement was associated with stronger intentions to talk with a health care professional (r = 0.44, p =.01), talk with friends/family (r = 0.52, p =.01), and vaccinate against HPV (r = 0.43, p =.01). Young adults were receptive to watching narrative-based health information videos on social media. When promoting HPV vaccination, more engaging information leads to greater intentions to talk about the vaccine and get vaccinated.

Adaptation and Dissemination of a National Cancer Institute HPV Vaccine Evidence-Based Cancer Control Program to the Social Media Messaging Environment

Social media offers a unique opportunity to widely disseminate HPV vaccine messaging to reach youth and parents, given the information channel has become mainstream with 330 million monthly users in the United States and 4.2 billion users worldwide. Yet, a gap remains on how to adapt evidence-based vaccine interventions for the in vivo competitive social media messaging environment and what strategies to employ to make vaccine messages go viral. Push-pull and RE-AIM dissemination frameworks guided our adaptation of a National Cancer Institute video-based HPV vaccine cancer control program, the HPV Vaccine Decision Narratives, for the social media environment. We also aimed to understand how dissemination might differ across three platforms, namely Instagram, TikTok, and Twitter, to increase reach and engagement. Centering theory and a question-answer framework guided the adaptation process of segmenting vaccine decision story videos into shorter coherent segments for social media. Twelve strategies were implemented over 4 months to build a following and disseminate the intervention. The evaluation showed that all platforms increased following, but Instagram and TikTok outperformed Twitter on impressions, followers, engagement, and reach metrics. Although TikTok increased reach the most (unique accounts that viewed content), Instagram increased followers, engagement, and impressions the most. For Instagram, the top performer, six of 12 strategies contributed to increasing reach, including the use of videos, more than 11 hashtags, COVID-19 hashtags, mentions, and follow-for-follow strategies. This observational social media study identified dissemination strategies that significantly increased the reach of vaccine messages in a real-world competitive social media messaging environment. Engagement presented greater challenges. Results inform the planning and adaptation considerations necessary for transforming public health HPV vaccine interventions for social media environments, with unique considerations depending on the platform.

Social media-assisted interventions on human papillomavirus and vaccination-related knowledge, intention and behavior: a scoping review

Social media holds the potential to engage adolescents and young adults and to facilitate interventions improving Human Papillomavirus Vaccine (HPVV). This article systematically reviewed the literature on Cochrane Library, PubMed, Web of Science, EMBASE, Scopus and CINAHL. Interventions delivered or facilitated by social media with outcomes of HPV-related knowledge, awareness, attitude, vaccination intention and behavior were included. Standardized forms were used to abstract the basic characteristics, settings, guiding theories and key findings of the interventions. Twenty-four studies met the eligibility criteria. Sixteen were educational interventions, and the other eight investigated the effect of social media message contents on improving Human Papillomavirus (HPV)-related outcomes. The studies were published between 2015 and 2021. The most frequently used social media platforms were Facebook, and the most commonly adopted theory was the health belief model (HBM). Existing interventions have shown preliminary but promising effects in improving HPV awareness and knowledge. Still, such improvements have not always been translated to improved behavioral intentions and vaccination rates. The contents and phrasing of social media messages and pre-existing individual characteristics of social media users moderated intervention effectiveness. Social media could be a valuable tool for engaging participants and delivering HPV interventions. Future interventions should apply stronger theory bases.

Vacteens.org: A Mobile Web app to Improve HPV Vaccine Uptake

U.S. HPV vaccine uptake remains below the Healthy People 2030 goal of 80% series completion. Parental concerns and misinformation about the efficacy and safety of the Human Papillomavirus (HPV) vaccine remain, and may be addressed by digital interventions tailored to their concerns. Reported here are results from a small scale randomized trial testing a mobile web app for parents and their adolescent daughters (ages 11–14 years) encouraging HPV vaccination in New Mexico, an ethnically-diverse U.S. state.

Methods: A clinic-cluster randomized trial where pediatric clinics (n = 9) were recruited and randomized, and parent-adolescent pairs (n = 82) within clinics received either the Vacteens.org/Vacunadolescente.org mobile web app or Usual and Customary (UC) HPV Vaccination information. Parents completed online surveys at baseline and 3-months. Daughters' HPV vaccine data were collected from the New Mexico State Immunization Information System 1 year post baseline.

Results: Three month survey results found Vacteens.org/Vacunadolescente.org parents to have higher positive HPV vaccine beliefs, informed decision making, intent to vaccinate and vaccine confidence outcomes than UC parents. HPV vaccine data found higher first dose HPV vaccination (Pearson χ² = 6.13, p = 0.013, Vacteens.org/Vacunadolescente.org group 59.4%, UC group 40.6%), and higher HPV vaccination series completion (Pearson χ² = 6.49, p = 0.011, Vacteens.org/Vacunadolescente.org group 68.4%, UC group 31.6%).

Conclusions: The small trial results showed the Vacteens.org/Vacunadolescente.org web app prompted positive vaccine-related attitudes and beliefs, and more HPV vaccination initiation and series completion. Mobile web apps can make decision-making tools for HPV vaccination widely available on digital platforms, reducing vaccine hesitancy, and confusion and increase HPV vaccine uptake.