Improving immunization delivery using an electronic health record: the ImmProve project

Zero-shot learning to extract assessment criteria and medical services from the preventive healthcare guidelines using large language models

OBJECTIVES

The integration of these preventive guidelines with Electronic Health Records (EHRs) systems, coupled with the generation of personalized preventive care recommendations, holds significant potential for improving healthcare outcomes. Our study investigates the feasibility of using Large Language Models (LLMs) to automate the assessment criteria and risk factors from the guidelines for future analysis against medical records in EHR.

MATERIALS AND METHODS

We annotated the criteria, risk factors, and preventive medical services described in the adult guidelines published by United States Preventive Services Taskforce and evaluated 3 state-of-the-art LLMs on extracting information in these categories from the guidelines automatically.

RESULTS

We included 24 guidelines in this study. The LLMs can automate the extraction of all criteria, risk factors, and medical services from 9 guidelines. All 3 LLMs perform well on extracting information regarding the demographic criteria or risk factors. Some LLMs perform better on extracting the social determinants of health, family history, and preventive counseling services than the others.

DISCUSSION

While LLMs demonstrate the capability to handle lengthy preventive care guidelines, several challenges persist, including constraints related to the maximum length of input tokens and the tendency to generate content rather than adhering strictly to the original input. Moreover, the utilization of LLMs in real-world clinical settings necessitates careful ethical consideration. It is imperative that healthcare professionals meticulously validate the extracted information to mitigate biases, ensure completeness, and maintain accuracy.

CONCLUSION

We developed a data structure to store the annotated preventive guidelines and make it publicly available. Employing state-of-the-art LLMs to extract preventive care criteria, risk factors, and preventive care services paves the way for the future integration of these guidelines into the EHR.

Multilevel Implementation Strategies for Adolescent Human Papillomavirus Vaccine Uptake: A Cluster Randomized Clinical Trial

Importance

Despite availability of a safe and effective vaccine, an estimated 36 500 new cancers in the US result from human papillomavirus (HPV) annually. HPV vaccine uptake falls short of national public health goals and lags other adolescent vaccines.

Objective

To evaluate the individual and combined impact of 2 evidence-based interventions on HPV vaccination rates among 11- and 12-year-old children.

Design, Setting, and Participants

The study team conducted a cluster randomized clinical trial with a stepped-wedge factorial design at 6 primary care practices affiliated with Mayo Clinic in southeastern Minnesota. Using block randomization to ensure balance of patient volumes across interventions, each practice was allocated to a sequence of four 12-month steps with the initial baseline step followed by 2 intermediate steps (none, 1, or both interventions) and a final step wherein all practices implemented both interventions. Each month, all eligible children who turned 11 or 12 years in the 2 months prior were identified and followed until the end of the step. Data were analyzed from April 2018 through March 2019. Participants included children who turned 11 or 12 years old and were due for a dose of the HPV vaccine.

Interventions

Parents of eligible patients were mailed reminder/recalls following their child's birthdays. Health care professionals received confidential audit/feedback on their personal in-office success with HPV vaccine uptake via intra-campus mail. These 2 interventions were assessed separately and in combination.

Main Outcomes and Measures

Eligible patients' receipt of any valid dose of HPV vaccine during the study step.

Results

The cohort was comprised of 9242 11-year-olds (5165 [55.9%]) and 12-year-olds (4077 [44.1%]), and slightly more males (4848 [52.5%]). Parent reminder/recall resulted in 34.6% receiving a dose of HPV vaccine, health care professional audit/feedback, 30.4%, both interventions together resulted in 39.7%-all contrasted to usual care, 21.9%. Compared with usual care, the odds of HPV vaccination were higher for parent reminder/recall (odds ratio [OR], 1.56; 95% CI, 1.23-1.97) and for the combination of parent reminder/recall and health care professional audit/feedback (OR, 2.03; 95% CI, 1.44-2.85). Health care professional audit/feedback alone did not differ significantly from usual care (OR, 1.19; 95% CI, 0.94-1.51).

Conclusions and Relevance

In this cluster randomized trial, the combination of parent reminder/recall and health care professional audit/feedback increased the odds of HPV vaccination compared with usual care. These findings underscore the value of simultaneous implementation of evidence-based strategies to improve HPV vaccination.

Understanding Implementation of Evidence-Based Interventions to Address Human Papillomavirus Vaccination: Qualitative Perspectives of Middle Managers

Engaging individuals in middle management positions (eg, nurse or clinic managers) could facilitate implementation of evidence-based interventions (EBIs) to improve uptake of human papillomavirus (HPV) vaccination. Our goal was to understand middle managers' role in and perspectives on implementation of EBIs for HPV vaccination. We conducted qualitative interviews with middle managers in pediatric and family practice clinics. We used constructs from the Consolidated Framework for Implementation Research (CFIR) to design the interview guide and as a coding framework. Participants (n = 19) reported overseeing implementation related to HPV vaccination. Across interviews, CFIR inner setting constructs (eg, structural characteristics and implementation climate) were identified as being both barriers and facilitators. As evidenced in this study, middle managers have a deep understanding of organizational factors, and they have the ability to facilitate implementation efforts related to HPV vaccination. Future efforts could focus on engaging middle managers and leveraging their expertise and understanding of barriers and facilitators.

Resident Perceptions of Continuity Clinic Patient Metrics Differ From EHR Data: Pilot Use of Population Health Dashboards

BACKGROUND AND OBJECTIVES

Population health management (PHM) dashboards using electronic health record (EHR) data can teach trainees about the population they serve while also delivering data on their clinical practice. Yet, few studies have demonstrated their use. In this pilot study, we assessed baseline resident perceptions of population health metrics for continuity clinic panels by comparing resident estimates with EHR-reported values delivered by individualized PHM dashboards.

METHODS

A descriptive, comparative study was conducted at a primary continuity clinic site for pediatric residents in January 2018. Residents were surveyed about population health metrics for their patient panels, including demographics, utilization, and medical diagnoses. We compared resident estimates to corresponding EHR-reported values using 2-tailed paired t tests.

RESULTS

A total of 42 out of 55 eligible residents (76%) completed the survey. Compared with EHR-reported values, residents estimated higher percentages of emergency department utilization (22.1% vs 10.3%, P < .01) and morbidity, including medical complexity (15.6% vs 5.9%, P < .01), overweight (38.1% vs 11.7%, P < .01), obesity (20.5% vs 15.8%, P = .02), and asthma (34.6% vs 21.4%, P < .01).

CONCLUSIONS

In this pilot study of PHM dashboards, resident perceptions of continuity clinic population health metrics did not align with EHR data. Estimates were higher for measures of utilization and morbidity. PHM dashboards may help trainees better understand their patient populations and serve as a consistent source of objective practice data. However, further research and investment is needed to evaluate dashboard implementation and impact on trainee and patient outcomes.

Human Papillomavirus vaccination clinical decision support for young adults in an upper midwestern healthcare system: a clinic cluster-randomized control trial

INTRODUCTION

Human papillomavirus (HPV) vaccination rates are low in young adults. Clinical decision support (CDS) in primary care may increase HPV vaccination. We tested the treatment effect of algorithm-driven, web-based, and electronic health record-linked CDS with or without shared decision-making tools (SDMT) on HPV vaccination rates compared to usual care (UC).

METHODS

In a clinic cluster-randomized control trial conducted in a healthcare system serving a largely rural population, we randomized 34 primary care clinic clusters (with three clinics sharing clinicians randomized together) to: CDS; CDS+SDMT; UC. The sample included young adults aged 18-26 due for HPV vaccination with a study index visit from 08/01/2018-03/15/2019 in a study clinic. Generalized linear mixed models tested differences in HPV vaccination status 12 months after index visits by study arm.

RESULTS

Among 10,253 patients, 6,876 (65.2%) were due for HPV vaccination, and 5,054 met study eligibility criteria. In adjusted analyses, the HPV vaccination series was completed by 12 months in 2.3% (95% CI: 1.6%-3.2%) of CDS, 1.6% (95% CI: 1.1%-2.3%) of CDS+SDMT, and 2.2% (95% CI: 1.6%-3.0%) of UC patients, and at least one HPV vaccine was received by 12 months in 13.1% (95% CI: 10.6%-16.1%) of CDS, 9.2% (95% CI: 7.3%-11.6%) of CDS+SDMT, and 11.2% (95% CI: 9.1%-13.7%) of UC patients. Differences were not significant between arms. Females, those with prior HPV vaccinations, and those seen at urban clinics had significantly higher odds of HPV vaccination in adjusted models.

DISCUSSION

CDS may require optimization for young adults to significantly impact HPV vaccination.

TRIAL REGISTRATION

clinicaltrials.gov NCT02986230, 12/6/2016.

Healthcare providers' practice protocols, strategies, and needed tools to address parental HPV vaccine hesitancy: An exploratory study

Parental hesitancy related to human papillomavirus (HPV) vaccines has increased during the pandemic, and there is a call to action by the National HPV Vaccination Roundtable to improve vaccination rates. While there are evidence-based strategies available to address parental hesitancy, there are few clear guidelines on how to engage parents to build confidence in the HPV vaccine within the clinical settings. The purpose of this investigation is to explore practice protocols, individual provider strategies, and perceived tools needed to address HPV vaccine hesitant parents from the perspective of providers during the COVID-19 pandemic in the United States. Fifteen healthcare providers participated in qualitative, semi-structured interviews between May 2021 and March 2022. An inductive, qualitative content analysis approach was used to analyze the data. Five themes were described: 1) Provider experiences engaging with HPV vaccine hesitant parents; 2) Existing protocols in the clinics to address HPV vaccine hesitant parents; 3) Strategies used by providers to address parental HPV vaccine hesitancy; 4) Sample message content used by providers to address parental HPV vaccine concerns; and 5) Perceived strategies and tools needed to address parental vaccine hesitancy. Recommendations to address parental hesitancy include recommending HPV vaccinationat 9  years, using a strong recommendation and continued discussion, applying evidence-based approaches and/or promising strategies, linking parents to credible outside sources, and ongoing follow-up if delayed or declined. These findings can be used by researchers and clinicians to improve strategies and messages to inform the development of a protocol to standardize encounters and communication for patient-parent-provider encounters that can influence parental decision-making around HPV vaccine uptake.

Impact assessment of a provider-targeted national vaccine messaging campaign on human papillomavirus vaccination rates among US adolescent males

Initial uptake of the cancer-preventative human papillomavirus (HPV) vaccine in the US was slow, especially among adolescent males. To address this, the US Centers for Disease Control and Prevention (CDC) partnered with the Hager Sharp communications development company to launch a national campaign in 2015 to improve physician counseling and rebrand the vaccine as cancer prevention. In this study, we compared HPV vaccination rates among 13-17-year-old males before (2010-2014) and after (2015-2019) the CDC-Hager Sharp campaign using National Immunization Survey-Teen data to determine the potential impact of this campaign on improving vaccine uptake among adolescent males. Employing provider-verified vaccination data available for 49,644 males from 2010 to 2014 and 47,943 males from 2015 to 2019, we found that the adjusted prevalence ratios of 13-17-year-old males who initiated and completed the vaccine series increased approximately 5-fold between the 2010-2014 and 2015-2019 periods. Increases in post-campaign initiation/completion rates were greatest among respondents with mothers who were married or had attended college, respondents who lived in the Northeast or Midwest, and those from households with annual incomes > $75,000. Together, these data suggest that the campaign contributed to the observed increase in HPV vaccine uptake among adolescent males. Although sociodemographic disparities were identified, the greater improvement in vaccination rates observed among individuals with higher socio-demographic status may simply reflect their relatively poorer rates of initial vaccine uptake. Overall, the data suggest that provider-targeted campaigns can be a useful tool to boost vaccinations and should be considered for inclusion in future vaccination campaigns.

Interventions to Improve Immunization Coverage Among Children and Adolescents: A Meta-analysis

BACKGROUND AND OBJECTIVES

Vaccinations are recognized as a feasible, cost-effective public health intervention for reducing the burden and associated mortality of many infectious diseases. The purpose of this study was to evaluate the effectiveness of potential interventions to improve the uptake of vaccines among children and adolescents.

METHODS

We performed a literature search until December 2020. Eligible studies were identified using Cochrane Central Register of Controlled Trials, MEDLINE, PubMed, and other sources. We included studies conducted on children and adolescents aged 5 to 19 years. Studies comprised of hospitalized children and those with comorbid conditions were excluded. Two authors independently performed the meta-analysis.

RESULTS

Findings from 120 studies (123 articles), of which 95 were meta-analyzed, reveal that vaccination education may increase overall vaccination coverage by 19% (risk ratio [RR], 1.19; 95% confidence interval [CI], 1.12-1.26), reminders by 15% (RR, 1.15; 95% CI, 1.11-1.18), interventions for providers by 13% (RR, 1.13; 95% CI, 1.07-1.19), financial incentives by 67% (RR, 1.67; 95% CI, 1.40-1.99), and multilevel interventions by 25% (RR, 1.25; 95% CI, 1.10-1.41). The impact of school-based clinics and policy and legislation on overall vaccination coverage is still uncertain, and no impact of a multicomponent intervention on overall vaccination coverage was found.

CONCLUSIONS

Educational interventions, reminders, provider-directed interventions, financial incentives, and multilevel interventions may improve vaccination coverage among school-aged children and adolescents.

Incomplete Records as a Leading Cause of Missed Opportunity for Human Papillomavirus Vaccine Initiation in a Safety Net Health System

OBJECTIVE

The goal of this study was to categorize reasons behind missed opportunities for human papillomavirus (HPV) vaccine initiation in an under-resourced population and to identify associated patient and clinic characteristics.

METHODS

Manual chart review was performed for patients aged 11 to 18 years who visited a primary care clinic in a health system in Texas, USA between 06/01/18 and 08/31/18 and were due for an initial HPV vaccine dose but did not receive it. Reasons for HPV vaccine noninitiation were categorized as follows: incomplete immunization record, no documentation of discussion (no documentation that the HPV vaccine was offered or ordered), refusal, staff/provider error, and medical. Multinomial logistic regression was used to examine factors associated with each category.

RESULTS

Of 4467 adolescents seen in the study period, 575 (12.9%) were due for the first dose of HPV vaccine but did not receive it. The most common reason for noninitiation was incomplete immunization record (37%), followed by no documentation of discussion (24%), refusal (20%), staff/provider error (15%), and medical (4%). The highest odds of incomplete immunization were among older adolescents. The highest odds of no documentation of discussion were during sick visits. The highest odds of staff/provider error were among patients with commercial insurance. The lowest odds of refusal were in patients with county/indigent insurance.

CONCLUSIONS

The most common reason for missed opportunity visits for HPV vaccine initiation was lack of adequate immunization records. Our study highlights the importance of immunization record access and bidirectional reporting as important targets for future interventions.

Increasing HPV Vaccination Uptake among Adolescents: A Systematic Review

Human Papillomavirus (HPV) vaccination is a well-known fundamental strategy in the prevention of cervical cancer, as it is always caused by HPV infection. In fact, primary prevention of the infection corresponds to primary prevention of HPV-related cancers and other diseases. Since an effective prevention at the population level is the final goal, it is mandatory for healthcare systems to achieve a high HPV vaccination coverage among the adolescents to reduce the circulation of the virus and the burden of HPV-related diseases. This research identified, through a systematic literature review, 38 papers on strategies adopted to increase HPV vaccination coverage among adolescents. The evaluated strategies targeted adolescents/parents and/or healthcare providers and could be grouped in three main types: (1) reminder-based, (2) education, information, and communication activities, and (3) multicomponent strategies. Several types of strategy, such as those relied only on reminders and integrating different interventions, showed a positive impact on vaccination coverage. Nonetheless, the heterogeneity of the interventions suggests the importance to adapt such strategies to the specific national/local contexts to maximize vaccination coverage.

Factors influencing rates of human papillomavirus vaccination

Purpose

Failure modes and effects analysis (FMEA) was used to identify ways in which community clinic practices related to suboptimal human papillomavirus (HPV) vaccination rates could be improved.

Method

FMEA is a standardized safety method that helps determine where processes fail, the impact of failures, and needed process changes. In a quality improvement initiative conducted at an academic health center–based community clinic, a multidisciplinary team used FMEA to map HPV vaccination processes and identify areas for improvement of vaccination practices. Risk priority numbers (RPNs) were assigned to identified failure modes based on likelihood of occurrence, likelihood of detection, and ability to correct locally. Failure modes with the highest RPNs were targeted for process improvements.

Results

High RPN failure modes were related to clinic processes for follow-up, immunization status checks during well-child visits, and vaccination discussions during sick-child visits. New procedures included scheduling follow-up vaccinations and reminders during the initial vaccination appointment. HPV immunization rates improved following implementation of these procedures, indicating that clinic processes focused on patient follow-up can impact vaccination series completion.

Conclusion

FMEA processes can help health systems identify workflow barriers and locally relevant opportunities for improvement. Team-based approaches to care process improvements can also benefit from standardized problem identification and solving.

Longitudinal Evaluation of Clinical Decision Support to Improve Influenza Vaccine Uptake in an Integrated Pediatric Health Care Delivery System, Houston, Texas

OBJECTIVE

Our study retrospectively evaluated the implementation of an influenza vaccine best practice alert (BPA) in an electronic medical record within an integrated pediatric health care delivery system.

METHODS

An influenza BPA was implemented throughout a large pediatric health care delivery system in Houston, TX, to improve vaccine uptake. Outcomes were measured retrospectively over 3 years of BPA implementation and compared with a control year prior to BPA implementation. Primary outcomes were influenza vaccine uptake, distribution of influenza vaccines ordered by week, proportion of BPA displays ignored, and missed vaccination opportunities.

RESULTS

Influenza vaccine uptake declined from the pre-BPA year (47.2%; 95% confidence interval [CI]: 47.0, 47.4) to the last study year (45.1%; 95% CI: 44.9, 45.2). BPA displays were increasingly ignored by clinical staff throughout the study years from 59.6% in 2014-2015 to 72.5% in 2016-2017. For providers, BPA displays were ignored less frequently each year from 53.4% in 2014-2015 to 51.4% in 2017-2017. Within the primary care outpatient group, the proportion of missed vaccination opportunities in sick visits decreased from 86.8% during the pre-BPA year to 81.0, 79.8, and 82.7% during the subsequent study years 2014-2015, 2015-2016, and 2016-2017, respectively.

CONCLUSION

Implementation of a widespread influenza BPA in an integrated pediatric health care delivery system did not produce meaningful increases in influenza vaccine uptake. Differences between clinical staff and providers on BPA use warrant further investigation.

Age-Dependent Hemoglobin A1c Therapeutic Targets Reduce Diabetic Medication Changes in the Elderly

OBJECTIVE

To assess whether implementation of age-dependent therapeutic targets for high hemoglobin A1c (HbA1c) changed clinicians' ordering of diabetes medications for older adults.

BACKGROUND

In 2016, Kaiser Permanente Southern California (KPSC) changed the therapeutic targets for alerting clinicians about high HbA1c results in the electronic health record, KP HealthConnect (KPHC). Previously, all HbA1c results ≥7.0 percent were flagged as high in adult patients with diabetes. Starting in 2016, HbA1c therapeutic targets were relaxed to <7.5 percent for patients age 65 to 75, and to <8.0 percent for patients over age 75 to reduce treatment intensity and adverse events.

METHODS

This retrospective analysis used logistic regression models to calculate the change in odds of a medication change following an HbA1c result after age-dependent HbA1c flags were introduced.

RESULTS

The odds of medication change decreased among patients whose HbA1c targets were relaxed: Odds Ratio (OR) 0.72 (95 percent CI 0.67-0.76) for patients age 65-75 and HbA1c 7.0 percent-7.5 percent; OR 0.72 (95 percent CI 0.65-0.80) for patients over age 75 and HbA1c 7.0 percent-7.5 percent; and OR 0.67 (95 percent CI 0.61-0.75) for patients over age 75 and HbA1c 7.5 percent-8.0 percent. In the age and HbA1c ranges for which the alerts did not change, the odds of medication change generally increased or stayed the same. There was little evidence of medication de-intensification in any group.

CONCLUSIONS

These findings suggest that the change in therapeutic targets was associated with a reduction in medication intensification among older adults with diabetes.

Pediatric Hospitalizations: Are We Missing an Opportunity to Immunize?

OBJECTIVES

Fewer than half of children receive all recommended immunizations on time. Hospitalizations may be opportunities to address delayed immunizations. Our objectives were to assess (1) prevalence of delayed immunizations among hospitalized patients, (2) missed opportunities to administer delayed immunizations, and (3) time to catch up after discharge.

METHODS

We conducted a retrospective cohort study investigating immunization status of patients 0 to 21 years of age admitted to an academic children's center from 2012 to 2013 at the time of admission, at discharge, and 18 months postdischarge. Immunization catch-up at 18 months postdischarge was defined as having received immunizations due on discharge per Centers for Disease Control and Prevention recommendations. χ² and t test analyses compared characteristics among patients caught up and not caught up at 18 months postdischarge. Analysis of variance and logistic regression analyses compared mean number of immunizations needed and odds of immunization catch-up among age groups. Kaplan-Meier and Cox proportional hazards analyses compared catch-up time by age, race, sex, and insurance.

RESULTS

Among 166 hospitalized patients, 80 were not up to date on immunizations at admission, and only 1 received catch-up immunizations before discharge. Ninety-nine percent (79 of 80) were not up to date on discharge per Centers for Disease Control and Prevention recommendations. Thirty percent (24 of 79), mostly adolescents, were not caught up at 18 months postdischarge. Median postdischarge catch-up time was 3.5 months (range: 0.03-18.0 months). Patients 0 to 35 months of age were more likely to catch up compared with those of other ages (hazard ratio = 2.73; P = .001), with no differences seen when comparing race, sex, or insurance.

CONCLUSIONS

Pediatric hospitalizations provide important opportunities to screen and immunize children.

Trends in Use of Electronic Health Records in Pediatric Office Settings

OBJECTIVES

To determine the prevalence and functionalities of electronic health records (EHRs) and pediatricians' perceptions of EHRs.

STUDY DESIGN

An 8-page self-administered questionnaire sent to 1619 randomly selected nonretired US American Academy of Pediatrics members in 2016 was completed by 709 (43.8%). Responses were compared with surveys in 2009 and 2012.

RESULTS

The percent of pediatricians who were using EHRs increased from 58% in 2009 and 79% in 2012 to 94% in 2016. Those with fully functional EHRs, including pediatric functionality, more than doubled from 8.2% in 2012 to 16.9% in 2016 (P = .01). Fully functional EHRs lacking pediatric functionality increased slightly from 7.8% to 11.1% (P = .3), and the percentage of pediatricians with basic EHRs remained stable (30.4% to 31.0%; P < .3). The percentage of pediatricians who lacked basic EHR functionality or who reported no EHR decreased (from 53.6% to 41.0%; P < .001). On average, pediatricians spent 3.4 hours per day documenting care.

CONCLUSIONS

Although the adoption of EHRs has increased, >80% of pediatricians are working with EHRs that lack optimal functionality and 41% of pediatricians are not using EHRs with even basic functionality. EHRs lacking pediatric functionality impact the health of children through increased medical errors, missed diagnoses, lack of adherence to guidelines, and reduced availability of child-specific information. The pediatric certification outlined in the 21st Century Cures Act may result in improved EHR products for pediatricians.

Implementation of Strategies to Improve Human Papillomavirus Vaccine Coverage: A Provider Survey

INTRODUCTION

Human papillomavirus (HPV) vaccine coverage in the U.S. is persistently suboptimal, despite research describing barriers to vaccination and strategies to increase vaccination coverage. The objective was to assess providers' approach to the HPV vaccine and their implementation of strategies to increase HPV vaccination coverage. The hypothesis was that adoption of improvement measures to address underuse of the HPV vaccine has not occurred.

METHODS

Community pediatric providers from two Midwestern practice-based research networks completed self-administered electronic surveys. Data were collected over 6 months in 2015 and organized and analyzed in 2016.

RESULTS

There were 100 providers that participated. Despite agreement with national recommendations, some providers delayed their recommendation until the adolescent was older and many reported missed vaccination opportunities. Many providers experienced parental concerns including safety of the HPV vaccine, belief their child was not at risk of HPV infection, and their child's resistance to receiving multiple shots. Providers identified the following as barriers to adherence to Advisory Committee on Immunization Practices guidelines: bad publicity of the HPV vaccine, information about the HPV vaccine on the web, and a lack of a follow-up system for those who delayed HPV vaccine initiation. Approximately half of the participants had implemented strategies to address these barriers beyond offering immunization-only appointments.

CONCLUSIONS

Participants were aware of barriers to HPV vaccine use, but many had not adopted a systematic approach to increase vaccine coverage. A better understanding of the challenges facing providers to adopting improvement measures and a strategy to address barriers to implementation are needed to improve HPV coverage.

Evaluating the impact of multilevel evidence-based implementation strategies to enhance provider recommendation on human papillomavirus vaccination rates among an empaneled primary care patient population: a study protocol for a stepped-wedge cluster randomized trial

Background

Each year, human papillomavirus (HPV) causes 30,000 cancers in the USA despite the availability of effective and safe vaccines. Uptake of HPV vaccine has been low and lags behind other adolescent vaccines. This protocol describes a multilevel intervention to improve HPV vaccination rates.

Methods

Using a cluster randomized trial, we will evaluate the independent and combined impact of two evidence-based implementation strategies with innovative enhancements on HPV vaccination rates for female and male patients. The clusters are six primary care sites providing care to pediatric populations. We will use a stepped-wedge cluster randomized design, including process evaluation, to test the hypothesis that compared with the current course of care and a practice-level intervention using reminder-recall interventions coupled with provider-level audit and feedback with education increases HPV vaccination rates in exposed clusters. The factorial design allows us to use a single trial to test these two interventions and to assess each individually and in combination. Our design has four 12-month steps. The first step will be a baseline period; data collected during it will provide a within-practice control group for each cluster. Second, two clusters will be randomly assigned to receive intervention 1 (reminder and recall), and two clusters will be randomly selected to receive intervention 2 (audit and feedback with education). Third, the other two clusters will be randomly allocated to intervention 1 or 2. Clusters initially with intervention 1 will be randomly allocated to 1 + 2 or 1; clusters initially with intervention 2 will be randomly allocated to 1 + 2 or 2. Fourth, all clusters will receive both interventions. To ensure balance of patient numbers across interventions, we will use block randomization at the first step, with the six clusters grouped into three pairs according to volume. Our primary outcome will be vaccination rates.

Discussion

Results of our clinical trial and process evaluation will provide evidence showing whether practice- and provider-level interventions improve HPV vaccination rates and will offer insight into contextual factors associated with direction and magnitude of trial outcomes.

Trial registration

ClinicalTrials.gov, NCT03501992, registered April 18, 2018.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0778-x) contains supplementary material, which is available to authorized users.

Impact of a clinical interventions bundle on uptake of HPV vaccine at an OB/GYN clinic

INTRODUCTION

HPV vaccine uptake is lowest among young adults. Little is known about the most effective way to decrease missed opportunities (MO) and increase uptake of the vaccine in this vulnerable population.

OBJECTIVES

To determine the impact of a clinical intervention bundle on the rate of MO and uptake of the vaccine among young adult women.

METHODS

From 2/2014 to 7/2015, an intervention bundle (designating physician and nurse champions, pre-screening patients' charts, empowering nurses to recommend immunization, providing no-cost vaccinations, placing prompts in clinic note templates, eliminating requirement for pre-vaccination pregnancy test) was implemented at an urban, hospital-based OB/GYN clinic. Medical records were reviewed for all vaccine-eligible (non-pregnant, 11-26 years) women seen between 2/2013 and 9/2016. Impact of the bundled interventions on the monthly rates of MO and vaccine uptake was estimated by analyzing immunization trends with an interrupted time-series model using counterfactual comparison groups in order to control for pre-existing trends.

RESULTS

There were 6,463 vaccine-eligible visits during our study period. The prevalence of women who had both completed and initiated the series was significantly higher, 20.3% and 29.7% respectively, in the last month, compared to their counterfactuals (p < 0.01). In the last study month, the rate of MO was significantly lower than its counterfactual (19.73 per 100 encounters lower, p < 0.01). Hispanic women had attributable reductions in their rates of MO that were twice that of White women. Statistically significant attributable reductions were also seen among Spanish speakers, publicly insured, and uninsured women.

CONCLUSIONS

Implementation of this intervention bundle effectively reduced the monthly rate of MO and increased the prevalence of women who had initiated and completed the HPV vaccine series. The reduction of MO was most drastic among Hispanic, publicly insured and uninsured women compared to White and privately insured.

Simple and Elaborated Clinician Reminder Prompts for Human Papillomavirus Vaccination: A Randomized Clinical Trial

OBJECTIVE

To evaluate the effects of simple and elaborated health care provider (HCP) reminder prompts on human papillomavirus (HPV) vaccine initiation rates.

METHODS

Twenty-nine pediatric HCPs serving 5 pediatric clinics were randomized to 1 of 3 arms: 1) usual practice control, 2) simple reminder prompt, and 3) elaborated reminder prompt, which included suggested language for recommending the early adolescent platform vaccines. Prompts were delivered via a computer-based clinical decision support system deployed in the 5 clinics. Eligible patients were ages 11 to 13 years, had not received HPV vaccine, and were due for meningococcal ACWY (MenACWY) vaccine and/or the tetanus, diphtheria, and pertussis booster (Tdap). Receipt of HPV vaccine was determined via automated queries sent to the Indiana immunization registry. Data were analyzed via logistic regression models, with generalized estimating equations used to account for the clustering of patients within HCPs.

RESULTS

Ten HCPs in the control group saw 301 patients, 8 HCPs in the simple prompt group saw 124, and 11 HCPs in the elaborated prompt group saw 223. The elaborated prompt arm had a higher rate of HPV vaccination (62%) than the control arm (45%): adjusted odds ratio, 2.76; 95% confidence interval, 1.07 to 7.14. The simple prompt arm did not differ significantly from the control arm with respect to HPV vaccine initiation, which might have been because of the small sample size for this arm. MenACWY and Tdap rates did not vary across the 3 arms.

CONCLUSIONS

Results suggest that an elaborated HCP-targeted reminder prompt, with suggested recommendation language, might improve rates of HPV vaccine initiation.

Electronic Immunization Alerts and Spillover Effects on Other Preventive Care

The impact of electronic health record (EHR) immunization clinical alert systems on the delivery of other preventive services remains unknown. We assessed for spillover effects of an EHR immunization alert on delivery of 6 other preventive services, in children 18 to 30 months of age needing immunizations. We conducted a secondary data analysis, with additional primary data collection, of a randomized, historically controlled trial to improve immunization rates with EHR alerts, in an urban, primary care clinic. No significant differences were found in screening for anemia, lead, development, nutrition, and injury prevention counseling in children prompting EHR immunization alerts (n = 129), compared with controls (n = 135). Significant increases in oral health screening in patients prompting EHR alerts (odds ratio = 4.8, 95% CI = 1.8-13.0) were likely due to practice changes over time. An EHR clinical alert system targeting immunizations did not have a spillover effect on the delivery of other preventive services.

Pharmacist impact on pediatric vaccination errors and missed opportunities in the setting of clinical decision support

OBJECTIVE

To determine pharmacist impact on vaccination errors and missed opportunities in the pediatric primary care setting with the presence of clinical decision support (CDS) by comparing a clinic with a pharmacist and CDS to a clinic with CDS alone.

DESIGN

A retrospective chart review of patients' electronic medical records compared vaccination errors and missed opportunities between 2 pediatric primary care clinics.

SETTING

Two urban, pediatric primary care clinics were selected for the study.

PARTICIPANTS

Encounters were included in the analysis for children presenting for any visit over a 3-month period.

INTERVENTION

The intervention clinic had a full-time clinical pharmacist and CDS. The comparison clinic had CDS alone.

MAIN OUTCOME MEASURES

Vaccination errors were defined as follows: doses administered before minimum recommended age, doses administered before minimum recommended dosing interval, unnecessary doses, and invalid doses for a combination of these reasons. Missed opportunities were defined as vaccine doses due at the date of encounter but not administered, without documented reason for vaccination delay or refusal by provider or patient. The likelihood of missing an opportunity was also assessed for patient age, visit type, and provider type.

RESULTS

One thousand and twenty patient encounters were randomly selected and reviewed. The vaccination error rate was 0.4% in the comparison group and 0% in the intervention group (P = 0.4995). The number of encounters with a missed opportunity was significantly higher in the comparison group compared with the intervention group (51 vs. 30 encounters with missed opportunities; P = 0.015; adjusted odds ratio, 2.14 [95% CI 1.3-35]).

CONCLUSION

Although the use of CDS results in a low rate of vaccination errors, technology cannot be solely relied on for vaccination recommendations in the pediatric population because of the rigidity of CDS configuration. Pharmacists continue to play a vital role to ensure that children are appropriately vaccinated in the primary care setting.

'First 1000 days' health interventions in low- and middle-income countries: alignment of South African policies with high-quality evidence

BACKGROUND

In South Africa (SA), despite adoption of international strategies and approaches, maternal, neonatal and child (MNC) morbidity and mortality rates have not sufficiently declined.

OBJECTIVES

To conduct an umbrella review (UR) that identifies interventions in low- and middle-income countries, with a high-quality evidence base, that improve MNC morbidity and mortality outcomes within the first 1000 days of life; and to assess the incorporation of the evidence into local strategies, guidelines and documents.

METHODS

We included publications about women and children in the first 1000 days of life; healthcare professionals and community members. Comparators were those who did not receive the intervention. Interventions were pharmacological and non-pharmacological. Outcomes were MNC morbidity and mortality. Authors conducted English language electronic and manual searches (2000-2013). The quality of systematic reviews and meta-analyses (SRs/MAs) were reviewed. Interventions were ranked according to level of evidence; and then aligned with SA strategies, policies and guidelines. A tool to extract data was developed and used by two authors who independently extracted data. Summary measures from MAs or summaries of SRs were reviewed and the specificities of the various interventions listed. A search of all local high-level documents was done and these were assessed to determine the specificities of the recommendations and their alignment to the evidence.

RESULTS

In total, 19 interventions presented in 32 SRs were identified. Overall, SA's policymakers have sufficiently included high-quality evidence-based interventions into local policies. However, optimal period of birth spacing (two to five years) is not explicitly promoted nor was ante- and postnatal depression adequately incorporated. Antenatal care visits should be increased from four to about eight according to the evidence.

CONCLUSION

Incorporation of existing evidence into policies can be strengthened in SA. The UR methods are useful to inform policymaking and identify research gaps. RESPONSIBLE EDITOR Nawi Ng, Umeå University, Sweden.

Effectiveness of a smartphone app on improving immunization of children in rural Sichuan Province, China: a cluster randomized controlled trial

Background

The aim of this study was to assess the effectiveness of an EPI smartphone application (EPI app) on improving vaccination coverage in rural Sichuan Province, China.

Methods

This matched-pair cluster randomized controlled study included 32 village doctors, matched in 16 pairs, and took place from 2013 to 2015. Village doctors in the intervention group used the EPI app and reminder text messages while village doctors in the control group used their usual procedures and text messages. The primary outcome was full vaccination coverage with all five vaccines (1 dose of BCG, 3 doses of hepatitis B, 3 doses of OPV, 3 doses of DPT and 1 dose of measles vaccine), and the secondary outcome was coverage with each dose of the five individual vaccines. We also conducted qualitative interviews with village doctors to understand perceptions on using the EPI app and how this changed their vaccination work.

Results

The full vaccination coverage increased statistically significant from baseline to end-line in both the intervention (67 % [95 % CI:58-75 %] to 84 % [95 % CI:76-90 %], P = 0.028) and control group (71 % [95 % CI:62-79 %] to 82 % [95 % CI:74-88 %], P = 0.014). The intervention group had higher increase in full vaccination coverage from baseline to end-line compared to the control group (17 % vs 10 %), but this was not statistically significant (P = 0.164). Village doctors found it more convenient to use the EPI app to manage child vaccination and also reported saving time by looking up information of caregivers and contacting caregivers for overdue vaccinations quicker. However, village doctors found it hard to manage children who migrated out of the counties.

Conclusions

This study showed that an app and text messages can be used by village doctors to improve full vaccination coverage, though no significant increase in vaccination coverage was found when assessing the effect of the app on its own. Village doctors using EPI app reported having improved their working efficiency of managing childhood vaccination. Future studies should be conducted to evaluate the impact of more integrated approach of mHealth intervention on child immunization.

Trial registration

Chinese Clinical Trials Registry (ChiCTR): ChiCTR-TRC-13003960, registered on December 6, 2013.

Electronic supplementary material

The online version of this article (doi:10.1186/s12889-016-3549-0) contains supplementary material, which is available to authorized users.

Interventions to Improve HPV Vaccine Uptake: A Systematic Review

CONTEXT

The human papillomavirus (HPV) vaccine is a safe, effective cancer prevention method that is underutilized in the United States. Despite increased understanding of barriers to vaccination, rates remain low. Globally, developed and developing nations have achieved high rates of vaccination.

OBJECTIVE

Identification of effective strategies is necessary to optimize uptake of the HPV vaccine. We systematically reviewed the literature for national and international interventions that have successfully increased HPV vaccine uptake.

DATA SOURCES

We used a standardized protocol to search for articles published between January 1, 2006, and April 30, 2015, in 3 electronic databases: PubMed, Scopus, and Embase.

STUDY SELECTION

We identified interventions designed to increase HPV vaccine uptake among adolescents and young adults aged 11 to 26 years. All study designs were acceptable. Only articles that included postintervention vaccination rates were included.

DATA EXTRACTION

Two authors independently reviewed each article for data extraction and quality assessment. Interventions were classified according to the Community Preventive Service Task Force guide.

RESULTS

Results were reported according to the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. Fifty-one articles met eligibility criteria: 2 informational interventions, 18 behavioral interventions, and 31 environmental interventions. Factors associated with HPV vaccine uptake were increased vaccine availability, decreased financial barriers, and interventions targeting both providers and patients.

LIMITATIONS

Lack of consistent RE-AIM metric reporting, limiting our ability to assess intervention validity and quality.

CONCLUSIONS

Population-based vaccination strategies that increased vaccine availability reached the greatest number of adolescents and were most successful in achieving high rates of vaccination.

Electronic Health Record-Enabled Research in Children Using the Electronic Health Record for Clinical Discovery

Initially described more than 50 years ago, electronic health records (EHRs) are now becoming ubiquitous throughout pediatric health care settings. The confluence of increased EHR implementation and the exponential growth of digital data within them, the development of clinical informatics tools and techniques, and the growing workforce of experienced EHR users presents new opportunities to use EHRs to augment clinical discovery and improve pediatric patient care. This article reviews the basic concepts surrounding EHR-enabled research and clinical discovery, including the types and fidelity of EHR data elements, EHR data validation/corroboration, and the steps involved in analytical interrogation.

HPV vaccination: Population approaches for improving rates

OBJECTIVE

To review the literature on interventions to increase HPV vaccinations and assess whether The Community Preventive Services Task Force recommendations are supported by current evidence.

METHODS

We used a PubMed search to identify studies that assessed interventions that looked at provider assessment and feedback, provider reminders, client reminder and recall, and clinic based education programs.

RESULTS

Of the 13 studies identified, 8 included client reminder and recall interventions, 4 included provider assessment and feedback and/or provider reminders and 2 included clinic based education. 11 of the 13 studies demonstrated a positive effect on HPV vaccine initiation or completion. Provider assessment and feedback studies were more likely to report a positive effect on HPV vaccine initiation than on series completion, while client reminder recall interventions more frequently produced an effect on series completion than on initiation.

CONCLUSIONS

There is evidence to support the application of the Community Preventive Services Task Force recommendations specifically to HPV vaccination both for client reminder and recall programs and for provider assessment and feedback interventions. Multiple targeted approaches will be needed to substantially impact HPV vaccine rates.

Interventions to increase HPV vaccination coverage: A systematic review

We reviewed intervention studies designed to increase human papillomavirus (HPV) vaccination coverage to further understand the impact interventions can have on HPV vaccination coverage. We searched 5 databases for intervention studies published from June 2006 to May 2015. Studies were included if they quantitatively measured HPV vaccination coverage as an outcome and were conducted in the United States. We abstracted outcomes, methods, and results from each study and classified by type of intervention conducted. Findings from 34 studies suggest many types of intervention strategies can increase HPV vaccination coverage in different settings, and with modest cost. Interventions were effective especially when implemented in combination at both provider and community levels. However, not all interventions showed significant effects on coverage. More research is needed to identify the best methods for widespread implementation of effective strategies.

Sauver JL, Finney Rutten LJ. The most effective and promising population health strategies to advance human papillomavirus vaccination

The US is failing to make substantive progress toward improving rates of human papillomavirus vaccine uptake. While the Healthy People 2020 goal for human papillomavirus (HPV) vaccination is 80%, the three-dose completion rate in the US in 2014 for 13- to 17-year-old females is less than 40%, and the rate for males is just above 20%. Experts point to a number of reasons for the poor HPV vaccination rates including parental concerns about safety, necessity, and timing. However, the evidence refuting these concerns is substantial. Efforts focusing on education and communication have not shown promise, but several population health strategies have reminder/recall systems; practice-focused strategies targeting staff, clinicians, and parents; assessment and feedback activities; and school-based HPV vaccination programs.

Practice- and Community-Based Interventions to Increase Human Papillomavirus Vaccine Coverage: A Systematic Review

IMPORTANCE

Vaccines against human papillomavirus (HPV) are recommended for routine use in adolescents aged 11 to 12 years in the United States, but uptake remains suboptimal. Educational interventions focused on parents and patients to increase coverage have not generally demonstrated effectiveness.

OBJECTIVE

To systematically review the literature on effectiveness of interventions conducted at the practice or community level to increase uptake of HPV vaccines in the United States.

EVIDENCE REVIEW

Keyword searches of the PubMed, Web of Science, and MEDLINE databases identified studies of adolescents that included the outcome of HPV vaccination published through July 2014. References of identified articles were also reviewed. A total of 366 records were screened, 38 full-text articles were reviewed, and 14 published studies were included. Results were summarized by different intervention approaches.

FINDINGS

Practice- and community-based intervention approaches included reminder and recall (n = 7), physician-focused interventions (eg, audit and feedback) (n = 6), school-based programs (n = 2), and social marketing (n = 2) (2 interventions tested multiple approaches). Seven studies used a randomized design, and 8 used quasiexperimental approaches (one used both). Thirteen studies included girls, and 2 studies included boys. Studies were conducted in a variety of populations and geographic locations. Twelve studies reported significant increases in at least one HPV vaccination outcome, one reported a nonsignificant increase, and one reported mixed effects.

CONCLUSIONS AND RELEVANCE

Most practice- and community-based interventions significantly increased HPV vaccination rates using varied approaches across diverse populations. This finding is in stark contrast to a recent review that did not find effects to warrant widespread implementation for any educational intervention. To address the current suboptimal rates of HPV vaccination in the United States, future efforts should focus on programs that can be implemented within health care settings, such as reminder and recall strategies and physician-focused efforts, as well as the use of alternative community-based locations, such as schools.

Effect of provider prompts on adolescent immunization rates: a randomized trial

OBJECTIVE

Adolescent immunization rates are suboptimal. Experts recommend provider prompts at health care visits to improve rates. We assessed the impact of either electronic health record (EHR) or nurse- or staff-initiated provider prompts on adolescent immunization rates.

METHODS

We conducted a randomized controlled trial, allocating practices in 1 of 2 practice-based research networks (PBRN) to provider prompts or standard-of-care control. Ten primary care practices participated, 5 intervention and 5 controls, each matched in pairs on urban, suburban, or rural location and practice type (pediatric or family medicine), from a PBRN in Greater Rochester, New York (GR-PBRN); and 12 practices, 6 intervention, 6 controls, similarly matched, from a national pediatric continuity clinic PBRN (CORNET). The study period was 1 year per practice, ranging from June 2011 to January 2013. Study participants were adolescents 11 to 17 years attending these 22 practices; random sample of chart reviews per practice for baseline and postintervention year to assess immunization rates (n = 7,040 total chart reviews for adolescents with >1 visit in a period). The intervention was an EHR prompt (4 GR-PBRN and 5 CORNET practice pairs) (alert) that appeared on providers' computer screens at all office visits, indicating the specific immunizations that adolescents were recommended to receive. Staff prompts (1 GR-PBRN pair and 1 CORNET pair) in the form of a reminder sheet was placed on the provider's desk in the exam room indicating the vaccines due. We compared immunization rates, stratified by PBRN, for routine vaccines (meningococcus, pertussis, human papillomavirus, influenza) at study beginning and end.

RESULTS

Intervention and control practices within each PBRN were similar at baseline for demographics and immunization rates. Immunization rates at the study end for adolescents who were behind on immunizations at study initiation were not significantly different for intervention versus control practices for any vaccine or combination of vaccines. Results were similar for each PBRN and also when only EHR-based prompts was assessed. For example, at study end, 3-dose human papillomavirus vaccination rates for GR-PBRN intervention versus control practices were 51% versus 53% (adjusted odds ratio 0.96; 95% confidence interval 0.64-1.34); CORNET intervention versus control rates were 50% versus 42% (adjusted odds ratio 1.06; 95% confidence interval 0.68-1.88).

CONCLUSIONS AND RELEVANCE

In both a local and national setting, provider prompts failed to improve adolescent immunization rates. More rigorous practice-based changes are needed.

Effect of decision support on missed opportunities for human papillomavirus vaccination

BACKGROUND

Missed opportunities for human papilloma virus (HPV) vaccination are common, presenting a barrier to achieving widespread vaccine coverage and preventing infection.

PURPOSE

To compare the impact of clinician- versus family-focused decision support, none, or both on captured opportunities for HPV vaccination.

DESIGN

Twelve-month cluster randomized controlled trial conducted in 2010-2011.

SETTING/PARTICIPANTS

Adolescent girls aged 11-17 years due for HPV Dose 1, 2, or 3 receiving care at primary care practices.

INTERVENTION

Twenty-two primary care practices were cluster randomized to receive a three-part clinician-focused intervention (educational sessions, electronic health record-based alerts, and performance feedback) or none. Within each practice, girls were randomized at the patient level to receive family-focused, automated, educational phone calls or none. Randomization resulted in four groups: clinician-focused, family-focused, combined, or no intervention.

MAIN OUTCOME MEASURES

Standardized proportions of captured opportunities (due vaccine received at clinician visit) were calculated among girls in each study arm. Analyses were conducted in 2013.

RESULTS

Among 17,016 adolescent girls and their 32,472 visits (14,247 preventive, 18,225 acute), more HPV opportunities were captured at preventive than acute visits (36% vs 4%, p<0.001). At preventive visits, the clinician intervention increased captured opportunities by 9 percentage points for HPV-1 and 6 percentage points for HPV-3 (p≤0.01), but not HPV-2. At acute visits, the clinician and combined interventions significantly improved captured opportunities for all three doses (p≤0.01). The family intervention was similar to none. Results differed by practice setting; at preventive visits, the clinician intervention was more effective for HPV-1 in suburban than urban settings, whereas at acute visits, the clinician intervention was more effective for all doses at urban practices.

CONCLUSIONS

Clinician-focused decision support is a more effective strategy than family-focused to prevent missed HPV vaccination opportunities. Given the persistence of missed opportunities even in intervention groups, complementary strategies are needed. This study is registered at clinicaltrials.gov NCT01159093.