Methodology for computing the burden of disease of adverse events following immunization

Background incidence rates of health outcomes in populations at risk for Lyme disease using US administrative claims data

BACKGROUND

Background incidence rates (IRs) of health outcomes in Lyme disease endemic regions are useful to contextualize events reported during Lyme disease vaccine clinical trials or post-marketing. The objective of this study was to estimate and compare IRs of health outcomes in Lyme disease endemic versus non-endemic regions in the US during pre-COVID and COVID era timeframes.

METHODS

IQVIA PharMetrics® Plus commercial claims database was used to estimate IRs of 64 outcomes relevant to vaccine safety monitoring in the US during January 1, 2017-December 31, 2019 and January 1, 2020-December 31, 2021. Analyses included all individuals aged ≥ 2 years with ≥ 1 year of continuous enrollment. Outcomes were defined by International Classification of Diseases Clinical Modification, 10th Revision (ICD-10-CM) diagnosis codes. IRs and 95 % confidence intervals (CIs) were calculated for each outcome and compared between endemic vs. non-endemic regions, and pre-COVID vs. COVID era using IR ratios (IRR).

RESULTS

The study population included 8.7 million (M) in endemic and 27.8 M in non-endemic regions. Mean age and sex were similar in endemic and non-endemic regions. In both study periods, the IRs were statistically higher in endemic regions for anaphylaxis, meningoencephalitis, myocarditis/pericarditis, and rash (including erythema migrans) as compared with non-endemic regions. Conversely, significantly lower IRs were observed in endemic regions for acute kidney injury, disseminated intravascular coagulation, heart failure, myelitis, myopathies, and systemic lupus erythematosus in both study periods. Most outcomes were statistically less frequent during the COVID-era.

CONCLUSION

This study identified potential differences between Lyme endemic and non-endemic regions of the US in background IRs of health conditions during pre-COVID and COVID era timeframes to inform Lyme disease vaccine safety monitoring. These regional and temporal differences in background IRs should be considered when contextualizing possible safety signals in clinical trials and post-marketing of a vaccine targeted at Lyme disease prevention.

Comprehensive Measurement of the Burden of Disease due to Adverse Events: A New Analysis of the Cross-Sectional Patient Safety Incident Inquiry

BACKGROUND

A methodology for comprehensively and reasonably measuring the burden of disease due to adverse events has yet to be clearly established. In this study, a new and systematic method for measuring the burden of disease due to adverse events was tested by utilizing the results of a medical record review, which is commonly used as a gold standard.

METHODS

Using the characteristics of preventable adverse events identified in the 2019 Patient Safety Incidents Inquiry (PSII), conducted to monitor the level of patient safety in Korea accurately, the resulting disability-adjusted life years (DALYs) and economic costs were estimated. DALYs were calculated as the sum of the years lived with a disability for patients who suffered permanent disability, or more, due to preventable adverse events, and the years of life lost due to premature mortality was calculated for patients who died due to preventable adverse events. The economic cost was calculated using the main diagnostic codes of patients who suffered preventable adverse events, identified as prolonged hospitalization in PSII, and the average medical cost by disease category and age group.

RESULTS

Estimates of DALYs due to preventable adverse events were 1,114.4 DALYs per 100,000 population for the minimum standard and 1,658.5 DALYs per 100,000 population for the maximum standard. Compared to the 2015 Korea Burden of Disease results, the ranking of DALYs due to preventable adverse events was sixth for the minimum standard and third for the maximum standard. The annual medical cost of adverse events in 2016 was estimated to be approximately Korean Republic Won (KRW) 870 billion (700 million US dollars). Medical expenses due to preventable adverse events were calculated to be approximately KRW 150 billion (120 million US dollars) as a minimum standard and approximately KRW 300 billion (240 million US dollars) as a maximum standard.

CONCLUSION

If this more standard method of systematically calculating the disease burden due to adverse events is used, it will be possible to compare the size of the patient safety problem with that of other diseases. The results of this study indicate that we still need to pay more attention to the issue of patient safety.

Risk and Benefit of mRNA COVID-19 Vaccines for the Omicron Variant by Age, Sex, and Presence of Comorbidity: A Quality-Adjusted Life Years Analysis

The development of the mutant omicron variant of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) during the coronavirus disease 2019 (COVID-19) pandemic raised the importance of reevaluating the risk and benefit of COVID-19 vaccines. With a decision tree model, we calculated the benefit-risk ratio and the benefit-risk difference of receiving monovalent messenger RNA (mRNA) COVID-19 vaccine (primary 2 doses, a third dose, and a fourth dose) in the 4-5 months after vaccination using quality-adjusted life years. The analysis was stratified by age, sex, and the presence of comorbidity. Evidence from peer-reviewed publications and gray literature was reviewed on September 16, 2022, to inform the study. Benefit-risk ratios for receipt of the BNT162b2 vaccine (Pfizer-BioNTech) ranged from 6.8 for males aged 12-17 years without comorbidity for the primary doses to 221.3 for females aged ≥65 years with comorbidity for the third dose. The benefit-risk ratios for receipt of the mRNA-1273 vaccine (Moderna) ranged from 7.2 for males aged 18-29 years without comorbidity for the primary doses to 101.4 for females aged ≥65 years with comorbidity for the third dose. In all scenarios of the one-way sensitivity analysis, the benefit-risk ratios were more than 1, irrespective of age, sex, comorbidity status, and type of vaccine, for both primary and booster doses. The benefits of mRNA COVID-19 vaccines in protecting against the omicron variant outweigh the risks, irrespective of age, sex, and comorbidity.

Accounting for Adverse Events Following Immunization in Economic Evaluation: Systematic Review of Economic Evaluations of Pediatric Vaccines Against Pneumococcus, Rotavirus, Human Papillomavirus, Meningococcus and Measles-Mumps-Rubella-Varicella

OBJECTIVES

Economic evaluations of vaccines should accurately represent all relevant economic and health consequences of vaccination, including losses due to adverse events following immunization (AEFI). We investigated to what extent economic evaluations of pediatric vaccines account for AEFI, which methods are used to do so and whether inclusion of AEFI is associated with study characteristics and the vaccine's safety profile.

METHODS

A systematic literature search (MEDLINE, EMBASE, Cochrane Systematic Reviews and Trials, Database of the Centre for Reviews and Dissemination of the University of York, EconPapers, Paediatric Economic Database Evaluation, Tufts New England Cost-Effectiveness Analysis Registry, Tufts New England Global Health CEA, International Network of Agencies for Health Technology Assessment Database) was performed for economic evaluations published between 2014 and 29 April 2021 (date of search) pertaining to the five groups of pediatric vaccines licensed in Europe and the United States since 1998: the human papillomavirus (HPV) vaccines, the meningococcal vaccines (MCV), the measles-mumps-rubella-varicella (MMRV) combination vaccines, the pneumococcal conjugate vaccines (PCV) and the rotavirus vaccines (RV). Rates of accounting for AEFI were calculated, stratified by study characteristics (e.g., region, publication year, journal impact factor, level of industry involvement) and triangulated with the vaccine's safety profile (Advisory Committee on Immunization Practices [ACIP] recommendations and information on safety-related product label changes). The studies accounting for AEFI were analyzed in terms of the methods used to account for both cost and effect implications of AEFI.

RESULTS

We identified 112 economic evaluations, of which 28 (25%) accounted for AEFI. This proportion was significantly higher for MMRV (80%, four out of five evaluations), MCV (61%, 11 out of 18 evaluations) and RV (60%, nine out of 15 evaluations) compared to HPV (6%, three out of 53 evaluations) and PCV (5%, one out of 21 evaluations). No other study characteristics were associated with a study's likelihood of accounting for AEFI. Vaccines for which AEFI were more frequently accounted for also had a higher frequency of label changes and a higher level of attention to AEFI in ACIP recommendations. Nine studies accounted for both the cost and health implications of AEFI, 18 studies considered only costs and one only health outcomes. While the cost impact was usually estimated based on routine billing data, the adverse health impact of AEFI was usually estimated based on assumptions.

DISCUSSION

Although (mild) AEFI were demonstrated for all five studied vaccines, only a quarter of reviewed studies accounted for these, mostly in an incomplete and inaccurate manner. We provide guidance on which methods to use to better quantify the impact of AEFI on both costs and health outcomes. Policymakers should be aware that the impact of AEFI on cost-effectiveness is likely to be underestimated in the majority of economic evaluations.

Suitability of databases in the Asia-Pacific for collaborative monitoring of vaccine safety

INTRODUCTION

Information regarding availability of electronic healthcare databases in the Asia-Pacific region is critical for planning vaccine safety assessments particularly, as COVID-19 vaccines are introduced. This study aimed to identify data sources in the region, potentially suitable for vaccine safety surveillance. This manuscript is endorsed by the International Society for Pharmacoepidemiology (ISPE).

METHODS

Nineteen countries targeted for database reporting were identified using published country lists and review articles. Surveillance capacity was assessed using two surveys: a 9-item introductory survey and a 51-item full survey. Survey questions related to database characteristics, covariate and health outcome variables, vaccine exposure characteristics, access and governance, and dataset linkage capability. Other questions collated research/regulatory applications of the data and local publications detailing database use for research.

RESULTS

Eleven databases containing vaccine-specific information were identified across 8 countries. Databases were largely national in coverage (8/11, 73%), encompassed all ages (9/11, 82%) with population size from 1.4 to 52 million persons. Vaccine exposure information varied particularly for standardized vaccine codes (5/11, 46%), brand (7/11, 64%) and manufacturer (5/11, 46%). Outcome data were integrated with vaccine data in 6 (55%) databases and available via linkage in 5 (46%) databases. Data approval processes varied, impacting on timeliness of data access.

CONCLUSIONS

Variation in vaccine data availability, complexities in data access including, governance and data release approval procedures, together with requirement for data linkage for outcome information, all contribute to the challenges in building a distributed network for vaccine safety assessment in the Asia-Pacific and globally. Common data models (CDMs) may help expedite vaccine safety research across the region.

Incidence Rates of Autoimmune Diseases in European Healthcare Databases: A Contribution of the ADVANCE Project

INTRODUCTION

The public-private ADVANCE collaboration developed and tested a system to generate evidence on vaccine benefits and risks using European electronic healthcare databases. In the safety of vaccines, background incidence rates are key to allow proper monitoring and assessment. The goals of this study were to compute age-, sex-, and calendar-year stratified incidence rates of nine autoimmune diseases in seven European healthcare databases from four countries and to assess validity by comparing with published data.

METHODS

Event rates were calculated for the following outcomes: acute disseminated encephalomyelitis, Bell's palsy, Guillain-Barré syndrome, immune thrombocytopenia purpura, Kawasaki disease, optic neuritis, narcolepsy, systemic lupus erythematosus, and transverse myelitis. Cases were identified by diagnosis codes. Participating organizations/databases originated from Denmark, Italy, Spain, and the UK. The source population comprised all persons registered, with at least 1 year of data prior to the study start, or follow-up from birth. Stratified incidence rates were computed per database over the period 2003 to 2014.

RESULTS

Between 2003 and 2014, 148,947 incident cases of nine autoimmune diseases were identified. Crude incidence rates were highest for Bell's palsy [23.8/100,000 person-years (PYs), 95% confidence interval (CI) 23.6-24.1] and lowest for Kawasaki disease (0.7/100,000 PYs, 95% CI 0.6-0.7). Specific patterns were observed by sex, age, calendar time, and data sources. Rates were comparable with published estimates.

CONCLUSION

A range of autoimmune events could be identified in the ADVANCE system. Estimation of rates indicated consistency across selected European healthcare databases, as well as consistency with US published data.

ADVANCE system testing: Benefit-risk analysis of a marketed vaccine using multi-criteria decision analysis and individual-level state transition modelling

BACKGROUND

The Accelerated Development of VAccine beNefit-risk Collaboration in Europe (ADVANCE) is a public-private collaboration aiming to develop and test a system for rapid benefit-risk (B/R) monitoring of vaccines using electronic health record (eHR) databases in Europe. Proof-of-concept studies were designed to assess the proposed processes and system for generating the required evidence to perform B/R assessment and near-real time monitoring of vaccines. We aimed to test B/R methodologies for vaccines, using the comparison of the B/R profiles of whole-cell (wP) and acellular pertussis (aP) vaccine formulations in children as an example.

METHODS

We used multi-criteria decision analysis (MCDA) to structure the B/R assessment combined with individual-level state transition modelling to build the B/R effects table. In the state transition model, we simulated the number of events in two hypothetical cohorts of 1 million children followed from first pertussis dose till pre-school-entry booster (or six years of age, whichever occurred first), with one cohort receiving wP, and the other aP. The benefits were reductions in pertussis incidence and complications. The risks were increased incidences of febrile convulsions, fever, hypotonic-hyporesponsive episodes, injection-site reactions and persistent crying. Most model parameters were informed by estimates (coverage, background incidences, relative risks) from eHR databases from Denmark (SSI), Spain (BIFAP and SIDIAP), Italy (Pedianet) and the UK (RCGP-RSC and THIN). Preferences were elicited from clinical and epidemiological experts.

RESULTS

Using state transition modelling to build the B/R effects table facilitated the comparison of different vaccine effects (e.g. immediate vaccine risks vs long-term vaccine benefits). Estimates from eHR databases could be used to inform the simulation model. The model results could be easily combined with preference weights to obtain B/R scores.

CONCLUSION

Existing B/R methodology, modelling and estimates from eHR databases can be successfully used for B/R assessment of vaccines.

Benefit-Risk Monitoring of Vaccines Using an Interactive Dashboard: A Methodological Proposal from the ADVANCE Project

INTRODUCTION

New vaccines are launched based on their benefit-risk (B/R) profile anticipated from clinical development. Proactive post-marketing surveillance is necessary to assess whether the vaccination uptake and the B/R profile are as expected and, ultimately, whether further public health or regulatory actions are needed. There are several, typically not integrated, facets of post-marketing vaccine surveillance: the surveillance of vaccination coverage, vaccine safety, effectiveness and impact.

OBJECTIVE

With this work, we aim to assess the feasibility and added value of using an interactive dashboard as a potential methodology for near real-time monitoring of vaccine coverage and pre-specified health benefits and risks of vaccines.

METHODS

We developed a web application with an interactive dashboard for B/R monitoring. The dashboard is demonstrated using simulated electronic healthcare record data mimicking the introduction of rotavirus vaccination in the UK. The interactive dashboard allows end users to select certain parameters, including expected vaccine effectiveness, age groups, and time periods and allows calculation of the incremental net health benefit (INHB) as well as the incremental benefit-risk ratio (IBRR) for different sets of preference weights. We assessed the potential added value of the dashboard by user testing amongst a range of stakeholders experienced in the post-marketing monitoring of vaccines.

RESULTS

The dashboard was successfully implemented and demonstrated. The feedback from the potential end users was generally positive, although reluctance to using composite B/R measures was expressed.

CONCLUSION

The use of interactive dashboards for B/R monitoring is promising and received support from various stakeholders. In future research, the use of such an interactive dashboard will be further tested with real-life data as opposed to simulated data.

Methodology for computing the burden of disease of adverse events following immunization

Purpose

Composite disease burden measures such as disability‐adjusted life‐years (DALY) have been widely used to quantify the population‐level health impact of disease or injury, but application has been limited for the estimation of the burden of adverse events following immunization. Our objective was to assess the feasibility of adapting the DALY approach for estimating adverse event burden.

Methods

We developed a practical methodological framework, explicitly describing all steps involved: acquisition of relative or absolute risks and background event incidence rates, selection of disability weights and durations, and computation of the years lived with disability (YLD) measure, with appropriate estimation of uncertainty. We present a worked example, in which YLD is computed for 3 recognized adverse reactions following 3 childhood vaccination types, based on background incidence rates and relative/absolute risks retrieved from the literature.

Results

YLD provided extra insight into the health impact of an adverse event over presentation of incidence rates only, as severity and duration are additionally incorporated. As well as providing guidance for the deployment of DALY methodology in the context of adverse events associated with vaccination, we also identified where data limitations potentially occur.

Conclusions

Burden of disease methodology can be applied to estimate the health burden of adverse events following vaccination in a systematic way. As with all burden of disease studies, interpretation of the estimates must consider the quality and accuracy of the data sources contributing to the DALY computation.