Data mining for prospective early detection of safety signals in the Vaccine Adverse Event Reporting System (VAERS): a case study of febrile seizures after a 2010-2011 seasonal influenza virus vaccine

Development of Interoperable Computable Phenotype Algorithms for Adverse Events of Special Interest to Be Used for Biologics Safety Surveillance: Validation Study

BACKGROUND

Adverse events associated with vaccination have been evaluated by epidemiological studies and more recently have gained additional attention with the emergency use authorization of several COVID-19 vaccines. As part of its responsibility to conduct postmarket surveillance, the US Food and Drug Administration continues to monitor several adverse events of special interest (AESIs) to ensure vaccine safety, including for COVID-19.

OBJECTIVE

This study is part of the Biologics Effectiveness and Safety Initiative, which aims to improve the Food and Drug Administration's postmarket surveillance capabilities while minimizing public burden. This study aimed to enhance active surveillance efforts through a rules-based, computable phenotype algorithm to identify 5 AESIs being monitored by the Center for Disease Control and Prevention for COVID-19 or other vaccines: anaphylaxis, Guillain-Barré syndrome, myocarditis/pericarditis, thrombosis with thrombocytopenia syndrome, and febrile seizure. This study examined whether these phenotypes have sufficiently high positive predictive value (PPV) to ensure that the cases selected for surveillance are reasonably likely to be a postbiologic adverse event. This allows patient privacy, and security concerns for the data sharing of patients who had nonadverse events can be properly accounted for when evaluating the cost-benefit aspect of our approach.

METHODS

AESI phenotype algorithms were developed to apply to electronic health record data at health provider organizations across the country by querying for standard and interoperable codes. The codes queried in the rules represent symptoms, diagnoses, or treatments of the AESI sourced from published case definitions and input from clinicians. To validate the performance of the algorithms, we applied them to electronic health record data from a US academic health system and provided a sample of cases for clinicians to evaluate. Performance was assessed using PPV.

RESULTS

With a PPV of 93.3%, our anaphylaxis algorithm performed the best. The PPVs for our febrile seizure, myocarditis/pericarditis, thrombocytopenia syndrome, and Guillain-Barré syndrome algorithms were 89%, 83.5%, 70.2%, and 47.2%, respectively.

CONCLUSIONS

Given our algorithm design and performance, our results support continued research into using interoperable algorithms for widespread AESI postmarket detection.

The REporting of A Disproportionality Analysis for DrUg Safety Signal Detection Using Individual Case Safety Reports in PharmacoVigilance (READUS-PV): Explanation and Elaboration

In pharmacovigilance, disproportionality analyses based on individual case safety reports are widely used to detect safety signals. Unfortunately, publishing disproportionality analyses lacks specific guidelines, often leading to incomplete and ambiguous reporting, and carries the risk of incorrect conclusions when data are not placed in the correct context. The REporting of A Disproportionality analysis for drUg Safety signal detection using individual case safety reports in PharmacoVigilance (READUS-PV) statement was developed to address this issue by promoting transparent and comprehensive reporting of disproportionality studies. While the statement paper explains in greater detail the procedure followed to develop these guidelines, with this explanation paper we present the 14 items retained for READUS-PV guidelines, together with an in-depth explanation of their rationale and bullet points to illustrate their practical implementation. Our primary objective is to foster the adoption of the READUS-PV guidelines among authors, editors, peer reviewers, and readers of disproportionality analyses. Enhancing transparency, completeness, and accuracy of reporting, as well as proper interpretation of their results, READUS-PV guidelines will ultimately facilitate evidence-based decision making in pharmacovigilance.

Comparative safety profile of bivalent and original COVID-19 mRNA vaccines regarding myocarditis/pericarditis: A pharmacovigilance study

OBJECTIVES

Bivalent COVID-19 mRNA vaccines, which contain two different components, were authorized to provide protection against both the original strain of SARS-CoV-2 and the Omicron variant as a measure to address the COVID-19 pandemic. Concerns regarding the risk of myocarditis/pericarditis associated with bivalent vaccination have been raised due to the observed superior neutralizing antibody responses. This study aimed to investigate the risk of myocarditis/pericarditis following bivalent COVID-19 mRNA vaccination compared to monovalent vaccination.

METHODS

The CDC COVID Data Tracker and the Vaccines Adverse Event Reporting System (VAERS) were analyzed between December 13, 2020 to March 8, 2023. Reporting rates were determined by dividing the number of myocarditis/pericarditis cases by the total number of vaccine doses administered. Disproportionality patterns regarding myocarditis/pericarditis were evaluated for various COVID-19 mRNA vaccinations using reporting odds ratios (RORs).

RESULTS

The reporting rate for myocarditis/pericarditis following original monovalent COVID-19 mRNA vaccination was 6.91 (95 % confidence interval [95 %CI] 6.71-7.12) per million doses, while the reporting rate for bivalent vaccination was significantly lower (1.24, 95%CI 0.96-1.58). Disproportionality analysis revealed a higher reporting of myocarditis/pericarditis following original vaccination with a ROR of 2.21 (95 %CI 2.00-2.43), while bivalent COVID-19 mRNA vaccination was associated with fewer reports of myocarditis/pericarditis (ROR 0.57, 95 %CI 0.45-0.72). Sub-analyses based on symptoms, sex, age and manufacturer further supported these findings.

CONCLUSION

This population-based study provides evidence that bivalent COVID-19 mRNA vaccination is not associated with risk of myocarditis/pericarditis. These findings provide important insights into the safety profile of bivalent COVID-19 mRNA vaccines and support their continued use as updated boosters.

Febrile Seizures: An Updated Narrative Review for Pediatric Ambulatory Care Providers

BACKGROUND

While generally self-limited, febrile seizures result in significant familial distress. Ambulatory pediatric care providers must be prepared to counsel families on the causes, risk factors, management principles, and prognosis of children with febrile seizures.

OBJECTIVE

To provide an updated, evidence-based review of febrile seizures focused on the needs of an ambulatory pediatric care provider.

METHODS

A narrative review of the literature prioritizing landmark articles, metanalyses, longitudinal population longitudinal cohort studies and national level guidelines.

RESULTS

Febrile seizures are aberrant physiological responses to fever in children caused by complex interactions of cytokine mediated neuroinflammation, environmental triggers, and genetic predisposition. Other than investigations to determine fever etiology, routine bloodwork, lumbar punctures, neuroimaging and electroencephalograms are low yield. The general prognosis is excellent, however, clinicians should be aware of long-term outcomes including: cognitive impairment with non-simple febrile seizures; neuropsychiatric associations; recurrent febrile seizure and epilepsy risk factors; and the association between complex febrile seizures and sudden unexpected death. Children with a high risk of recurrence, complex febrile seizures, limited access to care, or extreme parental anxiety may benefit from intermittent oral diazepam prophylaxis.

CONCLUSION

Clinicians should consider four management priorities: 1) terminating the seizure; 2) excluding critical differential diagnoses; 3) investigating fever etiology; and 4) providing adequate counselling to families. The clinical approach and prognosis of febrile seizure can be based on subtype. Children with non-simple (i.e. complex or febrile status epilepticus) febrile seizures require closer care than the vast majority of children with simple febrile seizures, who have excellent outcomes.

Three seasons of enhanced safety surveillance of a cell culture-based quadrivalent influenza vaccine

The objective of this paper is to summarize annual enhanced safety surveillance activity across three seasons (2019/20-2021/22) for cell culture-based quadrivalent influenza vaccine (QIVc; Flucelvax® Tetra) in all age groups. This activity was conducted in primary care setting in Genoa (Italy) during the seasons 2019/20, 2020/21 and 2021/22. All adverse events registered within the first seven days following immunization were analyzed by season, type, age group and seriousness. Over three seasons, 3,603 QIVc exposures were recorded within the enhanced passive safety surveillance activity. No safety signals were identified. The overall reporting rates of individual case safety reports for the seasons 2019/20, 2020/21 and 2021/22 were 1.75%, 0.48% and 0.40%, respectively. The average number of adverse events per individual case safety report was similar (range 3.3-3.8 adverse events per case report) across the three seasons. Most adverse events were reactogenic in nature. The rate of adverse events was similarly low in all age groups. Enhanced passive safety surveillance activity is a feasible approach for the post-marketing monitoring of seasonal influenza vaccines. Within its limitations, results of this study support the favorable safety profile of QIVc. These safety data could further bolster public trust in influenza vaccines with the goal to increase vaccination uptake in all target groups.

Myocarditis and Pericarditis Post-mRNA COVID-19 Vaccination: Insights from a Pharmacovigilance Perspective

Concerns remain regarding the rare cardiovascular adverse events, myocarditis and pericarditis (myo/pericarditis), particularly in younger individuals following mRNA COVID-19 vaccination. Our study aimed to comprehensively assess potential safety signals related to these cardiac events following the primary and booster doses, with a specific focus on younger populations, including children as young as 6 months of age. Using the Vaccine Adverse Events Reporting System (VAERS), the United States national passive surveillance system, we conducted a retrospective pharmacovigilance study analyzing spontaneous reports of myo/pericarditis. We employed both frequentist and Bayesian methods and conducted subgroup analyses by age, sex, and vaccine dose. We observed a higher reporting rate of myo/pericarditis following the primary vaccine series, particularly in males and mainly after the second dose. However, booster doses demonstrated a lower number of reported cases, with no significant signals detected after the fourth or fifth doses. In children and young adults, we observed notable age and sex differences in the reporting of myo/pericarditis cases. Males in the 12-17 and 18-24-year-old age groups had the highest number of cases, with significant signals for both males and females after the second dose. We also identified an increased reporting for a spectrum of cardiovascular symptoms such as chest pain and dyspnea, which increased with age, and were reported more frequently than myo/pericarditis. The present study identified signals of myo/pericarditis and related cardiovascular symptoms after mRNA COVID-19 vaccination, especially among children and adolescents. These findings underline the importance for continued vaccine surveillance and the need for further studies to confirm these results and to determine their clinical implications in public health decision-making, especially for younger populations.

A bibliometric analysis and visualization of medical data mining research

BACKGROUND

Data mining technology used in the field of medicine has been widely studied by scholars all over the world. But there is little research on medical data mining (MDM) from the perspectives of bibliometrics and visualization, and the research topics and development trends in this field are still unclear.

METHODS

This paper has applied bibliometric visualization software tools, VOSviewer 1.6.10 and CiteSpace V, to study the citation characteristics, international cooperation, author cooperation, and geographical distribution of the MDM.

RESULTS

A total of 1575 documents are obtained, and the most frequent document type is article (1376). SHAN NH is the most productive author, with the highest number of publications of 12, and the Gillies's article (750 times citation) is the most cited paper. The most productive country and institution in MDM is the USA (559) and US FDA (35), respectively. The Journal of Biomedical Informatics, Expert Systems with Applications and Journal of Medical Systems are the most productive journals, which reflected the nature of the research, and keywords "classification (790)" and "system (576)" have the strongest strength. The hot topics in MDM are drug discovery, medical imaging, vaccine safety, and so on. The 3 frontier topics are reporting system, precision medicine, and inflammation, and would be the foci of future research.

CONCLUSION

The present study provides a panoramic view of data mining methods applied in medicine by visualization and bibliometrics. Analysis of authors, journals, institutions, and countries could provide reference for researchers who are fresh to the field in different ways. Researchers may also consider the emerging trends when deciding the direction of their study.

Comparison of alpha-spending plans for near real-time monitoring for Guillain-Barré Syndrome after influenza vaccination during the 2010/11 influenza season

BACKGROUND

Near real-time surveillance of the influenza vaccine, which is administered to a large proportion of the US population every year, is essential to ensure safety of the vaccine. For efficient near real-time surveillance, it is key to select appropriate parameters such as monitoring start date, number of interim tests and a scheme for spending a pre-defined total alpha across the entire influenza season. Guillain-Barré Syndrome, shown to be associated with the 1976 influenza vaccine, is used to evaluate how choices of these parameters can affect whether or not a signal is detected and the time to signal. FDA has been monitoring for the risk of GBS after influenza vaccination for every influenza season since 2008.

METHODS

Using Medicare administrative data and the Updating Sequential Probability Ratio Test methodology to account for claims delay, we evaluated a number of different alpha-spending plans by varying several parameters.

RESULTS

For relative risks of 5 or greater, almost all alpha-spending plans have 100% power; however, for relative risks of 1.5 or lower, the constant and O'Brien-Fleming plans have increasingly more power. For RRs of 1.5 and greater, the Pocock plan signals earliest but would not signal at a RR of 1.25, as observed in prior influenza seasons. There were no remarkable differences across the different plans in regards to monitoring start dates defined by the number of vaccinations; reducing the number of interim tests improves performance only marginally.

CONCLUSIONS

A constant alpha-spending plan appears to be robust, in terms of power and time to detect a signal, across a range of these parameters, including alternate monitoring start dates based on either cumulative vaccinations or GBS claims observed, frequency of monitoring, hypothetical relative risks, and vaccine uptake patterns.

Safety of the 9-Valent Human Papillomavirus Vaccine

BACKGROUND

The 9-valent human papillomavirus vaccine (9vHPV) was approved for females and males aged 9 to 26 years in 2014. We analyzed postlicensure surveillance reports to the Vaccine Adverse Event Reporting System (VAERS).

METHODS

We searched VAERS data for US reports of adverse events (AEs) after 9vHPV from December 2014 through December 2017. We calculated reporting rates and conducted empirical Bayesian data mining to identify disproportional reporting. Physicians reviewed reports for selected prespecified conditions.

RESULTS

VAERS received 7244 reports after 9vHPV: 31.2% among females, 21.6% among males, and for 47.2%, sex was not reported. Overall, 97.4% of reports were nonserious. Dizziness, syncope, headache, and injection site reactions were most commonly reported; the most commonly reported AEs were similar between females and males. Two reports of death after 9vHPV were verified; no information in autopsy reports or death certificates suggested a causal relationship with vaccination. Approximately 28 million 9vHPV doses were distributed during the study period; crude AE reporting rates were 259 reports per million 9vHPV doses distributed for all reports and 7 per million doses distributed for serious reports. Syncope (a known AE associated with human papillomavirus vaccination) and several types of vaccine administration errors (eg, administered at wrong age) exceeded the statistical threshold for empirical Bayesian data mining findings.

CONCLUSIONS

No new or unexpected safety concerns or reporting patterns of 9vHPV with clinically important AEs were detected. The safety profile of 9vHPV is consistent with data from prelicensure trials and from postmarketing safety data of its predecessor, the quadrivalent human papillomavirus vaccine.

Early signal detection of adverse events following influenza vaccination using proportional reporting ratio, Victoria, Australia

INTRODUCTION

Timely adverse event following immunisation (AEFI) signal event detection is essential to minimise further vaccinees receiving unsafe vaccines. We explored the proportional reporting ratio (PRR) ability to detect two known signal events with influenza vaccines with the aim of providing a model for prospective routine signal detection and improving vaccine safety surveillance in Australia.

METHODS

Passive AEFI surveillance reports from 2008-2017 relating to influenza vaccines were accessed from the Australian SAEFVIC (Victoria) database. Proportional reporting ratios were calculated for two vaccine-event categories; fever and allergic AEFI. Signal detection sensitivity for two known signal events were determined using weekly data; cumulative data by individual year and; cumulative for all previous years. Signal event thresholds of PRR ≥2 and Chi-square ≥4 were applied.

RESULTS

PRR provided sensitive signal detection when calculated cumulatively by individual year or by all previous years. Known signal events were detected 15 and 11 days earlier than traditional methods used at the time of the actual events.

CONCLUSION

Utilising a single jurisdiction's data, PRR improved vaccine pharmacovigilance and showed the potential to detect important safety signals much earlier than previously. It has potential to maximise immunisation safety in Australia. This study progresses the necessary work to establish national cohesion for passive surveillance signal detection and strengthen routine Australian vaccine pharmacovigilance.

Major Birth Defects after Vaccination Reported to the Vaccine Adverse Event Reporting System (VAERS), 1990 to 2014

BACKGROUND

Major birth defects are important infant outcomes that have not been well studied in the postmarketing surveillance of vaccines given to pregnant women. We assessed the presence of major birth defects following vaccination in the Vaccine Adverse Event Reporting System (VAERS), a national spontaneous reporting system used to monitor the safety of vaccines in the United States.

METHODS

We searched VAERS for reports of major birth defects during January 1, 1990, through December 31, 2014. We excluded birth defects from vaccines that had been studied in pregnancy registries or other epidemiological studies (e.g., human papilloma virus, varicella, measles/mumps/rubella, and anthrax vaccines). Birth defects were categorized into trimester of vaccination and classified based on the organs and/or systems affected. If several birth defects affecting different systems were described, we classified those as multiple body systems. Empirical Bayesian data mining was used to assess for disproportionate reporting.

RESULTS

We identified 50 reports of major birth defects; in 28 reports, the vaccine was given during the first trimester; 25 were reports with single vaccines administered. Birth defects accounted for 0.03% of all reports received by VAERS during the study period and 3.2% of pregnancy reports; reported defects affected predominately the musculoskeletal (N = 10) or nervous (N = 10) systems. No unusual clusters or specific birth defects were identified.

CONCLUSION

This review of the VAERS database found that major birth defects were infrequently reported, with no particular condition reported disproportionally. Birth defects after routine maternal vaccination will continue to be monitored in VAERS for signals to prompt future studies. Birth Defects Research 109:1057-1062, 2017. © 2017 Wiley Periodicals, Inc.

Meningococcal conjugate vaccine safety surveillance in the Vaccine Safety Datalink using a tree-temporal scan data mining method

PURPOSE

The objective of our study was to conduct a data mining analysis to identify potential adverse events (AEs) following MENACWY-D using the tree-temporal scan statistic in the Vaccine Safety Datalink population and demonstrate the feasibility of this method in a large distributed safety data setting.

METHODS

Traditional pharmacovigilance techniques used in vaccine safety are generally geared to detecting AEs based on pre-defined sets of conditions or diagnoses. Using a newly developed tree-temporal scan statistic data mining method, we performed a pilot study to evaluate the safety profile of the meningococcal conjugate vaccine Menactra® (MenACWY-D), screening thousands of potential AE diagnoses and diagnosis groupings. The study cohort included enrolled participants in the Vaccine Safety Datalink aged 11 to 18 years who had received MenACWY-D vaccination(s) between 2005 and 2014. The tree-temporal scan statistic was employed to identify statistical associations (signals) of AEs following MENACWY-D at a 0.05 level of significance, adjusted for multiple testing.

RESULTS

We detected signals for 2 groups of outcomes: diseases of the skin and subcutaneous tissue, fever, and urticaria. Both groups are known AEs following MENACWY-D vaccination. We also identified a statistical signal for pleurisy, but further examination suggested it was likely a false signal. No new MENACWY-D safety concerns were raised.

CONCLUSIONS

As a pilot study, we demonstrated that the tree-temporal scan statistic data mining method can be successfully applied to screen broadly for a wide range of vaccine-AE associations within a large health care data network.

Logistic Regression Likelihood Ratio Test Analysis for Detecting Signals of Adverse Events in Post-market Safety Surveillance

The Vaccine Adverse Event Reporting System (VAERS) and other product surveillance systems compile reports of product-associated adverse events (AEs), and these reports may include a wide range of information including age, gender, and concomitant vaccines. Controlling for possible confounding variables such as these is an important task when utilizing surveillance systems to monitor post-market product safety. A common method for handling possible confounders is to compare observed product-AE combinations with adjusted baseline frequencies where the adjustments are made by stratifying on observable characteristics. Though approaches such as these have proven to be useful, in this article we propose a more flexible logistic regression approach which allows for covariates of all types rather than relying solely on stratification. Indeed, a main advantage of our approach is that the general regression framework provides flexibility to incorporate additional information such as demographic factors and concomitant vaccines. As part of our covariate-adjusted method, we outline a procedure for signal detection that accounts for multiple comparisons and controls the overall Type 1 error rate. To demonstrate the effectiveness of our approach, we illustrate our method with an example involving febrile convulsion, and we further evaluate its performance in a series of simulation studies.

Surveillance of Adverse Events After Seasonal Influenza Vaccination in Pregnant Women and Their Infants in the Vaccine Adverse Event Reporting System, July 2010-May 2016

INTRODUCTION

Routine immunization of pregnant women with seasonal inactivated influenza vaccines (IIVs) is recommended in all trimesters of pregnancy. A review of the Vaccine Adverse Event Reporting System (VAERS) during 1990-2009 did not find any unexpected patterns of pregnancy complications or fetal outcomes after administration of IIV or live attenuated influenza vaccines (LAIVs). During the 2009-2010 pandemic influenza A (H1N1) vaccination campaign, a study noted that the number of VAERS reports from pregnant women who received the H1N1 2009 inactivated monovalent vaccine (n = 288) increased compared with 1990-2009 seasonal IIV pregnancy reports (n = 148).

OBJECTIVES

The objective of this study was to assess the safety of seasonal influenza vaccines in pregnant women and their infants whose reports were submitted to VAERS during 2010-2016.

METHODS

We searched VAERS for US reports of adverse events (AEs) in pregnant women who received IIV or LAIV from 1 July 2010 through 6 May 2016. Clinicians reviewed reports and available medical records and assigned a primary clinical category for each report. Reports were coded as serious based on the Code of Federal Regulations.

RESULTS

We identified 671 reports after seasonal influenza vaccines administered to pregnant women: 544 after IIV and 127 after LAIV. Serious events occurred among 61 (11.2%) reports following IIV and one (0.8%) report following LAIV. No deaths were reported. Among reports with trimester information (n = 296), IIV was administered during the first trimester in 116 (39.2%). Among IIV reports, the most frequent pregnancy-specific AE was spontaneous abortion in 62 (11.4%) reports, followed by stillbirth in ten (1.8%) and preterm delivery in six (1.1%). The most common non-pregnancy-specific AEs were injection-site reactions (55 [10.1%]). Neonatal or infant outcomes were reported in 22 (4.0%) reports, seven of which had major birth defects of different types and no neonatal deaths.

CONCLUSION

As in 2009-2010, no new or unexpected patterns in maternal or fetal outcomes were observed during 2010-2016.

Surveillance systems and methods for monitoring the post-marketing safety of influenza vaccines at the Centers for Disease Control and Prevention

INTRODUCTION

Annual influenza vaccine safety monitoring is an important component of the influenza vaccination program in the United States to ensure that vaccines are safe, which is important for maintaining public trust in the national vaccination program. This is specially the case for influenza vaccines since the antigen composition of the viruses of which the vaccine is made often changes from one season to the next, based on the circulating strain of influenza virus.

AREAS COVERED

This review describes the two surveillance systems used by the Centers for Disease Control and Prevention (CDC) to monitor the safety of influenza vaccines: 1) the Vaccine Adverse Event Reporting System (VAERS); and 2) the Vaccine Safety datalink (VSD).

EXPERT OPINION

VAERS and VSD are used routinely to monitor the safety of influenza vaccines in the United States, and over the years they have demonstrated their value in monitoring vaccine safety since their implementation in 1990. Both systems, although different, complemented each other well to study febrile seizures in young children following influenza vaccination during the 2010-2011 influenza season. Other examples of potential safety concerns after influenza vaccines are also presented and discussed.

Post-Marketing Surveillance of Human Rabies Diploid Cell Vaccine (Imovax) in the Vaccine Adverse Event Reporting System (VAERS) in the United States, 1990‒2015

BACKGROUND

In 1980, human diploid cell vaccine (HDCV, Imovax Rabies, Sanofi Pasteur), was licensed for use in the United States.

OBJECTIVE

To assess adverse events (AEs) after HDCV reported to the US Vaccine Adverse Event Reporting System (VAERS), a spontaneous reporting surveillance system.

METHODS

We searched VAERS for US reports after HDCV among persons vaccinated from January 1, 1990-July 31, 2015. Medical records were requested for reports classified as serious (death, hospitalization, prolonged hospitalization, disability, life-threatening-illness), and those suggesting anaphylaxis and Guillain-Barré syndrome (GBS). Physicians reviewed available information and assigned a primary clinical category to each report using MedDRA system organ classes. Empirical Bayesian (EB) data mining was used to identify disproportional AE reporting after HDCV.

RESULTS

VAERS received 1,611 reports after HDCV; 93 (5.8%) were serious. Among all reports, the three most common AEs included pyrexia (18.2%), headache (17.9%), and nausea (16.5%). Among serious reports, four deaths appeared to be unrelated to vaccination.

CONCLUSIONS

This 25-year review of VAERS did not identify new or unexpected AEs after HDCV. The vast majority of AEs were non-serious. Injection site reactions, hypersensitivity reactions, and non-specific constitutional symptoms were most frequently reported, similar to findings in pre-licensure studies.

Post-licensure surveillance of quadrivalent inactivated influenza (IIV4) vaccine in the United States, Vaccine Adverse Event Reporting System (VAERS), July 1, 2013-May 31, 2015

BACKGROUND

Quadrivalent inactivated influenza vaccines (IIV4) were first available for use during 2013-14 influenza season for individuals aged ≥6 months. IIV4 is designed to protect against four different flu viruses; two influenza A viruses and two influenza B viruses.

METHODS

We searched the Vaccine Adverse Event Reporting System (VAERS) for US reports after IIV4 and trivalent inactivated influenza vaccine (IIV3) from 7/1/2013-5/31/2015. Medical records were requested for non-manufacturer reports classified as serious (i.e. death, hospitalization, prolonged hospitalization, life-threatening illness, permanent disability). The review included automated data analysis, clinical review of all serious reports, reports of special interest, and empirical Bayesian data mining.

RESULTS

VAERS received 1,838 IIV4 reports; 512 (28%) in persons aged 6 months-17 years of which 42 (8.2%) were serious reports; 1,265 (69%) in persons aged >18 years of which 84 (6.6%) were serious reports; two in children <6 months and 59 in persons of unknown age. Injection site erythema (24%), fever (14%) and injection site swelling (17%) were the most frequent adverse events among persons aged 6 months-17 years, while injection site pain (16%), pain (15%) and pain in extremity (13%) were the most frequent among persons aged 18-64 years given the vaccine alone. Among non-death serious reports, injection site reactions, constitutional symptoms, Guillain-Barré syndrome, seizures, and anaphylaxis were the most frequently reported adverse events. Data mining detected disproportional reporting for incorrect vaccine administration with no associated adverse events. Adverse events following IIV4 reported to VAERS were similar to those following IIV3.

CONCLUSIONS

In our review of VAERS reports, IIV4 had a similar safety profile to IIV3. Most of the reported AEs were non-serious. Our findings are consistent with data from pre-licensure studies of IIV4.

Enhancing Vaccine Safety Capacity Globally: A Lifecycle Perspective

Major vaccine safety controversies have arisen in several countries beginning in the last decades of 20th century. Such periodic vaccine safety controversies are unlikely to go away in the near future as more national immunization programs mature with near elimination of target vaccine-preventable diseases that result in relative greater prominence of adverse events following immunizations, both true reactions and temporally coincidental events. There are several ways in which vaccine safety capacity can be improved to potentially mitigate the impact of future vaccine safety controversies. This paper aims to take a "lifecycle" approach, examining some potential pre- and post-licensure opportunities to improve vaccine safety, in both developed (specifically U.S. and Europe) and low- and middle-income countries.

Surveillance of adverse events after the first trivalent inactivated influenza vaccine produced in mammalian cell culture (Flucelvax(®)) reported to the Vaccine Adverse Event Reporting System (VAERS), United States, 2013-2015

BACKGROUND

In November 2012, the first cell cultured influenza vaccine, a trivalent subunit inactivated influenza vaccine (Flucelvax(®), ccIIV3), was approved in the US for adults aged ≥ 18 years.

OBJECTIVE

To assess adverse events (AEs) after ccIIV3 reported to the US Vaccine Adverse Event Reporting System (VAERS), a spontaneous reporting surveillance system.

METHODS

We searched VAERS for US reports after ccIIV3 among persons vaccinated from July 1, 2013-March 31, 2015. Medical records were requested for reports classified as serious (death, hospitalization, prolonged hospitalization, disability, life-threatening-illness), and those suggesting anaphylaxis and Guillain-Barré syndrome (GBS). Physicians reviewed available information and assigned a primary clinical category using MedDRA system organ classes (SOC) to each report. Empirical Bayesian data mining was used to identify disproportional AE reporting following ccIIV3.

RESULTS

VAERS received 629 reports following ccIIV3 of which 313 were for administration of vaccine to persons <18 years. Among 309 reports with an AE documented, 19 (6.1%) were serious and the most common categories were 152 (49.2%) general disorders and administration site conditions (mostly injection site and systemic reactions) and 73 (23.6%) immune system disorders with two reports of anaphylaxis. Four reports of GBS were submitted. Disproportional reporting was identified for 'drug administered to patient of inappropriate age.'

CONCLUSIONS

Review of VAERS reports did not identify any concerning pattern of AEs after ccIIV3. Injection site and systemic reactions were the most commonly reported AEs, similar to the pre-licensure clinical trials. Reports following ccIIV3 in persons <18 years highlight the need for education of healthcare providers regarding approved ccIIV3 use.

Enhancing vaccine safety capacity globally: A lifecycle perspective

Major vaccine safety controversies have arisen in several countries beginning in the last decades of 20th century. Such periodic vaccine safety controversies are unlikely to go away in the near future as more national immunization programs mature with near elimination of target vaccine-preventable diseases that result in relative greater prominence of adverse events following immunizations, both true reactions and temporally coincidental events. There are several ways in which vaccine safety capacity can be improved to potentially mitigate the impact of future vaccine safety controversies. This paper aims to take a "lifecycle" approach, examining some potential pre- and post-licensure opportunities to improve vaccine safety, in both developed (specifically U.S. and Europe) and low- and middle-income countries.

Can Natural Language Processing Improve the Efficiency of Vaccine Adverse Event Report Review?

BACKGROUND

Individual case review of spontaneous adverse event (AE) reports remains a cornerstone of medical product safety surveillance for industry and regulators. Previously we developed the Vaccine Adverse Event Text Miner (VaeTM) to offer automated information extraction and potentially accelerate the evaluation of large volumes of unstructured data and facilitate signal detection.

OBJECTIVE

To assess how the information extraction performed by VaeTM impacts the accuracy of a medical expert's review of the vaccine adverse event report.

METHODS

The "outcome of interest" (diagnosis, cause of death, second level diagnosis), "onset time," and "alternative explanations" (drug, medical and family history) for the adverse event were extracted from 1000 reports from the Vaccine Adverse Event Reporting System (VAERS) using the VaeTM system. We compared the human interpretation, by medical experts, of the VaeTM extracted data with their interpretation of the traditional full text reports for these three variables. Two experienced clinicians alternately reviewed text miner output and full text. A third clinician scored the match rate using a predefined algorithm; the proportion of matches and 95% confidence intervals (CI) were calculated. Review time per report was analyzed.

RESULTS

Proportion of matches between the interpretation of the VaeTM extracted data, compared to the interpretation of the full text: 93% for outcome of interest (95% CI: 91-94%) and 78% for alternative explanation (95% CI: 75-81%). Extracted data on the time to onset was used in 14% of cases and was a match in 54% (95% CI: 46-63%) of those cases. When supported by structured time data from reports, the match for time to onset was 79% (95% CI: 76-81%). The extracted text averaged 136 (74%) fewer words, resulting in a mean reduction in review time of 50 (58%) seconds per report.

CONCLUSION

Despite a 74% reduction in words, the clinical conclusion from VaeTM extracted data agreed with the full text in 93% and 78% of reports for the outcome of interest and alternative explanation, respectively. The limited amount of extracted time interval data indicates the need for further development of this feature. VaeTM may improve review efficiency, but further study is needed to determine if this level of agreement is sufficient for routine use.

Safety monitoring in the Vaccine Adverse Event Reporting System (VAERS)

The Centers for Disease Control and Prevention (CDC) and the U.S. Food and Drug Administration (FDA) conduct post-licensure vaccine safety monitoring using the Vaccine Adverse Event Reporting System (VAERS), a spontaneous (or passive) reporting system. This means that after a vaccine is approved, CDC and FDA continue to monitor safety while it is distributed in the marketplace for use by collecting and analyzing spontaneous reports of adverse events that occur in persons following vaccination. Various methods and statistical techniques are used to analyze VAERS data, which CDC and FDA use to guide further safety evaluations and inform decisions around vaccine recommendations and regulatory action. VAERS data must be interpreted with caution due to the inherent limitations of passive surveillance. VAERS is primarily a safety signal detection and hypothesis generating system. Generally, VAERS data cannot be used to determine if a vaccine caused an adverse event. VAERS data interpreted alone or out of context can lead to erroneous conclusions about cause and effect as well as the risk of adverse events occurring following vaccination. CDC makes VAERS data available to the public and readily accessible online. We describe fundamental vaccine safety concepts, provide an overview of VAERS for healthcare professionals who provide vaccinations and might want to report or better understand a vaccine adverse event, and explain how CDC and FDA analyze VAERS data. We also describe strengths and limitations, and address common misconceptions about VAERS. Information in this review will be helpful for healthcare professionals counseling patients, parents, and others on vaccine safety and benefit-risk balance of vaccination.

Use of data mining at the Food and Drug Administration

Objectives This article summarizes past and current data mining activities at the United States Food and Drug Administration (FDA).

Target audience We address data miners in all sectors, anyone interested in the safety of products regulated by the FDA (predominantly medical products, food, veterinary products and nutrition, and tobacco products), and those interested in FDA activities.

Scope Topics include routine and developmental data mining activities, short descriptions of mined FDA data, advantages and challenges of data mining at the FDA, and future directions of data mining at the FDA.

Adverse events following Haemophilus influenzae type b vaccines in the Vaccine Adverse Event Reporting System, 1990-2013

OBJECTIVE

To characterize adverse events (AEs) after Haemophilus influenzae type b (Hib) vaccines reported to the US Vaccine Adverse Event Reporting System (VAERS), a spontaneous reporting surveillance system.

STUDY DESIGN

We searched VAERS for US reports after Hib vaccines among reports received from January 1, 1990, to December 1, 2013. We reviewed a random sample of reports and accompanying medical records for reports classified as serious. All reports of death were reviewed. Physicians assigned a primary clinical category to each reviewed report. We used empirical Bayesian data mining to identify AEs that were disproportionally reported after Hib vaccines.

RESULTS

VAERS received 29,747 reports after Hib vaccines; 5179 (17%) were serious, including 896 reports of deaths. Median age was 6 months (range 0-1022 months). Sudden infant death syndrome was the stated cause of death in 384 (51%) of 749 death reports with autopsy/death certificate records. The most common nondeath serious AE categories were neurologic (80; 37%), other noninfectious (46; 22%) (comprising mainly constitutional signs and symptoms); and gastrointestinal (39; 18%) conditions. No new safety concerns were identified after clinical review of reports of AEs that exceeded the data mining statistical threshold.

CONCLUSION

Review of VAERS reports did not identify any new or unexpected safety concerns for Hib vaccines.

Adverse Events Following Measles, Mumps, and Rubella Vaccine in Adults Reported to the Vaccine Adverse Event Reporting System (VAERS), 2003-2013

BACKGROUND

Limited data exist on the safety of the measles, mumps, and rubella (MMR) vaccine in adults. We reviewed reports of adverse events (AEs) to the Vaccine Adverse Event Reporting System (VAERS) to assess safety in this previously understudied group.

METHODS

VAERS is the national spontaneous vaccine safety surveillance system coadministered by the Centers for Disease Control and Prevention and the US Food and Drug Administration. We searched the VAERS database for US reports of adults aged ≥19 years who received the MMR vaccine from 1 January 2003 to 31 July 2013. We clinically reviewed reports and available medical records for serious AEs, pregnancy reports, and reports for selected prespecified outcomes.

RESULTS

During this period, VAERS received 3175 US reports after MMR vaccine in adults. Of these, 168 (5%) were classified as serious, including 7 reports of death. Females accounted for 77% of reports. The most common signs and symptoms for all reports were pyrexia (19%), rash (17%), pain (13%), and arthralgia (13%). We did not detect any new safety findings in empirical Bayesian data mining. We identified 131 reports of MMR vaccine administered to a pregnant woman; the majority of these vaccinations were in the first trimester and in 83 (62%), no AE was reported.

CONCLUSIONS

In our review of VAERS data, we did not detect any new or unexpected safety concerns for MMR vaccination in adults. We identified reports of pregnant women exposed to MMR, which is a group in whom the vaccine is contraindicated, suggesting the need for continued provider education on vaccine recommendations and screening.

Adverse events after Fluzone ® Intradermal vaccine reported to the Vaccine Adverse Event Reporting System (VAERS), 2011-2013

BACKGROUND

In May 2011, the first trivalent inactivated influenza vaccine exclusively for intradermal administration (TIV-ID) was licensed in the US for adults aged 18-64 years.

OBJECTIVE

To characterize adverse events (AEs) after TIV-ID reported to the US Vaccine Adverse Event Reporting System (VAERS), a spontaneous reporting surveillance system.

METHODS

We searched VAERS for US reports after TIV-ID among persons vaccinated from July 1, 2011-February 28, 2013. Medical records were requested for reports coded as serious (death, hospitalization, prolonged hospitalization, disability, life-threatening-illness), and those suggesting anaphylaxis. Clinicians reviewed available information and assigned a primary clinical category to each report. Empirical Bayesian data mining was used to identify disproportional AE reporting following TIV-ID. Causality was not assessed.

RESULTS

VAERS received 466 reports after TIV-ID; 9 (1.9%) were serious, including one reported fatality in an 88-year-old vaccinee. Median age was 43 years (range 4-88 years). The most common AE categories were: 218 (46.8%) injection site reactions; 89 (19.1%) other non-infectious (comprised mainly of constitutional signs and symptoms); and 74 (15.9%) allergy. Eight reports (1.7%) of anaphylaxis were verified by the Brighton criteria or a documented physician diagnosis. Disproportional reporting was identified for three AEs: 'injection site nodule', 'injection site pruritus', and 'drug administered to patient of inappropriate age'. The findings for the first two AEs were expected. Twenty-four reports of vaccinees <18 years or ≥ 65 years were reported, and 14 of 24 were coded with the AE 'drug administered to patient of inappropriate age'.

CONCLUSIONS

Review of VAERS reports did not identify any new or unexpected safety concerns after TIV-ID. Injection site reactions were the most commonly reported AEs, similar to the pre-licensure clinical trials. Use of TIV-ID in younger and older individuals outside the approved age range highlights the need for education of healthcare providers regarding approved TIV-ID use.