Can routinely collected laboratory and health administrative data be used to assess influenza vaccine effectiveness? Assessing the validity of the Flu and Other Respiratory Viruses Research (FOREVER) Cohort

Relative vaccine effectiveness of MF59®-adjuvanted vs high-dose trivalent inactivated influenza vaccines for prevention of test-confirmed influenza hospitalizations during the 2017-2020 influenza seasons

OBJECTIVES

This study evaluated relative vaccine effectiveness (rVE) of MF59-adjuvanted trivalent inactivated influenza vaccine (aTIV) vs high-dose trivalent inactivated influenza vaccine (HD-TIV) for prevention of test-confirmed influenza emergency department visits and/or inpatient admissions ("ED/IP") and for IP admissions alone pooled across the 2017-2020 influenza seasons. Exploratory individual season analyses were also performed.

METHODS

This retrospective test-negative design study included US adults age ≥65 years vaccinated with aTIV or HD-TIV who presented to an ED or IP setting with acute respiratory or febrile illness during the 2017-2020 influenza seasons. Test-positive cases and test-negative controls were grouped by vaccine received. The rVE of aTIV vs HD-TIV was evaluated using a combination of inverse probability of treatment weighting and logistic regression to adjust for potential confounders.

RESULTS

Pooled analyses over the 3 seasons found no significant differences in the rVE of aTIV vs HD-TIV for prevention of test-confirmed influenza ED/IP (-2.5% [-19.6, 12.2]) visits and admissions or IP admissions alone (-1.6% [-22.5, 15.7]). The exploratory individual season analyses also showed no significant differences.

CONCLUSIONS

Evidence from the 2017-2020 influenza seasons indicates aTIV and HD-TIV are comparable for prevention of test-confirmed influenza ED/IP visits in US adults age ≥65 years.

Relative Vaccine Effectiveness of Cell- vs Egg-Based Quadrivalent Influenza Vaccine Against Test-Confirmed Influenza Over 3 Seasons Between 2017 and 2020 in the United States

Background

Influenza vaccine viruses grown in eggs may acquire egg-adaptive mutations that may reduce antigenic similarity between vaccine and circulating influenza viruses and decrease vaccine effectiveness. We compared cell- and egg-based quadrivalent influenza vaccines (QIVc and QIVe, respectively) for preventing test-confirmed influenza over 3 US influenza seasons (2017-2020).

Methods

Using a retrospective test-negative design, we estimated the relative vaccine effectiveness (rVE) of QIVc vs QIVe among individuals aged 4 to 64 years who had an acute respiratory or febrile illness and were tested for influenza in routine outpatient care. Exposure, outcome, and covariate data were obtained from electronic health records linked to pharmacy and medical claims. Season-specific rVE was estimated by comparing the odds of testing positive for influenza among QIVc vs QIVe recipients. Models were adjusted for age, sex, geographic region, influenza test date, and additional unbalanced covariates. A doubly robust approach was used combining inverse probability of treatment weights with multivariable regression.

Results

The study included 31 824, 33 388, and 34 398 patients in the 2017-2018, 2018-2019, and 2019-2020 seasons, respectively; ∼10% received QIVc and ∼90% received QIVe. QIVc demonstrated superior effectiveness vs QIVe in prevention of test-confirmed influenza: rVEs were 14.8% (95% CI, 7.0%-22.0%) in 2017-2018, 12.5% (95% CI, 4.7%-19.6%) in 2018-2019, and 10.0% (95% CI, 2.7%-16.7%) in 2019-2020.

Conclusions

This study demonstrated consistently superior effectiveness of QIVc vs QIVe in preventing test-confirmed influenza over 3 seasons characterized by different circulating viruses and degrees of egg adaptation.

Measuring waning protection from seasonal influenza vaccination during nine influenza seasons, Ontario, Canada, 2010/11 to 2018/19

BackgroundWaning immunity from seasonal influenza vaccination can cause suboptimal protection during peak influenza activity. However, vaccine effectiveness studies assessing waning immunity using vaccinated and unvaccinated individuals are subject to biases.AimWe examined the association between time since vaccination and laboratory-confirmed influenza to assess the change in influenza vaccine protection over time.MethodsUsing linked laboratory and health administrative databases in Ontario, Canada, we identified community-dwelling individuals aged ≥ 6 months who received an influenza vaccine before being tested for influenza by RT-PCR during the 2010/11 to 2018/19 influenza seasons. We estimated the adjusted odds ratio (aOR) for laboratory-confirmed influenza by time since vaccination (categorised into intervals) and for every 28 days.ResultsThere were 53,065 individuals who were vaccinated before testing for influenza, with 10,264 (19%) influenza-positive cases. The odds of influenza increased from 1.05 (95% CI: 0.91-1.22) at 42-69 days after vaccination and peaked at 1.27 (95% CI: 1.04-1.55) at 126-153 days when compared with the reference interval (14-41 days). This corresponded to 1.09-times increased odds of influenza every 28 days (aOR = 1.09; 95% CI: 1.04-1.15). Individuals aged 18-64 years showed the greatest decline in protection against influenza A(H1N1) (aORper 28 days = 1.26; 95% CI: 0.97-1.64), whereas for individuals aged ≥ 65 years, it was against influenza A(H3N2) (aORper 28 days = 1.20; 95% CI: 1.08-1.33). We did not observe evidence of waning vaccine protection for individuals aged < 18 years.ConclusionsInfluenza vaccine protection wanes during an influenza season. Understanding the optimal timing of vaccination could ensure robust protection during seasonal influenza activity.

Early influenza vaccine effectiveness estimates using routinely collected data, Alberta, Canada, 2023/24 season

Timely and precise influenza vaccine effectiveness (VE) estimates are needed to guide public health messaging and impact vaccine uptake immediately. Using routinely collected laboratory, vaccination and health administrative data from Alberta, Canada, we estimated influenza VE against infection for the 2023/24 season on a near real-time basis, to late December, at 61% (95% CI: 58-64) against influenza A(H1N1), 49% (95% CI: 28-63) against influenza A(H3N2) and 75% (95% CI: 58-85) against influenza B.

Maternal mRNA covid-19 vaccination during pregnancy and delta or omicron infection or hospital admission in infants: test negative design study

OBJECTIVE

To estimate the effectiveness of maternal mRNA covid-19 vaccination during pregnancy against delta and omicron severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) infection and hospital admission in infants.

DESIGN

Test negative design study.

SETTING

Community and hospital testing in Ontario, Canada.

PARTICIPANTS

Infants younger than six months of age, born between 7 May 2021 and 31 March 2022, who were tested for SARS-CoV-2 between 7 May 2021 and 5 September 2022.

INTERVENTION

Maternal mRNA covid-19 vaccination during pregnancy.

MAIN OUTCOME MEASURES

Laboratory confirmed delta or omicron infection or hospital admission of the infant. Multivariable logistic regression estimated vaccine effectiveness, with adjustments for clinical and sociodemographic characteristics associated with vaccination and infection.

RESULTS

8809 infants met eligibility criteria, including 99 delta cases (4365 controls) and 1501 omicron cases (4847 controls). Infant vaccine effectiveness from two maternal doses was 95% (95% confidence interval 88% to 98%) against delta infection and 97% (73% to 100%) against infant hospital admission due to delta and 45% (37% to 53%) against omicron infection and 53% (39% to 64%) against hospital admission due to omicron. Vaccine effectiveness for three doses was 73% (61% to 80%) against omicron infection and 80% (64% to 89%) against hospital admission due to omicron. Vaccine effectiveness for two doses against infant omicron infection was highest with the second dose in the third trimester (53% (42% to 62%)) compared with the first (47% (31% to 59%)) or second (37% (24% to 47%)) trimesters. Vaccine effectiveness for two doses against infant omicron infection decreased from 57% (44% to 66%) between birth and eight weeks to 40% (21% to 54%) after 16 weeks of age.

CONCLUSIONS

Maternal covid-19 vaccination with a second dose during pregnancy was highly effective against delta and moderately effective against omicron infection and hospital admission in infants during the first six months of life. A third vaccine dose bolstered protection against omicron. Effectiveness for two doses was highest with maternal vaccination in the third trimester, and effectiveness decreased in infants beyond eight weeks of age.

Burden of Severe Illness Associated With Laboratory-Confirmed Influenza in Adults Aged 50-64 Years, 2010-2011 to 2016-2017

Background

Understanding the burden of influenza is necessary to optimize recommendations for influenza vaccination. We describe the epidemiology of severe influenza in 50- to 64-year-old residents of metropolitan Toronto and Peel region, Canada, over 7 influenza seasons.

Methods

Prospective population-based surveillance for hospitalization associated with laboratory-confirmed influenza was conducted from September 2010 to August 2017. Conditions increasing risk of influenza complications were as defined by Canada's National Advisory Committee on Immunization. Age-specific prevalence of medical conditions was estimated using Ontario health administrative data. Population rates were estimated using Statistics Canada data.

Results

Over 7 seasons, 1228 hospitalizations occurred in patients aged 50-64 years: 40% due to A(H3N2), 30% A(H1N1), and 22% influenza B. The average annual hospitalization rate was 15.6, 20.9, and 33.2 per 100 000 in patients aged 50-54, 55-59, and 60-64 years, respectively; average annual mortality was 0.9/100 000. Overall, 33% of patients had received current season influenza vaccine; 963 (86%) had ≥1 underlying condition increasing influenza complication risk. The most common underlying medical conditions were chronic lung disease (38%) and diabetes mellitus (31%); 25% of patients were immunocompromised. The average annual hospitalization rate was 6.1/100 000 in those without and 41/100 000 in those with any underlying condition, and highest in those with renal disease or immunocompromise (138 and 281 per 100 000, respectively). The case fatality rate in hospitalized patients was 4.4%; median length of stay was 4 days (interquartile range, 2-8 days).

Conclusions

The burden of severe influenza in 50- to 64-year-olds remains significant despite our universal publicly funded vaccination program. These data may assist in improving estimates of the cost-effectiveness of new strategies to reduce this burden.

Roles for Pathogen Interference in Influenza Vaccination, with Implications to Vaccine Effectiveness (VE) and Attribution of Influenza Deaths

Pathogen interference is the ability of one pathogen to alter the course and clinical outcomes of infection by another. With up to 3000 species of human pathogens the potential combinations are vast. These combinations operate within further immune complexity induced by infection with multiple persistent pathogens, and by the role which the human microbiome plays in maintaining health, immune function, and resistance to infection. All the above are further complicated by malnutrition in children and the elderly. Influenza vaccination offers a measure of protection for elderly individuals subsequently infected with influenza. However, all vaccines induce both specific and non-specific effects. The specific effects involve stimulation of humoral and cellular immunity, while the nonspecific effects are far more nuanced including changes in gene expression patterns and production of small RNAs which contribute to pathogen interference. Little is known about the outcomes of vaccinated elderly not subsequently infected with influenza but infected with multiple other non-influenza winter pathogens. In this review we propose that in certain years the specific antigen mix in the seasonal influenza vaccine inadvertently increases the risk of infection from other non-influenza pathogens. The possibility that vaccination could upset the pathogen balance, and that the timing of vaccination relative to the pathogen balance was critical to success, was proposed in 2010 but was seemingly ignored. Persons vaccinated early in the winter are more likely to experience higher pathogen interference. Implications to the estimation of vaccine effectiveness and influenza deaths are discussed.

Effectiveness of COVID-19 vaccines against symptomatic SARS-CoV-2 infection and severe outcomes with variants of concern in Ontario

SARS-CoV-2 variants of concern (VOC) are more transmissible and may have the potential for increased disease severity and decreased vaccine effectiveness. We estimated the effectiveness of BNT162b2 (Pfizer-BioNTech Comirnaty), mRNA-1273 (Moderna Spikevax) and ChAdOx1 (AstraZeneca Vaxzevria) vaccines against symptomatic SARS-CoV-2 infection and COVID-19 hospitalization or death caused by the Alpha (B.1.1.7), Beta (B.1.351), Gamma (P.1) and Delta (B.1.617.2) VOC in Ontario, Canada, using a test-negative design study. We identified 682,071 symptomatic community-dwelling individuals who were tested for SARS-CoV-2, and 15,269 individuals with a COVID-19 hospitalization or death. Effectiveness against symptomatic infection ≥7 d after two doses was 89-92% against Alpha, 87% against Beta, 88% against Gamma, 82-89% against Beta/Gamma and 87-95% against Delta across vaccine products. The corresponding estimates ≥14 d after one dose were lower. Effectiveness estimates against hospitalization or death were similar to or higher than against symptomatic infection. Effectiveness against symptomatic infection was generally lower for older adults (≥60 years) than for younger adults (<60 years) for most of the VOC-vaccine combinations. Our findings suggest that jurisdictions facing vaccine supply constraints may benefit from delaying the second dose in younger individuals to more rapidly achieve greater overall population protection; however, older adults would likely benefit most from minimizing the delay in receiving the second dose to achieve adequate protection against VOC.

Effectiveness of BNT162b2 and mRNA-1273 covid-19 vaccines against symptomatic SARS-CoV-2 infection and severe covid-19 outcomes in Ontario, Canada: test negative design study

OBJECTIVE

To estimate the effectiveness of mRNA covid-19 vaccines against symptomatic infection and severe outcomes (hospital admission or death).

DESIGN

Test negative design study.

SETTING

Ontario, Canada between 14 December 2020 and 19 April 2021.

PARTICIPANTS

324 033 community dwelling people aged ≥16 years who had symptoms of covid-19 and were tested for SARS-CoV-2.

INTERVENTIONS

BNT162b2 (Pfizer-BioNTech) or mRNA-1273 (Moderna) vaccine.

MAIN OUTCOME MEASURES

Laboratory confirmed SARS-CoV-2 by reverse transcription polymerase chain reaction (RT-PCR) and hospital admissions and deaths associated with SARS-CoV-2 infection. Multivariable logistic regression was adjusted for personal and clinical characteristics associated with SARS-CoV-2 and vaccine receipt to estimate vaccine effectiveness against symptomatic infection and severe outcomes.

RESULTS

Of 324 033 people with symptoms, 53 270 (16.4%) were positive for SARS-CoV-2 and 21 272 (6.6%) received at least one dose of vaccine. Among participants who tested positive, 2479 (4.7%) were admitted to hospital or died. Vaccine effectiveness against symptomatic infection observed ≥14 days after one dose was 60% (95% confidence interval 57% to 64%), increasing from 48% (41% to 54%) at 14-20 days after one dose to 71% (63% to 78%) at 35-41 days. Vaccine effectiveness observed ≥7 days after two doses was 91% (89% to 93%). Vaccine effectiveness against hospital admission or death observed ≥14 days after one dose was 70% (60% to 77%), increasing from 62% (44% to 75%) at 14-20 days to 91% (73% to 97%) at ≥35 days, whereas vaccine effectiveness observed ≥7 days after two doses was 98% (88% to 100%). For adults aged ≥70 years, vaccine effectiveness estimates were observed to be lower for intervals shortly after one dose but were comparable to those for younger people for all intervals after 28 days. After two doses, high vaccine effectiveness was observed against variants with the E484K mutation.

CONCLUSIONS

Two doses of mRNA covid-19 vaccines were observed to be highly effective against symptomatic infection and severe outcomes. Vaccine effectiveness of one dose was observed to be lower, particularly for older adults shortly after the first dose.

A Call for Caution in Use of Pertussis Vaccine Effectiveness Studies to Estimate Waning Immunity: A Canadian Immunization Research Network Study

BACKGROUND

Vaccine effectiveness (VE) studies provide essential evidence on waning vaccine-derived immunity, a major threat to pertussis control. We evaluated how study design affects estimates by comparing 2 case-control studies conducted in Ontario, Canada.

METHODS

We compared results from a test-negative design (TND) with a frequency-matched design (FMD) case-control study using pertussis cases from 2005-2015. In the first study, we identified test-negative controls from the public health laboratory that diagnosed cases and, in the second, randomly selected controls from patients attending the same physicians that reported cases, frequency matched on age and year. We compared characteristics of cases and controls using standardized differences.

RESULTS

In both designs, VE estimates for the early years postimmunization were consistent with clinical trials (TND, 84%; FMD, 89% at 1-3 years postvaccination) but diverged as time since last vaccination increased (TND, 41%; FMD, 74% by 8 years postvaccination). Overall, we observed lower VE and faster waning in the TND than the FMD. In the TND but not FMD, controls differed from cases in important confounders, being younger, having more comorbidities, and higher healthcare use. Differences between the controls of each design were greater than differences between cases. TND controls were more likely to be unvaccinated or incompletely vaccinated than FMD controls (P < .001).

CONCLUSIONS

The FMD adjusted better for healthcare-seeking behavior than the TND. Duration of protection from pertussis vaccines is unclear because estimates vary by study design. Caution should be exercised by experts, researchers, and decision makers when evaluating evidence on optimal timing of boosters.

Modeling the impacts of clinical influenza testing on influenza vaccine effectiveness estimates

BACKGROUND

Test-negative design studies for evaluating influenza vaccine effectiveness (VE) enroll patients with acute respiratory infection. Enrollment typically occurs before influenza status is determined, resulting in over-enrollment of influenza-negative patients. With availability of rapid and accurate molecular clinical testing, influenza status could be ascertained prior to enrollment, thus improving study efficiency. We estimate potential biases in VE when using clinical testing.

METHODS

We simulate data assuming 60% vaccinated, 25% of those vaccinated are influenza positive, and VE of 50%. We show the effect on VE in five scenarios.

RESULTS

VE is affected only when clinical testing preferentially targets patients based on both vaccination and influenza status. VE is overestimated by 10% if non-testing occurs in 39% of vaccinated influenza-positive patients and 24% of others; and if non-testing occurs in 8% of unvaccinated influenza-positive patients and 27% of others. VE is underestimated by 10% if non-testing occurs in 32% of unvaccinated influenza-negative patients and 18% of others.

CONCLUSIONS

Although differential clinical testing by vaccine receipt and influenza positivity may produce errors in estimated VE, bias in testing would have to be substantial and overall proportion of patients tested would have to be small to result in a meaningful difference in VE.

A systematic review of quantitative bias analysis applied to epidemiological research

BACKGROUND

Quantitative bias analysis (QBA) measures study errors in terms of direction, magnitude and uncertainty. This systematic review aimed to describe how QBA has been applied in epidemiological research in 2006-19.

METHODS

We searched PubMed for English peer-reviewed studies applying QBA to real-data applications. We also included studies citing selected sources or which were identified in a previous QBA review in pharmacoepidemiology. For each study, we extracted the rationale, methodology, bias-adjusted results and interpretation and assessed factors associated with reproducibility.

RESULTS

Of the 238 studies, the majority were embedded within papers whose main inferences were drawn from conventional approaches as secondary (sensitivity) analyses to quantity-specific biases (52%) or to assess the extent of bias required to shift the point estimate to the null (25%); 10% were standalone papers. The most common approach was probabilistic (57%). Misclassification was modelled in 57%, uncontrolled confounder(s) in 40% and selection bias in 17%. Most did not consider multiple biases or correlations between errors. When specified, bias parameters came from the literature (48%) more often than internal validation studies (29%). The majority (60%) of analyses resulted in >10% change from the conventional point estimate; however, most investigators (63%) did not alter their original interpretation. Degree of reproducibility related to inclusion of code, formulas, sensitivity analyses and supplementary materials, as well as the QBA rationale.

CONCLUSIONS

QBA applications were rare though increased over time. Future investigators should reference good practices and include details to promote transparency and to serve as a reference for other researchers.

Family and Child Risk Factors for Early-Life RSV Illness

BACKGROUND AND OBJECTIVES

Most infants hospitalized with respiratory syncytial virus (RSV) do not meet common "high-risk" criteria and are otherwise healthy. The objective of this study was to quantify the risks and relative importance of socioeconomic factors for severe, early-life RSV-related illness. We hypothesized several of these factors, particularly those indicating severe social vulnerability, would have statistically significant associations with increased RSV hospitalization rates and may offer impactful targets for population-based RSV prevention strategies, such as prophylaxis programs.

METHODS

We used linked health, laboratory, and sociodemographic administrative data for all children born in Ontario (2012-2018) to identify all RSV-related hospitalizations occurring before the third birthday or end of follow-up (March 31, 2019). We estimated rate ratios and population attributable fractions using a fully adjusted model.

RESULTS

A total of 11 782 RSV-related hospitalizations were identified among 789 484 children. Multiple socioeconomic factors were independently associated with increased RSV-related admissions, including young maternal age, maternal criminal involvement, and maternal history of serious mental health and/or addiction concerns. For example, an estimated 4.1% (95% confidence interval: 2.2 to 5.9) of RSV-related admissions could be prevented by eliminating the increased admissions risks among children whose mothers used welfare-based drug insurance. Notably, 41.6% (95% confidence interval: 39.6 to 43.5) of admissions may be prevented by targeting older siblings (eg, through vaccination).

CONCLUSIONS

Many social factors were independently associated with early-life RSV-related hospitalization. Existing RSV prophylaxis and emerging vaccination programs should consider the importance of both clinical and social risk factors when determining eligibility and promoting compliance.

Comparison of local influenza vaccine effectiveness using two methods

Background

In some settings, research methods to determine influenza vaccine effectiveness (VE) may not be appropriate because of cost, time constraints, or other factors. Administrative database analysis of viral testing results and vaccination history may be a viable alternative. This study compared VE estimates from outpatient research and administrative databases.

Methods

Using the test-negative, case-control design, data for 2017–2018 and 2018–2019 influenza seasons were collected using: 1) consent, specimen collection, RT-PCR testing and vaccine verification using multiple methods; and 2) an administrative database of outpatients with a clinical respiratory viral panel combined with electronic immunization records. Odds ratios for likelihood of influenza infection by vaccination status were calculated using multivariable logistic regression. VE = (1 − aOR) × 100.

Results

Research participants were significantly younger (P < 0.001), more often white (69% vs. 59%; P < 0.001) than non-white and less frequently enrolled through the emergency department (35% vs. 72%; P < 0.001) than administrative database participants. VE was significant against all influenza and influenza A in each season and both seasons combined (37–49%). Point estimate differences between methods were evident, with higher VE in the research database, but insignificant due to low sample sizes. When enrollment sites were separately analyzed, there were significant differences in VE estimates for all influenza (66% research vs. 46% administrative P < 0.001) and influenza A (67% research vs. 49% administrative; P < 0.001) in the emergency department.

Conclusions:

The selection of the appropriate method for determining influenza vaccine effectiveness depends on many factors, including sample size, subgroups of interest, etc., suggesting that research estimates may be more generalizable. Other advantages of research databases for VE estimates include lack of clinician-related selection bias for testing and less misclassification of vaccination status. The advantages of the administrative databases are potentially shorter time to VE results and lower cost.

Mitigation of biases in estimating hazard ratios under non-sensitive and non-specific observation of outcomes-applications to influenza vaccine effectiveness

Background

Non-sensitive and non-specific observation of outcomes in time-to-event data affects event counts as well as the risk sets, thus, biasing the estimation of hazard ratios. We investigate how imperfect observation of incident events affects the estimation of vaccine effectiveness based on hazard ratios.

Methods

Imperfect time-to-event data contain two classes of events: a portion of the true events of interest; and false-positive events mistakenly recorded as events of interest. We develop an estimation method utilising a weighted partial likelihood and probabilistic deletion of false-positive events and assuming the sensitivity and the false-positive rate are known. The performance of the method is evaluated using simulated and Finnish register data.

Results

The novel method enables unbiased semiparametric estimation of hazard ratios from imperfect time-to-event data. False-positive rates that are small can be approximated to be zero without inducing bias. The method is robust to misspecification of the sensitivity as long as the ratio of the sensitivity in the vaccinated and the unvaccinated is specified correctly and the cumulative risk of the true event is small.

Conclusions

The weighted partial likelihood can be used to adjust for outcome measurement errors in the estimation of hazard ratios and effectiveness but requires specifying the sensitivity and the false-positive rate. In absence of exact information about these parameters, the method works as a tool for assessing the potential magnitude of bias given a range of likely parameter values.

Validating International Classification of Disease 10th Revision algorithms for identifying influenza and respiratory syncytial virus hospitalizations

Objective

Routinely collected health administrative data can be used to efficiently assess disease burden in large populations, but it is important to evaluate the validity of these data. The objective of this study was to develop and validate International Classification of Disease 10^th revision (ICD -10) algorithms that identify laboratory-confirmed influenza or laboratory-confirmed respiratory syncytial virus (RSV) hospitalizations using population-based health administrative data from Ontario, Canada.

Study design and setting

Influenza and RSV laboratory data from the 2014–15, 2015–16, 2016–17 and 2017–18 respiratory virus seasons were obtained from the Ontario Laboratories Information System (OLIS) and were linked to hospital discharge abstract data to generate influenza and RSV reference cohorts. These reference cohorts were used to assess the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of the ICD-10 algorithms. To minimize misclassification in future studies, we prioritized specificity and PPV in selecting top-performing algorithms.

Results

83,638 and 61,117 hospitalized patients were included in the influenza and RSV reference cohorts, respectively. The best influenza algorithm had a sensitivity of 73% (95% CI 72% to 74%), specificity of 99% (95% CI 99% to 99%), PPV of 94% (95% CI 94% to 95%), and NPV of 94% (95% CI 94% to 95%). The best RSV algorithm had a sensitivity of 69% (95% CI 68% to 70%), specificity of 99% (95% CI 99% to 99%), PPV of 91% (95% CI 90% to 91%) and NPV of 97% (95% CI 97% to 97%).

Conclusion

We identified two highly specific algorithms that best ascertain patients hospitalized with influenza or RSV. These algorithms may be applied to hospitalized patients if data on laboratory tests are not available, and will thereby improve the power of future epidemiologic studies of influenza, RSV, and potentially other severe acute respiratory infections.

Influenza vaccine effectiveness against all-cause mortality following laboratory-confirmed influenza in older adults, 2010-2011 to 2015-2016 seasons in Ontario, Canada

Background

Older adults are at increased risk of mortality from influenza infections. We estimated influenza vaccine effectiveness (VE) against mortality following laboratory-confirmed influenza.

Methods

Using a test-negative design study and linked laboratory and health administrative databases in Ontario, Canada, we estimated VE against all-cause mortality following laboratory-confirmed influenza for community-dwelling adults aged >65 years during the 2010–2011 to 2015–2016 influenza seasons.

Results

Among 54 116 older adults tested for influenza across the 6 seasons, 6837 died within 30 days of specimen collection. Thirteen percent (925 individuals) tested positive for influenza, and 50.6% were considered vaccinated for that season. Only 23.2% of influenza test-positive cases had influenza recorded as their underlying cause of death. Before and after multivariable adjustment, we estimated VE against all-cause mortality following laboratory-confirmed influenza to be 20% (95% confidence interval [CI], 8%–30%) and 20% (95% CI, 7%–30%), respectively. This estimate increased to 34% after correcting for influenza vaccination exposure misclassification. We observed significant VE against deaths following influenza confirmation during 2014–2015 (VE = 26% [95% CI, 5%–42%]). We also observed significant VE against deaths following confirmation of influenza A/H1N1 and A/H3N2, and against deaths with COPD as the underlying cause.

Conclusions

These results support the importance of influenza vaccination in older adults, who account for most influenza-associated deaths annually.

The impact of repeated vaccination using 10-year vaccination history on protection against influenza in older adults: a test-negative design study across the 2010/11 to 2015/16 influenza seasons in Ontario, Canada

Introduction

Annual influenza vaccination is recommended for older adults, but evidence regarding the impact of repeated vaccination has been inconclusive.

Aim

We investigated vaccine effectiveness (VE) against laboratory-confirmed influenza and the impact of repeated vaccination over 10 previous seasons on current season VE among older adults.

Methods

We conducted an observational test-negative study in community-dwelling adults aged > 65 years in Ontario, Canada for the 2010/11 to 2015/16 seasons by linking laboratory and health administrative data. We estimated VE using multivariable logistic regression. We assessed the impact of repeated vaccination by stratifying by previous vaccination history.

Results

We included 58,304 testing episodes for respiratory viruses, with 11,496 (20%) testing positive for influenza and 31,004 (53%) vaccinated. Adjusted VE against laboratory-confirmed influenza for the six seasons combined was 21% (95% confidence interval (CI): 18 to 24%). Patients who were vaccinated in the current season, but had received no vaccinations in the previous 10 seasons, had higher current season VE (34%; 95%CI: 9 to 52%) than patients who had received 1–3 (26%; 95%CI: 13 to 37%), 4–6 (24%; 95%CI: 15 to 33%), 7–8 (13%; 95%CI: 2 to 22%), or 9–10 (7%; 95%CI: −4 to 16%) vaccinations (trend test p = 0.001). All estimates were higher after correcting for misclassification of current season vaccination status. For patients who were not vaccinated in the current season, residual protection rose significantly with increasing numbers of vaccinations received previously.

Conclusions

Although VE appeared to decrease with increasing numbers of previous vaccinations, current season vaccination likely provides some protection against influenza regardless of the number of vaccinations received over the previous 10 influenza seasons.

Influenza vaccine effectiveness against hospitalization with laboratory-confirmed influenza in Greece: A pooled analysis across six seasons, 2013-2014 to 2018-2019

BACKGROUND

Monitoring seasonal influenza Vaccine Effectiveness (VE) is key to inform vaccination strategies and sustain uptake. Pooling data across multiple seasons increases precision and allows for subgroup analyses, providing more conclusive evidence. Our aim was to assess VE against hospitalization with laboratory-confirmed influenza in Greece over six seasons, from 2013 to 2014 to 2018-2019, using routinely collected surveillance data.

METHODS

Swab samples from hospitalized patients across the country were tested for influenza by RT-PCR. We used the test-negative design, with patients testing positive for influenza serving as cases and those testing negative serving as controls. VE was calculated as one minus the Odds Ratio (OR) for influenza vaccination, estimated by mixed-effects logistic regression and adjusted for age, sex, hospitalization type (being in intensive care or not), time from symptom onset to swabbing, and calendar time. Stratified estimates by age and hospitalization type were obtained, and also subgroup estimates by influenza type/subtype and season. Antigenic and genetic characterization of a subset of circulating influenza strains was performed.

RESULTS

A total of 3,882 test-positive cases and 5,895 test-negative controls were analyzed. Across all seasons, adjusted VE was 45.5% (95% CI: 31.6-56.6) against all influenza, 62.8% against A(H1N1)pdm09 (95% CI: 40.7-76.7), 28.2% against A(H3N2) (95% CI: 12.0-41.3) and 45.5% against influenza B (95% CI: 29.1-58.1). VE was slightly lower for patients aged 60 years and over, and similar between patients hospitalized inside or outside intensive care. Circulating A(H1N1)pdm09 and B strains were antigenically similar to the vaccine strains, whereas A(H3N2) were not.

CONCLUSION

Our results confirm the public health benefits from seasonal influenza vaccination, despite the suboptimal effectiveness against A(H3N2) strains. Continued monitoring of VE is essential, and routinely collected surveillance data can be valuable in this regard.

Using population-wide administrative and laboratory data to estimate type- and subtype-specific influenza vaccine effectiveness: a surveillance protocol

INTRODUCTION

The appropriateness of using routinely collected laboratory data combined with administrative data for estimating influenza vaccine effectiveness (VE) is still being explored. This paper outlines a protocol to estimate influenza VE using linked laboratory and administrative data which could act as a companion to estimates derived from other methods.

METHODS AND ANALYSIS

We will use the test-negative design to estimate VE for each influenza type/subtype and season. Province-wide individual-level records of positive and negative influenza tests at the Provincial Laboratory for Public Health in Alberta will be linked, by unique personal health numbers, to administrative databases and vaccination records held at the Ministry of Health in Alberta to determine covariates and influenza vaccination status, respectively. Covariates of interests include age, sex, immunocompromising chronic conditions and healthcare setting. Cases will be defined based on an individual's first positive influenza test during the season, and potential controls will be defined based on an individual's first negative influenza test during the season. One control for each case will be randomly selected based on the week the specimen was collected. We will estimate VE using multivariable logistic regression.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the University of Alberta's Health Research Ethics Board-Health Panel under study ID Pro00075997. Results will be disseminated by public health officials in Alberta.