Potential conflicts of interest in vaccine economics research: a commentary with a case study of pneumococcal conjugate vaccination

Vaccine confidence, public understanding and probity: time for a shift in focus?

Lack of vaccine confidence can contribute to drops in vaccination coverage and subsequent outbreaks of diseases like measles and polio. Low trust in vaccines is attributed to a combination of factors, including lack of understanding, vaccine scares, flawed policies, social media and mistrust of vaccine manufacturers, scientists and decision-makers. The COVID-19 crisis has laid bare societies' vulnerability to new pathogens and the critical role of vaccines (and their acceptability) in containing this and future pandemics. It has also put science at the forefront of the response, with several governments relying on academics to help shape policy and communicate with the public. Against this backdrop, protecting public trust in scientists and scientific output is arguably more important than ever. Yet, conflicts of interest (CoI) in biomedical research remain ubiquitous and harmful, and measures to curb them have had limited success. There is also evidence of bias in industry-sponsored vaccine studies and academics are voicing concerns about the risks of working in a CoI prevalent research area. Here, we set out to challenge established thinking with regard to vaccine confidence, by shifting the gaze from a deficit in public understanding towards probity in research relationships and suggesting an alternative and perhaps complementary strategy for addressing vaccine mistrust. We argue that a concerted effort needs to be made to revisit the norms that undergird contemporary vaccine research, coupled with a willingness of all stakeholders to reimagine those relationships with an emphasis on demonstrating trustworthiness and probity.

Sponsorship Bias in Base-Case Values and Uncertainty Bounds of Health Economic Evaluations? A Systematic Review of Herpes Zoster Vaccination

BACKGROUND

New health technologies are more likely adopted when they have lower incremental cost-effectiveness ratios (ICERs) and/or when their ICER is presented with more certainty. Industry-funded (IF) health economic evaluations use often more favorable base-case values, leading to more favorable conclusions.

PURPOSE

To study whether IF health economic evaluations of varicella-zoster virus vaccination in the elderly use more favorable base-case values and account for less uncertainty than non-industry-funded (NIF) evaluations.

METHODS

DATA SOURCE

PubMed. Data extracted: funding source; incremental cost per quality-adjusted life year (QALY) gained; vaccine price; study quality score; base-case values, uncertainty ranges, and data sources for influential parameters: duration of vaccine protection, utility loss due to herpes zoster (HZ) disease, percentage of HZ patients developing postherpetic neuralgia (PHN), and duration of PHN.

DATA SYNTHESIS

qualitative comparisons; Fisher exact test for differences in study quality score and 1-sided Mann-Whitney U tests for differences in base-case values and uncertainty ranges.

RESULTS

Despite using the same data sources, IF studies ( n = 10) assume a longer duration of vaccine protection ( U = 56, P = 0.03), have a higher percentage of HZ patients developing PHN ( U = 22/33, P = 0.02/0.03 for ages 60-64/65-69), and tend to use higher HZ utility loss than NIF studies ( n = 11) for their baseline. IF studies show lower ICERs given similar or even higher vaccine prices than NIF studies, consider less uncertainty around the duration of vaccine protection ( U = 8, P < 0.001), and tend to use less uncertainty around the duration of PHN. Yet their quality has been rated equally well, using current standard quality rating tools.

CONCLUSION

Researchers and decision makers should be aware of potential sponsorship bias in health economic evaluations, especially in the way source data are used to specify base-case values and uncertainty ranges.

Choosing between 7-, 10- and 13-valent pneumococcal conjugate vaccines in childhood: a review of economic evaluations (2006-2014)

BACKGROUND

Seven-valent pneumococcal conjugate vaccines (PCV7) have been used in children for more than a decade. Given the observed increase in disease caused by pneumococcal serotypes not covered by PCV7, an increasing number of countries are switching from 7-valent to 10- and 13-valent PCVs ("PCV10" and "PCV13"). Economic evaluations are important tools to inform decisions and price negotiations to make such a switch.

OBJECTIVE

This review aims to provide a critical assessment of economic evaluations involving PCV10 or PCV13, published since 2006.

METHODS

We searched Scopus, ISI Web of Science (SCI and SSCI) and Pubmed to retrieve, select and review relevant studies, which were archived between 1st January 2006 and 31st January 2014. The review protocol involved standard extraction of assumptions, methods, results and sponsorships from the original studies.

RESULTS

Sixty-three economic evaluations on PCVs published since January 2006 were identified. About half of these evaluated PCV10 and/or PCV13, the subject of this review. At current prices, both PCV13 and PCV10 were likely judged preferable to PCV7. However, the combined uncertainty related to price differences, burden of disease, vaccine effectiveness, herd and serotype replacement effects determine the preference base for either PCV10 or PCV13. The pivotal assumptions and results of these analyses also depended on which manufacturer sponsored the study.

CONCLUSION

A more thorough exploration of uncertainty should be made in future analyses on this subject, as we lack understanding to adequately model herd and serotype replacement effects to reliably predict the population impact of PCVs. The introduction of further improved PCVs in an environment of evolving antibiotic resistance and under the continuing influence of previous PCVs implies that the complexity and data requirements for relevant analyses will further increase. Decision makers using these analyses should not just rely on an analysis from a single manufacturer.

Cost effectiveness of the new pneumococcal vaccines: a systematic review of European studies

INTRODUCTION

Diseases caused by Streptococcus pneumoniae (pneumococcus) are a major global public health problem. Despite their importance, information on the burden of the different pneumococcal diseases is limited and estimates vary widely.

OBJECTIVE AND METHODS

We critically reviewed the full economic evaluations (FEEs) on the new pneumococcal conjugate vaccines (PCVs) conducted in the European Union (EU) to assess their potential contribution to public decision making. We selected the FEEs focussed on PCV-10 and PCV-13 and published in English from January 2007 until June 2013. We screened the selected articles to assess their main methodological features using a common checklist composed of epidemiological, clinical and economic items.

RESULTS

All the ten studies selected were based on modelling and the time horizon was always long term. Two studies focused on adults, the remaining eight on infants. Only one study based herd immunity on national data, eight used foreign data or modelling and the last did not consider it. National prices and tariffs were claimed to be sources for unit costs in all studies; however, half of them assumed price parity when one vaccine was not yet marketed, and the figures varied within the countries where more than one study was conducted. Conclusions supported the economic utility of pneumococcal vaccination in all studies, raising some concern only in (i) the independent study, which found that PCV-13 was borderline cost effective, and (ii) the study sponsored by both manufacturers, which estimated an incremental ratio slightly above the national threshold for both PCV-10 and PCV-13.

CONCLUSION

The European studies we analysed are mostly based on weak sources of data. Because of the limited information on vaccine effectiveness and lack of epidemiological and economic data, the need for extensive recourse to assumptions leads to great within- and between-study variability generated by authors' choices.

When are statins cost-effective in cardiovascular prevention? A systematic review of sponsorship bias and conclusions in economic evaluations of statins

Background

We examined sponsorship of published cost-effectiveness analyses of statin use for cardiovascular (CV) prevention, and determined whether the funding source is associated with study conclusions.

Methods and Findings

We searched PubMed/MEDLINE (up to June 2011) to identify cost-effectiveness analyses of statin use for CV prevention reporting outcomes as incremental costs per quality-adjusted life years (QALY) and/or life years gained (LYG). We examined relationships between the funding source and the study conclusions by means of tests of differences between proportions. Seventy-five studies were included. Forty-eight studies (64.0%) were industry-sponsored. Fifty-two (69.3%) articles compared statins versus non-active alternatives. Secondary CV prevention represented 42.7% of articles, followed by primary CV prevention (38.7%) and both (18.7%). Overall, industry-sponsored studies were much less likely to report unfavourable or neutral conclusions (0% versus 37.1%; p<0.001). For primary CV prevention, the proportion with unfavourable or neutral conclusions was 0% for industry-sponsored studies versus 57.9% for non-sponsored studies (p<0.001). Conversely, no statistically significant differences were identified for studies evaluating secondary CV prevention (0% versus 12.5%; p=0.222). Incremental costs per QALY/LYG estimates reported in industry-sponsored studies were generally more likely to fall below a hypothetical willingness-to-pay threshold of US $50,000.

Conclusions

Our systematic analysis suggests that pharmaceutical industry sponsored economic evaluations of statins have generally favored the cost-effectiveness profile of their products particularly in primary CV prevention.

Pneumococcal conjugate vaccination in Canadian infants and children younger than five years of age: Recommendations and expected benefits

INTRODUCTION

Streptococcus pneumoniae infection may result in invasive pneumococcal disease (IPD), such as bacteremia, meningitis and bacteremic pneumonia, or in non-IPD, such as pneumonia, sinusitis and otitis media. In June 2001, a heptavalent pneumococcal conjugate vaccine (PCV7) (Prevnar, Wyeth Pharmaceuticals, Canada) was approved for use in children in Canada. The objective of the present paper is to review S pneumoniae-induced disease incidence and vaccine recommendations in Canadian infants and children younger than five years of age. Particular attention is given to the expected benefits of vaccination in Canada based on postmarketing data and economic modelling.

METHODS

Searches were performed on PubMed and Web of Science databases and specific Canadian journals using the key words 'pneumococc*', 'vaccine', 'conjugate', 'infant' and 'Canadian'.

RESULTS AND DISCUSSION

PCV7 appears to be safe and effective against IPD and non-IPD in children younger than five years of age and, more importantly, in children younger than two years of age (who are at highest risk for IPD). An examination of postmarketing data showed a reduction in incidence of pneumococcal disease in age groups that were vaccinated and in older age groups, indicating the likelihood of herd protection. Concurrently, there was a reduction in the occurrence of antimicrobial-resistant isolates.

CONCLUSIONS

The results from the present review suggest that PCV7 is currently benefiting Canadian children and society by lowering S pneumoniae-associated disease. Additional gains from herd protection and further reductions in antimicrobial resistance will be achieved as more Canadian children younger than five years of age are routinely vaccinated with PCV7.

Burden of disease and economic evaluation of healthcare interventions: are we investigating what really matters?

Background

The allocation of limited available healthcare resources demands an agreed rational allocation principle and the consequent priority setting. We assessed the association between economic evaluations of healthcare interventions published in Spain (1983-2008) and the disease burden in the population.

Methods

Electronic databases (e.g., PubMed/MEDLINE, SCOPUS, ISI Web of Knowledge, CRD, IME, IBECS) and reports from health technology assessment agencies were systematically reviewed. For each article, multiple variables were recorded such as: year and journal of publication, type of study, health intervention targetted, perspective of analysis, type of costs and sources of information, first author's affiliation, explicit recommendations aimed at decision-making, and the main disease cause to which the intervention was addressed. The following disease burden measures were calculated: years of life lost (YLLs), years lived with disability (YLDs), disability-adjusted life years (DALYs), and mortality by cause. Correlation and linear regression models were fitted.

Results

Four hundred and seventy-seven economic evaluations were identified. Cardiovascular diseases (15.7%), infectious diseases (15.3%), malignant neoplasms (13.2%), and neuropsychiatric diseases (9.6%) were the conditions most commonly addressed. Accidents and injuries, congenital anomalies, oral conditions, nutritional deficiencies and other neoplasms were the categories with a lowest number of studies (0.6% for each of them). For the main disease categories (n = 20), a correlation was seen with: mortality 0.67 (p = 0.001), DALYs 0.63 (p = 0.003), YLLs 0.54 (p = 0.014), and YLDs 0.51 (p = 0.018). By disease sub-categories (n = 51), the correlations were generally low and non statistically significant.

Conclusions

Examining discrepancies between economic evaluations in particular diseases and the overall burden of disease helps shed light on whether there are potentially over- and under-investigated areas. The approach taken could help policy-makers understand whether resources for economic evaluation are being allocated by using summary measures of population health.

Sponsorship-related outcome selection bias in published economic studies of triptans: systematic review

BACKGROUND

Economic studies funded by the pharmaceutical industry are more likely to report favorable results and recommendations for the sponsor's product than are studies funded by nonindustry establishments.

PURPOSE

To determine whether clinical outcome data obtained from the same meta-analyses are used differently in various economic studies of oral triptans and whether there is an association between the study sponsorship and the choice of clinical outcome measure.

DATA SOURCES

Economic studies of triptans were identified by updating a previously published systematic review.

STUDY SELECTION

Twelve studies that used the same meta-analyses as the source of clinical outcome data were identified.

DATA EXTRACTION

Two independent reviewers extracted the essential data from the identified studies.

DATA SYNTHESIS

In the 12 appraised studies, 9 alternative measures of effectiveness were derived from the same meta-analyses. Eleven studies were industry-related, and in these the selected clinical outcome consistently favored the sponsor's product. Also the reported results suggested that the sponsor's product was more cost-effective than the competitors' products.

LIMITATIONS

The cost-effectiveness of triptans is dependent on both the definition of clinical effectiveness and the treatment-related costs. Only bias related to the selection of the clinical outcome measure has been taken into account in this review.

CONCLUSIONS

The results of published economic studies of triptans are conflicting and biased. There is a tendency to select clinical outcome measures that support the sponsor's product. This leads to concern about the possible poor applicability of these results in decision making.

Industry involvement and baseline assumptions of cost-effectiveness analyses: diagnostic accuracy of the Papanicolaou test

BACKGROUND

Industry involvement has been associated with more favourable cost-effectiveness ratios in cost-effectiveness analyses, but the mechanisms for this association are unclear. We evaluated whether the assumed accuracy of the Papanicolaou (Pap) test was correlated with the features of cost-effectiveness analysis studies.

METHODS

We searched PubMed (last updated April 2010) for cost-effectiveness analysis studies in which at least one strategy involved the Pap test for cervical cancer. We assessed the baseline assumed diagnostic sensitivity and specificity of the Pap test in each study and the association of these values with three levels of manufacturer involvement in the study.

RESULTS

Among 88 analyzed cost-effectiveness analysis studies, the assumed sensitivity of the Pap test was lower in studies with manufacturer-affiliated authors, manufacturer funding or manufacturer-related competing interests versus studies without (mean sensitivity 60% v. 70%, p < 0.001). The assumed specificity of the Pap test was lower in cost-effectiveness analyses involving new screening tests (mean 93% v. 96%, p = 0.016). The assumed specificity did not differ between trials with manufacturer involvement versus those without (mean 95% v. 95%, p = 0.755).

INTERPRETATION

The results of cost-effectiveness analyses may be affected by a downgrading of the assumed diagnostic accuracy of the standard Pap test against which newer tests or interventions are compared. New technology then seems to have more favourable results against a straw-man comparator.

WHO Guide for standardisation of economic evaluations of immunization programmes

Traditional EPI vaccines are considered to be among the most efficient uses of scarce health care resources. Today, there are many under-used and new vaccines available. In the short- to medium-term, these vaccines will not cost the few cents per dose the traditional vaccines do, but will be 'multi-dollar' vaccines. Decision-makers will need information, among other things, on their relative cost-effectiveness. A number of reviews have indicated that there is scope for improving the transparency, completeness and comparability of economic evaluations of vaccination programmes. Thus, there is a need to improve the quality of economic evaluations of vaccination programmes. Adherence to general guidelines would increase the quality, interpretability and transferability of future analyses. However, there is reason to believe that there might also be a need for more specific advice for vaccination programmes. For example, there are inconsistencies in the methods used to estimate the future benefits of vaccination programmes and the relative efficiency of these programmes can be sensitive to some of the more controversial aspects of general guidelines, such as the inclusion of indirect costs and the discounting of health outcomes. This guide has been developed in order to meet the needs of decision-makers for relevant, reliable and consistent economic information. They aim to provide clear and concise, practical and high quality guidance for those who conduct economic evaluations.

Cost-effectiveness of pneumococcal polysaccharide vaccination in adults: a systematic review of conclusions and assumptions

Streptococcus pneumoniae infections in adults are associated with substantial morbidity, mortality, and costs. A literature review was conducted to identify strengths and limitations of the cost-effectiveness of pneumococcal polysaccharide vaccine studies. A comparative analysis of the impact of model parameters on cost-effectiveness ratios was complemented by systematic assessment of the studies. We identified 11 economic evaluations of pneumococcal polysaccharide vaccine (PPV-23) in adults. In general, all 11 studies found that vaccination with PPV-23 is a cost-effective, and in some cases a cost-saving strategy for the prevention of invasive pneumococcal disease (IPD). The systematic assessment indicated that the results of the cost-effectiveness studies of PPV-23 are influenced by the values applied to vaccine efficacy, IPD incidence and case-fatality.

Medical societies' recommendations for immunization with Human Papillomavirus vaccine and disclosure of conflicts of interests

OBJECTIVE

To review the recommendations on Human Papillomavirus (HPV) vaccination issued by different medical societies, as well as disclosures of any conflict of interests regarding such recommendations.

METHODS

The search for recommendations was mainly conducted through the Internet, together with a bibliography search on Pubmed (November 2008). The countries were selected to encompass a broad range of healthcare systems and income levels.

RESULTS

In all, 18 documents were identified: 4 from the U.S., 5 from Canada, and 1 from France (all 10 in favor of recommending vaccination), 5 from Spain (3 in favor of vaccination and 2 recommending no vaccination until further evidence of the vaccine effectiveness to prevent cervical cancer becomes available), 2 from Argentina (one in favor of vaccination and another pointing to the missing information on the vaccine's cost-effectiveness), and 1 from Chile (recommending no vaccination until more information becomes available). Only two documents disclose specific conflicts of interests for authors (American Cancer Society and Chilean Working Group on HPV). One of the Canadian documents did not include any conflict of interest statement, although Merck and GSK are listed among the sponsors.

CONCLUSIONS

Disclosure of conflicts of interest in documents where medical societies issue recommendations on HPV vaccination is very unusual. However, lack of disclosure is more frequent (near twice) when recommendations are in favor of the vaccination.

Reviewing the cost effectiveness of rotavirus vaccination: the importance of uncertainty in the choice of data sources

Published health economic evaluations of rotavirus vaccination up until July 2008 were reviewed. We assess whether differences in the results and conclusions of the various studies are due to differences in methodological and modelling choices, and/or the way parameter uncertainty was taken into account, or whether these are merely the result of genuine country/region-specific differences. No unambiguous single answer emerged as to whether universal rotavirus vaccination is or is not cost effective. The relevance and merits of each study need to be assessed within its context. This is illustrated by the fact that comparisons of different analyses for a single country show that one of the most important explanations for the variations in results and conclusions seems to be the use of different information sources for the estimation of input parameters. Future studies should gather reliable and relevant information focusing on the most influential input parameters, i.e. rotavirus mortality (and efficacy against rotavirus deaths) for low- and middle-income countries, and a range of variables for high-income countries, including the incidence and cost of rotavirus hospitalization. Moreover, if no information is available for an important input parameter, the impact of a wide range of values should be explored rather than excluding it from the analysis or specifying a single-point value. Furthermore, future analyses may have to consider ways of accounting for herd immunity (e.g. by using a dynamic model).

Pharmaceutical company funding and its consequences: a qualitative systematic review

This article systematically reviews published studies of the association of pharmaceutical industry funding and clinical trial results, as well a few closely related studies. It reviews two earlier results, and surveys the recent literature. Results are clear: Pharmaceutical company sponsorship is strongly associated with results that favor the sponsors' interests.

Do we fully understand the economic value of vaccines?

Although many vaccination strategies are cost-effective, some of the newer vaccines are more expensive and may raise concerns about value for money. However, standard methods of economic evaluation may not adequately assess the true cost-effectiveness of vaccines, with the consequent under-application of vaccine strategies. Therefore, this paper reviews the evidence on cost-effectiveness of vaccines and vaccination strategies for pneumococcal disease, meningococcal disease, Hepatitis A and influenza. In each case the evidence is considered alongside existing vaccination policies in the major developed countries. The paper also highlights areas where traditional economic evaluations may not adequately reflect the value of vaccines.

Enhanced decision support for policy makers using a web interface to health-economic models—Illustrated with a cost-effectiveness analysis of nation-wide infant vaccination with the 7-valent pneumococcal conjugate vaccine in the Netherlands

We have developed a web-based user-interface (web interface) to enhance the usefulness of health-economic evaluations to support decision making (http://pcv.healtheconomics.nl). It allows the user to interact with a health-economic model to evaluate predefined and customized scenarios and perform sensitivity analysis. To explore its usefulness, it was applied to an evaluation of cost-effectiveness of nation-wide infant vaccination with the 7-valent pneumococcal conjugate vaccine (PCV7), that was used to support a policy decision on the inclusion of PCV7 in the national vaccination program (NVP) of the Netherlands. We used a decision-tree analytic model to project the impact of infant vaccination with four doses of PCV7 on an annual cohort of infants born in the Netherlands. The base-case analysis includes the beneficial effects on unvaccinated individuals (herd protection). Additional scenarios varying the number of doses, discount rate for effects and the number of serotypes in the vaccine were evaluated and can be analysed on the web. Our model projects a base-case incremental cost-effectiveness ratio (iCER) of euro14,000 (95% uncertainty interval (UI): 9,800-20,200) per quality adjusted life year (QALY) or euro15,600 (95% UI: 11,100-23,900) per life year gained (LYG).

The burden of pneumococcal disease in the Canadian population before routine use of the seven-valent pneumococcal conjugate vaccine

BACKGROUND

In the United States, implementation of the seven-valent conjugate vaccine into childhood immunization schedules has had an effect on the burden of pneumococcal disease in all ages of the population. To evaluate the impact in Canada, it is essential to have an estimate of the burden of pneumococcal disease before routine use of the vaccine.

METHODS

The incidence and costs of pneumococcal disease in the Canadian population in 2001 were estimated from various sources, including published studies, provincial databases and expert opinion.

RESULTS

In 2001, there were 565,000 cases of pneumococcal disease in the Canadian population, with invasive infections representing 0.7%, pneumonia 7.5% and acute otitis media 91.8% of cases. There were a total of 3000 deaths, mainly as a result of pneumonia and largely attributable to the population aged 65 years or older. There were 54,330 life-years lost due to pneumococcal disease, and 37,430 quality-adjusted life-years lost due to acute disease, long-term sequelae and deaths. Societal costs were estimated to be $193 million (range $155 to $295 million), with 82% borne by the health system and 18% borne by families. Invasive pneumococcal infections represented 17% of the costs and noninvasive infections represented 83%, with approximately one-half of this proportion attributable to acute otitis media and myringotomy.

CONCLUSIONS

The burden of pneumococcal disease before routine use of the pneumococcal conjugate vaccine was substantial in all age groups of the Canadian population. This estimate provides a baseline for further analysis of the direct and indirect impacts of the vaccine.

Complexity and reflexivity: two important issues for economic evaluation in health care

Economic evaluations are analytic techniques to assess the relative costs and consequences of health care programmes and technologies. Their role is to provide rigorous data to inform the health care decision-making process. Economic evaluation may oversimplify complex health care decisions. These analyses often ignore important health consequences, contextual elements, relationships or other relevant modifying factors, which might not be appropriate in a multi-objective, multi-stakeholder issue. One solution would be to develop a new paradigm based on the issues of perspective and context. Complexity theory may provide a useful conceptual framework for economic evaluation in health care. Complexity thinking develops an awareness of issues including uncertainty, contextual issues, multiple perspectives, broader societal involvement, and transdisciplinarity. This points the economic evaluation field towards an accountability and epistemology based on pluralism and uncertainty, requiring new forms of lay-expert engagement and roles of lay knowledge into decision-making processes. This highlights the issue of reflexivity in economic evaluation in health care. A reflexive approach would allow economic evaluators to analyze how objective structures and subjective elements influence their practices. In return, this would point increase the integrity and reliability of economic evaluations. Reflexivity provides opportunities for critically thinking about the organization and activities of the intellectual field, and perhaps the potential of moving in new, creative directions. This paper argues for economic evaluators to have a less positivist attitude towards what is useful knowledge, and to use more imagination about the data and methodologies they use.

Convincing or confusing? Economic evaluations of childhood pneumococcal conjugate vaccination--a review (2002-2006)

We review 15 economic analyses of pneumococcal conjugate vaccines, published between 2002 and 2006, in terms of methodology, assumptions, results and conclusions. We found a great diversity in assumptions (eg, vaccine efficacy parameters, incidence rates for both invasive and non-invasive disease) mainly due to local variation in data and opinions. Accordingly, the results varied greatly, from total net savings to over euro 100,000 per discounted QALY gained. The cost of the vaccination program (determined by price per dose and schedule (4 or 3 doses, or fewer)), and likely herd immunity impacts are highly influential though rarely explored in these published studies. If the net long-term impact (determined by a mixture of effects related to herd immunity, serotype replacement, antibiotic resistance and cross reactivity) remains beneficial and if a 3-dose schedule confers near-equivalent protection to a 4-dose schedule, the cost-effectiveness of PCV7 vaccination programs can be viewed as attractive in developed countries.