A Systematic Review of Economic Evaluation Methodologies Between Resource-Limited and Resource-Rich Countries: A Case of Rotavirus Vaccines

Economic evaluations of non-communicable diseases conducted in Sub-Saharan Africa: a critical review of data sources

BACKGROUND

Policymakers in sub-Saharan Africa (SSA) face challenging decisions regarding the allocation of health resources. Economic evaluations can help decision makers to determine which health interventions should be funded and or included in their benefits package. A major problem is whether the evaluations incorporated data from sources that are reliable and relevant to the country of interest. We aimed to review the quality of the data sources used in all published economic evaluations for cardiovascular disease and diabetes in SSA.

METHODS

We systematically searched selected databases for all published economic evaluations for CVD and diabetes in SSA. We modified a hierarchy of data sources and used a reference case to measure the adherence to reporting and methodological characteristics, and descriptively analysed author statements.

RESULTS

From 7,297 articles retrieved from the search, we selected 35 for study inclusion. Most were modelled evaluations and almost all focused on pharmacological interventions. The studies adhered to the reporting standards but were less adherent to the methodological standards. The quality of data sources varied. The quality level of evidence in the data domains of resource use and costs were generally considered of high quality, with studies often sourcing information from reliable databases within the same jurisdiction. The authors of most studies referred to data sources in the discussion section of the publications highlighting the challenges of obtaining good quality and locally relevant data.

CONCLUSIONS

The data sources in some domains are considered high quality but there remains a need to make substantial improvements in the methodological adherence and overall quality of data sources to provide evidence that is sufficiently robust to support decision making in SSA within the context of UHC and health benefits plans. Many SSA governments will need to strengthen and build their capacity to conduct economic evaluations of interventions and health technology assessment for improved priority setting. This capacity building includes enhancing local infrastructures for routine data production and management. If many of the policy makers are using economic evaluations to guide resource allocation, it is imperative that the evidence used is of the feasibly highest quality.

Systematic review of rotavirus vaccination cost-effectiveness in high income settings utilising dynamic transmission modelling techniques

PURPOSE

This systematic review presents cost-effectiveness studies of rotavirus vaccination in high-income settings based on dynamic transmission modelling to inform policy decisions about implementing rotavirus vaccination programmes.

METHODS

We searched CEA Registry, MEDLINE, Embase, Health Technology Assessment Database, Scopus, and the National Health Service Economic Evaluation Database for studies published since 2002. Full economic evaluation studies based on dynamic transmission models, focusing on high-income countries, live oral rotavirus vaccine and children ≤ 5 years of age were eligible for inclusion. Included studies were appraised for quality and risk of bias using the Consensus on Health Economic Criteria (CHEC) list and the Philips checklist. The review protocol was prospectively registered with PROSPERO (CRD42020208406).

RESULTS

A total of four economic evaluations were identified. Study settings included England and Wales, France, Norway, and the United States. All studies compared either pentavalent or monovalent rotavirus vaccines to no intervention. All studies were cost-utility analyses that reported incremental cost per quality-adjusted life year (QALY) gained. Included studies consistently concluded that rotavirus vaccination is cost-effective compared with no vaccination relative to the respective country's willingness to pay threshold when herd protection benefits are incorporated in the modelling framework.

CONCLUSIONS

Rotavirus vaccination was found to be cost-effective in all identified studies that used dynamic transmission models in high-income settings where child mortality rates due to rotavirus gastroenteritis are close to zero. Previous systematic reviews of economic evaluations considered mostly static models and had less conclusive findings than the current study. This review suggests that modelling choices influence cost-effectiveness results for rotavirus vaccination. Specifically, the review suggests that dynamic transmission models are more likely to account for the full impact of rotavirus vaccination than static models in cost-effectiveness analyses.

Analyses of the return on investment of public health interventions: a scoping review and recommendations for future studies

Return on investment (ROI) analysis is increasingly being used for evaluating the value for money of public health interventions. Given its potential role for informing health policies, it is important that there is a more comprehensive understanding of ROI analysis within the global health field. To address this gap in the literature, we conducted a scoping review of recent research articles reporting an ROI metric for a health intervention within the public sector in any country setting. The database search was limited to literature published in English and studies published between 1 January 2018 and 14 June 2021. Uses and settings where the ROI metric is being applied, key methodological features of the calculations and the types of economic benefits included were extracted. 118 relevant studies were included within this scoping review. We found that ROI analyses of health interventions differed between those that only included fiscal savings (such as prevented medical expenses) and those which incorporated a wider range of benefits (such as monetised health benefits). This highlights the variation in the definition of ROI analyses and supports the finding that ROI analyses are used for a range of different research questions/purposes within the healthcare sector. We also found that the methodologies used in ROI calculations were inconsistent and often poorly reported. This review demonstrates that there is notable variation in the methodology surrounding recent ROI calculations of healthcare interventions, as well as the definition of ROI analysis. We recommend that ROI metrics should be carefully interpreted before they are used to inform policy decisions regarding the allocation of healthcare resources. To improve the consistency of future studies, we also set out recommended use cases for ROI analysis and a reporting checklist.

Use of Utility and Disability Weights in Economic Evaluation of Pediatric Vaccines

OBJECTIVE

To describe how utility weights and disability weights have been used in the context of quality-adjusted life-years (QALYs) and disability-adjusted life-years (DALYs)-based cost-effectiveness analysis (CEA) of pediatric vaccines for infectious diseases and assess the comparability between weights.

METHODS

A systematic review was conducted of CEAs of pediatric vaccines for 16 infectious diseases, published between January 2013 and December 2020 and using QALYs or DALYs as outcome measure. Data on values and sources of weights for the estimation of QALYs and DALYs were extracted from studies and compared across similar health states. Reporting was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement.

RESULTS

Out of 2154 articles identified, 216 CEAs met our inclusion criteria. Of the included studies, 157 used utility weights and 59 used disability weights in their valuation of health states. In QALY studies, the source, background, who's preferences (adults'/children's) were applied and adjustments made to utility weights were poorly reported. In DALY studies, the Global Burden of Disease study was most often referenced. Valuation weights for similar health states varied within QALY studies and between DALY and QALY studies, but no systematic differences were identified.

CONCLUSIONS

This review identified considerable gaps in the way valuation weights are used and reported on in CEA. The nonstandardized use of weights may lead to different conclusions about cost-effectiveness of vaccines and policy decisions.

Cost-effectiveness of rotavirus vaccination in children under five years of age in 195 countries: A meta-regression analysis

Background

Rotavirus caused an estimated 151,714 deaths from diarrhea among children under 5 in 2019. To reduce mortality, countries are considering adding rotavirus vaccination to their routine immunization program. Cost-effectiveness analyses (CEAs) to inform these decisions are not available in every setting, and where they are, results are sensitive to modeling assumptions, especially about vaccine efficacy. We used advances in meta-regression methods and estimates of vaccine efficacy by location to estimate incremental cost-effectiveness ratios (ICERs) for rotavirus vaccination in 195 countries.

Methods

Beginning with Tufts University CEA and Global Health CEA registries we used 515 ICERs from 68 articles published through 2017, extracted 938 additional one-way sensitivity analyses, and excluded 33 ICERs for a sample of 1,418. We used a five-stage, mixed-effects, Bayesian metaregression framework to predict ICERs, and logistic regression model to predict the probability that the vaccine was cost-saving. For both models, covariates were vaccine characteristics including efficacy, study methods, and country-specific rotavirus disability-adjusted life-years (DALYs) and gross domestic product (GDP) per capita. All results are reported in 2017 United States dollars.

Results

Vaccine efficacy, vaccine cost, GDP per capita and rotavirus DALYs were important drivers of variability in ICERs. Globally, the median ICER was $2,289 (95% uncertainty interval (UI): $147–$38,993) and ranged from $85 per DALY averted (95% UI: $13–$302) in Central African Republic to $70,599 per DALY averted (95% UI: $11,030–$263,858) in the United States. Among countries eligible for support from Gavi, The Vaccine Alliance, the mean ICER was $255 per DALY averted (95% UI: $39–$918), and among countries eligible for the PAHO revolving fund, the mean ICER was $2,464 per DALY averted (95% UI: $382–$3,118).

Conclusion

Our findings incorporate recent evidence that vaccine efficacy differs across locations, and support expansion of rotavirus vaccination programs, particularly in countries eligible for support from Gavi, The Vaccine Alliance.

Economic analysis for national immunization program planning: A case of rotavirus vaccines in Burundi

BACKGROUND

In Burundi, diarrhea is the third leading cause of mortality among children under five years of age. This study conducted an economic analysis of rotavirus vaccination program in Burundi.

METHODS

A Markov model was constructed to simulate clinical and economic outcomes for the 2019 birth cohort for a period of 5 years. Empirical costing data were collected. ICER per episode averted, ICER per death averted, ICER per DALY averted, net present value, and budget impact were estimated for 4 brands of WHO pre-qualified rotavirus vaccines. One-way and probabilistic sensitivity analysis as well as threshold analysis were performed.

RESULTS

For the base case, while all four WHO pre-qualified rotavirus vaccines were cost-effective (ICER < 3 GDP per capita), three of them (i.e. Rotarix, Rotavac and Rotasiil) were very cost-effective (ICER <1 GDP per capita) from both the provider and societal perspectives. The vaccines were still very cost-effective at a price increase of up to US$ 5.09, US$ 3.16, US$ 3.89, and US$ 2.69 for Rotarix, RotaTeq, Rotavac, and Rotasiil, respectively. Probabilistic sensitivity analysis indicated that vaccination programs with Rotarix, RotaTeq, Rotavac, and Rotasiil are cost-effective at a probability of 93.8%, 27%, 99.1%, and 92.7%, respectively. All vaccination programs were cost-beneficial with a net present value in the range of US$ 5,214,912 and US$ 11,135,997.The budget required to run the vaccination program, estimated with break-even prices, ranged between US$ 42,249,498 and US$ 53,487,935 for a 5-year time period. When compared to the GDP of Burundi in 2019, these are are less than 2%.

CONCLUSION

The rotavirus vaccine is good value for money. Findings from this study offer evidence on potential economic benefits as well as the required budget for different rotavirus vaccination programs, which could be useful for future planning related to rotavirus vaccine coverage in Burundi after graduation from GAVI.

Cost-effectiveness evaluations of the 9-Valent human papillomavirus (HPV) vaccine: Evidence from a systematic review

INTRODUCTION

The World Health Organization (WHO) recommends that human papillomavirus (HPV) vaccination programs are established to be cost-effective before implementation. WHO recommends HPV vaccination for girls aged 9-13 years to tackle the high burden of cervical cancer. This review examined the existing evidence on the cost-effectiveness of the 9-valent HPV vaccine within a global context.

METHODS

The literature search covering a period of January 2000 to 31 July 2019 was conducted in PubMed and Scopus bibliographic databases. A combined checklist (i.e., WHO, Drummond and CHEERS) was used to examine the quality of eligible studies. A total of 12 studies were eligible for this review and most of them were conducted in developed countries.

RESULTS

Despite some heterogeneity in approaches to measure cost-effectiveness, ten studies concluded that 9vHPV vaccination was cost-effective and two did not. The addition of adolescent boys into immunisation programs was cost effective when vaccine price and coverage was comparatively low. When vaccination coverage for females was more than 75%, gender neutral HPV vaccination was less cost-effective than vaccination targeting only girls aged 9-18 years. Multi cohort immunization approach was found cost-effective in the age range of 9-14 years. However, the upper age limit at which vaccination was found not cost-effective requires further evaluation. This review identified duration of vaccine protection, time horizon, vaccine price, coverage, healthcare costs, efficacy and discounting rates as the most dominating parameters in determining cost-effectiveness.

CONCLUSIONS

These findings have implications in extending HPV immunization programs whether switching to the 9-valent vaccine or the inclusion of adolescent boys' vaccination or extending the age of vaccination. Further, this review also supports extending vaccination programs to low-resource settings where vaccine prices are competitive, donor funding is available, burden of cervical cancer is high and screening options are limited.

Systematic Review and Meta-Analysis of Cost-effectiveness of Rotavirus Vaccine in Low-Income and Lower-Middle-Income Countries

BACKGROUND

Rotavirus causes morbidity and mortality in children particularly in low-income countries (LICs) and lower-middle-income countries (LMICs). This systematic review and meta-analysis aimed to assess cost-effectiveness of rotavirus vaccine in LICs and LMICs.

METHODS

Relevant studies were identified from PubMed and Scopus from their inception to January 2019. Studies were eligible if they assessed the cost-effectiveness of rotavirus vaccine in children in LICs and LMICs and reported incremental cost-effectiveness ratios. Risk of bias and quality assessment was assessed based on the Consolidated Health Economic Evaluation Reporting Standard checklist. Incremental net benefits (INBs) were estimated, and meta-analysis based on the DerSimonian and Laird method was applied to pool INBs across studies.

RESULTS

We identified 1614 studies, of which 28 studies (29 countries) were eligible and conducted using cost-utility analysis in LICs (n = 8) and LMICs (n = 21). The pooled INB was estimated at $62.17 (95% confidence interval, $7.12-$117.21) in LICs, with a highly significant heterogeneity (χ2 = 33.96; df = 6; P < .001; I 2 = 82.3%), whereas the pooled INB in LMICs was $82.46 (95% confidence interval, $54.52-$110.41) with no heterogeneity (χ2 = 8.46; df = 11; P = .67; I 2 = 0%).

CONCLUSIONS

Rotavirus vaccine would be cost-effective to introduce in LICs and LMICs. These findings could aid decision makers and provide evidence for introduction of rotavirus vaccination.

Systematic review of cost-effectiveness studies of human papillomavirus (HPV) vaccination: 9-Valent vaccine, gender-neutral and multiple age cohort vaccination

BACKGROUND

The success of human papillomavirus (HPV) national immunization program depends on effective strategies in optimizing the uptake of HPV vaccine. Given the increasing number of economic evaluations, this review was conducted to update the economic evidence on HPV vaccination, by focusing on: (i) 9-valent vaccine compared to bi- or quadrivalent vaccine; (ii) gender-neutral vaccination compared to female only vaccination; and (iii) multiple age cohort immunization compared to single age cohort immunization.

METHODS

Searches were performed until June 2016 using 4 databases: PubMed; Embase; Cochrane Library; and LILACS. The combined WHO, Drummond and CHEERS checklist were used to evaluate the quality of included studies.

RESULTS

Thirty-four studies were included in the review and most of them were conducted in high-income countries. The inclusion of adolescent boys in vaccination program was found to be cost-effective if vaccine price and coverage was low. When coverage for female was above 75%, gender-neutral vaccination was less cost-effective than when targeting only girls aged 9-18 years. Current evidence does not show conclusive proof of greater cost-effectiveness of 9-valent vaccine compared to the older HPV vaccines as the price for 9-valent vaccine was still uncertain. Multicohort immunization strategy was cost-effective in the age range 9-14 years but the upper age limit at which vaccination was no longer cost-effective needs to be further investigated. Key influential parameters identified were duration of vaccine protection, vaccine price, coverage, and discounting rates.

CONCLUSIONS

These findings are expected to support policy-makers in making recommendations for HPV immunization programs on either switching to the 9-valent vaccine or inclusion of adolescent boys' vaccination or extending the age of vaccination.

Identifying priority technical and context-specific issues in improving the conduct, reporting and use of health economic evaluation in low- and middle-income countries

Background

The use of economic evaluation in healthcare policies and decision-making, which is limited in low- and middle-income countries (LMICs), might be promoted through the improvement of the conduct and reporting of studies. Although the literature indicates that there are many issues affecting the conduct, reporting and use of this evidence, it is unclear which factors should be prioritised in finding solutions. This study aims to identify the top priority issues that impede the conduct, reporting and use of economic evaluation as well as potential solutions as an input for future research topics by the international Decision Support Initiative and other movements.

Methods

A survey on issues regarding the conduct, reporting and use of economic evaluation as well as on potential solutions was conducted using an online questionnaire among researchers who have experience in conducting economic evaluations in LMICs. The respondents were requested to consider the list of issues provided, rank the most important ones and propose solutions. A scoring system was applied to derive the ranking of difficulties according to researchers’ responses. Issues were grouped into technical and context-specific difficulties and analysed separately as a whole and by region.

Results

Researchers considered the lack of quality local clinical data, poor reporting and insufficient data to conduct the analysis from the chosen perspective as the most important technical difficulties. On the other hand, the non-integration of economic evaluations into decision-making was considered the most important context-specific issue. Finally, context-specific issues were considered the larger barrier to the use of economic evaluation.

Conclusion

The technical issues that were considered most important were closely linked with the lack of an appropriately functioning information system as well as the capacity to generate essential contextual information (e.g. data and locally relevant utility values), especially when the methodology is complex. To overcome this, simpler approaches to collect data that yields information of comparable quality to more rigorous methods should be developed. The international community can play a major role through research on methodologies feasible for LMIC settings as well as in building research capacity in countries. Context-specific issues, which were recognised as larger barriers, should be improved in parallel.

Electronic supplementary material

The online version of this article (10.1186/s12961-018-0280-6) contains supplementary material, which is available to authorized users.

Cost-effectiveness analysis of introducing universal childhood rotavirus vaccination in Bangladesh

Diarrhea is one of the world's leading killers of children, and globally, rotavirus is the most common cause of severe diarrhea among under 5 children. In Bangladesh, rotavirus kills nearly 6,000 under 5 children in each year. To reduce the burden of childhood rotavirus diseases, universal rotavirus vaccination is recommended by World Health Organization. The objective of this study is to assess the cost-effectiveness of introducing universal childhood rotavirus vaccination with the newly developed ROTAVAC vaccine in national Expanded Programme of Immunization in Bangladesh. We developed a decision model to examine the potential impact of vaccination in Bangladesh and to examine the effect if the vaccination is applied in the nationwide immunization program schedule. Introduction of childhood universal rotavirus vaccination in Bangladesh scenario appears as highly cost-effective and would offer substantial future benefits for the young population if vaccinated today. The cost per DALY averted of introducing the rotavirus vaccine compared with status quo is approximately US$ 740.27 and US$ 728.67 per DALY averted from the health system and societal perspective respectively which is "very cost-effective" using GDP threshold level according to World Health Organization definition. The results of this analysis seek to contribute to an evidence-based recommendation about the introduction of universal rotavirus vaccination in national Expanded Programme of Immunization (EPI) in Bangladesh.

Capturing Budget Impact Considerations Within Economic Evaluations: A Systematic Review of Economic Evaluations of Rotavirus Vaccine in Low- and Middle-Income Countries and a Proposed Assessment Framework

BACKGROUND

In low- and middle-income countries, budget impact is an important criterion for funding new interventions, particularly for large public health investments such as new vaccines. However, budget impact analyses remain less frequently conducted and less well researched than cost-effectiveness analyses.

OBJECTIVE

The objective of this study was to fill the gap in research on budget impact analyses by assessing (1) the quality of stand-alone budget impact analyses, and (2) the feasibility of extending cost-effectiveness analyses to capture budget impact.

METHODS

We developed a budget impact analysis checklist and scoring system for budget impact analyses, which we then adapted for cost-effectiveness analyses, based on current International Society for Pharmacoeconomics and Outcomes Research Task Force recommendations. We applied both budget impact analysis and cost-effectiveness analysis checklists and scoring systems to examine the extent to which existing economic evaluations provide sufficient evidence about budget impact to enable decision making. We used rotavirus vaccination as an illustrative case in which low- and middle-income countries uptake has been limited despite demonstrated cost effectiveness. A systematic literature review was conducted to identify economic evaluations of rotavirus vaccine in low- and middle-income countries published between January 2000 and February 2017. We critically appraised the quality of budget impact analyses, and assessed the extension of cost-effectiveness analyses to provide useful budget impact information.

RESULTS

Six budget impact analyses and 60 cost-effectiveness analyses were identified. Budget impact analyses adhered to most International Society for Pharmacoeconomics and Outcomes Research recommendations, with key exceptions being provision of undiscounted financial streams for each budget period and model validation. Most cost-effectiveness analyses could not be extended to provide useful budget impact information; cost-effectiveness analyses also rarely presented undiscounted annual costs, or estimated financial streams during the first years of programme scale-up.

CONCLUSIONS

Cost-effectiveness analyses vastly outnumber budget impact analyses of rotavirus vaccination, despite both being critical for policy decision making. Straightforward changes to the presentation of cost-effectiveness analyses results could facilitate their adaptation into budget impact analyses.

Global economic evaluations of rotavirus vaccines: A systematic review

INTRODUCTION

World Health Organization (WHO) recommends Rotavirus vaccines to prevent and control rotavirus infections. Economic evaluations (EE) have been considered to support decision making of national policy. Summarizing global experience of the economic value of rotavirus vaccines is crucial in order to encourage global WHO recommendations for vaccine uptake. Therefore, a systematic review of economic evaluations of rotavirus vaccine was conducted.

METHODS

We searched Medline, Embase, NHS EED, EconLit, CEA Registry, SciELO, LILACS, CABI-Global Health Database, Popline, World Bank - e-Library, and WHOLIS. Full economic evaluations studies, published from inception to November 2015, evaluating Rotavirus vaccines preventing Rotavirus infections were included. The methods, assumptions, results and conclusions of the included studies were extracted and appraised using WHO guide for standardization of EE of immunization programs.

RESULTS

104 relevant studies were included. The majority of studies were conducted in high-income countries. Cost-utility analysis was mostly reported in many studies using incremental cost-effectiveness ratio per DALY averted or QALY gained. Incremental cost per QALY gained was used in many studies from high-income countries. Mass routine vaccination against rotavirus provided the ICERs ranging from cost-saving to highly cost-effective in comparison to no vaccination among low-income countries. Among middle-income countries, vaccination offered the ICERs ranging from cost-saving to cost-effective. Due to low- or no subsidized price of rotavirus vaccines from external funders, being not cost-effective was reported in some high-income settings.

CONCLUSION

Mass vaccination against rotavirus was generally found to be cost-effective, particularly in low- and middle-income settings according to the external subsidization of vaccine price. On the other hand, it may not be a cost-effective intervention at market price in some high-income settings. This systematic review provides supporting information to health policy-makers and health professionals when considering rotavirus vaccination as a national program.