Methodological quality of economic evaluations of new pharmaceuticals in The Netherlands

A Systematic Review of Demand-Side Methods of Estimating the Societal Monetary Value of Health Gain

OBJECTIVES

Although many reviews of the literature on cost-effectiveness thresholds (CETs) exist, the availability of new studies and the absence of a fully comprehensive analysis warrant a new review. This study systematically reviews demand-side methods for estimating the societal monetary value of health gain.

METHODS

Several electronic databases were searched from inception to October 2019. To be included, a study had to be an original article in any language, with a clearly described method for estimating the societal monetary values of health gain and with all estimated values reported. Estimates were converted to US dollars ($), using purchasing power parity (PPP) exchange rates and the gross domestic product (GDP) per capita (2019).

RESULTS

We included 53 studies; 45 used direct approach and 8 used indirect approach. Median estimates from the direct approach were PPP$ 24 942 (range 554-1 301 912) per quality-adjusted life-year (QALY), which were typically 0.53 (range 0.02-24.08) GDP per capita. Median estimates using the indirect approach were PPP$ 310 051 (range 36 402-7 574 870) per QALY, which accounted for 7.87 (range 0.68-116.95) GDP per capita.

CONCLUSIONS

Our review found that the societal values of health gain or CETs were less than GDP per capita. The great variety in methods and estimates suggests that a more standardized and internationally agreed methodology for estimating CET is warranted. Multiple CETs may have a role when QALYs are not equally valued from a societal perspective (eg, QALYs accruing to people near death compared with equivalent QALYs to others).

Quality of health economic evaluations submitted to the Italian Medicines Agency: current state and future actions

Objectives

The purpose of this study was to evaluate the current state of health economic evaluations (HEEs) submitted by pharmaceutical companies to the Italian Medicines Agency (AIFA) as part of their pricing and reimbursement (P&R) dossiers, and to explore potential future actions in order to enhance their quality.

Methods

All company dossiers submitted from October 2016 to December 2018 were reviewed to select those containing pharmacoeconomic studies. The general characteristics of HEEs were described and their quality assessed based on a checklist adapted from Philips et al. (Review of guidelines for good practice in decision-analytic modelling in health technology assessment. Health Technol Assess. 2004;8: 1–158).

Results

Of the 299 dossiers submitted to AIFA, 105 included one or more pharmacoeconomic studies, of which fifty-three were cost-effectiveness analyses. Overall, the compliance of the HEEs with the quality checklist was highly variable: some studies reached high methodological standards whereas others had serious flaws (mean 59.22 percent, range 19.35–90.32 percent). The main weaknesses were the unjustified exclusion of relevant alternatives, poor description and justification of model data and assumptions, and insufficient exploration of uncertainty and study validity. Non-homogeneity across studies was found in study perspectives, discount rates, methods for costing, estimating quality-adjusted life-years and conducting sensitivity analyses.

Conclusions

Based on the results of this study, the recommended actions for increasing the quality of HEEs within reimbursement submissions in Italy are twofold: first, to set methodological standards for conducting and reporting HEEs; second, to strengthen the internal assessment process, also through the acquisition of companies' models and re-evaluation of results. These actions will hopefully provide greater contribution to the evidence-based P&R decision making.

Subcategorizing the Expected Value of Perfect Implementation to Identify When and Where to Invest in Implementation Initiatives

Purpose. Clinical practice variations and low implementation of effective and cost-effective health care technologies are a key challenge for health care systems and may lead to suboptimal treatment and health loss for patients. The purpose of this work was to subcategorize the expected value of perfect implementation (EVPIM) to enable estimation of the absolute and relative value of eliminating slow, low, and delayed implementation. Methods. Building on the EVPIM framework, this work defines EVPIM subcategories to estimate the expected value of eliminating slow, low, or delayed implementation. The work also shows how information on regional implementation patterns can be used to estimate the value of eliminating regional implementation variation. The application of this subcategorization is illustrated by a case study of the implementation of an antiplatelet therapy for the secondary prevention after myocardial infarction in Sweden. Incremental net benefit (INB) estimates are based on published cost-effectiveness assessments and a threshold of SEK 250,000 (£22,300) per quality-adjusted life year (QALY). Results. In the case study, slow, low, and delayed implementation was estimated to represent 22%, 34%, and 44% of the total population EVPIM (2941 QALYs or SEK 735 million), respectively. The value of eliminating implementation variation across health care regions was estimated to 39% of total EVPIM (1138 QALYs). Conclusion. Subcategorizing EVPIM estimates the absolute and relative value of eliminating different parts of suboptimal implementation. By doing so, this approach could help decision makers to identify which parts of suboptimal implementation are contributing most to total EVPIM and provide the basis for assessing the cost and benefit of implementation activities that may address these in future implementation of health care interventions.

What do national pharmacoeconomic guidelines recommend regarding the statistical analysis of trial-based economic evaluations?

Introduction: The statistical quality of many trial-based economic evaluations is poor. When conducting trial-based economic evaluations, researchers often turn to national pharmacoeconomic guidelines for guidance. Therefore, this study reviewed which recommendations are currently given by national pharmacoeconomic guidelines on the statistical analysis of trial-based economic evaluations.Areas covered: 40 national pharmacoeconomic guidelines were identified. Data were extracted on the guidelines' recommendations on how to deal with baseline imbalances, skewed costs, correlated costs and effects, clustering of data, longitudinal data, and missing data in trial-based economic evaluations. Four guidelines (10%) were found to include recommendations on how to deal with baseline imbalances, five (13%) on how to deal with skewed costs, and seven (18%) on how to deal with missing data. Recommendations were very general in nature and recommendations on dealing with correlated costs and effects, clustering of data, and longitudinal data were lacking.Expert opinion: Current national pharmacoeconomic guidelines provide little to no guidance on how to deal with the statistical challenges to trial-based economic evaluations. Since the use of suboptimal statistical methods may lead to biased results, and, therefore, possibly to a waste of scarce resources, national agencies are advised to include more statistical guidance in their pharmacoeconomic guidelines.

A systematic review of the methodological quality of economic studies evaluating ophthalmic drugs

INTRODUCTION

Innovative drugs have been approved in ophthalmology. Thus, the number and importance of economic evaluation studies of ophthalmic drugs have been growing. This study aims to assess the methodological quality of pharmacoeconomic studies of ophthalmic drugs.

AREAS COVERED

A systematic search was conducted in Pubmed/Embase until November 2018 to identify full pharmacoeconomic studies evaluating ophthalmic drugs. The quality of studies was evaluated using the British Medical Journal (BMJ) checklist. Quality indicators were evaluated by Fisher's exact test. Ninety-five studies were included, 50 (52.6%) cost-utility analysis, 28 (29.5%) cost-effectiveness and 17 (17.9%) cost-effectiveness/cost-utility. All studies presented, at least, three methodological limitations. Cost-utility studies, studies conducted from a health system perspective, with time horizons longer than one-year and that rely on observational or observational and experimental data simultaneously are associated with higher quality. Only eight (8.4%) studies considered two eyes in the economic analysis and only 13 (13.7%) considered the natural history of the disease when extrapolating results for long-term analysis.

EXPERT OPINION

The majority of the pharmacoeconomic studies were assessed as having good methodological quality, however, the methodological quality scores were sensitive to several indicators. Therefore, improving the quality of studies would enhance their usefulness in the decision-making processes.

Systematic Review of Health Economic Evaluation Studies Developed in Brazil from 1980 to 2013

BACKGROUND

Brazil has sought to use economic evaluation to support healthcare decision-making processes. While a number of health economic evaluations (HEEs) have been conducted, no study has systematically reviewed the quality of Brazilian HEE. The objective of this systematic review was to provide an overview regarding the state of HEE research and to evaluate the number, characteristics, and quality of reporting of published HEE studies conducted in a Brazilian setting.

METHODS

We systematically searched electronic databases (MEDLINE, EMBASE, Latin American, and Caribbean Literature on Health Sciences Database, Scientific Electronic Library Online, NHS Economic Evaluation Database, health technology assessment Database, Bireme, and Biblioteca Virtual em Saúde Economia da Saúde); citation indexes (SCOPUS, Web of Science), and Sistema de Informação da Rede Brasileira de Avaliação de Tecnologia em Saúde. Partial and full HEEs published between 1980 and 2013 that referred to a Brazilian setting were considered for inclusion.

RESULTS

In total, 535 studies were included in the review, 36.8% of these were considered to be full HEE. The category of healthcare technologies more frequently assessed were procedures (34.8%) and drugs (28.8%) which main objective was treatment (72.1%). Forty-four percent of the studies reported their funding source and 36% reported a conflict of interest. Overall, the full HEE quality of reporting was satisfactory. But some items were generally poorly reported and significant improvement is required: (1) methods used to estimate healthcare resource use quantities and unit costs, (2) methods used to estimate utility values, (3) sources of funding, and (4) conflicts of interest.

CONCLUSION

A steady number of HEE have been published in Brazil since 1980. To improve their contribution to inform national healthcare policy efforts need to be made to enhance the quality of reporting of HEEs and promote improvements in the way HEEs are designed, implemented (i.e., using sound methods for HEEs) and reported.

Methodological Issues in Economic Evaluations Submitted to the Pan-Canadian Oncology Drug Review (pCODR)

BACKGROUND

Public drug plans are faced with increasingly difficult funding decisions. In Canada, the pan-Canadian Oncology Drug Review (pCODR) makes funding recommendations to the provincial and territorial drug plans responsible for cancer drugs. Assessments of the economic models submitted by pharmaceutical manufacturers are publicly reported.

OBJECTIVES

The main objective of this research was to identify recurring methodological issues in economic models submitted to pCODR for funding reviews. The secondary objective was to explore whether there exists any observed relationships between reported methodological issues and funding recommendations made by pCODR's expert review committee.

METHODS

Publicly available Economic Guidance Reports from July 2011 (inception) until June 2014 for drug reviews with a final funding recommendation (N = 34) were independently examined by two authors. Major methodological issues from each review were abstracted and grouped into nine main categories. Each issue was also categorized based on perception of the reviewer's actions to manage it.

RESULTS

The most commonly reported issues involved costing (59% of reviews), time horizon (56%), and model structure (36%). Several types of issues were identified that usually could not be resolved, such as quality of clinical data or uncertainty with indirect comparisons. Issues with costing or choice of utility estimates could usually be addressed or explored by reviewers. No statistically significant relationship was found between any methodological issue and funding recommendations from the expert review committee.

CONCLUSIONS

The findings provide insights that can be used by parties who submit or review economic evidence for continuous improvement and consistency in economic modeling, reporting, and decision making.

A New Statistical Method to Determine the Degree of Validity of Health Economic Model Outcomes against Empirical Data

BACKGROUND

The validation of health economic (HE) model outcomes against empirical data is of key importance. Although statistical testing seems applicable, guidelines for the validation of HE models lack guidance on statistical validation, and actual validation efforts often present subjective judgment of graphs and point estimates.

OBJECTIVES

To discuss the applicability of existing validation techniques and to present a new method for quantifying the degrees of validity statistically, which is useful for decision makers.

METHODS

A new Bayesian method is proposed to determine how well HE model outcomes compare with empirical data. Validity is based on a pre-established accuracy interval in which the model outcomes should fall. The method uses the outcomes of a probabilistic sensitivity analysis and results in a posterior distribution around the probability that HE model outcomes can be regarded as valid.

RESULTS

We use a published diabetes model (Modelling Integrated Care for Diabetes based on Observational data) to validate the outcome "number of patients who are on dialysis or with end-stage renal disease." Results indicate that a high probability of a valid outcome is associated with relatively wide accuracy intervals. In particular, 25% deviation from the observed outcome implied approximately 60% expected validity.

CONCLUSIONS

Current practice in HE model validation can be improved by using an alternative method based on assessing whether the model outcomes fit to empirical data at a predefined level of accuracy. This method has the advantage of assessing both model bias and parameter uncertainty and resulting in a quantitative measure of the degree of validity that penalizes models predicting the mean of an outcome correctly but with overly wide credible intervals.

Many Miles to Go: A Systematic Review of the State of Cost-Utility Analyses in Brazil

BACKGROUND

Little is known about the quality and quantity of cost-utility analyses (CUAs) in Brazil.

OBJECTIVE

The objective of this study was to provide a systematic review of published CUAs of healthcare technologies in Brazil.

METHODS

We performed a systematic review of economic evaluations studies published in MEDLINE, EMBASE, LILACS (Latin American and Caribbean Health Sciences Literature), SciELO (Scientific Electronic Library Online), NHS EED (National Health Service Economic Evaluation Database), HTA (Health Technology Assessment) Database, Web of Science, Scopus, Bireme (Biblioteca Regional de Medicina), BVS ECOS (Health Economics database of the Brazilian Virtual Library of Health), and SISREBRATS (Sistema de Informação da Rede Brasileira de Avaliação de Tecnologias em Saúde [Brazilian Network for the Evaluation of Health Technologies]) from 1980 to 2013. Articles were included if they were CUAs according to the classification devised by Drummond et al. Two independent reviewers screened articles for relevance and carried out data extraction. Disagreements were resolved through discussion or through consultation with a third reviewer. We performed a qualitative narrative synthesis.

RESULTS

Of the 535 health economic evaluations (HEEs) relating to Brazil, only 40 were CUAs and therefore included in the analysis. Most studies adhered to methodological guidelines for quality of reporting and 77.5% used quality-adjusted life-years (QALYs) as the health outcome. Of these studies, 51.6% did not report the population used to elicit preferences for outcomes and 45.2% used a specific population such as expert opinion. The preference elicitation method was not reported in 58.1% of these studies. The majority (80.6%) of studies did not report the instrument used to derive health state valuations and no publication reported whether tariffs (or preference weights) were national or international. No study mentioned the methodology used to estimate QALYs.

CONCLUSIONS

Many published Brazilian cost-utility studies adhere to key recommended general methods for HEE; however, the use of QALY calculations is far from being the current international standard. Development of health preferences research can contribute to quality improvement of health technology assessment reports in Brazil.

Health Economics as Rhetoric: The Limited Impact of Health Economics on Funding Decisions in Four European Countries

BACKGROUND

A response to the challenge of high-cost treatments in health care has been economic evaluation. Cost-effectiveness analysis presented as cost per quality-adjusted life-years gained has been controversial, raising heated support and opposition.

OBJECTIVES

To assess the impact of economic evaluation in decisions on what to fund in four European countries and discuss the implications of our findings.

METHODS

We used a protocol to review the key features of the application of economic evaluation in reimbursement decision making in England, Germany, the Netherlands, and Sweden, reporting country-specific highlights.

RESULTS

Although the institutions and processes vary by country, health economic evaluation has had limited impact on restricting access of controversial high-cost drugs. Even in those countries that have gone the furthest, ways have been found to avoid refusing to fund high-cost drugs for particular diseases including cancer, multiple sclerosis, and orphan diseases. Economic evaluation may, however, have helped some countries to negotiate price reductions for some drugs. It has also extended to the discussion of clinical effectiveness to include cost.

CONCLUSIONS

The differences in approaches but similarities in outcomes suggest that health economic evaluation be viewed largely as rhetoric (in D.N. McCloskey's terms in The Rhetoric of Economics, 1985). This is not to imply that economics had no impact: rather that it usually contributed to the discourse in ways that differed by country. The reasons for this no doubt vary by perspective, from political science to ethics. Economic evaluation may have less to do with rationing or denial of medical treatments than to do with expanding the discourse used to discuss such issues.

Cost-effectiveness thresholds: pros and cons

Cost-effectiveness analysis is used to compare the costs and outcomes of alternative policy options. Each resulting cost-effectiveness ratio represents the magnitude of additional health gained per additional unit of resources spent. Cost-effectiveness thresholds allow cost-effectiveness ratios that represent good or very good value for money to be identified. In 2001, the World Health Organization's Commission on Macroeconomics in Health suggested cost-effectiveness thresholds based on multiples of a country's per-capita gross domestic product (GDP). In some contexts, in choosing which health interventions to fund and which not to fund, these thresholds have been used as decision rules. However, experience with the use of such GDP-based thresholds in decision-making processes at country level shows them to lack country specificity and this - in addition to uncertainty in the modelled cost-effectiveness ratios - can lead to the wrong decision on how to spend health-care resources. Cost-effectiveness information should be used alongside other considerations - e.g. budget impact and feasibility considerations - in a transparent decision-making process, rather than in isolation based on a single threshold value. Although cost-effectiveness ratios are undoubtedly informative in assessing value for money, countries should be encouraged to develop a context-specific process for decision-making that is supported by legislation, has stakeholder buy-in, for example the involvement of civil society organizations and patient groups, and is transparent, consistent and fair.

Unremarked or Unperformed? Systematic Review on Reporting of Validation Efforts of Health Economic Decision Models in Seasonal Influenza and Early Breast Cancer

BACKGROUND

Transparent reporting of validation efforts of health economic models give stakeholders better insight into the credibility of model outcomes. In this study we reviewed recently published studies on seasonal influenza and early breast cancer in order to gain insight into the reporting of model validation efforts in the overall health economic literature.

METHODS

A literature search was performed in Pubmed and Embase to retrieve health economic modelling studies published between 2008 and 2014. Reporting on model validation was evaluated by checking for the word validation, and by using AdViSHE (Assessment of the Validation Status of Health Economic decision models), a tool containing a structured list of relevant items for validation. Additionally, we contacted corresponding authors to ask whether more validation efforts were performed other than those reported in the manuscripts.

RESULTS

A total of 53 studies on seasonal influenza and 41 studies on early breast cancer were included in our review. The word validation was used in 16 studies (30 %) on seasonal influenza and 23 studies (56 %) on early breast cancer; however, in a minority of studies, this referred to a model validation technique. Fifty-seven percent of seasonal influenza studies and 71 % of early breast cancer studies reported one or more validation techniques. Cross-validation of study outcomes was found most often. A limited number of studies reported on model validation efforts, although good examples were identified. Author comments indicated that more validation techniques were performed than those reported in the manuscripts.

CONCLUSIONS

Although validation is deemed important by many researchers, this is not reflected in the reporting habits of health economic modelling studies. Systematic reporting of validation efforts would be desirable to further enhance decision makers' confidence in health economic models and their outcomes.

A Systematic Review of the Level of Evidence in Economic Evaluations of Medical Devices: The Example of Vertebroplasty and Kyphoplasty

CONTEXT

Economic evaluations are far less frequently reported for medical devices than for drugs. In addition, little is known about the quality of existing economic evaluations, particularly for innovative devices, such as those used in vertebroplasty and kyphoplasty.

OBJECTIVE

To assess the level of evidence provided by the available economic evaluations for vertebroplasty and kyphoplasty.

DATA SOURCES

A systematic review of articles in English or French listed in the MEDLINE, PASCAL, COCHRANE and National Health Service Economic Evaluation databases, with limits on publication date (up to the date of the review, March 2014).

STUDY SELECTION

We included only economic evaluations of vertebroplasty or kyphoplasty. Editorial and methodological articles were excluded.

DATA EXTRACTION

Data were extracted from articles by two authors working independently and using two analysis grids to measure the quality of economic evaluations.

DATA SYNTHESIS

Twenty-one studies met our inclusion criteria. All were published between 2008 and 2014. Eighteen (86%) were full economic evaluations. Cost-effectiveness analysis (CEA) was the most frequent type of economic evaluation, and was present in 11 (52%) studies. Only three CEAs complied fully with the British Medical Journal checklist. The quality of the data sources used in the 21 studies was high, but the CEAs conforming to methodological guidelines did not use high-quality data sources for all components of the analysis.

CONCLUSIONS

This systematic review shows that the level of evidence in economic evaluations of vertebroplasty and kyphoplasty is low, despite the recent publication of a large number of studies. This finding highlights the challenges to be faced to improve the quality of economic evaluations of medical devices.

Use of DALYs in economic analyses on interventions for infectious diseases: a systematic review

A systematic literature review was performed on full economic evaluations of infectious disease interventions using disability-adjusted life years (DALY) as outcome measure. The search was limited to the period between 1994 and September 2011 and conducted in Medline, SciSearch and EMBASE databases. We included 154 studies, mostly targeting HIV/AIDS and malaria with most conducted for African countries (40%) and <10% in high-income countries. Third-payer perspective was applied in 29% of the studies, 25% used the societal perspective and 12% used both. Only 16% of the studies took indirect effects (i.e. herd immunity) of interventions into account. Intervention, direct healthcare and indirect non-healthcare costs were taken into account in respectively 100%, 81% and 36% of the studies. The majority of the studies followed the Global Burden of Disease method for DALY estimations, but most studies deviated from WHO cost-effectiveness guidelines. Better adherence to freely accessible guidelines will improve generalizability between full economic evaluations.

Assessment of methodological quality of economic evaluations in belgian drug reimbursement applications

Objectives

This paper aims to assess the methodological quality of economic evaluations included in Belgian reimbursement applications for Class 1 drugs.

Materials and Methods

For 19 reimbursement applications submitted during 2011 and Spring 2012, a descriptive analysis assessed the methodological quality of the economic evaluation, evaluated the assessment of that economic evaluation by the Drug Reimbursement Committee and the response to that assessment by the company. Compliance with methodological guidelines issued by the Belgian Healthcare Knowledge Centre was assessed using a detailed checklist of 23 methodological items. The rate of compliance was calculated based on the number of economic evaluations for which the item was applicable.

Results

Economic evaluations tended to comply with guidelines regarding perspective, target population, subgroup analyses, comparator, use of comparative clinical data and final outcome measures, calculation of costs, incremental analysis, discounting and time horizon. However, more attention needs to be paid to the description of limitations of indirect comparisons, the choice of an appropriate analytic technique, the expression of unit costs in values for the current year, the estimation and valuation of outcomes, the presentation of results of sensitivity analyses, and testing the face validity of model inputs and outputs. Also, a large variation was observed in the scope and depth of the quality assessment by the Drug Reimbursement Committee.

Conclusions

Although general guidelines exist, pharmaceutical companies and the Drug Reimbursement Committee would benefit from the existence of a more detailed checklist of methodological items that need to be reported in an economic evaluation.

Unravelling drug reimbursement outcomes: a comparative study of the role of pharmacoeconomic evidence in Dutch and Swedish reimbursement decision making

BACKGROUND

To sustainably manage equitable access to effective drugs, many developed countries have established a national system to determine whether drugs should be reimbursed.

OBJECTIVES

Our objectives were (i) to investigate the role of pharmacoeconomic evidence in Dutch and Swedish drug reimbursement decision making; and (ii) to determine the extent to which appraising the importance of full economic evaluations relative to other evidence is a transparent process.

DATA SOURCES

Data sources included all Dutch and Swedish drug reimbursement information published in the period January 2005 to July 2011.

METHODS

After categorising all the reimbursement applications and decisions in published data sources, we selected all dossiers-in both countries-that included a full economic evaluation (i.e. cost-effectiveness and/or cost-utility analysis) and then investigated how the evidence was appraised for its societal value.

RESULTS

In The Netherlands, only 35 % of the 118 applications on List 1B (i.e. claiming added therapeutic value) were found to include pharmacoeconomic evidence. In all cases where drugs received a 'no' decision, combined with an evaluation that they were of similar (n = 7) or added (n = 5) therapeutic value, we found that the pharmacoeconomic evidence had been judged insufficiently robust. We also found that in 21 % of the 'yes' decisions, combined with an evaluation of similar (n = 2) or added (n = 2) therapeutic value, the pharmacoeconomic evidence had been judged insufficiently robust. In Sweden, we found that drugs that received a 'no' decision (n = 39) had been judged either not cost effective (74 %) or not supported by sufficiently credible data (26 %). Nearly all drugs that received a 'yes' decision (n = 252) had been judged cost effective (92 %). However, of all these judgements, 53 % were based on a price comparison and 10 % on a cost-minimisation analysis; only 33 % were based on a full economic evaluation. More economic evaluations were available in Sweden than in The Netherlands (97 vs. 31, respectively), mainly due to the numerous exemptions from pharmacoeconomic evidence in The Netherlands (65 %). Dossiers for only 11 drugs included a full economic evaluation in both countries; of these, the reimbursement decisions differed for four drugs. Appraisal elements were reported only descriptively; their actual influence on the final decision remained unclear. In four dossiers, the (high) severity of the treatable disease was explicitly mentioned in both countries; three of these were identical and related to indications in cancer.

CONCLUSIONS

Both countries publish drug reimbursement information. Therapeutic value appears to be the most decisive criterion; the relative importance of full economic evaluations is more modest than would generally be expected, especially in The Netherlands. Although the assessment process is reasonably transparent, both countries could make the appraisal process more transparent by more explicitly showing the actual role of each different (societal) criterion in their decision making.

Quality assessment of economic analyses in pediatric urology

OBJECTIVE

To describe and evaluate economic analyses or economic evaluations in pediatric urologic literature, including study types such as cost-effectiveness analysis, which are increasingly common in the medical literature.

METHODS

We performed a systematic literature review of the MEDLINE, EMBASE, and Cochrane databases (1990-2011) to identify economic analyses of pediatric urologic topics. Studies were evaluated using published quality metrics. We examined the analysis type, data sources, perspective, methodology, sensitivity analyses, and the reporting of methods, results, limitations, and conclusions.

RESULTS

We identified 2945 nonduplicated studies, 60 of which met inclusion criteria. Economic analyses of pediatric urologic topics increased in number during the study period, from 1 study (2%) in 1990 to 7 (12%) in 2010 (P <.0001 for trend). The most common types of analyses were cost-effectiveness and cost-minimization (22 each, 37%), typically performed from the payer perspective (26 [43%]). Although 44 (73%) correctly identified the analysis type, only 21 (35%) correctly identified the study perspective. Optimal data sources were used in 7 studies (11%). Appropriate inflationary discounting was used in 17 of 53 (32%). Sensitivity analyses were not reported in 31 of 53 (58%). The descriptions of study methods were adequate in 43 studies (72%), assumptions were adequately reported in 42 (70%), and 37 (62%) adequately discussed limitations.

CONCLUSION

Although economic analyses are increasing in the pediatric urologic literature, there is a need for standardization in methods and reporting. Future investigations should attempt to follow standardized reporting guidelines and should pay particular attention to reporting of methods and results, including a comprehensive discussion of limitations.