The quality of economic studies of cancer pharmacogenomics: a quantitative appraisal of the evidence

Evaluating the quality of the economic evidence in colorectal cancer genomics studies

The increase in the use of genome-based screening and diagnostic tests adds to the overall costs of oncologic care for colorectal cancer. This, in turn, has resulted in an increase in published economic analyses. Aim: To perform a systematic literature review of the available economic evidence evaluating the value of genomic testing for colorectal cancer and appraise the quality of the economic studies conducted to date. Methods: A systematic review of the literature for economic studies of colorectal cancer genomics from January 2006 through October 2020, and evaluation of study quality using the Quality of Health Economic Studies (QHES) instrument was conducted. The validated QHES was then applied to a final set of articles that met eligibility criteria. Results: Our search of the literature initially yielded 12,859 records. A final set of 49 articles met our inclusion criteria. The QHES score ranged from 24 to 100, with an average score of 82. Most of the studies (n = 40, 82%) scored above 75 and were considered of good quality. Conclusion: Our analysis revealed that most of the economic analyses of colorectal cancer genomic molecular diagnostics in the literature may be of good quality. There is, however, some variation in methodological rigor between the articles.

Personalized medicine in colorectal cancer diagnosis and treatment: a systematic review of health economic evaluations

Background

Due to its epidemiological relevance, several studies have been performed to assess the cost-effectiveness of diagnostic tests and treatments in colorectal cancer (CRC) patients.

Objective

We reviewed economic evaluations on diagnosis of inherited CRC-syndromes and genetic tests for the detection of mutations associated with response to therapeutics.

Methods

A systematic literature review was performed by searching the main literature databases for relevant papers on the field, published in the last 5 years.

Results

20 studies were included in the final analysis: 14 investigating the cost-effectiveness of hereditary-CRC screening; 5 evaluating the cost-effectiveness of KRAS mutation assessment before treatment; and 1 study analysing the cost-effectiveness of genetic tests for early-stage CRC patients prognosis. Overall, we found that: (a) screening strategies among CRC patients were more effective than no screening; (b) all the evaluated interventions were cost-saving for certain willingness-to-pay (WTP) threshold; and (c) all new CRC patients diagnosed at age 70 or below should be screened. Regarding patients treatment, we found that KRAS testing is economically sustainable only if anticipated in patients with non-metastatic CRC (mCRC), while becoming unsustainable, due to an incremental cost-effectiveness ratio (ICER) beyond the levels of WTP-threshold, in all others evaluated scenarios.

Conclusions

The poor evidence in the field, combined to the number of assumptions done to perform the models, lead us to a high level of uncertainty on the cost-effectiveness of genetic evaluations in CRC, suggesting that major research is required in order to assess the best combination among detection tests, type of genetic test screening and targeted-therapy.

Electronic supplementary material

The online version of this article (10.1186/s12962-018-0085-z) contains supplementary material, which is available to authorized users.

Economic Evaluations of Pathology Tests, 2010-2015: A Scoping Review

BACKGROUND

Concerns about pathology testing such as the value provided by new tests and the potential for inappropriate utilization have led to a greater need to assess costs and benefits. Economic evaluations are a formal method of analyzing costs and benefits, yet for pathology tests, questions remain about the scope and quality of the economic evidence.

OBJECTIVE

To describe the extent and quality of published evidence provided by economic evaluations of pathology tests from 2010 to 2015.

METHODS

Economic evaluations relating to pathology tests from 2010 to 2015 were reviewed. Eight databases were searched for published studies, and details recorded for the country, clinical focus, type of testing, and consideration of sensitivity, specificity, and false test results. The reporting quality of studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards checklist and cost-effectiveness ratios were analyzed for publication bias.

RESULTS

We found 356 economic evaluations of pathology tests, most of which regarded developed countries. The most common economic evaluations were cost-utility analyses and the most common clinical focus was infectious diseases. More than half of the studies considered sensitivity and specificity, but few studies considered the impact of false test results. The average Consolidated Health Economic Evaluation Reporting Standards checklist score was 17 out of 24. Cost-utility ratios were commonly less than $10,000/quality-adjusted life-year or more than $200,000/quality-adjusted life-year.

CONCLUSIONS

The number of economic evaluations of pathology tests has increased in recent years, but the rate of increase has plateaued. Furthermore, the quality of studies in the past 5 years was highly variable, and there is some question of publication bias in reporting cost-effectiveness ratios.

Cost-utility analyses of drug therapies in breast cancer: a systematic review

The economic evaluation (EE) of health care products has become a necessity. Their quality must be high in order to trust the results and make informed decisions. While cost-utility analyses (CUAs) should be preferred to cost-effectiveness analyses in the oncology area, the quality of breast cancer (BC)-related CUA has been given little attention so far. Thus, firstly, a systematic review of published CUA related to drug therapies for BC, gene expression profiling, and HER2 status testing was performed. Secondly, the quality of selected CUA was assessed and the factors associated with a high-quality CUA identified. The systematic literature search was conducted in PubMed, MEDLINE/EMBASE, and Cochrane to identify published CUA between 2000 and 2014. After screening and data extraction, the quality of each selected CUA was assessed by two independent reviewers, using the checklist proposed by Drummond et al. The analysis of factors associated with a high-quality CUA (defined as a Drummond score ≥7) was performed using a two-step approach. Our systematic review was based on 140 CUAs and showed a wide variety of methodological approaches, including differences in the perspective adopted, the time horizon, measurement of cost and effectiveness, and more specially health-state utility values (HSUVs). The median Drummond score was 7 [range 3-10]. Only one in two of the CUA (n = 74) had a Drummond score ≥7, synonymous of "high quality." The statistically significant predictors of a high-quality CUA were article with "gene expression profiling" topic (p = 0.001), consulting or pharmaceutical company as main location of first author (p = 0.004), and articles with both incremental cost-utility ratio and incremental cost-effectiveness ratio as outcomes of EE (p = 0.02). Our systematic review identified only 140 CUAs published over the past 15 years with one in two of high quality. It showed a wide variety of methodological approaches, especially focused on HSUVs. A critical appraisal of utility values is necessary to better understand one of the main difficulties encountered by authors and propose areas for improvement to increase the quality of CUA. Since the last 5 years, there is a tendency toward an improvement in the quality of these studies, probably coupled with economic context, a better and widely spreading of recommendations and thus appropriation by medical practitioners. That being said, there is an urgent need for mandatory use of European and international recommendations to ensure quality of such approaches and to allow easy comparison.

The 3-I framework: a framework for developing public policies regarding pharmacogenomics (PGx) testing in Canada

The 3-I framework of analyzing the ideas, interests, and institutions around a topic has been used by political scientists to guide public policy development. In Canada, there is a lack of policy governing pharmacogenomics (PGx) testing compared to other developed nations. The goal of this study was to use the 3-I framework, a policy development tool, and apply it to PGx testing to identify and analyze areas where current policy is limited and challenges exist in bringing PGx testing into wide-spread clinical practice in Canada. A scoping review of the literature was conducted to determine the extent and challenges of PGx policy implementation at federal and provincial levels. Based on the 3-I analysis, contentious ideas related to PGx are (i) genetic discrimination, (ii) informed consent, (iii) the lack of knowledge about PGx in health care, (iv) the value of PGx testing, (v) the roles of health care workers in the coordination of PGx services, and (vi) confidentiality and privacy. The 3-I framework is a useful tool for policy makers, and applying it to PGx policy development is a new approach in Canadian genomics. Policy makers at every organizational level can use this analysis to help develop targeted PGx policies.