A systematic review and checklist presenting the main challenges for health economic modeling in personalized medicine: towards implementing patient-level models

System dynamics simulation for evaluating implementation strategies of genomic sequencing: tutorial and conceptual model

INTRODUCTION

Precision Medicine (PM), especially in oncology, involve diagnostic and complex treatment pathways that are based on genomic features. To conduct evaluation and decision analysis for PM, advanced modeling techniques are needed due to its complexity. Although System Dynamics (SD) has strong modeling power, it has not been widely used in PM and individualized treatment.

AREAS COVERED

We explained SD tools using examples in cancer context and the rationale behind using SD for genomic testing and personalized oncology. We compared SD with other Dynamic Simulation Modelling (DSM) methods and listed SD's advantages. We developed a conceptual model using Causal Loop Diagram (CLD) for strategic decision-making in Whole Genome Sequencing (WGS) implementation.

EXPERT OPINION

The paper demonstrates that SD is well-suited for health policy evaluation challenges and has useful tools for modeling precision oncology and genomic testing. SD's system-oriented modeling captures dynamic and complex interactions within systems using feedback loops. SD models are simple to implement, utilize less data and computational resources, and conduct both exploratory and explanatory analyses over time. If the targeted system has complex interactions and many components, deals with lack of data, and requires interpretability and clinicians' input, SD offers attractive advantages for modeling and evaluating scenarios.

Health Economic Evidence and Modeling Challenges for Liquid Biopsy Assays in Cancer Management: A Systematic Literature Review

BACKGROUND

Cancer-derived material circulating in the bloodstream and other bodily fluids, referred to as liquid biopsies (LBs), has become an appealing adjunct or alternative to tissue biopsies, showing vital promise in several clinical applications.

PURPOSE

A systematic literature review was conducted to (1) summarize the current health economic evidence for LB assays and (2) identify and analyze the studies addressed or reported on the challenges of health economic modeling in precision medicine.

METHODS

Relevant studies were identified in the EMBASE, MEDLINE, Cochrane Library, EconLit, and the University of Melbourne Full Text Journal databases from 1 January 2013 to 16 September 2022. Included papers were selected if they were economic evaluations and/or budget impact analyses.

RESULTS

A total of 24 studies were included and analyzed, with the majority being full economic evaluations (n = 19, 79.2%). Four studies (16.7%) were health and budget impact analyses, and one study (4.1%) incorporated both an economic evaluation and a budget impact analysis. Cohort-level modeling techniques were the most common approach (n = 16; 80%). LB technologies were cost-effective in 15 studies (75%) considering different biomarkers, cancer types and stages, and economic analyses. These studies evaluated LBs for screening and early detection (66.7%), treatment selection (26.7%), and monitoring treatment response (6.6%). Budget impact analysis results were varied among included studies, with the majority of studies (n = 4; 80%) reporting either cost savings, minimal, or modest budget impact, while one study (20%) reported LBs as an efficient strategy. The reviewed studies often inadequately reported or addressed modeling challenges, such as patient-level processes, the combination of tests and treatments, preferences, and uncertainty.

CONCLUSION

LBs could provide a cost-effective approach for treatment selection in lung cancer and aid in the screening and early detection of other cancers, including colorectal, gastric, breast, and brain cancers. This is in comparison with various alternatives, such as the standard of care (SOC) and no screening scenario. However, it is important to mention that in some comparisons, LBs were used in combination with SOC instead of replacing it. Importantly, few studies have pointed toward LBs' cost-effectiveness for monitoring treatment response. Most health and budget impact analyses, especially those focused on lung cancer, suggest potential cost savings or a minimal-to-moderate budget impact. Nevertheless, additional research is needed to ascertain their effectiveness across various stages of lung and colorectal cancer, as well as to address potential modeling challenges.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42022307939.

Evaluating the Value for Money of Precision Medicine from Early Cycle to Market Access: A Comprehensive Review of Approaches and Challenges

OBJECTIVES

This study aimed to perform a comprehensive review of modeling approaches and methodological and policy challenges in the economic evaluation (EE) of precision medicine (PM) across clinical stages.

METHODS

First, a systematic review was performed to assess the approaches of EEs in the past 10 years. Next, a targeted review of methodological articles was conducted for methodological and policy challenges in performing EEs of PM. All findings were synthesized into a structured framework that focused on patient population, Intervention, Comparator, Outcome, Time, Equity and ethics, Adaptability and Modeling aspects, named the "PICOTEAM" framework. Finally, a stakeholder consultation was conducted to understand the major determinants of decision making in PM investment.

RESULTS

In 39 methodological articles, we identified major challenges to the EE of PM. These challenges include that PM applications involve complex and evolving clinical decision space, that clinical evidence is sparse because of small subgroups and complex pathways in PM settings, a one-time PM application may have lifetime or intergenerational impacts but long-term evidence is often unavailable, and that equity and ethics concerns are exceptional. In 275 EEs of PM, current approaches did not sufficiently capture the value of PM compared with targeted therapies, nor did they differentiate Early EEs from Conventional EEs. Finally, policy makers perceived the budget impact, cost savings, and cost-effectiveness of PM as the most important determinants in decision making.

CONCLUSIONS

There is an urgent need to modify existing guidelines or develop a new reference case that fits into the new healthcare paradigm of PM to guide decision making in research and development and market access.

Population-Based Screening Using Low-Dose Chest Computed Tomography: A Systematic Review of Health Economic Evaluations

BACKGROUND

Chest low-dose computed tomography (LDCT) is a promising technology for population-based screening because it is non-invasive, relatively inexpensive, associated with low radiation and highly sensitive to lung cancer. To improve the cost-effectiveness of lung cancer screening, simultaneous screening for other diseases could be considered. This systematic review was conducted to analyse studies that published evidence on the cost-effectiveness of chest LDCT screening programs for different diseases.

METHODS

Scopus and PubMed were searched for English publications (1 January 2011-22 July 2022) using search terms related to screening, computed tomography and cost-effectiveness. An additional search specifically searched for the cost-effectiveness of screening for lung cancer, chronic obstructive pulmonary disease or cardiovascular disease. Included publications should present a full health economic evaluation of population screening with chest LDCT. The extracted data included the disease screened for, model type, country context of screening, inclusion of comorbidities or incidental findings, incremental costs, incremental effects and the resulting cost-effectiveness ratio amongst others. Reporting quality was assessed using the 2022 Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist.

RESULTS

The search yielded 1799 unique papers, of which 43 were included. Most papers focused on lung cancer screening (n = 40), and three were on coronary calcium scoring. Microsimulation was the most commonly applied modelling type (n = 16), followed by life table analysis (n = 10) and Markov cohort models (n = 10). Studies reflected the healthcare context of the US (n = 15), Canada (n = 4), the UK (n = 3) and 13 other countries. The reported incremental cost-effectiveness ratio ranged from US$10,000 to US$90,000/quality-adjusted life year (QALY) for lung cancer screening compared to no screening and was US$15,900/QALY-US$45,300/QALY for coronary calcium scoring compared to no screening.

DISCUSSION

Almost all health economic evaluations of LDCT screening focused on lung cancer. Literature regarding the health economic benefits of simultaneous LDCT screening for multiple diseases is absent. Most studies suggest LDCT screening is cost-effective for current and former smokers aged 55-74 with a minimum of 30 pack-years of smoking history. Consequently, more evidence on LDCT is needed to support further cost-effectiveness analyses. Preferably evidence on simultaneous screening for multiple diseases is needed, but alternatively, on single-disease screening.

REGISTRATION OF SYSTEMATIC REVIEW

Prospective Register of Ongoing Systematic Reviews registration CRD42021290228 can be accessed https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=290228 .

Evaluating the quality of the economic evidence in colorectal cancer genomics studies

The increase in the use of genome-based screening and diagnostic tests adds to the overall costs of oncologic care for colorectal cancer. This, in turn, has resulted in an increase in published economic analyses. Aim: To perform a systematic literature review of the available economic evidence evaluating the value of genomic testing for colorectal cancer and appraise the quality of the economic studies conducted to date. Methods: A systematic review of the literature for economic studies of colorectal cancer genomics from January 2006 through October 2020, and evaluation of study quality using the Quality of Health Economic Studies (QHES) instrument was conducted. The validated QHES was then applied to a final set of articles that met eligibility criteria. Results: Our search of the literature initially yielded 12,859 records. A final set of 49 articles met our inclusion criteria. The QHES score ranged from 24 to 100, with an average score of 82. Most of the studies (n = 40, 82%) scored above 75 and were considered of good quality. Conclusion: Our analysis revealed that most of the economic analyses of colorectal cancer genomic molecular diagnostics in the literature may be of good quality. There is, however, some variation in methodological rigor between the articles.

Machine Learning Methods in Health Economics and Outcomes Research-The PALISADE Checklist: A Good Practices Report of an ISPOR Task Force

Advances in machine learning (ML) and artificial intelligence offer tremendous potential benefits to patients. Predictive analytics using ML are already widely used in healthcare operations and care delivery, but how can ML be used for health economics and outcomes research (HEOR)? To answer this question, ISPOR established an emerging good practices task force for the application of ML in HEOR. The task force identified 5 methodological areas where ML could enhance HEOR: (1) cohort selection, identifying samples with greater specificity with respect to inclusion criteria; (2) identification of independent predictors and covariates of health outcomes; (3) predictive analytics of health outcomes, including those that are high cost or life threatening; (4) causal inference through methods, such as targeted maximum likelihood estimation or double-debiased estimation-helping to produce reliable evidence more quickly; and (5) application of ML to the development of economic models to reduce structural, parameter, and sampling uncertainty in cost-effectiveness analysis. Overall, ML facilitates HEOR through the meaningful and efficient analysis of big data. Nevertheless, a lack of transparency on how ML methods deliver solutions to feature selection and predictive analytics, especially in unsupervised circumstances, increases risk to providers and other decision makers in using ML results. To examine whether ML offers a useful and transparent solution to healthcare analytics, the task force developed the PALISADE Checklist. It is a guide for balancing the many potential applications of ML with the need for transparency in methods development and findings.

Accounting for Intergenerational Cascade Testing in Economic Evaluations of Clinical Genomics: A Scoping Review

OBJECTIVES

Clinical genomics is emerging as a diagnostic tool in the identification of blood relatives at risk of developing heritable diseases. Our objective was to identify how genetic cascade screening has been incorporated into health economic evaluations.

METHODS

A scoping review was conducted to identify how multiple generations of a family were included in economic evaluations of clinical genomic sequencing, how many and which relatives were included, and uptake rates. Databases were searched for full economic evaluations of genetic interventions that screened multiple generations of families and were in English language, and no restrictions were made for disease or publication type. Data were synthesized using a narrative approach.

RESULTS

Twenty-five studies were included covering a range of diseases in various countries. Markov cohort models were mostly used with hypothetical populations and unsupported by clinical evidence. Cascade testing was either the primary intervention or secondary to the index cases. The number and type of relatives were based on assumptions or identified through population or family records, clinical registry data, or clinical literature. Studies included only immediate family members and the uptake of testing ranged between 20% and 100%. All interventions were reported as cost-effective, and a higher number of relatives was a key driver.

CONCLUSIONS

Several economic evaluations have considered the impacts of cascade testing interventions within clinical genomics. Ideally, models supported with high-quality clinical data are needed and, in their absence, transparent and justifiable assumptions of uptake rates and choices about including relatives. Consideration of more appropriate modeling types is required.

Health economic evidence for the use of molecular biomarker tests in hematological malignancies: A systematic review

Objectives

Molecular biomarker tests can inform the clinical management of genomic heterogeneous hematological malignancies, yet their availability in routine care largely depends on the supporting health economic evidence. This study aims to systematically review the economic evidence for recent molecular biomarker tests in hematological malignancies.

Methods

We conducted a systematic search in five electronic databases for studies published between January 2010 and October 2020. Publications were independently screened by two reviewers. Clinical study characteristics, economic methodology, and results were extracted, and reporting quality was assessed.

Results

Fourteen studies were identified, of which half (n = 7; 50%) were full economic evaluations examining both health and economic outcomes. Studies were predominantly conducted in a first‐line treatment setting (n = 7; 50%) and adopted a non‐lifetime time horizon to measure health outcomes and costs (n = 7; 50%). Five studies reported that companion diagnostics for associated therapies were likely cost‐effective for acute myeloid leukemia, chronic myeloid leukemia, diffuse large B‐cell lymphoma, and multiple myeloma. Four studies suggested molecular biomarker tests for treatment monitoring in chronic myeloid leukemia were likely cost‐saving.

Conclusions

Although there is initial confirmation of the promising health economic results, the present research for molecular biomarker tests in hematological malignancies is sparse with many applications of technological advances yet to be evaluated.

Guidance for the Harmonisation and Improvement of Economic Evaluations of Personalised Medicine

OBJECTIVE

The objective of this study was to develop guidance contributing to improved consistency and quality in economic evaluations of personalised medicine (PM), given current ambiguity about how to measure the value of PM as well as considerable variation in the methodology and reporting in economic evaluations of PM.

METHODS

A targeted literature review of methodological papers was performed for an overview of modelling challenges in PM. Expert interviews were held to discuss best modelling practice. A systematic literature review of economic evaluations of PM was conducted to gain insight into current modelling practice. The findings were synthesised and used to develop a set of draft recommendations. The draft recommendations were discussed at a stakeholder workshop and subsequently finalised.

RESULTS

Twenty-two methodological papers were identified. Some argued that the challenges in modelling PM can be addressed within existing methodological frameworks, others disagreed. Eighteen experts were interviewed. They believed large uncertainty to be a key concern. Out of 195 economic evaluations of PM identified, 56% addressed none of the identified modelling challenges. A set of 23 recommendations was developed. Eight recommendations focus on the modelling of test-treatment pathways. The use of non-randomised controlled trial data is discouraged but several recommendations are provided in case randomised controlled trial data are unavailable. The parameterisation of structural uncertainty is recommended. Other recommendations consider perspective and discounting; premature survival data; additional value elements; patient and clinician compliance; and managed entry agreements.

CONCLUSIONS

This study provides a comprehensive list of recommendations to modellers of PM and to evaluators and reviewers of PM models.

Overview and Use of Tools for Selecting Modelling Techniques in Health Economic Studies

The availability and use of tools to guide the choice of modelling technique are not well understood. Our study aims to review existing tools and explore the use of those tools in health economic models. Two reviews and one case study were conducted. Review 1 aimed to identify tools based on expert opinion and citation searching and explore the value of the tools for health economic models. Review 2, based on citation searching, aimed to describe how those tools have been used in health economic models. Both reviews were conducted using Web of Science and Scopus. Two independent reviewers selected studies for inclusion. A case study, focused on economic evaluations of antipsychotic medication in schizophrenia, was conducted to compare the modelling techniques used by existing models with modelling techniques recommended by identified tools. Seven tools were identified, of which the revised Brennan's toolkit, was assessed to be the most appropriate for health economic models. The seven tools were cited 126 times in publications reporting health economic models. Only 17 of these (13.5%) reported that they used the tool(s) to guide the choice of modelling technique. Application of these tools suggested discrete event simulation is most appropriate for modelling antipsychotic medication in schizophrenia, but discrete event simulation was only used by 17% of existing models. There is considerable inconsistency between the modelling techniques used by existing models and modelling techniques recommended by tools. It is recommended that for future modelling studies the choice of modelling technique should be justified, this can be achieved by the application of model selection tools, such as the revised Brennan's toolkit. Future research is required to explore the barriers to using model selection tools in health economic models and to update existing tools and make them easier to use.

Early technology assessment of using whole genome sequencing in personalized oncology

Introduction: Personalized medicine-based treatments in advanced cancer hold the promise to offer substantial health benefits to genetic subgroups, but require efficient biomarker-based patient stratification to match the right treatment and may be expensive. Standard molecular diagnostics are currently very heterogeneous, and tests are often performed sequentially. The alternative to whole genome sequencing (WGS) i.e. simultaneously testing for all relevant DNA-based biomarkers thereby allowing immediate selection of the most optimal therapy, is more costly than current techniques. In the current implementation stage, it is important to explore the added value and cost-effectiveness of using WGS on a patient level and to assess optimal introduction of WGS on the level of the healthcare system.Areas covered: First, an overview of current worldwide initiatives concerning the use of WGS in clinical practice for cancer diagnostics is given. Second, a comprehensive, early health technology assessment (HTA) approach of evaluating WGS in the Netherlands is described, relating to the following aspects: diagnostic value, WGS-based treatment decisions, assessment of long-term health benefits and harms, early cost-effectiveness modeling, nation-wide organization, and Ethical, Legal and Societal Implications.Expert opinion: This study provides evidence to guide further development and implementation of WGS in clinical practice and the healthcare system.

Using Metamodeling to Identify the Optimal Strategy for Colorectal Cancer Screening

OBJECTIVES

Metamodeling can address computational challenges within decision-analytic modeling studies evaluating many strategies. This article illustrates the value of metamodeling for evaluating colorectal cancer screening strategies while accounting for colonoscopy capacity constraints.

METHODS

In a traditional approach, the best screening strategy was identified from a limited subset of strategies evaluated with the validated Adenoma and Serrated pathway to Colorectal CAncer model. In a metamodeling approach, metamodels were fitted to this limited subset to evaluate all potentially plausible strategies and determine the best overall screening strategy. Approaches were compared based on the best screening strategy in life-years gained compared with no screening. Metamodel runtime and accuracy was assessed.

RESULTS

The metamodeling approach evaluated >40 000 strategies in <1 minute with high accuracy after 1 adaptive sampling step (mean absolute error: 0.0002 life-years) using 300 samples in total (generation time: 8 days). Findings indicated that health outcomes could be improved without requiring additional colonoscopy capacity. Obtaining similar insights using the traditional approach could require at least 1000 samples (generation time: 28 days). Suggested benefits from screening at ages <40 years require adequate validation of the underlying Adenoma and Serrated pathway to Colorectal CAncer model before making policy recommendations.

CONCLUSIONS

Metamodeling allows rapid assessment of a vast set of strategies, which may lead to identification of more favorable strategies compared to a traditional approach. Nevertheless, metamodel validation and identifying extrapolation beyond the support of the original decision-analytic model are critical to the interpretation of results. The screening strategies identified with metamodeling support ongoing discussions on decreasing the starting age of colorectal cancer screening.

How to Address Uncertainty in Health Economic Discrete-Event Simulation Models: An Illustration for Chronic Obstructive Pulmonary Disease

Background. Evaluation of personalized treatment options requires health economic models that include multiple patient characteristics. Patient-level discrete-event simulation (DES) models are deemed appropriate because of their ability to simulate a variety of characteristics and treatment pathways. However, DES models are scarce in the literature, and details about their methods are often missing. Methods. We describe 4 challenges associated with modeling heterogeneity and structural, stochastic, and parameter uncertainty that can be encountered during the development of DES models. We explain why these are important and how to correctly implement them. To illustrate the impact of the modeling choices discussed, we use (results of) a model for chronic obstructive pulmonary disease (COPD) as a case study. Results. The results from the case study showed that, under a correct implementation of the uncertainty in the model, a hypothetical intervention can be deemed as cost-effective. The consequences of incorrect modeling uncertainty included an increase in the incremental cost-effectiveness ratio ranging from 50% to almost a factor of 14, an extended life expectancy of approximately 1.4 years, and an enormously increased uncertainty around the model outcomes. Thus, modeling uncertainty incorrectly can have substantial implications for decision making. Conclusions. This article provides guidance on the implementation of uncertainty in DES models and improves the transparency of reporting uncertainty methods. The COPD case study illustrates the issues described in the article and helps understanding them better. The model R code shows how the uncertainty was implemented. For readers not familiar with R, the model's pseudo-code can be used to understand how the model works. By doing this, we can help other developers, who are likely to face similar challenges to those described here.

Addressing Challenges of Economic Evaluation in Precision Medicine Using Dynamic Simulation Modeling

OBJECTIVES

The objective of this article is to describe the unique challenges and present potential solutions and approaches for economic evaluations of precision medicine (PM) interventions using simulation modeling methods.

METHODS

Given the large and growing number of PM interventions and applications, methods are needed for economic evaluation of PM that can handle the complexity of cascading decisions and patient-specific heterogeneity reflected in the myriad testing and treatment pathways. Traditional approaches (eg, Markov models) have limitations, and other modeling techniques may be required to overcome these challenges. Dynamic simulation models, such as discrete event simulation and agent-based models, are used to design and develop mathematical representations of complex systems and intervention scenarios to evaluate the consequence of interventions over time from a systems perspective.

RESULTS

Some of the methodological challenges of modeling PM can be addressed using dynamic simulation models. For example, issues regarding companion diagnostics, combining and sequencing of tests, and diagnostic performance of tests can be addressed by capturing patient-specific pathways in the context of care delivery. Issues regarding patient heterogeneity can be addressed by using patient-level simulation models.

CONCLUSION

The economic evaluation of PM interventions poses unique methodological challenges that might require new solutions. Simulation models are well suited for economic evaluation in PM because they enable patient-level analyses and can capture the dynamics of interventions in complex systems specific to the context of healthcare service delivery.

Being Precise About Precision Medicine: What Should Value Frameworks Incorporate to Address Precision Medicine? A Report of the Personalized Precision Medicine Special Interest Group

Precision medicine is a dynamic area embracing a diverse and increasing type of approaches that allow the targeting of new medicines, screening programs or preventive healthcare strategies, which include the use of biologic markers or complex tests driven by algorithms also potentially taking account of patient preferences. The International Society for Pharmacoeconomics and Outcome Research expanded its current work around precision medicine to (1) describe the evolving paradigm of precision medicine with examples of current and evolving applications, (2) describe key stakeholders perspectives on the value of precision medicine in their respective domains, and (3) define the core factors that should be considered in a value assessment framework for precision medicine. With the ultimate goal of improving health of well-defined patient groups, precision medicine will affect all stakeholders in the healthcare system at multiple levels spanning the individual perspective to the societal perspective. For an efficient, timely and practical precision medicine value assessment framework, it will be important to address these multiple perspectives through building consensus among the stakeholders for robust procedures and measures of value aspects, including performance of precision mechanism; aligned reimbursement processes of precision mechanism and subsequent treatment; transparent expectations for evidence requirements and study designs adequately matched to the intended use of the precision mechanism and to the smaller target patient populations; recognizing the potential range of value-generation such as ruling-in and ruling-out decisions.

Artificial neural network metamodel for sensitivity analysis in a total hip replacement health economic model

Objectives: Metamodels have been used to approximate complex simulations and have many applications with sensitivity analysis, optimization, etc. However, their use in health economics is very limited. Application of artificial neural network (ANN) with a health economic model has never been investigated. The study intends to introduce ANN as a metamodeling method to conduct sensitivity analysis in a total hip replacement decision analytical model and compare its performance with two other counterparts. Methods: First, a nonlinear factor screening method was adopted to screen out unimportant factors from the simulation. Second, an ANN was developed using the important variables to approximate the simulation. Performance of the ANN metamodel was then compared with its Gaussian Process (GP) and multiple linear regression (MLR) counterparts. Results: Out of 31, the factor screening method identified 12 important variables from the simulation. ANN metamodels showed best predictive capabilities in terms of performance measures (mean squared error of prediction, MSEP and mean absolute percentage deviation, MAPD) used for predicting both costs and quality-adjusted life years (QALYs) for two prostheses. Conclusion: The study provides a methodological development in sensitivity analysis and demonstrates that an ANN metamodel is a potential approximation method for computationally expensive health economic simulations.

The Future of Precision Medicine: Potential Impacts for Health Technology Assessment

OBJECTIVE

Precision medicine allows healthcare interventions to be tailored to groups of patients based on their disease susceptibility, diagnostic or prognostic information, or treatment response. We analysed what developments are expected in precision medicine over the next decade and considered the implications for health technology assessment (HTA) agencies.

METHODS

We performed a pragmatic literature search to account for the large size and wide scope of the precision medicine literature. We refined and enriched these results with a series of expert interviews up to 1 h in length, including representatives from HTA agencies, research councils and researchers designed to cover a wide spectrum of precision medicine applications and research.

RESULTS

We identified 31 relevant papers and interviewed 13 experts. We found that three types of precision medicine are expected to emerge in clinical practice: complex algorithms, digital health applications and 'omics'-based tests. These are expected to impact upon each stage of the HTA process, from scoping and modelling through to decision-making and review. The complex and uncertain treatment pathways associated with patient stratification and fast-paced technological innovation are central to these effects.

DISCUSSION

Innovation in precision medicine promises substantial benefits but will change the way in which some health services are delivered and evaluated. The shelf life of guidance may decrease, structural uncertainty may increase and new equity considerations will emerge. As biomarker discovery accelerates and artificial intelligence-based technologies emerge, refinements to the methods and processes of evidence assessments will help to adapt and maintain the objective of investing in healthcare that is value for money.

Health economic impact of liquid biopsies in cancer management

INTRODUCTION

Liquid biopsies (LBs) are referred to as the sampling and analysis of non-solid tissue, primarily blood, as a diagnostic and monitoring tool for cancer. Because LBs are largely non-invasive, they are a less-costly alternative for serial analysis of tumor progression and heterogeneity to facilitate clinical management. Although a variety of tumor markers are proposed (e.g., free-circulating DNA), the clinical evidence for Circulating Tumor Cells (CTCs) is currently the most developed. Areas covered: This paper presents a health economic perspective of LBs in cancer management. We first briefly introduce the requirements in biomarker development and validation, illustrated for CTCs. Second, we discuss the state-of-art on the clinical utility of LBs in breast cancer in more detail. We conclude with a future perspective on the clinical use and reimbursement of LBs Expert commentary: A significant increase in clinical research on LBs can be observed and the results suggest a rapid change of cancer management. In addition to studies evaluating clinical utility of LBs, a smooth translation into clinical practice requires systematic assessment of the health economic benefits. This paper argues that (early stage) health economic research is required to facilitate its clinical use and to prioritize further evidence development.

Accounting for parameter uncertainty in the definition of parametric distributions used to describe individual patient variation in health economic models

Background

Parametric distributions based on individual patient data can be used to represent both stochastic and parameter uncertainty. Although general guidance is available on how parameter uncertainty should be accounted for in probabilistic sensitivity analysis, there is no comprehensive guidance on reflecting parameter uncertainty in the (correlated) parameters of distributions used to represent stochastic uncertainty in patient-level models. This study aims to provide this guidance by proposing appropriate methods and illustrating the impact of this uncertainty on modeling outcomes.

Methods

Two approaches, 1) using non-parametric bootstrapping and 2) using multivariate Normal distributions, were applied in a simulation and case study. The approaches were compared based on point-estimates and distributions of time-to-event and health economic outcomes. To assess sample size impact on the uncertainty in these outcomes, sample size was varied in the simulation study and subgroup analyses were performed for the case-study.

Results

Accounting for parameter uncertainty in distributions that reflect stochastic uncertainty substantially increased the uncertainty surrounding health economic outcomes, illustrated by larger confidence ellipses surrounding the cost-effectiveness point-estimates and different cost-effectiveness acceptability curves. Although both approaches performed similar for larger sample sizes (i.e. n = 500), the second approach was more sensitive to extreme values for small sample sizes (i.e. n = 25), yielding infeasible modeling outcomes.

Conclusions

Modelers should be aware that parameter uncertainty in distributions used to describe stochastic uncertainty needs to be reflected in probabilistic sensitivity analysis, as it could substantially impact the total amount of uncertainty surrounding health economic outcomes. If feasible, the bootstrap approach is recommended to account for this uncertainty.

Electronic supplementary material

The online version of this article (doi: 10.1186/s12874-017-0437-y) contains supplementary material, which is available to authorized users.

Comparison of Timed Automata with Discrete Event Simulation for Modeling of Biomarker-Based Treatment Decisions: An Illustration for Metastatic Castration-Resistant Prostate Cancer

BACKGROUND

With the advent of personalized medicine, the field of health economic modeling is being challenged and the use of patient-level dynamic modeling techniques might be required.

OBJECTIVES

To illustrate the usability of two such techniques, timed automata (TA) and discrete event simulation (DES), for modeling personalized treatment decisions.

METHODS

An early health technology assessment on the use of circulating tumor cells, compared with prostate-specific antigen and bone scintigraphy, to inform treatment decisions in metastatic castration-resistant prostate cancer was performed. Both modeling techniques were assessed quantitatively, in terms of intermediate outcomes (e.g., overtreatment) and health economic outcomes (e.g., net monetary benefit). Qualitatively, among others, model structure, agent interactions, data management (i.e., importing and exporting data), and model transparency were assessed.

RESULTS

Both models yielded realistic and similar intermediate and health economic outcomes. Overtreatment was reduced by 6.99 and 7.02 weeks by applying circulating tumor cell as a response marker at a net monetary benefit of -€1033 and -€1104 for the TA model and the DES model, respectively. Software-specific differences were observed regarding data management features and the support for statistical distributions, which were considered better for the DES software. Regarding method-specific differences, interactions were modeled more straightforward using TA, benefiting from its compositional model structure.

CONCLUSIONS

Both techniques prove suitable for modeling personalized treatment decisions, although DES would be preferred given the current software-specific limitations of TA. When these limitations are resolved, TA would be an interesting modeling alternative if interactions are key or its compositional structure is useful to manage multi-agent complex problems.

Emerging Use of Early Health Technology Assessment in Medical Product Development: A Scoping Review of the Literature

Early health technology assessment is increasingly being used to support health economic evidence development during early stages of clinical research. Such early models can be used to inform research and development about the design and management of new medical technologies to mitigate the risks, perceived by industry and the public sector, associated with market access and reimbursement. Over the past 25 years it has been suggested that health economic evaluation in the early stages may benefit the development and diffusion of medical products. Early health technology assessment has been suggested in the context of iterative economic evaluation alongside phase I and II clinical research to inform clinical trial design, market access, and pricing. In addition, performing early health technology assessment was also proposed at an even earlier stage for managing technology portfolios. This scoping review suggests a generally accepted definition of early health technology assessment to be "all methods used to inform industry and other stakeholders about the potential value of new medical products in development, including methods to quantify and manage uncertainty". The present review also aimed to identify recent published empirical studies employing an early-stage assessment of a medical product. With most included studies carried out to support a market launch, the dominant methodology was early health economic modeling. Further methodological development is required, in particular, by combining systems engineering and health economics to manage uncertainty in medical product portfolios.