A simulation model for evaluating the medical and economic outcomes of screening strategies for colorectal cancer

Critical Analysis of Markov Models Used for the Economic Evaluation of Colorectal Cancer Screening: A Systematic Review

BACKGROUND

The economic evaluation of colorectal cancer screening is challenging because of the need to model the underlying unobservable natural history of the disease.

OBJECTIVES

To describe the available Markov models and to critically analyze their main structural assumptions.

METHODS

A systematic search was performed in eight relevant databases (MEDLINE, Embase, Econlit, National Health Service Economic Evaluation Database, Health Economic Evaluations Database, Health Technology Assessment database, Cost-Effective Analysis Registry, and European Network of Health Economics Evaluation Databases), identifying 34 models that met the inclusion criteria. A comparative analysis of model structure and parameterization was conducted using two checklists and guidelines for cost-effectiveness screening models.

RESULTS

Two modeling techniques were identified. One strategy used a Markov model to reproduce the natural history of the disease and an overlaying model that reproduced the screening process, whereas the other used a single model to represent a screening program. Most of the studies included only adenoma-carcinoma sequences, a few included de novo cancer, and none included the serrated pathway. Parameterization of adenoma dwell time, sojourn time, and surveillance differed between studies, and there was a lack of validation and statistical calibration against local epidemiological data. Most of the studies analyzed failed to perform an adequate literature review and synthesis of diagnostic accuracy properties of the screening tests modeled.

CONCLUSIONS

Several strategies to model colorectal cancer screening have been developed, but many challenges remain to adequately represent the natural history of the disease and the screening process. Structural uncertainty analysis could be a useful strategy for understanding the impact of the assumptions of different models on cost-effectiveness results.

Cost-Effectiveness Models in Breast Cancer Screening in the General Population: A Systematic Review

BACKGROUND

Many Western countries have long-established population-based mammography screening programs. Prior to implementing these programs, decision-analytic modeling was widely used to inform decisions.

OBJECTIVE

The aim of this study was to perform a systematic review of cost-effectiveness models in breast cancer screening in the general population to analyze their structural and methodological approaches.

METHODS

A systematic literature search for health economic models was performed in the electronic databases MEDLINE (Ovid), EMBASE, CRD Databases, Cochrane Library, and EconLit in August 2011 with updates in June 2013, April 2015, and November 2016. To assess studies systematically, a standardized form was applied to extract relevant information that was then summarized in evidence tables.

RESULTS

Thirty-five studies were included; 27 state-transition models were analyzed using cohort (n = 12) and individual-level simulation (n = 15). Twenty-one studies modeled the natural history of breast cancer and predicted mortality as a function of the early detection modality. The models employed different assumptions regarding ductal carcinoma in situ. Thirteen studies performed cost-utility analyses with different sources for utility values, but assumptions were often made about utility weights. Twenty-two models did not report any validation.

CONCLUSION

State-transition modeling was the most frequently applied analytic approach. Different methods in modeling the progression of ductal carcinoma in situ to invasive cancer were identified because there is currently no agreement on the biological behavior of noninvasive breast cancer. Main weaknesses were the lack of precise utility estimates and insufficient reporting of validation. Sensitivity analyses of assumptions regarding ductal carcinoma in situ and in particular adequate validation are critical to minimize the risk of biased model outcomes.

Cost-effectiveness of family history-based colorectal cancer screening in Australia

Background

With 14.234 diagnoses and over 4047 deaths reported in 2007, colorectal cancer (CRC) is the second most common cancer and second most common cause of cancer-related mortality in Australia. The direct treatment cost has recently been estimated to be around AU$1.2 billion for the year 2011, which corresponds to a four-fold increase, compared the cost reported in 2001. Excluding CRCs due to known rare genetic disorders, 20% to 25% of all CRCs occur in a familial aggregation setting due to genetic variants or shared environmental risk factors that are yet to be characterised. A targeted screening strategy addressed to this segment of the population is a potentially valuable tool for reducing the overall burden of CRC.

Methods

We developed a Markov model to assess the cost-effectiveness of three screening strategies offered to people at increased risk due to a strong family history of CRC. The model simulated the evolution of a cohort of 10,000 individuals from age 50 to 90 years. We compared screening with biennial iFOBT, five-yearly colonoscopy and ten-yearly colonoscopy versus the current strategy of the Australian National Bowel Cancer Screening Programme (i.e. base case).

Results

Under the NBCSP scenario, 6,491 persons developed CRC with an average screening lifetime cost of AU$3,441 per person. In comparison, screening with biennial iFOBT, colonoscopy every ten years, and colonoscopy every five years reduced CRC incidence by 27%, 35% and 60%, and mortality by 15%, 26% and 46% respectively. All three screening strategies had a cost under AU$50,000 per life year gained, which is regarded as the upper limit of acceptable cost-effectiveness in the Australian health system. At AU$12,405 per life year gained and an average lifetime expectancy of 16.084 years, five-yearly colonoscopy screening was the most cost-effective strategy.

Conclusion

The model demonstrates that intensive CRC screening strategies targeting people at increased risk would be cost-effective in the Australian context. Our findings provide evidence that substantial health benefits can be generated from risk-based CRC screening at a relatively modest incremental cost.

A simulation model of colorectal cancer surveillance and recurrence

Background

Approximately one-third of those treated curatively for colorectal cancer (CRC) will experience recurrence. No evidence-based consensus exists on how best to follow patients after initial treatment to detect asymptomatic recurrence. Here, a new approach for simulating surveillance and recurrence among CRC survivors is outlined, and development and calibration of a simple model applying this approach is described. The model’s ability to predict outcomes for a group of patients under a specified surveillance strategy is validated.

Methods

We developed an individual-based simulation model consisting of two interacting submodels: a continuous-time disease-progression submodel overlain by a discrete-time Markov submodel of surveillance and re-treatment. In the former, some patients develops recurrent disease which probabilistically progresses from detectability to unresectability, and which may produce early symptoms leading to detection independent of surveillance testing. In the latter submodel, patients undergo user-specified surveillance testing regimens. Parameters describing disease progression were preliminarily estimated through calibration to match five-year disease-free survival, overall survival at years 1–5, and proportion of recurring patients undergoing curative salvage surgery from one arm of a published randomized trial. The calibrated model was validated by examining its ability to predict these same outcomes for patients in a different arm of the same trial undergoing less aggressive surveillance.

Results

Calibrated parameter values were consistent with generally observed recurrence patterns. Sensitivity analysis suggested probability of curative salvage surgery was most influenced by sensitivity of carcinoembryonic antigen assay and of clinical interview/examination (i.e. scheduled provider visits). In validation, the model accurately predicted overall survival (59% predicted, 58% observed) and five-year disease-free survival (55% predicted, 53% observed), but was less accurate in predicting curative salvage surgery (10% predicted; 6% observed).

Conclusions

Initial validation suggests the feasibility of this approach to modeling alternative surveillance regimens among CRC survivors. Further calibration to individual-level patient data could yield a model useful for predicting outcomes of specific surveillance strategies for risk-based subgroups or for individuals. This approach could be applied toward developing novel, tailored strategies for further clinical study. It has the potential to produce insights which will promote more effective surveillance—leading to higher cure rates for recurrent CRC.

The cost-effectiveness of immunochemical tests for colorectal cancer screening

BACKGROUND

The optimal immunochemical test to use for generalised mass screening is still under debate in France.

AIM

To compare the cost and effectiveness in biennial screening for colorectal cancer of fifteen strategies consisting of the three-stool sample un-rehydrated guaiac faecal occult blood test and three immunochemical tests: Magstream, FOB-Gold and OC-Sensor, at different positivity cut-off levels and stool-sample collection.

METHODS

A Markov model was used to compare these strategies in a general population of 100,000 individuals aged 50-74 over a 20-year period.

RESULTS

Immunochemical tests were efficient strategies compared with guaiac faecal occult blood test. When all 15 strategies were compared with each other, only five of them remained efficient: the one- and two-stool sample Magstream, the one- and two-stool sample FOB-Gold with the 176 ng/mL cut-off, and the two-stool sample OC-Sensor with the 150 ng/mL cut-off. Sensitivity analyses showed that, at an identical price, the one-stool sample OC-Sensor was the most efficient strategy, and outperformed FOB-Gold.

CONCLUSION

One-stool immunochemical testing can be considered a promising alternative to the guaiac faecal occult blood test for colorectal cancer mass screening in the general population. Competition between manufacturers should now be introduced to reduce purchase price differences.

Empirically evaluating decision-analytic models

OBJECTIVES

Model-based cost-effectiveness analyses support decision-making. To augment model credibility, evaluation via comparison to independent, empirical studies is recommended.

METHODS

We developed a structured reporting format for model evaluation and conducted a structured literature review to characterize current model evaluation recommendations and practices. As an illustration, we applied the reporting format to evaluate a microsimulation of human papillomavirus and cervical cancer. The model's outputs and uncertainty ranges were compared with multiple outcomes from a study of long-term progression from high-grade precancer (cervical intraepithelial neoplasia [CIN]) to cancer. Outcomes included 5 to 30-year cumulative cancer risk among women with and without appropriate CIN treatment. Consistency was measured by model ranges overlapping study confidence intervals.

RESULTS

The structured reporting format included: matching baseline characteristics and follow-up, reporting model and study uncertainty, and stating metrics of consistency for model and study results. Structured searches yielded 2963 articles with 67 meeting inclusion criteria and found variation in how current model evaluations are reported. Evaluation of the cervical cancer microsimulation, reported using the proposed format, showed a modeled cumulative risk of invasive cancer for inadequately treated women of 39.6% (30.9-49.7) at 30 years, compared with the study: 37.5% (28.4-48.3). For appropriately treated women, modeled risks were 1.0% (0.7-1.3) at 30 years, study: 1.5% (0.4-3.3).

CONCLUSIONS

To support external and projective validity, cost-effectiveness models should be iteratively evaluated as new studies become available, with reporting standardized to facilitate assessment. Such evaluations are particularly relevant for models used to conduct comparative effectiveness analyses.

Prevention, screening and treatment of colorectal cancer: a global and regional generalized cost effectiveness analysis

BACKGROUND

Regional generalized cost-effectiveness estimates of prevention, screening and treatment interventions for colorectal cancer are presented.

METHODS

Standardised WHO-CHOICE methodology was used. A colorectal cancer model was employed to provide estimates of screening and treatment effectiveness. Intervention effectiveness was determined via a population state-transition model (PopMod) that simulates the evolution of a sub-regional population accounting for births, deaths and disease epidemiology. Economic costs of procedures and treatment were estimated, including programme overhead and training costs.

RESULTS

In regions characterised by high income, low mortality and high existing treatment coverage, the addition of screening to the current high treatment levels is very cost-effective, although no particular intervention stands out in cost-effectiveness terms relative to the others.In regions characterised by low income, low mortality with existing treatment coverage around 50%, expanding treatment with or without screening is cost-effective or very cost-effective. Abandoning treatment in favour of screening (no treatment scenario) would not be cost effective.In regions characterised by low income, high mortality and low treatment levels, the most cost-effective intervention is expanding treatment.

CONCLUSIONS

From a cost-effectiveness standpoint, screening programmes should be expanded in developed regions and treatment programmes should be established for colorectal cancer in regions with low treatment coverage.

Multi-state Markov models in cancer screening evaluation: a brief review and case study

This work presents a brief overview of Markov models in cancer screening evaluation and focuses on two specific models. A three-state model was first proposed to estimate jointly the sensitivity of the screening procedure and the average duration in the preclinical phase, i.e. the period when the cancer is asymptomatic but detectable by screening. A five-state model, incorporating lymph node involvement as a prognostic factor, was later proposed combined with a survival analysis to predict the mortality reduction associated with screening. The strengths and limitations of these two models are illustrated using data from French breast cancer service screening programmes. The three-state model is a useful frame but parameter estimates should be interpreted with caution. They are highly correlated and depend heavily on the parametric assumptions of the model. Our results pointed out a serious limitation to the five-state model, due to implicit assumptions which are not always verified. Although it may still be useful, there is a need for more flexible models. Over-diagnosis is an important issue for both models and induces bias in parameter estimates. It can be addressed by adding a non-progressive state, but this may provide an uncertain estimation of over-diagnosis. When the primary goal is to avoid bias, rather than to estimate over-diagnosis, it may be more appropriate to correct for over-diagnosis assuming different levels in a sensitivity analysis. This would be particularly relevant in a perspective of mortality reduction estimation.

Cost-effectiveness of screening for colorectal cancer in France using a guaiac test versus an immunochemical test

Objectives: The aim of this study was to compare the cost and the effectiveness of two biennial fecal occult blood screening tests for colorectal cancer: a guaiac nonrehydrated test (G-FOBT) and an immunochemical test (I-FOBT) with the absence of screening.

Methods: A Markov model was developed to compare these strategies in a general population of subjects aged 50 to 74 over a 20-year period.

Results: Compared with the absence of screening, G-FOBT and I-FOBT were associated with a decrease in colorectal cancer mortality of 17.4 percent and 25.2 percent, respectively. With regard to cost-effectiveness, expressed as cost per life-year gained, I-FOBT was the most effective and most costly alternative. Compared with no screening, G-FOBT and I-FOBT presented similar discounted incremental cost-effectiveness ratios: €2,739 and €2,819 respectively per life-year gained. When compared with G-FOBT, I-FOBT presented an incremental cost-effectiveness ratio of €2,988 per life-year gained. Sensitivity analyses showed the strong influence of the I-FOBT lead time, of the participation rate to screening for I-FOBT, and of the purchase price of the I-FOBT on the discounted incremental cost-effectiveness ratios.

Conclusions: Compared with the absence of screening and with G-FOBT, the biennial two-stool immunochemical test can be considered a promising method for mass screening for colorectal cancer.

Calibration methods used in cancer simulation models and suggested reporting guidelines

Increasingly, computer simulation models are used for economic and policy evaluation in cancer prevention and control. A model's predictions of key outcomes, such as screening effectiveness, depend on the values of unobservable natural history parameters. Calibration is the process of determining the values of unobservable parameters by constraining model output to replicate observed data. Because there are many approaches for model calibration and little consensus on best practices, we surveyed the literature to catalogue the use and reporting of these methods in cancer simulation models. We conducted a MEDLINE search (1980 through 2006) for articles on cancer-screening models and supplemented search results with articles from our personal reference databases. For each article, two authors independently abstracted pre-determined items using a standard form. Data items included cancer site, model type, methods used for determination of unobservable parameter values and description of any calibration protocol. All authors reached consensus on items of disagreement. Reviews and non-cancer models were excluded. Articles describing analytical models, which estimate parameters with statistical approaches (e.g. maximum likelihood) were catalogued separately. Models that included unobservable parameters were analysed and classified by whether calibration methods were reported and if so, the methods used. The review process yielded 154 articles that met our inclusion criteria and, of these, we concluded that 131 may have used calibration methods to determine model parameters. Although the term 'calibration' was not always used, descriptions of calibration or 'model fitting' were found in 50% (n = 66) of the articles, with an additional 16% (n = 21) providing a reference to methods. Calibration target data were identified in nearly all of these articles. Other methodological details, such as the goodness-of-fit metric, were discussed in 54% (n = 47 of 87) of the articles reporting calibration methods, while few details were provided on the algorithms used to search the parameter space. Our review shows that the use of cancer simulation modelling is increasing, although thorough descriptions of calibration procedures are rare in the published literature for these models. Calibration is a key component of model development and is central to the validity and credibility of subsequent analyses and inferences drawn from model predictions. To aid peer-review and facilitate discussion of modelling methods, we propose a standardized Calibration Reporting Checklist for model documentation.

Cost-effectiveness analysis of fecal occult blood screening for colorectal cancer

OBJECTIVES

Clinical trials have demonstrated that fecal occult blood screening for colorectal cancer can significantly reduce mortality. However, to be deemed a priority from a public health policy perspective, any new program must prove itself to be cost-effective. The objective of this study was to assess the cost-effectiveness of screening for colorectal cancer using a fecal occult blood screening test, the Hemoccult-II, in a cohort of 100,000 asymptomatic individuals 50-74 years of age.

METHODS

A decision analysis model using a Markov approach simulates the trajectory of the cohort allocated either to screening or no screening over a 20-year period through several health states. Clinical and economic data used in the model came from the Burgundy trial, French population-based studies, and Registry data.

RESULTS

Modeling biennial screening versus the absence of screening over a 20-year period resulted in a 17.7 percent mortality reduction and a discounted incremental cost-effectiveness ratio of 3357 Euro per life-year gained among individuals 50-74 years of age. Sensitivity analyses performed on epidemiological and economic data showed the strong impact on the results of colonoscopy cost, of compliance to screening, and of specificity of the screening test.

CONCLUSIONS

Cost-effectiveness estimates and sensitivity analyses suggest that biennial screening for colorectal cancer with fecal occult blood test could be recommended from the age of 50 until 74. Our findings support the attempts to introduce large-scale population screening programs.

Building a model to determine the cost-effectiveness of breast cancer screening in France

This paper describes the methods and initial validation of a cost-effectiveness model developed to simulate the breast cancer screening situation in France. The first screening pilot programmes were set up in France in 1989 to test the feasibility of a decentralized screening model based in a large number of existing non-dedicated radiology centres. The present cost-effectiveness model was built as a tool to help guide current policy discussions on the future of screening in France. This Markov model compares the costs and effects expected when a screening programme is offered to a given cohort of women to those expected in the absence of screening. The model was initially validated using current results from the Bas-Rhin screening programme and local cancer registry epidemiological data. Over a 20-year period, 315 274 women would attend for screening, of whom 12 491 would be recalled for further assessment. 4423 cancers would be detected, resulting in 637 deaths. Screening allows the detection of 106 additional cancer cases, thereby preventing 92 deaths, and saves 1522 life-years compared with a situation without screening. Breast cancer mortality is reduced by 12.6%, yielding a cost-effectiveness ratio of 137 000 FF per life-year saved. The results of initial analyses suggest that the model is capable of suitably assessing the impact of breast cancer screening in terms of costs and effects. Further scenario analyses are needed to understand the impact of screening policy changes on the costs and effectiveness of future screening programmes.