Validation of Colorectal Cancer Models on Long-term Outcomes from a Randomized Controlled Trial

The Efficacy of Real-time Computer-aided Detection of Colonic Neoplasia in Community Practice: A Pragmatic Randomized Controlled Trial

BACKGROUND & AIMS

The use of computer-aided detection (CADe) has increased the adenoma detection rates (ADRs) during colorectal cancer (CRC) screening/surveillance in randomized controlled trials (RCTs) but has not shown benefit in real-world implementation studies. We performed a single-center pragmatic RCT to evaluate the impact of real-time CADe on ADRs in colonoscopy performed by community gastroenterologists.

METHODS

We enrolled 1100 patients undergoing colonoscopy for CRC screening, surveillance, positive fecal-immunohistochemical tests, and diagnostic indications at one community-based center from September 2022 to March 2023. Patients were randomly assigned (1:1) to traditional colonoscopy or real-time CADe. Blinded pathologists analyzed histopathologic findings. The primary outcome was ADR (the percentage of patients with at least 1 histologically proven adenoma or carcinoma). Secondary outcomes were adenomas detected per colonoscopy (APC), sessile-serrated lesion detection rate, and non-neoplastic resection rate.

RESULTS

The median age was 55.5 years (interquartile range, 50-62 years), 61% were female, 72.7% were of Hispanic ethnicity, and 9.1% had inadequate bowel preparation. The ADR for the CADe group was significantly higher than the traditional colonoscopy group (42.5% vs 34.4%; P = .005). The mean APC was significantly higher in the CADe group compared with the traditional colonoscopy group (0.89 ± 1.46 vs 0.60 ± 1.12; P < .001). The improvement in adenoma detection was driven by increased detection of <5 mm adenomas. CADe had a higher sessile-serrated lesion detection rate than traditional colonoscopy (4.7% vs 2.0%; P = .01). The improvement in ADR with CADe was significantly higher in the first half of the study (47.2% vs 33.7%; P = .002) compared with the second half (38.7% vs 34.9%; P = .33).

CONCLUSIONS

In a single-center pragmatic RCT, real-time CADe modestly improved ADR and APC in average-detector community endoscopists. (ClinicalTrials.gov number, NCT05963724).

Revisiting the standard blueprint for biomarker development to address emerging cancer early detection technologies

Novel liquid biopsy technologies are creating a watershed moment in cancer early detection. Evidence supporting population screening is nascent, but a rush to market the new tests is prompting cancer early detection researchers to revisit the standard blueprint that the Early Detection Research Network established to evaluate novel screening biomarkers. In this commentary, we review the Early Detection Research Network's Phases of Biomarker Development (PBD) for rigorous evaluation of novel early detection biomarkers and discuss both hazards and opportunities involved in expedited evaluation. According to the PBD, for a biomarker-based test to be considered for population screening, 1) test sensitivity in a prospective screening setting must be adequate, 2) the shift to early curable stages must be meaningful, and 3) any stage shift must translate into clinically significant mortality benefit. In the past, determining mortality benefit has required lengthy randomized screening trials, but interest is growing in expedited trial designs with shorter-term endpoints. Whether and how best to use such endpoints in a manner that retains the rigor of the PBD remains to be determined. We discuss how computational disease modeling can be harnessed to learn about screening impact and meet the needs of the moment.

Estimated US Cancer Deaths Prevented With Increased Use of Lung, Colorectal, Breast, and Cervical Cancer Screening

Importance

Increased use of recommended screening could help achieve the Cancer Moonshot goal of reducing US cancer deaths.

Objective

To estimate the number of cancer deaths that could be prevented with a 10-percentage point increase in the use of US Preventive Services Task Force (USPSTF)-recommended screening.

Design, Setting, and Participants

This decision analytical model study is an extension of previous studies conducted for the USPSTF from 2018 to 2023. This study simulated contemporary cohorts of US adults eligible for lung, colorectal, breast, and cervical cancer screening.

Exposures

Annual low-dose computed lung tomography among eligible adults aged 50 to 80 years; colonoscopy every 10 years among adults aged 45 to 75 years; biennial mammography among female adults aged 40 to 74 years; and triennial cervical cytology screening among female adults aged 21 to 29 years, followed by human papillomavirus testing every 5 years from ages 30 to 65 years.

Main Outcomes and Measures

Estimated number of cancer deaths prevented with a 10-percentage point increase in screening use, assuming screening commences at the USPSTF-recommended starting age and continues throughout the lifetime. Outcomes were presented 2 ways: (1) per 100 000 and (2) among US adults in 2021; and they were expressed among the target population at the age of screening initiation. For lung cancer, estimates were among those who will also meet the smoking eligibility criteria during their lifetime. Harms from increased uptake were also reported.

Results

A 10-percentage point increase in screening use at the age that USPSTF recommended screening commences was estimated to prevent 226 lung cancer deaths (range across models within the cancer site, 133-332 deaths), 283 (range, 263-313) colorectal cancer deaths, 82 (range, 61-106) breast cancer deaths, and 81 (1 model; no range available) cervical cancer deaths over the lifetimes of 100 000 persons eligible for screening. These rates corresponded with an estimated 1010 (range, 590-1480) lung cancer deaths prevented, 11 070 (range, 10 280-12 250) colorectal cancer deaths prevented, 1790 (range, 1330-2310) breast cancer deaths prevented, and 1710 (no range available) cervical cancer deaths prevented over the lifetimes of eligible US residents at the recommended age to initiate screening in 2021. Increased uptake was also estimated to generate harms, including 100 000 (range, 45 000-159 000) false-positive lung scans, 6000 (range, 6000-7000) colonoscopy complications, 300 000 (range, 295 000-302 000) false-positive mammograms, and 348 000 (no range available) colposcopies over the lifetime.

Conclusions and Relevance

In this decision analytical model study, a 10-percentage point increase in uptake of USPSTF-recommended lung, colorectal, breast, and cervical cancer screening at the recommended starting age was estimated to yield important reductions in cancer deaths. Achieving these reductions is predicated on ensuring equitable access to screening.

Effectiveness of Colorectal Cancer (CRC) Screening on All-Cause and CRC-Specific Mortality Reduction: A Systematic Review and Meta-Analysis

(1) Background: The aim of this study was to pool and compare all-cause and colorectal cancer (CRC) specific mortality reduction of CRC screening in randomized control trials (RCTs) and simulation models, and to determine factors that influence screening effectiveness. (2) Methods: PubMed, Embase, Web of Science and Cochrane library were searched for eligible studies. Multi-use simulation models or RCTs that compared the mortality of CRC screening with no screening in general population were included. CRC-specific and all-cause mortality rate ratios and 95% confidence intervals were calculated by a bivariate random model. (3) Results: 10 RCTs and 47 model studies were retrieved. The pooled CRC-specific mortality rate ratios in RCTs were 0.88 (0.80, 0.96) and 0.76 (0.68, 0.84) for guaiac-based fecal occult blood tests (gFOBT) and single flexible sigmoidoscopy (FS) screening, respectively. For the model studies, the rate ratios were 0.45 (0.39, 0.51) for biennial fecal immunochemical tests (FIT), 0.31 (0.28, 0.34) for biennial gFOBT, 0.61 (0.53, 0.72) for single FS, 0.27 (0.21, 0.35) for 10-yearly colonoscopy, and 0.35 (0.29, 0.42) for 5-yearly FS. The CRC-specific mortality reduction of gFOBT increased with higher adherence in both studies (RCT: 0.78 (0.68, 0.89) vs. 0.92 (0.87, 0.98), model: 0.30 (0.28, 0.33) vs. 0.92 (0.51, 1.63)). Model studies showed a 0.62-1.1% all-cause mortality reduction with single FS screening. (4) Conclusions: Based on RCTs and model studies, biennial FIT/gFOBT, single and 5-yearly FS, and 10-yearly colonoscopy screening significantly reduces CRC-specific mortality. The model estimates are much higher than in RCTs, because the simulated biennial gFOBT assumes higher adherence. The effectiveness of screening increases at younger screening initiation ages and higher adherences.

Modeling the Natural History and Screening Effects of Colorectal Cancer Using Both Adenoma and Serrated Neoplasia Pathways: The Development, Calibration, and Validation of a Discrete Event Simulation Model

Background. Existing colorectal cancer (CRC) screening models mostly focus on the adenoma pathway of CRC development, overlooking the serrated neoplasia pathway, which might result in overly optimistic screening predictions. In addition, Bayesian inference methods have not been widely used for model calibration. We aimed to develop a CRC screening model accounting for both pathways, calibrate it with approximate Bayesian computation (ABC) methods, and validate it with large CRC screening trials. Methods. A discrete event simulation (DES) of the CRC natural history (DECAS) was constructed using the adenoma and serrated pathways in R software. The model simulates CRC-related events in a specific birth cohort through various natural history states. Calibration took advantage of 74 prevalence data points from the German screening colonoscopy program of 5.2 million average-risk participants using an ABC method. CRC incidence outputs from DECAS were validated with the German national cancer registry data; screening effects were validated using 17-y data from the UK Flexible Sigmoidoscopy Screening sigmoidoscopy trial and a German screening colonoscopy cohort study. Results. The Bayesian calibration rendered 1,000 sets of posterior parameter samples. With the calibrated parameters, the observed age- and sex-specific CRC prevalences from the German registries were within the 95% DECAS-predicted intervals. Regarding screening effects, DECAS predicted a 41% (95% intervals 30%-51%) and 62% (95% intervals 55%-68%) reduction in 17-y cumulative CRC mortality for a single screening sigmoidoscopy and colonoscopy, respectively, falling within 95% confidence intervals reported in the 2 clinical studies used for validation. Conclusions. We presented DECAS, the first Bayesian-calibrated DES model for CRC natural history and screening, accounting for 2 CRC tumorigenesis pathways. The validated model can serve as a valid tool to evaluate the (cost-)effectiveness of CRC screening strategies.

Highlights

This article presents a new discrete event simulation model, DECAS, which models both adenoma-carcinoma and serrated neoplasia pathways for colorectal cancer (CRC) development and CRC screening effects.DECAS is calibrated based on a Bayesian inference method using the data from German screening colonoscopy program, which consists of more than 5 million first-time average-risk participants aged 55 years and older in 2003 to 2014.DECAS is flexible for evaluating various CRC screening strategies and can differentiate screening effects in different parts of the colon.DECAS is validated with large screening sigmoidoscopy and colonoscopy clinical study data and can be further used to evaluate the (cost-)effectiveness of German colorectal cancer screening strategies.

An Evolutionary Algorithm to Personalize Stool-Based Colorectal Cancer Screening

BACKGROUND

Fecal immunochemical testing (FIT) is an established method for colorectal cancer (CRC) screening. Measured FIT-concentrations are associated with both present and future risk of CRC, and may be used for personalized screening. However, evaluation of personalized screening is computationally challenging. In this study, a broadly applicable algorithm is presented to efficiently optimize personalized screening policies that prescribe screening intervals and FIT-cutoffs, based on age and FIT-history.

METHODS

We present a mathematical framework for personalized screening policies and a bi-objective evolutionary algorithm that identifies policies with minimal costs and maximal health benefits. The algorithm is combined with an established microsimulation model (MISCAN-Colon), to accurately estimate the costs and benefits of generated policies, without restrictive Markov assumptions. The performance of the algorithm is demonstrated in three experiments.

RESULTS

In Experiment 1, a relatively small benchmark problem, the optimal policies were known. The algorithm approached the maximum feasible benefits with a relative difference of 0.007%. Experiment 2 optimized both intervals and cutoffs, Experiment 3 optimized cutoffs only. Optimal policies in both experiments are unknown. Compared to policies recently evaluated for the USPSTF, personalized screening increased health benefits up to 14 and 4.3%, for Experiments 2 and 3, respectively, without adding costs. Generated policies have several features concordant with current screening recommendations.

DISCUSSION

The method presented in this paper is flexible and capable of optimizing personalized screening policies evaluated with computationally-intensive but established simulation models. It can be used to inform screening policies for CRC or other diseases. For CRC, more debate is needed on what features a policy needs to exhibit to make it suitable for implementation in practice.

Too Good to Be True? Evaluation of Colonoscopy Sensitivity Assumptions Used in Policy Models

BACKGROUND

Models can help guide colorectal cancer (CRC) screening policy. While models are carefully calibrated and validated, there is less scrutiny of assumptions about test performance.

METHODS

We examined the validity of the CRC-SPIN model and colonoscopy sensitivity assumptions. Standard sensitivity assumptions, consistent with published decision analyses, assume sensitivity equal to 0.75 for diminutive adenomas (<6mm), 0.85 for small adenomas (6-10mm), 0.95 for large adenomas ( {greater than or equal to} 10mm), and 0.95 for preclinical cancer. We also selected adenoma sensitivity that resulted in more accurate predictions. Targets were drawn from the Wheat Bran Fiber study. We examined how well the model predicted outcomes measured over a three-year follow-up period, including: the number of adenomas detected, the size of the largest adenoma detected, and incident CRC.

RESULTS

Using standard sensitivity assumptions, the model predicted adenoma prevalence that was too low (42.5% versus 48.9% observed, with 95% confidence interval 45.3%-50.7%) and detection of too few large adenomas (5.1% versus 14.% observed, with 95% confidence interval 11.8%-17.4%). Predictions were close to targets when we set sensitivities to 0.20 for diminutive adenomas, 0.60 for small adenomas, 0.80 for 10-20mm adenomas, and 0.98 for adenomas 20mm and larger.

CONCLUSIONS

Colonoscopy may be less accurate than currently assumed, especially for diminutive adenomas. Alternatively, the CRC-SPIN model may not accurately simulate onset and progression of adenomas in higher-risk populations.

IMPACT

Misspecification of either colonoscopy sensitivity or disease progression in high-risk populations may impact the predicted effectiveness of CRC screening. When possible, decision analyses used to inform policy should address these uncertainties.

Colorectal Cancer Screening: An Updated Modeling Study for the US Preventive Services Task Force

Importance

The US Preventive Services Task Force (USPSTF) is updating its 2016 colorectal cancer screening recommendations.

Objective

To provide updated model-based estimates of the benefits, burden, and harms of colorectal cancer screening strategies and to identify strategies that may provide an efficient balance of life-years gained (LYG) from screening and colonoscopy burden to inform the USPSTF.

Design, Setting, and Participants

Comparative modeling study using 3 microsimulation models of colorectal cancer screening in a hypothetical cohort of 40-year-old US individuals at average risk of colorectal cancer.

Exposures

Screening from ages 45, 50, or 55 years to ages 70, 75, 80, or 85 years with fecal immunochemical testing (FIT), multitarget stool DNA testing, flexible sigmoidoscopy alone or with FIT, computed tomography colonography, or colonoscopy. All persons with an abnormal noncolonoscopy screening test result were assumed to undergo follow-up colonoscopy. Screening intervals varied by test. Full adherence with all procedures was assumed.

Main Outcome and Measures

Estimated LYG relative to no screening (benefit), lifetime number of colonoscopies (burden), number of complications from screening (harms), and balance of incremental burden and benefit (efficiency ratios). Efficient strategies were those estimated to require fewer additional colonoscopies per additional LYG relative to other strategies.

Results

Estimated LYG from screening strategies ranged from 171 to 381 per 1000 40-year-olds. Lifetime colonoscopy burden ranged from 624 to 6817 per 1000 individuals, and screening complications ranged from 5 to 22 per 1000 individuals. Among the 49 strategies that were efficient options with all 3 models, 41 specified screening beginning at age 45. No single age to end screening was predominant among the efficient strategies, although the additional LYG from continuing screening after age 75 were generally small. With the exception of a 5-year interval for computed tomography colonography, no screening interval predominated among the efficient strategies for each modality. Among the strategies highlighted in the 2016 USPSTF recommendation, lowering the age to begin screening from 50 to 45 years was estimated to result in 22 to 27 additional LYG, 161 to 784 additional colonoscopies, and 0.1 to 2 additional complications per 1000 persons (ranges are across screening strategies, based on mean estimates across models). Assuming full adherence, screening outcomes and efficient strategies were similar by sex and race and across 3 scenarios for population risk of colorectal cancer.

Conclusions and Relevance

This microsimulation modeling analysis suggests that screening for colorectal cancer with stool tests, endoscopic tests, or computed tomography colonography starting at age 45 years provides an efficient balance of colonoscopy burden and life-years gained.