Non-invasive prediction of microsatellite instability in colorectal cancer by a genetic algorithm-enhanced artificial neural network-based CT radiomics signature

Deep Learning of radiology-genomics integration for computational oncology: A mini review

In the field of computational oncology, patient status is often assessed using radiology-genomics, which includes two key technologies and data, such as radiology and genomics. Recent advances in deep learning have facilitated the integration of radiology-genomics data, and even new omics data, significantly improving the robustness and accuracy of clinical predictions. These factors are driving artificial intelligence (AI) closer to practical clinical applications. In particular, deep learning models are crucial in identifying new radiology-genomics biomarkers and therapeutic targets, supported by explainable AI (xAI) methods. This review focuses on recent developments in deep learning for radiology-genomics integration, highlights current challenges, and outlines some research directions for multimodal integration and biomarker discovery of radiology-genomics or radiology-omics that are urgently needed in computational oncology.

A CT-based deep learning for segmenting tumors and predicting microsatellite instability in patients with colorectal cancers: a multicenter cohort study

PURPOSE

To develop and validate deep learning (DL) models using preoperative contrast-enhanced CT images for tumor auto-segmentation and microsatellite instability (MSI) prediction in colorectal cancer (CRC).

MATERIALS AND METHODS

Patients with CRC who underwent surgery or biopsy between January 2018 and April 2023 were retrospectively enrolled. Mismatch repair protein expression was determined via immunohistochemistry or fluorescence multiplex polymerase chain reaction-capillary electrophoresis. Manually delineated tumor contours using arterial and venous phase CT images by three abdominal radiologists are served as ground truth. Tumor auto-segmentation used nnU-Net. MSI prediction employed ViT or convolutional neural networks models, trained and validated with arterial and venous phase images (image model) or combined clinical-pathological factors (combined model). The segmentation model was evaluated using patch coverage ratio, Dice coefficient, recall, precision, and F1-score. The predictive models' efficacy was assessed using areas under the curves and decision curve analysis.

RESULTS

Overall, 2180 patients (median age: 61 years ± 17 [SD]; 1285 males) were divided into training (n = 1159), validation (n = 289), and independent external test (n = 732) groups. High-level MSI status was present in 435 patients (20%). In the external test set, the segmentation model performed well in the arterial phase, with patch coverage ratio, Dice coefficient, recall, precision, and F1-score values of 0.87, 0.71, 0.72, 0.74, and 0.71, respectively. For MSI prediction, the combined models outperformed the clinical model (AUC = 0.83 and 0.82 vs 0.67, p < 0.001) and two image models (AUC = 0.75 and 0.77, p < 0.001). Decision curve analysis confirmed the higher net benefit of the combined model compared to the other models across probability thresholds ranging from 0.1 to 0.45.

CONCLUSION

DL enhances tumor segmentation efficiency and, when integrated with contrast-enhanced CT and clinicopathological factors, exhibits good diagnostic performance in predicting MSI in CRC.

Non-invasive CT radiomic biomarkers predict microsatellite stability status in colorectal cancer: a multicenter validation study

BACKGROUND

Microsatellite instability (MSI) status is a strong predictor of response to immunotherapy of colorectal cancer. Radiogenomic approaches promise the ability to gain insight into the underlying tumor biology using non-invasive routine clinical images. This study investigates the association between tumor morphology and the status of MSI versus microsatellite stability (MSS), validating a novel radiomic signature on an external multicenter cohort.

METHODS

Preoperative computed tomography scans with matched MSI status were retrospectively collected for 243 colorectal cancer patients from three hospitals: Seoul National University Hospital (SNUH); Netherlands Cancer Institute (NKI); and Fondazione IRCCS Istituto Nazionale dei Tumori, Milan Italy (INT). Radiologists delineated primary tumors in each scan, from which radiomic features were extracted. Machine learning models trained on SNUH data to identify MSI tumors underwent external validation using NKI and INT images. Performances were compared in terms of area under the receiving operating curve (AUROC).

RESULTS

We identified a radiomic signature comprising seven radiomic features that were predictive of tumors with MSS or MSI (AUROC 0.69, 95% confidence interval [CI] 0.54-0.84, p = 0.018). Integrating radiomic and clinical data into an algorithm improved predictive performance to an AUROC of 0.78 (95% CI 0.60-0.91, p = 0.002) and enhanced the reliability of the predictions.

CONCLUSION

Differences in the radiomic morphological phenotype between tumors MSS or MSI could be detected using radiogenomic approaches. Future research involving large-scale multicenter prospective studies that combine various diagnostic data is necessary to refine and validate more robust, potentially tumor-agnostic MSI radiogenomic models.

RELEVANCE STATEMENT

Noninvasive radiomic signatures derived from computed tomography scans can predict MSI in colorectal cancer, potentially augmenting traditional biopsy-based methods and enhancing personalized treatment strategies.

KEY POINTS

Noninvasive CT-based radiomics predicted MSI in colorectal cancer, enhancing stratification. A seven-feature radiomic signature differentiated tumors with MSI from those with MSS in multicenter cohorts. Integrating radiomic and clinical data improved the algorithm's predictive performance.

A radiomics-boosted deep-learning for risk assessment of synchronous peritoneal metastasis in colorectal cancer

OBJECTIVES

Synchronous colorectal cancer peritoneal metastasis (CRPM) has a poor prognosis. This study aimed to create a radiomics-boosted deep learning model by PET/CT image for risk assessment of synchronous CRPM.

METHODS

A total of 220 colorectal cancer (CRC) cases were enrolled in this study. We mapped the feature maps (Radiomic feature maps (RFMs)) of radiomic features across CT and PET image patches by a 2D sliding kernel. Based on ResNet50, a radiomics-boosted deep learning model was trained using PET/CT image patches and RFMs. Besides that, we explored whether the peritumoral region contributes to the assessment of CRPM. In this study, the performance of each model was evaluated by the area under the curves (AUC).

RESULTS

The AUCs of the radiomics-boosted deep learning model in the training, internal, external, and all validation datasets were 0.926 (95% confidence interval (CI): 0.874-0.978), 0.897 (95% CI: 0.801-0.994), 0.885 (95% CI: 0.795-0.975), and 0.889 (95% CI: 0.823-0.954), respectively. This model exhibited consistency in the calibration curve, the Delong test and IDI identified it as the most predictive model.

CONCLUSIONS

The radiomics-boosted deep learning model showed superior estimated performance in preoperative prediction of synchronous CRPM from pre-treatment PET/CT, offering potential assistance in the development of more personalized treatment methods and follow-up plans.

CRITICAL RELEVANCE STATEMENT

The onset of synchronous colorectal CRPM is insidious, and using a radiomics-boosted deep learning model to assess the risk of CRPM before treatment can help make personalized clinical treatment decisions or choose more sensitive follow-up plans.

KEY POINTS

Prognosis for patients with CRPM is bleak, and early detection poses challenges. The synergy between radiomics and deep learning proves advantageous in evaluating CRPM. The radiomics-boosted deep-learning model proves valuable in tailoring treatment approaches for CRC patients.

A multicenter study: predicting KRAS mutation and prognosis in colorectal cancer through a CT-based radiomics nomogram

PURPOSE

To establish a CT-based radiomics nomogram for preoperative prediction of KRAS mutation and prognostic stratification in colorectal cancer (CRC) patients.

METHODS

In a retrospective analysis, 408 patients with confirmed CRC were included, comprising 168 cases in the training set, 111 cases in the internal validation set, and 129 cases in the external validation set. Radiomics features extracted from the primary tumors were meticulously screened to identify those closely associated with KRAS mutation. Subsequently, a radiomics nomogram was constructed by integrating these radiomics features with clinically significant parameters. The diagnostic performance was assessed through the area under the receiver operating characteristic curve (AUC). Lastly, the prognostic significance of the nomogram was explored, and Kaplan-Meier analysis was employed to depict survival curves for the high-risk and low-risk groups.

RESULTS

A radiomics model was constructed using 19 radiomics features significantly associated with KRAS mutation. Furthermore, a nomogram was developed by integrating these radiomics features with two clinically significant parameters (age, tumor location). The nomogram achieved AUCs of 0.834, 0.813, and 0.811 in the training set, internal validation set, and external validation set, respectively. Additionally, the nomogram effectively stratified patients into high-risk (KRAS mutation) and low-risk (KRAS wild-type) groups, demonstrating a significant difference in overall survival (P < 0.001). Patients categorized in the high-risk group exhibited inferior overall survival in contrast to those classified in the low-risk group.

CONCLUSIONS

The CT-based radiomics nomogram demonstrates the capability to effectively predict KRAS mutation in CRC patients and stratify their prognosis preoperatively.

Application research of radiomics in colorectal cancer: A bibliometric study

BACKGROUND

Radiomics has shown great potential in the clinical field of colorectal cancer (CRC). However, few bibliometric studies have systematically analyzed existing research in this field. The purpose of this study is to understand the current research status and future development directions of CRC.

METHODS

Search the English documents on the application of radiomics in the field of CRC research included in the Web of Science Core Collection from its establishment to October 2023. VOSviewer and CiteSpace software were used to conduct bibliometric and visual analysis of online publications related to countries/regions, authors, journals, references, and keywords in this field.

RESULTS

A total of 735 relevant documents published from Web of Science Core Collection to October 2023 were retrieved, and a total of 419 documents were obtained based on the screening criteria, including 376 articles and 43 reviews. The number of publications is increasing year by year. Among them, China publishes the most relevant documents (n = 238), which is much higher than Italy (n = 69) and the United States (n = 63). Tian Jie is the author with the most publications and citations (n = 17, citations = 2128), GE Healthcare is the most productive institution (n = 26), Frontiers in Oncology is the journal with the most publications (n = 60), and European Radiology is the most cited journal (n = 776). Hot spots for the application of radiomics in CRC include magnetic resonance, neoadjuvant chemoradiotherapy, survival, texture analysis, and machine learning. These directions are the current hot spots for the application of radiomics research in CRC and may be the direction of continued development in the future.

CONCLUSION

Through bibliometric analysis, the application of radiomics in CRC has been increasing year by year. The application of radiomics improves the accuracy of preoperative diagnosis, prediction, and prognosis of CRC. The results of bibliometrics analysis provide a valuable reference for the research direction of radiomics. However, radiomics still faces many challenges in the future, such as the single nature of the data source which may affect the comprehensiveness of the results. Future studies can further expand the data sources and build a multicenter public database to more comprehensively reflect the research status and development trend of CRC radiomics.

A radiomics signature derived from CT imaging to predict MSI status and immunotherapy outcomes in gastric cancer: a multi-cohort study

BACKGROUND

Accurate microsatellite instability (MSI) testing is essential for identifying gastric cancer (GC) patients eligible for immunotherapy. We aimed to develop and validate a CT-based radiomics signature to predict MSI and immunotherapy outcomes in GC.

METHODS

This retrospective multicohort study included a total of 457 GC patients from two independent medical centers in China and The Cancer Imaging Archive (TCIA) databases. The primary cohort (n = 201, center 1, 2017-2022), was used for signature development via Least Absolute Shrinkage and Selection Operator (LASSO) and logistic regression analysis. Two independent immunotherapy cohorts, one from center 1 (n = 184, 2018-2021) and another from center 2 (n = 43, 2020-2021), were utilized to assess the signature's association with immunotherapy response and survival. Diagnostic efficiency was evaluated using the area under the receiver operating characteristic curve (AUC), and survival outcomes were analyzed via the Kaplan-Meier method. The TCIA cohort (n = 29) was included to evaluate the immune infiltration landscape of the radiomics signature subgroups using both CT images and mRNA sequencing data.

RESULTS

Nine radiomics features were identified for signature development, exhibiting excellent discriminative performance in both the training (AUC: 0.851, 95%CI: 0.782, 0.919) and validation cohorts (AUC: 0.816, 95%CI: 0.706, 0.926). The radscore, calculated using the signature, demonstrated strong predictive abilities for objective response in immunotherapy cohorts (AUC: 0.734, 95%CI: 0.662, 0.806; AUC: 0.724, 95%CI: 0.572, 0.877). Additionally, the radscore showed a significant association with PFS and OS, with GC patients with a low radscore experiencing a significant survival benefit from immunotherapy. Immune infiltration analysis revealed significantly higher levels of CD8 + T cells, activated CD4 + B cells, and TNFRSF18 expression in the low radscore group, while the high radscore group exhibited higher levels of T cells regulatory and HHLA2 expression.

CONCLUSION

This study developed a robust radiomics signature with the potential to serve as a non-invasive biomarker for GC's MSI status and immunotherapy response, demonstrating notable links to post-immunotherapy PFS and OS. Additionally, distinct immune profiles were observed between low and high radscore groups, highlighting their potential clinical implications.

Noninvasive prediction of perineural invasion in intrahepatic cholangiocarcinoma by clinicoradiological features and computed tomography radiomics based on interpretable machine learning: a multicenter cohort study

BACKGROUND

Perineural invasion (PNI) of intrahepatic cholangiocarcinoma (ICC) is a strong independent risk factor for tumour recurrence and long-term patient survival. However, there is a lack of noninvasive tools for accurately predicting the PNI status. The authors develop and validate a combined model incorporating radiomics signature and clinicoradiological features based on machine learning for predicting PNI in ICC, and used the Shapley Additive explanation (SHAP) to visualize the prediction process for clinical application.

METHODS

This retrospective and prospective study included 243 patients with pathologically diagnosed ICC (training, n =136; external validation, n =81; prospective, n =26, respectively) who underwent preoperative contrast-enhanced computed tomography between January 2012 and May 2023 at three institutions (three tertiary referral centres in Guangdong Province, China). The ElasticNet was applied to select radiomics features and construct signature derived from computed tomography images, and univariate and multivariate analyses by logistic regression were used to identify the significant clinical and radiological variables with PNI. A robust combined model incorporating radiomics signature and clinicoradiological features based on machine learning was developed and the SHAP was used to visualize the prediction process. A Kaplan-Meier survival analysis was performed to compare prognostic differences between PNI-positive and PNI-negative groups and was conducted to explore the prognostic information of the combined model.

RESULTS

Among 243 patients (mean age, 61.2 years ± 11.0 (SD); 152 men and 91 women), 108 (44.4%) were diagnosed as PNI-positive. The radiomics signature was constructed by seven radiomics features, with areas under the curves of 0.792, 0.748, and 0.729 in the training, external validation, and prospective cohorts, respectively. Three significant clinicoradiological features were selected and combined with radiomics signature to construct a combined model using machine learning. The eXtreme Gradient Boosting exhibited improved accuracy and robustness (areas under the curves of 0.884, 0.831, and 0.831, respectively). Survival analysis showed the construction combined model could be used to stratify relapse-free survival (hazard ratio, 1.933; 95% CI: 1.093-3.418; P =0.021).

CONCLUSIONS

We developed and validated a robust combined model incorporating radiomics signature and clinicoradiological features based on machine learning to accurately identify the PNI statuses of ICC, and visualize the prediction process through SHAP for clinical application.

Preoperative contrast-enhanced CT imaging and clinicopathological characteristics analysis of mismatch repair-deficient colorectal cancer

BACKGROUND

Colorectal cancer (CRC) can develop through various pathogenetic pathways, and one of the primary pathways is high microsatellite instability (MSI-H)/deficient mismatch repair (dMMR). This study investigated the correlation between preoperative contrast-enhanced CT (CECT) and clinicopathologic characteristics of colorectal cancer (CRC) according to different mismatch repair (MMR) statuses.

METHODS

From April 2021 to July 2022, a total of 281 CRC patients with preoperative CECT and available MMR status were enrolled from a single centre for this retrospective study. Preoperative CECT features and clinicopathologic characteristics were analysed. Univariate and multivariate logistic regression analyses were used for statistical analysis. A nomogram was established based on the multivariate logistic regression results. Preoperative and postoperative dynamic nomogram prediction models were established. The C-index, a calibration plot, and clinical applicability of the two models were evaluated, and internal validation was performed using three methods.

RESULTS

In total, 249 patients were enrolled in the proficient mismatch repair (pMMR) group and 32 patients in the deficient mismatch repair (dMMR) group. In multivariate analysis, tumour location (right-hemi colon vs. left-hemi colon, odds ratio (OR) = 2.90, p = .036), the hypoattenuation-within-tumour ratio (HR) (HR > 2/3 vs. HR < 1/3, OR = 36.7, p < .001; HR 1/3-2/3 vs. HR < 1/3, OR = 6.05, p = .031), the number of lymph nodes with long diameter ≥ 8 mm on CECT (OR = 1.32, p = .01), CEA status (CEA positive vs. CEA negative, OR = 0.07, p = .002) and lymph node metastasis (OR = 0.45, p = .008) were independent risk factors for dMMR. Pre- and postoperative C-statistic were 0.861 and 0.908, respectively.

CONCLUSION

The combination of pre-operative CECT and clinicopathological characteristics of CRC correlates with MMR status, providing possible non-invasive MMR prediction. Particularly for dMMR CRC, tumour-draining lymph node status should be prudently evaluated by CECT.

CT-based deep learning model for the prediction of DNA mismatch repair deficient colorectal cancer: a diagnostic study

BACKGROUND

Stratification of DNA mismatch repair (MMR) status in patients with colorectal cancer (CRC) enables individual clinical treatment decision making. The present study aimed to develop and validate a deep learning (DL) model based on the pre-treatment CT images for predicting MMR status in CRC.

METHODS

1812 eligible participants (training cohort: n = 1124; internal validation cohort: n = 482; external validation cohort: n = 206) with CRC were enrolled from two institutions. All pretherapeutic CT images from three dimensions were trained by the ResNet101, then integrated by Gaussian process regression (GPR) to develop a full-automatic DL model for MMR status prediction. The predictive performance of the DL model was evaluated using the area under the receiver operating characteristic curve (AUC) and then tested in the internal and external validation cohorts. Additionally, the participants from institution 1 were sub-grouped by various clinical factors for subgroup analysis, then the predictive performance of the DL model for identifying MMR status between participants in different groups were compared.

RESULTS

The full-automatic DL model was established in the training cohort to stratify the MMR status, which presented promising discriminative ability with the AUCs of 0.986 (95% CI 0.971-1.000) in the internal validation cohort and 0.915 (95% CI 0.870-0.960) in the external validation cohort. In addition, the subgroup analysis based on the thickness of CT images, clinical T and N stages, gender, the longest diameter, and the location of tumors revealed that the DL model showed similar satisfying prediction performance.

CONCLUSIONS

The DL model may potentially serve as a noninvasive tool to facilitate the pre-treatment individualized prediction of MMR status in patients with CRC, which could promote the personalized clinical-making decision.

Systematic review of machine learning-based radiomics approach for predicting microsatellite instability status in colorectal cancer

This study aimed to systematically summarize the performance of the machine learning-based radiomics models in the prediction of microsatellite instability (MSI) in patients with colorectal cancer (CRC). It was conducted according to the preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA) guideline and was registered at the PROSPERO website with an identifier CRD42022295787. Systematic literature searching was conducted in databases of PubMed, Embase, Web of Science, and Cochrane Library up to November 10, 2022. Research which applied radiomics analysis on preoperative CT/MRI/PET-CT images for predicting the MSI status in CRC patients with no history of anti-tumor therapies was eligible. The radiomics quality score (RQS) and Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) were applied to evaluate the research quality (full score 100%). Twelve studies with 4,320 patients were included. All studies were retrospective, and only four had an external validation cohort. The median incidence of MSI was 19% (range 8-34%). The area under the receiver operator curve of the models ranged from 0.78 to 0.96 (median 0.83) in the external validation cohort. The median sensitivity was 0.76 (range 0.32-1.00), and the median specificity was 0.87 (range 0.69-1.00). The median RQS score was 38% (range 14-50%), and half of the studies showed high risk in patient selection as evaluated by QUADAS-2. In conclusion, while radiomics based on pretreatment imaging modalities had a high performance in the prediction of MSI status in CRC, so far it does not appear to be ready for clinical use due to insufficient methodological quality.