The Conversion of MRI Data With Multiple b-Values into Signature-Like Pictures to Predict Treatment Response for Rectal Cancer

Machine learning in predicting pathological complete response to neoadjuvant chemoradiotherapy in rectal cancer using MRI: a systematic review and meta-analysis

OBJECTIVES

To evaluate the performance of machine learning models in predicting pathological complete response (pCR) to neoadjuvant chemoradiotherapy (nCRT) in patients with rectal cancer using magnetic resonance imaging.

METHODS

We searched PubMed, Embase, Cochrane Library, and Web of Science for studies published before March 2024. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) was used to assess the methodological quality of the included studies, random-effects models were used to calculate sensitivity and specificity, I2 values were used for heterogeneity measurements, and subgroup analyses were carried out to detect potential sources of heterogeneity.

RESULTS

A total of 1699 patients from 24 studies were included. For machine learning models in predicting pCR to nCRT, the meta-analysis calculated a pooled area under the curve (AUC) of 0.91 (95% CI, 0.88-0.93), pooled sensitivity of 0.83 (95% CI, 0.74-0.89), and pooled specificity of 0.86 (95% CI, 0.80-0.91). We investigated 6 studies that mainly contributed to heterogeneity. After performing meta-analysis again excluding these 6 studies, the heterogeneity was significantly reduced. In subgroup analysis, the pooled AUC of the deep-learning model was 0.93 and 0.89 for the traditional statistical model; the pooled AUC of studies that used diffusion-weighted imaging (DWI) was 0.90 and 0.92 in studies that did not use DWI; the pooled AUC of studies conducted in China was 0.93, and was 0.83 in studies conducted in other countries.

CONCLUSIONS

This systematic study showed that machine learning has promising potential in predicting pCR to nCRT in patients with locally advanced rectal cancer. Compared to traditional machine learning models, although deep-learning-based studies are less predominant and more heterogeneous, they are able to obtain higher AUC.

ADVANCES IN KNOWLEDGE

Compared to traditional machine learning models, deep-learning-based studies are able to obtain higher AUC, although they are less predominant and more heterogeneous. Together with clinical information, machine learning-based models may bring us closer towards precision medicine.

Image-based artificial intelligence for the prediction of pathological complete response to neoadjuvant chemoradiotherapy in patients with rectal cancer: a systematic review and meta-analysis

OBJECTIVE

Artificial intelligence (AI) holds enormous potential for noninvasively identifying patients with rectal cancer who could achieve pathological complete response (pCR) following neoadjuvant chemoradiotherapy (nCRT). We aimed to conduct a meta-analysis to summarize the diagnostic performance of image-based AI models for predicting pCR to nCRT in patients with rectal cancer.

METHODS

This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. A literature search of PubMed, Embase, Cochrane Library, and Web of Science was performed from inception to July 29, 2023. Studies that developed or utilized AI models for predicting pCR to nCRT in rectal cancer from medical images were included. The Quality Assessment of Diagnostic Accuracy Studies-AI was used to appraise the methodological quality of the studies. The bivariate random-effects model was used to summarize the individual sensitivities, specificities, and areas-under-the-curve (AUCs). Subgroup and meta-regression analyses were conducted to identify potential sources of heterogeneity. Protocol for this study was registered with PROSPERO (CRD42022382374).

RESULTS

Thirty-four studies (9933 patients) were identified. Pooled estimates of sensitivity, specificity, and AUC of AI models for pCR prediction were 82% (95% CI: 76-87%), 84% (95% CI: 79-88%), and 90% (95% CI: 87-92%), respectively. Higher specificity was seen for the Asian population, low risk of bias, and deep-learning, compared with the non-Asian population, high risk of bias, and radiomics (all P < 0.05). Single-center had a higher sensitivity than multi-center (P = 0.001). The retrospective design had lower sensitivity (P = 0.012) but higher specificity (P < 0.001) than the prospective design. MRI showed higher sensitivity (P = 0.001) but lower specificity (P = 0.044) than non-MRI. The sensitivity and specificity of internal validation were higher than those of external validation (both P = 0.005).

CONCLUSIONS

Image-based AI models exhibited favorable performance for predicting pCR to nCRT in rectal cancer. However, further clinical trials are warranted to verify the findings.

Deep learning in MRI-guided radiation therapy: A systematic review

Recent advances in MRI-guided radiation therapy (MRgRT) and deep learning techniques encourage fully adaptive radiation therapy (ART), real-time MRI monitoring, and the MRI-only treatment planning workflow. Given the rapid growth and emergence of new state-of-the-art methods in these fields, we systematically review 197 studies written on or before December 31, 2022, and categorize the studies into the areas of image segmentation, image synthesis, radiomics, and real time MRI. Building from the underlying deep learning methods, we discuss their clinical importance and current challenges in facilitating small tumor segmentation, accurate x-ray attenuation information from MRI, tumor characterization and prognosis, and tumor motion tracking. In particular, we highlight the recent trends in deep learning such as the emergence of multi-modal, visual transformer, and diffusion models.

Predicting tumor deposits in rectal cancer: a combined deep learning model using T2-MR imaging and clinical features

BACKGROUND

Tumor deposits (TDs) are associated with poor prognosis in rectal cancer (RC). This study aims to develop and validate a deep learning (DL) model incorporating T2-MR image and clinical factors for the preoperative prediction of TDs in RC patients.

METHODS AND METHODS

A total of 327 RC patients with pathologically confirmed TDs status from January 2016 to December 2019 were retrospectively recruited, and the T2-MR images and clinical variables were collected. Patients were randomly split into a development dataset (n = 246) and an independent testing dataset (n = 81). A single-channel DL model, a multi-channel DL model, a hybrid DL model, and a clinical model were constructed. The performance of these predictive models was assessed by using receiver operating characteristics (ROC) analysis and decision curve analysis (DCA).

RESULTS

The areas under the curves (AUCs) of the clinical, single-DL, multi-DL, and hybrid-DL models were 0.734 (95% CI, 0.674-0.788), 0.710 (95% CI, 0.649-0.766), 0.767 (95% CI, 0.710-0.819), and 0.857 (95% CI, 0.807-0.898) in the development dataset. The AUC of the hybrid-DL model was significantly higher than the single-DL and multi-DL models (both p < 0.001) in the development dataset, and the single-DL model (p = 0.028) in the testing dataset. Decision curve analysis demonstrated the hybrid-DL model had higher net benefit than other models across the majority range of threshold probabilities.

CONCLUSIONS

The proposed hybrid-DL model achieved good predictive efficacy and could be used to predict tumor deposits in rectal cancer.

CRITICAL RELEVANCE STATEMENT

The proposed hybrid-DL model achieved good predictive efficacy and could be used to predict tumor deposits in rectal cancer.

KEY POINTS

• Preoperative non-invasive identification of TDs is of great clinical significance. • The combined hybrid-DL model achieved good predictive efficacy and could be used to predict tumor deposits in rectal cancer. • A preoperative nomogram provides gastroenterologist with an accurate and effective tool.

Histogram array and convolutional neural network of DWI for differentiating pancreatic ductal adenocarcinomas from solid pseudopapillary neoplasms and neuroendocrine neoplasms

PURPOSE

This study aimed to investigate the diagnostic performance of the histogram array and convolutional neural network (CNN) based on diffusion-weighted imaging (DWI) with multiple b-values under magnetic resonance imaging (MRI) to distinguish pancreatic ductal adenocarcinomas (PDACs) from solid pseudopapillary neoplasms (SPNs) and pancreatic neuroendocrine neoplasms (PNENs).

METHODS

This retrospective study consisted of patients diagnosed with PDACs (n = 132), PNENs (n = 45) and SPNs (n = 54). All patients underwent 3.0-T MRI including DWI with 10 b values. The regions of interest (ROIs) of pancreatic tumor were manually drawn using ITK-SNAP software, which included entire tumor at DWI (b = 1500 s/m²). The histogram array was obtained through the ROIs from multiple b-value data. PyTorch (version 1.11) was used to construct a CNN classifier to categorize the histogram array into PDACs, PNENs or SPNs.

RESULTS

The area under the curves (AUCs) of the histogram array and the CNN model for differentiating PDACs from PNENs and SPNs were 0.896, 0.846, and 0.839 in the training, validation and testing cohorts, respectively. The accuracy, sensitivity and specificity were 90.22%, 96.23%, and 82.05% in the training cohort, 84.78%, 96.15%, and 70.0% in the validation cohort, and 81.72%, 90.57%, and 70.0% in the testing cohort. The performance of CNN with AUC of 0.865 for this differentiation was significantly higher than that of f with AUC = 0.755 (P = 0.0057) and α with AUC = 0.776 (P = 0.0278) in all patients.

CONCLUSION

The histogram array and CNN based on DWI data with multiple b-values using MRI provided an accurate diagnostic performance to differentiate PDACs from PNENs and SPNs.

Artificial intelligence with magnetic resonance imaging for prediction of pathological complete response to neoadjuvant chemoradiotherapy in rectal cancer: A systematic review and meta-analysis

Purpose

The purpose of this study was to evaluate the diagnostic accuracy of artificial intelligence (AI) models with magnetic resonance imaging(MRI) in predicting pathological complete response(pCR) to neoadjuvant chemoradiotherapy (nCRT) in patients with rectal cancer. Furthermore, assessed the methodological quality of the models.

Methods

We searched PubMed, Embase, Cochrane Library, and Web of science for studies published before 21 June 2022, without any language restrictions. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools were used to assess the methodological quality of the included studies. We calculated pooled sensitivity and specificity using random-effects models, I² values were used to measure heterogeneity, and subgroup analyses to explore potential sources of heterogeneity.

Results

We selected 21 papers for inclusion in the meta-analysis from 1562 retrieved publications, with a total of 1873 people in the validation groups. The meta-analysis showed that AI models based on MRI predicted pCR to nCRT in patients with rectal cancer: a pooled area under the curve (AUC) 0.91 (95% CI, 0.88-0.93), sensitivity of 0.82(95% CI,0.71-0.90), pooled specificity 0.86(95% CI,0.80-0.91). In the subgroup analysis, the pooled AUC of the deep learning(DL) model was 0.97, the pooled AUC of the radiomics model was 0.85; the pooled AUC of the combined model with clinical factors was 0.92, and the pooled AUC of the radiomics model alone was 0.87. The mean RQS score of the included studies was 10.95, accounting for 30.4% of the total score.

Conclusions

Radiomics is a promising noninvasive method with high value in predicting pathological response to nCRT in patients with rectal cancer. DL models have higher predictive accuracy than radiomics models, and combined models incorporating clinical factors have higher diagnostic accuracy than radiomics models alone. In the future, prospective, large-scale, multicenter investigations using radiomics approaches will strengthen the diagnostic power of pCR.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/, identifier CRD42021285630.

Artificial intelligence in multi-parametric magnetic resonance imaging: A review

Multi-parametric magnetic resonance imaging (mpMRI) is an indispensable tool in the clinical workflow for the diagnosis and treatment planning of various diseases. Machine learning-based artificial intelligence (AI) methods, especially those adopting the deep learning technique, have been extensively employed to perform mpMRI image classification, segmentation, registration, detection, reconstruction, and super-resolution. The current availability of increasing computational power and fast-improving AI algorithms have empowered numerous computer-based systems for applying mpMRI to disease diagnosis, imaging-guided radiotherapy, patient risk and overall survival time prediction, and the development of advanced quantitative imaging technology for magnetic resonance fingerprinting. However, the wide application of these developed systems in the clinic is still limited by a number of factors, including robustness, reliability, and interpretability. This survey aims to provide an overview for new researchers in the field as well as radiologists with the hope that they can understand the general concepts, main application scenarios, and remaining challenges of AI in mpMRI. This article is protected by copyright. All rights reserved.

Pre-Treatment Computed Tomography Radiomics for Predicting the Response to Neoadjuvant Chemoradiation in Locally Advanced Rectal Cancer: A Retrospective Study

Background and Purpose

Computerized tomography (CT) scans are commonly performed to assist in diagnosis and treatment of locally advanced rectal cancer (LARC). This study assessed the usefulness of pretreatment CT-based radiomics for predicting pathological complete response (pCR) of LARC to neoadjuvant chemoradiotherapy (nCRT).

Materials and Methods

Patients with LARC who underwent nCRT followed by total mesorectal excision surgery from July 2010 to December 2018 were enrolled in this retrospective study. A total of 340 radiomic features were extracted from pretreatment contrast-enhanced CT images. The most relevant features to pCR were selected using the least absolute shrinkage and selection operator (LASSO) method and a radiomic signature was generated. Predictive models were built with radiomic features and clinico-pathological variables. Model performance was assessed with decision curve analysis and was validated in an independent cohort.

Results

The pCR was achieved in 44 of the 216 consecutive patients (20.4%) in this study. The model with the best performance used both radiomics and clinical variables including radiomic signatures, distance to anal verge, lymphocyte-to-monocyte ratio, and carcinoembryonic antigen. This combined model discriminated between patients with and without pCR with an area under the curve of 0.926 and 0.872 in the training and the validation cohorts, respectively. The combined model also showed better performance than models built with radiomic or clinical variables alone.

Conclusion

Our combined predictive model was robust in differentiating patients with and without response to nCRT.