A computer-aided algorithm to quantitatively predict lymph node status on MRI in rectal cancer

Application of radiomics for preoperative prediction of lymph node metastasis in colorectal cancer: a systematic review and meta-analysis

BACKGROUND

Colorectal cancer (CRC) stands as the third most prevalent cancer globally, projecting 3.2 million new cases and 1.6 million deaths by 2040. Accurate lymph node metastasis (LNM) detection is critical for determining optimal surgical approaches, including preoperative neoadjuvant chemoradiotherapy and surgery, which significantly influence CRC prognosis. However, conventional imaging lacks adequate precision, prompting exploration into radiomics, which addresses this shortfall by converting medical images into reproducible, quantitative data.

METHODS

Following PRISMA, Supplemental Digital Content 1 (http://links.lww.com/JS9/C77) and Supplemental Digital Content 2 (http://links.lww.com/JS9/C78), and AMSTAR-2 guidelines, Supplemental Digital Content 3 (http://links.lww.com/JS9/C79), we systematically searched PubMed, Web of Science, Embase, Cochrane Library, and Google Scholar databases until 11 January 2024, to evaluate radiomics models' diagnostic precision in predicting preoperative LNM in CRC patients. The quality and bias risk of the included studies were assessed using the Radiomics Quality Score (RQS) and the modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. Subsequently, statistical analyses were conducted.

RESULTS

Thirty-six studies encompassing 8039 patients were included, with a significant concentration in 2022-2023 (20/36). Radiomics models predicting LNM demonstrated a pooled area under the curve (AUC) of 0.814 (95% CI: 0.78-0.85), featuring sensitivity and specificity of 0.77 (95% CI: 0.69, 0.84) and 0.73 (95% CI: 0.67, 0.78), respectively. Subgroup analyses revealed similar AUCs for CT and MRI-based models, and rectal cancer models outperformed colon and colorectal cancers. Additionally, studies utilizing cross-validation, 2D segmentation, internal validation, manual segmentation, prospective design, and single-center populations tended to have higher AUCs. However, these differences were not statistically significant. Radiologists collectively achieved a pooled AUC of 0.659 (95% CI: 0.627, 0.691), significantly differing from the performance of radiomics models (P<0.001).

CONCLUSION

Artificial intelligence-based radiomics shows promise in preoperative lymph node staging for CRC, exhibiting significant predictive performance. These findings support the integration of radiomics into clinical practice to enhance preoperative strategies in CRC management.

Development of a Diagnostic Artificial Intelligence Tool for Lateral Lymph Node Metastasis in Advanced Rectal Cancer

BACKGROUND

Metastatic lateral lymph node dissection can improve survival in patients with rectal adenocarcinoma, with or without chemoradiotherapy. However, the optimal imaging diagnostic criteria for lateral lymph node metastases remain undetermined.

OBJECTIVE

To develop a lateral lymph node metastasis diagnostic artificial intelligence tool using deep learning, for patients with rectal adenocarcinoma who underwent radical surgery and lateral lymph node dissection.

DESIGN

Retrospective study.

SETTINGS

Multicenter study.

PATIENTS

A total of 209 patients with rectal adenocarcinoma, who underwent radical surgery and lateral lymph node dissection at 15 participating hospitals, were enrolled in the study and allocated to training (n = 139), test (n = 17), or validation (n = 53) cohorts.

MAIN OUTCOME MEASURES

In the neoadjuvant treatment group, images taken before pretreatment were classified as baseline images and those taken after pretreatment as presurgery images. In the upfront surgery group, presurgery images were classified as both baseline and presurgery images. We constructed 2 types of artificial intelligence, using baseline and presurgery images, by inputting the patches from these images into ResNet-18, and we assessed their diagnostic accuracy.

RESULTS

Overall, 124 patients underwent surgery alone, 52 received neoadjuvant chemotherapy, and 33 received chemoradiotherapy. The number of resected lateral lymph nodes in the training, test, and validation cohorts was 2418, 279, and 850, respectively. The metastatic rates were 2.8%, 0.7%, and 3.7%, respectively. In the validation cohort, the precision-recall area under the curve was 0.870 and 0.963 for the baseline and presurgery images, respectively. Although both baseline and presurgery images provided good accuracy for diagnosing lateral lymph node metastases, the accuracy of presurgery images was better than that of baseline images.

LIMITATIONS

The number of cases is small.

CONCLUSIONS

An artificial intelligence tool is a promising tool for diagnosing lateral lymph node metastasis with high accuracy.

DESARROLLO DE UNA HERRAMIENTA DE INTELIGENCIA ARTIFICIAL PARA EL DIAGNSTICO DE METSTASIS EN GANGLIOS LINFTICOS LATERALES EN CNCER DE RECTO AVANZADO

ANTECEDENTES:Disección de nódulos linfáticos laterales metastásicos puede mejorar la supervivencia en pacientes con adenocarcinoma del recto, con o sin quimiorradioterapia. Sin embargo, aún no se han determinado los criterios óptimos de diagnóstico por imágenes de los nódulos linfáticos laterales metastásicos.OBJETIVO:Nuestro objetivo fue desarrollar una herramienta de inteligencia artificial para el diagnóstico de metástasis en nódulos linfáticos laterales mediante el aprendizaje profundo, para pacientes con adenocarcinoma del recto que se sometieron a cirugía radical y disección de nódulos linfáticos laterales.DISEÑO:Estudio retrospectivo.AJUSTES:Estudio multicéntrico.PACIENTES:Un total de 209 pacientes con adenocarcinoma del recto, que se sometieron a cirugía radical y disección de nódulos linfáticos laterales en 15 hospitales participantes, se inscribieron en el estudio y se asignaron a cohortes de entrenamiento (n = 139), prueba (n = 17) o validación (n = 53).PRINCIPALES MEDIDAS DE RESULTADO:En el grupo de tratamiento neoadyuvante, las imágenes tomadas antes del tratamiento se clasificaron como imágenes de referencia y las posteriores al tratamiento, como imágenes previas a la cirugía. En el grupo de cirugía inicial, las imágenes previas a la cirugía se clasificaron como imágenes de referencia y previas a la cirugía. Construimos dos tipos de inteligencia artificial, utilizando imágenes de referencia y previas a la cirugía, ingresando los parches de estas imágenes en ResNet-18. Evaluamos la precisión diagnóstica de los dos tipos de inteligencia artificial.RESULTADOS:En general, 124 pacientes se sometieron a cirugía solamente, 52 recibieron quimioterapia neoadyuvante y 33 recibieron quimiorradioterapia. El número de nódulos linfáticos laterales removidos en los cohortes de entrenamiento, prueba y validación fue de 2,418; 279 y 850, respectivamente. Las tasas metastásicas fueron 2.8%, 0.7%, y 3.7%, respectivamente. En el cohorte de validación, el área de recuperación de precisión bajo la curva fue de 0.870 y 0.963 para las imágenes de referencia y antes de la cirugía, respectivamente. Aunque tanto las imágenes previas a la cirugía como las iniciales proporcionaron una buena precisión para diagnosticar metástasis en los nódulos linfáticos laterales, la precisión de las imágenes previas a la cirugía fue mejor que la de las imágenes iniciales.LIMITACIONES:El número de casos es pequeño.CONCLUSIÓN:La inteligencia artificial es una herramienta prometedora para diagnosticar metástasis en los nódulos linfáticos laterales con alta precisión. (Traducción-Dr. Aurian Garcia Gonzalez ).

Progress in the diagnosis of lymph node metastasis in rectal cancer: a review

Historically, the chief focus of lymph node metastasis research has been molecular and clinical studies of a few essential pathways and genes. Recent years have seen a rapid accumulation of massive omics and imaging data catalyzed by the rapid development of advanced technologies. This rapid increase in data has driven improvements in the accuracy of diagnosis of lymph node metastasis, and its analysis further demands new methods and the opportunity to provide novel insights for basic research. In fact, the combination of omics data, imaging data, clinical medicine, and diagnostic methods has led to notable advances in our basic understanding and transformation of lymph node metastases in rectal cancer. Higher levels of integration will require a concerted effort among data scientists and clinicians. Herein, we review the current state and future challenges to advance the diagnosis of lymph node metastases in rectal cancer.

Intra- and Interobserver Variability in Magnetic Resonance Imaging Measurements in Rectal Cancer Patients

Colorectal cancer is the second most common cancer in Europe, and accurate lymph node staging in rectal cancer patients is essential for the selection of their treatment. MRI lymph node staging is complex, and few studies have been published regarding its reproducibility. This study assesses the inter- and intraobserver variability in lymph node size, apparent diffusion coefficient (ADC) measurements, and morphological characterization among inexperienced and experienced radiologists. Four radiologists with different levels of experience in MRI rectal cancer staging analyzed 36 MRI scans of 36 patients with rectal adenocarcinoma. Inter- and intraobserver variation was calculated using interclass correlation coefficients and Cohens-kappa statistics, respectively. Inter- and intraobserver agreement for the length and width measurements was good to excellent, and for that of ADC it was fair to good. Interobserver agreement for the assessment of irregular border was moderate, heterogeneous signal was fair, round shape was fair to moderate, and extramesorectal lymph node location was moderate to almost perfect. Intraobserver agreement for the assessment of irregular border was fair to substantial, heterogeneous signal was fair to moderate, round shape was fair to moderate, and extramesorectal lymph node location was substantial to almost perfect. Our data indicate that subjective variables such as morphological characteristics are less reproducible than numerical variables, regardless of the level of experience of the observers.

Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis

Background

Artificial intelligence (AI) is increasingly being used in medical imaging analysis. We aimed to evaluate the diagnostic accuracy of AI models used for detection of lymph node metastasis on pre-operative staging imaging for colorectal cancer.

Methods

A systematic review was conducted according to PRISMA guidelines using a literature search of PubMed (MEDLINE), EMBASE, IEEE Xplore and the Cochrane Library for studies published from January 2010 to October 2020. Studies reporting on the accuracy of radiomics models and/or deep learning for the detection of lymph node metastasis in colorectal cancer by CT/MRI were included. Conference abstracts and studies reporting accuracy of image segmentation rather than nodal classification were excluded. The quality of the studies was assessed using a modified questionnaire of the QUADAS-2 criteria. Characteristics and diagnostic measures from each study were extracted. Pooling of area under the receiver operating characteristic curve (AUROC) was calculated in a meta-analysis.

Results

Seventeen eligible studies were identified for inclusion in the systematic review, of which 12 used radiomics models and five used deep learning models. High risk of bias was found in two studies and there was significant heterogeneity among radiomics papers (73.0%). In rectal cancer, there was a per-patient AUROC of 0.808 (0.739–0.876) and 0.917 (0.882–0.952) for radiomics and deep learning models, respectively. Both models performed better than the radiologists who had an AUROC of 0.688 (0.603 to 0.772). Similarly in colorectal cancer, radiomics models with a per-patient AUROC of 0.727 (0.633–0.821) outperformed the radiologist who had an AUROC of 0.676 (0.627–0.725).

Conclusion

AI models have the potential to predict lymph node metastasis more accurately in rectal and colorectal cancer, however, radiomics studies are heterogeneous and deep learning studies are scarce.

Trial registration

PROSPERO CRD42020218004.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-021-08773-w.

Magnetic Resonance Imaging Evaluation of the Accuracy of Various Lymph Node Staging Criteria in Rectal Cancer: A Systematic Review and Meta-Analysis

Background

Magnetic resonance imaging (MRI)-based lymph node staging remains a significant challenge in the treatment of rectal cancer. Pretreatment evaluation of lymph node metastasis guides the formulation of treatment plans. This systematic review aimed to evaluate the diagnostic performance of MRI in lymph node staging using various morphological criteria.

Methods

A systematic search of the EMBASE, Medline, and Cochrane databases was performed. Original articles published between 2000 and January 2021 that used MRI for lymph node staging in rectal cancer were eligible. The included studies were assessed using the QUADAS-2 tool. A bivariate random-effects model was used to conduct a meta-analysis of diagnostic test accuracy.

Results

Thirty-seven studies were eligible for this meta-analysis. The pooled sensitivity, specificity, and diagnostic odds ratio of preoperative MRI for the lymph node stage were 0.73 (95% confidence interval [CI], 0.68–0.77), 0.74 (95% CI, 0.68–0.80), and 7.85 (95% CI, 5.78–10.66), respectively. Criteria for positive mesorectal lymph node metastasis included (A) a short-axis diameter of 5 mm, (B) morphological standard, including an irregular border and mixed-signal intensity within the lymph node, (C) a short-axis diameter of 5 mm with the morphological standard, (D) a short-axis diameter of 8 mm with the morphological standard, and (E) a short-axis diameter of 10 mm with the morphological standard. The pooled sensitivity/specificity for these criteria were 75%/64%, 81%/67%, 74%/79%, 72%/66%, and 62%/91%, respectively. There was no significant difference among the criteria in sensitivity/specificity. The area under the receiver operating characteristic (ROC) curve values of the fitted summary ROC indicated a diagnostic accuracy rate of 0.75–0.81.

Conclusion

MRI scans have minimal accuracy as a reference index for pretreatment staging of various lymph node staging criteria in rectal cancer. Multiple types of evidence should be used in clinical decision-making.

Deep transfer learning based on magnetic resonance imaging can improve the diagnosis of lymph node metastasis in patients with rectal cancer

Background

Lymph node (LN) metastasis is the main prognostic factor for local recurrence and overall survival of patients with rectal cancer. The accurate evaluation of LN status in rectal cancer patients is associated with improved treatment and prognosis. This study aimed to apply deep transfer learning to classify LN status in patients with rectal cancer to improve N staging accuracy.

Methods

The study included 129 patients with 325 rectal cancer screenshots of LN T2-weighted (T2W) images from April 2018 to March 2019. Deep learning was applied through a pre-trained model, Inception-v3, for recognition and detection of LN status. The results were compared to manual identification by experienced radiologists. Two radiologists reviewed images and independently identified their status using various criteria with or without short axial (SA) diameter measurements. The accuracy, positive predictive value (PPV), negative predictive value (NPV), sensitivity, specificity, and the area under the receiver operating characteristic (ROC) curve (AUC) were calculated.

Results

When the same radiologist performed the analysis, the AUC was not significantly different in the presence or absence of LN diameter measurements (P>0.05). In the deep transfer learning method, the PPV, NPV, sensitivity, and specificity were 95.2%, 95.3%, 95.3%, and 95.2%, respectively, and the AUC and accuracy were 0.994 and 95.7%, respectively. These results were all higher than that achieved with manual diagnosis by the radiologists.

Conclusions

The internal details of LNs should be used as the main criteria for positive diagnosis when using MRI. Deep transfer learning can improve the MRI diagnosis of positive LN metastasis in patients with rectal cancer.

Artificial intelligence for the diagnosis of lymph node metastases in patients with abdominopelvic malignancy: A systematic review and meta-analysis

PURPOSE

Accurate clinical diagnosis of lymph node metastases is of paramount importance in the treatment of patients with abdominopelvic malignancy. This review assesses the diagnostic performance of deep learning algorithms and radiomics models for lymph node metastases in abdominopelvic malignancies.

METHODOLOGY

Embase (PubMed, MEDLINE), Science Direct and IEEE Xplore databases were searched to identify eligible studies published between January 2009 and March 2019. Studies that reported on the accuracy of deep learning algorithms or radiomics models for abdominopelvic malignancy by CT or MRI were selected. Study characteristics and diagnostic measures were extracted. Estimates were pooled using random-effects meta-analysis. Evaluation of risk of bias was performed using the QUADAS-2 tool.

RESULTS

In total, 498 potentially eligible studies were identified, of which 21 were included and 17 offered enough information for a quantitative analysis. Studies were heterogeneous and substantial risk of bias was found in 18 studies. Almost all studies employed radiomics models (n = 20). The single published deep-learning model out-performed radiomics models with a higher AUROC (0.912 vs 0.895), but both radiomics and deep-learning models outperformed the radiologist's interpretation in isolation (0.774). Pooled results for radiomics nomograms amongst tumour subtypes demonstrated the highest AUC 0.895 (95 %CI, 0.810-0.980) for urological malignancy, and the lowest AUC 0.798 (95 %CI, 0.744-0.852) for colorectal malignancy.

CONCLUSION

Radiomics models improve the diagnostic accuracy of lymph node staging for abdominopelvic malignancies in comparison with radiologist's assessment. Deep learning models may further improve on this, but data remain limited.

A deep learning nomogram kit for predicting metastatic lymph nodes in rectal cancer

Background

Preoperative diagnoses of metastatic lymph nodes (LNs) by the most advanced deep learning technology of Faster Region‐based Convolutional Neural Network (Faster R‐CNN) have not yet been reported.

Materials and Methods

In total, 545 patients with pathologically confirmed rectal cancer between January 2016 and March 2019 were included and were randomly allocated with a split ratio of 2:1 to the training and validation sets, respectively. The MRI images for metastatic LNs were evaluated by Faster R‐CNN. Multivariate regression analyses were used to develop the predictive models. Faster R‐CNN nomograms were constructed based on the multivariate analyses in the training sets and were validated in the validation sets.

Results

The Faster R‐CNN nomogram for predicting metastatic LN status contained predictors of age, metastatic LNs by Faster R‐CNN and differentiation degrees of tumors, with areas under the curves (AUCs) of 0.862 (95% CI: 0.816‐0.909) and 0.920 (95% CI: 0.876‐0.964) in the training and validation sets, respectively. The Faster R‐CNN nomogram for predicting LN metastasis degree contained predictors of metastatic LNs by Faster R‐CNN and differentiation degrees of tumors, with AUCs of 0.859 (95% CI: 0.804‐0.913) and 0.886 (95% CI: 0.822‐0.950) in the training and validation sets, respectively. Calibration plots and decision curve analyses demonstrated good calibrations and clinical utilities. The two nomograms were used jointly as a kit for predicting metastatic LNs.

Conclusion

The Faster R‐CNN nomogram kit exhibits excellent performance in discrimination, calibration, and clinical utility and is convenient and reliable for predicting metastatic LNs preoperatively.

Clinical trial registration: ChiCTR‐DDD‐17013842.

Rectal cancer MR staging: pearls and pitfalls at baseline examination

In recent years, rectal MRI has become a central diagnostic tool in rectal cancer staging. Indeed, rectal MR has the ability to accurately evaluate a number of important findings that may impact patient management, including distance of the tumor to the mesorectal fascia, presence of extramural vascular invasion (EMVI), presence of lymph nodes, and involvement of the peritoneum/anterior peritoneal reflection. Many of these findings are difficult to assess in nonexpert hands. In this review, we present a practical approach for radiologists to provide high-quality interpretations at initial baseline exams, based on recent guidelines from the Society of Abdominal Radiology, Rectal and Anal Cancer Disease Focused Panel. Practical pearls and pitfalls are discussed, focusing on optimization of technique including, patient preparation and protocol recommendations, interpretation, and essentials of reporting.

Accuracy of Various Lymph Node Staging Criteria in Rectal Cancer with Magnetic Resonance Imaging

INTRODUCTION

The accuracy of pretherapeutic staging of lymph nodes (LN) in rectal cancer by MR imaging (MRI) is still limited. The aim of the study was to determine the sensitivity and specificity of different morphological criteria in nodal staging.

MATERIAL AND METHODS

LN were analyzed by MRI in 60 patients with rectal cancer and primary surgery. Signs of LN metastasis (cN+) were spiculated/indistinct border contour, inhomogeneous signal intensity, or LN size. The accuracy of these signs for clinical LN staging was analyzed with conclusive postoperative histological lymph node examination.

RESULTS

68.3% of patients with nodal metastasis (pN+) were correctly identified by size with a cutoff value of 7.2 mm. This, however, was not inferior to the 76.7% identified using the inhomogeneous morphological signal intensity and spiculated/indistinct border contour criteria (p = 0.096). 3.3 versus 5% were overstaged, and 28.3 versus 18.3% understaged by these criteria. Sensitivities/specificities for (a) size, (b) spiculated/indistinct border contour, and (c) inhomogeneous signal intensity and spiculated/indistinct border contour were (a) 32%/94%, (b) 56%/86%, and (c) 56%/91%, respectively.

CONCLUSIONS

The accuracy of LN staging in rectal cancer was not improved by morphological criteria. These limitations suggest being reticent when recommending neoadjuvant chemoradiation merely based on preoperative positive LN staging.

Magnetic resonance imaging of rectal cancer

Magnetic resonance imaging (MRI) is still the most commonly used imaging technique for the diagnosis of rectal cancer with the highest degree of accuracy, and it is also recommended by the National Comprehensive Cancer Network, European Society for Medical Oncology, and Chinese guidelines for diagnosis and treatment of colorectal cancer. The application of diffusion weighted imaging, apparent diffusion coefficient, diffusion weighted imaging with background signal suppression, intravoxel incoherent motion, perfusion imaging, magnetic resonance spectroscopy, and molecular imaging has provided many choices for tumor detection and preoperative staging, differential diagnosis of benign and malignant rectum lesions, postoperative follow-up, recurrence monitoring, and efficacy evaluation. We believe that with the development of basic theory and related technology, MRI for rectal cancer assessment will become more efficient.

Quantification of heterogeneity as a biomarker in tumor imaging: a systematic review

BACKGROUND

Many techniques are proposed for the quantification of tumor heterogeneity as an imaging biomarker for differentiation between tumor types, tumor grading, response monitoring and outcome prediction. However, in clinical practice these methods are barely used. This study evaluates the reported performance of the described methods and identifies barriers to their implementation in clinical practice.

METHODOLOGY

The Ovid, Embase, and Cochrane Central databases were searched up to 20 September 2013. Heterogeneity analysis methods were classified into four categories, i.e., non-spatial methods (NSM), spatial grey level methods (SGLM), fractal analysis (FA) methods, and filters and transforms (F&T). The performance of the different methods was compared.

PRINCIPAL FINDINGS

Of the 7351 potentially relevant publications, 209 were included. Of these studies, 58% reported the use of NSM, 49% SGLM, 10% FA, and 28% F&T. Differentiation between tumor types, tumor grading and/or outcome prediction was the goal in 87% of the studies. Overall, the reported area under the curve (AUC) ranged from 0.5 to 1 (median 0.87). No relation was found between the performance and the quantification methods used, or between the performance and the imaging modality. A negative correlation was found between the tumor-feature ratio and the AUC, which is presumably caused by overfitting in small datasets. Cross-validation was reported in 63% of the classification studies. Retrospective analyses were conducted in 57% of the studies without a clear description.

CONCLUSIONS

In a research setting, heterogeneity quantification methods can differentiate between tumor types, grade tumors, and predict outcome and monitor treatment effects. To translate these methods to clinical practice, more prospective studies are required that use external datasets for validation: these datasets should be made available to the community to facilitate the development of new and improved methods.

Towards new response criteria in neuroendocrine tumors: which changes in MRI parameters are associated with longer progression-free survival after radioembolization of liver metastases?

PURPOSE

To evaluate the association of therapy-related changes in imaging parameters with progression-free survival (PFS) of patients with unresectable liver metastases from neuroendocrine tumors (NETLMs).

MATERIALS AND METHODS

Forty-five radioembolized patients (median age: 62 years; range: 43-75) received a pre- and 3 months posttherapeutic magnetic resonance imaging (MRI) examination. The latter were evaluated for tumor size, arterial enhancement, and necrosis pattern. Influences of therapy-related changes on PFS were analyzed. Statistical analysis included Student's t-test, Wilcoxon test, Cox regression analysis, and Kaplan-Meier curves.

RESULTS

The median percentage decrease in sum of diameters was 9.7% (range: 43.9% decrease to 15.4% increase). Twenty-one patients (47%) showed increased necrosis. Three parameters were associated with significantly longer PFS: a decrease of diameter (hazard ratio [HR]: 0.206; 95% confidence interval [CI]: 0.058-0.725; P = 0.0139), a decrease in tumor arterial enhancement (HR: 0.143; 95% CI: 0.029-0.696; P = 0.0160), and an increase in necrosis after 3 months (HR: 0.321; 95% CI: 0.104-0.990; P = 0.0480). Multivariate analysis revealed that changes in diameter and arterial enhancement have complementary information and are associated independently with long PFS.

CONCLUSION

A decrease both in sum of diameters and arterial enhancement of metastases, as well as an increase in necrosis, are associated with significantly longer PFS after radioembolization.