A deep learning nomogram kit for predicting metastatic lymph nodes in rectal cancer

Role of artificial intelligence in colorectal cancer

The sphere of artificial intelligence (AI) is ever expanding. Applications for clinical practice have been emerging over recent years. Although its uptake has been most prominent in endoscopy, this represents only one aspect of holistic patient care. There are a multitude of other potential avenues in which gastrointestinal care may be involved. We aim to review the role of AI in colorectal cancer as a whole. We performed broad scoping and focused searches of the applications of AI in the field of colorectal cancer. All trials including qualitative research were included from the year 2000 onwards. Studies were grouped into pre-operative, intra-operative and post-operative aspects. Pre-operatively, the major use is with endoscopic recognition. Colonoscopy has embraced the use for human derived classifications such as Narrow-band Imaging International Colorectal Endoscopic, Japan Narrow-band Imaging Expert Team, Paris and Kudo. However, novel detection and diagnostic methods have arisen from advances in AI classification. Intra-operatively, adjuncts such as image enhanced identification of structures and assessment of perfusion have led to improvements in clinical outcomes. Post-operatively, monitoring and surveillance have taken strides with potential socioeconomic and environmental savings. The uses of AI within the umbrella of colorectal surgery are multiple. We have identified existing technologies which are already augmenting cancer care. The future applications are exciting and could at least match, if not surpass human standards.

Impact of artificial intelligence in the management of esophageal, gastric and colorectal malignancies

The incidence of gastrointestinal malignancies has increased over the past decade at an alarming rate. Colorectal and gastric cancers are the third and fifth most commonly diagnosed cancers worldwide but are cited as the second and third leading causes of mortality. Early institution of appropriate therapy from timely diagnosis can optimize patient outcomes. Artificial intelligence (AI)-assisted diagnostic, prognostic, and therapeutic tools can assist in expeditious diagnosis, treatment planning/response prediction, and post-surgical prognostication. AI can intercept neoplastic lesions in their primordial stages, accurately flag suspicious and/or inconspicuous lesions with greater accuracy on radiologic, histopathological, and/or endoscopic analyses, and eliminate over-dependence on clinicians. AI-based models have shown to be on par, and sometimes even outperformed experienced gastroenterologists and radiologists. Convolutional neural networks (state-of-the-art deep learning models) are powerful computational models, invaluable to the field of precision oncology. These models not only reliably classify images, but also accurately predict response to chemotherapy, tumor recurrence, metastasis, and survival rates post-treatment. In this systematic review, we analyze the available evidence about the diagnostic, prognostic, and therapeutic utility of artificial intelligence in gastrointestinal oncology.

Multicenter Evaluation of a Weakly Supervised Deep Learning Model for Lymph Node Diagnosis in Rectal Cancer at MRI

Purpose To develop a Weakly supervISed model DevelOpment fraMework (WISDOM) model to construct a lymph node (LN) diagnosis model for patients with rectal cancer (RC) that uses preoperative MRI data coupled with postoperative patient-level pathologic information. Materials and Methods In this retrospective study, the WISDOM model was built using MRI (T2-weighted and diffusion-weighted imaging) and patient-level pathologic information (the number of postoperatively confirmed metastatic LNs and resected LNs) based on the data of patients with RC between January 2016 and November 2017. The incremental value of the model in assisting radiologists was investigated. The performances in binary and ternary N staging were evaluated using area under the receiver operating characteristic curve (AUC) and the concordance index (C index), respectively. Results A total of 1014 patients (median age, 62 years; IQR, 54-68 years; 590 male) were analyzed, including the training cohort (n = 589) and internal test cohort (n = 146) from center 1 and two external test cohorts (cohort 1: 117; cohort 2: 162) from centers 2 and 3. The WISDOM model yielded an overall AUC of 0.81 and C index of 0.765, significantly outperforming junior radiologists (AUC = 0.69, P < .001; C index = 0.689, P < .001) and performing comparably with senior radiologists (AUC = 0.79, P = .21; C index = 0.788, P = .22). Moreover, the model significantly improved the performance of junior radiologists (AUC = 0.80, P < .001; C index = 0.798, P < .001) and senior radiologists (AUC = 0.88, P < .001; C index = 0.869, P < .001). Conclusion This study demonstrates the potential of WISDOM as a useful LN diagnosis method using routine rectal MRI data. The improved radiologist performance observed with model assistance highlights the potential clinical utility of WISDOM in practice. Keywords: MR Imaging, Abdomen/GI, Rectum, Computer Applications-Detection/Diagnosis Supplemental material is available for this article. Published under a CC BY 4.0 license.

Progress in the diagnosis of lymph node metastasis in rectal cancer: a review

Historically, the chief focus of lymph node metastasis research has been molecular and clinical studies of a few essential pathways and genes. Recent years have seen a rapid accumulation of massive omics and imaging data catalyzed by the rapid development of advanced technologies. This rapid increase in data has driven improvements in the accuracy of diagnosis of lymph node metastasis, and its analysis further demands new methods and the opportunity to provide novel insights for basic research. In fact, the combination of omics data, imaging data, clinical medicine, and diagnostic methods has led to notable advances in our basic understanding and transformation of lymph node metastases in rectal cancer. Higher levels of integration will require a concerted effort among data scientists and clinicians. Herein, we review the current state and future challenges to advance the diagnosis of lymph node metastases in rectal cancer.

Machine Learning in Metastatic Cancer Research: Potentials, Possibilities, and Prospects

Cancer has received extensive recognition for its high mortality rate, with metastatic cancer being the top cause of cancer-related deaths. Metastatic cancer involves the spread of the primary tumor to other body organs. As much as the early detection of cancer is essential, the timely detection of metastasis, the identification of biomarkers, and treatment choice are valuable for improving the quality of life for metastatic cancer patients. This study reviews the existing studies on classical machine learning (ML) and deep learning (DL) in metastatic cancer research. Since the majority of metastatic cancer research data are collected in the formats of PET/CT and MRI image data, deep learning techniques are heavily involved. However, its black-box nature and expensive computational cost are notable concerns. Furthermore, existing models could be overestimated for their generality due to the non-diverse population in clinical trial datasets. Therefore, research gaps are itemized; follow-up studies should be carried out on metastatic cancer using machine learning and deep learning tools with data in a symmetric manner.

Deep learning based radiomics for gastrointestinal cancer diagnosis and treatment: A minireview

Gastrointestinal (GI) cancers are the major cause of cancer-related mortality globally. Medical imaging is an important auxiliary means for the diagnosis, assessment and prognostic prediction of GI cancers. Radiomics is an emerging and effective technology to decipher the encoded information within medical images, and traditional machine learning is the most commonly used tool. Recent advances in deep learning technology have further promoted the development of radiomics. In the field of GI cancer, although there are several surveys on radiomics, there is no specific review on the application of deep-learning-based radiomics (DLR). In this review, a search was conducted on Web of Science, PubMed, and Google Scholar with an emphasis on the application of DLR for GI cancers, including esophageal, gastric, liver, pancreatic, and colorectal cancers. Besides, the challenges and recommendations based on the findings of the review are comprehensively analyzed to advance DLR.

AI-Model for Identifying Pathologic Myopia Based on Deep Learning Algorithms of Myopic Maculopathy Classification and "Plus" Lesion Detection in Fundus Images

Background: Pathologic myopia (PM) associated with myopic maculopathy (MM) and “Plus” lesions is a major cause of irreversible visual impairment worldwide. Therefore, we aimed to develop a series of deep learning algorithms and artificial intelligence (AI)–models for automatic PM identification, MM classification, and “Plus” lesion detection based on retinal fundus images.

Materials and Methods: Consecutive 37,659 retinal fundus images from 32,419 patients were collected. After excluding 5,649 ungradable images, a total dataset of 32,010 color retinal fundus images was manually graded for training and cross-validation according to the META-PM classification. We also retrospectively recruited 1,000 images from 732 patients from the three other hospitals in Zhejiang Province, serving as the external validation dataset. The area under the receiver operating characteristic curve (AUC), sensitivity, specificity, accuracy, and quadratic-weighted kappa score were calculated to evaluate the classification algorithms. The precision, recall, and F1-score were calculated to evaluate the object detection algorithms. The performance of all the algorithms was compared with the experts’ performance. To better understand the algorithms and clarify the direction of optimization, misclassification and visualization heatmap analyses were performed.

Results: In five-fold cross-validation, algorithm I achieved robust performance, with accuracy = 97.36% (95% CI: 0.9697, 0.9775), AUC = 0.995 (95% CI: 0.9933, 0.9967), sensitivity = 93.92% (95% CI: 0.9333, 0.9451), and specificity = 98.19% (95% CI: 0.9787, 0.9852). The macro-AUC, accuracy, and quadratic-weighted kappa were 0.979, 96.74% (95% CI: 0.963, 0.9718), and 0.988 (95% CI: 0.986, 0.990) for algorithm II. Algorithm III achieved an accuracy of 0.9703 to 0.9941 for classifying the “Plus” lesions and an F1-score of 0.6855 to 0.8890 for detecting and localizing lesions. The performance metrics in external validation dataset were comparable to those of the experts and were slightly inferior to those of cross-validation.

Conclusion: Our algorithms and AI-models were confirmed to achieve robust performance in real-world conditions. The application of our algorithms and AI-models has promise for facilitating clinical diagnosis and healthcare screening for PM on a large scale.

Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis

Background

Artificial intelligence (AI) is increasingly being used in medical imaging analysis. We aimed to evaluate the diagnostic accuracy of AI models used for detection of lymph node metastasis on pre-operative staging imaging for colorectal cancer.

Methods

A systematic review was conducted according to PRISMA guidelines using a literature search of PubMed (MEDLINE), EMBASE, IEEE Xplore and the Cochrane Library for studies published from January 2010 to October 2020. Studies reporting on the accuracy of radiomics models and/or deep learning for the detection of lymph node metastasis in colorectal cancer by CT/MRI were included. Conference abstracts and studies reporting accuracy of image segmentation rather than nodal classification were excluded. The quality of the studies was assessed using a modified questionnaire of the QUADAS-2 criteria. Characteristics and diagnostic measures from each study were extracted. Pooling of area under the receiver operating characteristic curve (AUROC) was calculated in a meta-analysis.

Results

Seventeen eligible studies were identified for inclusion in the systematic review, of which 12 used radiomics models and five used deep learning models. High risk of bias was found in two studies and there was significant heterogeneity among radiomics papers (73.0%). In rectal cancer, there was a per-patient AUROC of 0.808 (0.739–0.876) and 0.917 (0.882–0.952) for radiomics and deep learning models, respectively. Both models performed better than the radiologists who had an AUROC of 0.688 (0.603 to 0.772). Similarly in colorectal cancer, radiomics models with a per-patient AUROC of 0.727 (0.633–0.821) outperformed the radiologist who had an AUROC of 0.676 (0.627–0.725).

Conclusion

AI models have the potential to predict lymph node metastasis more accurately in rectal and colorectal cancer, however, radiomics studies are heterogeneous and deep learning studies are scarce.

Trial registration

PROSPERO CRD42020218004.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-021-08773-w.

Automatic classification and detection of oral cancer in photographic images using deep learning algorithms

BACKGROUND

Oral cancer is a deadly disease among the most common malignant tumors worldwide, and it has become an increasingly important public health problem in developing and low-to-middle income countries. This study aims to use the convolutional neural network (CNN) deep learning algorithms to develop an automated classification and detection model for oral cancer screening.

METHODS

The study included 700 clinical oral photographs, collected retrospectively from the oral and maxillofacial center, which were divided into 350 images of oral squamous cell carcinoma and 350 images of normal oral mucosa. The classification and detection models were created by using DenseNet121 and faster R-CNN, respectively. Four hundred and ninety images were randomly selected as training data. In addition, 70 and 140 images were assigned as validating and testing data, respectively.

RESULTS

The classification accuracy of DenseNet121 model achieved a precision of 99%, a recall of 100%, an F1 score of 99%, a sensitivity of 98.75%, a specificity of 100%, and an area under the receiver operating characteristic curve of 99%. The detection accuracy of a faster R-CNN model achieved a precision of 76.67%, a recall of 82.14%, an F1 score of 79.31%, and an area under the precision-recall curve of 0.79.

CONCLUSION

The DenseNet121 and faster R-CNN algorithm were proved to offer the acceptable potential for classification and detection of cancerous lesions in oral photographic images.

Radiomics Based on T2-Weighted Imaging and Apparent Diffusion Coefficient Images for Preoperative Evaluation of Lymph Node Metastasis in Rectal Cancer Patients

Purpose

To develop and validate a radiomics nomogram based on T2-weighted imaging (T2WI) and apparent diffusion coefficient (ADC) features for the preoperative prediction of lymph node (LN) metastasis in rectal cancer patients.

Materials and Methods

One hundred and sixty-two patients with rectal cancer confirmed by pathology were retrospectively analyzed, who underwent T2WI and DWI sequences. The data sets were divided into training (n = 97) and validation (n = 65) cohorts. For each case, a total of 2,752 radiomic features were extracted from T2WI, and ADC images derived from diffusion-weighted imaging. A two-sample t-test was used for prefiltering. The least absolute shrinkage selection operator method was used for feature selection. Three radiomics scores (rad-scores) (rad-score 1 for T2WI, rad-score 2 for ADC, and rad-score 3 for the combination of both) were calculated using the support vector machine classifier. Multivariable logistic regression analysis was then used to construct a radiomics nomogram combining rad-score 3 and independent risk factors. The performances of three rad-scores and the nomogram were evaluated using the area under the receiver operating characteristic curve (AUC). Decision curve analysis (DCA) was used to assess the clinical usefulness of the radiomics nomogram.

Results

The AUCs of the rad-score 1 and rad-score 2 were 0.805, 0.749 and 0.828, 0.770 in the training and validation cohorts, respectively. The rad-score 3 achieved an AUC of 0.879 in the training cohort and an AUC of 0.822 in the validation cohort. The radiomics nomogram, incorporating the rad-score 3, age, and LN size, showed good discrimination with the AUC of 0.937 for the training cohort and 0.884 for the validation cohort. DCA confirmed that the radiomics nomogram had clinical utility.

Conclusions

The radiomics nomogram, incorporating rad-score based on features from the T2WI and ADC images, and clinical factors, has favorable predictive performance for preoperative prediction of LN metastasis in patients with rectal cancer.

Artificial intelligence in rectal cancer

Accurate and rapid diagnosis is essential for correct treatment in rectal cancer. Determining the optimal treatment plan for a patient with rectal cancer is a complex process, and the oncological results and toxicity are not the same in every patient with the same treatment at the same stage. In recent years, the increasing interest in artificial intelligence in all fields of science has also led to the development of innovative tools in oncology. Artificial intelligence studies have increased in many steps from diagnosis to follow-up in rectal cancer. It is thought that artificial intelligence will provide convenience in many ways from personalized treatment to reducing the workload of the physician. Prediction algorithms can be standardized by sharing data between centers, diversifying data, and creating big data.

Nomogram for predicting the risk of bone metastasis in breast cancer: a SEER population-based study

Background

Bone is the most common metastasis site of breast cancer. The prognosis of bone metastasis is better than other distant metastases, but patients with skeletal related events (SREs) have a poor quality of life, high healthcare costs and low survival rates. This study aimed to establish an effective nomogram for predicting risk of bone metastasis of breast cancer.

Methods

The nomogram was built on 4,895 adult/female/primary invasive breast cancer patients with complete clinicopathologic information, captured by the Surveillance, Epidemiology, and End Results (SEER) database from 2010 to 2015. Five biological factors (age, grade, histologic type, surgery of breast lesions and subtypes) were assessed with logistic regression to predict the risk of bone metastases. The predictive accuracy and discriminative ability of the nomogram were determined by the Receiver Operating Characteristic (ROC) curves and the calibration plot. Results were validated on a separate 2,093 cohort using bootstrap resampling from 2010 to 2015 as an internal group and a retrospective study on 120 patients in the First Affiliated Hospital of China Medical University from 2010 to 2014 at the same situation as an external group.

Results

On multivariate logistic regression of the primary cohort, independent factors for bone metastases were age, grade, histologic type, surgery of breast lesions and subtypes, which were all selected into the nomogram. The calibration plot for probability of incidence showed good agreement between prediction by nomogram and two observations. The ROC curves presented a good statistical model for risk of bone metastasis, and the corresponding AUC value of the development group, internal validation group and external validation group were 0.678, 0.689 and 0.704 respectively.

Conclusions

The proposed nomogram resulted in more-accurate prognostic prediction for breast cancer patients with bone metastases.