A Novel Model Based on Deep Convolutional Neural Network Improves Diagnostic Accuracy of Intramucosal Gastric Cancer (With Video)

Deep Learning and Gastric Cancer: Systematic Review of AI-Assisted Endoscopy

BACKGROUND

Gastric cancer (GC), a significant health burden worldwide, is typically diagnosed in the advanced stages due to its non-specific symptoms and complex morphological features. Deep learning (DL) has shown potential for improving and standardizing early GC detection. This systematic review aims to evaluate the current status of DL in pre-malignant, early-stage, and gastric neoplasia analysis.

METHODS

A comprehensive literature search was conducted in PubMed/MEDLINE for original studies implementing DL algorithms for gastric neoplasia detection using endoscopic images. We adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The focus was on studies providing quantitative diagnostic performance measures and those comparing AI performance with human endoscopists.

RESULTS

Our review encompasses 42 studies that utilize a variety of DL techniques. The findings demonstrate the utility of DL in GC classification, detection, tumor invasion depth assessment, cancer margin delineation, lesion segmentation, and detection of early-stage and pre-malignant lesions. Notably, DL models frequently matched or outperformed human endoscopists in diagnostic accuracy. However, heterogeneity in DL algorithms, imaging techniques, and study designs precluded a definitive conclusion about the best algorithmic approach.

CONCLUSIONS

The promise of artificial intelligence in improving and standardizing gastric neoplasia detection, diagnosis, and segmentation is significant. This review is limited by predominantly single-center studies and undisclosed datasets used in AI training, impacting generalizability and demographic representation. Further, retrospective algorithm training may not reflect actual clinical performance, and a lack of model details hinders replication efforts. More research is needed to substantiate these findings, including larger-scale multi-center studies, prospective clinical trials, and comprehensive technical reporting of DL algorithms and datasets, particularly regarding the heterogeneity in DL algorithms and study designs.

Convolutional neural network model by deep learning and teaching robot in keyboard musical instrument teaching

Keyboard instruments play a significant role in the music teaching process, providing students with an enjoyable musical experience while enhancing their music literacy. This study aims to investigate the current state of keyboard instrument teaching in preschool education, identify existing challenges, and propose potential solutions using the literature review method. In response to identified shortcomings, this paper proposes integrating intelligent technology and subject teaching through the application of teaching robots in keyboard instrument education. Specifically, a Convolutional Neural Network model of Deep Learning is employed for system debugging, enabling the teaching robot to analyze students' images and movements during musical instrument play and deliver targeted teaching. Feedback from students who participated in keyboard instrument teaching with the robot indicates high satisfaction levels. This paper aims to diversify keyboard instruments' teaching mode, introduce the practical application of robots in classroom teaching, and facilitate personalized teaching catering to individual students' aptitudes.

Development and validation of novel immune-inflammation-based clinical predictive nomograms in HER2-negative advanced gastric cancer

Purpose

To explore the predictive value of multiple immune-inflammatory biomarkers including serum VEGFA and systemic immune-inflammation index (SII) in HER2-negative advanced gastric cancer (AGC) and establish nomograms for predicting the first-line chemotherapeutic efficacy, progression-free survival (PFS) and overall survival (OS) of patients with this fatal disease.

Methods

From November 2017 to April 2022, 102 and 34 patients with a diagnosis of HER2-negative AGC at the First Affiliated Hospital of Bengbu Medical College were enrolled as development and validation cohorts, respectively. Univariate and multivariate analyses were performed to evaluate the clinical value of the candidate indicators. The variables were screened using LASSO regression analysis. Predictive models were developed using significant predictors and are displayed as nomograms.

Results

Baseline VEGFA expression was significantly higher in HER2-negative AGC patients than in nonneoplastic patients and was associated with malignant serous effusion and therapeutic efficacy (all p<0.001). Multivariate analysis indicated that VEGFA was an independent predictor for first-line therapeutic efficacy and PFS (both p<0.01) and SII was an independent predictor for first-line PFS and OS (both p<0.05) in HER2-negative AGC patients. The therapeutic efficacy model had an R2 of 0.37, a Brier score of 0.15, and a Harrell's C-index of 0.82 in the development cohort and 0.90 in the validation cohort. The decision curve analysis indicated that the model added more net benefits than VEGFA assessment alone. The PFS/OS models had Harrell's C-indexes of 0.71/0.69 in the development cohort and 0.71/0.62 in the validation cohort.

Conclusion

The established nomograms integrating serum VEGFA/SII and commonly available baseline characteristics provided satisfactory performance in predicting the therapeutic efficacy and prognosis of HER2-negative AGC patients.

Systematic meta-analysis of computer-aided detection to detect early esophageal cancer using hyperspectral imaging

One of the leading causes of cancer deaths is esophageal cancer (EC) because identifying it in early stage is challenging. Computer-aided diagnosis (CAD) could detect the early stages of EC have been developed in recent years. Therefore, in this study, complete meta-analysis of selected studies that only uses hyperspectral imaging to detect EC is evaluated in terms of their diagnostic test accuracy (DTA). Eight studies are chosen based on the Quadas-2 tool results for systematic DTA analysis, and each of the methods developed in these studies is classified based on the nationality of the data, artificial intelligence, the type of image, the type of cancer detected, and the year of publishing. Deeks' funnel plot, forest plot, and accuracy charts were made. The methods studied in these articles show the automatic diagnosis of EC has a high accuracy, but external validation, which is a prerequisite for real-time clinical applications, is lacking.

Endoscopic Resection of Early Gastric Cancer and Pre-Malignant Gastric Lesions

Early gastric cancer comprises gastric malignancies that are confined to the mucosa or submucosa, irrespective of lymph node metastasis. Endoscopic resection is currently pivotal for the management of such early lesions, and it is the recommended treatment for tumors presenting a very low risk of lymph node metastasis. In general, these lesions consist of two groups of differentiated mucosal adenocarcinomas: non-ulcerated lesions (regardless of their size) and small ulcerated lesions. Endoscopic submucosal dissection is the technique of choice in most cases. This procedure has high rates of complete histological resection while maintaining gastric anatomy and its functions, resulting in fewer adverse events than surgery and having a lesser impact on patient-reported quality of life. Nonetheless, approximately 20% of resected lesions do not fulfill curative criteria and demand further treatment, highlighting the importance of patient selection. Additionally, the preservation of the stomach results in a moderate risk of metachronous lesions, which underlines the need for surveillance. We review the current evidence regarding the endoscopic treatment of early gastric cancer, including the short-and long-term results and management after resection.

Unassisted Clinicians Versus Deep Learning-Assisted Clinicians in Image-Based Cancer Diagnostics: Systematic Review With Meta-analysis

BACKGROUND

A number of publications have demonstrated that deep learning (DL) algorithms matched or outperformed clinicians in image-based cancer diagnostics, but these algorithms are frequently considered as opponents rather than partners. Despite the clinicians-in-the-loop DL approach having great potential, no study has systematically quantified the diagnostic accuracy of clinicians with and without the assistance of DL in image-based cancer identification.

OBJECTIVE

We systematically quantified the diagnostic accuracy of clinicians with and without the assistance of DL in image-based cancer identification.

METHODS

PubMed, Embase, IEEEXplore, and the Cochrane Library were searched for studies published between January 1, 2012, and December 7, 2021. Any type of study design was permitted that focused on comparing unassisted clinicians and DL-assisted clinicians in cancer identification using medical imaging. Studies using medical waveform-data graphics material and those investigating image segmentation rather than classification were excluded. Studies providing binary diagnostic accuracy data and contingency tables were included for further meta-analysis. Two subgroups were defined and analyzed, including cancer type and imaging modality.

RESULTS

In total, 9796 studies were identified, of which 48 were deemed eligible for systematic review. Twenty-five of these studies made comparisons between unassisted clinicians and DL-assisted clinicians and provided sufficient data for statistical synthesis. We found a pooled sensitivity of 83% (95% CI 80%-86%) for unassisted clinicians and 88% (95% CI 86%-90%) for DL-assisted clinicians. Pooled specificity was 86% (95% CI 83%-88%) for unassisted clinicians and 88% (95% CI 85%-90%) for DL-assisted clinicians. The pooled sensitivity and specificity values for DL-assisted clinicians were higher than for unassisted clinicians, at ratios of 1.07 (95% CI 1.05-1.09) and 1.03 (95% CI 1.02-1.05), respectively. Similar diagnostic performance by DL-assisted clinicians was also observed across the predefined subgroups.

CONCLUSIONS

The diagnostic performance of DL-assisted clinicians appears better than unassisted clinicians in image-based cancer identification. However, caution should be exercised, because the evidence provided in the reviewed studies does not cover all the minutiae involved in real-world clinical practice. Combining qualitative insights from clinical practice with data-science approaches may improve DL-assisted practice, although further research is required.

TRIAL REGISTRATION

PROSPERO CRD42021281372; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=281372.

Current Status of Artificial Intelligence-Based Computer-Assisted Diagnosis Systems for Gastric Cancer in Endoscopy

Artificial intelligence (AI) is gradually being utilized in various fields as its performance has been improving with the development of deep learning methods, availability of big data, and the progression of computer processing units. In the field of medicine, AI is mainly implemented in image recognition, such as in radiographic and pathologic diagnoses. In the realm of gastrointestinal endoscopy, although AI-based computer-assisted detection/diagnosis (CAD) systems have been applied in some areas, such as colorectal polyp detection and diagnosis, so far, their implementation in real-world clinical settings is limited. The accurate detection or diagnosis of gastric cancer (GC) is one of the challenges in which performance varies greatly depending on the endoscopist's skill. The diagnosis of early GC is especially challenging, partly because early GC mimics atrophic gastritis in the background mucosa. Therefore, several CAD systems for GC are being actively developed. The development of a CAD system for GC is considered challenging because it requires a large number of GC images. In particular, early stage GC images are rarely available, partly because it is difficult to diagnose gastric cancer during the early stages. Additionally, the training image data should be of a sufficiently high quality to conduct proper CAD training. Recently, several AI systems for GC that exhibit a robust performance, owing to being trained on a large number of high-quality images, have been reported. This review outlines the current status and prospects of AI use in esophagogastroduodenoscopy (EGDS), focusing on the diagnosis of GC.

Application of Deep Convolutional Neural Networks in the Diagnosis of Osteoporosis

The aim of this study was to assess the possibility of using deep convolutional neural networks (DCNNs) to develop an effective method for diagnosing osteoporosis based on CT images of the spine. The research material included the CT images of L1 spongy tissue belonging to 100 patients (50 healthy and 50 diagnosed with osteoporosis). Six pre-trained DCNN architectures with different topological depths (VGG16, VGG19, MobileNetV2, Xception, ResNet50, and InceptionResNetV2) were used in the study. The best results were obtained for the VGG16 model characterised by the lowest topological depth (ACC = 95%, TPR = 96%, and TNR = 94%). A specific challenge during the study was the relatively small (for deep learning) number of observations (400 images). This problem was solved using DCNN models pre-trained on a large dataset and a data augmentation technique. The obtained results allow us to conclude that the transfer learning technique yields satisfactory results during the construction of deep models for the diagnosis of osteoporosis based on small datasets of CT images of the spine.

Multi-center verification of the influence of data ratio of training sets on test results of an AI system for detecting early gastric cancer based on the YOLO-v4 algorithm

Objective

Convolutional Neural Network(CNN) is increasingly being applied in the diagnosis of gastric cancer. However, the impact of proportion of internal data in the training set on test results has not been sufficiently studied. Here, we constructed an artificial intelligence (AI) system called EGC-YOLOV4 using the YOLO-v4 algorithm to explore the optimal ratio of training set with the power to diagnose early gastric cancer.

Design

A total of 22,0918 gastroscopic images from Yixing People’s Hospital were collected. 7 training set models were established to identify 4 test sets. Respective sensitivity, specificity, Youden index, accuracy, and corresponding thresholds were tested, and ROC curves were plotted.

Results

1. The EGC-YOLOV4 system completes all tests at an average reading speed of about 15 ms/sheet; 2. The AUC values in training set 1 model were 0.8325, 0.8307, 0.8706, and 0.8279, in training set 2 model were 0.8674, 0.8635, 0.9056, and 0.9249, in training set 3 model were 0.8544, 0.8881, 0.9072, and 0.9237, in training set 4 model were 0.8271, 0.9020, 0.9102, and 0.9316, in training set 5 model were 0.8249, 0.8484, 0.8796, and 0.8931, in training set 6 model were 0.8235, 0.8539, 0.9002, and 0.9051, in training set 7 model were 0.7581, 0.8082, 0.8803, and 0.8763.

Conclusion

EGC-YOLOV4 can quickly and accurately identify the early gastric cancer lesions in gastroscopic images, and has good generalization.The proportion of positive and negative samples in the training set will affect the overall diagnostic performance of AI.In this study, the optimal ratio of positive samples to negative samples in the training set is 1:1~ 1:2.

A deep learning-based model improves diagnosis of early gastric cancer under narrow band imaging endoscopy

BACKGROUND

Diagnosis of early gastric cancer (EGC) under narrow band imaging endoscopy (NBI) is dependent on expertise and skills. We aimed to elucidate whether artificial intelligence (AI) could diagnose EGC under NBI and evaluate the diagnostic assistance of the AI system.

METHODS

In this retrospective diagnostic study, 21,785 NBI images and 20 videos from five centers were divided into a training dataset (13,151 images, 810 patients), an internal validation dataset (7057 images, 283 patients), four external validation datasets (1577 images, 147 patients), and a video validation dataset (20 videos, 20 patients). All the images were labeled manually and used to train an AI system using You look only once v3 (YOLOv3). Next, the diagnostic performance of the AI system and endoscopists were compared and the diagnostic assistance of the AI system was assessed. The accuracy, sensitivity, specificity, and AUC were primary outcomes.

RESULTS

The AI system diagnosed EGCs on validation datasets with AUCs of 0.888-0.951 and diagnosed all the EGCs (100.0%) in video dataset. The AI system achieved better diagnostic performance (accuracy, 93.2%, 95% CI, 90.0-94.9%) than senior (85.9%, 95% CI, 84.2-87.4%) and junior (79.5%, 95% CI, 77.8-81.0%) endoscopists. The AI system significantly enhanced the performance of endoscopists in senior (89.4%, 95% CI, 87.9-90.7%) and junior (84.9%, 95% CI, 83.4-86.3%) endoscopists.

CONCLUSION

The NBI AI system outperformed the endoscopists and exerted potential assistant impact in EGC identification. Prospective validations are needed to evaluate the clinical reinforce of the system in real clinical practice.

Implementation of artificial intelligence in upper gastrointestinal endoscopy

The application of artificial intelligence (AI) using deep learning has significantly expanded in the field of esophagogastric endoscopy. Recent studies have shown promising results in detecting and differentiating early gastric cancer using AI tools built using white light, magnified, or image‐enhanced endoscopic images. Some studies have reported the use of AI tools to predict the depth of early gastric cancer based on endoscopic images. Similarly, studies based on using AI for detecting early esophageal cancer have also been reported, with an accuracy comparable to that of endoscopy specialists. Moreover, an AI system, developed to diagnose pharyngeal cancer, has shown promising performance with high sensitivity. These reports suggest that, if introduced for regular use in clinical settings, AI systems can significantly reduce the burden on physicians. This review summarizes the current status of AI applications in the upper gastrointestinal tract and presents directions for clinical practice implementation and future research.

Diagnostic accuracy of convolutional neural network-based endoscopic image analysis in diagnosing gastric cancer and predicting its invasion depth: a systematic review and meta-analysis

BACKGROUND AND AIMS

This study aimed to evaluate the accuracy and effectiveness of the convolutional neural network (CNN) in diagnosing gastric cancer and predicting the invasion depth of gastric cancer and to compare the performance of the CNN with that of endoscopists.

METHODS

PubMed, Embase, Web of Science, and gray literature were searched until July 23, 2021 for studies that assessed the diagnostic accuracy of CNN-assisted examinations for gastric cancer or the invasion depth of gastric cancer. Studies meeting inclusion criteria were included in the systematic review and meta-analysis.

RESULTS

Seventeen studies comprising 51,446 images and 174 videos of 5539 patients were included. The pooled sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), and area under the curve (AUC) of the CNN for diagnosing gastric cancer were 89% (95% confidence interval [CI], 85-93), 93% (95% CI, 88-97), 13.4 (95% CI, 7.3-25.5), .11 (95% CI, .07-.17), and .94 (95% CI, .91-.98), respectively. The performance of the CNN in diagnosing gastric cancer was not significantly different from that of expert endoscopists (.95 vs .90, P > .05) and was better than that of overall endoscopists (experts and nonexperts) (.95 vs .87, P < .05). The pooled sensitivity, specificity, LR+, LR-, and AUC of the CNN for predicting the invasion depth of gastric cancer were 82% (95% CI, 78-85), 90% (95% CI, 82-95), 8.4 (95% CI, 4.2-16.8), .20 (95% CI, .16-.26), and .90 (95% CI, .87-.93), respectively.

CONCLUSIONS

The CNN is highly accurate in diagnosing gastric cancer and predicting the invasion depth of gastric cancer. The performance of the CNN in diagnosing gastric cancer is not significantly different from that of expert endoscopists. Studies of the real-time performance of the CNN for gastric cancer diagnosis are needed to confirm these findings.

Real-time use of artificial intelligence for diagnosing early gastric cancer by magnifying image-enhanced endoscopy: a multicenter diagnostic study (with videos)

BACKGROUND AND AIMS

Endoscopy is a pivotal method for detecting early gastric cancer (EGC). However, skill among endoscopists varies greatly. Here, we proposed a deep learning-based system named ENDOANGEL-ME to diagnose EGC in magnifying image-enhanced endoscopy (M-IEE).

METHODS

M-IEE images were retrospectively obtained from 6 hospitals in China, including 4667 images for training and validation, 1324 images for internal tests, and 4702 images for external tests. One hundred eighty-seven stored videos from 2 hospitals were used to evaluate the performance of ENDOANGEL-ME and endoscopists and to assess the effect of ENDOANGEL-ME on improving the performance of endoscopists. Prospective consecutive patients undergoing M-IEE were enrolled from August 17, 2020 to August 2, 2021 in Renmin Hospital of Wuhan University to assess the applicability of ENDOANGEL-ME in clinical practice.

RESULTS

A total of 3099 patients undergoing M-IEE were enrolled in this study. The diagnostic accuracy of ENDOANGEL-ME for diagnosing EGC was 88.44% and 90.49% in internal and external images, respectively. In 93 internal videos, ENDOANGEL-ME achieved an accuracy of 90.32% for diagnosing EGC, significantly superior to that of senior endoscopists (70.16% ± 8.78%). In 94 external videos, with the assistance of ENDOANGEL-ME, endoscopists showed improved accuracy and sensitivity (85.64% vs 80.32% and 82.03% vs 67.19%, respectively). In 194 prospective consecutive patients with 251 lesions, ENDOANGEL-ME achieved a sensitivity of 92.59% (25/27) and an accuracy of 83.67% (210/251) in real clinical practice.

CONCLUSIONS

This multicenter diagnostic study showed that ENDOANGEL-ME can be well applied in the clinical setting. (Clinical trial registration number: ChiCTR2000035116.).

Optimization of Complete Rat Heart Decellularization Using Artificial Neural Networks

Whole organ decellularization techniques have facilitated the fabrication of extracellular matrices (ECMs) for engineering new organs. Unfortunately, there is no objective gold standard evaluation of the scaffold without applying a destructive method such as histological analysis or DNA removal quantification of the dry tissue. Our proposal is a software application using deep convolutional neural networks (DCNN) to distinguish between different stages of decellularization, determining the exact moment of completion. Hearts from male Sprague Dawley rats (n = 10) were decellularized using 1% sodium dodecyl sulfate (SDS) in a modified Langendorff device in the presence of an alternating rectangular electric field. Spectrophotometric measurements of deoxyribonucleic acid (DNA) and total proteins concentration from the decellularization solution were taken every 30 min. A monitoring system supervised the sessions, collecting a large number of photos saved in corresponding folders. This system aimed to prove a strong correlation between the data gathered by spectrophotometry and the state of the heart that could be visualized with an OpenCV-based spectrometer. A decellularization completion metric was built using a DCNN based classifier model trained using an image set comprising thousands of photos. Optimizing the decellularization process using a machine learning approach launches exponential progress in tissue bioengineering research.

Deep learning system compared with expert endoscopists in predicting early gastric cancer and its invasion depth and differentiation status (with videos)

BACKGROUND AND AIMS

We aimed to develop and validate a deep learning-based system that covers various aspects of early gastric cancer (EGC) diagnosis, including detecting gastric neoplasm, identifying EGC, and predicting EGC invasion depth and differentiation status. Herein, we provide a state-of-the-art comparison of the system with endoscopists using real-time videos in a nationwide human-machine competition.

METHODS

This multicenter, prospective, real-time, competitive comparative, diagnostic study enrolled consecutive patients who received magnifying narrow-band imaging endoscopy at the Peking University Cancer Hospital from June 9, 2020 to November 17, 2020. The offline competition was conducted in Wuhan, China, and the endoscopists and the system simultaneously read patients' videos and made diagnoses. The primary outcomes were sensitivity in detecting neoplasms and diagnosing EGCs.

RESULTS

One hundred videos, including 37 EGCs and 63 noncancerous lesions, were enrolled; 46 endoscopists from 44 hospitals in 19 provinces in China participated in the competition. The sensitivity rates of the system for detecting neoplasms and diagnosing EGCs were 87.81% and 100%, respectively, significantly higher than those of endoscopists (83.51% [95% confidence interval [CI], 81.23-85.79] and 87.13% [95% CI, 83.75-90.51], respectively). Accuracy rates of the system for predicting EGC invasion depth and differentiation status were 78.57% and 71.43%, respectively, slightly higher than those of endoscopists (63.75% [95% CI, 61.12-66.39] and 64.41% [95% CI, 60.65-68.16], respectively).

CONCLUSIONS

The system outperformed endoscopists in identifying EGCs and was comparable with endoscopists in predicting EGC invasion depth and differentiation status in videos. This deep learning-based system could be a powerful tool to assist endoscopists in EGC diagnosis in clinical practice.

Machine Learning for Future Subtyping of the Tumor Microenvironment of Gastro-Esophageal Adenocarcinomas

Tumor progression involves an intricate interplay between malignant cells and their surrounding tumor microenvironment (TME) at specific sites. The TME is dynamic and is composed of stromal, parenchymal, and immune cells, which mediate cancer progression and therapy resistance. Evidence from preclinical and clinical studies revealed that TME targeting and reprogramming can be a promising approach to achieve anti-tumor effects in several cancers, including in GEA. Thus, it is of great interest to use modern technology to understand the relevant components of programming the TME. Here, we discuss the approach of machine learning, which recently gained increasing interest recently because of its ability to measure tumor parameters at the cellular level, reveal global features of relevance, and generate prognostic models. In this review, we discuss the relevant stromal composition of the TME in GEAs and discuss how they could be integrated. We also review the current progress in the application of machine learning in different medical disciplines that are relevant for the management and study of GEA.