Deep learning for gastroscopic images: computer-aided techniques for clinicians

Diagnosis to dissection: AI's role in early detection and surgical intervention for gastric cancer

Gastric cancer remains a formidable health challenge worldwide; early detection and effective surgical intervention are critical for improving patient outcomes. This comprehensive review explores the evolving landscape of gastric cancer management, emphasizing the significant contributions of artificial intelligence (AI) in revolutionizing both diagnostic and therapeutic approaches. Despite advancements in the medical field, the subtle nature of early gastric cancer symptoms often leads to late-stage diagnoses, where survival rates are notably decreased. Historically, the treatment of gastric cancer has transitioned from palliative care to surgical resection, evolving further with the introduction of minimally invasive surgical (MIS) techniques. In the current era, AI has emerged as a transformative force, enhancing the precision of early gastric cancer detection through sophisticated image analysis, and supporting surgical decision-making with predictive modeling and real-time preop-, intraop-, and postoperative guidance. However, the deployment of AI in healthcare raises significant ethical, legal, and practical challenges, including the necessity for ongoing professional education and the development of standardized protocols to ensure patient safety and the effective use of AI technologies. Future directions point toward a synergistic integration of AI with clinical best practices, promising a new era of personalized, efficient, and safer gastric cancer management.

Early gastric cancer detection and lesion segmentation based on deep learning and gastroscopic images

Gastric cancer is a highly prevalent disease that poses a serious threat to public health. In clinical practice, gastroscopy is frequently used by medical practitioners to screen for gastric cancer. However, the symptoms of gastric cancer at different stages of advancement vary significantly, particularly in the case of early gastric cancer (EGC). The manifestations of EGC are often indistinct, leading to a detection rate of less than 10%. In recent years, researchers have focused on leveraging deep learning algorithms to assist medical professionals in detecting EGC and thereby improve detection rates. To enhance the ability of deep learning to detect EGC and segment lesions in gastroscopic images, an Improved Mask R-CNN (IMR-CNN) model was proposed. This model incorporates a "Bi-directional feature extraction and fusion module" and a "Purification module for feature channel and space" based on the Mask R-CNN (MR-CNN). Our study includes a dataset of 1120 images of EGC for training and validation of the models. The experimental results indicate that the IMR-CNN model outperforms the original MR-CNN model, with Precision, Recall, Accuracy, Specificity and F1-Score values of 92.9%, 95.3%, 93.9%, 92.5% and 94.1%, respectively. Therefore, our proposed IMR-CNN model has superior detection and lesion segmentation capabilities and can effectively aid doctors in diagnosing EGC from gastroscopic images.

Exploring factors that influence the behavioural intention of medical students to use 3D gastroscopic model to learn how to operate gastroscope using UTAUT Model

BACKGROUND

The application of virtual reality (VR) in gastroscopic operation teaching can be safe and effective, but the advantages can be realized only when students accept and use it. This study aims to identify the factors influencing Chinese clinical medical postgraduates on their intention to use the 3D gastroscopic model constructed based on VR technology using Unified Theory of Acceptance and Use of Technology (UTAUT) model. Students' demographic factors are also taken into consideration.

METHODS

All methods were carried out in accordance with relevant guidelines. Data were collected from clinical medical postgraduates students in China using stratified sampling. A total of 292 questionnaires including valid responses were used in this study. Data were processed using Amos 24.0 and SPSS 26.0 software and the statistical analysis technique was based on structural equation modeling (SEM).

RESULTS

The results showed that different from the mediator of home location and year of clinical learning, mediator of gender, university kind and graduate degree did not affect the behavioral intention. In addition, performance expectancy, facilitating condition, and social influence directly and indirectly have effect on behavioral intention. Also, the significance between social influence and performance expectancy, social influence and effort expectancy were verified.

CONCLUSIONS

This study manifested that the proposed framework based on the UTAUT had explanatory power to identify the factors influencing the students' behavioral intention to use the 3D gastroscopic model constructed based on VR technology. Whereas, an important variable of effort expectancy in the frame of the SEM were not certified, thereby indicating that particular attention should be paid to this variable by universities and teachers before applying 3D gastroscopic model constructed based on VR technology in teaching. Added preparatory work is required such as explaining the basic knowledge of the operating steps of VR model and make students adequately understand its accessibility, which can probably improve the intentions of them to use it. The positive effects of social influence on performance expectancy and effort expectancy we proposed was also verified in this study, which provided a direction for future research.

Artificial intelligence and automation in endoscopy and surgery

Modern endoscopy relies on digital technology, from high-resolution imaging sensors and displays to electronics connecting configurable illumination and actuation systems for robotic articulation. In addition to enabling more effective diagnostic and therapeutic interventions, the digitization of the procedural toolset enables video data capture of the internal human anatomy at unprecedented levels. Interventional video data encapsulate functional and structural information about a patient's anatomy as well as events, activity and action logs about the surgical process. This detailed but difficult-to-interpret record from endoscopic procedures can be linked to preoperative and postoperative records or patient imaging information. Rapid advances in artificial intelligence, especially in supervised deep learning, can utilize data from endoscopic procedures to develop systems for assisting procedures leading to computer-assisted interventions that can enable better navigation during procedures, automation of image interpretation and robotically assisted tool manipulation. In this Perspective, we summarize state-of-the-art artificial intelligence for computer-assisted interventions in gastroenterology and surgery.

Detection and Characterization of Gastric Cancer Using Cascade Deep Learning Model in Endoscopic Images

Endoscopy is widely applied in the examination of gastric cancer. However, extensive knowledge and experience are required, owing to the need to examine the lesion while manipulating the endoscope. Various diagnostic support techniques have been reported for this examination. In our previous study, segmentation of invasive areas of gastric cancer was performed directly from endoscopic images and the detection sensitivity per case was 0.98. This method has challenges of false positives and computational costs because segmentation was applied to all healthy images that were captured during the examination. In this study, we propose a cascaded deep learning model to perform categorization of endoscopic images and identification of the invasive region to solve the above challenges. Endoscopic images are first classified as normal, showing early gastric cancer and showing advanced gastric cancer using a convolutional neural network. Segmentation on the extent of gastric cancer invasion is performed for the images classified as showing cancer using two separate U-Net models. In an experiment, 1208 endoscopic images collected from healthy subjects, 533 images collected from patients with early stage gastric cancer, and 637 images from patients with advanced gastric cancer were used for evaluation. The sensitivity and specificity of the proposed approach in the detection of gastric cancer via image classification were 97.0% and 99.4%, respectively. Furthermore, both detection sensitivity and specificity reached 100% in a case-based evaluation. The extent of invasion was also identified at an acceptable level, suggesting that the proposed method may be considered useful for the classification of endoscopic images and identification of the extent of cancer invasion.