Evolving role of artificial intelligence in gastrointestinal endoscopy

Expanding role and scope of artificial intelligence in the field of gastrointestinal pathology

Digital pathology (DP) and its subsidiaries including artificial intelligence (AI) are rapidly making inroads into the area of diagnostic anatomic pathology (AP) including gastrointestinal (GI) pathology. It is poised to revolutionize the field of diagnostic AP. Historically, AP has been slow to adopt digital technology, but this is changing rapidly, with many centers worldwide transitioning to DP. Coupled with advanced techniques of AI such as deep learning and machine learning, DP is likely to transform histopathology from a subjective field to an objective, efficient, and transparent discipline. AI is increasingly integrated into GI pathology, offering numerous advancements and improvements in overall diagnostic accuracy, efficiency, and patient care. Specifically, AI in GI pathology enhances diagnostic accuracy, streamlines workflows, provides predictive insights, integrates multimodal data, supports research, and aids in education and training, ultimately improving patient care and outcomes. This review summarized the latest developments in the role and scope of AI in AP with a focus on GI pathology. The main aim was to provide updates and create awareness among the pathology community.

A novel endoscopic ultrasomics-based machine learning model and nomogram to predict the pathological grading of pancreatic neuroendocrine tumors

Objectives

This research aimed to retrospectively construct and authenticate ultrasomics models using endoscopic ultrasonography (EUS) images for forecasting the pathological grading of pancreatic neuroendocrine tumors (PNETs).

Methods

After confirmation through pathological examination, a retrospective analysis of 79 patients was conducted, including 49 with grade 1 PNETs and 30 with grade 2/3 PNETs. These patients were randomized to the training or test cohort in a 6:4 proportion. The least absolute shrinkage and selection operator (LASSO) algorithm was used to reduce the dimensionality of ultrasomics features derived from standard EUS images. These nonzero coefficient features were retained and applied to construct prediction models via eight machine-learning algorithms. The optimum ulstrasomics model was determined, followed by creating and evaluating a nomogram.

Results

Ultrasomics features of 107 were extracted, and only those with coefficients greater than zero were retained. The XGboost ultrasomics model performed exceptionally well, achieving AUCs of 0.987 and 0.781 in the training and test cohorts, respectively. Furthermore, an effective nomogram was developed and visually represented. Finally, the calibration curves, decision curve analysis (DCA) plots, and clinical impact curve (CIC) displayed in the ulstrasomics model and nomogram demonstrated high accuracy. They provided significant net benefits for clinical decision-making.

Conclusions

A novel ulstrasomics model and nomogram were created and certified to predict the pathological grading of PNETs using EUS images. This study has the potential to provide valuable insights that improve the clinical applicability and efficacy of EUS in predicting the grading of PNETs.

Endoscopic ultrasonography-based intratumoral and peritumoral machine learning radiomics analyses for distinguishing insulinomas from non-functional pancreatic neuroendocrine tumors

Objectives

To develop and validate radiomics models utilizing endoscopic ultrasonography (EUS) images to distinguish insulinomas from non-functional pancreatic neuroendocrine tumors (NF-PNETs).

Methods

A total of 106 patients, comprising 61 with insulinomas and 45 with NF-PNETs, were included in this study. The patients were randomly assigned to either the training or test cohort. Radiomics features were extracted from both the intratumoral and peritumoral regions, respectively. Six machine learning algorithms were utilized to train intratumoral prediction models, using only the nonzero coefficient features. The researchers identified the most effective intratumoral radiomics model and subsequently employed it to develop peritumoral and combined radiomics models. Finally, a predictive nomogram for insulinomas was constructed and assessed.

Results

A total of 107 radiomics features were extracted based on EUS, and only features with nonzero coefficients were retained. Among the six intratumoral radiomics models, the light gradient boosting machine (LightGBM) model demonstrated superior performance. Furthermore, a peritumoral radiomics model was established and evaluated. The combined model, integrating both the intratumoral and peritumoral radiomics features, exhibited a comparable performance in the training cohort (AUC=0.876) and achieved the highest accuracy in predicting outcomes in the test cohorts (AUC=0.835). The Delong test, calibration curves, and decision curve analysis (DCA) were employed to validate these findings. Insulinomas exhibited a significantly smaller diameter compared to NF-PNETs. Finally, the nomogram, incorporating diameter and radiomics signature, was constructed and assessed, which owned superior performance in both the training (AUC=0.929) and test (AUC=0.913) cohorts.

Conclusion

A novel and impactful radiomics model and nomogram were developed and validated for the accurate differentiation of NF-PNETs and insulinomas utilizing EUS images.

Role of Artificial Intelligence in the Diagnosis of Gastroesophageal Reflux Disease

Gastroesophageal reflux disease (GERD) is a disorder that usually presents with heartburn. GERD is diagnosed clinically, but most patients are misdiagnosed due to atypical presentations. The increased use of artificial intelligence (AI) in healthcare has provided multiple ways of diagnosing and treating patients accurately. In this review, multiple studies in which AI models were used to diagnose GERD are discussed. According to the studies, using AI models helped to diagnose GERD in patients accurately. AI, although considered one of the most potent emerging aspects of medicine with its accuracy in patient diagnosis, presents limitations of its own, which explains why healthcare providers may hesitate to use AI in patient care. The challenges and limitations should be addressed before AI is fully incorporated into the healthcare system.

Construction and validation of an endoscopic ultrasonography-based ultrasomics nomogram for differentiating pancreatic neuroendocrine tumors from pancreatic cancer

Objectives

To develop and validate various ultrasomics models based on endoscopic ultrasonography (EUS) for retrospective differentiating pancreatic neuroendocrine tumors (PNET) from pancreatic cancer.

Methods

A total of 231 patients, comprising 127 with pancreatic cancer and 104 with PNET, were retrospectively enrolled. These patients were randomly divided into either a training or test cohort at a ratio of 7:3. Ultrasomics features were extracted from conventional EUS images, focusing on delineating the region of interest (ROI) for pancreatic lesions. Subsequently, dimensionality reduction of the ultrasomics features was performed by applying the Mann-Whitney test and least absolute shrinkage and selection operator (LASSO) algorithm. Eight machine learning algorithms, namely logistic regression (LR), light gradient boosting machine (LightGBM), multilayer perceptron (MLP), random forest (RF), extra trees, k nearest neighbors (KNN), support vector machine (SVM), and extreme gradient boosting (XGBoost), were employed to train prediction models using nonzero coefficient features. The optimal ultrasomics model was determined using a ROC curve and utilized for subsequent analysis. Clinical-ultrasonic features were assessed using both univariate and multivariate logistic regression. An ultrasomics nomogram model, integrating both ultrasomics and clinical-ultrasonic features, was developed.

Results

A total of 107 EUS-based ultrasomics features were extracted, and 6 features with nonzero coefficients were ultimately retained. Among the eight ultrasomics models based on machine learning algorithms, the RF model exhibited superior performance with an AUC= 0.999 (95% CI 0.9977 - 1.0000) in the training cohort and an AUC= 0.649 (95% CI 0.5215 - 0.7760) in the test cohort. A clinical-ultrasonic model was established and evaluated, yielding an AUC of 0.999 (95% CI 0.9961 - 1.0000) in the training cohort and 0.847 (95% CI 0.7543 - 0.9391) in the test cohort. Subsequently, the ultrasomics nomogram demonstrated a significant improvement in prediction accuracy in the test cohort, as evidenced by an AUC of 0.884 (95% CI 0.8047 - 0.9635) and confirmed by the Delong test. The calibration curve and decision curve analysis (DCA) depicted this ultrasomics nomogram demonstrated superior accuracy. They also yielded the highest net benefit for clinical decision-making compared to alternative models.

Conclusions

A novel ultrasomics nomogram was proposed and validated, that integrated clinical-ultrasonic and ultrasomics features obtained through EUS, aiming to accurately and efficiently identify pancreatic cancer and PNET.

The adoption of artificial intelligence assisted endoscopy in the Middle East: challenges and future potential

The use of artificial intelligence (AI) in endoscopy has shown immense potential to enhance diagnostic accuracy, streamline procedures, and improve patient outcomes. There are potential uses in every field of endoscopy, from improving adenoma detection rate (ADR) in colonoscopy to reducing read time in capsule endoscopy or minimizing blind spots in gastroscopy. Indeed, some of these systems are already licensed and in commercial use across the world. In the Middle East, where healthcare systems are rapidly evolving, there is a growing interest in adopting AI technologies to revolutionise endoscopic practices. This article provides an overview of the advancements, potential opportunities and challenges associated with the implementation of AI in endoscopy within the Middle East region. Our aim is to contribute to the ongoing dialogue surrounding the implementation of AI in endoscopy and consider some of the factors that are particularly relevant in the Middle Eastern context, including the need to train the models for local populations, cost and training, as well as trying to ensure equity of access for patients. It provides valuable insights for healthcare professionals, policymakers, and researchers interested in leveraging AI to enhance endoscopic procedures, improve patient care, and address the unique healthcare needs of the Middle East population.

A Comprehensive Guide to Artificial Intelligence in Endoscopic Ultrasound

BACKGROUND

Endoscopic Ultrasound (EUS) is widely used for the diagnosis of bilio-pancreatic and gastrointestinal (GI) tract diseases, for the evaluation of subepithelial lesions, and for sampling of lymph nodes and solid masses located next to the GI tract. The role of Artificial Intelligence in healthcare in growing. This review aimed to provide an overview of the current state of AI in EUS from imaging to pathological diagnosis and training.

METHODS

AI algorithms can assist in lesion detection and characterization in EUS by analyzing EUS images and identifying suspicious areas that may require further clinical evaluation or biopsy sampling. Deep learning techniques, such as convolutional neural networks (CNNs), have shown great potential for tumor identification and subepithelial lesion (SEL) evaluation by extracting important features from EUS images and using them to classify or segment the images.

RESULTS

AI models with new features can increase the accuracy of diagnoses, provide faster diagnoses, identify subtle differences in disease presentation that may be missed by human eyes, and provide more information and insights into disease pathology.

CONCLUSIONS

The integration of AI in EUS images and biopsies has the potential to improve the diagnostic accuracy, leading to better patient outcomes and to a reduction in repeated procedures in case of non-diagnostic biopsies.

Clinicians’ Guide to Artificial Intelligence in Colon Capsule Endoscopy—Technology Made Simple

Artificial intelligence (AI) applications have become widely popular across the healthcare ecosystem. Colon capsule endoscopy (CCE) was adopted in the NHS England pilot project following the recent COVID pandemic’s impact. It demonstrated its capability to relieve the national backlog in endoscopy. As a result, AI-assisted colon capsule video analysis has become gastroenterology’s most active research area. However, with rapid AI advances, mastering these complex machine learning concepts remains challenging for healthcare professionals. This forms a barrier for clinicians to take on this new technology and embrace the new era of big data. This paper aims to bridge the knowledge gap between the current CCE system and the future, fully integrated AI system. The primary focus is on simplifying the technical terms and concepts in machine learning. This will hopefully address the general “fear of the unknown in AI” by helping healthcare professionals understand the basic principle of machine learning in capsule endoscopy and apply this knowledge in their future interactions and adaptation to AI technology. It also summarises the evidence of AI in CCE and its impact on diagnostic pathways. Finally, it discusses the unintended consequences of using AI, ethical challenges, potential flaws, and bias within clinical settings.

An Optimal Artificial Intelligence System for Real-Time Endoscopic Prediction of Invasion Depth in Early Gastric Cancer

We previously constructed a VGG-16 based artificial intelligence (AI) model (image classifier [IC]) to predict the invasion depth in early gastric cancer (EGC) using endoscopic static images. However, images cannot capture the spatio-temporal information available during real-time endoscopy-the AI trained on static images could not estimate invasion depth accurately and reliably. Thus, we constructed a video classifier [VC] using videos for real-time depth prediction in EGC. We built a VC by attaching sequential layers to the last convolutional layer of IC v2, using video clips. We computed the standard deviation (SD) of output probabilities for a video clip and the sensitivities in the manner of frame units to observe consistency. The sensitivity, specificity, and accuracy of IC v2 for static images were 82.5%, 82.9%, and 82.7%, respectively. However, for video clips, the sensitivity, specificity, and accuracy of IC v2 were 33.6%, 85.5%, and 56.6%, respectively. The VC performed better analysis of the videos, with a sensitivity of 82.3%, a specificity of 85.8%, and an accuracy of 83.7%. Furthermore, the mean SD was lower for the VC than IC v2 (0.096 vs. 0.289). The AI model developed utilizing videos can predict invasion depth in EGC more precisely and consistently than image-trained models, and is more appropriate for real-world situations.

Mapping intellectual structures and research hotspots in the application of artificial intelligence in cancer: A bibliometric analysis

Background

Artificial intelligence (AI) is more and more widely used in cancer, which is of great help to doctors in diagnosis and treatment. This study aims to summarize the current research hotspots in the Application of Artificial Intelligence in Cancer (AAIC) and to assess the research trends in AAIC.

Methods

Scientific publications for AAIC-related research from 1 January 1998 to 1 July 2022 were obtained from the Web of Science database. The metrics analyses using bibliometrics software included publication, keyword, author, journal, institution, and country. In addition, the blustering analysis on the binary matrix was performed on hot keywords.

Results

The total number of papers in this study is 1592. The last decade of AAIC research has been divided into a slow development phase (2013-2018) and a rapid development phase (2019-2022). An international collaboration centered in the USA is dedicated to the development and application of AAIC. Li J is the most prolific writer in AAIC. Through clustering analysis and high-frequency keyword research, it has been shown that AI plays a significantly important role in the prediction, diagnosis, treatment and prognosis of cancer. Classification, diagnosis, carcinogenesis, risk, and validation are developing topics. Eight hotspot fields of AAIC were also identified.

Conclusion

AAIC can benefit cancer patients in diagnosing cancer, assessing the effectiveness of treatment, making a decision, predicting prognosis and saving costs. Future AAIC research may be dedicated to optimizing AI calculation tools, improving accuracy, and promoting AI.

Artificial intelligence: Emerging player in the diagnosis and treatment of digestive disease

Given the breakthroughs in key technologies, such as image recognition, deep learning and neural networks, artificial intelligence (AI) continues to be increasingly developed, leading to closer and deeper integration with an increasingly data-, knowledge- and brain labor-intensive medical industry. As society continues to advance and individuals become more aware of their health needs, the problems associated with the aging of the population are receiving increasing attention, and there is an urgent demand for improving medical technology, prolonging human life and enhancing health. Digestive system diseases are the most common clinical diseases and are characterized by complex clinical manifestations and a general lack of obvious symptoms in the early stage. Such diseases are very difficult to diagnose and treat. In recent years, the incidence of diseases of the digestive system has increased. As AI applications in the field of health care continue to be developed, AI has begun playing an important role in the diagnosis and treatment of diseases of the digestive system. In this paper, the application of AI in assisted diagnosis and the application and prospects of AI in malignant and benign digestive system diseases are reviewed.

Current advancements in application of artificial intelligence in clinical decision-making by gastroenterologists in gastrointestinal bleeding

Artificial Intelligence (AI) is a type of intelligence that comes from machines or computer systems that mimics human cognitive function. Recently, AI has been utilized in medicine and helped clinicians make clinical decisions. In gastroenterology, AI has assisted colon polyp detection, optical biopsy, and diagnosis of Helicobacter pylori infection. AI also has a broad role in the clinical prediction and management of gastrointestinal bleeding. Machine learning can determine the clinical risk of upper and lower gastrointestinal bleeding. AI can assist the management of gastrointestinal bleeding by identifying high-risk patients who might need urgent endoscopic treatment or blood transfusion, determining bleeding stigmata during endoscopy, and predicting recurrence of gastrointestinal bleeding. The present review will discuss the role of AI in the clinical prediction and management of gastrointestinal bleeding, primarily on how it could assist gastroenterologists in their clinical decision-making compared to conventional methods. This review will also discuss challenges in implementing AI in routine practice.

Recent Updates and Technological Developments in Evaluating Cardiac Syncope in the Emergency Department

Syncope is a commonly encountered problem in the emergency department (ED), accounting for approximately 3% of presenting complaints. Clinical assessment of syncope can be challenging due to the diverse range of conditions that can precipitate the symptom. Annual mortality for patients presenting with syncope ranges from 0-12%, and if the syncope is secondary to a cardiac cause, then this figure rises to 18-33%. In ED, it is paramount to accurately identify those presenting with syncope, especially patients with an underlying cardiac aetiology, initiate appropriate management, and refer them for further investigations. In 2018, the European Society of Cardiology (ESC) updated its guidelines with regard to diagnosing and managing patients with syncope. We highlight recent developments and considerations in various components of the workup, such as history, physical examination, investigations, risk stratification, and novel biomarkers, since the establishment of the 2018 ESC guidelines. We further discuss the emerging role of artificial intelligence in diagnosing cardiac syncope and postulate how wearable technology may transform evaluating cardiac syncope in ED.

Utilization of Ultrasonic Image Characteristics Combined with Endoscopic Detection on the Basis of Artificial Intelligence Algorithm in Diagnosis of Early Upper Gastrointestinal Cancer

The aim of this study was to evaluate the diagnostic value of artificial intelligence algorithm combined with ultrasound endoscopy in early esophageal cancer and precancerous lesions by comparing the examination of conventional endoscopy and artificial intelligence algorithm combined with ultrasound endoscopy, and by comparing the real-time diagnosis of endoscopy and the ultrasonic image characteristics of artificial intelligence algorithm combined with endoscopic detection and pathological results. 120 cases were selected. According to the inclusion and exclusion criteria, 80 patients who met the criteria were selected and randomly divided into two groups: endoscopic examination combined with ultrasound imaging based on intelligent algorithm processing (cascade region-convolutional neural network (Cascade RCNN) model algorithm group) and simple use of endoscopy group (control group). This study shows that the ultrasonic image of artificial intelligence algorithm is effective, and the detection performance is better than that of endoscopic detection. The results are close to the gold standard of doctor recognition, and the detection time is greatly shortened, and the recognition time is shortened by 71 frames per second. Compared with the traditional convolutional neural network (CNN) algorithm, the accuracy and recall of image analysis and segmentation using feature pyramid network are increased. The detection rates of CNN model, Cascade RCNN model, and endoscopic detection alone in early esophageal cancer and precancerous lesions are 56.3% (45/80), 88.8% (71/80), and 44.1% (35/80), respectively. The detection rate of Cascade RCNN model and CNN model was higher than that of endoscopy alone, and the difference was statistically significant (P < 0.05). The sensitivity, specificity, positive predictive value, and negative predictive value of Cascade RCNN model were higher than those of CNN model, which was close to the gold standard for physician identification. This provided a reference basis for endoscopic ultrasound identification of early upper gastrointestinal cancer or other gastrointestinal cancers.

Artificial intelligence in arthroplasty

Artificial intelligence (AI) is altering the world of medicine. Given the rapid advances in technology, computers are now able to learn and improve, imitating humanoid cognitive function. AI applications currently exist in various medical specialties, some of which are already in clinical use. This review presents the potential uses and limitations of AI in arthroplasty to provide a better understanding of the existing technology and future direction of this field.Recent literature demonstrates that the utilization of AI in the field of arthroplasty has the potential to improve patient care through better diagnosis, screening, planning, monitoring, and prediction. The implementation of AI technology will enable arthroplasty surgeons to provide patient-specific management in clinical decision making, preoperative health optimization, resource allocation, decision support, and early intervention. While this technology presents a variety of exciting opportunities, it also has several limitations and challenges that need to be overcome to ensure its safety and effectiveness.

Deep learning vs conventional learning algorithms for clinical prediction in Crohn's disease: A proof-of-concept study

BACKGROUND

Traditional methods of developing predictive models in inflammatory bowel diseases (IBD) rely on using statistical regression approaches to deriving clinical scores such as the Crohn's disease (CD) activity index. However, traditional approaches are unable to take advantage of more complex data structures such as repeated measurements. Deep learning methods have the potential ability to automatically find and learn complex, hidden relationships between predictive markers and outcomes, but their application to clinical prediction in CD and IBD has not been explored previously.

AIM

To determine and compare the utility of deep learning with conventional algorithms in predicting response to anti-tumor necrosis factor (anti-TNF) therapy in CD.

METHODS

This was a retrospective single-center cohort study of all CD patients who commenced anti-TNF therapy (either adalimumab or infliximab) from January 1, 2010 to December 31, 2015. Remission was defined as a C-reactive protein (CRP) < 5 mg/L at 12 mo after anti-TNF commencement. Three supervised learning algorithms were compared: (1) A conventional statistical learning algorithm using multivariable logistic regression on baseline data only; (2) A deep learning algorithm using a feed-forward artificial neural network on baseline data only; and (3) A deep learning algorithm using a recurrent neural network on repeated data. Predictive performance was assessed using area under the receiver operator characteristic curve (AUC) after 10× repeated 5-fold cross-validation.

RESULTS

A total of 146 patients were included (median age 36 years, 48% male). Concomitant therapy at anti-TNF commencement included thiopurines (68%), methotrexate (18%), corticosteroids (44%) and aminosalicylates (33%). After 12 mo, 64% had CRP < 5 mg/L. The conventional learning algorithm selected the following baseline variables for the predictive model: Complex disease behavior, albumin, monocytes, lymphocytes, mean corpuscular hemoglobin concentration and gamma-glutamyl transferase, and had a cross-validated AUC of 0.659, 95% confidence interval (CI): 0.562-0.756. A feed-forward artificial neural network using only baseline data demonstrated an AUC of 0.710 (95%CI: 0.622-0.799; P = 0.25 vs conventional). A recurrent neural network using repeated biomarker measurements demonstrated significantly higher AUC compared to the conventional algorithm (0.754, 95%CI: 0.674-0.834; P = 0.036).

CONCLUSION

Deep learning methods are feasible and have the potential for stronger predictive performance compared to conventional model building methods when applied to predicting remission after anti-TNF therapy in CD.

Deep learning for diagnosis of precancerous lesions in upper gastrointestinal endoscopy: A review

Upper gastrointestinal (GI) cancers are the leading cause of cancer-related deaths worldwide. Early identification of precancerous lesions has been shown to minimize the incidence of GI cancers and substantiate the vital role of screening endoscopy. However, unlike GI cancers, precancerous lesions in the upper GI tract can be subtle and difficult to detect. Artificial intelligence techniques, especially deep learning algorithms with convolutional neural networks, might help endoscopists identify the precancerous lesions and reduce interobserver variability. In this review, a systematic literature search was undertaken of the Web of Science, PubMed, Cochrane Library and Embase, with an emphasis on the deep learning-based diagnosis of precancerous lesions in the upper GI tract. The status of deep learning algorithms in upper GI precancerous lesions has been systematically summarized. The challenges and recommendations targeting this field are comprehensively analyzed for future research.