Artificial Intelligence in Endoscopy

Artificial Intelligence in Colorectal Cancer: From Patient Screening over Tailoring Treatment Decisions to Identification of Novel Biomarkers

BACKGROUND

Artificial intelligence (AI) is increasingly entering and transforming not only medical research but also clinical practice. In the last 10 years, new AI methods have enabled computers to perform visual tasks, reaching high performance and thereby potentially supporting and even outperforming human experts. This is in particular relevant for colorectal cancer (CRC), which is the 3rd most common cancer type in general, as along the CRC patient journey many complex visual tasks need to be performed: from endoscopy over imaging to histopathology; the screening, diagnosis, and treatment of CRC involve visual image analysis tasks.

SUMMARY

In all these clinical areas, AI models have shown promising results by supporting physicians, improving accuracy, and providing new biological insights and biomarkers. By predicting prognostic and predictive biomarkers from routine images/slides, AI models could lead to an improved patient stratification for precision oncology approaches in the near future. Moreover, it is conceivable that AI models, in particular together with innovative techniques such as single-cell or spatial profiling, could help identify novel clinically as well as biologically meaningful biomarkers that could pave the way to new therapeutic approaches.

KEY MESSAGES

Here, we give a comprehensive overview of AI in colorectal cancer, describing and discussing these developments as well as the next steps which need to be taken to incorporate AI methods more broadly into the clinical care of CRC.

Artificial intelligence-assisted ultrasound imaging in hemophilia: research, development, and evaluation of hemarthrosis and synovitis detection

Background

Joint bleeding can lead to synovitis and arthropathy in people with hemophilia, reducing quality of life. Although early diagnosis is associated with improved therapeutic outcomes, diagnostic ultrasonography requires specialist experience. Artificial intelligence (AI) algorithms may support ultrasonography diagnoses.

Objectives

This study will research, develop, and evaluate the diagnostic precision of an AI algorithm for detecting the presence or absence of hemarthrosis and synovitis in people with hemophilia.

Methods

Elbow, knee, and ankle ultrasound images were obtained from people with hemophilia from January 2010 to March 2022. The images were used to train and test the AI models to estimate the presence/absence of hemarthrosis and synovitis. The primary endpoint was the area under the curve for the diagnostic precision to diagnose hemarthrosis and synovitis. Other endpoints were the rate of accuracy, precision, sensitivity, and specificity.

Results

Out of 5649 images collected, 3435 were used for analysis. The area under the curve for hemarthrosis detection for the elbow, knee, and ankle joints was ≥0.87 and for synovitis, it was ≥0.90. The accuracy and precision for hemarthrosis detection were ≥0.74 and ≥0.67, respectively, and those for synovitis were ≥0.83 and ≥0.74, respectively. Analysis across people with hemophilia aged 10 to 60 years showed consistent results.

Conclusion

AI models have the potential to aid diagnosis and enable earlier therapeutic interventions, helping people with hemophilia achieve healthy and active lives. Although AI models show potential in diagnosis, evidence is unclear on required control for abnormal findings. Long-term observation is crucial for assessing impact on joint health.

Application of artificial intelligence in gastrointestinal endoscopy

Endoscopy is an important method for diagnosing gastrointestinal (GI) diseases. In this study, we provide an overview of the advances in artificial intelligence (AI) technology in the field of GI endoscopy over recent years, including esophagus, stomach, large intestine, and capsule endoscopy (small intestine). AI-assisted endoscopy shows high accuracy, sensitivity, and specificity in the detection and diagnosis of GI diseases at all levels. Hence, AI will make a breakthrough in the field of GI endoscopy in the near future. However, AI technology currently has some limitations and is still in the preclinical stages.

Using deep learning and explainable artificial intelligence to assess the severity of gastroesophageal reflux disease according to the Los Angeles Classification System

OBJECTIVES

Gastroesophageal reflux disease (GERD) is a complex disease with a high worldwide prevalence. The Los Angeles classification (LA-grade) system is meaningful for assessing the endoscopic severity of GERD. Deep learning (DL) methods have been widely used in the field of endoscopy. However, few DL-assisted researches have concentrated on the diagnosis of GERD. This study is the first to develop a five-category classification DL model based on the LA-grade using explainable artificial intelligence (XAI).

MATERIALS AND METHODS

A total of 2081 endoscopic images were used for the development of a DL model, and the classification accuracy of the models and endoscopists with different levels of experience was compared.

RESULTS

Some mainstream DL models were utilized, of which DenseNet-121 outperformed. The area under the curve (AUC) of the DenseNet-121 was 0.968, and its classification accuracy (86.7%) was significantly higher than that of junior (71.5%) and experienced (77.4%) endoscopists. An XAI evaluation was also performed to explore the perception consistency between the DL model and endoscopists, which showed meaningful results for real-world applications.

CONCLUSIONS

The DL model showed a potential in improving the accuracy of endoscopists in LA-grading of GERD, and it has noticeable clinical application prospects and is worthy of further promotion.

Effects of ai-assisted colonoscopy on adenoma miss rate/adenoma detection rate: A protocol for systematic review and meta-analysis

BACKGROUND

Colonoscopy can detect colorectal adenomas and reduce the incidence of colorectal cancer, but there are still many missing diagnoses. Artificial intelligence-assisted colonoscopy (AIAC) can effectively reduce the rate of missed diagnosis and improve the detection rate of adenoma, but its clinical application is still unclear. This systematic review and meta-analysis assessed the adenoma missed detection rate (AMR) and the adenoma detection rate (ADR) by artificial colonoscopy.

METHODS

Conduct a comprehensive literature search using the PubMed, Medline database, Embase, and the Cochrane Library. This meta-analysis followed the direction of the preferred reporting items for systematic reviews and meta-analyses, the preferred reporting item for systematic review and meta-analysis. The random effect model was used for meta-analysis.

RESULTS

A total of 12 articles were eventually included in the study. Computer aided detection (CADe) significantly decreased AMR compared with the control group (137/1039, 13.2% vs 304/1054, 28.8%; OR,0.39; 95% CI, 0.26-0.59; P < .05). Similarly, there was statistically significant difference in ADR between the CADe group and control group, respectively (1835/5041, 36.4% vs 1309/4553, 28.7%; OR, 1.54; 95% CI, 1.39-1.71; P < .05). The advanced adenomas missed rate and detection rate in CADe group was not statistically significant when compared with the control group.

CONCLUSIONS

AIAC can effectively reduce AMR and improve ADR, especially small adenomas. Therefore, this method is worthy of clinical application. However, due to the limitations of the number and quality of the included studies, more in-depth studies are needed in the field of AIAC in the future.

Innovations in GI-endoscopy

Gastrointestinal endoscopy covers both diagnosis and therapy. Due to its diagnostic accuracy and minimal invasiveness, several innovations have been made within the last years including artificial intelligence and endoscopic tumor resection. The present review highlights some of these innovation. In addition, a special focus is set on the experience made by our own research group trying to combine the expertise of endoscopists/ physicians as well as engineers and computer scientists.

Artificial intelligence applications in gastroenterology: steps ahead

Artificial intelligence (AI) applications are used in gastroenterology for automatic imaging diagnostic methods such as ultrasonography, computer tomography, magnetic resonance imaging, but also in endoscopy, capsule endoscopy and biopsy followed by automatic digital pathology evaluation. The accuracy of AI-based systems is superior to human expertise. Furthermore, in reality, a very small percentage of the patients are being investigated by a human expert in endoscopy, so implementing AI in this investigation would only increase the diagnostic accuracy. The existence of an unimaginable number of digital images and different types of medical information made possible the analysis and training of convolutional neural network (CNN), which consists of multilayers of artificial neural networks (ANN) with step-by-step minimal processing, creating a fundamental resource for any AI-based system to learn by itself how to automatically perform medical tasks, which were performed only by human experts in the past. The main objectives for AI applications used in gastroenterology are to improve the medical procedures with enhanced precision, to reduce the number of medical errors and to perform repetitive tasks.