Current status and future perspective on artificial intelligence for lower endoscopy

Practical utility of linked color imaging in colonoscopy: Updated literature review

The remarkable recent developments in image-enhanced endoscopy (IEE) have significantly contributed to the advancement of diagnostic techniques. Linked color imaging (LCI) is an IEE technique in which color differences are expanded by processing image data to enhance short-wavelength narrow-band light. This feature of LCI causes reddish areas to appear redder and whitish areas to appear whiter. Because most colorectal lesions, such as neoplastic and inflammatory lesions, have a reddish tone, LCI is an effective tool for identifying colorectal lesions by clarifying the redder areas and distinguishing them from the surrounding normal mucosa. To date, eight randomized controlled trials have been conducted to evaluate the effectiveness of LCI in identifying colorectal adenomatous lesions. The results of a meta-analysis integrating these studies demonstrated that LCI was superior to white-light endoscopy for detecting colorectal adenomatous lesions. LCI also improves the detection of serrated lesions by enhancing their whiteness. Furthermore, accumulating evidence suggests that LCI is superior to white-light endoscopy for the diagnosis of the colonic mucosa in patients with ulcerative colitis. In this review, based on a comprehensive search of the current literature since the implementation of LCI, the utility of LCI in the detection and diagnosis of colorectal lesions is discussed. Additionally, the latest data, including attempts to combine artificial intelligence and LCI, are presented.

Artificial Intelligence-assisted colonoscopy and colorectal cancer screening: Where are we going?

Colorectal cancer is a significant global health concern, necessitating effective screening strategies to reduce its incidence and mortality rates. Colonoscopy plays a crucial role in the detection and removal of colorectal neoplastic precursors. However, there are limitations and variations in the performance of endoscopists, leading to missed lesions and suboptimal outcomes. The emergence of artificial intelligence (AI) in endoscopy offers promising opportunities to improve the quality and efficacy of screening colonoscopies. In particular, AI applications, including computer-aided detection (CADe) and computer-aided characterization (CADx), have demonstrated the potential to enhance adenoma detection and optical diagnosis accuracy. Additionally, AI-assisted quality control systems aim to standardize the endoscopic examination process. This narrative review provides an overview of AI principles and discusses the current knowledge on AI-assisted endoscopy in the context of screening colonoscopies. It highlights the significant role of AI in improving lesion detection, characterization, and quality assurance during colonoscopy. However, further well-designed studies are needed to validate the clinical impact and cost-effectiveness of AI-assisted colonoscopy before its widespread implementation.

Evaluating false-positive detection in a computer-aided detection system for colonoscopy

BACKGROUND AND AIM

Computer-aided detection (CADe) systems can efficiently detect polyps during colonoscopy. However, false-positive (FP) activation is a major limitation of CADe. We aimed to compare the rate and causes of FP using CADe before and after an update designed to reduce FP.

METHODS

We analyzed CADe-assisted colonoscopy videos recorded between July 2022 and October 2022. The number and causes of FPs and excessive time spent by the endoscopist on FP (ET) were compared pre- and post-update using 1:1 propensity score matching.

RESULTS

During the study period, 191 colonoscopy videos (94 and 97 in the pre- and post-update groups, respectively) were recorded. Propensity score matching resulted in 146 videos (73 in each group). The mean number of FPs and median ET per colonoscopy were significantly lower in the post-update group than those in the pre-update group (4.2 ± 3.7 vs 18.1 ± 11.1; P < 0.001 and 0 vs 16 s; P < 0.001, respectively). Mucosal tags, bubbles, and folds had the strongest association with decreased FP post-update (pre-update vs post-update: 4.3 ± 3.6 vs 0.4 ± 0.8, 0.32 ± 0.70 vs 0.04 ± 0.20, and 8.6 ± 6.7 vs 1.6 ± 1.7, respectively). There was no significant decrease in the true positive rate (post-update vs pre-update: 95.0% vs 99.2%; P = 0.09) or the adenoma detection rate (post-update vs pre-update: 52.1% vs 49.3%; P = 0.87).

CONCLUSIONS

The updated CADe can reduce FP without impairing polyp detection. A reduction in FP may help relieve the burden on endoscopists.

Impact of computer-aided characterization for diagnosis of colorectal lesions, including sessile serrated lesions: Multireader, multicase study

OBJECTIVES

Computer-aided characterization (CADx) may be used to implement optical biopsy strategies into colonoscopy practice; however, its impact on endoscopic diagnosis remains unknown. We aimed to evaluate the additional diagnostic value of CADx when used by endoscopists for assessing colorectal polyps.

METHODS

This was a single-center, multicase, multireader, image-reading study using randomly extracted images of pathologically confirmed polyps resected between July 2021 and January 2022. Approved CADx that could predict two-tier classification (neoplastic or nonneoplastic) by analyzing narrow-band images of the polyps was used to obtain a CADx diagnosis. Participating endoscopists determined if the polyps were neoplastic or not and noted their confidence level using a computer-based, image-reading test. The test was conducted twice with a 4-week interval: the first test was conducted without CADx prediction and the second test with CADx prediction. Diagnostic performances for neoplasms were calculated using the pathological diagnosis as reference and performances with and without CADx prediction were compared.

RESULTS

Five hundred polyps were randomly extracted from 385 patients and diagnosed by 14 endoscopists (including seven experts). The sensitivity for neoplasia was significantly improved by referring to CADx (89.4% vs. 95.6%). CADx also had incremental effects on the negative predictive value (69.3% vs. 84.3%), overall accuracy (87.2% vs. 91.8%), and high-confidence diagnosis rate (77.4% vs. 85.8%). However, there was no significant difference in specificity (80.1% vs. 78.9%).

CONCLUSIONS

Computer-aided characterization has added diagnostic value for differentiating colorectal neoplasms and may improve the high-confidence diagnosis rate.

Monocular endoscopy images depth estimation with multi-scale residual fusion

BACKGROUND

Monocular depth estimation plays a fundamental role in clinical endoscopy surgery. However, the coherent illumination, smooth surfaces, and texture-less nature of endoscopy images present significant challenges to traditional depth estimation methods. Existing approaches struggle to accurately perceive depth in such settings.

METHOD

To overcome these challenges, this paper proposes a novel multi-scale residual fusion method for estimating the depth of monocular endoscopy images. Specifically, we address the issue of coherent illumination by leveraging image frequency domain component space transformation, thereby enhancing the stability of the scene's light source. Moreover, we employ an image radiation intensity attenuation model to estimate the initial depth map. Finally, to refine the accuracy of depth estimation, we utilize a multi-scale residual fusion optimization technique.

RESULTS

To evaluate the performance of our proposed method, extensive experiments were conducted on public datasets. The structural similarity measures for continuous frames in three distinct clinical data scenes reached impressive values of 0.94, 0.82, and 0.84, respectively. These results demonstrate the effectiveness of our approach in capturing the intricate details of endoscopy images. Furthermore, the depth estimation accuracy achieved remarkable levels of 89.3 % and 91.2 % for the two models' data, respectively, underscoring the robustness of our method.

CONCLUSIONS

Overall, the promising results obtained on public datasets highlight the significant potential of our method for clinical applications, facilitating reliable depth estimation and enhancing the quality of endoscopy surgical procedures.

Care Delivery Interventions for Individuals with Cancer: A Literature Review and Focus on Gastrointestinal Malignancies

BACKGROUND

Gastrointestinal malignancies represent a particularly challenging condition, often requiring a multidisciplinary approach to management in order to meet the unique needs of these individuals and their caregivers.

PURPOSE

In this literature review, we sought to describe care delivery interventions that strive to improve the quality of life and care for patients with a focus on gastrointestinal malignancies.

CONCLUSION

We highlight patient-centered care delivery interventions, including patient-reported outcomes, hospital-at-home interventions, and other models of care for individuals with cancer. By demonstrating the relevance and utility of these different care models for patients with gastrointestinal malignancies, we hope to highlight the importance of developing and testing new interventions to address the unique needs of this population.

Development and validation of a three-dimensional deep learning-based system for assessing bowel preparation on colonoscopy video

Background

The performance of existing image-based training models in evaluating bowel preparation on colonoscopy videos was relatively low, and only a few models used external data to prove their generalization. Therefore, this study attempted to develop a more precise and stable AI system for assessing bowel preparation of colonoscopy video.

Methods

We proposed a system named ViENDO to assess the bowel preparation quality, including two CNNs. First, Information-Net was used to identify and filter out colonoscopy video frames unsuitable for Boston bowel preparation scale (BBPS) scoring. Second, BBPS-Net was trained and tested with 5,566 suitable short video clips through three-dimensional (3D) convolutional neural network (CNN) technology to detect BBPS-based insufficient bowel preparation. Then, ViENDO was applied to complete withdrawal colonoscopy videos from multiple centers to predict BBPS segment scores in clinical settings. We also conducted a human-machine contest to compare its performance with endoscopists.

Results

In video clips, BBPS-Net for determining inadequate bowel preparation generated an area under the curve of up to 0.98 and accuracy of 95.2%. When applied to full-length withdrawal colonoscopy videos, ViENDO assessed bowel cleanliness with an accuracy of 93.8% in the internal test set and 91.7% in the external dataset. The human-machine contest demonstrated that the accuracy of ViENDO was slightly superior compared to most endoscopists, though no statistical significance was found.

Conclusion

The 3D-CNN-based AI model showed good performance in evaluating full-length bowel preparation on colonoscopy video. It has the potential as a substitute for endoscopists to provide BBPS-based assessments during daily clinical practice.

Cost-effectiveness analysis of computer-aided detection systems for colonoscopy in Japan

OBJECTIVES

The usefulness of computer-aided detection systems (CADe) for colonoscopy has been increasingly reported. In many countries, however, data on the cost-effectiveness of their use are lacking; consequently, CADe for colonoscopy has not been covered by health insurance. We aimed to evaluate the cost-effectiveness of colonoscopy using CADe in Japan.

METHODS

We conducted a simulation model analysis using Japanese data to examine the cost-effectiveness of colonoscopy with and without CADe for a population aged 40-74 years who received colorectal cancer (CRC) screening with a fecal immunochemical test (FIT). The rates of receiving FIT screening and colonoscopy following a positive FIT were set as 40% and 70%, respectively. The sensitivities of FIT for advanced adenomas and CRC Dukes' A-D were 26.5% and 52.8-78.3%, respectively. CADe colonoscopy was judged to be cost-effective when its incremental cost-effectiveness ratio (ICER) was below JPY 5,000,000 per quality-adjusted life-years (QALYs) gained.

RESULTS

Compared to conventional colonoscopy, CADe colonoscopy showed a higher QALY (20.4098 vs. 20.4088) and lower CRC incidence (2373 vs. 2415 per 100,000) and mortality (561 vs. 569 per 100,000). When the CADe cost was set at JPY 1000-6000, the ICER per QALY gained for CADe colonoscopy was lower than JPY 5,000,000 (JPY 796,328-4,971,274). The CADe cost threshold at which the ICER for CADe colonoscopy exceeded JPY 5,000,000 was JPY 6040.

CONCLUSIONS

Computer-aided detection systems for colonoscopy has the potential to be cost-effective when the CADe cost is up to JPY 6000. These results suggest that the insurance reimbursement of CADe for colonoscopy is reasonable.

Artificial Intelligence in Pediatric Endoscopy: Current Status and Future Applications

The application of artificial intelligence (AI) has great promise for improving pediatric endoscopy. The majority of preclinical studies have been undertaken in adults, with the greatest progress being made in the context of colorectal cancer screening and surveillance. This development has only been possible with advances in deep learning, like the convolutional neural network model, which has enabled real-time detection of pathology. Comparatively, the majority of deep learning systems developed in inflammatory bowel disease have focused on predicting disease severity and were developed using still images rather than videos. The application of AI to pediatric endoscopy is in its infancy, thus providing an opportunity to develop clinically meaningful and fair systems that do not perpetuate societal biases. In this review, we provide an overview of AI, summarize the advances of AI in endoscopy, and describe its potential application to pediatric endoscopic practice and education.

Comprehensive review of publicly available colonoscopic imaging databases for artificial intelligence research: availability, accessibility, and usability

BACKGROUND AND AIMS

Publicly available databases containing colonoscopic imaging data are valuable resources for artificial intelligence (AI) research. Currently, little is known regarding the available number and content of these databases. This review aimed to describe the availability, accessibility, and usability of publicly available colonoscopic imaging databases, focusing on polyp detection, polyp characterization, and quality of colonoscopy.

METHODS

A systematic literature search was performed in MEDLINE and Embase to identify AI studies describing publicly available colonoscopic imaging databases published after 2010. Second, a targeted search using Google's Dataset Search, Google Search, GitHub, and Figshare was done to identify databases directly. Databases were included if they contained data about polyp detection, polyp characterization, or quality of colonoscopy. To assess accessibility of databases, the following categories were defined: open access, open access with barriers, and regulated access. To assess the potential usability of the included databases, essential details of each database were extracted using a checklist derived from the Checklist for Artificial Intelligence in Medical Imaging.

RESULTS

We identified 22 databases with open access, 3 databases with open access with barriers, and 15 databases with regulated access. The 22 open access databases contained 19,463 images and 952 videos. Nineteen of these databases focused on polyp detection, localization, and/or segmentation; 6 on polyp characterization, and 3 on quality of colonoscopy. Only half of these databases have been used by other researcher to develop, train, or benchmark their AI system. Although technical details were in general well reported, important details such as polyp and patient demographics and the annotation process were under-reported in almost all databases.

CONCLUSIONS

This review provides greater insight on public availability of colonoscopic imaging databases for AI research. Incomplete reporting of important details limits the ability of researchers to assess the usability of current databases.

Investigation of trends in gut microbiome associated with colorectal cancer using machine learning

Background

The rapid growth of publications on the gut microbiome and colorectal cancer (CRC) makes it feasible for text mining and bibliometric analysis.

Methods

Publications were retrieved from the Web of Science. Bioinformatics analysis was performed, and a machine learning-based Latent Dirichlet Allocation (LDA) model was used to identify the subfield research topics.

Results

A total of 5,696 publications related to the gut microbiome and CRC were retrieved from the Web of Science Core Collection from 2000 to 2022. China and the USA were the most productive countries. The top 25 references, institutions, and authors with the strongest citation bursts were identified. Abstracts from all 5,696 publications were extracted for a text mining analysis that identified the top 50 topics in this field with increasing interest. The colitis animal model, expression of cytokines, microbiome sequencing and 16s, microbiome composition and dysbiosis, and cell growth inhibition were increasingly noticed during the last two years. The 50 most intensively investigated topics were identified and further categorized into four clusters, including "microbiome sequencing and tumor," "microbiome compositions, interactions, and treatment," "microbiome molecular features and mechanisms," and "microbiome and metabolism."

Conclusion

This bibliometric analysis explores the historical research tendencies in the gut microbiome and CRC and identifies specific topics of increasing interest. The developmental trajectory, along with the noticeable research topics characterized by this analysis, will contribute to the future direction of research in CRC and its clinical translation.

Where do we stand in AI for endoscopic image analysis? Deciphering gaps and future directions

Recent developments in deep learning have enabled data-driven algorithms that can reach human-level performance and beyond. The development and deployment of medical image analysis methods have several challenges, including data heterogeneity due to population diversity and different device manufacturers. In addition, more input from experts is required for a reliable method development process. While the exponential growth in clinical imaging data has enabled deep learning to flourish, data heterogeneity, multi-modality, and rare or inconspicuous disease cases still need to be explored. Endoscopy being highly operator-dependent with grim clinical outcomes in some disease cases, reliable and accurate automated system guidance can improve patient care. Most designed methods must be more generalisable to the unseen target data, patient population variability, and variable disease appearances. The paper reviews recent works on endoscopic image analysis with artificial intelligence (AI) and emphasises the current unmatched needs in this field. Finally, it outlines the future directions for clinically relevant complex AI solutions to improve patient outcomes.

Computer-aided classification of colorectal segments during colonoscopy: a deep learning approach based on images of a magnetic endoscopic positioning device

OBJECTIVE

Assessment of the anatomical colorectal segment of polyps during colonoscopy is important for treatment and follow-up strategies, but is largely operator dependent. This feasibility study aimed to assess whether, using images of a magnetic endoscope imaging (MEI) positioning device, a deep learning approach can be useful to objectively divide the colorectum into anatomical segments.

METHODS

Models based on the VGG-16 based convolutional neural network architecture were developed to classify the colorectum into anatomical segments. These models were pre-trained on ImageNet data and further trained using prospectively collected data of the POLAR study in which endoscopists were using MEI (3930 still images and 90,151 video frames). Five-fold cross validation with multiple runs was used to evaluate the overall diagnostic accuracies of the models for colorectal segment classification (divided into a 5-class and 2-class colorectal segment division). The colorectal segment assignment by endoscopists was used as the reference standard.

RESULTS

For the 5-class colorectal segment division, the best performing model correctly classified the colorectal segment in 753 of the 1196 polyps, corresponding to an overall accuracy of 63%, sensitivity of 63%, specificity of 89% and kappa of 0.47. For the 2-class colorectal segment division, 1112 of the 1196 polyps were correctly classified, corresponding to an accuracy of 93%, sensitivity of 93%, specificity of 90% and kappa of 0.82.

CONCLUSION

The diagnostic performance of a deep learning approach for colorectal segment classification based on images of a MEI device is yet suboptimal (clinicaltrials.gov: NCT03822390).

Use of advanced endoscopic technology for optical characterization of neoplasia in patients with ulcerative colitis: Systematic review

OBJECTIVES

Advances in endoscopic technology, including magnifying and image-enhanced techniques, have been attracting increasing attention for the optical characterization of colorectal lesions. These techniques are being implemented into clinical practice as cost-effective and real-time approaches. Additionally, with the recent progress in endoscopic interventions, endoscopic resection is gaining acceptance as a treatment option in patients with ulcerative colitis (UC). Therefore, accurate preoperative characterization of lesions is now required. However, lesion characterization in patients with UC may be difficult because UC is often affected by inflammation, and it may be characterized by a distinct "bottom-up" growth pattern, and even expert endoscopists have relatively little experience with such cases. In this systematic review, we assessed the current status and limitations of the use of optical characterization of lesions in patients with UC.

METHODS

A literature search of online databases (MEDLINE via PubMed and CENTRAL via the Cochrane Library) was performed from 1 January 2000 to 30 November 2021.

RESULTS

The database search initially identified 748 unique articles. Finally, 25 studies were included in the systematic review: 23 focused on differentiation of neoplasia from non-neoplasia, one focused on differentiation of UC-associated neoplasia from sporadic neoplasia, and one focused on differentiation of low-grade dysplasia from high-grade dysplasia and cancer.

CONCLUSIONS

Optical characterization of neoplasia in patients with UC, even using advanced endoscopic technology, is still challenging and several issues remain to be addressed. We believe that the information revealed in this review will encourage researchers to commit to the improvement of optical diagnostics for UC-associated lesions.

Multi-step validation of a deep learning-based system for the quantification of bowel preparation: a prospective, observational study

BACKGROUND

Inadequate bowel preparation is associated with a decrease in adenoma detection rate (ADR). A deep learning-based bowel preparation assessment system based on the Boston bowel preparation scale (BBPS) has been previously established to calculate the automatic BBPS (e-BBPS) score (ranging 0-20). The aims of this study were to investigate whether there was a statistically inverse relationship between the e-BBPS score and the ADR, and to determine the threshold of e-BBPS score for adequate bowel preparation in colonoscopy screening.

METHODS

In this prospective, observational study, we trained and internally validated the e-BBPS system using retrospective colonoscopy images and videos from the Endoscopy Center of Wuhan University, annotated by endoscopists. We externally validated the system using colonoscopy images and videos from the First People's Hospital of Yichang and the Third Hospital of Wuhan. To prospectively validate the system, we recruited consecutive patients at Renmin Hospital of Wuhan University aged between 18 and 75 years undergoing colonoscopy. The exclusion criteria included: contraindication to colonoscopy, family polyposis syndrome, inflammatory bowel disease, history of surgery for colorectal or colorectal cancer, known or suspected bowel obstruction or perforation, patients who were pregnant or lactating, inability to receive caecal intubation, and lumen obstruction. We did colonoscopy procedures and collected withdrawal videos, which were reviewed and the e-BBPS system was applied to all colon segments. The primary outcome of this study was ADR, defined as the proportion of patients with one or more conventional adenomas detected during colonoscopy. We calculated the ADR of each e-BBPS score and did a correlation analysis using Spearman analysis.

FINDINGS

From May 11 to Aug 10, 2020, 616 patients underwent screening colonoscopies, which evaluated. There was a significant inverse correlation between the e-BBPS score and ADR (Spearman's rank -0·976, p<0·010). The ADR for the e-BBPS scores 1-8 was 28·57%, 28·68%, 26·79%, 19·19%, 17·57%, 17·07%, 14·81%, and 0%, respectively. According to the 25% ADR standard for screening colonoscopy, an e-BBPS score of 3 was set as a threshold to guarantee an ADR of more than 25%, and so high-quality endoscopy. Patients with scores of more than 3 had a significantly lower ADR than those with a score of 3 or less (ADR 15·93% vs 28·03%, p<0·001, 95% CI 0·28-0·66, odds ratio 0·43).

INTERPRETATION

The e-BBPS system has potential to provide a more objective and refined threshold for the quantification of adequate bowel preparation.

FUNDING

Project of Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision and Hubei Province Major Science and Technology Innovation Project.