Artificial intelligence and computer-aided diagnosis for colonoscopy: where do we stand now?

Bridging the Diagnostic Gap between Histopathologic and Hysteroscopic Chronic Endometritis with Deep Learning Models

Chronic endometritis (CE) is an inflammatory pathologic condition of the uterine mucosa characterized by unusual infiltration of CD138(+) endometrial stromal plasmacytes (ESPCs). CE is often identified in infertile women with unexplained etiology, tubal factors, endometriosis, repeated implantation failure, and recurrent pregnancy loss. Diagnosis of CE has traditionally relied on endometrial biopsy and histopathologic/immunohistochemistrical detection of ESPCs. Endometrial biopsy, however, is a somewhat painful procedure for the subjects and does not allow us to grasp the whole picture of this mucosal tissue. Meanwhile, fluid hysteroscopy has been recently adopted as a less-invasive diagnostic modality for CE. We launched the ARCHIPELAGO (ARChival Hysteroscopic Image-based Prediction for histopathologic chronic Endometritis in infertile women using deep LeArninG mOdel) study to construct the hysteroscopic CE finding-based prediction tools for histopathologic CE. The development of these deep learning-based novel models and computer-aided detection/diagnosis systems potentially benefits infertile women suffering from this elusive disease.

Image enhanced colonoscopy: updates and prospects-a review

Colonoscopy has been proven to be a successful approach in both identifying and preventing colorectal cancer. The incorporation of advanced imaging technologies, such as image-enhanced endoscopy (IEE), plays a vital role in real-time diagnosis. The advancements in endoscopic imaging technology have been continuous, from replacing fiber optics with charge-coupled devices to the introduction of chromoendoscopy in the 1970s. Recent technological advancements include "push-button" technologies like autofluorescence imaging (AFI), narrowed-spectrum endoscopy, and confocal laser endomicroscopy (CLE). Dye-based chromoendoscopy (DCE) is falling out of favor due to the longer time required for application and removal of the dye and the difficulty of identifying lesions in certain situations. Narrow band imaging (NBI) is a technology that filters the light used for illumination leading to improved contrast and better visibility of structures on the mucosal surface and has shown a consistently higher adenoma detection rate (ADR) compared to white light endoscopy. CLE has high sensitivity and specificity for polyp detection and characterization, and several classifications have been developed for accurate identification of normal, regenerative, and dysplastic epithelium. Other IEE technologies, such as blue laser imaging (BLI), linked-color imaging (LCI), i-SCAN, and AFI, have also shown promise in improving ADR and characterizing polyps. New technologies, such as Optivista, red dichromatic imaging (RDI), texture and color enhancement imaging (TXI), and computer-aided detection (CAD) using artificial intelligence (AI), are being developed to improve polyp detection and pathology prediction prior to widespread use in clinical practice.

The Impacts of Computer-Aided Detection of Colorectal Polyps on Subsequent Colonoscopy Surveillance Intervals: Simulation Study

BACKGROUND

Computer-aided detection (CADe) of colorectal polyps has been shown to increase adenoma detection rates, which would potentially shorten subsequent surveillance intervals.

OBJECTIVE

The purpose of this study is to simulate the potential changes in subsequent colonoscopy surveillance intervals after the application of CADe in a large cohort of patients.

METHODS

We simulated the projected increase in polyp and adenoma detection by universal CADe application in our patients who had undergone colonoscopy with complete endoscopic and histological findings between 2016 and 2020. The simulation was based on bootstrapping the published performance of CADe. The corresponding changes in surveillance intervals for each patient, as recommended by the US Multi-Society Task Force on Colorectal Cancer (USMSTF) or the European Society of Gastrointestinal Endoscopy (ESGE), were determined after the CADe was determined.

RESULTS

A total of 3735 patients who had undergone colonoscopy were included. Based on the simulated CADe effect, the application of CADe would result in 19.1% (n=714) and 1.9% (n=71) of patients having shorter surveillance intervals, according to the USMSTF and ESGE guidelines, respectively. In particular, all (or 2.7% (n=101) of the total) patients who were originally scheduled to have 3-5 years of surveillance would have their surveillance intervals shortened to 3 years, following the USMSTF guidelines. The changes in this group of patients were largely attributed to an increase in the number of adenomas (n=75, 74%) rather than serrated lesions being detected.

CONCLUSIONS

Widespread adoption of CADe would inevitably increase the demand for surveillance colonoscopies with the shortening of original surveillance intervals, particularly following the current USMSTF guideline.

Experimental evidence of effective human-AI collaboration in medical decision-making

Artificial Intelligence (AI) systems are precious support for decision-making, with many applications also in the medical domain. The interaction between MDs and AI enjoys a renewed interest following the increased possibilities of deep learning devices. However, we still have limited evidence-based knowledge of the context, design, and psychological mechanisms that craft an optimal human-AI collaboration. In this multicentric study, 21 endoscopists reviewed 504 videos of lesions prospectively acquired from real colonoscopies. They were asked to provide an optical diagnosis with and without the assistance of an AI support system. Endoscopists were influenced by AI ([Formula: see text]), but not erratically: they followed the AI advice more when it was correct ([Formula: see text]) than incorrect ([Formula: see text]). Endoscopists achieved this outcome through a weighted integration of their and the AI opinions, considering the case-by-case estimations of the two reliabilities. This Bayesian-like rational behavior allowed the human-AI hybrid team to outperform both agents taken alone. We discuss the features of the human-AI interaction that determined this favorable outcome.

Videomics of the Upper Aero-Digestive Tract Cancer: Deep Learning Applied to White Light and Narrow Band Imaging for Automatic Segmentation of Endoscopic Images

Introduction

Narrow Band Imaging (NBI) is an endoscopic visualization technique useful for upper aero-digestive tract (UADT) cancer detection and margins evaluation. However, NBI analysis is strongly operator-dependent and requires high expertise, thus limiting its wider implementation. Recently, artificial intelligence (AI) has demonstrated potential for applications in UADT videoendoscopy. Among AI methods, deep learning algorithms, and especially convolutional neural networks (CNNs), are particularly suitable for delineating cancers on videoendoscopy. This study is aimed to develop a CNN for automatic semantic segmentation of UADT cancer on endoscopic images.

Materials and Methods

A dataset of white light and NBI videoframes of laryngeal squamous cell carcinoma (LSCC) was collected and manually annotated. A novel DL segmentation model (SegMENT) was designed. SegMENT relies on DeepLabV3+ CNN architecture, modified using Xception as a backbone and incorporating ensemble features from other CNNs. The performance of SegMENT was compared to state-of-the-art CNNs (UNet, ResUNet, and DeepLabv3). SegMENT was then validated on two external datasets of NBI images of oropharyngeal (OPSCC) and oral cavity SCC (OSCC) obtained from a previously published study. The impact of in-domain transfer learning through an ensemble technique was evaluated on the external datasets.

Results

219 LSCC patients were retrospectively included in the study. A total of 683 videoframes composed the LSCC dataset, while the external validation cohorts of OPSCC and OCSCC contained 116 and 102 images. On the LSCC dataset, SegMENT outperformed the other DL models, obtaining the following median values: 0.68 intersection over union (IoU), 0.81 dice similarity coefficient (DSC), 0.95 recall, 0.78 precision, 0.97 accuracy. For the OCSCC and OPSCC datasets, results were superior compared to previously published data: the median performance metrics were, respectively, improved as follows: DSC=10.3% and 11.9%, recall=15.0% and 5.1%, precision=17.0% and 14.7%, accuracy=4.1% and 10.3%.

Conclusion

SegMENT achieved promising performances, showing that automatic tumor segmentation in endoscopic images is feasible even within the highly heterogeneous and complex UADT environment. SegMENT outperformed the previously published results on the external validation cohorts. The model demonstrated potential for improved detection of early tumors, more precise biopsies, and better selection of resection margins.