In vivo computer-aided diagnosis of colorectal polyps using white light endoscopy

Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challenge

Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, appearance, and location makes the detection of polyps challenging. Moreover, colonoscopy surveillance and removal of polyps are highly operator-dependent procedures and occur in a highly complex organ topology. There exists a high missed detection rate and incomplete removal of colonic polyps. To assist in clinical procedures and reduce missed rates, automated methods for detecting and segmenting polyps using machine learning have been achieved in past years. However, the major drawback in most of these methods is their ability to generalise to out-of-sample unseen datasets from different centres, populations, modalities, and acquisition systems. To test this hypothesis rigorously, we, together with expert gastroenterologists, curated a multi-centre and multi-population dataset acquired from six different colonoscopy systems and challenged the computational expert teams to develop robust automated detection and segmentation methods in a crowd-sourcing Endoscopic computer vision challenge. This work put forward rigorous generalisability tests and assesses the usability of devised deep learning methods in dynamic and actual clinical colonoscopy procedures. We analyse the results of four top performing teams for the detection task and five top performing teams for the segmentation task. Our analyses demonstrate that the top-ranking teams concentrated mainly on accuracy over the real-time performance required for clinical applicability. We further dissect the devised methods and provide an experiment-based hypothesis that reveals the need for improved generalisability to tackle diversity present in multi-centre datasets and routine clinical procedures.

Accuracy of polyp characterization by artificial intelligence and endoscopists: a prospective, non-randomized study in a tertiary endoscopy center

Background and study aims Artificial intelligence (AI) in gastrointestinal endoscopy is developing very fast. Computer-aided detection of polyps and computer-aided diagnosis (CADx) for polyp characterization are available now. This study was performed to evaluate the diagnostic performance of a new commercially available CADx system in clinical practice. Patients and methods This prospective, non-randomized study was performed at a tertiary academic endoscopy center from March to August 2022. We included patients receiving a colonoscopy. Polypectomy had to be performed in all polyps. Every patient was examined concurrently by an endoscopist and AI using two opposing screens. The AI system, overseen by a second observer, was not visible to the endoscopist. The primary outcome was accuracy of the AI classifying the polyps into "neoplastic" and "non-neoplastic." The secondary outcome was accuracy of the classification by the endoscopists. Sessile serrated lesions were classified as neoplastic. Results We included 156 patients (mean age 65; 57 women) with 262 polyps ≤10 mm. Eighty-four were hyperplastic polyps (32.1%), 158 adenomas (60.3%), seven sessile serrated lesions (2.7%) and 13 other entities (normal/inflammatory colonmucosa, lymphoidic polyp) (4.9%) on histological diagnosis. Sensitivity, specificity and accuracy of AI were 89.70% (95% confidence interval [CI]: 84.02%-93.88%), 75.26% (95% CI: 65.46%-83.46%) and 84.35% (95% CI:79.38%-88.53%), respectively. Sensitivity, specificity and accuracy for less experienced endoscopists (2-5 years of endoscopy) were 95.56% (95% CI: 84.85%-99.46%), 61.54% (95% CI: 40.57%-79.77%) and 83.10% (95% CI: 72.34%-90.95%) and for experienced endoscopists 90.83% (95% CI: 84.19%-95.33%), 71.83% (95% CI: 59.90%-81.87%) and 83.77% (95% CI: 77.76%-88.70%), respectively. Conclusion Accuracy for polyp characterization by a new commercially available AI system is high, but does not fulfill the criteria for a "resect-and-discard" strategy.