Optical diagnosis of colorectal polyps using convolutional neural networks

Role of artificial intelligence in colorectal cancer

The sphere of artificial intelligence (AI) is ever expanding. Applications for clinical practice have been emerging over recent years. Although its uptake has been most prominent in endoscopy, this represents only one aspect of holistic patient care. There are a multitude of other potential avenues in which gastrointestinal care may be involved. We aim to review the role of AI in colorectal cancer as a whole. We performed broad scoping and focused searches of the applications of AI in the field of colorectal cancer. All trials including qualitative research were included from the year 2000 onwards. Studies were grouped into pre-operative, intra-operative and post-operative aspects. Pre-operatively, the major use is with endoscopic recognition. Colonoscopy has embraced the use for human derived classifications such as Narrow-band Imaging International Colorectal Endoscopic, Japan Narrow-band Imaging Expert Team, Paris and Kudo. However, novel detection and diagnostic methods have arisen from advances in AI classification. Intra-operatively, adjuncts such as image enhanced identification of structures and assessment of perfusion have led to improvements in clinical outcomes. Post-operatively, monitoring and surveillance have taken strides with potential socioeconomic and environmental savings. The uses of AI within the umbrella of colorectal surgery are multiple. We have identified existing technologies which are already augmenting cancer care. The future applications are exciting and could at least match, if not surpass human standards.

Accuracy of polyp characterization by artificial intelligence and endoscopists: a prospective, non-randomized study in a tertiary endoscopy center

Background and study aims Artificial intelligence (AI) in gastrointestinal endoscopy is developing very fast. Computer-aided detection of polyps and computer-aided diagnosis (CADx) for polyp characterization are available now. This study was performed to evaluate the diagnostic performance of a new commercially available CADx system in clinical practice. Patients and methods This prospective, non-randomized study was performed at a tertiary academic endoscopy center from March to August 2022. We included patients receiving a colonoscopy. Polypectomy had to be performed in all polyps. Every patient was examined concurrently by an endoscopist and AI using two opposing screens. The AI system, overseen by a second observer, was not visible to the endoscopist. The primary outcome was accuracy of the AI classifying the polyps into "neoplastic" and "non-neoplastic." The secondary outcome was accuracy of the classification by the endoscopists. Sessile serrated lesions were classified as neoplastic. Results We included 156 patients (mean age 65; 57 women) with 262 polyps ≤10 mm. Eighty-four were hyperplastic polyps (32.1%), 158 adenomas (60.3%), seven sessile serrated lesions (2.7%) and 13 other entities (normal/inflammatory colonmucosa, lymphoidic polyp) (4.9%) on histological diagnosis. Sensitivity, specificity and accuracy of AI were 89.70% (95% confidence interval [CI]: 84.02%-93.88%), 75.26% (95% CI: 65.46%-83.46%) and 84.35% (95% CI:79.38%-88.53%), respectively. Sensitivity, specificity and accuracy for less experienced endoscopists (2-5 years of endoscopy) were 95.56% (95% CI: 84.85%-99.46%), 61.54% (95% CI: 40.57%-79.77%) and 83.10% (95% CI: 72.34%-90.95%) and for experienced endoscopists 90.83% (95% CI: 84.19%-95.33%), 71.83% (95% CI: 59.90%-81.87%) and 83.77% (95% CI: 77.76%-88.70%), respectively. Conclusion Accuracy for polyp characterization by a new commercially available AI system is high, but does not fulfill the criteria for a "resect-and-discard" strategy.

Polyp characterization using deep learning and a publicly accessible polyp video database

OBJECTIVES

Convolutional neural networks (CNN) for computer-aided diagnosis of polyps are often trained using high-quality still images in a single chromoendoscopy imaging modality with sessile serrated lesions (SSLs) often excluded. This study developed a CNN from videos to classify polyps as adenomatous or nonadenomatous using standard narrow-band imaging (NBI) and NBI-near focus (NBI-NF) and created a publicly accessible polyp video database.

METHODS

We trained a CNN with 16,832 high and moderate quality frames from 229 polyp videos (56 SSLs). It was evaluated with 222 polyp videos (36 SSLs) across two test-sets. Test-set I consists of 14,320 frames (157 polyps, 111 diminutive). Test-set II, which is publicly accessible, 3317 video frames (65 polyps, 41 diminutive), which was benchmarked with three expert and three nonexpert endoscopists.

RESULTS

Sensitivity for adenoma characterization was 91.6% in test-set I and 89.7% in test-set II. Specificity was 91.9% and 88.5%. Sensitivity for diminutive polyps was 89.9% and 87.5%; specificity 90.5% and 88.2%. In NBI-NF, sensitivity was 89.4% and 89.5%, with a specificity of 94.7% and 83.3%. In NBI, sensitivity was 85.3% and 91.7%, with a specificity of 87.5% and 90.0%, respectively. The CNN achieved preservation and incorporation of valuable endoscopic innovations (PIVI)-1 and PIVI-2 thresholds for each test-set. In the benchmarking of test-set II, the CNN was significantly more accurate than nonexperts (13.8% difference [95% confidence interval 3.2-23.6], P = 0.01) with no significant difference with experts.

CONCLUSIONS

A single CNN can differentiate adenomas from SSLs and hyperplastic polyps in both NBI and NBI-NF. A publicly accessible NBI polyp video database was created and benchmarked.

Cost-effectiveness of Artificial Intelligence-Aided Colonoscopy for Adenoma Detection in Colon Cancer Screening

Background and Aims

Artificial intelligence-aided colonoscopy significantly improves adenoma detection. We assessed the cost-effectiveness of the GI Genius technology, an artificial intelligence-aided computer diagnosis for polyp detection (CADe), in improving colorectal cancer outcomes, adopting a Canadian health care perspective.

Methods

A Markov model with 1-year cycles and a lifetime horizon was used to estimate incremental cost-effectiveness ratio comparing CADe to conventional colonoscopy polyp detection amongst patients with a positive faecal immunochemical test. Outcomes were life years (LYs) and quality-adjusted life years (QALY) gained. The analysis applied costs associated with health care resource utilization, including procedures and follow-ups, from a provincial payer's perspective using 2022 Canadian dollars. Effectiveness and cost data were sourced from the literature and publicly available databases. Extensive probabilistic and deterministic sensitivity analyses were performed, assessing model robustness.

Results

Life years and QALY gains for the CADe and conventional colonoscopy groups were 19.144 versus 19.125 and 17.137 versus 17.113, respectively. CADe and conventional colonoscopies' overall per-case costs were $2990.74 and $3004.59, respectively. With a willingness-to-pay pre-set at $50,000/QALY, the incremental cost-effectiveness ratio was dominant for both outcomes, showing that CADe colonoscopy is cost-effective. Deterministic sensitivity analysis confirmed that the model was sensitive to the incidence risk ratio of adenoma per colonoscopy for large adenomas. Probabilistic sensitivity analysis showed that the CADe strategy was cost-effective in up to 73.4% of scenarios.

Conclusion

The addition of CADe solution to colonoscopy is a dominant, cost-effective strategy when used in faecal immunochemical test-positive patients in a Canadian health care setting.

Survey on the perceptions of UK gastroenterologists and endoscopists to artificial intelligence

BACKGROUND AND AIMS

With the potential integration of artificial intelligence (AI) into clinical practice, it is essential to understand end users' perception of this novel technology. The aim of this study, which was endorsed by the British Society of Gastroenterology (BSG), was to evaluate the UK gastroenterology and endoscopy communities' views on AI.

METHODS

An online survey was developed and disseminated to gastroenterologists and endoscopists across the UK.

RESULTS

One hundred four participants completed the survey. Quality improvement in endoscopy (97%) and better endoscopic diagnosis (92%) were perceived as the most beneficial applications of AI to clinical practice. The most significant challenges were accountability for incorrect diagnoses (85%) and potential bias of algorithms (82%). A lack of guidelines (92%) was identified as the greatest barrier to adopting AI in routine clinical practice. Participants identified real-time endoscopic image diagnosis (95%) as a research priority for AI, while the most perceived significant barriers to AI research were funding (82%) and the availability of annotated data (76%). Participants consider the priorities for the BSG AI Task Force to be identifying research priorities (96%), guidelines for adopting AI devices in clinical practice (93%) and supporting the delivery of multicentre clinical trials (91%).

CONCLUSION

This survey has identified views from the UK gastroenterology and endoscopy community regarding AI in clinical practice and research, and identified priorities for the newly formed BSG AI Task Force.