1
|
Messmann H, Bisschops R, Antonelli G, Libânio D, Sinonquel P, Abdelrahim M, Ahmad OF, Areia M, Bergman JJGHM, Bhandari P, Boskoski I, Dekker E, Domagk D, Ebigbo A, Eelbode T, Eliakim R, Häfner M, Haidry RJ, Jover R, Kaminski MF, Kuvaev R, Mori Y, Palazzo M, Repici A, Rondonotti E, Rutter MD, Saito Y, Sharma P, Spada C, Spadaccini M, Veitch A, Gralnek IM, Hassan C, Dinis-Ribeiro M. Expected value of artificial intelligence in gastrointestinal endoscopy: European Society of Gastrointestinal Endoscopy (ESGE) Position Statement. Endoscopy 2022; 54:1211-1231. [PMID: 36270318 DOI: 10.1055/a-1950-5694] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
This ESGE Position Statement defines the expected value of artificial intelligence (AI) for the diagnosis and management of gastrointestinal neoplasia within the framework of the performance measures already defined by ESGE. This is based on the clinical relevance of the expected task and the preliminary evidence regarding artificial intelligence in artificial or clinical settings. MAIN RECOMMENDATIONS:: (1) For acceptance of AI in assessment of completeness of upper GI endoscopy, the adequate level of mucosal inspection with AI should be comparable to that assessed by experienced endoscopists. (2) For acceptance of AI in assessment of completeness of upper GI endoscopy, automated recognition and photodocumentation of relevant anatomical landmarks should be obtained in ≥90% of the procedures. (3) For acceptance of AI in the detection of Barrett's high grade intraepithelial neoplasia or cancer, the AI-assisted detection rate for suspicious lesions for targeted biopsies should be comparable to that of experienced endoscopists with or without advanced imaging techniques. (4) For acceptance of AI in the management of Barrett's neoplasia, AI-assisted selection of lesions amenable to endoscopic resection should be comparable to that of experienced endoscopists. (5) For acceptance of AI in the diagnosis of gastric precancerous conditions, AI-assisted diagnosis of atrophy and intestinal metaplasia should be comparable to that provided by the established biopsy protocol, including the estimation of extent, and consequent allocation to the correct endoscopic surveillance interval. (6) For acceptance of artificial intelligence for automated lesion detection in small-bowel capsule endoscopy (SBCE), the performance of AI-assisted reading should be comparable to that of experienced endoscopists for lesion detection, without increasing but possibly reducing the reading time of the operator. (7) For acceptance of AI in the detection of colorectal polyps, the AI-assisted adenoma detection rate should be comparable to that of experienced endoscopists. (8) For acceptance of AI optical diagnosis (computer-aided diagnosis [CADx]) of diminutive polyps (≤5 mm), AI-assisted characterization should match performance standards for implementing resect-and-discard and diagnose-and-leave strategies. (9) For acceptance of AI in the management of polyps ≥ 6 mm, AI-assisted characterization should be comparable to that of experienced endoscopists in selecting lesions amenable to endoscopic resection.
Collapse
Affiliation(s)
- Helmut Messmann
- III Medizinische Klinik, Universitatsklinikum Augsburg, Augsburg, Germany
| | - Raf Bisschops
- Department of Gastroenterology and Hepatology, Catholic University of Leuven (KUL), TARGID, University Hospital Leuven, Leuven, Belgium
| | - Giulio Antonelli
- Gastroenterology and Digestive Endoscopy Unit, Ospedale dei Castelli Hospital, Ariccia, Rome, Italy
- Department of Anatomical, Histological, Forensic Medicine and Orthopedics Sciences, Sapienza University of Rome, Italy
| | - Diogo Libânio
- Department of Gastroenterology, Porto Comprehensive Cancer Center, and RISE@CI-IPOP (Health Research Network), Porto, Portugal
- MEDCIDS, Faculty of Medicine, University of Porto, Porto, Portugal
| | - Pieter Sinonquel
- Department of Gastroenterology and Hepatology, Catholic University of Leuven (KUL), TARGID, University Hospital Leuven, Leuven, Belgium
| | - Mohamed Abdelrahim
- Endoscopy Department, Portsmouth Hospitals University NHS Trust, Portsmouth, UK
| | - Omer F Ahmad
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London Hospital, London, UK
- Division of Surgery and Interventional Sciences, University College London Hospital, London, UK
- Gastrointestinal Services, University College London Hospital, London, UK
| | - Miguel Areia
- Gastroenterology Department, Portuguese Oncology Institute of Coimbra, Coimbra, Portugal
| | | | - Pradeep Bhandari
- Endoscopy Department, Portsmouth Hospitals University NHS Trust, Portsmouth, UK
| | - Ivo Boskoski
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Evelien Dekker
- Department of Gastroenterology and Hepatology, Amsterdam UMC, Amsterdam, The Netherlands
| | - Dirk Domagk
- Department of Medicine I, Josephs-Hospital Warendorf, Academic Teaching Hospital, University of Muenster, Warendorf, Germany
| | - Alanna Ebigbo
- III Medizinische Klinik, Universitatsklinikum Augsburg, Augsburg, Germany
| | - Tom Eelbode
- Department of Electrical Engineering (ESAT/PSI), Medical Imaging Research Center, KU Leuven, Leuven, Belgium
| | - Rami Eliakim
- Department of Gastroenterology, Sheba Medical Center Tel Hashomer & Sackler School of Medicine, Tel-Aviv University, Ramat Gan, Israel
| | - Michael Häfner
- 2nd Medical Department, Barmherzige Schwestern Krankenhaus, Vienna, Austria
| | - Rehan J Haidry
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London Hospital, London, UK
- Division of Surgery and Interventional Sciences, University College London Hospital, London, UK
| | - Rodrigo Jover
- Servicio de Gastroenterología, Hospital General Universitario Dr. Balmis, Instituto de Investigación Biomédica de Alicante ISABIAL, Departamento de Medicina Clínica, Universidad Miguel Hernández, Alicante, Spain
| | - Michal F Kaminski
- Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway
- Department of Gastroenterology, Hepatology and Clinical Oncology, Centre of Postgraduate Medical Education, Warsaw, Poland
- Department of Oncological Gastroenterology and Department of Cancer Prevention, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | - Roman Kuvaev
- Endoscopy Department, Yaroslavl Regional Cancer Hospital, Yaroslavl, Russian Federation
- Department of Gastroenterology, Faculty of Additional Professional Education, N.A. Pirogov Russian National Research Medical University, Moscow, Russian Federation
| | - Yuichi Mori
- Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | | | - Alessandro Repici
- Department of Biomedical Sciences, Humanitas University, Rozzano, Milan, Italy
- IRCCS Humanitas Research Hospital, Rozzano, Milan, Italy
| | | | - Matthew D Rutter
- North Tees and Hartlepool NHS Foundation Trust, Stockton-on-Tees, UK
- Population Health Sciences Institute, Newcastle University, Newcastle, UK
| | - Yutaka Saito
- Endoscopy Division, National Cancer Center Hospital, Tokyo, Japan
| | - Prateek Sharma
- Gastroenterology and Hepatology Division, University of Kansas School of Medicine, Kansas, USA
- Kansas City VA Medical Center, Kansas City, USA
| | - Cristiano Spada
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Digestive Endoscopy, Fondazione Poliambulanza Istituto Ospedaliero, Brescia, Italy
| | - Marco Spadaccini
- Department of Biomedical Sciences, Humanitas University, Rozzano, Milan, Italy
- IRCCS Humanitas Research Hospital, Rozzano, Milan, Italy
| | - Andrew Veitch
- Department of Gastroenterology, Royal Wolverhampton Hospitals NHS Trust, Wolverhampton, UK
| | - Ian M Gralnek
- Ellen and Pinchas Mamber Institute of Gastroenterology and Hepatology, Emek Medical Center, Afula, Israel
- Rappaport Faculty of Medicine, Technion Israel Institute of Technology, Haifa, Israel
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Rozzano, Milan, Italy
- IRCCS Humanitas Research Hospital, Rozzano, Milan, Italy
| | - Mario Dinis-Ribeiro
- Department of Gastroenterology, Porto Comprehensive Cancer Center, and RISE@CI-IPOP (Health Research Network), Porto, Portugal
| |
Collapse
|
2
|
Yeung M, Sala E, Schönlieb CB, Rundo L. Focus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopy. Comput Biol Med 2021; 137:104815. [PMID: 34507156 PMCID: PMC8505797 DOI: 10.1016/j.compbiomed.2021.104815] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Revised: 08/26/2021] [Accepted: 08/26/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Colonoscopy remains the gold-standard screening for colorectal cancer. However, significant miss rates for polyps have been reported, particularly when there are multiple small adenomas. This presents an opportunity to leverage computer-aided systems to support clinicians and reduce the number of polyps missed. METHOD In this work we introduce the Focus U-Net, a novel dual attention-gated deep neural network, which combines efficient spatial and channel-based attention into a single Focus Gate module to encourage selective learning of polyp features. The Focus U-Net incorporates several further architectural modifications, including the addition of short-range skip connections and deep supervision. Furthermore, we introduce the Hybrid Focal loss, a new compound loss function based on the Focal loss and Focal Tversky loss, designed to handle class-imbalanced image segmentation. For our experiments, we selected five public datasets containing images of polyps obtained during optical colonoscopy: CVC-ClinicDB, Kvasir-SEG, CVC-ColonDB, ETIS-Larib PolypDB and EndoScene test set. We first perform a series of ablation studies and then evaluate the Focus U-Net on the CVC-ClinicDB and Kvasir-SEG datasets separately, and on a combined dataset of all five public datasets. To evaluate model performance, we use the Dice similarity coefficient (DSC) and Intersection over Union (IoU) metrics. RESULTS Our model achieves state-of-the-art results for both CVC-ClinicDB and Kvasir-SEG, with a mean DSC of 0.941 and 0.910, respectively. When evaluated on a combination of five public polyp datasets, our model similarly achieves state-of-the-art results with a mean DSC of 0.878 and mean IoU of 0.809, a 14% and 15% improvement over the previous state-of-the-art results of 0.768 and 0.702, respectively. CONCLUSIONS This study shows the potential for deep learning to provide fast and accurate polyp segmentation results for use during colonoscopy. The Focus U-Net may be adapted for future use in newer non-invasive colorectal cancer screening and more broadly to other biomedical image segmentation tasks similarly involving class imbalance and requiring efficiency.
Collapse
Affiliation(s)
- Michael Yeung
- Department of Radiology, University of Cambridge, Cambridge, CB2 0QQ, United Kingdom; School of Clinical Medicine, University of Cambridge, Cambridge, CB2 0SP, United Kingdom.
| | - Evis Sala
- Department of Radiology, University of Cambridge, Cambridge, CB2 0QQ, United Kingdom; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, CB2 0RE, United Kingdom.
| | - Carola-Bibiane Schönlieb
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, CB3 0WA, United Kingdom.
| | - Leonardo Rundo
- Department of Radiology, University of Cambridge, Cambridge, CB2 0QQ, United Kingdom; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, CB2 0RE, United Kingdom.
| |
Collapse
|
3
|
Hassan C, Bhandari P, Antonelli G, Repici A. Artificial intelligence for non-polypoid colorectal neoplasms. Dig Endosc 2021; 33:285-289. [PMID: 32767704 DOI: 10.1111/den.13807] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2020] [Revised: 07/31/2020] [Accepted: 08/04/2020] [Indexed: 12/15/2022]
Abstract
The miss rate of flat advanced colorectal neoplasia is still unacceptably high, especially in the Western setting, notwithstanding the widespread implementation of quality improvement programs and training. It is well known that flat morphology is associated with miss rate of colorectal neoplasia, and that this subset of lesions often shows a more aggressive biological behaviour. Artificial intelligence (AI) applied to the detection of colorectal neoplasia has been shown to increase adenoma detection rate, consistently across all lesion sizes and locations in the colon. However, there is still uncertainty whether AI can reduce the miss rate of flat advanced neoplasia, mainly because all published trials report a low number of flat colorectal lesions in their training sets, and this could reduce AI accuracy for this subset of lesions. In addition, flat lesions have different morphologies with variable prevalence and potentially different accuracy in their detection. For example, the subtle appearance and rarer frequency of a non-granular laterally spreading tumor (LST) could be much harder to identify than a granular mixed LST. In this review, we present a summary of the evidence on the role of AI in the identification of colorectal flat neoplasia, with a focus on data regarding presence of LSTs in the training/validation sets of the AI systems currently available on the market.
Collapse
|
4
|
Ciuti G, Skonieczna-Żydecka K, Marlicz W, Iacovacci V, Liu H, Stoyanov D, Arezzo A, Chiurazzi M, Toth E, Thorlacius H, Dario P, Koulaouzidis A. Frontiers of Robotic Colonoscopy: A Comprehensive Review of Robotic Colonoscopes and Technologies. J Clin Med 2020; 9:E1648. [PMID: 32486374 PMCID: PMC7356873 DOI: 10.3390/jcm9061648] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 05/16/2020] [Accepted: 05/19/2020] [Indexed: 12/15/2022] Open
Abstract
Flexible colonoscopy remains the prime mean of screening for colorectal cancer (CRC) and the gold standard of all population-based screening pathways around the world. Almost 60% of CRC deaths could be prevented with screening. However, colonoscopy attendance rates are affected by discomfort, fear of pain and embarrassment or loss of control during the procedure. Moreover, the emergence and global thread of new communicable diseases might seriously affect the functioning of contemporary centres performing gastrointestinal endoscopy. Innovative solutions are needed: artificial intelligence (AI) and physical robotics will drastically contribute for the future of the healthcare services. The translation of robotic technologies from traditional surgery to minimally invasive endoscopic interventions is an emerging field, mainly challenged by the tough requirements for miniaturization. Pioneering approaches for robotic colonoscopy have been reported in the nineties, with the appearance of inchworm-like devices. Since then, robotic colonoscopes with assistive functionalities have become commercially available. Research prototypes promise enhanced accessibility and flexibility for future therapeutic interventions, even via autonomous or robotic-assisted agents, such as robotic capsules. Furthermore, the pairing of such endoscopic systems with AI-enabled image analysis and recognition methods promises enhanced diagnostic yield. By assembling a multidisciplinary team of engineers and endoscopists, the paper aims to provide a contemporary and highly-pictorial critical review for robotic colonoscopes, hence providing clinicians and researchers with a glimpse of the major changes and challenges that lie ahead.
Collapse
Affiliation(s)
- Gastone Ciuti
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | - Karolina Skonieczna-Żydecka
- Department of Human Nutrition and Metabolomics, Pomeranian Medical University in Szczecin, 71-460 Szczecin, Poland;
| | - Wojciech Marlicz
- Department of Gastroenterology, Pomeranian Medical University in Szczecin, 71-252 Szczecin, Poland;
- Endoklinika sp. z o.o., 70-535 Szczecin, Poland
| | - Veronica Iacovacci
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | - Hongbin Liu
- School of Biomedical Engineering & Imaging Sciences, Faculty of Life Sciences and Medicine, King’s College London, London SE1 7EH, UK;
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London W1W 7TY, UK;
| | - Alberto Arezzo
- Department of Surgical Sciences, University of Torino, 10126 Torino, Italy;
| | - Marcello Chiurazzi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | - Ervin Toth
- Department of Gastroenterology, Skåne University Hospital, Lund University, 20502 Malmö, Sweden;
| | - Henrik Thorlacius
- Department of Clinical Sciences, Section of Surgery, Lund University, 20502 Malmö, Sweden;
| | - Paolo Dario
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | | |
Collapse
|