1
|
Agudo Castillo B, Mascarenhas M, Martins M, Mendes F, de la Iglesia D, Costa AMMPD, Esteban Fernández-Zarza C, González-Haba Ruiz M. Advancements in biliopancreatic endoscopy: a comprehensive review of artificial intelligence in EUS and ERCP. REVISTA ESPANOLA DE ENFERMEDADES DIGESTIVAS 2024. [PMID: 38832589 DOI: 10.17235/reed.2024.10456/2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2024]
Abstract
The development and implementation of artificial intelligence (AI), particularly deep learning (DL) models, has generated significant interest across various fields of gastroenterology. While research in luminal endoscopy has seen rapid translation to clinical practice with approved AI devices, its potential extends far beyond, offering promising benefits for biliopancreatic endoscopy like optical characterization of strictures during cholangioscopy or detection and classification of pancreatic lesions during diagnostic endoscopic ultrasound (EUS). This narrative review provides an up-to-date of the latest literature and available studies in this field. Serving as a comprehensive guide to the current landscape of AI in biliopancreatic endoscopy, emphasizing technological advancements, main applications, ethical considerations, and future directions for research and clinical implementation.
Collapse
Affiliation(s)
| | | | - Miguel Martins
- Gastroenterology, Centro Hospitalar Universitário de São João
| | - Francisco Mendes
- Gastroenterology, Centro Hospitalar Universitário de São João, Portugal
| | | | | | | | | |
Collapse
|
2
|
Rosa B, Cotter J. Capsule endoscopy and panendoscopy: A journey to the future of gastrointestinal endoscopy. World J Gastroenterol 2024; 30:1270-1279. [PMID: 38596501 PMCID: PMC11000081 DOI: 10.3748/wjg.v30.i10.1270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Revised: 01/22/2024] [Accepted: 02/21/2024] [Indexed: 03/14/2024] Open
Abstract
In 2000, the small bowel capsule revolutionized the management of patients with small bowel disorders. Currently, the technological development achieved by the new models of double-headed endoscopic capsules, as miniaturized devices to evaluate the small bowel and colon [pan-intestinal capsule endoscopy (PCE)], makes this non-invasive procedure a disruptive concept for the management of patients with digestive disorders. This technology is expected to identify which patients will require conventional invasive endoscopic procedures (colonoscopy or balloon-assisted enteroscopy), based on the lesions detected by the capsule, i.e., those with an indication for biopsies or endoscopic treatment. The use of PCE in patients with inflammatory bowel diseases, namely Crohn's disease, as well as in patients with iron deficiency anaemia and/or overt gastrointestinal (GI) bleeding, after a non-diagnostic upper endoscopy (esophagogastroduodenoscopy), enables an effective, safe and comfortable way to identify patients with relevant lesions, who should undergo subsequent invasive endoscopic procedures. The recent development of magnetically controlled capsule endoscopy to evaluate the upper GI tract, is a further step towards the possibility of an entirely non-invasive assessment of all the segments of the digestive tract, from mouth-to-anus, meeting the expectations of the early developers of capsule endoscopy.
Collapse
Affiliation(s)
- Bruno Rosa
- Department of Gastroenterology, Hospital da Senhora da Oliveira, Guimarães 4835-044, Portugal
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, Braga 4710-057, Portugal
- ICVS/3B's, PT Government Associate Laboratory, Braga 4710-057, Portugal
| | - José Cotter
- Department of Gastroenterology, Hospital da Senhora da Oliveira, Guimarães 4835-044, Portugal
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, Braga 4710-057, Portugal
- ICVS/3B's, PT Government Associate Laboratory, Braga 4710-057, Portugal
| |
Collapse
|
3
|
Mascarenhas M, Martins M, Afonso J, Ribeiro T, Cardoso P, Mendes F, Andrade P, Cardoso H, Ferreira J, Macedo G. The Future of Minimally Invasive Capsule Panendoscopy: Robotic Precision, Wireless Imaging and AI-Driven Insights. Cancers (Basel) 2023; 15:5861. [PMID: 38136403 PMCID: PMC10742312 DOI: 10.3390/cancers15245861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2023] [Revised: 12/04/2023] [Accepted: 12/13/2023] [Indexed: 12/24/2023] Open
Abstract
In the early 2000s, the introduction of single-camera wireless capsule endoscopy (CE) redefined small bowel study. Progress continued with the development of double-camera devices, first for the colon and rectum, and then, for panenteric assessment. Advancements continued with magnetic capsule endoscopy (MCE), particularly when assisted by a robotic arm, designed to enhance gastric evaluation. Indeed, as CE provides full visualization of the entire gastrointestinal (GI) tract, a minimally invasive capsule panendoscopy (CPE) could be a feasible alternative, despite its time-consuming nature and learning curve, assuming appropriate bowel cleansing has been carried out. Recent progress in artificial intelligence (AI), particularly in the development of convolutional neural networks (CNN) for CE auxiliary reading (detecting and diagnosing), may provide the missing link in fulfilling the goal of establishing the use of panendoscopy, although prospective studies are still needed to validate these models in actual clinical scenarios. Recent CE advancements will be discussed, focusing on the current evidence on CNN developments, and their real-life implementation potential and associated ethical challenges.
Collapse
Affiliation(s)
- Miguel Mascarenhas
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - Patrícia Andrade
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Helder Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - João Ferreira
- Department of Mechanic Engineering, Faculty of Engineering, University of Porto, 4200-065 Porto, Portugal;
- DigestAID—Digestive Artificial Intelligence Development, 455/461, 4200-135 Porto, Portugal
| | - Guilherme Macedo
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| |
Collapse
|
4
|
Mascarenhas M, Mendes F, Ribeiro T, Afonso J, Cardoso P, Martins M, Cardoso H, Andrade P, Ferreira J, Mascarenhas Saraiva M, Macedo G. Deep Learning and Minimally Invasive Endoscopy: Automatic Classification of Pleomorphic Gastric Lesions in Capsule Endoscopy. Clin Transl Gastroenterol 2023; 14:e00609. [PMID: 37404050 PMCID: PMC10584281 DOI: 10.14309/ctg.0000000000000609] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Accepted: 06/02/2023] [Indexed: 07/06/2023] Open
Abstract
INTRODUCTION Capsule endoscopy (CE) is a minimally invasive examination for evaluating the gastrointestinal tract. However, its diagnostic yield for detecting gastric lesions is suboptimal. Convolutional neural networks (CNNs) are artificial intelligence models with great performance for image analysis. Nonetheless, their role in gastric evaluation by wireless CE (WCE) has not been explored. METHODS Our group developed a CNN-based algorithm for the automatic classification of pleomorphic gastric lesions, including vascular lesions (angiectasia, varices, and red spots), protruding lesions, ulcers, and erosions. A total of 12,918 gastric images from 3 different CE devices (PillCam Crohn's; PillCam SB3; OMOM HD CE system) were used from the construction of the CNN: 1,407 from protruding lesions; 994 from ulcers and erosions; 822 from vascular lesions; and 2,851 from hematic residues and the remaining images from normal mucosa. The images were divided into a training (split for three-fold cross-validation) and validation data set. The model's output was compared with a consensus classification by 2 WCE-experienced gastroenterologists. The network's performance was evaluated by its sensitivity, specificity, accuracy, positive predictive value and negative predictive value, and area under the precision-recall curve. RESULTS The trained CNN had a 97.4% sensitivity; 95.9% specificity; and positive predictive value and negative predictive value of 95.0% and 97.8%, respectively, for gastric lesions, with 96.6% overall accuracy. The CNN had an image processing time of 115 images per second. DISCUSSION Our group developed, for the first time, a CNN capable of automatically detecting pleomorphic gastric lesions in both small bowel and colon CE devices.
Collapse
Affiliation(s)
- Miguel Mascarenhas
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
| | - Hélder Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, Porto, Portugal
| | - Patrícia Andrade
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, Porto, Portugal
| | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering of the University of Porto, Porto, Portugal
- Digestive Artificial Intelligence Development, Porto, Portugal
| | | | - Guilherme Macedo
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, Porto, Portugal
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, Porto, Portugal
| |
Collapse
|
5
|
Pecere S, Chiappetta MF, Del Vecchio LE, Despott E, Dray X, Koulaouzidis A, Fuccio L, Murino A, Rondonotti E, Spaander M, Spada C. The evolving role of small-bowel capsule endoscopy. Best Pract Res Clin Gastroenterol 2023; 64-65:101857. [PMID: 37652655 DOI: 10.1016/j.bpg.2023.101857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 08/08/2023] [Indexed: 09/02/2023]
Affiliation(s)
- Silvia Pecere
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli, IRCCS, Rome, Italy; Centre for Endoscopic Research Therapeutics and Training (CERTT), Università Cattolica del Sacro Cuore, Rome, Italy
| | - Michele Francesco Chiappetta
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli, IRCCS, Rome, Italy; Centre for Endoscopic Research Therapeutics and Training (CERTT), Università Cattolica del Sacro Cuore, Rome, Italy.
| | - Livio Enrico Del Vecchio
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli, IRCCS, Rome, Italy; Centre for Endoscopic Research Therapeutics and Training (CERTT), Università Cattolica del Sacro Cuore, Rome, Italy
| | - Edward Despott
- Royal Free Unit for Endoscopy and Centre for Gastroenterology, UCL Institute for Liver and Digestive Health, Royal Free NHS Foundation Trust, London, United Kingdom; Wolfson Unit for Endoscopy, St Mark's Hospital and Academic Institute, Imperial College London, London, United Kingdom
| | - Xavier Dray
- Sorbonne University, Centre for Digestive Endoscopy, Saint Antoine Hospital, APHP, Paris, France
| | | | - Lorenzo Fuccio
- IRCCS Azienda Ospedaliero-Universitaria di Bologna, Gastroenterology Unit, Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy
| | - Alberto Murino
- Royal Free Unit for Endoscopy and Centre for Gastroenterology, UCL Institute for Liver and Digestive Health, Royal Free NHS Foundation Trust, London, United Kingdom; Wolfson Unit for Endoscopy, St Mark's Hospital and Academic Institute, Imperial College London, London, United Kingdom
| | | | - Manon Spaander
- Department of Gastroenterology and Hepatology, Erasmus MC University Medical Center, Rotterdam, the Netherlands
| | - Cristiano Spada
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli, IRCCS, Rome, Italy; Centre for Endoscopic Research Therapeutics and Training (CERTT), Università Cattolica del Sacro Cuore, Rome, Italy
| |
Collapse
|