1
|
Saraiva MM, González-Haba M, Widmer J, Mendes F, Gonda T, Agudo B, Ribeiro T, Costa A, Fazel Y, Lera ME, Horneaux de Moura E, Ferreira de Carvalho M, Bestetti A, Afonso J, Martins M, Almeida MJ, Vilas-Boas F, Moutinho-Ribeiro P, Lopes S, Fernandes J, Ferreira J, Macedo G. Deep Learning and Automatic Differentiation of Pancreatic Lesions in Endoscopic Ultrasound: A Transatlantic Study. Clin Transl Gastroenterol 2024; 15:e00771. [PMID: 39324610 PMCID: PMC11596526 DOI: 10.14309/ctg.0000000000000771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Accepted: 09/13/2024] [Indexed: 09/27/2024] Open
Abstract
INTRODUCTION Endoscopic ultrasound (EUS) allows for characterization and biopsy of pancreatic lesions. Pancreatic cystic neoplasms (PCN) include mucinous (M-PCN) and nonmucinous lesions (NM-PCN). Pancreatic ductal adenocarcinoma (P-DAC) is the commonest pancreatic solid lesion (PSL), followed by pancreatic neuroendocrine tumor (P-NET). Although EUS is preferred for pancreatic lesion evaluation, its diagnostic accuracy is suboptimal. This multicentric study aims to develop a convolutional neural network (CNN) for detecting and distinguishing PCN (namely M-PCN and NM-PCN) and PSL (particularly P-DAC and P-NET). METHODS A CNN was developed with 378 EUS examinations from 4 international reference centers (Centro Hospitalar Universitário São João, Hospital Universitario Puerta de Hierro Majadahonda, New York University Hospitals, Hospital das Clínicas Faculdade de Medicina da Universidade de São Paulo). About 126.000 images were obtained-19.528 M-PCN, 8.175 NM-PCN, 64.286 P-DAC, 29.153 P-NET, and 4.858 normal pancreas images. A trinary CNN differentiated normal pancreas tissue from M-PCN and NM-PCN. A binary CNN distinguished P-DAC from P-NET. The total data set was divided into a training and testing data set (used for model's evaluation) in a 90/10% ratio. The model was evaluated through its sensitivity, specificity, positive and negative predictive values, and accuracy. RESULTS The CNN had 99.1% accuracy for identifying normal pancreatic tissue, 99.0% and 99.8% for M-PCN and NM-PCN, respectively. P-DAC and P-NET were distinguished with 94.0% accuracy. DISCUSSION Our group developed the first worldwide CNN capable of detecting and differentiating the commonest PCN and PSL in EUS images, using examinations from 4 centers in 2 continents, minimizing the impact of the demographic bias. Larger multicentric studies are needed for technology implementation.
Collapse
Affiliation(s)
- Miguel Mascarenhas Saraiva
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
- Faculty of Medicine of the University of Porto, Porto, Portugal;
| | | | - Jessica Widmer
- New York University Langone Hospital, New York, New York, USA;
| | - Francisco Mendes
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
| | - Tamas Gonda
- New York University Manhattan Hospital, New York, New York, USA;
| | - Belen Agudo
- Hospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain;
| | - Tiago Ribeiro
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
- Faculty of Medicine of the University of Porto, Porto, Portugal;
| | - António Costa
- Hospital Universitario Puerta de Hierro Majadahonda, Madrid, Spain;
| | - Yousef Fazel
- New York University Langone Hospital, New York, New York, USA;
| | - Marcos Eduardo Lera
- Hospital Das Clinicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo, Brazil;
| | | | | | - Alexandre Bestetti
- Hospital Das Clinicas da Faculdade de Medicina da Universidade de São Paulo, São Paulo, Brazil;
| | - João Afonso
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
- Faculty of Medicine of the University of Porto, Porto, Portugal;
| | - Miguel Martins
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
| | - Maria João Almeida
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
| | - Filipe Vilas-Boas
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
- Faculty of Medicine of the University of Porto, Porto, Portugal;
| | - Pedro Moutinho-Ribeiro
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
- Faculty of Medicine of the University of Porto, Porto, Portugal;
| | - Susana Lopes
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
- Faculty of Medicine of the University of Porto, Porto, Portugal;
| | - Joana Fernandes
- Faculty of Engineering of the University of Porto, Porto, Portugal.
| | - João Ferreira
- Faculty of Engineering of the University of Porto, Porto, Portugal.
| | - Guilherme Macedo
- Department of Gastroenterology, Precision Medicine Unit, São João University Hospital, Porto, Portugal;
- WGO Gastroenterology and Hepatology Training Center, Porto, Portugal;
- Faculty of Medicine of the University of Porto, Porto, Portugal;
| |
Collapse
|
2
|
Mota J, Almeida MJ, Mendes F, Martins M, Ribeiro T, Afonso J, Cardoso P, Cardoso H, Andrade P, Ferreira J, Mascarenhas M, Macedo G. From Data to Insights: How Is AI Revolutionizing Small-Bowel Endoscopy? Diagnostics (Basel) 2024; 14:291. [PMID: 38337807 PMCID: PMC10855436 DOI: 10.3390/diagnostics14030291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 01/09/2024] [Accepted: 01/16/2024] [Indexed: 02/12/2024] Open
Abstract
The role of capsule endoscopy and enteroscopy in managing various small-bowel pathologies is well-established. However, their broader application has been hampered mainly by their lengthy reading times. As a result, there is a growing interest in employing artificial intelligence (AI) in these diagnostic and therapeutic procedures, driven by the prospect of overcoming some major limitations and enhancing healthcare efficiency, while maintaining high accuracy levels. In the past two decades, the applicability of AI to gastroenterology has been increasing, mainly because of the strong imaging component. Nowadays, there are a multitude of studies using AI, specifically using convolutional neural networks, that prove the potential applications of AI to these endoscopic techniques, achieving remarkable results. These findings suggest that there is ample opportunity for AI to expand its presence in the management of gastroenterology diseases and, in the future, catalyze a game-changing transformation in clinical activities. This review provides an overview of the current state-of-the-art of AI in the scope of small-bowel study, with a particular focus on capsule endoscopy and enteroscopy.
Collapse
Affiliation(s)
- Joana Mota
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Maria João Almeida
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Helder Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Patrícia Andrade
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering, University of Porto, R. Dr. Roberto Frias, 4200-465 Porto, Portugal;
- Digestive Artificial Intelligence Development, R. Alfredo Allen 455-461, 4200-135 Porto, Portugal
| | - Miguel Mascarenhas
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- ManopH Gastroenterology Clinic, R. de Sá da Bandeira 752, 4000-432 Porto, Portugal
| | - Guilherme Macedo
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| |
Collapse
|