1
|
Cardoso P, Mascarenhas M, Afonso J, Ribeiro T, Mendes F, Martins M, Andrade P, Cardoso H, Mascarenhas Saraiva M, Ferreira JP, Macedo G. Deep learning and minimally invasive inflammatory activity assessment: a proof-of-concept study for development and score correlation of a panendoscopy convolutional network. Therap Adv Gastroenterol 2024; 17:17562848241251569. [PMID: 38812708 PMCID: PMC11135072 DOI: 10.1177/17562848241251569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 04/14/2024] [Indexed: 05/31/2024] Open
Abstract
Background Capsule endoscopy (CE) is a valuable tool for assessing inflammation in patients with Crohn's disease (CD). The current standard for evaluating inflammation are validated scores (and clinical laboratory values) like Lewis score (LS), Capsule Endoscopy Crohn's Disease Activity Index (CECDAI), and ELIAKIM. Recent advances in artificial intelligence (AI) have made it possible to automatically select the most relevant frames in CE. Objectives In this proof-of-concept study, our objective was to develop an automated scoring system using CE images to objectively grade inflammation. Design Pan-enteric CE videos (PillCam Crohn's) performed in CD patients between 09/2020 and 01/2023 were retrospectively reviewed and LS, CECDAI, and ELIAKIM scores were calculated. Methods We developed a convolutional neural network-based automated score consisting of the percentage of positive frames selected by the algorithm (for small bowel and colon separately). We correlated clinical data and the validated scores with the artificial intelligence-generated score (AIS). Results A total of 61 patients were included. The median LS was 225 (0-6006), CECDAI was 6 (0-33), ELIAKIM was 4 (0-38), and SB_AIS was 0.5659 (0-29.45). We found a strong correlation between SB_AIS and LS, CECDAI, and ELIAKIM scores (Spearman's r = 0.751, r = 0.707, r = 0.655, p = 0.001). We found a strong correlation between LS and ELIAKIM (r = 0.768, p = 0.001) and a very strong correlation between CECDAI and LS (r = 0.854, p = 0.001) and CECDAI and ELIAKIM scores (r = 0.827, p = 0.001). Conclusion Our study showed that the AI-generated score had a strong correlation with validated scores indicating that it could serve as an objective and efficient method for evaluating inflammation in CD patients. As a preliminary study, our findings provide a promising basis for future refining of a CE score that may accurately correlate with prognostic factors and aid in the management and treatment of CD patients.
Collapse
Affiliation(s)
- Pedro Cardoso
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - Miguel Mascarenhas
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - João Afonso
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - Tiago Ribeiro
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - Francisco Mendes
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - Miguel Martins
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - Patrícia Andrade
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - Hélder Cardoso
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| | - Miguel Mascarenhas Saraiva
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João P.S. Ferreira
- Faculty of Engineering, University of Porto, Porto, Portugal
- Institute of Science and Innovation in Mechanical and Industrial Engineering, Porto, Portugal
| | - Guilherme Macedo
- Department of Gastroenterology, São João University Hospital, Porto, Portugal
- WGO Training Center, Porto, Portugal
- Faculty of Medicine of the University of Porto, Porto, Portugal
| |
Collapse
|
2
|
Mascarenhas M, Martins M, Afonso J, Ribeiro T, Cardoso P, Mendes F, Andrade P, Cardoso H, Ferreira J, Macedo G. The Future of Minimally Invasive Capsule Panendoscopy: Robotic Precision, Wireless Imaging and AI-Driven Insights. Cancers (Basel) 2023; 15:5861. [PMID: 38136403 PMCID: PMC10742312 DOI: 10.3390/cancers15245861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2023] [Revised: 12/04/2023] [Accepted: 12/13/2023] [Indexed: 12/24/2023] Open
Abstract
In the early 2000s, the introduction of single-camera wireless capsule endoscopy (CE) redefined small bowel study. Progress continued with the development of double-camera devices, first for the colon and rectum, and then, for panenteric assessment. Advancements continued with magnetic capsule endoscopy (MCE), particularly when assisted by a robotic arm, designed to enhance gastric evaluation. Indeed, as CE provides full visualization of the entire gastrointestinal (GI) tract, a minimally invasive capsule panendoscopy (CPE) could be a feasible alternative, despite its time-consuming nature and learning curve, assuming appropriate bowel cleansing has been carried out. Recent progress in artificial intelligence (AI), particularly in the development of convolutional neural networks (CNN) for CE auxiliary reading (detecting and diagnosing), may provide the missing link in fulfilling the goal of establishing the use of panendoscopy, although prospective studies are still needed to validate these models in actual clinical scenarios. Recent CE advancements will be discussed, focusing on the current evidence on CNN developments, and their real-life implementation potential and associated ethical challenges.
Collapse
Affiliation(s)
- Miguel Mascarenhas
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - Patrícia Andrade
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - Helder Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| | - João Ferreira
- Department of Mechanic Engineering, Faculty of Engineering, University of Porto, 4200-065 Porto, Portugal;
- DigestAID—Digestive Artificial Intelligence Development, 455/461, 4200-135 Porto, Portugal
| | - Guilherme Macedo
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (M.M.); (J.A.); (T.R.); (P.C.); (F.M.); (P.A.); (H.C.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-427 Porto, Portugal
| |
Collapse
|
3
|
Jalayeri Nia G, Arasaradnam RP, Koulaouzidis A. Clinical utility of colon capsule endoscopy: a moving target? Therap Adv Gastroenterol 2023; 16:17562848231195680. [PMID: 37822570 PMCID: PMC10563479 DOI: 10.1177/17562848231195680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Accepted: 08/01/2023] [Indexed: 10/13/2023] Open
Abstract
The purpose of this article is to provide an overview of white light colon capsule endoscopy's current clinical application, concentrating on its most recent developments. Second-generation colon capsule endoscopy (CCE2) is approved by the FDA for use as an adjunctive test in patients with incomplete colonoscopy and within Europe in patients at average risk, those with incomplete colonoscopies or those unwilling to undergo conventional colonoscopies. Since the publication of European Society of GI Endoscopy guidelines on the use of CCE, there has been a significant increase in comparative studies on the diagnostic yield of CCE. This paper discusses CCE2 in further detail. It explains newly developed colon capsule system and the current status on the use of CCE, it also provides a comprehensive summary of systematic reviews on the implementation of CCE in colorectal cancer screening from a methodological perspective. Patients with ulcerative colitis can benefit from CCE2 in terms of assessing mucosal inflammation. As part of this review, performance of CCE2 for assessing disease severity in ulcerative colitis is compared with colonoscopy. Finally, an assessment if CCE can become a cost-effective clinical service overall.
Collapse
Affiliation(s)
- Gohar Jalayeri Nia
- Department of Gastroenterology, University Hospital of Coventry and Warwickshire, Clifford Bridge Road, Coventry CV2 2DX, UK
| | - Ramesh P. Arasaradnam
- Department of Gastroenterology, University Hospital of Coventry and Warwickshire, Coventry, UK
- Warwick Medical School, University of Warwick, Coventry, UK
- Department of Gastroenterology, Leicester Cancer Research Centre at University of Leicester, Leicester, UK
- School of Life Sciences, University of Coventry, Coventry, UK
| | - Anastasios Koulaouzidis
- Department of Medicine, OUH Svendborg Sygehus, Svendborg, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Surgical Research Unit, Odense University Hospital, Odense, Denmark
- Department of Social Medicine and Public Health, Pomeranian Medical University, Szczecin, Poland
| |
Collapse
|
4
|
Abstract
PURPOSE OF REVIEW This is a review of colon capsule endoscopy (CCE) with a focus on its recent developments, technological improvements, and current and potential future indications. RECENT FINDINGS Based on the current literature, CCE II demonstrates comparable polyp detection rates as optical colonoscopy and CT colonography, and improved cost-effectiveness. The main limitation to patient acceptance is the requirement of a rigorous bowel preparation. Preliminary studies show good correlation between CCE and optical colonoscopy for assessment of colonic disease activity in inflammatory bowel disease (IBD). CCE II is currently FDA, approved as an adjunctive test in patients with prior incomplete colonoscopy, and in the evaluation of patients with suspected lower gastrointestinal bleeding. The test is approved in Europe as one of the options for average-risk colorectal cancer screening, and high-risk screening in patients with contraindications or unwilling to undergo colonoscopy. CCE has a potential role in the evaluation and monitoring of colonic disease activity in IBD. Future technological advances should focus on minimizing bowel preparation, improvement in reading times, and development of therapeutic capabilities. • With technological improvements, the second-generation colon capsule has a significantly higher sensitivity than the first-generation capsule for detection of colon polyps. • Colon capsule endoscopy has been approved in Europe as an option for average-risk colorectal cancer screening, and high-risk screening in patients with contraindications or unwilling to undergo colonoscopy. • Colon capsule endoscopy has received FDA approval as an option for colorectal cancer screening in patients with prior incomplete colonoscopy, and in evaluation of patients with suspected lower gastrointestinal bleeding. • Colon capsule endoscopy may have a role in evaluation and monitoring of inflammatory bowel disease. • Colon capsule endoscopy currently requires a bowel preparation that is more rigorous than colonoscopy.
Collapse
Affiliation(s)
- Shabana F Pasha
- Division of Gastroenterology and Hepatology, Mayo Clinic Arizona, Scottsdale, AZ, USA.
| |
Collapse
|
5
|
Koulaouzidis A, Iakovidis DK. Robust capsule endoscopy lesion quantification and localization systems. Comput Biol Med 2015; 65:267-8. [PMID: 25906948 DOI: 10.1016/j.compbiomed.2015.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Affiliation(s)
| | - Dimitris K Iakovidis
- Department of Computer Engineering, Technological Educational Institute of Central Greece, Greece
| |
Collapse
|