1
|
Handa P, Goel N, Indu S, Gunjan D. AI-KODA score application for cleanliness assessment in video capsule endoscopy frames. MINIM INVASIV THER 2024; 33:311-320. [PMID: 39138994 DOI: 10.1080/13645706.2024.2390879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Accepted: 07/03/2024] [Indexed: 08/15/2024]
Abstract
BACKGROUND Currently, there is no automated method for assessing cleanliness in video capsule endoscopy (VCE). Our objectives were to automate the process of evaluating and collecting medical scores of VCE frames according to the existing KOrea-CanaDA (KODA) scoring system by developing an easy-to-use mobile application called artificial intelligence-KODA (AI-KODA) score, as well as to determine the inter-rater and intra-rater reliability of the KODA score among three readers for prospective AI applications, and check the efficacy of the application. METHOD From the 28 patient capsule videos considered, 1539 sequential frames were selected at five-minute intervals, and 634 random frames were selected at random intervals during small bowel transit. The frames were processed and shifted to AI-KODA. Three readers (gastroenterology fellows), who had been trained in reading VCE, rated 2173 frames in duplicate four weeks apart after completing the training module on AI-KODA. The scores were saved automatically in real time. Reliability was assessed for each video using estimate of intra-class correlation coefficients (ICCs). Then, the AI dataset was developed using the frames and their respective scores, and it was subjected to automatic classification of the scores via the random forest and the k-nearest neighbors classifiers. RESULTS For sequential frames, ICCs for inter-rater variability were 'excellent' to 'good' among the three readers, while ICCs for intra-rater variability were 'good' to 'moderate'. For random frames, ICCs for inter-rater and intra-rater variability were 'excellent' among the three readers. The overall accuracy achieved was up to 61% for the random forest classifier and 62.38% for the k-nearest neighbors classifier. CONCLUSIONS AI-KODA automates the process of scoring VCE frames based on the existing KODA score. It saves time in cleanliness assessment and is user-friendly for research and clinical use. Comprehensive benchmarking of the AI dataset is in process.
Collapse
Affiliation(s)
- Palak Handa
- Department of Electronics and Communication Engineering, Delhi Technological University, Delhi, India
| | - Nidhi Goel
- Department of Electronics and Communication Engineering, Indira Gandhi Delhi Technical University for Women, Delhi, India
| | - Sreedevi Indu
- Department of Electronics and Communication Engineering, Delhi Technological University, Delhi, India
| | - Deepak Gunjan
- Department of Gastroenterology & HNU, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|
2
|
Handa P, Goel N, Indu S, Gunjan D. A multi-label dataset and its evaluation for automated scoring system for cleanliness assessment in video capsule endoscopy. Phys Eng Sci Med 2024; 47:1213-1226. [PMID: 38884670 DOI: 10.1007/s13246-024-01441-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Accepted: 05/14/2024] [Indexed: 06/18/2024]
Abstract
An automated scoring system for cleanliness assessment during video capsule endoscopy (VCE) is presently lacking. The present study focused on developing an approach to automatically assess the cleanliness in VCE frames as per the latest scoring i.e., Korea-Canada (KODA). Initially, an easy-to-use mobile application called artificial intelligence-KODA (AI-KODA) score was developed to collect a multi-label image dataset of twenty-eight patient capsule videos. Three readers (gastroenterology fellows), who had been trained in reading VCE, rated this dataset in a duplicate manner. The labels were saved automatically in real-time. Inter-rater and intra-rater reliability were checked. The developed dataset was then randomly split into train:validate:test ratio of 70:20:10 and 60:20:20. It was followed by a comprehensive benchmarking and evaluation of three multi-label classification tasks using ten machine learning and two deep learning algorithms. Reliability estimation was found to be overall good among the three readers. Overall, random forest classifier achieved the best evaluation metrics, followed by Adaboost, KNeighbours, and Gaussian naive bayes in the machine learning-based classification tasks. Deep learning algorithms outperformed the machine learning-based classification tasks for only VM labels. Thorough analysis indicates that the proposed approach has the potential to save time in cleanliness assessment and is user-friendly for research and clinical use. Further research is required for the improvement of intra-rater reliability of KODA, and the development of automated multi-task classification in this field.
Collapse
Affiliation(s)
| | - Nidhi Goel
- Department of ECE, IGDTUW, New Delhi, India
| | - S Indu
- Department of ECE, DTU, New Delhi, India
| | - Deepak Gunjan
- Department of Gastroenterology and HNU, AIIMS, Delhi, India
| |
Collapse
|
3
|
Krasaelap A, Lerner DG, Oliva S. The Role of Endoscopy in the Diagnosis and Management of Small Bowel Pathology in Children. Gastrointest Endosc Clin N Am 2023; 33:423-445. [PMID: 36948754 DOI: 10.1016/j.giec.2022.11.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/24/2023]
Abstract
Small bowel evaluation has been transformed by capsule endoscopy and advances in small bowel imaging, which provide reliable and noninvasive means for assessing the mucosal surface. Device-assisted enteroscopy has been critical for histopathological confirmation and endoscopic therapy for a wide range of small bowel pathology that conventional endoscopy cannot reach. The purpose of this review is to provide a comprehensive overview of the indications, techniques, and clinical applications of capsule endoscopy; device-assisted enteroscopy; and imaging studies for small bowel evaluation in children.
Collapse
Affiliation(s)
- Amornluck Krasaelap
- Division of Pediatric Gastroenterology, Hepatology and Nutrition, Children's Mercy Hospital, 2401 Gillham Road, Kansas City, MO 64108, USA.
| | - Diana G Lerner
- Division of Pediatric Gastroenterology, Department of Pediatrics, Hepatology and Nutrition, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, USA
| | - Salvatore Oliva
- Maternal and Child Health Department, Pediatric Gastroenterology and Liver Unit, Sapienza - University of Rome, Piazzale Aldo Moro, 5 00185, Roma, RM, Italy
| |
Collapse
|
4
|
Cohen SA, Oliva S. Capsule Endoscopy in Pediatric Inflammatory Bowel Disease. PEDIATRIC INFLAMMATORY BOWEL DISEASE 2023:307-317. [DOI: 10.1007/978-3-031-14744-9_23] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
|
5
|
Cortegoso Valdivia P, Deding U, Bjørsum-Meyer T, Baatrup G, Fernández-Urién I, Dray X, Boal-Carvalho P, Ellul P, Toth E, Rondonotti E, Kaalby L, Pennazio M, Koulaouzidis A. Inter/Intra-Observer Agreement in Video-Capsule Endoscopy: Are We Getting It All Wrong? A Systematic Review and Meta-Analysis. Diagnostics (Basel) 2022; 12:2400. [PMID: 36292089 PMCID: PMC9600122 DOI: 10.3390/diagnostics12102400] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 09/28/2022] [Accepted: 09/29/2022] [Indexed: 12/09/2022] Open
Abstract
Video-capsule endoscopy (VCE) reading is a time- and energy-consuming task. Agreement on findings between readers (either different or the same) is a crucial point for increasing performance and providing valid reports. The aim of this systematic review with meta-analysis is to provide an evaluation of inter/intra-observer agreement in VCE reading. A systematic literature search in PubMed, Embase and Web of Science was performed throughout September 2022. The degree of observer agreement, expressed with different test statistics, was extracted. As different statistics are not directly comparable, our analyses were stratified by type of test statistics, dividing them in groups of "None/Poor/Minimal", "Moderate/Weak/Fair", "Good/Excellent/Strong" and "Perfect/Almost perfect" to report the proportions of each. In total, 60 studies were included in the analysis, with a total of 579 comparisons. The quality of included studies, assessed with the MINORS score, was sufficient in 52/60 studies. The most common test statistics were the Kappa statistics for categorical outcomes (424 comparisons) and the intra-class correlation coefficient (ICC) for continuous outcomes (73 comparisons). In the overall comparison of inter-observer agreement, only 23% were evaluated as "good" or "perfect"; for intra-observer agreement, this was the case in 36%. Sources of heterogeneity (high, I2 81.8-98.1%) were investigated with meta-regressions, showing a possible role of country, capsule type and year of publication in Kappa inter-observer agreement. VCE reading suffers from substantial heterogeneity and sub-optimal agreement in both inter- and intra-observer evaluation. Artificial-intelligence-based tools and the adoption of a unified terminology may progressively enhance levels of agreement in VCE reading.
Collapse
Affiliation(s)
- Pablo Cortegoso Valdivia
- Gastroenterology and Endoscopy Unit, University Hospital of Parma, University of Parma, 43126 Parma, Italy
| | - Ulrik Deding
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | - Thomas Bjørsum-Meyer
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | - Gunnar Baatrup
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | | | - Xavier Dray
- Center for Digestive Endoscopy, Sorbonne University, Saint Antoine Hospital, APHP, 75012 Paris, France
| | - Pedro Boal-Carvalho
- Gastroenterology Department, Hospital da Senhora da Oliveira, Creixomil, 4835 Guimarães, Portugal
| | - Pierre Ellul
- Division of Gastroenterology, Mater Dei Hospital, 2090 Msida, Malta
| | - Ervin Toth
- Department of Gastroenterology, Skåne University Hospital, Lund University, 20502 Malmö, Sweden
| | | | - Lasse Kaalby
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | - Marco Pennazio
- University Division of Gastroenterology, City of Health and Science University Hospital, University of Turin, 10126 Turin, Italy
| | - Anastasios Koulaouzidis
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Medicine, OUH Svendborg Sygehus, 5700 Svendborg, Denmark
- Surgical Research Unit, OUH, 5000 Odense, Denmark
- Department of Social Medicine and Public Health, Pomeranian Medical University, 70-204 Szczecin, Poland
| |
Collapse
|
6
|
Abstract
Since its clearance for use throughout the world, capsule endoscopy (CE) has become an important diagnostic tool, helping us to understand and document both normal and abnormal findings in the small intestine, especially in children, since CE usually can be employed without sedation or radiation. The indications in children and adults are similar, though their relative frequencies are different, with evaluation of potential and known inflammatory bowel disease the most common in the pediatric population, with CE also yielding increased diagnostic certainty compared to radiographic studies and surrogate biomarkers. Newer capsules now create opportunities to expand that understanding and our practices so that we can learn when and how to employ CE and pan-enteric CE to better monitor and guide therapy. It will take further studies to determine the best uses for CE and how to select the appropriate candidates, especially with ongoing concern about capsule ingestion vs. placement, the potential for capsule retention (particularly in known Crohn's disease), still elusive optimal methods for bowel cleansing, and the most meaningful scoring for research and clinical use.
Collapse
Affiliation(s)
- Stanley A. Cohen
- Children's Center for Digestive Health Care, Atlanta, GA, United States
| | - Salvatore Oliva
- Pediatric Gastroenterology and Liver Unit, Maternal and Child Health Department, University Hospital Umberto I, Sapienza - University of Rome, Rome, Italy
| |
Collapse
|
7
|
Sey M, Yan B, McDonald C, Segal D, Friedland J, Puka K, Jairath V. A randomized controlled trial of high volume simethicone to improve visualization during capsule endoscopy. PLoS One 2021; 16:e0249490. [PMID: 33793636 PMCID: PMC8016230 DOI: 10.1371/journal.pone.0249490] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Accepted: 03/16/2021] [Indexed: 12/22/2022] Open
Abstract
Background The optimal dose of simethicone before capsule endoscopy is unknown. Prior studies have reported inconsistent cleansing, with some showing improved visualization only in the proximal small intestine. We hypothesized a higher volume of simethicone may improve cleansing and diagnostic yield, especially in the distal small bowel. Methods A phase III randomized controlled trial was conducted comparing high volume (1125 mg simethicone in 750 ml water) versus standard volume (300 mg simethicone in 200 ml water) solutions, both at 1.5 mg/ml. The primary outcome was adequate bowel preparation, defined as a KOrea-CanaDA (KODA) score >2.25, overall and stratified by the proximal and distal half of the small bowel. Secondary outcomes included mean KODA score, diagnostic yield, completion rate, and adverse events. All analyses were intention-to-treat. Results A total of 167 patients were randomized (mean (SD) age 58.7 (15.7), 54% female) and the most common indication was obscure gastrointestinal bleeding (71.7%). Adequate cleansing was achieved in 39 (50%) patients in the high volume group and in 39 (48%) patients in the standard volume group (RR 1.04, 95% CI 0.76–1.43, p = 0.82), with no differences observed in the proximal half (71% vs 64%, p = 0.40) or the distal half -of the small bowel (36% vs. 37%, p = 0.88). There was no differences in the mean (SD) KODA score (2.20 (0.41) vs. 2.18 (0.44), p = 0.73), diagnostic yields (53% vs. 56%, p = 0.71), or completion rates (both 95%). One adverse event, nausea, occurred in the control group. Conclusion High volume simethicone does not improve visualization during capsule endoscopy. Clinical trial registration Clinical trial:NCT02334631.
Collapse
Affiliation(s)
- Michael Sey
- Division of Gastroenterology, Department of Medicine, Western University, London, Ontario, Canada
- Program for Experimental Medicine, Western University, London, Ontario, Canada
- Lawson Health Research Institute, London Health Sciences Centre, London, Ontario, Canada
- * E-mail:
| | - Brian Yan
- Division of Gastroenterology, Department of Medicine, Western University, London, Ontario, Canada
| | - Cassandra McDonald
- Lawson Health Research Institute, London Health Sciences Centre, London, Ontario, Canada
| | - Dan Segal
- Niagara Health System, McMaster University, Hamilton, Ontario, Canada
| | - Joshua Friedland
- Department of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Klajdi Puka
- Department of Epidemiology and Biostatistics, Western University, London, Ontario, Canada
| | - Vipul Jairath
- Division of Gastroenterology, Department of Medicine, Western University, London, Ontario, Canada
- Program for Experimental Medicine, Western University, London, Ontario, Canada
- Lawson Health Research Institute, London Health Sciences Centre, London, Ontario, Canada
- Department of Epidemiology and Biostatistics, Western University, London, Ontario, Canada
| |
Collapse
|