1
|
Kim BS, Cho M, Chung GE, Lee J, Kang HY, Yoon D, Cho WS, Lee JC, Bae JH, Kong HJ, Kim S. Density clustering-based automatic anatomical section recognition in colonoscopy video using deep learning. Sci Rep 2024; 14:872. [PMID: 38195632 PMCID: PMC10776865 DOI: 10.1038/s41598-023-51056-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 12/29/2023] [Indexed: 01/11/2024] Open
Abstract
Recognizing anatomical sections during colonoscopy is crucial for diagnosing colonic diseases and generating accurate reports. While recent studies have endeavored to identify anatomical regions of the colon using deep learning, the deformable anatomical characteristics of the colon pose challenges for establishing a reliable localization system. This study presents a system utilizing 100 colonoscopy videos, combining density clustering and deep learning. Cascaded CNN models are employed to estimate the appendix orifice (AO), flexures, and "outside of the body," sequentially. Subsequently, DBSCAN algorithm is applied to identify anatomical sections. Clustering-based analysis integrates clinical knowledge and context based on the anatomical section within the model. We address challenges posed by colonoscopy images through non-informative removal preprocessing. The image data is labeled by clinicians, and the system deduces section correspondence stochastically. The model categorizes the colon into three sections: right (cecum and ascending colon), middle (transverse colon), and left (descending colon, sigmoid colon, rectum). We estimated the appearance time of anatomical boundaries with an average error of 6.31 s for AO, 9.79 s for HF, 27.69 s for SF, and 3.26 s for outside of the body. The proposed method can facilitate future advancements towards AI-based automatic reporting, offering time-saving efficacy and standardization.
Collapse
Grants
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- IITP-2023-2018-0-01833 the Ministry of Science and ICT, Korea under the Information Technology Research Center (ITRC) support program
Collapse
Affiliation(s)
- Byeong Soo Kim
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Minwoo Cho
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, 03080, Korea
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, 03080, Korea
- Department of Medicine, Seoul National University College of Medicine, Seoul, 03080, Korea
| | - Goh Eun Chung
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Jooyoung Lee
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Hae Yeon Kang
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Dan Yoon
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Woo Sang Cho
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Jung Chan Lee
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, 03080, Korea
- Institute of Bioengineering, Seoul National University, Seoul, 08826, Republic of Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, 03080, Korea
| | - Jung Ho Bae
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea.
| | - Hyoun-Joong Kong
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, 03080, Korea.
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, 03080, Korea.
- Department of Medicine, Seoul National University College of Medicine, Seoul, 03080, Korea.
- Medical Big Data Research Center, Seoul National University College of Medicine, Seoul, 03087, Korea.
| | - Sungwan Kim
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, 03080, Korea.
- Institute of Bioengineering, Seoul National University, Seoul, 08826, Republic of Korea.
- Artificial Intelligence Institute, Seoul National University, Research Park Building 942, 2 Fl., Seoul, 08826, Korea.
| |
Collapse
|
3
|
Flor N, Ceretti AP, Luigiano C, Brambillasca P, Savoldi AP, Verrusio C, Ferrari D. Performance of CT Colonography in Diagnosis of Synchronous Colonic Lesions in Patients With Occlusive Colorectal Cancer. AJR Am J Roentgenol 2020; 214:348-354. [DOI: 10.2214/ajr.19.21810] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/30/2023]
Affiliation(s)
- Nicola Flor
- Unità Operativa di Radiologia Diagnostica e Interventistica, Azienda Servizi Socio Territoriali Santi Paolo e Carlo, Presido San Paolo, via di Rudinì 8, 20142 Milan, Italy
| | - Andrea Pisani Ceretti
- Unità Operativa di Chirurgia II, Azienda Ospedaliera Santi Paolo e Carlo, Milan, Italy
| | - Carmelo Luigiano
- Unità Operativa di Endoscopia Digestiva, Azienda Ospedaliera Santi Paolo e Carlo, Milan, Italy
| | - Pietro Brambillasca
- Postgraduate School in Radiodiagnostics, Facoltà di Medicina e Chirurgia, Università degli Studi di Milano, Milan, Italy
| | - Anna Paola Savoldi
- Postgraduate School in Radiodiagnostics, Facoltà di Medicina e Chirurgia, Università degli Studi di Milano, Milan, Italy
| | - Clemente Verrusio
- Unità Operativa di Chirurgia I, Azienda Ospedaliera Santi Paolo e Carlo, Milan, Italy
| | - Daris Ferrari
- Unità Operativa di Oncologia, Azienda Ospedaliera Santi Paolo e Carlo, Milan, Italy
| |
Collapse
|
5
|
Blum-Guzman JP, Wanderley de Melo S. Location of colorectal cancer: colonoscopy versus surgery. Yield of colonoscopy in predicting actual location. Endosc Int Open 2017; 5:E642-E645. [PMID: 28691047 PMCID: PMC5500114 DOI: 10.1055/s-0043-110564] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/21/2016] [Accepted: 01/17/2017] [Indexed: 01/11/2023] Open
Abstract
BACKGROUND AND STUDY AIMS Recent studies suggest that differences in biological characteristics and risk factors across cancer site within the colon and rectum may translate to differences in survival. It can be challenging at times to determine the precise anatomical location of a lesion with a luminal view during colonoscopy. The aim of this study is to determine if there is a significant difference between the location of colorectal cancers described by gastroenterologists in colonoscopies and the actual anatomical location noted on operative and pathology reports after colon surgery. PATIENTS AND METHODS A single-center retrospective analysis of colonoscopies of patient with reported colonic masses from January 2005 to April 2014 (n = 380) was carried. Assessed data included demography, operative and pathology reports. Findings were compared: between the location of colorectal cancers described by gastroenterologists in colonoscopies and the actual anatomical location noted on operative reports or pathology samples. RESULTS We identified 380 colonic masses, 158 were confirmed adenocarcinomas. Of these 123 underwent surgical resection, 27 had to be excluded since no specific location was reported on their operative or pathology report. An absolute difference between endoscopic and surgical location was found in 32 cases (33 %). Of these, 22 (23 %) differed by 1 colonic segment, 8 (8 %) differed by 2 colonic segments and 2 (2 %) differed by 3 colonic segments. CONCLUSION There is a significant difference between the location of colorectal cancers reported by gastroenterologists during endoscopy and the actual anatomical location noted on operative or pathology reports after colon surgery. Endoscopic tattooing should be used when faced with any luminal lesions of interest.
Collapse
Affiliation(s)
- Juan Pablo Blum-Guzman
- University of Florida College of Medicine Jacksonville, Jacksonville, Florida, United States
| | | |
Collapse
|