1
|
Dalai SS, Ranjan Sahu BJ, Rautaray J, Khan MI, Jabr BA, Ali YA. Automated Bone Cancer Detection Using Deep Learning on X-Ray Images. Surg Innov 2025; 32:94-108. [PMID: 39679470 DOI: 10.1177/15533506241299886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2024]
Abstract
In recent days, bone cancer is a life-threatening health issue that can lead to death. However, physicians use CT-scan, X-rays, or MRI images to recognize bone cancer, but still require techniques to increase precision and reduce human labor. These methods face challenges such as high costs, time consumption, and the risk of misdiagnosis due to the complexity of bone tumor appearances. Therefore, it is essential to establish an automated system to detect healthy bones from cancerous ones. In this regard, Artificial intelligence, particularly deep learning, shows increased attention in the medical image analysis process. This research presents a new Golden Search Optimization along with Deep Learning Enabled Computer Aided Diagnosis for Bone Cancer Classification (GSODL-CADBCC) on X-ray images. The aim of the GSODL-CADBCC approach is to accurately distinguish the input X-ray images into healthy and cancerous. This research presents the GSODL-CADBCC technique that leverages the bilateral filtering technique to remove the noise. This method uses the SqueezeNet model to generate feature vectors, and the GSO algorithm efficiently selects the hyperparameters. Finally, the extracted features can be classified by improved cuckoo search with a long short-term memory model. The experimental results demonstrate that the GSODL- CADBCC approach attains highest performance with an average accuracy of 95.52% on the training set data and 94.79% on the testing set data. This automated approach not only reduces the need for manual interpretation but also minimizes the risk of diagnostic errors and provides a viable option for precise medical imaging-based bone cancer screening.
Collapse
Affiliation(s)
- Sasanka Sekhar Dalai
- Department of Computer Science and Engineering, Siksha 'O' Anusandhan (deemed to Be University), Bhubaneswar, India
| | - Bharat Jyoti Ranjan Sahu
- Department of Computer Science and Engineering, Siksha 'O' Anusandhan (deemed to Be University), Bhubaneswar, India
| | - Jyotirmayee Rautaray
- Department of Computer Science and Engineering, Siksha 'O' Anusandhan (deemed to Be University), Bhubaneswar, India
| | - M Ijaz Khan
- Department of Mechanical Engineering, Lebanese American University, Beirut, Lebanon
| | - Bander A Jabr
- Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| | - Yasser A Ali
- Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia
| |
Collapse
|
2
|
Sidhu R, Shiha MG, Carretero C, Koulaouzidis A, Dray X, Mussetto A, Keuchel M, Spada C, Despott EJ, Chetcuti Zammit S, McNamara D, Rondonotti E, Sabino J, Ferlitsch M. Performance measures for small-bowel endoscopy: a European Society of Gastrointestinal Endoscopy (ESGE) Quality Improvement Initiative - Update 2025. Endoscopy 2025; 57:366-389. [PMID: 39909070 DOI: 10.1055/a-2522-1995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2025]
Abstract
Quality markers and patient experience are being implemented to ensure standardization of practice across gastrointestinal (GI) endoscopy procedures. The set benchmarks ensure high quality procedures are delivered and linked to measurable outcomes.There has been an increase in the demand for small-bowel endoscopy. In 2019, the European Society of Gastrointestinal Endoscopy (ESGE) embarked on setting performance measures for small-bowel endoscopy. This included major (key) and minor performance indicators for both small-bowel capsule endoscopy (SBCE) and device-assisted enteroscopy (DAE). These suggested quality indicators cover all procedure domains, from patient selection and preparation, to intraprocedural aspects such as pathology identification, appropriate management, the patient experience, and post-procedure complications. Since 2019, there has been an increase in published studies looking at different aspects of small-bowel endoscopy, including real-world data. This paper provides an update on the 2019 performance measures, considering the latest literature.
Collapse
Affiliation(s)
- Reena Sidhu
- Academic Unit of Gastroenterology, Sheffield Teaching Hospitals, Sheffield, UK
- Division of Clinical Medicine, School of Medicine and Population Health, University of Sheffield, Sheffield, UK
| | - Mohamed G Shiha
- Academic Unit of Gastroenterology, Sheffield Teaching Hospitals, Sheffield, UK
- Division of Clinical Medicine, School of Medicine and Population Health, University of Sheffield, Sheffield, UK
| | - Cristina Carretero
- Department of Gastroenterology, University of Navarra Clinic, Healthcare Research Institute of Navarra, Pamplona, Spain
| | - Anastasios Koulaouzidis
- Surgical Research Unit, Odense University Hospital (OUH) and Svendborg Sygehus, Svendborg, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Department of Social Medicine and Public Health, Pomeranian Medical University, Szczecin, Poland
| | - Xavier Dray
- Sorbonne University, Center for Digestive Endoscopy, Sainte-Antoine Hospital, AP-HP, Paris, France
| | | | - Martin Keuchel
- Clinic for Internal Medicine, Agaplesion Bethesda Krankenhaus Bergedorf, Hamburg, Germany
| | - Cristiano Spada
- Digestive Endoscopy Unit and Gastroenterology, Fondazione Poliambulanza, Brescia, Italy
- Università Cattolica del Sacro Cuore, Rome, Italy
| | - Edward J Despott
- Royal Free Unit for Endoscopy, The Royal Free Hospital and UCL Institute for Liver and Digestive Health, London, UK
| | | | - Deirdre McNamara
- TAGG Research Centre, Department of Clinical Medicine, Trinity Centre, Tallaght Hospital, Dublin, Ireland
| | | | - João Sabino
- Department of Gastroenterology, University of Leuven, Leuven, Belgium
| | - Monika Ferlitsch
- Department of Internal Medicine III, Division of Gastroenterology and Hepatology, Medical University of Vienna, Vienna, Austria
- Department of Internal Medicine with Gastroenterology and Geriatrics, Klinik Floridsdorf, Vienna, Austria
| |
Collapse
|
3
|
Houdeville C, Souchaud M, Leenhardt R, Goltstein LC, Velut G, Beaumont H, Dray X, Histace A. Toward automated small bowel capsule endoscopy reporting using a summarizing machine learning algorithm: The SUM UP study. Clin Res Hepatol Gastroenterol 2025; 49:102509. [PMID: 39622290 DOI: 10.1016/j.clinre.2024.102509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2024] [Revised: 11/25/2024] [Accepted: 11/28/2024] [Indexed: 12/11/2024]
Abstract
BACKGROUND AND OBJECTIVES Deep learning (DL) algorithms demonstrate excellent diagnostic performance for the detection of vascular lesions via small bowel (SB) capsule endoscopy (CE), including vascular abnormalities with high (P2), intermediate (P1) or low (P0) bleeding potential, while dramatically decreasing the reading time. We aimed to improve the performance of a DL algorithm by characterizing vascular abnormalities using a machine learning (ML) classifier, and selecting the most relevant images for insertion into reports. MATERIALS AND METHODS A training dataset of 75 SB CE videos was created, containing 401 sequences of interest that encompassed 1,525 images of various vascular lesions. Several image classification algorithms were tested, to discriminate "typical angiodysplasia" (P2/P1) and "other vascular lesion" (P0) and to select the most relevant image within sequences with repetitive images. The performances of the best-fitting algorithms were subsequently assessed on an independent test dataset of 73 full-length SB CE video recordings. RESULTS Following DL detection, a random forest (RF) method demonstrated a specificity of 91.1 %, an area under the receiving operating characteristic curve of 0.873, and an accuracy of 84.2 % for discriminating P2/P1 from P0 lesions while allowing an 83.2 % reduction in the number of reported images. In the independent testing database, after RF was applied, the output number decreased by 91.6 %, from 216 (IQR 108-432) to 12 (IQR 5-33). The RF algorithm achieved 98.0 % agreement with initial, conventional (human) reporting. Following DL detection, the RF method allowed better characterization and accurate selection of images of relevant (P2/P1) SB vascular abnormalities for CE reporting without impairing diagnostic accuracy. These findings pave the way for automated SB CE reporting.
Collapse
Affiliation(s)
- Charles Houdeville
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France; Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France.
| | - Marc Souchaud
- Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France
| | - Romain Leenhardt
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France
| | - Lia Cmj Goltstein
- Department of Gastroenterology and Hepatology, Radboud University Medical Center, Nijmegen, Netherlands
| | - Guillaume Velut
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France; Department of Gastroenterology CHU Nantes, Hotel Dieu, Nantes, France
| | - Hanneke Beaumont
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, Netherlands
| | - Xavier Dray
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France; Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France
| | - Aymeric Histace
- Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France
| |
Collapse
|
4
|
Mota J, Almeida MJ, Mendes F, Martins M, Ribeiro T, Afonso J, Cardoso P, Cardoso H, Andrade P, Ferreira J, Mascarenhas M, Macedo G. From Data to Insights: How Is AI Revolutionizing Small-Bowel Endoscopy? Diagnostics (Basel) 2024; 14:291. [PMID: 38337807 PMCID: PMC10855436 DOI: 10.3390/diagnostics14030291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 01/09/2024] [Accepted: 01/16/2024] [Indexed: 02/12/2024] Open
Abstract
The role of capsule endoscopy and enteroscopy in managing various small-bowel pathologies is well-established. However, their broader application has been hampered mainly by their lengthy reading times. As a result, there is a growing interest in employing artificial intelligence (AI) in these diagnostic and therapeutic procedures, driven by the prospect of overcoming some major limitations and enhancing healthcare efficiency, while maintaining high accuracy levels. In the past two decades, the applicability of AI to gastroenterology has been increasing, mainly because of the strong imaging component. Nowadays, there are a multitude of studies using AI, specifically using convolutional neural networks, that prove the potential applications of AI to these endoscopic techniques, achieving remarkable results. These findings suggest that there is ample opportunity for AI to expand its presence in the management of gastroenterology diseases and, in the future, catalyze a game-changing transformation in clinical activities. This review provides an overview of the current state-of-the-art of AI in the scope of small-bowel study, with a particular focus on capsule endoscopy and enteroscopy.
Collapse
Affiliation(s)
- Joana Mota
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Maria João Almeida
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Helder Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Patrícia Andrade
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering, University of Porto, R. Dr. Roberto Frias, 4200-465 Porto, Portugal;
- Digestive Artificial Intelligence Development, R. Alfredo Allen 455-461, 4200-135 Porto, Portugal
| | - Miguel Mascarenhas
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- ManopH Gastroenterology Clinic, R. de Sá da Bandeira 752, 4000-432 Porto, Portugal
| | - Guilherme Macedo
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal (G.M.)
- WGO Gastroenterology and Hepatology Training Center, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| |
Collapse
|
5
|
Zhang RY, Qiang PP, Cai LJ, Li T, Qin Y, Zhang Y, Zhao YQ, Wang JP. Automatic detection of small bowel lesions with different bleeding risks based on deep learning models. World J Gastroenterol 2024; 30:170-183. [PMID: 38312122 PMCID: PMC10835517 DOI: 10.3748/wjg.v30.i2.170] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 12/15/2023] [Accepted: 12/26/2023] [Indexed: 01/12/2024] Open
Abstract
BACKGROUND Deep learning provides an efficient automatic image recognition method for small bowel (SB) capsule endoscopy (CE) that can assist physicians in diagnosis. However, the existing deep learning models present some unresolved challenges. AIM To propose a novel and effective classification and detection model to automatically identify various SB lesions and their bleeding risks, and label the lesions accurately so as to enhance the diagnostic efficiency of physicians and the ability to identify high-risk bleeding groups. METHODS The proposed model represents a two-stage method that combined image classification with object detection. First, we utilized the improved ResNet-50 classification model to classify endoscopic images into SB lesion images, normal SB mucosa images, and invalid images. Then, the improved YOLO-V5 detection model was utilized to detect the type of lesion and its risk of bleeding, and the location of the lesion was marked. We constructed training and testing sets and compared model-assisted reading with physician reading. RESULTS The accuracy of the model constructed in this study reached 98.96%, which was higher than the accuracy of other systems using only a single module. The sensitivity, specificity, and accuracy of the model-assisted reading detection of all images were 99.17%, 99.92%, and 99.86%, which were significantly higher than those of the endoscopists' diagnoses. The image processing time of the model was 48 ms/image, and the image processing time of the physicians was 0.40 ± 0.24 s/image (P < 0.001). CONCLUSION The deep learning model of image classification combined with object detection exhibits a satisfactory diagnostic effect on a variety of SB lesions and their bleeding risks in CE images, which enhances the diagnostic efficiency of physicians and improves the ability of physicians to identify high-risk bleeding groups.
Collapse
Affiliation(s)
- Rui-Ya Zhang
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Peng-Peng Qiang
- School of Computer and Information Technology, Shanxi University, Taiyuan 030006, Shanxi Province, China
| | - Ling-Jun Cai
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Tao Li
- School of Life Sciences and Technology, Mudanjiang Normal University, Mudanjiang 157011, Heilongjiang Province, China
| | - Yan Qin
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Yu Zhang
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Yi-Qing Zhao
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Jun-Ping Wang
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| |
Collapse
|
6
|
Zhu Y, Lyu X, Tao X, Wu L, Yin A, Liao F, Hu S, Wang Y, Zhang M, Huang L, Wang J, Zhang C, Gong D, Jiang X, Zhao L, Yu H. A newly developed deep learning-based system for automatic detection and classification of small bowel lesions during double-balloon enteroscopy examination. BMC Gastroenterol 2024; 24:10. [PMID: 38166722 PMCID: PMC10759410 DOI: 10.1186/s12876-023-03067-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/08/2023] [Accepted: 11/28/2023] [Indexed: 01/05/2024] Open
Abstract
BACKGROUND Double-balloon enteroscopy (DBE) is a standard method for diagnosing and treating small bowel disease. However, DBE may yield false-negative results due to oversight or inexperience. We aim to develop a computer-aided diagnostic (CAD) system for the automatic detection and classification of small bowel abnormalities in DBE. DESIGN AND METHODS A total of 5201 images were collected from Renmin Hospital of Wuhan University to construct a detection model for localizing lesions during DBE, and 3021 images were collected to construct a classification model for classifying lesions into four classes, protruding lesion, diverticulum, erosion & ulcer and angioectasia. The performance of the two models was evaluated using 1318 normal images and 915 abnormal images and 65 videos from independent patients and then compared with that of 8 endoscopists. The standard answer was the expert consensus. RESULTS For the image test set, the detection model achieved a sensitivity of 92% (843/915) and an area under the curve (AUC) of 0.947, and the classification model achieved an accuracy of 86%. For the video test set, the accuracy of the system was significantly better than that of the endoscopists (85% vs. 77 ± 6%, p < 0.01). For the video test set, the proposed system was superior to novices and comparable to experts. CONCLUSIONS We established a real-time CAD system for detecting and classifying small bowel lesions in DBE with favourable performance. ENDOANGEL-DBE has the potential to help endoscopists, especially novices, in clinical practice and may reduce the miss rate of small bowel lesions.
Collapse
Affiliation(s)
- Yijie Zhu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xiaoguang Lyu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xiao Tao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Lianlian Wu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Anning Yin
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Fei Liao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Shan Hu
- School of Computer Science, Wuhan University, Wuhan, China
| | - Yang Wang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Mengjiao Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Li Huang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Junxiao Wang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Chenxia Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Dexin Gong
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xiaoda Jiang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China
| | - Liang Zhao
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China.
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China.
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China.
| | - Honggang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China.
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China.
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, China.
| |
Collapse
|
7
|
Mendes F, Mascarenhas M, Ribeiro T, Afonso J, Cardoso P, Martins M, Cardoso H, Andrade P, Ferreira JPS, Mascarenhas Saraiva M, Macedo G. Artificial Intelligence and Panendoscopy-Automatic Detection of Clinically Relevant Lesions in Multibrand Device-Assisted Enteroscopy. Cancers (Basel) 2024; 16:208. [PMID: 38201634 PMCID: PMC10778030 DOI: 10.3390/cancers16010208] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 12/27/2023] [Accepted: 12/28/2023] [Indexed: 01/12/2024] Open
Abstract
Device-assisted enteroscopy (DAE) is capable of evaluating the entire gastrointestinal tract, identifying multiple lesions. Nevertheless, DAE's diagnostic yield is suboptimal. Convolutional neural networks (CNN) are multi-layer architecture artificial intelligence models suitable for image analysis, but there is a lack of studies about their application in DAE. Our group aimed to develop a multidevice CNN for panendoscopic detection of clinically relevant lesions during DAE. In total, 338 exams performed in two specialized centers were retrospectively evaluated, with 152 single-balloon enteroscopies (Fujifilm®, Porto, Portugal), 172 double-balloon enteroscopies (Olympus®, Porto, Portugal) and 14 motorized spiral enteroscopies (Olympus®, Porto, Portugal); then, 40,655 images were divided in a training dataset (90% of the images, n = 36,599) and testing dataset (10% of the images, n = 4066) used to evaluate the model. The CNN's output was compared to an expert consensus classification. The model was evaluated by its sensitivity, specificity, positive (PPV) and negative predictive values (NPV), accuracy and area under the precision recall curve (AUC-PR). The CNN had an 88.9% sensitivity, 98.9% specificity, 95.8% PPV, 97.1% NPV, 96.8% accuracy and an AUC-PR of 0.97. Our group developed the first multidevice CNN for panendoscopic detection of clinically relevant lesions during DAE. The development of accurate deep learning models is of utmost importance for increasing the diagnostic yield of DAE-based panendoscopy.
Collapse
Affiliation(s)
- Francisco Mendes
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
| | - Miguel Mascarenhas
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Tiago Ribeiro
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João Afonso
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Pedro Cardoso
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Miguel Martins
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
| | - Hélder Cardoso
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Patrícia Andrade
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João P. S. Ferreira
- Department of Mechanical Engineering, Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, 4200-465 Porto, Portugal;
- DigestAID—Digestive Artificial Intelligence Development, R. Alfredo Allen n°. 455/461, 4200-135 Porto, Portugal
| | | | - Guilherme Macedo
- Alameda Professor Hernâni Monteiro, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (F.M.); (T.R.); (P.C.); (M.M.); (P.A.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| |
Collapse
|
8
|
Mascarenhas M, Ribeiro T, Afonso J, Mendes F, Cardoso P, Martins M, Ferreira J, Macedo G. Smart Endoscopy Is Greener Endoscopy: Leveraging Artificial Intelligence and Blockchain Technologies to Drive Sustainability in Digestive Health Care. Diagnostics (Basel) 2023; 13:3625. [PMID: 38132209 PMCID: PMC10743290 DOI: 10.3390/diagnostics13243625] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Revised: 11/14/2023] [Accepted: 11/25/2023] [Indexed: 12/23/2023] Open
Abstract
The surge in the implementation of artificial intelligence (AI) in recent years has permeated many aspects of our life, and health care is no exception. Whereas this technology can offer clear benefits, some of the problems associated with its use have also been recognised and brought into question, for example, its environmental impact. In a similar fashion, health care also has a significant environmental impact, and it requires a considerable source of greenhouse gases. Whereas efforts are being made to reduce the footprint of AI tools, here, we were specifically interested in how employing AI tools in gastroenterology departments, and in particular in conjunction with capsule endoscopy, can reduce the carbon footprint associated with digestive health care while offering improvements, particularly in terms of diagnostic accuracy. We address the different ways that leveraging AI applications can reduce the carbon footprint associated with all types of capsule endoscopy examinations. Moreover, we contemplate how the incorporation of other technologies, such as blockchain technology, into digestive health care can help ensure the sustainability of this clinical speciality and by extension, health care in general.
Collapse
Affiliation(s)
- Miguel Mascarenhas
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal;
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - João Ferreira
- Faculty of Engineering, University of Porto, 4200-465 Porto, Portugal;
| | - Guilherme Macedo
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal;
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| |
Collapse
|
9
|
Popa SL, Stancu B, Ismaiel A, Turtoi DC, Brata VD, Duse TA, Bolchis R, Padureanu AM, Dita MO, Bashimov A, Incze V, Pinna E, Grad S, Pop AV, Dumitrascu DI, Munteanu MA, Surdea-Blaga T, Mihaileanu FV. Enteroscopy versus Video Capsule Endoscopy for Automatic Diagnosis of Small Bowel Disorders-A Comparative Analysis of Artificial Intelligence Applications. Biomedicines 2023; 11:2991. [PMID: 38001991 PMCID: PMC10669430 DOI: 10.3390/biomedicines11112991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 10/26/2023] [Accepted: 11/05/2023] [Indexed: 11/26/2023] Open
Abstract
BACKGROUND Small bowel disorders present a diagnostic challenge due to the limited accessibility of the small intestine. Accurate diagnosis is made with the aid of specific procedures, like capsule endoscopy or double-ballon enteroscopy, but they are not usually solicited and not widely accessible. This study aims to assess and compare the diagnostic effectiveness of enteroscopy and video capsule endoscopy (VCE) when combined with artificial intelligence (AI) algorithms for the automatic detection of small bowel diseases. MATERIALS AND METHODS We performed an extensive literature search for relevant studies about AI applications capable of identifying small bowel disorders using enteroscopy and VCE, published between 2012 and 2023, employing PubMed, Cochrane Library, Google Scholar, Embase, Scopus, and ClinicalTrials.gov databases. RESULTS Our investigation discovered a total of 27 publications, out of which 21 studies assessed the application of VCE, while the remaining 6 articles analyzed the enteroscopy procedure. The included studies portrayed that both investigations, enhanced by AI, exhibited a high level of diagnostic accuracy. Enteroscopy demonstrated superior diagnostic capability, providing precise identification of small bowel pathologies with the added advantage of enabling immediate therapeutic intervention. The choice between these modalities should be guided by clinical context, patient preference, and resource availability. Studies with larger sample sizes and prospective designs are warranted to validate these results and optimize the integration of AI in small bowel diagnostics. CONCLUSIONS The current analysis demonstrates that both enteroscopy and VCE with AI augmentation exhibit comparable diagnostic performance for the automatic detection of small bowel disorders.
Collapse
Affiliation(s)
- Stefan Lucian Popa
- 2nd Medical Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (S.L.P.); (A.I.); (S.G.); (A.-V.P.); (T.S.-B.)
| | - Bogdan Stancu
- 2nd Surgical Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400347 Cluj-Napoca, Romania;
| | - Abdulrahman Ismaiel
- 2nd Medical Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (S.L.P.); (A.I.); (S.G.); (A.-V.P.); (T.S.-B.)
| | - Daria Claudia Turtoi
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Vlad Dumitru Brata
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Traian Adrian Duse
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Roxana Bolchis
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Alexandru Marius Padureanu
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Miruna Oana Dita
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Atamyrat Bashimov
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Victor Incze
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Edoardo Pinna
- Faculty of Medicine, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (D.C.T.); (V.D.B.); (T.A.D.); (R.B.); (A.M.P.); (M.O.D.); (A.B.); (V.I.); (E.P.)
| | - Simona Grad
- 2nd Medical Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (S.L.P.); (A.I.); (S.G.); (A.-V.P.); (T.S.-B.)
| | - Andrei-Vasile Pop
- 2nd Medical Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (S.L.P.); (A.I.); (S.G.); (A.-V.P.); (T.S.-B.)
| | - Dinu Iuliu Dumitrascu
- Department of Anatomy, “Iuliu Hatieganu“ University of Medicine and Pharmacy, 400006 Cluj-Napoca, Romania;
| | - Mihai Alexandru Munteanu
- Department of Medical Disciplines, Faculty of Medicine and Pharmacy, University of Oradea, 410087 Oradea, Romania;
| | - Teodora Surdea-Blaga
- 2nd Medical Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania; (S.L.P.); (A.I.); (S.G.); (A.-V.P.); (T.S.-B.)
| | - Florin Vasile Mihaileanu
- 2nd Surgical Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400347 Cluj-Napoca, Romania;
| |
Collapse
|
10
|
Deep-Learning and Device-Assisted Enteroscopy: Automatic Panendoscopic Detection of Ulcers and Erosions. Medicina (B Aires) 2023; 59:medicina59010172. [PMID: 36676796 PMCID: PMC9865285 DOI: 10.3390/medicina59010172] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Revised: 01/03/2023] [Accepted: 01/06/2023] [Indexed: 01/17/2023] Open
Abstract
Background and Objectives: Device-assisted enteroscopy (DAE) has a significant role in approaching enteric lesions. Endoscopic observation of ulcers or erosions is frequent and can be associated with many nosological entities, namely Crohn's disease. Although the application of artificial intelligence (AI) is growing exponentially in various imaged-based gastroenterology procedures, there is still a lack of evidence of the AI technical feasibility and clinical applicability of DAE. This study aimed to develop and test a multi-brand convolutional neural network (CNN)-based algorithm for automatically detecting ulcers and erosions in DAE. Materials and Methods: A unicentric retrospective study was conducted for the development of a CNN, based on a total of 250 DAE exams. A total of 6772 images were used, of which 678 were considered ulcers or erosions after double-validation. Data were divided into a training and a validation set, the latter being used for the performance assessment of the model. Our primary outcome measures were sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), and an area under the curve precision-recall curve (AUC-PR). Results: Sensitivity, specificity, PPV, and NPV were respectively 88.5%, 99.7%, 96.4%, and 98.9%. The algorithm's accuracy was 98.7%. The AUC-PR was 1.00. The CNN processed 293.6 frames per second, enabling AI live application in a real-life clinical setting in DAE. Conclusion: To the best of our knowledge, this is the first study regarding the automatic multi-brand panendoscopic detection of ulcers and erosions throughout the digestive tract during DAE, overcoming a relevant interoperability challenge. Our results highlight that using a CNN to detect this type of lesion is associated with high overall accuracy. The development of binary CNN for automatically detecting clinically relevant endoscopic findings and assessing endoscopic inflammatory activity are relevant steps toward AI application in digestive endoscopy, particularly for panendoscopic evaluation.
Collapse
|
11
|
Deep Learning Multi-Domain Model Provides Accurate Detection and Grading of Mucosal Ulcers in Different Capsule Endoscopy Types. Diagnostics (Basel) 2022; 12:diagnostics12102490. [PMID: 36292178 PMCID: PMC9600959 DOI: 10.3390/diagnostics12102490] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 10/06/2022] [Accepted: 10/08/2022] [Indexed: 11/17/2022] Open
Abstract
Background and Aims: The aim of our study was to create an accurate patient-level combined algorithm for the identification of ulcers on CE images from two different capsules. Methods: We retrospectively collected CE images from PillCam-SB3′s capsule and PillCam-Crohn’s capsule. ML algorithms were trained to classify small bowel CE images into either normal or ulcerated mucosa: a separate model for each capsule type, a cross-domain model (training the model on one capsule type and testing on the other), and a combined model. Results: The dataset included 33,100 CE images: 20,621 PillCam-SB3 images and 12,479 PillCam-Crohn’s images, of which 3582 were colonic images. There were 15,684 normal mucosa images and 17,416 ulcerated mucosa images. While the separate model for each capsule type achieved excellent accuracy (average AUC 0.95 and 0.98, respectively), the cross-domain model achieved a wide range of accuracies (0.569–0.88) with an AUC of 0.93. The combined model achieved the best results with an average AUC of 0.99 and average mean patient accuracy of 0.974. Conclusions: A combined model for two different capsules provided high and consistent diagnostic accuracy. Creating a holistic AI model for automated capsule reading is an essential part of the refinement required in ML models on the way to adapting them to clinical practice.
Collapse
|
12
|
Georgeanu VA, Mămuleanu M, Ghiea S, Selișteanu D. Malignant Bone Tumors Diagnosis Using Magnetic Resonance Imaging Based on Deep Learning Algorithms. Medicina (B Aires) 2022; 58:medicina58050636. [PMID: 35630053 PMCID: PMC9147948 DOI: 10.3390/medicina58050636] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Revised: 04/29/2022] [Accepted: 05/02/2022] [Indexed: 11/16/2022] Open
Abstract
Background and Objectives: Malignant bone tumors represent a major problem due to their aggressiveness and low survival rate. One of the determining factors for improving vital and functional prognosis is the shortening of the time between the onset of symptoms and the moment when treatment starts. The objective of the study is to predict the malignancy of a bone tumor from magnetic resonance imaging (MRI) using deep learning algorithms. Materials and Methods: The cohort contained 23 patients in the study (14 women and 9 men with ages between 15 and 80). Two pretrained ResNet50 image classifiers are used to classify T1 and T2 weighted MRI scans. To predict the malignancy of a tumor, a clinical model is used. The model is a feed forward neural network whose inputs are patient clinical data and the output values of T1 and T2 classifiers. Results: For the training step, the accuracies of 93.67% for the T1 classifier and 86.67% for the T2 classifier were obtained. In validation, both classifiers obtained 95.00% accuracy. The clinical model had an accuracy of 80.84% for training phase and 80.56% for validation. The receiver operating characteristic curve (ROC) of the clinical model shows that the algorithm can perform class separation. Conclusions: The proposed method is based on pretrained deep learning classifiers which do not require a manual segmentation of the MRI images. These algorithms can be used to predict the malignancy of a tumor and on the other hand can shorten the time of their diagnosis and treatment process. While the proposed method requires minimal intervention from an imagist, it needs to be tested on a larger cohort of patients.
Collapse
Affiliation(s)
- Vlad Alexandru Georgeanu
- Department of General Medicine, “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania;
- Orthopaedics and Trauma Surgery Department, “St. Pantelimon” Hospital, 021659 Bucharest, Romania
| | - Mădălin Mămuleanu
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania;
- Oncometrics S.R.L., 200677 Craiova, Romania
- Correspondence: ; Tel.: +40-762-893-723
| | | | - Dan Selișteanu
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania;
| |
Collapse
|