1
|
Mascarenhas M, Ribeiro T, Afonso J, Mendes F, Cardoso P, Martins M, Ferreira J, Macedo G. Smart Endoscopy Is Greener Endoscopy: Leveraging Artificial Intelligence and Blockchain Technologies to Drive Sustainability in Digestive Health Care. Diagnostics (Basel) 2023; 13:3625. [PMID: 38132209 PMCID: PMC10743290 DOI: 10.3390/diagnostics13243625] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Revised: 11/14/2023] [Accepted: 11/25/2023] [Indexed: 12/23/2023] Open
Abstract
The surge in the implementation of artificial intelligence (AI) in recent years has permeated many aspects of our life, and health care is no exception. Whereas this technology can offer clear benefits, some of the problems associated with its use have also been recognised and brought into question, for example, its environmental impact. In a similar fashion, health care also has a significant environmental impact, and it requires a considerable source of greenhouse gases. Whereas efforts are being made to reduce the footprint of AI tools, here, we were specifically interested in how employing AI tools in gastroenterology departments, and in particular in conjunction with capsule endoscopy, can reduce the carbon footprint associated with digestive health care while offering improvements, particularly in terms of diagnostic accuracy. We address the different ways that leveraging AI applications can reduce the carbon footprint associated with all types of capsule endoscopy examinations. Moreover, we contemplate how the incorporation of other technologies, such as blockchain technology, into digestive health care can help ensure the sustainability of this clinical speciality and by extension, health care in general.
Collapse
Affiliation(s)
- Miguel Mascarenhas
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal;
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| | - João Ferreira
- Faculty of Engineering, University of Porto, 4200-465 Porto, Portugal;
| | - Guilherme Macedo
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal;
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal; (T.R.); (J.A.); (P.C.); (M.M.)
- WGO Training Center, 4200-437 Porto, Portugal
| |
Collapse
|
2
|
Wang X, Hu X, Xu Y, Yong J, Li X, Zhang K, Gan T, Yang J, Rao N. A systematic review on diagnosis and treatment of gastrointestinal diseases by magnetically controlled capsule endoscopy and artificial intelligence. Therap Adv Gastroenterol 2023; 16:17562848231206991. [PMID: 37900007 PMCID: PMC10612444 DOI: 10.1177/17562848231206991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 09/21/2023] [Indexed: 10/31/2023] Open
Abstract
Background Magnetically controlled capsule endoscopy (MCCE) is a non-invasive, painless, comfortable, and safe equipment to diagnose gastrointestinal diseases (GID), partially overcoming the shortcomings of conventional endoscopy and wireless capsule endoscopy (WCE). With advancements in technology, the main technical parameters of MCCE have continuously been improved, and MCCE has become more intelligent. Objectives The aim of this systematic review was to summarize the research progress of MCCE and artificial intelligence (AI) in the diagnosis and treatment of GID. Data Sources and Methods We conducted a systematic search of PubMed and EMBASE for published studies on GID detection of MCCE, physical factors related to MCCE imaging quality, the application of AI in aiding MCCE, and its additional functions. We synergistically reviewed the included studies, extracted relevant data, and made comparisons. Results MCCE was confirmed to have the same performance as conventional gastroscopy and WCE in detecting common GID, while it lacks research in detecting early gastric cancer (EGC). The body position and cleanliness of the gastrointestinal tract are the main factors affecting imaging quality. The applications of AI in screening intestinal diseases have been comprehensive, while in the detection of common gastric diseases such as ulcers, it has been developed. MCCE can perform some additional functions, such as observations of drug behavior in the stomach and drug damage to the gastric mucosa. Furthermore, it can be improved to perform a biopsy. Conclusion This comprehensive review showed that the MCCE technology has made great progress, but studies on GID detection and treatment by MCCE are in the primary stage. Further studies are required to confirm the performance of MCCE.
Collapse
Affiliation(s)
- Xiaotong Wang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiaoming Hu
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Yongxue Xu
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Jiahao Yong
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiang Li
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Kaixuan Zhang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Tao Gan
- Digestive Endoscopic Center of West China Hospital, Sichuan University, Chengdu, China
| | - Jinlin Yang
- Digestive Endoscopic Center of West China Hospital, Sichuan University, No.37 Guoxue Alley, Wuhou District, Chengdu City, Chengdu, Sichuan Province 610017, China
| | - Nini Rao
- School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section Two, Jianshe North Road, Chengdu 610054, China
| |
Collapse
|
3
|
Oh S, Oh D, Kim D, Song W, Hwang Y, Cho N, Lim YJ. Video Analysis of Small Bowel Capsule Endoscopy Using a Transformer Network. Diagnostics (Basel) 2023; 13:3133. [PMID: 37835876 PMCID: PMC10572266 DOI: 10.3390/diagnostics13193133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 09/19/2023] [Accepted: 09/30/2023] [Indexed: 10/15/2023] Open
Abstract
Although wireless capsule endoscopy (WCE) detects small bowel diseases effectively, it has some limitations. For example, the reading process can be time consuming due to the numerous images generated per case and the lesion detection accuracy may rely on the operators' skills and experiences. Hence, many researchers have recently developed deep-learning-based methods to address these limitations. However, they tend to select only a portion of the images from a given WCE video and analyze each image individually. In this study, we note that more information can be extracted from the unused frames and the temporal relations of sequential frames. Specifically, to increase the accuracy of lesion detection without depending on experts' frame selection skills, we suggest using whole video frames as the input to the deep learning system. Thus, we propose a new Transformer-architecture-based neural encoder that takes the entire video as the input, exploiting the power of the Transformer architecture to extract long-term global correlation within and between the input frames. Subsequently, we can capture the temporal context of the input frames and the attentional features within a frame. Tests on benchmark datasets of four WCE videos showed 95.1% sensitivity and 83.4% specificity. These results may significantly advance automated lesion detection techniques for WCE images.
Collapse
Affiliation(s)
- SangYup Oh
- School of Electrical and Computer Engineering, Seoul National University, 1 Gwanak-ro, Kwanak-gu, Seoul 08826, Republic of Korea; (S.O.); (W.S.)
| | - DongJun Oh
- Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Republic of Korea;
| | - Dongmin Kim
- JLK TOWER, Gangnam-gu, Seoul 06141, Republic of Korea;
| | - Woohyuk Song
- School of Electrical and Computer Engineering, Seoul National University, 1 Gwanak-ro, Kwanak-gu, Seoul 08826, Republic of Korea; (S.O.); (W.S.)
| | - Youngbae Hwang
- Department of Electronics Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea;
| | - Namik Cho
- School of Electrical and Computer Engineering, Seoul National University, 1 Gwanak-ro, Kwanak-gu, Seoul 08826, Republic of Korea; (S.O.); (W.S.)
| | - Yun Jeong Lim
- Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Republic of Korea;
| |
Collapse
|
4
|
Kim MJ, Kim SH, Kim SM, Nam JH, Hwang YB, Lim YJ. The Advent of Domain Adaptation into Artificial Intelligence for Gastrointestinal Endoscopy and Medical Imaging. Diagnostics (Basel) 2023; 13:3023. [PMID: 37835766 PMCID: PMC10572560 DOI: 10.3390/diagnostics13193023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 09/01/2023] [Accepted: 09/12/2023] [Indexed: 10/15/2023] Open
Abstract
Artificial intelligence (AI) is a subfield of computer science that aims to implement computer systems that perform tasks that generally require human learning, reasoning, and perceptual abilities. AI is widely used in the medical field. The interpretation of medical images requires considerable effort, time, and skill. AI-aided interpretations, such as automated abnormal lesion detection and image classification, are promising areas of AI. However, when images with different characteristics are extracted, depending on the manufacturer and imaging environment, a so-called domain shift problem occurs in which the developed AI has a poor versatility. Domain adaptation is used to address this problem. Domain adaptation is a tool that generates a newly converted image which is suitable for other domains. It has also shown promise in reducing the differences in appearance among the images collected from different devices. Domain adaptation is expected to improve the reading accuracy of AI for heterogeneous image distributions in gastrointestinal (GI) endoscopy and medical image analyses. In this paper, we review the history and basic characteristics of domain shift and domain adaptation. We also address their use in gastrointestinal endoscopy and the medical field more generally through published examples, perspectives, and future directions.
Collapse
Affiliation(s)
- Min Ji Kim
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Republic of Korea; (M.J.K.); (S.H.K.); (J.H.N.)
| | - Sang Hoon Kim
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Republic of Korea; (M.J.K.); (S.H.K.); (J.H.N.)
| | - Suk Min Kim
- Department of Intelligent Systems and Robotics, College of Electrical & Computer Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea; (S.M.K.); (Y.B.H.)
| | - Ji Hyung Nam
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Republic of Korea; (M.J.K.); (S.H.K.); (J.H.N.)
| | - Young Bae Hwang
- Department of Intelligent Systems and Robotics, College of Electrical & Computer Engineering, Chungbuk National University, Cheongju 28644, Republic of Korea; (S.M.K.); (Y.B.H.)
| | - Yun Jeong Lim
- Division of Gastroenterology, Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Republic of Korea; (M.J.K.); (S.H.K.); (J.H.N.)
| |
Collapse
|
5
|
Ribeiro T, Mascarenhas Saraiva MJ, Afonso J, Cardoso P, Mendes F, Martins M, Andrade AP, Cardoso H, Mascarenhas Saraiva M, Ferreira J, Macedo G. Design of a Convolutional Neural Network as a Deep Learning Tool for the Automatic Classification of Small-Bowel Cleansing in Capsule Endoscopy. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:medicina59040810. [PMID: 37109768 PMCID: PMC10145655 DOI: 10.3390/medicina59040810] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/05/2023] [Revised: 04/03/2023] [Accepted: 04/06/2023] [Indexed: 04/29/2023]
Abstract
Background and objectives: Capsule endoscopy (CE) is a non-invasive method to inspect the small bowel that, like other enteroscopy methods, requires adequate small-bowel cleansing to obtain conclusive results. Artificial intelligence (AI) algorithms have been seen to offer important benefits in the field of medical imaging over recent years, particularly through the adaptation of convolutional neural networks (CNNs) to achieve more efficient image analysis. Here, we aimed to develop a deep learning model that uses a CNN to automatically classify the quality of intestinal preparation in CE. Methods: A CNN was designed based on 12,950 CE images obtained at two clinical centers in Porto (Portugal). The quality of the intestinal preparation was classified for each image as: excellent, ≥90% of the image surface with visible mucosa; satisfactory, 50-90% of the mucosa visible; and unsatisfactory, <50% of the mucosa visible. The total set of images was divided in an 80:20 ratio to establish training and validation datasets, respectively. The CNN prediction was compared with the classification established by consensus of a group of three experts in CE, currently considered the gold standard to evaluate cleanliness. Subsequently, how the CNN performed in diagnostic terms was evaluated using an independent validation dataset. Results: Among the images obtained, 3633 were designated as unsatisfactory preparation, 6005 satisfactory preparation, and 3312 with excellent preparation. When differentiating the classes of small-bowel preparation, the algorithm developed here achieved an overall accuracy of 92.1%, with a sensitivity of 88.4%, a specificity of 93.6%, a positive predictive value of 88.5%, and a negative predictive value of 93.4%. The area under the curve for the detection of excellent, satisfactory, and unsatisfactory classes was 0.98, 0.95, and 0.99, respectively. Conclusions: A CNN-based tool was developed to automatically classify small-bowel preparation for CE, and it was seen to accurately classify intestinal preparation for CE. The development of such a system could enhance the reproducibility of the scales used for such purposes.
Collapse
Affiliation(s)
- Tiago Ribeiro
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Miguel José Mascarenhas Saraiva
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| | - João Afonso
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Pedro Cardoso
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Francisco Mendes
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Miguel Martins
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Ana Patrícia Andrade
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| | - Hélder Cardoso
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| | | | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, 4200-465 Porto, Portugal
- INEGI-Institute of Science and Innovation in Mechanical and Industrial Engineering, 4200-465 Porto, Portugal
| | - Guilherme Macedo
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| |
Collapse
|
6
|
Mascarenhas M, Afonso J, Ribeiro T, Andrade P, Cardoso H, Macedo G. The Promise of Artificial Intelligence in Digestive Healthcare and the Bioethics Challenges It Presents. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:medicina59040790. [PMID: 37109748 PMCID: PMC10145124 DOI: 10.3390/medicina59040790] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 03/27/2023] [Accepted: 04/02/2023] [Indexed: 04/29/2023]
Abstract
With modern society well entrenched in the digital area, the use of Artificial Intelligence (AI) to extract useful information from big data has become more commonplace in our daily lives than we perhaps realize. Medical specialties that rely heavily on imaging techniques have become a strong focus for the incorporation of AI tools to aid disease diagnosis and monitoring, yet AI-based tools that can be employed in the clinic are only now beginning to become a reality. However, the potential introduction of these applications raises a number of ethical issues that must be addressed before they can be implemented, among the most important of which are issues related to privacy, data protection, data bias, explainability and responsibility. In this short review, we aim to highlight some of the most important bioethical issues that will have to be addressed if AI solutions are to be successfully incorporated into healthcare protocols, and ideally, before they are put in place. In particular, we contemplate the use of these aids in the field of gastroenterology, focusing particularly on capsule endoscopy and highlighting efforts aimed at resolving the issues associated with their use when available.
Collapse
Affiliation(s)
- Miguel Mascarenhas
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Patrícia Andrade
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Hélder Cardoso
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Guilherme Macedo
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| |
Collapse
|