1
|
Iacucci M, Santacroce G, Zammarchi I, Maeda Y, Del Amor R, Meseguer P, Kolawole BB, Chaudhari U, Di Sabatino A, Danese S, Mori Y, Grisan E, Naranjo V, Ghosh S. Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease. Lancet Gastroenterol Hepatol 2024; 9:758-772. [PMID: 38759661 DOI: 10.1016/s2468-1253(24)00053-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 02/16/2024] [Accepted: 02/23/2024] [Indexed: 05/19/2024]
Abstract
Integrating artificial intelligence into inflammatory bowel disease (IBD) has the potential to revolutionise clinical practice and research. Artificial intelligence harnesses advanced algorithms to deliver accurate assessments of IBD endoscopy and histology, offering precise evaluations of disease activity, standardised scoring, and outcome prediction. Furthermore, artificial intelligence offers the potential for a holistic endo-histo-omics approach by interlacing and harmonising endoscopy, histology, and omics data towards precision medicine. The emerging applications of artificial intelligence could pave the way for personalised medicine in IBD, offering patient stratification for the most beneficial therapy with minimal risk. Although artificial intelligence holds promise, challenges remain, including data quality, standardisation, reproducibility, scarcity of randomised controlled trials, clinical implementation, ethical concerns, legal liability, and regulatory issues. The development of standardised guidelines and interdisciplinary collaboration, including policy makers and regulatory agencies, is crucial for addressing these challenges and advancing artificial intelligence in IBD clinical practice and trials.
Collapse
Affiliation(s)
- Marietta Iacucci
- APC Microbiome Ireland, College of Medicine and Health, University College of Cork, Cork, Ireland.
| | - Giovanni Santacroce
- APC Microbiome Ireland, College of Medicine and Health, University College of Cork, Cork, Ireland
| | - Irene Zammarchi
- APC Microbiome Ireland, College of Medicine and Health, University College of Cork, Cork, Ireland
| | - Yasuharu Maeda
- APC Microbiome Ireland, College of Medicine and Health, University College of Cork, Cork, Ireland
| | - Rocío Del Amor
- Instituto de Investigación e Innovación en Bioingeniería, HUMAN-tech, Universitat Politècnica de València, València, Spain
| | - Pablo Meseguer
- Instituto de Investigación e Innovación en Bioingeniería, HUMAN-tech, Universitat Politècnica de València, València, Spain; Valencian Graduate School and Research Network of Artificial Intelligence, Valencia, Spain
| | | | | | - Antonio Di Sabatino
- Department of Internal Medicine and Medical Therapeutics, University of Pavia, Pavia, Italy; First Department of Internal Medicine, San Matteo Hospital Foundation, Pavia, Italy
| | - Silvio Danese
- Gastroenterology and Endoscopy, IRCCS Ospedale San Raffaele and University Vita-Salute San Raffaele, Milan, Italy
| | - Yuichi Mori
- Clinical Effectiveness Research Group, University of Oslo, Oslo, Norway; Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Enrico Grisan
- School of Engineering, London South Bank University, London, UK
| | - Valery Naranjo
- Instituto de Investigación e Innovación en Bioingeniería, HUMAN-tech, Universitat Politècnica de València, València, Spain
| | - Subrata Ghosh
- APC Microbiome Ireland, College of Medicine and Health, University College of Cork, Cork, Ireland
| |
Collapse
|
2
|
Zhang J, Liu R, Wang X, Zhang S, Shao L, Liu J, Zhao J, Wang Q, Tian J, Lu Y. Deep learning model based on endoscopic images predicting treatment response in locally advanced rectal cancer undergo neoadjuvant chemoradiotherapy: a multicenter study. J Cancer Res Clin Oncol 2024; 150:350. [PMID: 39001926 DOI: 10.1007/s00432-024-05876-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Accepted: 06/29/2024] [Indexed: 07/15/2024]
Abstract
PURPOSE Neoadjuvant chemoradiotherapy has been the standard practice for patients with locally advanced rectal cancer. However, the treatment response varies greatly among individuals, how to select the optimal candidates for neoadjuvant chemoradiotherapy is crucial. This study aimed to develop an endoscopic image-based deep learning model for predicting the response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer. METHODS In this multicenter observational study, pre-treatment endoscopic images of patients from two Chinese medical centers were retrospectively obtained and a deep learning-based tumor regression model was constructed. Treatment response was evaluated based on the tumor regression grade and was defined as good response and non-good response. The prediction performance of the deep learning model was evaluated in the internal and external test sets. The main outcome was the accuracy of the treatment prediction model, measured by the AUC and accuracy. RESULTS This deep learning model achieved favorable prediction performance. In the internal test set, the AUC and accuracy were 0.867 (95% CI: 0.847-0.941) and 0.836 (95% CI: 0.818-0.896), respectively. The prediction performance was fully validated in the external test set, and the model had an AUC of 0.758 (95% CI: 0.724-0.834) and an accuracy of 0.807 (95% CI: 0.774-0.843). CONCLUSION The deep learning model based on endoscopic images demonstrated exceptional predictive power for neoadjuvant treatment response, highlighting its potential for guiding personalized therapy.
Collapse
Affiliation(s)
- Junhao Zhang
- Department of Gastrointestinal Surgery, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Shinan District, Qingdao, 266003, China
| | - Ruiqing Liu
- Department of Gastrointestinal Surgery, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Shinan District, Qingdao, 266003, China
| | - Xujian Wang
- Graduate School for Elite Engineers, Shandong University, Jinan, China
| | - Shiwei Zhang
- Department of Gastric and Colorectal Surgery, General Surgery Center, The First Hospital of Jilin University, Changchun, China
| | - Lizhi Shao
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Junheng Liu
- Department of Gastroenterology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Jiahui Zhao
- Department of Gastroenterology, Endoscopy Center, The First Hospital of Jilin University, Changchun, China
| | - Quan Wang
- Department of Gastric and Colorectal Surgery, General Surgery Center, The First Hospital of Jilin University, Changchun, China
| | - Jie Tian
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
- School of Engineering Medicine, Beihang University, Beijing, 100191, China.
| | - Yun Lu
- Department of Gastrointestinal Surgery, The Affiliated Hospital of Qingdao University, No. 16, Jiangsu Road, Shinan District, Qingdao, 266003, China.
| |
Collapse
|
3
|
Iwai T, Kida M, Okuwaki K, Watanabe M, Adachi K, Ishizaki J, Hanaoka T, Tamaki A, Tadehara M, Imaizumi H, Kusano C. Deep learning analysis for differential diagnosis and risk classification of gastrointestinal tumors. Scand J Gastroenterol 2024:1-8. [PMID: 38950889 DOI: 10.1080/00365521.2024.2368241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Accepted: 06/08/2024] [Indexed: 07/03/2024]
Abstract
OBJECTIVES Recently, artificial intelligence (AI) has been applied to clinical diagnosis. Although AI has already been developed for gastrointestinal (GI) tract endoscopy, few studies have applied AI to endoscopic ultrasound (EUS) images. In this study, we used a computer-assisted diagnosis (CAD) system with deep learning analysis of EUS images (EUS-CAD) and assessed its ability to differentiate GI stromal tumors (GISTs) from other mesenchymal tumors and their risk classification performance. MATERIALS AND METHODS A total of 101 pathologically confirmed cases of subepithelial lesions (SELs) arising from the muscularis propria layer, including 69 GISTs, 17 leiomyomas and 15 schwannomas, were examined. A total of 3283 EUS images were used for training and five-fold-cross-validation, and 827 images were independently tested for diagnosing GISTs. For the risk classification of 69 GISTs, including very-low-, low-, intermediate- and high-risk GISTs, 2,784 EUS images were used for training and three-fold-cross-validation. RESULTS For the differential diagnostic performance of GIST among all SELs, the accuracy, sensitivity, specificity and area under the receiver operating characteristic (ROC) curve were 80.4%, 82.9%, 75.3% and 0.865, respectively, whereas those for intermediate- and high-risk GISTs were 71.8%, 70.2%, 72.0% and 0.771, respectively. CONCLUSIONS The EUS-CAD system showed a good diagnostic yield in differentiating GISTs from other mesenchymal tumors and successfully demonstrated the GIST risk classification feasibility. This system can determine whether treatment is necessary based on EUS imaging alone without the need for additional invasive examinations.
Collapse
Affiliation(s)
- Tomohisa Iwai
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Mitsuhiro Kida
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Kosuke Okuwaki
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Masafumi Watanabe
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Kai Adachi
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Junro Ishizaki
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Taro Hanaoka
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Akihiro Tamaki
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Masayoshi Tadehara
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Hiroshi Imaizumi
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| | - Chika Kusano
- Department of Gastroenterology, Kitasato University School of Medicine, Sagamihara, Japan
| |
Collapse
|
4
|
Biffi C, Antonelli G, Bernhofer S, Hassan C, Hirata D, Iwatate M, Maieron A, Salvagnini P, Cherubini A. REAL-Colon: A dataset for developing real-world AI applications in colonoscopy. Sci Data 2024; 11:539. [PMID: 38796533 PMCID: PMC11127922 DOI: 10.1038/s41597-024-03359-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 05/10/2024] [Indexed: 05/28/2024] Open
Abstract
Detection and diagnosis of colon polyps are key to preventing colorectal cancer. Recent evidence suggests that AI-based computer-aided detection (CADe) and computer-aided diagnosis (CADx) systems can enhance endoscopists' performance and boost colonoscopy effectiveness. However, most available public datasets primarily consist of still images or video clips, often at a down-sampled resolution, and do not accurately represent real-world colonoscopy procedures. We introduce the REAL-Colon (Real-world multi-center Endoscopy Annotated video Library) dataset: a compilation of 2.7 M native video frames from sixty full-resolution, real-world colonoscopy recordings across multiple centers. The dataset contains 350k bounding-box annotations, each created under the supervision of expert gastroenterologists. Comprehensive patient clinical data, colonoscopy acquisition information, and polyp histopathological information are also included in each video. With its unprecedented size, quality, and heterogeneity, the REAL-Colon dataset is a unique resource for researchers and developers aiming to advance AI research in colonoscopy. Its openness and transparency facilitate rigorous and reproducible research, fostering the development and benchmarking of more accurate and reliable colonoscopy-related algorithms and models.
Collapse
Affiliation(s)
- Carlo Biffi
- Cosmo Intelligent Medical Devices, Dublin, Ireland.
| | - Giulio Antonelli
- Gastroenterology and Digestive Endoscopy Unit, Ospedale dei Castelli (N.O.C.), Rome, Italy
| | - Sebastian Bernhofer
- Karl Landsteiner University of Health Sciences, Krems, Austria
- Department of Internal Medicine 2, University Hospital St. Pölten, St. Pölten, Austria
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
- Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Italy
| | - Daizen Hirata
- Gastrointestinal Center, Sano Hospital, Hyogo, Japan
| | - Mineo Iwatate
- Gastrointestinal Center, Sano Hospital, Hyogo, Japan
| | - Andreas Maieron
- Karl Landsteiner University of Health Sciences, Krems, Austria
- Department of Internal Medicine 2, University Hospital St. Pölten, St. Pölten, Austria
| | | | - Andrea Cherubini
- Cosmo Intelligent Medical Devices, Dublin, Ireland.
- Milan Center for Neuroscience, University of Milano-Bicocca, Milano, Italy.
| |
Collapse
|
5
|
López-Serrano A, Voces A, Lorente JR, Santonja FJ, Algarra A, Latorre P, Del Pozo P, Paredes JM. Artificial intelligence for dysplasia detection during surveillance colonoscopy in patients with ulcerative colitis: A cross-sectional, non-inferiority, diagnostic test comparison study. GASTROENTEROLOGIA Y HEPATOLOGIA 2024:S0210-5705(24)00168-7. [PMID: 38740327 DOI: 10.1016/j.gastrohep.2024.502210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Revised: 05/03/2024] [Accepted: 05/03/2024] [Indexed: 05/16/2024]
Abstract
BACKGROUND AND STUDY AIM High-definition virtual chromoendoscopy, along with targeted biopsies, is recommended for dysplasia surveillance in ulcerative colitis patients at risk for colorectal cancer. Computer-aided detection (CADe) systems aim to improve colonic adenoma detection, however their efficacy in detecting polyps and adenomas in this context remains unclear. This study evaluates the CADe Discovery™ system's effectiveness in detecting colonic dysplasia in ulcerative colitis patients at risk for colorectal cancer. PATIENTS AND METHODS A prospective cross-sectional, non-inferiority, diagnostic test comparison study was conducted on ulcerative colitis patients undergoing colorectal cancer surveillance colonoscopy between January 2021 and April 2021. Patients underwent virtual chromoendoscopy (VCE) with iSCAN 1 and 3 with optical enhancement. One endoscopist, blinded to CADe Discovery™ system results, examined colon sections, while a second endoscopist concurrently reviewed CADe images. Suspicious areas detected by both techniques underwent resection. Proportions of dysplastic lesions and patients with dysplasia detected by VCE or CADe were calculated. RESULTS Fifty-two patients were included, and 48 lesions analyzed. VCE and CADe each detected 9 cases of dysplasia (21.4% and 20.0%, respectively; p=0.629) in 8 patients and 7 patients (15.4% vs. 13.5%, respectively; p=0.713). Sensitivity, specificity, positive and negative predictive values, and diagnostic accuracy for dysplasia detection using VCE or CADe were 90% and 90%, 13% and 5%, 21% and 2%, 83% and 67%, and 29.2% and 22.9%, respectively. CONCLUSIONS The CADe Discovery™ system shows similar diagnostic performance to VCE with iSCAN in detecting colonic dysplasia in ulcerative colitis patients at risk for colorectal cancer.
Collapse
Affiliation(s)
- Antonio López-Serrano
- Gastroenterology Department, Hospital Universitari Dr. Peset, Valencia, Spain; Department of Medicine, Universitat de Valencia, Valencia, Spain.
| | - Alba Voces
- Gastroenterology Department, Hospital Universitari Dr. Peset, Valencia, Spain
| | - José Ramón Lorente
- Gastroenterology Department, Hospital Universitari Dr. Peset, Valencia, Spain
| | | | - Angela Algarra
- Gastroenterology Department, Hospital Universitari Dr. Peset, Valencia, Spain
| | - Patricia Latorre
- Gastroenterology Department, Hospital Universitari Dr. Peset, Valencia, Spain
| | - Pablo Del Pozo
- Gastroenterology Department, Hospital Universitari Dr. Peset, Valencia, Spain
| | - José María Paredes
- Gastroenterology Department, Hospital Universitari Dr. Peset, Valencia, Spain
| |
Collapse
|
6
|
Li SW, Zhang LH, Cai Y, Zhou XB, Fu XY, Song YQ, Xu SW, Tang SP, Luo RQ, Huang Q, Yan LL, He SQ, Zhang Y, Wang J, Ge SQ, Gu BB, Peng JB, Wang Y, Fang LN, Wu WD, Ye WG, Zhu M, Luo DH, Jin XX, Yang HD, Zhou JJ, Wang ZZ, Wu JF, Qin QQ, Lu YD, Wang F, Chen YH, Chen X, Xu SJ, Tung TH, Luo CW, Ye LP, Yu HG, Mao XL. Deep learning assists detection of esophageal cancer and precursor lesions in a prospective, randomized controlled study. Sci Transl Med 2024; 16:eadk5395. [PMID: 38630847 DOI: 10.1126/scitranslmed.adk5395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Accepted: 03/27/2024] [Indexed: 04/19/2024]
Abstract
Endoscopy is the primary modality for detecting asymptomatic esophageal squamous cell carcinoma (ESCC) and precancerous lesions. Improving detection rate remains challenging. We developed a system based on deep convolutional neural networks (CNNs) for detecting esophageal cancer and precancerous lesions [high-risk esophageal lesions (HrELs)] and validated its efficacy in improving HrEL detection rate in clinical practice (trial registration ChiCTR2100044126 at www.chictr.org.cn). Between April 2021 and March 2022, 3117 patients ≥50 years old were consecutively recruited from Taizhou Hospital, Zhejiang Province, and randomly assigned 1:1 to an experimental group (CNN-assisted endoscopy) or a control group (unassisted endoscopy) based on block randomization. The primary endpoint was the HrEL detection rate. In the intention-to-treat population, the HrEL detection rate [28 of 1556 (1.8%)] was significantly higher in the experimental group than in the control group [14 of 1561 (0.9%), P = 0.029], and the experimental group detection rate was twice that of the control group. Similar findings were observed between the experimental and control groups [28 of 1524 (1.9%) versus 13 of 1534 (0.9%), respectively; P = 0.021]. The system's sensitivity, specificity, and accuracy for detecting HrELs were 89.7, 98.5, and 98.2%, respectively. No adverse events occurred. The proposed system thus improved HrEL detection rate during endoscopy and was safe. Deep learning assistance may enhance early diagnosis and treatment of esophageal cancer and may become a useful tool for esophageal cancer screening.
Collapse
Affiliation(s)
- Shao-Wei Li
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
- Institute of Digestive Disease, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
- Key Laboratory of Minimally Invasive Techniques & Rapid Rehabilitation of Digestive System Tumor of Zhejiang Province, Taizhou Hospital Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Li-Hui Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan 430000, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan 430000, China
- Department of Gastroenterology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou 510000, China
| | - Yue Cai
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Xian-Bin Zhou
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Xin-Yu Fu
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Ya-Qi Song
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Shi-Wen Xu
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Shen-Ping Tang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Ren-Quan Luo
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan 430000, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan 430000, China
| | - Qin Huang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Ling-Ling Yan
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Sai-Qin He
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Yu Zhang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Jun Wang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Shu-Qiong Ge
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Bin-Bin Gu
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Jin-Bang Peng
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Yi Wang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Li-Na Fang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Wei-Dan Wu
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Wen-Guang Ye
- Department of Gastroenterology, Zhejiang University School Medicine Affiliated Hangzhou Cancer Hospital, Hangzhou 310000, China
| | - Min Zhu
- Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Ding-Hai Luo
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Xiu-Xiu Jin
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Hai-Deng Yang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Jing-Jing Zhou
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Zhen-Zhen Wang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Jian-Fen Wu
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Qiao-Qiao Qin
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Yan-di Lu
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Fei Wang
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Ya-Hong Chen
- Health Management Center, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Xia Chen
- Department of Gastroenterology, Wenling First People's Hospital, Taizhou, Zhejiang 317500, China
| | - Shan-Jing Xu
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Tao-Hsin Tung
- Evidence-based Medicine Center, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Chen-Wen Luo
- Evidence-based Medicine Center, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Li-Ping Ye
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
- Institute of Digestive Disease, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
- Key Laboratory of Minimally Invasive Techniques & Rapid Rehabilitation of Digestive System Tumor of Zhejiang Province, Taizhou Hospital Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| | - Hong-Gang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan 430000, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan 430000, China
| | - Xin-Li Mao
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
- Institute of Digestive Disease, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
- Key Laboratory of Minimally Invasive Techniques & Rapid Rehabilitation of Digestive System Tumor of Zhejiang Province, Taizhou Hospital Affiliated to Wenzhou Medical University, Linhai, Zhejiang 317000, China
| |
Collapse
|
7
|
Uchikov P, Khalid U, Kraev K, Hristov B, Kraeva M, Tenchev T, Chakarov D, Sandeva M, Dragusheva S, Taneva D, Batashki A. Artificial Intelligence in the Diagnosis of Colorectal Cancer: A Literature Review. Diagnostics (Basel) 2024; 14:528. [PMID: 38472999 DOI: 10.3390/diagnostics14050528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 02/26/2024] [Accepted: 02/27/2024] [Indexed: 03/14/2024] Open
Abstract
BACKGROUND The aim of this review is to explore the role of artificial intelligence in the diagnosis of colorectal cancer, how it impacts CRC morbidity and mortality, and why its role in clinical medicine is limited. METHODS A targeted, non-systematic review of the published literature relating to colorectal cancer diagnosis was performed with PubMed databases that were scouted to help provide a more defined understanding of the recent advances regarding artificial intelligence and their impact on colorectal-related morbidity and mortality. Articles were included if deemed relevant and including information associated with the keywords. RESULTS The advancements in artificial intelligence have been significant in facilitating an earlier diagnosis of CRC. In this review, we focused on evaluating genomic biomarkers, the integration of instruments with artificial intelligence, MR and hyperspectral imaging, and the architecture of neural networks. We found that these neural networks seem practical and yield positive results in initial testing. Furthermore, we explored the use of deep-learning-based majority voting methods, such as bag of words and PAHLI, in improving diagnostic accuracy in colorectal cancer detection. Alongside this, the autonomous and expansive learning ability of artificial intelligence, coupled with its ability to extract increasingly complex features from images or videos without human reliance, highlight its impact in the diagnostic sector. Despite this, as most of the research involves a small sample of patients, a diversification of patient data is needed to enhance cohort stratification for a more sensitive and specific neural model. We also examined the successful application of artificial intelligence in predicting microsatellite instability, showcasing its potential in stratifying patients for targeted therapies. CONCLUSIONS Since its commencement in colorectal cancer, artificial intelligence has revealed a multitude of functionalities and augmentations in the diagnostic sector of CRC. Given its early implementation, its clinical application remains a fair way away, but with steady research dedicated to improving neural architecture and expanding its applicational range, there is hope that these advanced neural software could directly impact the early diagnosis of CRC. The true promise of artificial intelligence, extending beyond the medical sector, lies in its potential to significantly influence the future landscape of CRC's morbidity and mortality.
Collapse
Affiliation(s)
- Petar Uchikov
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Usman Khalid
- Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Krasimir Kraev
- Department of Propaedeutics of Internal Diseases "Prof. Dr. Anton Mitov", Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Bozhidar Hristov
- Section "Gastroenterology", Second Department of Internal Diseases, Medical Faculty, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Maria Kraeva
- Department of Otorhinolaryngology, Medical Faculty, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Tihomir Tenchev
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Dzhevdet Chakarov
- Department of Propaedeutics of Surgical Diseases, Section of General Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Milena Sandeva
- Department of Midwifery, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Snezhanka Dragusheva
- Department of Nursing Care, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Daniela Taneva
- Department of Nursing Care, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Atanas Batashki
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| |
Collapse
|
8
|
Finocchiaro M, Banfi T, Donaire S, Arezzo A, Guarner-Argente C, Menciassi A, Casals A, Ciuti G, Hernansanz A. A Framework for the Evaluation of Human Machine Interfaces of Robot-Assisted Colonoscopy. IEEE Trans Biomed Eng 2024; 71:410-422. [PMID: 37535479 DOI: 10.1109/tbme.2023.3301741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/05/2023]
Abstract
The Human Machine Interface (HMI) of intraluminal robots has a crucial impact on the clinician's performance. It increases or decreases the difficulty of the tasks, and is connected to the users' physical and mental stress. OBJECTIVE This article presents a framework to compare and evaluate different HMIs for robotic colonoscopy, with the objective of identifying the optimal HMI that minimises the clinician's effort and maximises the clinical outcomes. METHODS The framework comprises a 1) a virtual simulator (clinically validated), 2) wearable sensors measuring the cognitive load, 3) a data collection unit of metrics correlated to the clinical performance, and 4) questionnaires exploring the users' impressions and perceived stress. The framework was tested with 42 clinicians investigating the optimal device for tele-operated control of robotic colonoscopes. Two control devices were selected and compared: a haptic serial-kinematic device and a standard videogame joypad. RESULTS The haptic device was preferred by the endoscopists, but the joypad enabled better clinical performance and reduced cognitive and physical load. CONCLUSION The framework can be used to evaluate different aspects of a HMI, both hardware and software, and determine the optimal HMI that can reduce the burden on clinicians while improving the clinical outcome. SIGNIFICANCE The findings of this study, and of future studies performed with this framework, can inform the design and development of HMIs for intraluminal robots, leading to improved clinical performance, reduced physical and mental stress for clinicians, and ultimately better patient outcomes.
Collapse
|
9
|
Brodersen JB, Jensen MD, Leenhardt R, Kjeldsen J, Histace A, Knudsen T, Dray X. Artificial Intelligence-assisted Analysis of Pan-enteric Capsule Endoscopy in Patients with Suspected Crohn's Disease: A Study on Diagnostic Performance. J Crohns Colitis 2024; 18:75-81. [PMID: 37527554 DOI: 10.1093/ecco-jcc/jjad131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Indexed: 08/03/2023]
Abstract
BACKGROUND AND AIM Pan-enteric capsule endoscopy [PCE] is a highly sensitive but time-consuming tool for detecting pathology. Artificial intelligence [AI] algorithms might offer a possibility to assist in the review and reduce the analysis time of PCE. This study examines the agreement between PCE assessments aided by AI technology and standard evaluations, in patients suspected of Crohn's disease [CD]. METHOD PCEs from a prospective, blinded, multicentre study, including patients suspected of CD, were processed by the deep learning solution AXARO® [Augmented Endoscopy, Paris, France]. Based on the image output, two observers classified the patient's PCE as normal or suggestive of CD, ulcerative colitis, or cancer. The primary outcome was per-patient sensitivities and specificities for detecting CD and inflammatory bowel disease [IBD]. Complete reading of PCE served as the reference standard. RESULTS A total of 131 patients' PCEs were analysed, with a median recording time of 303 min. The AXARO® framework reduced output to a median of 470 images [2.1%] per patient, and the pooled median review time was 3.2 min per patient. For detecting CD, the observers had a sensitivity of 96% and 92% and a specificity of 93% and 90%, respectively. For the detection of IBD, both observers had a sensitivity of 97% and had a specificity of 91% and 90%, respectively. The negative predictive value was 95% for CD and 97% for IBD. CONCLUSIONS Using the AXARO® framework reduced the initial review time substantially while maintaining high diagnostic accuracy-suggesting its use as a rapid tool to rule out IBD in PCEs of patients suspected of Crohn's disease.
Collapse
Affiliation(s)
- Jacob Broder Brodersen
- Department of Internal Medicine, Section of Gastroenterology, Hospital of South West Jutland, Esbjerg, Denmark
- Department of Regional Health Research, University of Southern Denmark, Odense, Denmark
| | - Michael Dam Jensen
- Department of Regional Health Research, University of Southern Denmark, Odense, Denmark
- Department of Internal Medicine, Section of Gastroenterology, Lillebaelt Hospital, Vejle, Denmark
| | - Romain Leenhardt
- Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, Cergy, France
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, Paris, France
| | - Jens Kjeldsen
- Department of Medical Gastroenterology, Odense University Hospital, Odense, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- OPEN Odense Patient Data Explorative Network, Odense University Hospital, Odense, Denmark
| | - Aymeric Histace
- Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, Cergy, France
| | - Torben Knudsen
- Department of Internal Medicine, Section of Gastroenterology, Hospital of South West Jutland, Esbjerg, Denmark
- Department of Regional Health Research, University of Southern Denmark, Odense, Denmark
| | - Xavier Dray
- Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, Cergy, France
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, Paris, France
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
10
|
Lou S, Du F, Song W, Xia Y, Yue X, Yang D, Cui B, Liu Y, Han P. Artificial intelligence for colorectal neoplasia detection during colonoscopy: a systematic review and meta-analysis of randomized clinical trials. EClinicalMedicine 2023; 66:102341. [PMID: 38078195 PMCID: PMC10698672 DOI: 10.1016/j.eclinm.2023.102341] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 11/14/2023] [Accepted: 11/15/2023] [Indexed: 05/11/2024] Open
Abstract
BACKGROUND The use of artificial intelligence (AI) in detecting colorectal neoplasia during colonoscopy holds the potential to enhance adenoma detection rates (ADRs) and reduce adenoma miss rates (AMRs). However, varied outcomes have been observed across studies. Thus, this study aimed to evaluate the potential advantages and disadvantages of employing AI-aided systems during colonoscopy. METHODS Using Medical Subject Headings (MeSH) terms and keywords, a comprehensive electronic literature search was performed of the Embase, Medline, and the Cochrane Library databases from the inception of each database until October 04, 2023, in order to identify randomized controlled trials (RCTs) comparing AI-assisted with standard colonoscopy for detecting colorectal neoplasia. Primary outcomes included AMR, ADR, and adenomas detected per colonoscopy (APC). Secondary outcomes comprised the poly missed detection rate (PMR), poly detection rate (PDR), and poly detected per colonoscopy (PPC). We utilized random-effects meta-analyses with Hartung-Knapp adjustment to consolidate results. The prediction interval (PI) and I2 statistics were utilized to quantify between-study heterogeneity. Moreover, meta-regression and subgroup analyses were performed to investigate the potential sources of heterogeneity. This systematic review and meta-analysis is registered with PROSPERO (CRD42023428658). FINDINGS This study encompassed 33 trials involving 27,404 patients. Those undergoing AI-aided colonoscopy experienced a significant decrease in PMR (RR, 0.475; 95% CI, 0.294-0.768; I2 = 87.49%) and AMR (RR, 0.495; 95% CI, 0.390-0.627; I2 = 48.76%). Additionally, a significant increase in PDR (RR, 1.238; 95% CI, 1.158-1.323; I2 = 81.67%) and ADR (RR, 1.242; 95% CI, 1.159-1.332; I2 = 78.87%), along with a significant increase in the rates of PPC (IRR, 1.388; 95% CI, 1.270-1.517; I2 = 91.99%) and APC (IRR, 1.390; 95% CI, 1.277-1.513; I2 = 86.24%), was observed. This resulted in 0.271 more PPCs (95% CI, 0.144-0.259; I2 = 65.61%) and 0.202 more APCs (95% CI, 0.144-0.259; I2 = 68.15%). INTERPRETATION AI-aided colonoscopy significantly enhanced the detection of colorectal neoplasia detection, likely by reducing the miss rate. However, future studies should focus on evaluating the cost-effectiveness and long-term benefits of AI-aided colonoscopy in reducing cancer incidence. FUNDING This work was supported by the Heilongjiang Provincial Natural Science Foundation of China (LH2023H096), the Postdoctoral research project in Heilongjiang Province (LBH-Z22210), the National Natural Science Foundation of China's General Program (82072640) and the Outstanding Youth Project of Heilongjiang Natural Science Foundation (YQ2021H023).
Collapse
Affiliation(s)
- Shenghan Lou
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Fenqi Du
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Wenjie Song
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Yixiu Xia
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Xinyu Yue
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Da Yang
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Binbin Cui
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Yanlong Liu
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| | - Peng Han
- Department of Colorectal Surgery, Harbin Medical University Cancer Hospital, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
- Key Laboratory of Tumor Immunology in Heilongjiang, No.150 Haping Road, Harbin, Heilongjiang, 150081, China
| |
Collapse
|
11
|
Bo Y, Wei S, Dengju Y, Yunhao W, Heyi Z. CCRA: A colon cleanliness rating algorithm based on colonoscopy video analysis. Heliyon 2023; 9:e22662. [PMID: 38034702 PMCID: PMC10687275 DOI: 10.1016/j.heliyon.2023.e22662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 11/15/2023] [Accepted: 11/16/2023] [Indexed: 12/02/2023] Open
Abstract
Objective A Colon Cleanliness Rating Algorithm (CCRA) based on colonoscopy image analysis is proposed in this paper, in order to solve the problem that the results of Colon Cleanliness (or Bowel Preparation Quality) rating caused by manual inspection are inconsistent. Methods Firstly, CCRA intercepts images from the colonoscopy video. Secondly, each colonoscopy image's stool area is segmented by U-Net to obtain the 2-classification segmentation results. Finally, the colon cleanliness is obtained by comparing the average area of the stool area with the standard proportion. Results After testing, the pixel accuracy of the U-Net model is 97.02 %, IoU is 83.67 %, accuracy is 92.17 %, recall is 90.21 %, F1-Score is 90.95 %. The accuracy of CCRA is 92.45 %-99.275. Conclusion The experimental results show that the CCRA proposed in this paper can quickly and accurately output the colon cleanliness rating of patients without manpower.
Collapse
Affiliation(s)
- Yu Bo
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080, China
| | - Shao Wei
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080, China
| | - Yao Dengju
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080, China
| | - Wang Yunhao
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080, China
| | - Zhang Heyi
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080, China
| |
Collapse
|
12
|
Jing Y, Li C, Du T, Jiang T, Sun H, Yang J, Shi L, Gao M, Grzegorzek M, Li X. A comprehensive survey of intestine histopathological image analysis using machine vision approaches. Comput Biol Med 2023; 165:107388. [PMID: 37696178 DOI: 10.1016/j.compbiomed.2023.107388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 08/06/2023] [Accepted: 08/25/2023] [Indexed: 09/13/2023]
Abstract
Colorectal Cancer (CRC) is currently one of the most common and deadly cancers. CRC is the third most common malignancy and the fourth leading cause of cancer death worldwide. It ranks as the second most frequent cause of cancer-related deaths in the United States and other developed countries. Histopathological images contain sufficient phenotypic information, they play an indispensable role in the diagnosis and treatment of CRC. In order to improve the objectivity and diagnostic efficiency for image analysis of intestinal histopathology, Computer-aided Diagnosis (CAD) methods based on machine learning (ML) are widely applied in image analysis of intestinal histopathology. In this investigation, we conduct a comprehensive study on recent ML-based methods for image analysis of intestinal histopathology. First, we discuss commonly used datasets from basic research studies with knowledge of intestinal histopathology relevant to medicine. Second, we introduce traditional ML methods commonly used in intestinal histopathology, as well as deep learning (DL) methods. Then, we provide a comprehensive review of the recent developments in ML methods for segmentation, classification, detection, and recognition, among others, for histopathological images of the intestine. Finally, the existing methods have been studied, and the application prospects of these methods in this field are given.
Collapse
Affiliation(s)
- Yujie Jing
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Chen Li
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China.
| | - Tianming Du
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Tao Jiang
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, China; International Joint Institute of Robotics and Intelligent Systems, Chengdu University of Information Technology, Chengdu, China
| | - Hongzan Sun
- Shengjing Hospital of China Medical University, Shenyang, China
| | - Jinzhu Yang
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Liyu Shi
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Minghe Gao
- Microscopic Image and Medical Image Analysis Group, College of Medicine and Biological Information Engineering, Northeastern University, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
| | - Marcin Grzegorzek
- Institute for Medical Informatics, University of Luebeck, Luebeck, Germany; Department of Knowledge Engineering, University of Economics in Katowice, Katowice, Poland
| | - Xiaoyan Li
- Cancer Hospital of China Medical University, Liaoning Cancer Hospital, Shenyang, China.
| |
Collapse
|
13
|
Darwish M, Altabel MZ, Abiyev RH. Enhancing Cervical Pre-Cancerous Classification Using Advanced Vision Transformer. Diagnostics (Basel) 2023; 13:2884. [PMID: 37761252 PMCID: PMC10529431 DOI: 10.3390/diagnostics13182884] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/28/2023] [Accepted: 09/05/2023] [Indexed: 09/29/2023] Open
Abstract
One of the most common types of cancer among in women is cervical cancer. Incidence and fatality rates are steadily rising, particularly in developing nations, due to a lack of screening facilities, experienced specialists, and public awareness. Visual inspection is used to screen for cervical cancer after the application of acetic acid (VIA), histopathology test, Papanicolaou (Pap) test, and human papillomavirus (HPV) test. The goal of this research is to employ a vision transformer (ViT) enhanced with shifted patch tokenization (SPT) techniques to create an integrated and robust system for automatic cervix-type identification. A vision transformer enhanced with shifted patch tokenization is used in this work to learn the distinct features between the three different cervical pre-cancerous types. The model was trained and tested on 8215 colposcopy images of the three types, obtained from the publicly available mobile-ODT dataset. The model was tested on 30% of the whole dataset and it showed a good generalization capability of 91% accuracy. The state-of-the art comparison indicated the outperformance of our model. The experimental results show that the suggested system can be employed as a decision support tool in the detection of the cervical pre-cancer transformation zone, particularly in low-resource settings with limited experience and resources.
Collapse
Affiliation(s)
| | | | - Rahib H. Abiyev
- Department of Computer Engineering, Applied Artificial Intelligence Research Centre, Near East University, Mersin 10, 99138 Nicosia, Turkey; (M.D.); (M.Z.A.)
| |
Collapse
|
14
|
Houwen BBSL, Hazewinkel Y, Giotis I, Vleugels JLA, Mostafavi NS, van Putten P, Fockens P, Dekker E. Computer-aided diagnosis for optical diagnosis of diminutive colorectal polyps including sessile serrated lesions: a real-time comparison with screening endoscopists. Endoscopy 2023; 55:756-765. [PMID: 36623839 PMCID: PMC10374350 DOI: 10.1055/a-2009-3990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Accepted: 01/09/2023] [Indexed: 01/11/2023]
Abstract
BACKGROUND : We aimed to compare the accuracy of the optical diagnosis of diminutive colorectal polyps, including sessile serrated lesions (SSLs), between a computer-aided diagnosis (CADx) system and endoscopists during real-time colonoscopy. METHODS : We developed the POLyp Artificial Recognition (POLAR) system, which was capable of performing real-time characterization of diminutive colorectal polyps. For pretraining, the Microsoft-COCO dataset with over 300 000 nonpolyp object images was used. For training, eight hospitals prospectively collected 2637 annotated images from 1339 polyps (i. e. publicly available online POLAR database). For clinical validation, POLAR was tested during colonoscopy in patients with a positive fecal immunochemical test (FIT), and compared with the performance of 20 endoscopists from eight hospitals. Endoscopists were blinded to the POLAR output. Primary outcome was the comparison of accuracy of the optical diagnosis of diminutive colorectal polyps between POLAR and endoscopists (neoplastic [adenomas and SSLs] versus non-neoplastic [hyperplastic polyps]). Histopathology served as the reference standard. RESULTS : During clinical validation, 423 diminutive polyps detected in 194 FIT-positive individuals were included for analysis (300 adenomas, 41 SSLs, 82 hyperplastic polyps). POLAR distinguished neoplastic from non-neoplastic lesions with 79 % accuracy, 89 % sensitivity, and 38 % specificity. The endoscopists achieved 83 % accuracy, 92 % sensitivity, and 44 % specificity. The optical diagnosis accuracy between POLAR and endoscopists was not significantly different (P = 0.10). The proportion of polyps in which POLAR was able to provide an optical diagnosis was 98 % (i. e. success rate). CONCLUSIONS : We developed a CADx system that differentiated neoplastic from non-neoplastic diminutive polyps during endoscopy, with an accuracy comparable to that of screening endoscopists and near-perfect success rate.
Collapse
Affiliation(s)
- Britt B. S. L. Houwen
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, the Netherlands
| | - Yark Hazewinkel
- Department of Gastroenterology and Hepatology, Radboud University Nijmegen Medical Center, Radboud University of Nijmegen, Nijmegen, The Netherlands
| | | | - Jasper L. A. Vleugels
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, the Netherlands
| | - Nahid S. Mostafavi
- Department of Gastroenterology and Hepatology, Subdivision Statistics, Amsterdam University Medical Center, Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Paul van Putten
- Department of Gastroenterology and Hepatology, Medical Center Leeuwarden, Leeuwarden, The Netherlands
| | - Paul Fockens
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, the Netherlands
| | - Evelien Dekker
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, the Netherlands
- Bergman Clinics Maag and Darm Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
15
|
Lv B, Wang K, Wei N, Yu F, Tao T, Shi Y. Diagnostic value of deep learning-assisted endoscopic ultrasound for pancreatic tumors: a systematic review and meta-analysis. Front Oncol 2023; 13:1191008. [PMID: 37576885 PMCID: PMC10414790 DOI: 10.3389/fonc.2023.1191008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 07/13/2023] [Indexed: 08/15/2023] Open
Abstract
Background and aims Endoscopic ultrasonography (EUS) is commonly utilized in the diagnosis of pancreatic tumors, although as this modality relies primarily on the practitioner's visual judgment, it is prone to result in a missed diagnosis or misdiagnosis due to inexperience, fatigue, or distraction. Deep learning (DL) techniques, which can be used to automatically extract detailed imaging features from images, have been increasingly beneficial in the field of medical image-based assisted diagnosis. The present systematic review included a meta-analysis aimed at evaluating the accuracy of DL-assisted EUS for the diagnosis of pancreatic tumors diagnosis. Methods We performed a comprehensive search for all studies relevant to EUS and DL in the following four databases, from their inception through February 2023: PubMed, Embase, Web of Science, and the Cochrane Library. Target studies were strictly screened based on specific inclusion and exclusion criteria, after which we performed a meta-analysis using Stata 16.0 to assess the diagnostic ability of DL and compare it with that of EUS practitioners. Any sources of heterogeneity were explored using subgroup and meta-regression analyses. Results A total of 10 studies, involving 3,529 patients and 34,773 training images, were included in the present meta-analysis. The pooled sensitivity was 93% (95% confidence interval [CI], 87-96%), the pooled specificity was 95% (95% CI, 89-98%), and the area under the summary receiver operating characteristic curve (AUC) was 0.98 (95% CI, 0.96-0.99). Conclusion DL-assisted EUS has a high accuracy and clinical applicability for diagnosing pancreatic tumors. Systematic review registration https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023391853, identifier CRD42023391853.
Collapse
Affiliation(s)
- Bing Lv
- School of Computer Science and Technology, Shandong University of Technology, Zibo, Shandong, China
| | - Kunhong Wang
- Department of Gastroenterology, Zibo Central Hospital, Zibo, Shandong, China
| | - Ning Wei
- Department of Gastroenterology, Zibo Central Hospital, Zibo, Shandong, China
| | - Feng Yu
- Department of Gastroenterology, Zibo Central Hospital, Zibo, Shandong, China
| | - Tao Tao
- Department of Gastroenterology, Zibo Central Hospital, Zibo, Shandong, China
| | - Yanting Shi
- Department of Gastroenterology, Zibo Central Hospital, Zibo, Shandong, China
| |
Collapse
|
16
|
Maida M, Marasco G, Facciorusso A, Shahini E, Sinagra E, Pallio S, Ramai D, Murino A. Effectiveness and application of artificial intelligence for endoscopic screening of colorectal cancer: the future is now. Expert Rev Anticancer Ther 2023; 23:719-729. [PMID: 37194308 DOI: 10.1080/14737140.2023.2215436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Accepted: 05/15/2023] [Indexed: 05/18/2023]
Abstract
INTRODUCTION Artificial intelligence (AI) in gastrointestinal endoscopy includes systems designed to interpret medical images and increase sensitivity during examination. This may be a promising solution to human biases and may provide support during diagnostic endoscopy. AREAS COVERED This review aims to summarize and evaluate data supporting AI technologies in lower endoscopy, addressing their effectiveness, limitations, and future perspectives. EXPERT OPINION Computer-aided detection (CADe) systems have been studied with promising results, allowing for an increase in adenoma detection rate (ADR), adenoma per colonoscopy (APC), and a reduction in adenoma miss rate (AMR). This may lead to an increase in the sensitivity of endoscopic examinations and a reduction in the risk of interval-colorectal cancer. In addition, computer-aided characterization (CADx) has also been implemented, aiming to distinguish adenomatous and non-adenomatous lesions through real-time assessment using advanced endoscopic imaging techniques. Moreover, computer-aided quality (CADq) systems have been developed with the aim of standardizing quality measures in colonoscopy (e.g. withdrawal time and adequacy of bowel cleansing) both to improve the quality of examinations and set a reference standard for randomized controlled trials.
Collapse
Affiliation(s)
- Marcello Maida
- Gastroenterology and Endoscopy Unit, S. Elia-Raimondi Hospital, Caltanissetta, Italy
| | - Giovanni Marasco
- IRCCS Azienda Ospedaliero Universitaria di Bologna, Bologna, Italy
- Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy
| | - Antonio Facciorusso
- Department of Medical and Surgical Sciences, University of Foggia, Foggia, Italy
| | - Endrit Shahini
- Gastroenterology Unit, National Institute of Gastroenterology-IRCCS "Saverio de Bellis", Castellana Grotte, Bari, Italy
| | - Emanuele Sinagra
- Gastroenterology and Endoscopy Unit, Fondazione Istituto San Raffaele Giglio, Cefalu, Italy
| | - Socrate Pallio
- Digestive Diseases Endoscopy Unit, Policlinico G. Martino Hospital, University of Messina, Messina, Italy
| | - Daryl Ramai
- Gastroenterology & Hepatology, University of Utah Health, Salt Lake City, UT, USA
| | - Alberto Murino
- Royal Free Unit for Endoscopy, The Royal Free Hospital and University College London Institute for Liver and Digestive Health, Hampstead, London, UK
- Department of Gastroenterology, Cleveland Clinic London, London, UK
| |
Collapse
|
17
|
Fu Y, Zhou F, Shi X, Wang L, Li Y, Wu J, Huang H. Classification of adenoid cystic carcinoma in whole slide images by using deep learning. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/11/2023]
|
18
|
Yao S, Zhang B, Fei X, Xiao M, Lu L, Liu D, Zhang S, Cui J. AI-Assisted Ultrasound for the Early Diagnosis of Antibody-Negative Autoimmune Thyroiditis. J Multidiscip Healthc 2023; 16:1801-1810. [PMID: 37404960 PMCID: PMC10315148 DOI: 10.2147/jmdh.s408117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 05/12/2023] [Indexed: 07/06/2023] Open
Abstract
The prevalence of antibody-negative chronic autoimmune thyroiditis (SN-CAT) is increasing. The early diagnosis of SN-CAT can effectively prevent its further development. Thyroid ultrasound can diagnose autoimmune thyroiditis and predict hypothyroidism. Primary hypothyroidism with a hypoechoic pattern suggested by thyroid ultrasound and negative thyroid serum antibodies is the main basis for the diagnosis of SN-CAT. However, for early SN-CAT, only hypoechoic thyroid changes and serological antibodies are currently available. This study explored how to achieve an accurate and early diagnosis of SN-CAT and prevent the development of SN-CAT combined with hypothyroidism. The diagnosis of a hypoechoic thyroid by artificial intelligence is expected to be a breakthrough in the accurate diagnosis of SN-CAT.
Collapse
Affiliation(s)
- Shengsheng Yao
- China Medical University - Department of Thyroid and Breast Surgery, Liaoning Provincial People’s Hospital, Shenyang, Liaoning Province, 110015, People’s Republic of China
| | - Bo Zhang
- Department of Science and Education, The 10th Division of Xinjiang Production and Construction Corps, Beitun General Hospital, Beitun City, Xinjiang Province, 831300, People’s Republic of China
| | - Xiang Fei
- Department of Thyroid and Breast Surgery, People’s Hospital of China Medical University (Liaoning Provincial People’s Hospital), Shenyang, Liaoning Province, 110015, People's Republic of China
| | - Mingming Xiao
- Department of Pathology, People’s Hospital of China Medical University (Liaoning Provincial People’s Hospital), Shenyang, Liaoning Province, 110015, People’s Republic of China
| | - Li Lu
- Department of Endocrinology, People’s Hospital of China Medical University (Liaoning Provincial People’s Hospital), Shenyang, Liaoning Province, 110015, People’s Republic of China
| | - Daming Liu
- Department of Ultrasound, People’s Hospital of China Medical University (Liaoning Provincial People’s Hospital), Shenyang, Liaoning Province, 110015, People’s Republic of China
| | - Siyuan Zhang
- Department of Thyroid and Breast Surgery, The 10th Division of Xinjiang Production and Construction Corps, Beitun General Hospital, Beitun City, Xinjiang Province, 831300, People’s Republic of China
| | - Jianchun Cui
- Department of Thyroid and Breast Surgery, People’s Hospital of China Medical University (Liaoning Provincial People’s Hospital), Shenyang, Liaoning Province, 110015, People's Republic of China
| |
Collapse
|
19
|
Du RC, Ouyang YB, Hu Y. Research trends on artificial intelligence and endoscopy in digestive diseases: A bibliometric analysis from 1990 to 2022. World J Gastroenterol 2023; 29:3561-3573. [PMID: 37389238 PMCID: PMC10303508 DOI: 10.3748/wjg.v29.i22.3561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/04/2023] [Revised: 04/03/2023] [Accepted: 05/04/2023] [Indexed: 06/06/2023] Open
Abstract
BACKGROUND Recently, artificial intelligence (AI) has been widely used in gastrointestinal endoscopy examinations.
AIM To comprehensively evaluate the application of AI-assisted endoscopy in detecting different digestive diseases using bibliometric analysis.
METHODS Relevant publications from the Web of Science published from 1990 to 2022 were extracted using a combination of the search terms “AI” and “endoscopy”. The following information was recorded from the included publications: Title, author, institution, country, endoscopy type, disease type, performance of AI, publication, citation, journal and H-index.
RESULTS A total of 446 studies were included. The number of articles reached its peak in 2021, and the annual citation numbers increased after 2006. China, the United States and Japan were dominant countries in this field, accounting for 28.7%, 16.8%, and 15.7% of publications, respectively. The Tada Tomohiro Institute of Gastroenterology and Proctology was the most influential institution. “Cancer” and “polyps” were the hotspots in this field. Colorectal polyps were the most concerning and researched disease, followed by gastric cancer and gastrointestinal bleeding. Conventional endoscopy was the most common type of examination. The accuracy of AI in detecting Barrett’s esophagus, colorectal polyps and gastric cancer from 2018 to 2022 is 87.6%, 93.7% and 88.3%, respectively. The detection rates of adenoma and gastrointestinal bleeding from 2018 to 2022 are 31.3% and 96.2%, respectively.
CONCLUSION AI could improve the detection rate of digestive tract diseases and a convolutional neural network-based diagnosis program for endoscopic images shows promising results.
Collapse
Affiliation(s)
- Ren-Chun Du
- Department of Gastroenterology, The First Affiliated Hospital of Nanchang University, Nanchang 330006, Jiangxi Province, China
| | - Yao-Bin Ouyang
- Department of Gastroenterology, The First Affiliated Hospital of Nanchang University, Nanchang 330006, Jiangxi Province, China
- Department of Oncology, Mayo Clinic, Rochester, MN 55905, United States
| | - Yi Hu
- Department of Gastroenterology, The First Affiliated Hospital of Nanchang University, Nanchang 330006, Jiangxi Province, China
- Department of Surgery, The Chinese University of Hong Kong, Hong Kong 999077, China
| |
Collapse
|
20
|
Ahmad OF, Mazomenos E, Chadebecq F, Kader R, Hussein M, Haidry RJ, Puyal JG, Brandao P, Toth D, Mountney P, Seward E, Vega R, Stoyanov D, Lovat LB. Identifying key mechanisms leading to visual recognition errors for missed colorectal polyps using eye-tracking technology. J Gastroenterol Hepatol 2023; 38:768-774. [PMID: 36652526 PMCID: PMC10601973 DOI: 10.1111/jgh.16127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/22/2022] [Revised: 01/04/2023] [Accepted: 01/14/2023] [Indexed: 01/20/2023]
Abstract
BACKGROUND AND AIM Lack of visual recognition of colorectal polyps may lead to interval cancers. The mechanisms contributing to perceptual variation, particularly for subtle and advanced colorectal neoplasia, have scarcely been investigated. We aimed to evaluate visual recognition errors and provide novel mechanistic insights. METHODS Eleven participants (seven trainees and four medical students) evaluated images from the UCL polyp perception dataset, containing 25 polyps, using eye-tracking equipment. Gaze errors were defined as those where the lesion was not observed according to eye-tracking technology. Cognitive errors occurred when lesions were observed but not recognized as polyps by participants. A video study was also performed including 39 subtle polyps, where polyp recognition performance was compared with a convolutional neural network. RESULTS Cognitive errors occurred more frequently than gaze errors overall (65.6%), with a significantly higher proportion in trainees (P = 0.0264). In the video validation, the convolutional neural network detected significantly more polyps than trainees and medical students, with per-polyp sensitivities of 79.5%, 30.0%, and 15.4%, respectively. CONCLUSIONS Cognitive errors were the most common reason for visual recognition errors. The impact of interventions such as artificial intelligence, particularly on different types of perceptual errors, needs further investigation including potential effects on learning curves. To facilitate future research, a publicly accessible visual perception colonoscopy polyp database was created.
Collapse
Affiliation(s)
- Omer F Ahmad
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | - Evangelos Mazomenos
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
| | - Francois Chadebecq
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
| | - Rawen Kader
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
| | - Mohamed Hussein
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
| | - Rehan J Haidry
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | - Juana González‐Bueno Puyal
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Odin Vision LtdLondonUK
| | - Patrick Brandao
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Odin Vision LtdLondonUK
| | | | | | - Ed Seward
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | - Roser Vega
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
| | - Laurence B Lovat
- Wellcome/EPSRC Centre for Interventional and Surgical SciencesUniversity College LondonLondonUK
- Division of Surgery and Interventional SciencesUniversity College LondonLondonUK
- Gastrointestinal ServicesUniversity College London HospitalLondonUK
| |
Collapse
|
21
|
Cherubini A, Dinh NN. A Review of the Technology, Training, and Assessment Methods for the First Real-Time AI-Enhanced Medical Device for Endoscopy. Bioengineering (Basel) 2023; 10:bioengineering10040404. [PMID: 37106592 PMCID: PMC10136070 DOI: 10.3390/bioengineering10040404] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 02/25/2023] [Accepted: 03/22/2023] [Indexed: 04/29/2023] Open
Abstract
Artificial intelligence (AI) has the potential to assist in endoscopy and improve decision making, particularly in situations where humans may make inconsistent judgments. The performance assessment of the medical devices operating in this context is a complex combination of bench tests, randomized controlled trials, and studies on the interaction between physicians and AI. We review the scientific evidence published about GI Genius, the first AI-powered medical device for colonoscopy to enter the market, and the device that is most widely tested by the scientific community. We provide an overview of its technical architecture, AI training and testing strategies, and regulatory path. In addition, we discuss the strengths and limitations of the current platform and its potential impact on clinical practice. The details of the algorithm architecture and the data that were used to train the AI device have been disclosed to the scientific community in the pursuit of a transparent AI. Overall, the first AI-enabled medical device for real-time video analysis represents a significant advancement in the use of AI for endoscopies and has the potential to improve the accuracy and efficiency of colonoscopy procedures.
Collapse
Affiliation(s)
- Andrea Cherubini
- Cosmo Intelligent Medical Devices, D02KV60 Dublin, Ireland
- Milan Center for Neuroscience, University of Milano-Bicocca, 20126 Milano, Italy
| | - Nhan Ngo Dinh
- Cosmo Intelligent Medical Devices, D02KV60 Dublin, Ireland
| |
Collapse
|
22
|
Chadebecq F, Lovat LB, Stoyanov D. Artificial intelligence and automation in endoscopy and surgery. Nat Rev Gastroenterol Hepatol 2023; 20:171-182. [PMID: 36352158 DOI: 10.1038/s41575-022-00701-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/03/2022] [Indexed: 11/10/2022]
Abstract
Modern endoscopy relies on digital technology, from high-resolution imaging sensors and displays to electronics connecting configurable illumination and actuation systems for robotic articulation. In addition to enabling more effective diagnostic and therapeutic interventions, the digitization of the procedural toolset enables video data capture of the internal human anatomy at unprecedented levels. Interventional video data encapsulate functional and structural information about a patient's anatomy as well as events, activity and action logs about the surgical process. This detailed but difficult-to-interpret record from endoscopic procedures can be linked to preoperative and postoperative records or patient imaging information. Rapid advances in artificial intelligence, especially in supervised deep learning, can utilize data from endoscopic procedures to develop systems for assisting procedures leading to computer-assisted interventions that can enable better navigation during procedures, automation of image interpretation and robotically assisted tool manipulation. In this Perspective, we summarize state-of-the-art artificial intelligence for computer-assisted interventions in gastroenterology and surgery.
Collapse
Affiliation(s)
- François Chadebecq
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - Laurence B Lovat
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, UK.
| |
Collapse
|
23
|
A Medical Image Segmentation Method Based on Improved UNet 3+ Network. Diagnostics (Basel) 2023; 13:diagnostics13030576. [PMID: 36766681 PMCID: PMC9914627 DOI: 10.3390/diagnostics13030576] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 01/16/2023] [Accepted: 02/01/2023] [Indexed: 02/07/2023] Open
Abstract
In recent years, segmentation details and computing efficiency have become more important in medical image segmentation for clinical applications. In deep learning, UNet based on a convolutional neural network is one of the most commonly used models. UNet 3+ was designed as a modified UNet by adopting the architecture of full-scale skip connections. However, full-scale feature fusion can result in excessively redundant computations. This study aimed to reduce the network parameters of UNet 3+ while further improving the feature extraction capability. First, to eliminate redundancy and improve computational efficiency, we prune the full-scale skip connections of UNet 3+. In addition, we use the attention module called Convolutional Block Attention Module (CBAM) to capture more essential features and thus improve the feature expression capabilities. The performance of the proposed model was validated by three different types of datasets: skin cancer segmentation, breast cancer segmentation, and lung segmentation. The parameters are reduced by about 36% and 18% compared to UNet and UNet 3+, respectively. The results show that the proposed method not only outperformed the comparison models in a variety of evaluation metrics but also achieved more accurate segmentation results. The proposed models have lower network parameters that enhance feature extraction and improve segmentation performance efficiently. Furthermore, the models have great potential for application in medical imaging computer-aided diagnosis.
Collapse
|
24
|
Irkham I, Ibrahim AU, Nwekwo CW, Al-Turjman F, Hartati YW. Current Technologies for Detection of COVID-19: Biosensors, Artificial Intelligence and Internet of Medical Things (IoMT): Review. SENSORS (BASEL, SWITZERLAND) 2022; 23:426. [PMID: 36617023 PMCID: PMC9824404 DOI: 10.3390/s23010426] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 12/14/2022] [Accepted: 12/21/2022] [Indexed: 06/17/2023]
Abstract
Despite the fact that COVID-19 is no longer a global pandemic due to development and integration of different technologies for the diagnosis and treatment of the disease, technological advancement in the field of molecular biology, electronics, computer science, artificial intelligence, Internet of Things, nanotechnology, etc. has led to the development of molecular approaches and computer aided diagnosis for the detection of COVID-19. This study provides a holistic approach on COVID-19 detection based on (1) molecular diagnosis which includes RT-PCR, antigen-antibody, and CRISPR-based biosensors and (2) computer aided detection based on AI-driven models which include deep learning and transfer learning approach. The review also provide comparison between these two emerging technologies and open research issues for the development of smart-IoMT-enabled platforms for the detection of COVID-19.
Collapse
Affiliation(s)
- Irkham Irkham
- Department of Chemistry, Faculty of Mathematics and Natural Sciences, Padjadjaran University, Bandung 40173, Indonesia
| | | | - Chidi Wilson Nwekwo
- Department of Biomedical Engineering, Near East University, Mersin 99138, Turkey
| | - Fadi Al-Turjman
- Research Center for AI and IoT, Faculty of Engineering, University of Kyrenia, Mersin 99138, Turkey
- Artificial Intelligence Engineering Department, AI and Robotics Institute, Near East University, Mersin 99138, Turkey
| | - Yeni Wahyuni Hartati
- Department of Chemistry, Faculty of Mathematics and Natural Sciences, Padjadjaran University, Bandung 40173, Indonesia
| |
Collapse
|
25
|
Houwen BBSL, Hartendorp F, Giotis I, Hazewinkel Y, Fockens P, Walstra TR, Dekker E, van Boeckel P, Boparai K, Borg FT, Carballal S, Cazemier M, Daca M, van Eijk B, Jansen J, Koussoulas V, Kuipers T, van Lelyveld N, Ordas I, Marsman W, Moreira L, Muños FR, Noach L, Pellisé M, Ramsoekh D, Schröder R, van Soest E, van Noorden JT, Tytgat K, van Oosterwijk P, van Putten P, Vehmeijer A, Vries RD, van der Vlugt M, Voogd F, van der Zanden E. Computer-aided classification of colorectal segments during colonoscopy: a deep learning approach based on images of a magnetic endoscopic positioning device. Scand J Gastroenterol 2022; 58:649-655. [PMID: 36458659 DOI: 10.1080/00365521.2022.2151320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
Abstract
OBJECTIVE Assessment of the anatomical colorectal segment of polyps during colonoscopy is important for treatment and follow-up strategies, but is largely operator dependent. This feasibility study aimed to assess whether, using images of a magnetic endoscope imaging (MEI) positioning device, a deep learning approach can be useful to objectively divide the colorectum into anatomical segments. METHODS Models based on the VGG-16 based convolutional neural network architecture were developed to classify the colorectum into anatomical segments. These models were pre-trained on ImageNet data and further trained using prospectively collected data of the POLAR study in which endoscopists were using MEI (3930 still images and 90,151 video frames). Five-fold cross validation with multiple runs was used to evaluate the overall diagnostic accuracies of the models for colorectal segment classification (divided into a 5-class and 2-class colorectal segment division). The colorectal segment assignment by endoscopists was used as the reference standard. RESULTS For the 5-class colorectal segment division, the best performing model correctly classified the colorectal segment in 753 of the 1196 polyps, corresponding to an overall accuracy of 63%, sensitivity of 63%, specificity of 89% and kappa of 0.47. For the 2-class colorectal segment division, 1112 of the 1196 polyps were correctly classified, corresponding to an accuracy of 93%, sensitivity of 93%, specificity of 90% and kappa of 0.82. CONCLUSION The diagnostic performance of a deep learning approach for colorectal segment classification based on images of a MEI device is yet suboptimal (clinicaltrials.gov: NCT03822390).
Collapse
Affiliation(s)
- Britt B S L Houwen
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Fons Hartendorp
- Department of Computer Science, University of Amsterdam, Amsterdam, the Netherlands
| | - Ioanis Giotis
- ZiuZ Visual Intelligence, Gorredijk, the Netherlands
| | - Yark Hazewinkel
- Department of Gastroenterology and Hepatology, Radboud University Medical Center, Radboud University, Nijmegen, The Netherlands
| | - Paul Fockens
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Taco R Walstra
- Department of Computer Science, University of Amsterdam, Amsterdam, the Netherlands
| | - Evelien Dekker
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands.,Bergman Clinics Maag & Darm Amsterdam, Amsterdam, The Netherlands
| | | | | | - P. van Boeckel
- Department of Gastroenterology and Hepatology, Sint Antonius Ziekenhuis, Nieuwegein, the Netherlands
| | - K. Boparai
- Department of Gastroenterology and Hepatology, Amstelland Hospital, Amstelveen, the Netherlands
| | - F. ter Borg
- Department of Gastroenterology and Hepatology, Deventer Hospital, Deventer, The Netherlands
| | - S. Carballal
- Department of Gastroenterology and Hepatology, Onze Lieve Vrouwe Gasthuis, Amsterdam, the Netherlands
- Department of Gastroenterology, Hospital Clinic of Barcelona, Barcelona, Spain
| | - M. Cazemier
- Centro de Investigación Biomédica en Red de Enfermedades Hepáticas y Digestivas (CIBERehd), Institut d‘Investigacions Biomediques August Pi i Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain
| | - M. Daca
- Department of Gastroenterology and Hepatology, Onze Lieve Vrouwe Gasthuis, Amsterdam, the Netherlands
- Department of Gastroenterology, Hospital Clinic of Barcelona, Barcelona, Spain
| | - B. van Eijk
- Department of Gastroenterology and Hepatology, Spaarne Ziekenhuis, Hoofddorp, the Netherlands
| | - J.M Jansen
- Centro de Investigación Biomédica en Red de Enfermedades Hepáticas y Digestivas (CIBERehd), Institut d‘Investigacions Biomediques August Pi i Sunyer (IDIBAPS), Universitat de Barcelona, Barcelona, Spain
| | - V. Koussoulas
- Department of Gastroenterology and Hepatology, Nij Smellinghe Hospital, Drachten, The Netherlands
| | - T. Kuipers
- Department of Gastroenterology and Hepatology, Amstelland Hospital, Amstelveen, the Netherlands
| | - N. van Lelyveld
- Department of Gastroenterology and Hepatology, Sint Antonius Ziekenhuis, Nieuwegein, the Netherlands
| | - I. Ordas
- Department of Gastroenterology and Hepatology, Onze Lieve Vrouwe Gasthuis, Amsterdam, the Netherlands
- Department of Gastroenterology, Hospital Clinic of Barcelona, Barcelona, Spain
| | - W. Marsman
- Department of Gastroenterology and Hepatology, Nij Smellinghe Hospital, Drachten, The Netherlands
| | - L. Moreira
- Department of Gastroenterology and Hepatology, Onze Lieve Vrouwe Gasthuis, Amsterdam, the Netherlands
- Department of Gastroenterology, Hospital Clinic of Barcelona, Barcelona, Spain
| | - F.J Rando Muños
- Department of Gastroenterology and Hepatology, Nij Smellinghe Hospital, Drachten, The Netherlands
| | - L. Noach
- Department of Gastroenterology and Hepatology, Amstelland Hospital, Amstelveen, the Netherlands
| | - M. Pellisé
- Department of Gastroenterology and Hepatology, Onze Lieve Vrouwe Gasthuis, Amsterdam, the Netherlands
- Department of Gastroenterology, Hospital Clinic of Barcelona, Barcelona, Spain
| | - D. Ramsoekh
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
- Bergman Clinics Maag & Darm Amsterdam, Amsterdam, The Netherlands
- Department of Gastroenterology and Hepatology, Amstelland Hospital, Amstelveen, the Netherlands
| | - R. Schröder
- Department of Gastroenterology and Hepatology, Nij Smellinghe Hospital, Drachten, The Netherlands
| | - E.J van Soest
- Department of Gastroenterology and Hepatology, Spaarne Ziekenhuis, Hoofddorp, the Netherlands
| | - J. Tenthof van Noorden
- Department of Gastroenterology and Hepatology, Sint Antonius Ziekenhuis, Nieuwegein, the Netherlands
| | - K.M.A.J Tytgat
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
- Bergman Clinics Maag & Darm Amsterdam, Amsterdam, The Netherlands
| | - P. van Oosterwijk
- Department of Gastroenterology and Hepatology, Deventer Hospital, Deventer, The Netherlands
| | - P. van Putten
- Department of Gastroenterology and Hepatology, Medical Center Leeuwarden, Leeuwarden, The Netherlands
| | - A. Vehmeijer
- Department of Gastroenterology and Hepatology, Spaarne Ziekenhuis, Hoofddorp, the Netherlands
| | - R. de Vries
- Department of Gastroenterology and Hepatology, Deventer Hospital, Deventer, The Netherlands
| | - M. van der Vlugt
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
- Bergman Clinics Maag & Darm Amsterdam, Amsterdam, The Netherlands
| | - F. Voogd
- Department of Gastroenterology and Hepatology, Medical Center Leeuwarden, Leeuwarden, The Netherlands
| | - E. van der Zanden
- Department of Gastroenterology and Hepatology, Amstelland Hospital, Amstelveen, the Netherlands
| | | |
Collapse
|
26
|
Intelligent oncology: The convergence of artificial intelligence and oncology. JOURNAL OF THE NATIONAL CANCER CENTER 2022. [DOI: 10.1016/j.jncc.2022.11.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
|
27
|
Rondonotti E, Di Paolo D, Rizzotto ER, Alvisi C, Buscarini E, Spadaccini M, Tamanini G, Paggi S, Amato A, Scardino G, Romeo S, Alicante S, Ancona F, Guido E, Marzo V, Chicco F, Agazzi S, Rosa C, Correale L, Repici A, Hassan C, Radaelli F. Efficacy of a computer-aided detection system in a fecal immunochemical test-based organized colorectal cancer screening program: a randomized controlled trial (AIFIT study). Endoscopy 2022; 54:1171-1179. [PMID: 35545122 DOI: 10.1055/a-1849-6878] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
BACKGROUND Computer-aided detection (CADe) increases adenoma detection in primary screening colonoscopy. The potential benefit of CADe in a fecal immunochemical test (FIT)-based colorectal cancer (CRC) screening program is unknown. This study assessed whether use of CADe increases the adenoma detection rate (ADR) in a FIT-based CRC screening program. METHODS In a multicenter, randomized trial, FIT-positive individuals aged 50-74 years undergoing colonoscopy, were randomized (1:1) to receive high definition white-light (HDWL) colonoscopy, with or without a real-time deep-learning CADe by endoscopists with baseline ADR > 25 %. The primary outcome was ADR. Secondary outcomes were mean number of adenomas per colonoscopy (APC) and advanced adenoma detection rate (advanced-ADR). Subgroup analysis according to baseline endoscopists' ADR (≤ 40 %, 41 %-45 %, ≥ 46 %) was also performed. RESULTS 800 individuals (median age 61.0 years [interquartile range 55-67]; 409 men) were included: 405 underwent CADe-assisted colonoscopy and 395 underwent HDWL colonoscopy alone. ADR and APC were significantly higher in the CADe group than in the HDWL arm: ADR 53.6 % (95 %CI 48.6 %-58.5 %) vs. 45.3 % (95 %CI 40.3 %-50.45 %; RR 1.18; 95 %CI 1.03-1.36); APC 1.13 (SD 1.54) vs. 0.90 (SD 1.32; P = 0.03). No significant difference in advanced-ADR was found (18.5 % [95 %CI 14.8 %-22.6 %] vs. 15.9 % [95 %CI 12.5 %-19.9 %], respectively). An increase in ADR was observed in all endoscopist groups regardless of baseline ADR. CONCLUSIONS Incorporating CADe significantly increased ADR and APC in the framework of a FIT-based CRC screening program. The impact of CADe appeared to be consistent regardless of endoscopist baseline ADR.
Collapse
Affiliation(s)
| | - Dhanai Di Paolo
- Gastroenterology Unit, Valduce Hospital, Como, Italy.,Foundation IRCCS Ca' Granda Ospedale Maggiore Policlinico, Department of Gastroenterology and Hepatology, Milan, Italy
| | - Erik Rosa Rizzotto
- Gastroenterology Unit, St. Antonio Hospital, Azienda Ospedaliera Universitaria, Padova, Italy
| | | | | | - Marco Spadaccini
- Department of Biomedical Sciences, Humanitas University, Rozzano, Milan, Italy.,Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Milan, Italy
| | | | - Silvia Paggi
- Gastroenterology Unit, Valduce Hospital, Como, Italy
| | - Arnaldo Amato
- Gastroenterology Unit, Valduce Hospital, Como, Italy
| | | | - Samanta Romeo
- Gastroenterology Unit, Azienda Ospedaliera "Ospedale Maggiore", Crema, Italy
| | - Saverio Alicante
- Gastroenterology Unit, Azienda Ospedaliera "Ospedale Maggiore", Crema, Italy
| | - Fabio Ancona
- Gastroenterology Unit, St. Antonio Hospital, Azienda Ospedaliera Universitaria, Padova, Italy
| | - Ennio Guido
- Gastroenterology Unit, St. Antonio Hospital, Azienda Ospedaliera Universitaria, Padova, Italy
| | | | - Fabio Chicco
- USD Endoscopia Digestiva, ASST Pavia, Pavia, Italy
| | | | - Cesare Rosa
- USD Endoscopia Digestiva, ASST Pavia, Pavia, Italy
| | - Loredana Correale
- Department of Biomedical Sciences, Humanitas University, Rozzano, Milan, Italy
| | - Alessandro Repici
- Department of Biomedical Sciences, Humanitas University, Rozzano, Milan, Italy.,Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Milan, Italy
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Rozzano, Milan, Italy.,Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Milan, Italy
| | | | | |
Collapse
|
28
|
Feng B, Xu C, An Z. AI recognition preprocessing algorithm for polyp based on illumination equalization and highlight restoration. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS 2022. [DOI: 10.1007/s41060-022-00353-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
|
29
|
Artificial Intelligence in Orthopedic Radiography Analysis: A Narrative Review. Diagnostics (Basel) 2022; 12:diagnostics12092235. [PMID: 36140636 PMCID: PMC9498096 DOI: 10.3390/diagnostics12092235] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 09/12/2022] [Accepted: 09/13/2022] [Indexed: 11/17/2022] Open
Abstract
Artificial intelligence (AI) in medicine is a rapidly growing field. In orthopedics, the clinical implementations of AI have not yet reached their full potential. Deep learning algorithms have shown promising results in computed radiographs for fracture detection, classification of OA, bone age, as well as automated measurements of the lower extremities. Studies investigating the performance of AI compared to trained human readers often show equal or better results, although human validation is indispensable at the current standards. The objective of this narrative review is to give an overview of AI in medicine and summarize the current applications of AI in orthopedic radiography imaging. Due to the different AI software and study design, it is difficult to find a clear structure in this field. To produce more homogeneous studies, open-source access to AI software codes and a consensus on study design should be aimed for.
Collapse
|
30
|
Polyp detection on video colonoscopy using a hybrid 2D/3D CNN. Med Image Anal 2022; 82:102625. [DOI: 10.1016/j.media.2022.102625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 08/22/2022] [Accepted: 09/10/2022] [Indexed: 12/15/2022]
|
31
|
Yu T, Lin N, Zhang X, Pan Y, Hu H, Zheng W, Liu J, Hu W, Duan H, Si J. An end-to-end tracking method for polyp detectors in colonoscopy videos. Artif Intell Med 2022; 131:102363. [DOI: 10.1016/j.artmed.2022.102363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2021] [Revised: 05/04/2022] [Accepted: 07/11/2022] [Indexed: 12/09/2022]
|
32
|
Computer copilots for endoscopic diagnosis. NPJ Digit Med 2022; 5:129. [PMID: 36050460 PMCID: PMC9436955 DOI: 10.1038/s41746-022-00678-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Accepted: 08/15/2022] [Indexed: 11/08/2022] Open
|
33
|
Shaukat A, Lichtenstein DR, Somers SC, Chung DC, Perdue DG, Gopal M, Colucci DR, Phillips SA, Marka NA, Church TR, Brugge WR. Computer-Aided Detection Improves Adenomas per Colonoscopy for Screening and Surveillance Colonoscopy: A Randomized Trial. Gastroenterology 2022; 163:732-741. [PMID: 35643173 DOI: 10.1053/j.gastro.2022.05.028] [Citation(s) in RCA: 36] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 05/05/2022] [Accepted: 05/13/2022] [Indexed: 12/28/2022]
Abstract
BACKGROUND & AIMS Colonoscopy for colorectal cancer screening is endoscopist dependent, and colonoscopy quality improvement programs aim to improve efficacy. This study evaluated the clinical benefit and safety of using a computer-aided detection (CADe) device in colonoscopy procedures. METHODS This randomized study prospectively evaluated the use of a CADe device at 5 academic and community centers by US board-certified gastroenterologists (n = 22). Participants aged ≥40 scheduled for screening or surveillance (≥3 years) colonoscopy were included; exclusion criteria included incomplete procedure, diagnostic indication, inflammatory bowel disease, and familial adenomatous polyposis. Patients were randomized by endoscopist to the standard or CADe colonoscopy arm using computer-generated, random-block method. The 2 primary endpoints were adenomas per colonoscopy (APC), the total number of adenomas resected divided by the total number of colonoscopies; and true histology rate (THR), the proportion of resections with clinically significant histology divided by the total number of polyp resections. The primary analysis used a modified intention-to-treat approach. RESULTS Between January and September 2021, 1440 participants were enrolled to be randomized. After exclusion of participants who did not meet the eligibility criteria, 677 in the standard arm and 682 in the CADe arm were included in a modified intention-to-treat analysis. APC increased significantly with use of the CADe device (standard vs CADe: 0.83 vs 1.05, P = .002; total number of adenomas, 562 vs 719). There was no decrease in THR with use of the CADe device (standard vs CADe: 71.7% vs 67.4%, P for noninferiority < .001; total number of non-neoplastic lesions, 284 vs 375). Adenoma detection rate was 43.9% and 47.8% in the standard and CADe arms, respectively (P = .065). CONCLUSIONS For experienced endoscopists performing screening and surveillance colonoscopies in the United States, the CADe device statistically improved overall adenoma detection (APC) without a concomitant increase in resection of non-neoplastic lesions (THR). CLINICALTRIALS gov registration: NCT04754347.
Collapse
Affiliation(s)
- Aasma Shaukat
- Division of Gastroenterology and Hepatology, Department of Medicine, New York University Grossman School of Medicine, New York, New York; Division of Environmental Health Sciences, University of Minnesota School of Public Health, Minneapolis, Minnesota.
| | - David R Lichtenstein
- Division of Gastroenterology, Department of Medicine, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
| | - Samuel C Somers
- Concord Hospital Gastroenterology/Concord Endoscopy Center, Concord, New Hampshire
| | - Daniel C Chung
- Division of Gastroenterology, Department of Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | | | | | | | | | - Nicholas A Marka
- Clinical and Translational Science Institute, University of Minnesota, Minneapolis, Minnesota
| | - Timothy R Church
- Division of Environmental Health Sciences, University of Minnesota School of Public Health, Minneapolis, Minnesota
| | - William R Brugge
- Division of Gastroenterology, Department of Medicine, Mount Auburn Hospital, Harvard Medical School, Boston, Massachusetts
| | | |
Collapse
|
34
|
Zhong L, Wang C. Diagnostic accuracy of S-Detect in distinguishing benign and malignant thyroid nodules: A meta-analysis. PLoS One 2022; 17:e0272149. [PMID: 35930525 PMCID: PMC9355179 DOI: 10.1371/journal.pone.0272149] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Accepted: 07/13/2022] [Indexed: 11/19/2022] Open
Abstract
Objectives In this meta-analysis study, the main objective was to determine the accuracy of S-detect in effectively distinguishing malignant thyroid nodules from benign thyroid nodules. Methods We searched the PubMed, Cochrane Library, and CBM databases from inception to August 1, 2021. Meta-analysis was conducted using STATA version 14.0 and Meta-Disc version 1.4 softwares. We calculated summary statistics for sensitivity (Sen), specificity (Spe), positive and negative likelihood ratio (LR+/LR−), diagnostic odds ratio(DOR), and receiver operating characteristic (SROC) curves. Cochran’s Q-statistic and I2 test were used to evaluate potential heterogeneity between studies. A sensitivity analysis was performed to evaluate the influence of single studies on the overall estimate. We also performed meta-regression analyses to investigate the potential sources of heterogeneity. Results In this study, a total of 17 studies meeting the requirements of the standard were used. The number of benign and malignant nodules analyzed and evaluated in this paper was 1595 and 1118 respectively. This paper mainly completes the required histological confirmation through s-detect. The pooled Sen and pooled Spe were 0.87 and 0.74, respectively, (95%CI = 0.84–0.89) and (95%CI = 0.66–0.81). Furthermore, the pooled LR+ and negative LR− were determined to be 3.37 (95%CI = 2.53–4.50) and 0.18 (95%CI = 0.15–0.21), respectively. The experimental results showed that the pooled DOR of thyroid nodules was 18.83 (95% CI = 13.21–26.84). In addition, area under SROC curve was determined to be 0.89 (SE = 0.0124). It should be pointed out that there is no evidence of bias (i.e. t = 0.25, P = 0.80). Conclusions Through this meta-analysis, it can be seen that the accuracy of s-detect is relatively high for the effective distinction between malignant thyroid nodules and benign thyroid nodules.
Collapse
Affiliation(s)
- Lin Zhong
- Pathology Department of the First Affiliated Hospital of Dalian Medical University, Dalian, China
| | - Cong Wang
- Ultrasound Department of the First Affiliated Hospital of Dalian Medical University, Dalian, China
- * E-mail:
| |
Collapse
|
35
|
Kou W, Galal GO, Klug MW, Mukhin V, Carlson DA, Etemadi M, Kahrilas PJ, Pandolfino JE. Deep learning-based artificial intelligence model for identifying swallow types in esophageal high-resolution manometry. Neurogastroenterol Motil 2022; 34:e14290. [PMID: 34709712 PMCID: PMC9046460 DOI: 10.1111/nmo.14290] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2021] [Revised: 10/13/2021] [Accepted: 10/19/2021] [Indexed: 02/08/2023]
Abstract
BACKGROUND This study aimed to build and evaluate a deep learning, artificial intelligence (AI) model to automatically classify swallow types based on raw data from esophageal high-resolution manometry (HRM). METHODS HRM studies on patients with no history of esophageal surgery were collected including 1,741 studies with 26,115 swallows labeled by swallow type (normal, hypercontractile, weak-fragmented, failed, and premature) by an expert interpreter per the Chicago Classification. The dataset was stratified and split into train/validation/test datasets for model development. Long short-term memory (LSTM), a type of deep-learning AI model, was trained and evaluated. The overall performance and detailed per-swallow type performance were analyzed. The interpretations of the supine swallows in a single study were further used to generate an overall classification of peristalsis. KEY RESULTS The LSTM model for swallow type yielded accuracies from the train/validation/test datasets of 0.86/0.81/0.83. The model's interpretation for study-level classification of peristalsis yielded accuracy of 0.88 in the test dataset. Among model misclassification, 535/698 (77%) swallows and 25/35 (71%) studies were to adjacent categories, for example, normal to weak or normal to ineffective, respectively. CONCLUSIONS AND INFERENCES A deep-learning AI model can automatically and accurately identify the Chicago Classification swallow types and peristalsis classification from raw HRM data. While future work to refine this model and incorporate overall manometric diagnoses are needed, this study demonstrates the role that AI will serve in the interpretation and classification of esophageal HRM studies.
Collapse
Affiliation(s)
- Wenjun Kou
- Gastroenterology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Galal Osama Galal
- Anesthesiology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Matthew William Klug
- Anesthesiology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Vladislav Mukhin
- Anesthesiology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Dustin A. Carlson
- Gastroenterology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Mozziyar Etemadi
- Anesthesiology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois,Department of Biomedical Engineering, Northwestern University, Evanston, Illinois
| | - Peter J Kahrilas
- Gastroenterology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - John E. Pandolfino
- Gastroenterology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| |
Collapse
|
36
|
Biffi C, Salvagnini P, Dinh NN, Hassan C, Sharma P, Cherubini A. A novel AI device for real-time optical characterization of colorectal polyps. NPJ Digit Med 2022; 5:84. [PMID: 35773468 PMCID: PMC9247164 DOI: 10.1038/s41746-022-00633-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 06/16/2022] [Indexed: 01/03/2023] Open
Abstract
Accurate in-vivo optical characterization of colorectal polyps is key to select the optimal treatment regimen during colonoscopy. However, reported accuracies vary widely among endoscopists. We developed a novel intelligent medical device able to seamlessly operate in real-time using conventional white light (WL) endoscopy video stream without virtual chromoendoscopy (blue light, BL). In this work, we evaluated the standalone performance of this computer-aided diagnosis device (CADx) on a prospectively acquired dataset of unaltered colonoscopy videos. An international group of endoscopists performed optical characterization of each polyp acquired in a prospective study, blinded to both histology and CADx result, by means of an online platform enabling careful video assessment. Colorectal polyps were categorized by reviewers, subdivided into 10 experts and 11 non-experts endoscopists, and by the CADx as either “adenoma” or “non-adenoma”. A total of 513 polyps from 165 patients were assessed. CADx accuracy in WL was found comparable to the accuracy of expert endoscopists (CADxWL/Exp; OR 1.211 [0.766–1.915]) using histopathology as the reference standard. Moreover, CADx accuracy in WL was found superior to the accuracy of non-expert endoscopists (CADxWL/NonExp; OR 1.875 [1.191–2.953]), and CADx accuracy in BL was found comparable to it (CADxBL/CADxWL; OR 0.886 [0.612–1.282]). The proposed intelligent device shows the potential to support non-expert endoscopists in systematically reaching the performances of expert endoscopists in optical characterization.
Collapse
Affiliation(s)
- Carlo Biffi
- Artificial Intelligence Group, Cosmo AI/Linkverse, Lainate/Rome, Italy
| | - Pietro Salvagnini
- Artificial Intelligence Group, Cosmo AI/Linkverse, Lainate/Rome, Italy
| | - Nhan Ngo Dinh
- Artificial Intelligence Group, Cosmo AI/Linkverse, Lainate/Rome, Italy
| | - Cesare Hassan
- Gastroenterology Unit, Nuovo Regina Margherita Hospital, Rome, Italy.,Endoscopy Unit, Humanitas Clinical and Research Center IRCCS, Rozzano, Italy
| | - Prateek Sharma
- VA Medical Center, Kansas City, MO, USA.,University of Kansas School of Medicine, Kansas City, MO, USA
| | | | - Andrea Cherubini
- Artificial Intelligence Group, Cosmo AI/Linkverse, Lainate/Rome, Italy. .,Milan Center for Neuroscience, University of Milano-Bicocca, 20126, Milano, Italy.
| |
Collapse
|
37
|
MiWEndo: Evaluation of a Microwave Colonoscopy Algorithm for Early Colorectal Cancer Detection in Ex Vivo Human Colon Models. SENSORS 2022; 22:s22134902. [PMID: 35808397 PMCID: PMC9269828 DOI: 10.3390/s22134902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 06/21/2022] [Accepted: 06/26/2022] [Indexed: 12/04/2022]
Abstract
This study assesses the efficacy of detecting colorectal cancer precursors or polyps in an ex vivo human colon model with a microwave colonoscopy algorithm. Nowadays, 22% of polyps go undetected with conventional colonoscopy, and the risk of cancer after a negative colonoscopy can be up to 7.9%. We developed a microwave colonoscopy device that consists of a cylindrical ring-shaped switchable microwave antenna array that can be attached to the tip of a conventional colonoscope as an accessory. The accessory is connected to an external unit that allows successive measurements of the colon and processes the measurements with a microwave imaging algorithm. An acoustic signal is generated when a polyp is detected. Fifteen ex vivo freshly excised human colons with cancer (n = 12) or polyps (n = 3) were examined with the microwave-assisted colonoscopy system simulating a real colonoscopy exploration. After the experiment, the dielectric properties of the specimens were measured with a coaxial probe and the samples underwent a pathology analysis. The results show that all the neoplasms were detected with a sensitivity of 100% and specificity of 87.4%.
Collapse
|
38
|
Song Y, Ren S, Lu Y, Fu X, Wong KKL. Deep learning-based automatic segmentation of images in cardiac radiography: A promising challenge. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 220:106821. [PMID: 35487181 DOI: 10.1016/j.cmpb.2022.106821] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2020] [Revised: 04/08/2022] [Accepted: 04/17/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Due to the advancement of medical imaging and computer technology, machine intelligence to analyze clinical image data increases the probability of disease prevention and successful treatment. When diagnosing and detecting heart disease, medical imaging can provide high-resolution scans of every organ or tissue in the heart. The diagnostic results obtained by the imaging method are less susceptible to human interference. They can process numerous patient information, assist doctors in early detection of heart disease, intervene and treat patients, and improve the understanding of heart disease symptoms and clinical diagnosis of great significance. In a computer-aided diagnosis system, accurate segmentation of cardiac scan images is the basis and premise of subsequent thoracic function analysis and 3D image reconstruction. EXISTING TECHNIQUES This paper systematically reviews automatic methods and some difficulties for cardiac segmentation in radiographic images. Combined with recent advanced deep learning techniques, the feasibility of using deep learning network models for image segmentation is discussed, and the commonly used deep learning frameworks are compared. DEVELOPED INSIGHTS There are many standard methods for medical image segmentation, such as traditional methods based on regions and edges and methods based on deep learning. Because of characteristics of non-uniform grayscale, individual differences, artifacts and noise of medical images, the above image segmentation methods have certain limitations. It is tough to obtain the needed results sensitivity and accuracy when performing heart segmentation. The deep learning model proposed has achieved good results in image segmentation. Accurate segmentation improves the accuracy of disease diagnosis and reduces subsequent irrelevant computations. SUMMARY There are two requirements for accurate segmentation of radiological images. One is to use image segmentation to improve the development of computer-aided diagnosis. The other is to achieve complete segmentation of the heart. When there are lesions or deformities in the heart, there will be some abnormalities in the radiographic images, and the segmentation algorithm needs to segment the heart altogether. The quantity of processing inside a certain range will no longer be a restriction for real-time detection with the advancement of deep learning and the enhancement of hardware device performance.
Collapse
Affiliation(s)
- Yucheng Song
- School of Computer Science and Engineering, Central South University, Changsha, China
| | - Shengbing Ren
- School of Computer Science and Engineering, Central South University, Changsha, China
| | - Yu Lu
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China.
| | - Xianghua Fu
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Kelvin K L Wong
- School of Computer Science and Engineering, Central South University, Changsha, China.
| |
Collapse
|
39
|
Tang CP, Lin TL, Hsieh YH, Hsieh CH, Tseng CW, Leung FW. Polyp detection and false-positive rates by computer-aided analysis of withdrawal-phase videos of colonoscopy of the right-sided colon segment in a randomized controlled trial comparing water exchange and air insufflation. Gastrointest Endosc 2022; 95:1198-1206.e6. [PMID: 34973967 DOI: 10.1016/j.gie.2021.12.020] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 12/17/2021] [Indexed: 12/11/2022]
Abstract
BACKGROUND AND AIMS Water exchange (WE) improves lesion detection but misses polyps because of human limitations. Computer-aided detection (CADe) identifies additional polyps overlooked by the colonoscopist. Additional polyp detection rate (APDR) is the proportion of patients with at least 1 additional polyp detected by CADe. The number of false positives (because of feces and air bubble) per colonoscopy (FPPC) is a major CADe limitation, which might be reduced by salvage cleaning with WE. We compared the APDR and FPPC by CADe between videos of WE and air insufflation in the right-sided colon. METHODS CADe used a convolutional neural network with transfer learning. We edited and coded withdrawal-phase videos in a randomized controlled trial that compared right-sided colon findings between air insufflation and WE. Two experienced blinded endoscopists analyzed the CADe-overlaid videos and identified additional polyps by consensus. An artifact triggered by CADe but not considered a polyp by the reviewers was defined as a false positive. The primary outcome was APDR. RESULTS Two hundred forty-five coded videos of colonoscopies inserted with WE (n = 123) and air insufflation (n = 122) methods were analyzed. The APDR in the WE group was significantly higher (37 [30.1%] vs 15 [12.3%], P = .001). The mean [standard deviation] FPPC related to feces (1.78 [1.67] vs 2.09 [2.09], P = .007) and bubbles (.53 [.89] vs 1.25 [2.45], P = .001) in the WE group were significantly lower. CONCLUSIONS CADe showed significantly higher APDR and lower number of FPPC related to feces and bubbles in the WE group. The results support the hypothesis that the strengths of CADe and WE complement the weaknesses of each other in optimizing polyp detection.
Collapse
Affiliation(s)
- Chia-Pei Tang
- Division of Gastroenterology, Department of Internal Medicine, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Chiayi, Taiwan; School of Medicine, Tzu Chi University, Hualien City, Taiwan
| | - Tu-Liang Lin
- Department of Management Information Systems, National Chiayi University, Chiayi, Taiwan
| | - Yu-Hsi Hsieh
- Division of Gastroenterology, Department of Internal Medicine, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Chiayi, Taiwan; School of Medicine, Tzu Chi University, Hualien City, Taiwan
| | - Chen-Hung Hsieh
- Department of Management Information Systems, National Chiayi University, Chiayi, Taiwan
| | - Chih-Wei Tseng
- Division of Gastroenterology, Department of Internal Medicine, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Chiayi, Taiwan; School of Medicine, Tzu Chi University, Hualien City, Taiwan
| | - Felix W Leung
- Sepulveda Ambulatory Care Center, Veterans Affairs Greater Los Angeles Healthcare System, North Hills, California, USA; David Geffen School of Medicine, University of California at Los Angeles, Los Angeles, California, USA
| |
Collapse
|
40
|
Colorectal polyp region extraction using saliency detection network with neutrosophic enhancement. Comput Biol Med 2022; 147:105760. [DOI: 10.1016/j.compbiomed.2022.105760] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Revised: 06/02/2022] [Accepted: 06/18/2022] [Indexed: 11/19/2022]
|
41
|
Ngwa W, Addai BW, Adewole I, Ainsworth V, Alaro J, Alatise OI, Ali Z, Anderson BO, Anorlu R, Avery S, Barango P, Bih N, Booth CM, Brawley OW, Dangou JM, Denny L, Dent J, Elmore SNC, Elzawawy A, Gashumba D, Geel J, Graef K, Gupta S, Gueye SM, Hammad N, Hessissen L, Ilbawi AM, Kambugu J, Kozlakidis Z, Manga S, Maree L, Mohammed SI, Msadabwe S, Mutebi M, Nakaganda A, Ndlovu N, Ndoh K, Ndumbalo J, Ngoma M, Ngoma T, Ntizimira C, Rebbeck TR, Renner L, Romanoff A, Rubagumya F, Sayed S, Sud S, Simonds H, Sullivan R, Swanson W, Vanderpuye V, Wiafe B, Kerr D. Cancer in sub-Saharan Africa: a Lancet Oncology Commission. Lancet Oncol 2022; 23:e251-e312. [PMID: 35550267 PMCID: PMC9393090 DOI: 10.1016/s1470-2045(21)00720-8] [Citation(s) in RCA: 102] [Impact Index Per Article: 51.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 12/02/2021] [Accepted: 12/06/2021] [Indexed: 01/13/2023]
Abstract
In sub-Saharan Africa (SSA), urgent action is needed to curb a growing crisis in cancer incidence and mortality. Without rapid interventions, data estimates show a major increase in cancer mortality from 520 348 in 2020 to about 1 million deaths per year by 2030. Here, we detail the state of cancer in SSA, recommend key actions on the basis of analysis, and highlight case studies and successful models that can be emulated, adapted, or improved across the region to reduce the growing cancer crises. Recommended actions begin with the need to develop or update national cancer control plans in each country. Plans must include childhood cancer plans, managing comorbidities such as HIV and malnutrition, a reliable and predictable supply of medication, and the provision of psychosocial, supportive, and palliative care. Plans should also engage traditional, complementary, and alternative medical practices employed by more than 80% of SSA populations and pathways to reduce missed diagnoses and late referrals. More substantial investment is needed in developing cancer registries and cancer diagnostics for core cancer tests. We show that investments in, and increased adoption of, some approaches used during the COVID-19 pandemic, such as hypofractionated radiotherapy and telehealth, can substantially increase access to cancer care in Africa, accelerate cancer prevention and control efforts, increase survival, and save billions of US dollars over the next decade. The involvement of African First Ladies in cancer prevention efforts represents one practical approach that should be amplified across SSA. Moreover, investments in workforce training are crucial to prevent millions of avoidable deaths by 2030. We present a framework that can be used to strategically plan cancer research enhancement in SSA, with investments in research that can produce a return on investment and help drive policy and effective collaborations. Expansion of universal health coverage to incorporate cancer into essential benefits packages is also vital. Implementation of the recommended actions in this Commission will be crucial for reducing the growing cancer crises in SSA and achieving political commitments to the UN Sustainable Development Goals to reduce premature mortality from non-communicable diseases by a third by 2030.
Collapse
Affiliation(s)
- Wilfred Ngwa
- Brigham and Women's Hospital, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, USA; Sidney Kimmel Comprehensive Cancer Center, School of Medicine, Johns Hopkins University, Baltimore, MD, USA; Department of Information and Sciences, ICT University, Yaoundé, Cameroon.
| | - Beatrice W Addai
- Breast Care International, Peace and Love Hospital, Kumasi, Ghana
| | - Isaac Adewole
- College of Medicine, University of Ibadan, Ibadan, Nigeria
| | - Victoria Ainsworth
- Department of Physics and Applied Physics, University of Massachusetts Lowell, Lowell, MA, USA
| | - James Alaro
- National Cancer Institute, National Institute of Health, Bethesda, MD, USA
| | | | - Zipporah Ali
- Kenya Hospices and Palliative Care Association, Nairobi, Kenya
| | - Benjamin O Anderson
- Division of Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, WA, USA; Department of Non-communicable Diseases, WHO, Geneva, Switzerland
| | - Rose Anorlu
- Department of Obstetrics and Gynaecology, College of Medicine, University of Lagos, Lagos University Teaching Hospital, Lagos, Nigeria
| | - Stephen Avery
- Department of Radiation Oncology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Prebo Barango
- WHO, Regional Office for Africa, Brazzaville, Republic of the Congo
| | - Noella Bih
- Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, USA
| | - Christopher M Booth
- Division of Cancer Care and Epidemiology, Cancer Research Institute, Queen's University, Kingston, ON, Canada
| | - Otis W Brawley
- Sidney Kimmel Comprehensive Cancer Center, School of Medicine, Johns Hopkins University, Baltimore, MD, USA; Department of Epidemiology, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, USA
| | | | - Lynette Denny
- Department of Obstetrics and Gynaecology, University of Cape Town, Cape Town, South Africa; South African Medical Research Council, Gynaecological Cancer Research Centre, Tygerberg, South Africa
| | | | - Shekinah N C Elmore
- Department of Radiation Oncology, School of Medicine, University of North Carolina, Chapel Hill, NC, USA
| | - Ahmed Elzawawy
- Department of Clinical Oncology, Suez Canal University, Ismailia, Egypt
| | | | - Jennifer Geel
- Division of Paediatric Haematology and Oncology, Faculty of Health Sciences, School of Clinical Medicine, University of the Witwatersrand, Johannesburg, South Africa
| | - Katy Graef
- BIO Ventures for Global Health, Seattle, WA, USA
| | - Sumit Gupta
- Division of Hematology/Oncology, The Hospital for Sick Children, Toronto, ON, Canada
| | | | - Nazik Hammad
- Department of Oncology, Queen's University, Kingston, ON, Canada
| | - Laila Hessissen
- Pediatric Oncology Department, Pediatric Teaching Hospital, Rabat, Morocco
| | - Andre M Ilbawi
- Department of Non-communicable Diseases, WHO, Geneva, Switzerland
| | - Joyce Kambugu
- Department of Pediatrics, Uganda Cancer Institute, Kampala, Uganda
| | - Zisis Kozlakidis
- Laboratory Services and Biobank Group, International Agency for Research on Cancer, WHO, Lyon, France
| | - Simon Manga
- Cameroon Baptist Convention Health Services, Bamenda, Cameroon
| | - Lize Maree
- Department of Nursing Education, University of the Witwatersrand, Johannesburg, South Africa
| | - Sulma I Mohammed
- Department of Comparative Pathobiology, Center for Cancer Research, Purdue University, West Lafayette, IN, USA
| | - Susan Msadabwe
- Department of Radiation Therapy, Cancer Diseases Hospital, Lusaka, Zambia
| | - Miriam Mutebi
- Department of Surgery, Aga Khan University Hospital, Nairobi, Kenya
| | | | - Ntokozo Ndlovu
- Faculty of Medicine and Health Sciences, University of Zimbabwe, Harare, Zimbabwe
| | - Kingsley Ndoh
- Department of Global Health, University of Washington, Seattle, WA, USA
| | | | - Mamsau Ngoma
- Ocean Road Cancer Institute, Dar es Salaam, Tanzania
| | - Twalib Ngoma
- Department of Clinical Oncology, Muhimbili University of Health and Allied Sciences, Dar es Salaam, Tanzania
| | | | - Timothy R Rebbeck
- Dana-Farber Cancer Institute, Harvard T H Chan School of Public Health, Boston, MA, USA
| | - Lorna Renner
- Department of Paediatrics, University of Ghana School of Medicine and Dentistry, Accra, Ghana
| | - Anya Romanoff
- Department of Health System Design and Global Health, Icahn School of Medicine, The Mount Sinai Hospital, New York, NY, USA
| | - Fidel Rubagumya
- Department of Oncology, Rwanda Military Hospital, Kigali, Rwanda; University of Global Health Equity, Kigali, Rwanda
| | - Shahin Sayed
- Department of Pathology, Aga Khan University Hospital, Nairobi, Kenya
| | - Shivani Sud
- Department of Radiation Oncology, School of Medicine, University of North Carolina, Chapel Hill, NC, USA
| | - Hannah Simonds
- Division of Radiation Oncology, Tygerberg Hospital and University of Stellenbosch, Stellenbosch, South Africa
| | | | - William Swanson
- Department of Physics and Applied Physics, Dana-Farber Cancer Institute, University of Massachusetts Lowell, Lowell, MA, USA
| | - Verna Vanderpuye
- National Centre for Radiotherapy, Oncology, and Nuclear Medicine, Korle Bu Teaching Hospital, Accra, Ghana
| | | | - David Kerr
- Radcliffe Department of Medicine, John Radcliffe Hospital, University of Oxford, Oxford, UK
| |
Collapse
|
42
|
Yang CB, Kim SH, Lim YJ. Preparation of image databases for artificial intelligence algorithm development in gastrointestinal endoscopy. Clin Endosc 2022; 55:594-604. [PMID: 35636749 PMCID: PMC9539300 DOI: 10.5946/ce.2021.229] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Accepted: 03/07/2022] [Indexed: 12/09/2022] Open
Abstract
Over the past decade, technological advances in deep learning have led to the introduction of artificial intelligence (AI) in medical imaging. The most commonly used structure in image recognition is the convolutional neural network, which mimics the action of the human visual cortex. The applications of AI in gastrointestinal endoscopy are diverse. Computer-aided diagnosis has achieved remarkable outcomes with recent improvements in machine-learning techniques and advances in computer performance. Despite some hurdles, the implementation of AI-assisted clinical practice is expected to aid endoscopists in real-time decision-making. In this summary, we reviewed state-of-the-art AI in the field of gastrointestinal endoscopy and offered a practical guide for building a learning image dataset for algorithm development.
Collapse
Affiliation(s)
- Chang Bong Yang
- Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang, Korea
| | - Sang Hoon Kim
- Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang, Korea
| | - Yun Jeong Lim
- Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang, Korea
| |
Collapse
|
43
|
Fu XY, Mao XL, Chen YH, You NN, Song YQ, Zhang LH, Cai Y, Ye XN, Ye LP, Li SW. The Feasibility of Applying Artificial Intelligence to Gastrointestinal Endoscopy to Improve the Detection Rate of Early Gastric Cancer Screening. Front Med (Lausanne) 2022; 9:886853. [PMID: 35652070 PMCID: PMC9150174 DOI: 10.3389/fmed.2022.886853] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 04/06/2022] [Indexed: 12/24/2022] Open
Abstract
Convolutional neural networks in the field of artificial intelligence show great potential in image recognition. It assisted endoscopy to improve the detection rate of early gastric cancer. The 5-year survival rate for advanced gastric cancer is less than 30%, while the 5-year survival rate for early gastric cancer is more than 90%. Therefore, earlier screening for gastric cancer can lead to a better prognosis. However, the detection rate of early gastric cancer in China has been extremely low due to many factors, such as the presence of gastric cancer without obvious symptoms, difficulty identifying lesions by the naked eye, and a lack of experience among endoscopists. The introduction of artificial intelligence can help mitigate these shortcomings and greatly improve the accuracy of screening. According to relevant reports, the sensitivity and accuracy of artificial intelligence trained on deep cirrocumulus neural networks are better than those of endoscopists, and evaluations also take less time, which can greatly reduce the burden on endoscopists. In addition, artificial intelligence can also perform real-time detection and feedback on the inspection process of the endoscopist to standardize the operation of the endoscopist. AI has also shown great potential in training novice endoscopists. With the maturity of AI technology, AI has the ability to improve the detection rate of early gastric cancer in China and reduce the death rate of gastric cancer related diseases in China.
Collapse
Affiliation(s)
- Xin-yu Fu
- Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| | - Xin-li Mao
- Key Laboratory of Minimally Invasive Techniques and Rapid Rehabilitation of Digestive System Tumor of Zhejiang Province, Taizhou Hospital Affiliated to Wenzhou Medical University, Linhai, China
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
- Institute of Digestive Disease, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| | - Ya-hong Chen
- Health Management Center, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| | - Ning-ning You
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| | - Ya-qi Song
- Taizhou Hospital, Zhejiang University, Linhai, China
| | - Li-hui Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, China
| | - Yue Cai
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| | - Xing-nan Ye
- Taizhou Hospital of Zhejiang Province, Shaoxing University, Linhai, China
| | - Li-ping Ye
- Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
- Key Laboratory of Minimally Invasive Techniques and Rapid Rehabilitation of Digestive System Tumor of Zhejiang Province, Taizhou Hospital Affiliated to Wenzhou Medical University, Linhai, China
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
- Institute of Digestive Disease, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| | - Shao-wei Li
- Key Laboratory of Minimally Invasive Techniques and Rapid Rehabilitation of Digestive System Tumor of Zhejiang Province, Taizhou Hospital Affiliated to Wenzhou Medical University, Linhai, China
- Department of Gastroenterology, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
- Institute of Digestive Disease, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, China
| |
Collapse
|
44
|
D’Antoni F, Russo F, Ambrosio L, Bacco L, Vollero L, Vadalà G, Merone M, Papalia R, Denaro V. Artificial Intelligence and Computer Aided Diagnosis in Chronic Low Back Pain: A Systematic Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19105971. [PMID: 35627508 PMCID: PMC9141006 DOI: 10.3390/ijerph19105971] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 05/09/2022] [Accepted: 05/12/2022] [Indexed: 12/10/2022]
Abstract
Low Back Pain (LBP) is currently the first cause of disability in the world, with a significant socioeconomic burden. Diagnosis and treatment of LBP often involve a multidisciplinary, individualized approach consisting of several outcome measures and imaging data along with emerging technologies. The increased amount of data generated in this process has led to the development of methods related to artificial intelligence (AI), and to computer-aided diagnosis (CAD) in particular, which aim to assist and improve the diagnosis and treatment of LBP. In this manuscript, we have systematically reviewed the available literature on the use of CAD in the diagnosis and treatment of chronic LBP. A systematic research of PubMed, Scopus, and Web of Science electronic databases was performed. The search strategy was set as the combinations of the following keywords: “Artificial Intelligence”, “Machine Learning”, “Deep Learning”, “Neural Network”, “Computer Aided Diagnosis”, “Low Back Pain”, “Lumbar”, “Intervertebral Disc Degeneration”, “Spine Surgery”, etc. The search returned a total of 1536 articles. After duplication removal and evaluation of the abstracts, 1386 were excluded, whereas 93 papers were excluded after full-text examination, taking the number of eligible articles to 57. The main applications of CAD in LBP included classification and regression. Classification is used to identify or categorize a disease, whereas regression is used to produce a numerical output as a quantitative evaluation of some measure. The best performing systems were developed to diagnose degenerative changes of the spine from imaging data, with average accuracy rates >80%. However, notable outcomes were also reported for CAD tools executing different tasks including analysis of clinical, biomechanical, electrophysiological, and functional imaging data. Further studies are needed to better define the role of CAD in LBP care.
Collapse
Affiliation(s)
- Federico D’Antoni
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
| | - Fabrizio Russo
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
- Correspondence: (F.R.); (M.M.)
| | - Luca Ambrosio
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Luca Bacco
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
- ItaliaNLP Lab, Istituto di Linguistica Computazionale “Antonio Zampolli”, National Research Council, Via Giuseppe Moruzzi, 1, 56124 Pisa, Italy
- Webmonks S.r.l., Via del Triopio, 5, 00178 Rome, Italy
| | - Luca Vollero
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
| | - Gianluca Vadalà
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Mario Merone
- Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 21, 00128 Rome, Italy; (F.D.); (L.B.); (L.V.)
- Correspondence: (F.R.); (M.M.)
| | - Rocco Papalia
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| | - Vincenzo Denaro
- Department of Orthopaedic Surgery, Università Campus Bio-Medico di Roma, Via Alvaro Del Portillo, 200, 00128 Rome, Italy; (L.A.); (G.V.); (R.P.); (V.D.)
| |
Collapse
|
45
|
Modern Machine Learning Practices in Colorectal Surgery: A Scoping Review. J Clin Med 2022; 11:jcm11092431. [PMID: 35566555 PMCID: PMC9100508 DOI: 10.3390/jcm11092431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/12/2022] [Accepted: 03/29/2022] [Indexed: 12/09/2022] Open
Abstract
Objective: The use of machine learning (ML) has revolutionized every domain of medicine. Surgeons are now using ML models for disease detection and outcome prediction with high precision. ML-guided colorectal surgeries are more efficient than conventional surgical procedures. The primary aim of this paper is to provide an overview of the latest research on “ML in colorectal surgery”, with its viable applications. Methods: PubMed, Google Scholar, Medline, and Cochrane library were searched. Results: After screening, 27 articles out of 172 were eventually included. Among all of the reviewed articles, those found to fit the criteria for inclusion had exclusively focused on ML in colorectal surgery, with justified applications. We identified existing applications of ML in colorectal surgery. Additionally, we discuss the benefits, risks, and safety issues. Conclusions: A better, more sustainable, and more efficient method, with useful applications, for ML in surgery is possible if we and data scientists work together to address the drawbacks of the current approach. Potential problems related to patients’ perspectives also need to be resolved. The development of accurate technologies alone will not solve the problem of perceived unreliability from the patients’ end. Confidence can only be developed within society if more research with precise results is carried out.
Collapse
|
46
|
Peng W, Chen S, Kong D, Zhou X, Lu X, Chang C. Grade classification of human glioma using a convolutional neural network based on mid-infrared spectroscopy mapping. JOURNAL OF BIOPHOTONICS 2022; 15:e202100313. [PMID: 34931464 DOI: 10.1002/jbio.202100313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 11/15/2021] [Accepted: 12/17/2021] [Indexed: 06/14/2023]
Abstract
This study proposes a convolutional neural network (CNN)-based computer-aided diagnosis (CAD) system for the grade classification of human glioma by using mid-infrared (MIR) spectroscopic mappings. Through data augmentation of pixels recombination, the mappings in the training set increased almost 161 times relative to the original mappings. The pixels of the recombined mappings in the training set came from all of the one-dimensional (1D) vibrational spectroscopy of 62 (almost 80% of all 77 patients) patients at specific bands. Compared with the performance of the CNN-CAD system based on the 1D vibrational spectroscopy, we found that the mean diagnostic accuracy of the recombined MIR spectroscopic mappings at peaks of 2917 cm-1 , 1539 cm-1 and 1234 cm-1 on the test set performed higher and the model also had more stable patterns. This research demonstrates that two-dimensional MIR mapping at a single frequency can be used by the CNN-CAD system for diagnosis and the research also gives a prompt that the mapping collection process can be replaced by a single-frequency IR imaging system, which is cheaper and more portable than a Fourier transform infrared microscopy and thus may be widely utilized in hospitals to provide meaningful assistance for pathologists in clinics.
Collapse
Affiliation(s)
- Wenyu Peng
- Key Laboratory of Biomedical Information Engineering of Ministry of Education, School of Life Science, Xi'an Jiaotong University, Xi'an, China
- Innovation Laboratory of Terahertz Biophysics, National Innovation Institute of Defense Technology, Beijing, China
| | - Shuo Chen
- Innovation Laboratory of Terahertz Biophysics, National Innovation Institute of Defense Technology, Beijing, China
| | - Dongsheng Kong
- Department of Neurosurgery, Chinese People's Liberation Army (PLA) General Hospital, Beijing, China
| | - Xiaojie Zhou
- National Facility for Protein Science in Shanghai, Shanghai Advanced Research Institute, Chinese Academy of Science, Shanghai, China
| | - Xiaoyun Lu
- Key Laboratory of Biomedical Information Engineering of Ministry of Education, School of Life Science, Xi'an Jiaotong University, Xi'an, China
| | - Chao Chang
- Key Laboratory of Biomedical Information Engineering of Ministry of Education, School of Life Science, Xi'an Jiaotong University, Xi'an, China
- Innovation Laboratory of Terahertz Biophysics, National Innovation Institute of Defense Technology, Beijing, China
| |
Collapse
|
47
|
Chen K, Li H, Pan Z, Wu Z, Song E. Insights into artificial intelligence in clinical oncology: opportunities and challenges. SCIENCE CHINA. LIFE SCIENCES 2022; 65:643-647. [PMID: 34846642 DOI: 10.1007/s11427-021-2010-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Accepted: 09/18/2021] [Indexed: 06/13/2023]
Affiliation(s)
- Kai Chen
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Breast Tumor Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Hanwei Li
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Zhanpeng Pan
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Zhuo Wu
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Artificial Intelligence Lab, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
- Department of Radiology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China
| | - Erwei Song
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China.
- Breast Tumor Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, 510120, China.
- Fountain-Valley Institute for Life Sciences, Guangzhou Institute of Biomedicine and Health, Chinese Academy of Sciences, Guangzhou, 510530, China.
- Bioland Laboratory, Guangzhou, 510005, China.
| |
Collapse
|
48
|
Effect of artificial intelligence-aided colonoscopy for adenoma and polyp detection: a meta-analysis of randomized clinical trials. Int J Colorectal Dis 2022; 37:495-506. [PMID: 34762157 DOI: 10.1007/s00384-021-04062-x] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/29/2021] [Indexed: 02/04/2023]
Abstract
BACKGROUND This meta-analysis aimed to determine whether artificial intelligence (AI) improves colonoscopy outcome metrics i.e. adenoma detection rate (ADR) and polyp detection rate (PDR). METHODS Two authors independently searched Web of Science, PubMed, Science Direct, and Cochrane Library to find all published research before July 2021 that has compared AI-aided colonoscopy with routine colonoscopy (RC) for detection of adenoma and polyp. RESULTS This meta-analysis included 10 RCTs with 6629 individuals in AI-aided (n = 3300) and routine (n = 3329) groups. The results showed that both ADR (RR, 1.43; P < 0.001) and PDR (RR, 1.44; P < 0.001) using AI-aided endoscopy were significantly greater when compared with RC. The adenomas detected per colonoscopy (APC) (WMD, 0.25; P = 0.009), polyps detected per colonoscopy (PPC) (WMD, 0.52; P < 0.001), and sessile serrated lesions detected per colonoscopy (SSLPC) (RR, 1.53; P < 0.001) were significantly higher in the AI-aided group compared with the RC group. Subgroup analysis based on size, location, and shape of adenomas and polyps demonstrated that, except for in the cecum and pedunculated adenomas or polyps, the AI-aided groups of the other subgroups are more advantageous. Withdrawal time was longer in the AI-aided group when biopsies were included, while withdrawal time excluding biopsy time showed no significant difference. CONCLUSIONS AI-aided polyp detection system significantly increases lesion detection rate. In addition, lesion detection by AI is hardly affected by factors such as size, location, and shape.
Collapse
|
49
|
Sterkenburg AJ, Hooghiemstra WTR, Schmidt I, Ntziachristos V, Nagengast WB, Gorpas D. Standardization and implementation of fluorescence molecular endoscopy in the clinic. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-210302SS-PERR. [PMID: 35170264 PMCID: PMC8847121 DOI: 10.1117/1.jbo.27.7.074704] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 01/19/2022] [Indexed: 05/26/2023]
Abstract
SIGNIFICANCE Near-infrared fluorescence molecular endoscopy (NIR-FME) is an innovative technique allowing for in vivo visualization of molecular processes in hollow organs. Despite its potential for clinical translation, NIR-FME still faces challenges, for example, the lack of consensus in performing quality control and standardization of procedures and systems. This may hamper the clinical approval of the technology by authorities and its acceptance by endoscopists. Until now, several clinical trials using NIR-FME have been performed. However, most of these trials had different study designs, making comparison difficult. AIM We describe the need for standardization in NIR-FME, provide a pathway for setting up a standardized clinical study, and describe future perspectives for NIR-FME. Body: Standardization is challenging due to many parameters. Invariable parameters refer to the hardware specifications. Variable parameters refer to movement or tissue optical properties. Phantoms can be of aid when defining the influence of these variables or when standardizing a procedure. CONCLUSION There is a need for standardization in NIR-FME and hurdles still need to be overcome before a widespread clinical implementation of NIR-FME can be realized. When these hurdles are overcome, clinical outcomes can be compared and systems can be benchmarked, enabling clinical implementation.
Collapse
Affiliation(s)
- Andrea J. Sterkenburg
- University of Groningen, University Medical Center Groningen, Department of Gastroenterology and Hepatology, Groningen, The Netherlands
| | - Wouter T. R. Hooghiemstra
- University of Groningen, University Medical Center Groningen, Department of Gastroenterology and Hepatology, Groningen, The Netherlands
| | - Iris Schmidt
- University of Groningen, University Medical Center Groningen, Department of Gastroenterology and Hepatology, Groningen, The Netherlands
| | - Vasilis Ntziachristos
- Technical University of Munich, School of Medicine, Chair of Biological Imaging, Central Institute for Translational Cancer Research (TranslaTUM), Munich, Germany
- Helmholtz Zentrum München (GmbH), Institute of Biological and Medical Imaging, Neuherberg, Germany
| | - Wouter B. Nagengast
- University of Groningen, University Medical Center Groningen, Department of Gastroenterology and Hepatology, Groningen, The Netherlands
| | - Dimitris Gorpas
- Technical University of Munich, School of Medicine, Chair of Biological Imaging, Central Institute for Translational Cancer Research (TranslaTUM), Munich, Germany
- Helmholtz Zentrum München (GmbH), Institute of Biological and Medical Imaging, Neuherberg, Germany
| |
Collapse
|
50
|
Kou W, Carlson DA, Baumann AJ, Donnan EN, Schauer JM, Etemadi M, Pandolfino JE. A multi-stage machine learning model for diagnosis of esophageal manometry. Artif Intell Med 2022; 124:102233. [PMID: 35115131 PMCID: PMC8817064 DOI: 10.1016/j.artmed.2021.102233] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Revised: 12/17/2021] [Accepted: 12/18/2021] [Indexed: 02/03/2023]
Abstract
High-resolution manometry (HRM) is the primary procedure used to diagnose esophageal motility disorders. Its manual interpretation and classification, including evaluation of swallow-level outcomes and then derivation of a study-level diagnosis based on Chicago Classification (CC), may be limited by inter-rater variability and inaccuracy of an individual interpreter. We hypothesized that an automatic diagnosis platform using machine learning and artificial intelligence approaches could be developed to accurately identify esophageal motility diagnoses. Further, a multi-stage modeling framework, akin to the step-wise approach of the CC, was utilized to leverage advantages of a combination of machine learning approaches including deep-learning models and feature-based models. Models were trained and tested using a dataset comprised of 1741 patients' HRM studies with CC diagnoses assigned by expert physician raters. In the swallow-level stage, three models based on convolutional neural networks (CNNs) were developed to predict swallow type and swallow pressurization (test accuracies of 0.88 and 0.93, respectively), and integrated relaxation pressure (IRP)(regression model with test error of 4.49 mmHg). At the study-level stage, model selection from families of the expert-knowledge-based rule models, xgboost models and artificial neural network(ANN) models were conducted. A simple model-agnostic strategy of model balancing motivated by Bayesian principles was utilized, which gave rise to model averaging weighted by precision scores. The averaged (blended) models and individual models were compared and evaluated, of which the best performance on test dataset is 0.81 in top-1 prediction, 0.92 in top-2 predictions. This is the first artificial-intelligence style model to automatically predict esophageal motility (CC) diagnoses from HRM studies using raw multi-swallow data and it achieved high accuracy. Thus, this proposed modeling framework could be broadly applied to assist with HRM interpretation in a clinical setting.
Collapse
Affiliation(s)
- Wenjun Kou
- Department of Medicine, Feinberg School of Medicine, Northwestern University, 676 North Saint Clair Street, 14th Floor, Chicago, IL 60611, USA,Corresponding author (Wenjun Kou)
| | - Dustin A. Carlson
- Department of Medicine, Feinberg School of Medicine, Northwestern University, 676 North Saint Clair Street, 14th Floor, Chicago, IL 60611, USA
| | - Alexandra J. Baumann
- Department of Medicine, Feinberg School of Medicine, Northwestern University, 676 North Saint Clair Street, 14th Floor, Chicago, IL 60611, USA
| | - Erica N. Donnan
- Department of Medicine, Feinberg School of Medicine, Northwestern University, 676 North Saint Clair Street, 14th Floor, Chicago, IL 60611, USA
| | - Jacob M. Schauer
- Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, 750 North Lake Shore Drive, 11th Floor, Chicago, IL 60611, USA
| | - Mozziyar Etemadi
- Department of Anesthesiology, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA,Department of Biomedical Engineering, McCormick School of Engineering, Northwestern University, Evanston IL 60201, USA
| | - John E. Pandolfino
- Department of Medicine, Feinberg School of Medicine, Northwestern University, 676 North Saint Clair Street, 14th Floor, Chicago, IL 60611, USA
| |
Collapse
|