1
|
Rehman A, Khan A, Fatima G, Naz S, Razzak I. Review on chest pathogies detection systems using deep learning techniques. Artif Intell Rev 2023; 56:1-47. [PMID: 37362896 PMCID: PMC10027283 DOI: 10.1007/s10462-023-10457-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
Abstract
Chest radiography is the standard and most affordable way to diagnose, analyze, and examine different thoracic and chest diseases. Typically, the radiograph is examined by an expert radiologist or physician to decide about a particular anomaly, if exists. Moreover, computer-aided methods are used to assist radiologists and make the analysis process accurate, fast, and more automated. A tremendous improvement in automatic chest pathologies detection and analysis can be observed with the emergence of deep learning. The survey aims to review, technically evaluate, and synthesize the different computer-aided chest pathologies detection systems. The state-of-the-art of single and multi-pathologies detection systems, which are published in the last five years, are thoroughly discussed. The taxonomy of image acquisition, dataset preprocessing, feature extraction, and deep learning models are presented. The mathematical concepts related to feature extraction model architectures are discussed. Moreover, the different articles are compared based on their contributions, datasets, methods used, and the results achieved. The article ends with the main findings, current trends, challenges, and future recommendations.
Collapse
Affiliation(s)
- Arshia Rehman
- COMSATS University Islamabad, Abbottabad-Campus, Abbottabad, Pakistan
| | - Ahmad Khan
- COMSATS University Islamabad, Abbottabad-Campus, Abbottabad, Pakistan
| | - Gohar Fatima
- The Islamia University of Bahawalpur, Bahawal Nagar Campus, Bahawal Nagar, Pakistan
| | - Saeeda Naz
- Govt Girls Post Graduate College No.1, Abbottabad, Pakistan
| | - Imran Razzak
- School of Computer Science and Engineering, University of New South Wales, Sydney, Australia
| |
Collapse
|
2
|
Preliminary Stages for COVID-19 Detection Using Image Processing. Diagnostics (Basel) 2022; 12:diagnostics12123171. [PMID: 36553177 PMCID: PMC9777505 DOI: 10.3390/diagnostics12123171] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 11/30/2022] [Accepted: 12/08/2022] [Indexed: 12/23/2022] Open
Abstract
COVID-19 was first discovered in December 2019 in Wuhan. There have been reports of thousands of illnesses and hundreds of deaths in almost every region of the world. Medical images, when combined with cutting-edge technology such as artificial intelligence, have the potential to improve the efficiency of the public health system and deliver faster and more reliable findings in the detection of COVID-19. The process of developing the COVID-19 diagnostic system begins with image accusation and proceeds via preprocessing, feature extraction, and classification. According to literature review, several attempts to develop taxonomies for COVID-19 detection using image processing methods have been introduced. However, most of these adhere to a standard category that exclusively considers classification methods. Therefore, in this study a new taxonomy for the early stages of COVID-19 detection is proposed. It attempts to offer a full grasp of image processing in COVID-19 while considering all phases required prior to classification. The survey concludes with a discussion of outstanding concerns and future directions.
Collapse
|
3
|
Nagaraj Y, de Jonge G, Andreychenko A, Presti G, Fink MA, Pavlov N, Quattrocchi CC, Morozov S, Veldhuis R, Oudkerk M, van Ooijen PMA. Facilitating standardized COVID-19 suspicion prediction based on computed tomography radiomics in a multi-demographic setting. Eur Radiol 2022; 32:6384-6396. [PMID: 35362751 PMCID: PMC8973680 DOI: 10.1007/s00330-022-08730-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 02/13/2022] [Accepted: 03/08/2022] [Indexed: 11/29/2022]
Abstract
Objective To develop an automatic COVID-19 Reporting and Data System (CO-RADS)–based classification in a multi-demographic setting. Methods This multi-institutional review boards–approved retrospective study included 2720 chest CT scans (mean age, 58 years [range 18–100 years]) from Italian and Russian patients. Three board-certified radiologists from three countries assessed randomly selected subcohorts from each population and provided CO-RADS–based annotations. CT radiomic features were extracted from the selected subcohorts after preprocessing steps like lung lobe segmentation and automatic noise reduction. We compared three machine learning models, logistic regression (LR), multilayer perceptron (MLP), and random forest (RF) for the automated CO-RADS classification. Model evaluation was carried out in two scenarios, first, training on a mixed multi-demographic subcohort and testing on an independent hold-out dataset. In the second scenario, training was done on a single demography and externally validated on the other demography. Results The overall inter-observer agreement for the CO-RADS scoring between the radiologists was substantial (k = 0.80). Irrespective of the type of validation test scenario, suspected COVID-19 CT scans were identified with an accuracy of 84%. SHapley Additive exPlanations (SHAP) interpretation showed that the “wavelet_(LH)_GLCM_Imc1” feature had a positive impact on COVID prediction both with and without noise reduction. The application of noise reduction improved the overall performance between the classifiers for all types. Conclusion Using an automated model based on the COVID-19 Reporting and Data System (CO-RADS), we achieved clinically acceptable performance in a multi-demographic setting. This approach can serve as a standardized tool for automated COVID-19 assessment. Keypoints • Automatic CO-RADS scoring of large-scale multi-demographic chest CTs with mean AUC of 0.93 ± 0.04. • Validation procedure resembles TRIPOD 2b and 3 categories, enhancing the quality of experimental design to test the cross-dataset domain shift between institutions aiding clinical integration. • Identification of COVID-19 pneumonia in the presence of community-acquired pneumonia and other comorbidities with an AUC of 0.92. Supplementary Information The online version contains supplementary material available at 10.1007/s00330-022-08730-6.
Collapse
Affiliation(s)
- Yeshaswini Nagaraj
- Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands. .,Machine Learning Lab, DASH, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.
| | - Gonda de Jonge
- Department of Radiology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Anna Andreychenko
- Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Healthcare Department, Moscow, Russia
| | - Gabriele Presti
- Unit of Diagnostic Imaging and Interventional Radiology, Departmental Faculty of Medicine and Surgery, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Matthias A Fink
- Clinic for Diagnostic and Interventional Radiology, University Hospital Heidelberg, Heidelberg, Germany.,Translational Lung Research Center Heidelberg, member of the German Center for Lung Research, Heidelberg, Germany
| | - Nikolay Pavlov
- Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Healthcare Department, Moscow, Russia
| | - Carlo C Quattrocchi
- Unit of Diagnostic Imaging and Interventional Radiology, Departmental Faculty of Medicine and Surgery, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Sergey Morozov
- Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Healthcare Department, Moscow, Russia
| | - Raymond Veldhuis
- Faculty of Electrical Engineering, Mathematics Computer Science (EWI), Data management Biometrics (DMB), University of Twente, Enschede, The Netherlands
| | - Matthijs Oudkerk
- Faculty of Medical Sciences, University of Groningen, Groningen, The Netherlands.,Institute for DiagNostic Accuracy Research, Groningen, The Netherlands
| | - Peter M A van Ooijen
- Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands.,Machine Learning Lab, DASH, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
4
|
Sarker S, Jamal L, Ahmed SF, Irtisam N. Robotics and artificial intelligence in healthcare during COVID-19 pandemic: A systematic review. ROBOTICS AND AUTONOMOUS SYSTEMS 2021; 146:103902. [PMID: 34629751 PMCID: PMC8493645 DOI: 10.1016/j.robot.2021.103902] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 09/03/2021] [Accepted: 09/13/2021] [Indexed: 05/05/2023]
Abstract
The outbreak of the COVID-19 pandemic is unarguably the biggest catastrophe of the 21st century, probably the most significant global crisis after the second world war. The rapid spreading capability of the virus has compelled the world population to maintain strict preventive measures. The outrage of the virus has rampaged through the healthcare sector tremendously. This pandemic created a huge demand for necessary healthcare equipment, medicines along with the requirement for advanced robotics and artificial intelligence-based applications. The intelligent robot systems have great potential to render service in diagnosis, risk assessment, monitoring, telehealthcare, disinfection, and several other operations during this pandemic which has helped reduce the workload of the frontline workers remarkably. The long-awaited vaccine discovery of this deadly virus has also been greatly accelerated with AI-empowered tools. In addition to that, many robotics and Robotics Process Automation platforms have substantially facilitated the distribution of the vaccine in many arrangements pertaining to it. These forefront technologies have also aided in giving comfort to the people dealing with less addressed mental health complicacies. This paper investigates the use of robotics and artificial intelligence-based technologies and their applications in healthcare to fight against the COVID-19 pandemic. A systematic search following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method is conducted to accumulate such literature, and an extensive review on 147 selected records is performed.
Collapse
Affiliation(s)
- Sujan Sarker
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Lafifa Jamal
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Syeda Faiza Ahmed
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Niloy Irtisam
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| |
Collapse
|
5
|
López-Cabrera JD, Orozco-Morales R, Portal-Díaz JA, Lovelle-Enríquez O, Pérez-Díaz M. Current limitations to identify covid-19 using artificial intelligence with chest x-ray imaging (part ii). The shortcut learning problem. HEALTH AND TECHNOLOGY 2021; 11:1331-1345. [PMID: 34660166 PMCID: PMC8502237 DOI: 10.1007/s12553-021-00609-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Accepted: 10/05/2021] [Indexed: 12/12/2022]
Abstract
Since the outbreak of the COVID-19 pandemic, computer vision researchers have been working on automatic identification of this disease using radiological images. The results achieved by automatic classification methods far exceed those of human specialists, with sensitivity as high as 100% being reported. However, prestigious radiology societies have stated that the use of this type of imaging alone is not recommended as a diagnostic method. According to some experts the patterns presented in these images are unspecific and subtle, overlapping with other viral pneumonias. This report seeks to evaluate the analysis the robustness and generalizability of different approaches using artificial intelligence, deep learning and computer vision to identify COVID-19 using chest X-rays images. We also seek to alert researchers and reviewers to the issue of "shortcut learning". Recommendations are presented to identify whether COVID-19 automatic classification models are being affected by shortcut learning. Firstly, papers using explainable artificial intelligence methods are reviewed. The results of applying external validation sets are evaluated to determine the generalizability of these methods. Finally, studies that apply traditional computer vision methods to perform the same task are considered. It is evident that using the whole chest X-Ray image or the bounding box of the lungs, the image regions that contribute most to the classification appear outside of the lung region, something that is not likely possible. In addition, although the investigations that evaluated their models on data sets external to the training set, the effectiveness of these models decreased significantly, it may provide a more realistic representation as how the model will perform in the clinic. The results indicate that, so far, the existing models often involve shortcut learning, which makes their use less appropriate in the clinical setting.
Collapse
Affiliation(s)
- José Daniel López-Cabrera
- Centro de Investigaciones de La Informática, Facultad de Matemática, Física y Computación, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| | - Rubén Orozco-Morales
- Departamento de Control Automático, Facultad de Ingeniería Eléctrica, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| | - Jorge Armando Portal-Díaz
- Departamento de Control Automático, Facultad de Ingeniería Eléctrica, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| | - Orlando Lovelle-Enríquez
- Departamento de Imagenología, Hospital Comandante Manuel Fajardo Rivero, Villa Clara, Santa Clara, Cuba
| | - Marlén Pérez-Díaz
- Departamento de Control Automático, Facultad de Ingeniería Eléctrica, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| |
Collapse
|
6
|
Ahmed KB, Goldgof GM, Paul R, Goldgof DB, Hall LO. Discovery of a Generalization Gap of Convolutional Neural Networks on COVID-19 X-Rays Classification. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:72970-72979. [PMID: 34178559 PMCID: PMC8224464 DOI: 10.1109/access.2021.3079716] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Accepted: 05/04/2021] [Indexed: 05/02/2023]
Abstract
A number of recent papers have shown experimental evidence that suggests it is possible to build highly accurate deep neural network models to detect COVID-19 from chest X-ray images. In this paper, we show that good generalization to unseen sources has not been achieved. Experiments with richer data sets than have previously been used show models have high accuracy on seen sources, but poor accuracy on unseen sources. The reason for the disparity is that the convolutional neural network model, which learns features, can focus on differences in X-ray machines or in positioning within the machines, for example. Any feature that a person would clearly rule out is called a confounding feature. Some of the models were trained on COVID-19 image data taken from publications, which may be different than raw images. Some data sets were of pediatric cases with pneumonia where COVID-19 chest X-rays are almost exclusively from adults, so lung size becomes a spurious feature that can be exploited. In this work, we have eliminated many confounding features by working with as close to raw data as possible. Still, deep learned models may leverage source specific confounders to differentiate COVID-19 from pneumonia preventing generalizing to new data sources (i.e. external sites). Our models have achieved an AUC of 1.00 on seen data sources but in the worst case only scored an AUC of 0.38 on unseen ones. This indicates that such models need further assessment/development before they can be broadly clinically deployed. An example of fine-tuning to improve performance at a new site is given.
Collapse
Affiliation(s)
- Kaoutar Ben Ahmed
- Department of Computer Science and EngineeringUniversity of South FloridaTampaFL33620USA
| | - Gregory M. Goldgof
- Department of Laboratory MedicineThe University of CaliforniaSan FranciscoCA94143USA
| | - Rahul Paul
- Department of Radiation OncologyMassachusetts General HospitalBostonMA02115USA
- Department of Radiation OncologyHarvard Medical SchoolBostonMA02115USA
| | - Dmitry B. Goldgof
- Department of Computer Science and EngineeringUniversity of South FloridaTampaFL33620USA
| | - Lawrence O. Hall
- Department of Computer Science and EngineeringUniversity of South FloridaTampaFL33620USA
| |
Collapse
|
7
|
Yao T, Lin H, Mao J, Huo S, Liu G. CT Imaging Features of Patients Infected with 2019 Novel Coronavirus. BIO INTEGRATION 2021. [DOI: 10.15212/bioi-2020-0038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Novel coronavirus pneumonia is an acute, infectious pneumonia caused by a novel coronavirus infection. Computed tomographic (CT) imaging is one of the main methods to screen and diagnose patients with this disease. Here, the importance and clinical value of chest CT examination in the
diagnosis of COVID-19 is expounded, and the pulmonary CT findings of COVID-19 patients in different stages are briefly summarized, thus providing a reference document for the CT diagnosis of COVID-19 patients.
Collapse
Affiliation(s)
- Tianhong Yao
- State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics & Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen 361102, China
| | - Huirong Lin
- State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics & Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen 361102, China
| | - Jingsong Mao
- Department of Radiology, Xiang’an Hospital of Xiamen University, Xiamen 361102, China
| | - Shuaidong Huo
- Fujian Provincial Key Laboratory of Innovative Drug Target Research, School of Pharmaceutical Science, Xiamen University, Xiamen 361102, China
| | - Gang Liu
- State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics & Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen 361102, China
| |
Collapse
|
8
|
Deng Q, Cao S, Wang H, Zhang Y, Chen L, Yang Z, Peng Z, Zhou Q. Application of quantitative lung ultrasound instead of CT for monitoring COVID-19 pneumonia in pregnant women: a single-center retrospective study. BMC Pregnancy Childbirth 2021; 21:259. [PMID: 33771120 PMCID: PMC7997654 DOI: 10.1186/s12884-021-03728-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2020] [Accepted: 03/17/2021] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Computed tomography (CT) is the preferred imaging technique for the evaluation of COVID-19 pneumonia. However, it is not suitable as a monitoring tool for pregnant women because of the risk of ionizing radiation damage to the fetus as well as the possible infection of others. In this study, we explored the value of bedside lung ultrasound (LUS) as an alternative to CT for the detection and monitoring of lung involvement in pregnant women with COVID-19. METHODS Clinical and LUS data of 39 pregnant women with COVID-19 were retrospectively reviewed. All LUS and CT images were analyzed to summarize the findings and calculate LUS scores and CT scores for each patient. LUS findings were compared with CT, and correlation between LUS scores and CT scores was evaluated. RESULTS Among the 39 pregnant women, there were 6 mild-type cases, 29 common-type cases, 4 severe-type cases, and no critical-type cases. The most common LUS findings of COVID-19 pneumonia in pregnant women were various grades of multiple B-lines (84.6%), thickened and irregular pleural lines (71.8%), pleural effusion (61.5%) and small multifocal consolidation limited to the subpleural space (35.9%). The mean LUS score at admission was 0 points in mild-type cases, 10.6 points in common-type cases and 15.3 points in severe-type cases (P < 0.01). The correlation between LUS scores and CT was 0.793. All patients were clinically cured and each underwent an average of three LUS follow-ups during hospitalization. The mean LUS score at discharge was 5.6 points lower than that at admission. The consistency of LUS and chest CT during follow-up was 0.652. CONCLUSIONS Quantitative LUS scoring can effectively instead of CT for detecting and monitoring of COVID-19 pneumonia in pregnant women and protect fetuses from the risk of ionizing radiation.
Collapse
Affiliation(s)
- Qing Deng
- Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China
| | - Sheng Cao
- Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China
| | - Hao Wang
- Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China
| | - Yao Zhang
- Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China
| | - Liao Chen
- Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China
| | - Zhaohui Yang
- Department of Radiology, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China
| | - Zhoufeng Peng
- Department of Radiology, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China
| | - Qing Zhou
- Department of Ultrasound, Renmin Hospital of Wuhan University, Wuhan, 430060, Hubei, China.
| |
Collapse
|
9
|
Current limitations to identify COVID-19 using artificial intelligence with chest X-ray imaging. HEALTH AND TECHNOLOGY 2021; 11:411-424. [PMID: 33585153 PMCID: PMC7864619 DOI: 10.1007/s12553-021-00520-2] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Accepted: 01/11/2021] [Indexed: 12/17/2022]
Abstract
The scientific community has joined forces to mitigate the scope of the current COVID-19 pandemic. The early identification of the disease, as well as the evaluation of its evolution is a primary task for the timely application of medical protocols. The use of medical images of the chest provides valuable information to specialists. Specifically, chest X-ray images have been the focus of many investigations that apply artificial intelligence techniques for the automatic classification of this disease. The results achieved to date on the subject are promising. However, some results of these investigations contain errors that must be corrected to obtain appropriate models for clinical use. This research discusses some of the problems found in the current scientific literature on the application of artificial intelligence techniques in the automatic classification of COVID-19. It is evident that in most of the reviewed works an incorrect evaluation protocol is applied, which leads to overestimating the results.
Collapse
|
10
|
Eldow ME. The worldwide methods of artificial intelligence for detection and diagnosis of COVID-19. LEVERAGING ARTIFICIAL INTELLIGENCE IN GLOBAL EPIDEMICS 2021. [PMCID: PMC8342405 DOI: 10.1016/b978-0-323-89777-8.00012-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
This chapter aims to present and review the early and recent initiatives, researches, and applications of artificial intelligence (AI) and its methods on the detection and diagnosis of COVID-19 virus. Common methods of AI will be presented on these applications including the traditional work on artificial neural networks and the recent approaches on machine learning and deep learning. In this chapter, a survey on many examples of the application of the AI methods on the detection and diagnosis of COVID-19 will be highlighted including the early trials in China and the recent researches in other regions, beside most trials in all other regions of the World including Asia, North America, Europe, and Africa. This chapter will also show many comparisons of the explained approaches and trials based on methods, type of applications, and regions. Brief view of the future and expected applications and trends of AI in the area of detection and diagnosis of viruses and especially the COVID-19 are explained and discussed at the end of the chapter.
Collapse
|