3
|
Rahman H, Khan AR, Sadiq T, Farooqi AH, Khan IU, Lim WH. A Systematic Literature Review of 3D Deep Learning Techniques in Computed Tomography Reconstruction. Tomography 2023; 9:2158-2189. [PMID: 38133073 PMCID: PMC10748093 DOI: 10.3390/tomography9060169] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 11/27/2023] [Accepted: 12/01/2023] [Indexed: 12/23/2023] Open
Abstract
Computed tomography (CT) is used in a wide range of medical imaging diagnoses. However, the reconstruction of CT images from raw projection data is inherently complex and is subject to artifacts and noise, which compromises image quality and accuracy. In order to address these challenges, deep learning developments have the potential to improve the reconstruction of computed tomography images. In this regard, our research aim is to determine the techniques that are used for 3D deep learning in CT reconstruction and to identify the training and validation datasets that are accessible. This research was performed on five databases. After a careful assessment of each record based on the objective and scope of the study, we selected 60 research articles for this review. This systematic literature review revealed that convolutional neural networks (CNNs), 3D convolutional neural networks (3D CNNs), and deep learning reconstruction (DLR) were the most suitable deep learning algorithms for CT reconstruction. Additionally, two major datasets appropriate for training and developing deep learning systems were identified: 2016 NIH-AAPM-Mayo and MSCT. These datasets are important resources for the creation and assessment of CT reconstruction models. According to the results, 3D deep learning may increase the effectiveness of CT image reconstruction, boost image quality, and lower radiation exposure. By using these deep learning approaches, CT image reconstruction may be made more precise and effective, improving patient outcomes, diagnostic accuracy, and healthcare system productivity.
Collapse
Affiliation(s)
- Hameedur Rahman
- Department of Computer Games Development, Faculty of Computing & AI, Air University, E9, Islamabad 44000, Pakistan;
| | - Abdur Rehman Khan
- Department of Creative Technologies, Faculty of Computing & AI, Air University, E9, Islamabad 44000, Pakistan;
| | - Touseef Sadiq
- Centre for Artificial Intelligence Research, Department of Information and Communication Technology, University of Agder, Jon Lilletuns vei 9, 4879 Grimstad, Norway
| | - Ashfaq Hussain Farooqi
- Department of Computer Science, Faculty of Computing AI, Air University, Islamabad 44000, Pakistan;
| | - Inam Ullah Khan
- Department of Electronic Engineering, School of Engineering & Applied Sciences (SEAS), Isra University, Islamabad Campus, Islamabad 44000, Pakistan;
| | - Wei Hong Lim
- Faculty of Engineering, Technology and Built Environment, UCSI University, Kuala Lumpur 56000, Malaysia;
| |
Collapse
|
7
|
Ali H, Shah Z. Combating COVID-19 Using Generative Adversarial Networks and Artificial Intelligence for Medical Images: Scoping Review. JMIR Med Inform 2022; 10:e37365. [PMID: 35709336 PMCID: PMC9246088 DOI: 10.2196/37365] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 03/06/2022] [Accepted: 03/11/2022] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND Research on the diagnosis of COVID-19 using lung images is limited by the scarcity of imaging data. Generative adversarial networks (GANs) are popular for synthesis and data augmentation. GANs have been explored for data augmentation to enhance the performance of artificial intelligence (AI) methods for the diagnosis of COVID-19 within lung computed tomography (CT) and X-ray images. However, the role of GANs in overcoming data scarcity for COVID-19 is not well understood. OBJECTIVE This review presents a comprehensive study on the role of GANs in addressing the challenges related to COVID-19 data scarcity and diagnosis. It is the first review that summarizes different GAN methods and lung imaging data sets for COVID-19. It attempts to answer the questions related to applications of GANs, popular GAN architectures, frequently used image modalities, and the availability of source code. METHODS A search was conducted on 5 databases, namely PubMed, IEEEXplore, Association for Computing Machinery (ACM) Digital Library, Scopus, and Google Scholar. The search was conducted from October 11-13, 2021. The search was conducted using intervention keywords, such as "generative adversarial networks" and "GANs," and application keywords, such as "COVID-19" and "coronavirus." The review was performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) guidelines for systematic and scoping reviews. Only those studies were included that reported GAN-based methods for analyzing chest X-ray images, chest CT images, and chest ultrasound images. Any studies that used deep learning methods but did not use GANs were excluded. No restrictions were imposed on the country of publication, study design, or outcomes. Only those studies that were in English and were published from 2020 to 2022 were included. No studies before 2020 were included. RESULTS This review included 57 full-text studies that reported the use of GANs for different applications in COVID-19 lung imaging data. Most of the studies (n=42, 74%) used GANs for data augmentation to enhance the performance of AI techniques for COVID-19 diagnosis. Other popular applications of GANs were segmentation of lungs and superresolution of lung images. The cycleGAN and the conditional GAN were the most commonly used architectures, used in 9 studies each. In addition, 29 (51%) studies used chest X-ray images, while 21 (37%) studies used CT images for the training of GANs. For the majority of the studies (n=47, 82%), the experiments were conducted and results were reported using publicly available data. A secondary evaluation of the results by radiologists/clinicians was reported by only 2 (4%) studies. CONCLUSIONS Studies have shown that GANs have great potential to address the data scarcity challenge for lung images in COVID-19. Data synthesized with GANs have been helpful to improve the training of the convolutional neural network (CNN) models trained for the diagnosis of COVID-19. In addition, GANs have also contributed to enhancing the CNNs' performance through the superresolution of the images and segmentation. This review also identified key limitations of the potential transformation of GAN-based methods in clinical applications.
Collapse
Affiliation(s)
- Hazrat Ali
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Zubair Shah
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| |
Collapse
|
8
|
Ayalew AM, Salau AO, Abeje BT, Enyew B. Detection and classification of COVID-19 disease from X-ray images using convolutional neural networks and histogram of oriented gradients. Biomed Signal Process Control 2022; 74:103530. [PMID: 35096125 PMCID: PMC8789569 DOI: 10.1016/j.bspc.2022.103530] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Revised: 01/04/2022] [Accepted: 01/21/2022] [Indexed: 12/11/2022]
Abstract
COVID-19 is now regarded as the most lethal disease caused by the novel coronavirus disease of humans. The COVID-19 pandemic has spread to every country on the planet and has wreaked havoc on these countries by increasing the number of human deaths, and in addition, caused intense hunger, and lowered economic productivity. Due to a lack of sufficient radiologist, a restricted amount of COVID-19 test kits is available in hospitals, and this is also accompanied by a shortage of equipment due to the daily increase in cases, as a result of increase in the number of persons infected with COVID-19 . Even for experienced radiologists, examining chest X-rays is a difficult task. Many people have died as a result of inaccurate COVID-19 diagnosis and treatment, as well as ineffective detection measures. This paper, therefore presents a unique detection and classification approach (DCCNet) for quick diagnosis of COVID-19 using chest X-ray images of patients. To achieve quick diagnosis, a convolutional neural network (CNN) and histogram of oriented gradients (HOG) method is proposed in this paper to help medical experts diagnose COVID-19 disease. The diagnostic performance of the hybrid CNN model and HOG-based method was then evaluated using chest X-ray images collected from University of Gondar and online databases. The experiment was performed using Keras (with TensorFlow as a backend) and Python. After the DCCNet model was evaluated, a 99.9% training accuracy and 98.3% test accuracy was achieved, while a 100% training accuracy and 98.5% test accuracy was achieved using HOG. After the evaluation, the hybrid model achieved 99.97% and 99.67% training and testing accuracy for detection and classification of COVID-19 which was better by 1.37% compared to when features were extracted using CNN and 1.17% when HOG was used. The DCCNet achieved a result that outperformed state-of-the-art models by 6.7%.
Collapse
Affiliation(s)
| | - Ayodeji Olalekan Salau
- Department of Electrical/Electronics and Computer Engineering, Afe Babalola University, Ado-Ekiti, Nigeria
- Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, India
| | | | - Belay Enyew
- Department of Information Technology, University of Gondar, Ethiopia
| |
Collapse
|
10
|
A Histogram-Based Low-Complexity Approach for the Effective Detection of COVID-19 Disease from CT and X-ray Images. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11198867] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
The global COVID-19 pandemic certainly has posed one of the more difficult challenges for researchers in the current century. The development of an automatic diagnostic tool, able to detect the disease in its early stage, could undoubtedly offer a great advantage to the battle against the pandemic. In this regard, most of the research efforts have been focused on the application of Deep Learning (DL) techniques to chest images, including traditional chest X-rays (CXRs) and Computed Tomography (CT) scans. Although these approaches have demonstrated their effectiveness in detecting the COVID-19 disease, they are of huge computational complexity and require large datasets for training. In addition, there may not exist a large amount of COVID-19 CXRs and CT scans available to researchers. To this end, in this paper, we propose an approach based on the evaluation of the histogram from a common class of images that is considered as the target. A suitable inter-histogram distance measures how this target histogram is far from the histogram evaluated on a test image: if this distance is greater than a threshold, the test image is labeled as anomaly, i.e., the scan belongs to a patient affected by COVID-19 disease. Extensive experimental results and comparisons with some benchmark state-of-the-art methods support the effectiveness of the developed approach, as well as demonstrate that, at least when the images of the considered datasets are homogeneous enough (i.e., a few outliers are present), it is not really needed to resort to complex-to-implement DL techniques, in order to attain an effective detection of the COVID-19 disease. Despite the simplicity of the proposed approach, all the considered metrics (i.e., accuracy, precision, recall, and F-measure) attain a value of 1.0 under the selected datasets, a result comparable to the corresponding state-of-the-art DNN approaches, but with a remarkable computational simplicity.
Collapse
|
11
|
Chen Y, Ding C, Yu L, Guo W, Feng X, Yu L, Su J, Xu T, Ren C, Shi D, Wu W, Yi P, Liu J, Tao J, Lang G, Li Y, Xu M, Sheng J, Li L, Xu K. One-year follow-up of chest CT findings in patients after SARS-CoV-2 infection. BMC Med 2021; 19:191. [PMID: 34365975 PMCID: PMC8349604 DOI: 10.1186/s12916-021-02056-8] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 07/07/2021] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND Knowledge about the 1-year outcome of COVID-19 is limited. The aim of this study was to follow-up and evaluate lung abnormalities on serial computed tomography (CT) scans in patients with COVID-19 after hospital discharge. METHODS A prospective cohort study of patients with COVID-19 from the First Affiliated Hospital, Zhejiang University School of Medicine was conducted, with assessments of chest CT during hospitalization and at 2 weeks, 1 month, 3 months, 6 months, and 1 year after hospital discharge. Risk factors of residual CT opacities and the influence of residual CT abnormalities on pulmonary functions at 1 year were also evaluated. RESULTS A total of 41 patients were followed in this study. Gradual recovery after hospital discharge was confirmed by the serial CT scores. Around 47% of the patients showed residual aberration on pulmonary CT with a median CT score of 0 (interquartile range (IQR) of 0-2) at 1 year after discharge, with ground-glass opacity (GGO) with reticular pattern as the major radiologic pattern. Patients with residual radiological abnormalities were older (p = 0.01), with higher rate in current smokers (p = 0.04), higher rate in hypertensives (p = 0.05), lower SaO2 (p = 0.004), and higher prevalence of secondary bacterial infections during acute phase (p = 0.02). Multiple logistic regression analyses indicated that age was a risk factor associated with residual radiological abnormalities (OR 1.08, 95% CI 1.01-1.15, p = 0.02). Pulmonary functions of total lung capacity (p = 0.008) and residual volume (p < 0.001) were reduced in patients with residual CT abnormalities and were negatively correlated with CT scores. CONCLUSION During 1-year follow-up after discharge, COVID-19 survivors showed continuous improvement on chest CT. However, residual lesions could still be observed and correlated with lung volume parameters. The risk of developing residual CT opacities increases with age.
Collapse
Affiliation(s)
- Yanfei Chen
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Cheng Ding
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Ling Yu
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Wanru Guo
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Xuewen Feng
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Liang Yu
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Junwei Su
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Ting Xu
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Cheng Ren
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Ding Shi
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Wenrui Wu
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Ping Yi
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Jun Liu
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Jingjing Tao
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Guanjing Lang
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Yongtao Li
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Min Xu
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Jifang Sheng
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China
| | - Lanjuan Li
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China.
| | - Kaijin Xu
- State Key Laboratory for Diagnosis and Treatment of Infectious Diseases, National Clinical Research Center for Infectious Diseases, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Department of Infectious Diseases, The First Affiliated Hospital, College of Medicine, Zhejiang University School of Medicine, 79 Qingchun Rd., Hangzhou City, 310003, China.
| |
Collapse
|