1
|
Pinto-Coelho L. How Artificial Intelligence Is Shaping Medical Imaging Technology: A Survey of Innovations and Applications. Bioengineering (Basel) 2023; 10:1435. [PMID: 38136026 PMCID: PMC10740686 DOI: 10.3390/bioengineering10121435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Revised: 12/12/2023] [Accepted: 12/15/2023] [Indexed: 12/24/2023] Open
Abstract
The integration of artificial intelligence (AI) into medical imaging has guided in an era of transformation in healthcare. This literature review explores the latest innovations and applications of AI in the field, highlighting its profound impact on medical diagnosis and patient care. The innovation segment explores cutting-edge developments in AI, such as deep learning algorithms, convolutional neural networks, and generative adversarial networks, which have significantly improved the accuracy and efficiency of medical image analysis. These innovations have enabled rapid and accurate detection of abnormalities, from identifying tumors during radiological examinations to detecting early signs of eye disease in retinal images. The article also highlights various applications of AI in medical imaging, including radiology, pathology, cardiology, and more. AI-based diagnostic tools not only speed up the interpretation of complex images but also improve early detection of disease, ultimately delivering better outcomes for patients. Additionally, AI-based image processing facilitates personalized treatment plans, thereby optimizing healthcare delivery. This literature review highlights the paradigm shift that AI has brought to medical imaging, highlighting its role in revolutionizing diagnosis and patient care. By combining cutting-edge AI techniques and their practical applications, it is clear that AI will continue shaping the future of healthcare in profound and positive ways.
Collapse
Affiliation(s)
- Luís Pinto-Coelho
- ISEP—School of Engineering, Polytechnic Institute of Porto, 4200-465 Porto, Portugal;
- INESCTEC, Campus of the Engineering Faculty of the University of Porto, 4200-465 Porto, Portugal
| |
Collapse
|
2
|
Moitra M, Alafeef M, Narasimhan A, Kakaria V, Moitra P, Pan D. Diagnosis of COVID-19 with simultaneous accurate prediction of cardiac abnormalities from chest computed tomographic images. PLoS One 2023; 18:e0290494. [PMID: 38096254 PMCID: PMC10721010 DOI: 10.1371/journal.pone.0290494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 08/09/2023] [Indexed: 12/17/2023] Open
Abstract
COVID-19 has potential consequences on the pulmonary and cardiovascular health of millions of infected people worldwide. Chest computed tomographic (CT) imaging has remained the first line of diagnosis for individuals infected with SARS-CoV-2. However, differentiating COVID-19 from other types of pneumonia and predicting associated cardiovascular complications from the same chest-CT images have remained challenging. In this study, we have first used transfer learning method to distinguish COVID-19 from other pneumonia and healthy cases with 99.2% accuracy. Next, we have developed another CNN-based deep learning approach to automatically predict the risk of cardiovascular disease (CVD) in COVID-19 patients compared to the normal subjects with 97.97% accuracy. Our model was further validated against cardiac CT-based markers including cardiac thoracic ratio (CTR), pulmonary artery to aorta ratio (PA/A), and presence of calcified plaque. Thus, we successfully demonstrate that CT-based deep learning algorithms can be employed as a dual screening diagnostic tool to diagnose COVID-19 and differentiate it from other pneumonia, and also predicts CVD risk associated with COVID-19 infection.
Collapse
Affiliation(s)
- Moumita Moitra
- Center for Blood Oxygen Transport and Hemostasis, Department of Pediatrics, University of Maryland Baltimore School of Medicine, Baltimore, Maryland, United States of America
- Department of Chemical, Biochemical and Environmental Engineering, University of Maryland Baltimore County, Baltimore, Maryland, United States of America
| | - Maha Alafeef
- Center for Blood Oxygen Transport and Hemostasis, Department of Pediatrics, University of Maryland Baltimore School of Medicine, Baltimore, Maryland, United States of America
- Department of Chemical, Biochemical and Environmental Engineering, University of Maryland Baltimore County, Baltimore, Maryland, United States of America
- Biomedical Engineering Department, Jordan University of Science and Technology, Irbid, Jordan
- Department of Nuclear Engineering, The Pennsylvania State University, State College, Pennsylvania, United States of America
| | - Arjun Narasimhan
- Center for Blood Oxygen Transport and Hemostasis, Department of Pediatrics, University of Maryland Baltimore School of Medicine, Baltimore, Maryland, United States of America
| | - Vikram Kakaria
- Center for Blood Oxygen Transport and Hemostasis, Department of Pediatrics, University of Maryland Baltimore School of Medicine, Baltimore, Maryland, United States of America
| | - Parikshit Moitra
- Center for Blood Oxygen Transport and Hemostasis, Department of Pediatrics, University of Maryland Baltimore School of Medicine, Baltimore, Maryland, United States of America
- Department of Nuclear Engineering, The Pennsylvania State University, State College, Pennsylvania, United States of America
| | - Dipanjan Pan
- Center for Blood Oxygen Transport and Hemostasis, Department of Pediatrics, University of Maryland Baltimore School of Medicine, Baltimore, Maryland, United States of America
- Department of Chemical, Biochemical and Environmental Engineering, University of Maryland Baltimore County, Baltimore, Maryland, United States of America
- Department of Nuclear Engineering, The Pennsylvania State University, State College, Pennsylvania, United States of America
- Department of Materials Science & Engineering, The Pennsylvania State University, State College, Pennsylvania, United States of America
- Huck Institutes of the Life Sciences, State College, Pennsylvania, United States of America
| |
Collapse
|
3
|
Iqbal S, N. Qureshi A, Li J, Mahmood T. On the Analyses of Medical Images Using Traditional Machine Learning Techniques and Convolutional Neural Networks. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2023; 30:3173-3233. [PMID: 37260910 PMCID: PMC10071480 DOI: 10.1007/s11831-023-09899-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 02/19/2023] [Indexed: 06/02/2023]
Abstract
Convolutional neural network (CNN) has shown dissuasive accomplishment on different areas especially Object Detection, Segmentation, Reconstruction (2D and 3D), Information Retrieval, Medical Image Registration, Multi-lingual translation, Local language Processing, Anomaly Detection on video and Speech Recognition. CNN is a special type of Neural Network, which has compelling and effective learning ability to learn features at several steps during augmentation of the data. Recently, different interesting and inspiring ideas of Deep Learning (DL) such as different activation functions, hyperparameter optimization, regularization, momentum and loss functions has improved the performance, operation and execution of CNN Different internal architecture innovation of CNN and different representational style of CNN has significantly improved the performance. This survey focuses on internal taxonomy of deep learning, different models of vonvolutional neural network, especially depth and width of models and in addition CNN components, applications and current challenges of deep learning.
Collapse
Affiliation(s)
- Saeed Iqbal
- Department of Computer Science, Faculty of Information Technology & Computer Science, University of Central Punjab, Lahore, Punjab 54000 Pakistan
- Faculty of Information Technology, Beijing University of Technology, Beijing, 100124 Beijing China
| | - Adnan N. Qureshi
- Department of Computer Science, Faculty of Information Technology & Computer Science, University of Central Punjab, Lahore, Punjab 54000 Pakistan
| | - Jianqiang Li
- Faculty of Information Technology, Beijing University of Technology, Beijing, 100124 Beijing China
- Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing, 100124 Beijing China
| | - Tariq Mahmood
- Artificial Intelligence and Data Analytics (AIDA) Lab, College of Computer & Information Sciences (CCIS), Prince Sultan University, Riyadh, 11586 Kingdom of Saudi Arabia
| |
Collapse
|
4
|
Garcea F, Serra A, Lamberti F, Morra L. Data augmentation for medical imaging: A systematic literature review. Comput Biol Med 2023; 152:106391. [PMID: 36549032 DOI: 10.1016/j.compbiomed.2022.106391] [Citation(s) in RCA: 26] [Impact Index Per Article: 26.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Revised: 11/22/2022] [Accepted: 11/29/2022] [Indexed: 12/13/2022]
Abstract
Recent advances in Deep Learning have largely benefited from larger and more diverse training sets. However, collecting large datasets for medical imaging is still a challenge due to privacy concerns and labeling costs. Data augmentation makes it possible to greatly expand the amount and variety of data available for training without actually collecting new samples. Data augmentation techniques range from simple yet surprisingly effective transformations such as cropping, padding, and flipping, to complex generative models. Depending on the nature of the input and the visual task, different data augmentation strategies are likely to perform differently. For this reason, it is conceivable that medical imaging requires specific augmentation strategies that generate plausible data samples and enable effective regularization of deep neural networks. Data augmentation can also be used to augment specific classes that are underrepresented in the training set, e.g., to generate artificial lesions. The goal of this systematic literature review is to investigate which data augmentation strategies are used in the medical domain and how they affect the performance of clinical tasks such as classification, segmentation, and lesion detection. To this end, a comprehensive analysis of more than 300 articles published in recent years (2018-2022) was conducted. The results highlight the effectiveness of data augmentation across organs, modalities, tasks, and dataset sizes, and suggest potential avenues for future research.
Collapse
Affiliation(s)
- Fabio Garcea
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy
| | - Alessio Serra
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy
| | - Fabrizio Lamberti
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy
| | - Lia Morra
- Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi, 24, Torino, 10129, Italy.
| |
Collapse
|
5
|
Diagnostic accuracy of ultra-low-dose CT colonography for the detection of colorectal polyps: a feasibility study. Jpn J Radiol 2022; 40:831-839. [PMID: 35344130 DOI: 10.1007/s11604-022-01266-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Accepted: 03/10/2022] [Indexed: 10/18/2022]
Abstract
PURPOSE The aim of this feasibility study was to evaluate the diagnostic accuracy of ultra-low-dose CT colonography using iterative reconstruction algorithms with reference to standard colonoscopy. MATERIALS AND METHODS Prior to this study, a phantom study was performed to investigate the optimal protocol for ultra-low-dose CT colonography. A total of 206 patients with average/high risk of colorectal cancer were recruited. After undergoing full bowel preparation, the patients were scanned in the prone and supine positions with the CT conditions set to 120 kV, standard deviation 45 to 50, and an adaptive iterative reconstruction algorithm applied. Two expert readers read the images independently. The main outcome measures were the per-patient and per-polyp accuracies for the detection of polyps ≥ 10 mm, with colonoscopy results as the reference standard. RESULTS Two hundred patients (102 females, mean age 67.5 years) underwent both ultra-low-dose CT colonography and colonoscopy on the same day. The mean radiation exposure dose was 0.64 ± 0.34 mSv. On colonoscopy, 39 patients had 45 polyps ≥ 10 mm (non-polypoid morphology 7), including 4 cancers. Per-patient sensitivity, specificity, and accuracy of CT colonography for polyps ≥ 10 mm were 0.74, 0.96, and 0.92 for reader one, and 0.74, 0.99, and 0.94 for reader two, respectively. Per-polyp sensitivities for polyps ≥ 10 mm were 0.73 for reader one and 0.71 for reader two. On subgroup analysis by morphology, non-polypoid polyps ≥ 10 mm were not detected by both readers. CONCLUSION Extreme ultra-low-dose CT colonography had an insufficient diagnostic performance for the detection of polyps ≥ 10 mm, because it was unable to detect non-polypoid polyps. This study showed that the problem with ultra-low-dose CT colonography was the lack of detectability of small-size polyps, especially non-polypoid polyps. To use ultra-low-dose CT colonography clinically, it is necessary to resolve the problems identified by this study.
Collapse
|
6
|
Chlap P, Min H, Vandenberg N, Dowling J, Holloway L, Haworth A. A review of medical image data augmentation techniques for deep learning applications. J Med Imaging Radiat Oncol 2021; 65:545-563. [PMID: 34145766 DOI: 10.1111/1754-9485.13261] [Citation(s) in RCA: 174] [Impact Index Per Article: 58.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Accepted: 05/23/2021] [Indexed: 12/21/2022]
Abstract
Research in artificial intelligence for radiology and radiotherapy has recently become increasingly reliant on the use of deep learning-based algorithms. While the performance of the models which these algorithms produce can significantly outperform more traditional machine learning methods, they do rely on larger datasets being available for training. To address this issue, data augmentation has become a popular method for increasing the size of a training dataset, particularly in fields where large datasets aren't typically available, which is often the case when working with medical images. Data augmentation aims to generate additional data which is used to train the model and has been shown to improve performance when validated on a separate unseen dataset. This approach has become commonplace so to help understand the types of data augmentation techniques used in state-of-the-art deep learning models, we conducted a systematic review of the literature where data augmentation was utilised on medical images (limited to CT and MRI) to train a deep learning model. Articles were categorised into basic, deformable, deep learning or other data augmentation techniques. As artificial intelligence models trained using augmented data make their way into the clinic, this review aims to give an insight to these techniques and confidence in the validity of the models produced.
Collapse
Affiliation(s)
- Phillip Chlap
- South Western Sydney Clinical School, University of New South Wales, Sydney, New South Wales, Australia.,Ingham Institute for Applied Medical Research, Sydney, New South Wales, Australia.,Liverpool and Macarthur Cancer Therapy Centre, Liverpool Hospital, Sydney, New South Wales, Australia
| | - Hang Min
- South Western Sydney Clinical School, University of New South Wales, Sydney, New South Wales, Australia.,Ingham Institute for Applied Medical Research, Sydney, New South Wales, Australia.,The Australian e-Health and Research Centre, CSIRO Health and Biosecurity, Brisbane, Queensland, Australia
| | - Nym Vandenberg
- Institute of Medical Physics, University of Sydney, Sydney, New South Wales, Australia
| | - Jason Dowling
- South Western Sydney Clinical School, University of New South Wales, Sydney, New South Wales, Australia.,The Australian e-Health and Research Centre, CSIRO Health and Biosecurity, Brisbane, Queensland, Australia
| | - Lois Holloway
- South Western Sydney Clinical School, University of New South Wales, Sydney, New South Wales, Australia.,Ingham Institute for Applied Medical Research, Sydney, New South Wales, Australia.,Liverpool and Macarthur Cancer Therapy Centre, Liverpool Hospital, Sydney, New South Wales, Australia.,Institute of Medical Physics, University of Sydney, Sydney, New South Wales, Australia.,Centre for Medical Radiation Physics, University of Wollongong, Wollongong, New South Wales, Australia
| | - Annette Haworth
- Institute of Medical Physics, University of Sydney, Sydney, New South Wales, Australia
| |
Collapse
|
7
|
Zhang Y, Lv X, Qiu J, Zhang B, Zhang L, Fang J, Li M, Chen L, Wang F, Liu S, Zhang S. Deep Learning With 3D Convolutional Neural Network for Noninvasive Prediction of Microvascular Invasion in Hepatocellular Carcinoma. J Magn Reson Imaging 2021; 54:134-143. [PMID: 33559293 DOI: 10.1002/jmri.27538] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 01/13/2021] [Accepted: 01/16/2021] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Microvascular invasion (MVI) is a critical prognostic factor of hepatocellular carcinoma (HCC). However, it could only be obtained by postoperative histological examination. PURPOSE To develop an end-to-end deep-learning models based on MRI images for preoperative prediction of MVI in HCC patients who underwent surgical resection. STUDY TYPE Retrospective. POPULATION Two hundred and thirty-seven patients with histologically confirmed HCC. FIELD STRENGTH 1.5 T and 3.0 T. SEQUENCE Axial T2 -weighted (T2 -w) with turbo spin echo sequence, T2 -Spectral Presaturation with Inversion Recovery (T2 -SPIR), and dynamic contrast-enhanced (DCE) imaging with fat suppressed enhanced T1 high-resolution isotropic volume examination. ASSESSMENT The patients were randomly divided into training (N = 158) and validation (N = 79) sets. Data augmentation by random rotation was performed on the training set and the sample size increased to 1940 for each MR sequence. A three-dimensional convolutional neural network (3D CNN) was used to develop four deep-learning models, including three single-layer models based on single-sequence, and fusion model combining three sequences. MVI status was obtained from the postoperative pathology reports. STATISTICAL TESTS The dice similarity coefficient (DSC) and Hausdorff distance (HD) were applied to assess the similarity and reproducibility between the manual segmentations of tumor from two radiologists. Receiver operating characteristic curve analysis was used to evaluate model performance. MVI was identified in 92 (38.8%) patients. Good reproducibility with interobserver DSCs of 0.90, 0.89, and 0.89 and HDs of 4.09, 3.67, and 3.60 was observed for PVP, T2 WI, and T2 -SPIR, respectively. The fusion model achieved an area under the curve (AUC) of 0.81, sensitivity of 69%, and specificity of 79% in the training set and 0.72, sensitivity of 55%, and specificity of 81% in the validation set. DATA CONCLUSION 3D CNN model may serve as a noninvasive tool to predict MVI in HCC, whereas its accuracy needs to be enhanced with larger cohort. LEVEL OF EVIDENCE 3 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Yongxin Zhang
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China.,Department of MR, Zhongshan City People's Hospital Affiliated to Sun Yat-sen University, Zhongshan, Guangdong, China
| | - Xiaofei Lv
- Department of Medical Imaging, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-Sen University Cancer Center, Guangzhou, China
| | - Jiliang Qiu
- Department of Liver Surgery, State Key Laboratory of Oncology in South China, Collaborative Innovation Centre for Cancer Medicine, Sun Yat-sen University Cancer Centre, Guangzhou, China
| | - Bin Zhang
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| | - Lu Zhang
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| | - Jin Fang
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| | - Minmin Li
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| | - Luyan Chen
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| | - Fei Wang
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| | - Shuyi Liu
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| | - Shuixing Zhang
- Department of Radiology, The First Affiliated Hospital of Jinan University, Guangzhou, Guangdong, China
| |
Collapse
|