1
|
Jafari M, Shoeibi A, Khodatars M, Ghassemi N, Moridian P, Alizadehsani R, Khosravi A, Ling SH, Delfan N, Zhang YD, Wang SH, Gorriz JM, Alinejad-Rokny H, Acharya UR. Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review. Comput Biol Med 2023; 160:106998. [PMID: 37182422 DOI: 10.1016/j.compbiomed.2023.106998] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 03/01/2023] [Accepted: 04/28/2023] [Indexed: 05/16/2023]
Abstract
In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.
Collapse
Affiliation(s)
- Mahboobeh Jafari
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Afshin Shoeibi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; Data Science and Computational Intelligence Institute, University of Granada, Spain.
| | - Marjane Khodatars
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Navid Ghassemi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Parisa Moridian
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Australia
| | - Niloufar Delfan
- Faculty of Computer Engineering, Dept. of Artificial Intelligence Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Juan M Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Spain; Department of Psychiatry, University of Cambridge, UK
| | - Hamid Alinejad-Rokny
- BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; UNSW Data Science Hub, The University of New South Wales, Sydney, NSW, 2052, Australia; Health Data Analytics Program, Centre for Applied Artificial Intelligence, Macquarie University, Sydney, 2109, Australia
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Dept. of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
2
|
Convolutional Neural Network-Processed MRI Images in the Diagnosis of Plastic Bronchitis in Children. CONTRAST MEDIA & MOLECULAR IMAGING 2021; 2021:2748830. [PMID: 34621144 PMCID: PMC8457940 DOI: 10.1155/2021/2748830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Revised: 08/27/2021] [Accepted: 08/30/2021] [Indexed: 11/24/2022]
Abstract
Objective The study focused on the features of the convolutional neural networks- (CNN-) processed magnetic resonance imaging (MRI) images for plastic bronchitis (PB) in children. Methods 30 PB children were selected as subjects, including 19 boys and 11 girls. They all received the MRI examination for the chest. Then, a CNN-based algorithm was constructed and compared with Active Appearance Model (AAM) algorithm for segmentation effects of MRI images in 30 PB children, factoring into occurring simultaneously than (OST), Dice, and Jaccard coefficient. Results The maximum Dice coefficient of CNN algorithm reached 0.946, while that of active AAM was 0.843, and the Jaccard coefficient of CNN algorithm was also higher (0.894 vs. 0.758, P < 0.05). The MRI images showed pulmonary inflammation in all subjects. Of 30 patients, 14 (46.66%) had complicated pulmonary atelectasis, 9 (30%) had the complicated pleural effusion, 3 (10%) had pneumothorax, 2 (6.67%) had complicated mediastinal emphysema, and 2 (6.67%) had complicated pneumopericardium. Also, of 30 patients, 19 (63.33%) had lung consolidation and atelectasis in a single lung lobe and 11 (36.67%) in both two lung lobes. Conclusion The algorithm based on CNN can significantly improve the segmentation accuracy of MRI images for plastic bronchitis in children. The pleural effusion was a dangerous factor for the occurrence and development of PB.
Collapse
|
3
|
Ciusdel C, Turcea A, Puiu A, Itu L, Calmac L, Weiss E, Margineanu C, Badila E, Berger M, Redel T, Passerini T, Gulsun M, Sharma P. Deep neural networks for ECG-free cardiac phase and end-diastolic frame detection on coronary angiographies. Comput Med Imaging Graph 2020; 84:101749. [PMID: 32623295 DOI: 10.1016/j.compmedimag.2020.101749] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Revised: 05/22/2020] [Accepted: 06/12/2020] [Indexed: 01/17/2023]
Abstract
Invasive coronary angiography (ICA) is the gold standard in Coronary Artery Disease (CAD) imaging. Detection of the end-diastolic frame (EDF) and, in general, cardiac phase detection on each temporal frame of a coronary angiography acquisition is of significant importance for the anatomical and non-invasive functional assessment of CAD. This task is generally performed via manual frame selection or semi-automated selection based on simultaneously acquired ECG signals - thus introducing the requirement of simultaneous ECG recordings. In this paper, we evaluate the performance of a purely image based workflow relying on deep neural networks for fully automated cardiac phase and EDF detection on coronary angiographies. A first deep neural network (DNN), trained to detect coronary arteries, is employed to preselect a subset of frames in which coronary arteries are well visible. A second DNN predicts cardiac phase labels for each frame. Only in the training and evaluation phases for the second DNN, ECG signals are used to provide ground truth labels for each angiographic frame. The networks were trained on 56,655 coronary angiographies from 6820 patients and evaluated on 20,780 coronary angiographies from 6261 patients. No exclusion criteria related to patient state (stable or acute CAD), previous interventions (PCI or CABG), or pathology were formulated. Cardiac phase detection had an accuracy of 98.8 %, a sensitivity of 99.3 % and a specificity of 97.6 % on the evaluation set. EDF prediction had a precision of 98.4 % and a recall of 97.9 %. Several sub-group analyses were performed, indicating that the cardiac phase detection performance is largely independent from acquisition angles, the heart rate of the patient, and the angiographic view (LCA / RCA). The average execution time of cardiac phase detection for one angiographic series was on average less than five seconds on a standard workstation. We conclude that the proposed image based workflow potentially obviates the need for manual frame selection and ECG acquisition, representing a relevant step towards automated CAD assessment.
Collapse
Affiliation(s)
- Costin Ciusdel
- Corporate Technology, Siemens SRL, B-dul Eroilor Nr. 3A, 500007, Brasov, Romania; Automation and Information Technology, Transilvania University of Brasov, Mihai Viteazu nr. 5, 5000174, Brasov, Romania
| | - Alexandru Turcea
- Corporate Technology, Siemens SRL, B-dul Eroilor Nr. 3A, 500007, Brasov, Romania
| | - Andrei Puiu
- Corporate Technology, Siemens SRL, B-dul Eroilor Nr. 3A, 500007, Brasov, Romania; Automation and Information Technology, Transilvania University of Brasov, Mihai Viteazu nr. 5, 5000174, Brasov, Romania
| | - Lucian Itu
- Corporate Technology, Siemens SRL, B-dul Eroilor Nr. 3A, 500007, Brasov, Romania; Automation and Information Technology, Transilvania University of Brasov, Mihai Viteazu nr. 5, 5000174, Brasov, Romania.
| | - Lucian Calmac
- Interventional Cardiology, Clinical Emergency Hospital, Calea Floreasca nr. 8, 014461, Bucharest, Romania
| | - Emma Weiss
- Internal Medicine, Clinical Emergency Hospital, Calea Floreasca nr. 8, 014461, Bucharest, Romania
| | - Cornelia Margineanu
- Internal Medicine, Clinical Emergency Hospital, Calea Floreasca nr. 8, 014461, Bucharest, Romania
| | - Elisabeta Badila
- Internal Medicine, Clinical Emergency Hospital, Calea Floreasca nr. 8, 014461, Bucharest, Romania
| | - Martin Berger
- Advanced Therapies, Siemens Healthcare GmbH, Siemensstr. 1, Bayern, 91301, Forchheim, Germany
| | - Thomas Redel
- Advanced Therapies, Siemens Healthcare GmbH, Siemensstr. 1, Bayern, 91301, Forchheim, Germany
| | - Tiziano Passerini
- Digital Services, Digital Technology & Innovation, Siemens Healthineers, 755 College Road, Princeton, 08540 NJ, USA
| | - Mehmet Gulsun
- Digital Services, Digital Technology & Innovation, Siemens Healthineers, 755 College Road, Princeton, 08540 NJ, USA
| | - Puneet Sharma
- Digital Services, Digital Technology & Innovation, Siemens Healthineers, 755 College Road, Princeton, 08540 NJ, USA
| |
Collapse
|
4
|
Soffer S, Ben-Cohen A, Shimon O, Amitai MM, Greenspan H, Klang E. Convolutional Neural Networks for Radiologic Images: A Radiologist's Guide. Radiology 2019; 290:590-606. [PMID: 30694159 DOI: 10.1148/radiol.2018180547] [Citation(s) in RCA: 275] [Impact Index Per Article: 55.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Deep learning has rapidly advanced in various fields within the past few years and has recently gained particular attention in the radiology community. This article provides an introduction to deep learning technology and presents the stages that are entailed in the design process of deep learning radiology research. In addition, the article details the results of a survey of the application of deep learning-specifically, the application of convolutional neural networks-to radiologic imaging that was focused on the following five major system organs: chest, breast, brain, musculoskeletal system, and abdomen and pelvis. The survey of the studies is followed by a discussion about current challenges and future trends and their potential implications for radiology. This article may be used as a guide for radiologists planning research in the field of radiologic image analysis using convolutional neural networks.
Collapse
Affiliation(s)
- Shelly Soffer
- From the Department of Diagnostic Imaging, Sheba Medical Center, Emek HaEla St 1, Ramat Gan, Israel (S.S., M.M.A., E.K.); Faculty of Engineering, Department of Biomedical Engineering, Medical Image Processing Laboratory, Tel Aviv University, Tel Aviv, Israel (A.B., H.G.); and Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel (S.S., O.S.)
| | - Avi Ben-Cohen
- From the Department of Diagnostic Imaging, Sheba Medical Center, Emek HaEla St 1, Ramat Gan, Israel (S.S., M.M.A., E.K.); Faculty of Engineering, Department of Biomedical Engineering, Medical Image Processing Laboratory, Tel Aviv University, Tel Aviv, Israel (A.B., H.G.); and Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel (S.S., O.S.)
| | - Orit Shimon
- From the Department of Diagnostic Imaging, Sheba Medical Center, Emek HaEla St 1, Ramat Gan, Israel (S.S., M.M.A., E.K.); Faculty of Engineering, Department of Biomedical Engineering, Medical Image Processing Laboratory, Tel Aviv University, Tel Aviv, Israel (A.B., H.G.); and Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel (S.S., O.S.)
| | - Michal Marianne Amitai
- From the Department of Diagnostic Imaging, Sheba Medical Center, Emek HaEla St 1, Ramat Gan, Israel (S.S., M.M.A., E.K.); Faculty of Engineering, Department of Biomedical Engineering, Medical Image Processing Laboratory, Tel Aviv University, Tel Aviv, Israel (A.B., H.G.); and Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel (S.S., O.S.)
| | - Hayit Greenspan
- From the Department of Diagnostic Imaging, Sheba Medical Center, Emek HaEla St 1, Ramat Gan, Israel (S.S., M.M.A., E.K.); Faculty of Engineering, Department of Biomedical Engineering, Medical Image Processing Laboratory, Tel Aviv University, Tel Aviv, Israel (A.B., H.G.); and Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel (S.S., O.S.)
| | - Eyal Klang
- From the Department of Diagnostic Imaging, Sheba Medical Center, Emek HaEla St 1, Ramat Gan, Israel (S.S., M.M.A., E.K.); Faculty of Engineering, Department of Biomedical Engineering, Medical Image Processing Laboratory, Tel Aviv University, Tel Aviv, Israel (A.B., H.G.); and Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel (S.S., O.S.)
| |
Collapse
|
5
|
Yang F, Jia X, Lei P, He Y, Xiang Y, Jiao J, Zhou S, Qian W, Duan Q. Quantification of hepatic steatosis in histologic images by deep learning method. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2019; 27:1033-1045. [PMID: 31744039 DOI: 10.3233/xst-190570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
OBJECTIVE To develop and test a novel method for automatic quantification of hepatic steatosis in histologic images based on the deep learning scheme designed to predict the fat ratio directly, which aims to improve accuracy in diagnosis of non-alcoholic fatty liver disease (NAFLD) with objective assessment of the severity of hepatic steatosis instead of subjective visual estimation. MATERIALS AND METHODS Thirty-six 8-week old New Zealand white rabbits of both sexes were fed with high-cholesterol, high-fat diet and sacrificed under deep anesthesia at various time points to obtain the pathological specimen. All rabbits were performed by multislice computed tomography for surveillance to measure density changes of liver parenchyma. A deep learning scheme using a convolutional neural network was developed to directly predict the liver fat ratio based on the pathological images. The average error value, standard deviation, and accuracy (error <5%) were evaluated and compared between the deep learning scheme and manual segmentation results. The Pearson's correlation coefficient was also calculated in this study. RESULTS The deep learning scheme performs successfully on rabbit liver histologic data, showing a high degree of accuracy and stability. The average error value, standard deviation, and accuracy (error <5%) were 3.21%, 4.02%, and 79.10% for the cropped images, 2.22%, 1.92%, and 88.34% for the original images, respectively. The strong positive correlation was also observed for cropped images (R = 0.9227) and original images (R = 0.9255) in comparison to labeled fat ratio. CONCLUSIONS This new deep learning scheme may aid in the quantification of steatosis in the liver and facilitate its treatment by providing an earlier clinical diagnosis.
Collapse
Affiliation(s)
- Fan Yang
- School of Biology & Engineering, Guizhou Medical University, Guiyang, Guizhou Province, China
- Key Laboratory of Biology and Medical Engineering, Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Xianyuan Jia
- School of Biology & Engineering, Guizhou Medical University, Guiyang, Guizhou Province, China
- Key Laboratory of Biology and Medical Engineering, Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Pinggui Lei
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Yan He
- School of Biology & Engineering, Guizhou Medical University, Guiyang, Guizhou Province, China
- Key Laboratory of Biology and Medical Engineering, Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Yining Xiang
- Department of Pathology, The Affiliated Hospital of Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Jun Jiao
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Shi Zhou
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Wei Qian
- Department of Electrical and Computer Engineering, College of Engineering, University of Texas, El Paso, TX, USA
| | - Qinghong Duan
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, Guizhou Province, China
| |
Collapse
|
6
|
Abstract
The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction, and intervention. Deep learning is a representation learning method that consists of layers that transform data nonlinearly, thus, revealing hierarchical relationships and structures. In this review, we survey deep learning application papers that use structured data, and signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.
Collapse
|