1
|
Manzke M, Iseke S, Böttcher B, Klemenz AC, Weber MA, Meinel FG. Development and performance evaluation of fully automated deep learning-based models for myocardial segmentation on T1 mapping MRI data. Sci Rep 2024; 14:18895. [PMID: 39143126 PMCID: PMC11324648 DOI: 10.1038/s41598-024-69529-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Accepted: 08/06/2024] [Indexed: 08/16/2024] Open
Abstract
To develop a deep learning-based model capable of segmenting the left ventricular (LV) myocardium on native T1 maps from cardiac MRI in both long-axis and short-axis orientations. Models were trained on native myocardial T1 maps from 50 healthy volunteers and 75 patients using manual segmentation as the reference standard. Based on a U-Net architecture, we systematically optimized the model design using two different training metrics (Sørensen-Dice coefficient = DSC and Intersection-over-Union = IOU), two different activation functions (ReLU and LeakyReLU) and various numbers of training epochs. Training with DSC metric and a ReLU activation function over 35 epochs achieved the highest overall performance (mean error in T1 10.6 ± 17.9 ms, mean DSC 0.88 ± 0.07). Limits of agreement between model results and ground truth were from -35.5 to + 36.1 ms. This was superior to the agreement between two human raters (-34.7 to + 59.1 ms). Segmentation was as accurate for long-axis views (mean error T1: 6.77 ± 8.3 ms, mean DSC: 0.89 ± 0.03) as for short-axis images (mean error ΔT1: 11.6 ± 19.7 ms, mean DSC: 0.88 ± 0.08). Fully automated segmentation and quantitative analysis of native myocardial T1 maps is possible in both long-axis and short-axis orientations with very high accuracy.
Collapse
Affiliation(s)
- Mathias Manzke
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Simon Iseke
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Benjamin Böttcher
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Ann-Christin Klemenz
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Marc-André Weber
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Felix G Meinel
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany.
| |
Collapse
|
2
|
Wang J, Zhang N, Wang S, Liang W, Zhao H, Xia W, Zhu J, Zhang Y, Zhang W, Chai S. AI approach to biventricular function assessment in cine-MRI: an ultra-small training dataset and multivendor study. Phys Med Biol 2023; 68:245025. [PMID: 37918023 DOI: 10.1088/1361-6560/ad0903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 11/01/2023] [Indexed: 11/04/2023]
Abstract
Objective. It was a great challenge to train an excellent and generalized model on an ultra-small data set composed of multi-orientation cardiac cine magnetic resonance imaging (MRI) images. We try to develop a 3D deep learning method based on an ultra-small training data set from muti-orientation cine MRI images and assess its performance of automated biventricular structure segmentation and function assessment in multivendor.Approach. We completed the training and testing of our deep learning networks using only heart datasets of 150 cases (90 cases for training and 60 cases for testing). This datasets were obtained from three different MRI vendors and each subject included two phases of the cardiac cycle and three cine sequences. A 3D deep learning algorithm combining Transformers and U-Net was trained. The performance of the segmentation was evaluated using the Dice metric and Hausdorff distance (HD). Based on this, the manual and automatic results of cardiac function parameters were compared with Pearson correlation, intraclass correlation coefficient (ICC) and Bland-Altman analysis in multivendor.Main results. The results show that the average Dice of 0.92, 0.92, 0.94 and HD95 of 2.50, 1.36, 1.37 for three sequences. The automatic and manual results of seven parameters were excellently correlated with the lowestr2 value of 0.824 and the highest of 0.983. The ICC (0.908-0.989,P< 0.001) showed that the results were highly consistent. Bland-Altman with a 95% limit of agreement showed there was no significant difference except for the difference in RVESV (P= 0.005) and LVM (P< 0.001).Significance. The model had high accuracy in segmentation and excellent correlation and consistency in function assessment. It provides a fast and effective method for studying cardiac MRI and heart disease.
Collapse
Affiliation(s)
- Jing Wang
- School of Information Science and Engineering, University of Jinan, People's Republic of China
| | - Nan Zhang
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, People's Republic of China
| | - Shuyu Wang
- Department of Electric Information Engineering, Shandong Youth University of Political Science, People's Republic of China
| | - Wei Liang
- Department of Ecological Environment Statistics, Department of ecological environment of Shandong, People's Republic of China
| | - Haiyue Zhao
- Department of Electric Information Engineering, Shandong Youth University of Political Science, People's Republic of China
| | - Weili Xia
- Department of Science and Education, Shandong Mental Health Center, People's Republic of China
| | - Jianlei Zhu
- Department of Neuromodulation Center, Shandong Mental Health Center, People's Republic of China
| | - Yan Zhang
- Department of Radiology, Shandong Mental Health Center, People's Republic of China
| | - Wei Zhang
- Department of Medical Ultrasound, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, People's Republic of China
| | - Senchun Chai
- Department of Automation, School of automation, Beijing Institute of Technology, People's Republic of China
| |
Collapse
|
3
|
Li YZ, Wang Y, Huang YH, Xiang P, Liu WX, Lai QQ, Gao YY, Xu MS, Guo YF. RSU-Net: U-net based on residual and self-attention mechanism in the segmentation of cardiac magnetic resonance images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 231:107437. [PMID: 36863157 DOI: 10.1016/j.cmpb.2023.107437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 11/20/2022] [Accepted: 02/18/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND Automated segmentation techniques for cardiac magnetic resonance imaging (MRI) are beneficial for evaluating cardiac functional parameters in clinical diagnosis. However, due to the characteristics of unclear image boundaries and anisotropic resolution anisotropy produced by cardiac magnetic resonance imaging technology, most of the existing methods still have the problems of intra-class uncertainty and inter-class uncertainty. However, due to the irregularity of the anatomical shape of the heart and the inhomogeneity of tissue density, the boundaries of its anatomical structures become uncertain and discontinuous. Therefore, fast and accurate segmentation of cardiac tissue remains a challenging problem in medical image processing. METHODOLOGY We collected cardiac MRI data from 195 patients as training set and 35patients from different medical centers as external validation set. Our research proposed a U-net network architecture with residual connections and a self-attentive mechanism (Residual Self-Attention U-net, RSU-Net). The network relies on the classic U-net network, adopts the U-shaped symmetric architecture of the encoding and decoding mode, improves the convolution module in the network, introduces skip connections, and improves the network's capacity for feature extraction. Then for solving locality defects of ordinary convolutional networks. To achieve a global receptive field, a self-attention mechanism is introduced at the bottom of the model. The loss function employs a combination of Cross Entropy Loss and Dice Loss to jointly guide network training, resulting in more stable network training. RESULTS In our study, we employ the Hausdorff distance (HD) and the Dice similarity coefficient (DSC) as metrics for assessing segmentation outcomes. Comparsion was made with the segmentation frameworks of other papers, and the comparison results prove that our RSU-Net network performs better and can make accurate segmentation of the heart. New ideas for scientific research. CONCLUSION Our proposed RSU-Net network combines the advantages of residual connections and self-attention. This paper uses the residual links to facilitate the training of the network. In this paper, a self-attention mechanism is introduced, and a bottom self-attention block (BSA Block) is used to aggregate global information. Self-attention aggregates global information, and has achieved good segmentation results on the cardiac segmentation dataset. It facilitates the diagnosis of cardiovascular patients in the future.
Collapse
Affiliation(s)
- Yuan-Zhe Li
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Yi Wang
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Yin-Hui Huang
- Department of Neurology, Jinjiang Municipal Hospital, Quanzhou 362000, China
| | - Ping Xiang
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China
| | - Wen-Xi Liu
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Qing-Quan Lai
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Yi-Yuan Gao
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China
| | - Mao-Sheng Xu
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China.
| | - Yi-Fan Guo
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China.
| |
Collapse
|
4
|
Shoaib MA, Chuah JH, Ali R, Hasikin K, Khalil A, Hum YC, Tee YK, Dhanalakshmi S, Lai KW. An Overview of Deep Learning Methods for Left Ventricle Segmentation. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:4208231. [PMID: 36756163 PMCID: PMC9902166 DOI: 10.1155/2023/4208231] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Revised: 10/25/2022] [Accepted: 11/24/2022] [Indexed: 01/31/2023]
Abstract
Cardiac health diseases are one of the key causes of death around the globe. The number of heart patients has considerably increased during the pandemic. Therefore, it is crucial to assess and analyze the medical and cardiac images. Deep learning architectures, specifically convolutional neural networks have profoundly become the primary choice for the assessment of cardiac medical images. The left ventricle is a vital part of the cardiovascular system where the boundary and size perform a significant role in the evaluation of cardiac function. Due to automatic segmentation and good promising results, the left ventricle segmentation using deep learning has attracted a lot of attention. This article presents a critical review of deep learning methods used for the left ventricle segmentation from frequently used imaging modalities including magnetic resonance images, ultrasound, and computer tomography. This study also demonstrates the details of the network architecture, software, and hardware used for training along with publicly available cardiac image datasets and self-prepared dataset details incorporated. The summary of the evaluation matrices with results used by different researchers is also presented in this study. Finally, all this information is summarized and comprehended in order to assist the readers to understand the motivation and methodology of various deep learning models, as well as exploring potential solutions to future challenges in LV segmentation.
Collapse
Affiliation(s)
- Muhammad Ali Shoaib
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
- Faculty of Information and Communication Technology, BUITEMS, Quetta, Pakistan
| | - Joon Huang Chuah
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Raza Ali
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
- Faculty of Information and Communication Technology, BUITEMS, Quetta, Pakistan
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Azira Khalil
- Faculty of Science & Technology, Universiti Sains Islam Malaysia, Nilai 71800, Malaysia
| | - Yan Chai Hum
- Department of Mechatronics and Biomedical Engineering, Lee Kong Chian Faculty of Engineering and Science, Universiti Tunku Abdul Rahman, Malaysia
| | - Yee Kai Tee
- Department of Mechatronics and Biomedical Engineering, Lee Kong Chian Faculty of Engineering and Science, Universiti Tunku Abdul Rahman, Malaysia
| | - Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, India
| | - Khin Wee Lai
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| |
Collapse
|
5
|
Shoaib MA, Chuah JH, Ali R, Dhanalakshmi S, Hum YC, Khalil A, Lai KW. Fully Automatic Left Ventricle Segmentation Using Bilateral Lightweight Deep Neural Network. LIFE (BASEL, SWITZERLAND) 2023; 13:life13010124. [PMID: 36676073 PMCID: PMC9864753 DOI: 10.3390/life13010124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 12/22/2022] [Accepted: 12/29/2022] [Indexed: 01/04/2023]
Abstract
The segmentation of the left ventricle (LV) is one of the fundamental procedures that must be performed to obtain quantitative measures of the heart, such as its volume, area, and ejection fraction. In clinical practice, the delineation of LV is still often conducted semi-automatically, leaving it open to operator subjectivity. The automatic LV segmentation from echocardiography images is a challenging task due to poorly defined boundaries and operator dependency. Recent research has demonstrated that deep learning has the capability to employ the segmentation process automatically. However, the well-known state-of-the-art segmentation models still lack in terms of accuracy and speed. This study aims to develop a single-stage lightweight segmentation model that precisely and rapidly segments the LV from 2D echocardiography images. In this research, a backbone network is used to acquire both low-level and high-level features. Two parallel blocks, known as the spatial feature unit and the channel feature unit, are employed for the enhancement and improvement of these features. The refined features are merged by an integrated unit to segment the LV. The performance of the model and the time taken to segment the LV are compared to other established segmentation models, DeepLab, FCN, and Mask RCNN. The model achieved the highest values of the dice similarity index (0.9446), intersection over union (0.8445), and accuracy (0.9742). The evaluation metrics and processing time demonstrate that the proposed model not only provides superior quantitative results but also trains and segments the LV in less time, indicating its improved performance over competing segmentation models.
Collapse
Affiliation(s)
- Muhammad Ali Shoaib
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur 50603, Malaysia
- Faculty of Information and Communication Technology, BUITEMS, Quetta 87300, Pakistan
| | - Joon Huang Chuah
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur 50603, Malaysia
| | - Raza Ali
- Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur 50603, Malaysia
- Faculty of Information and Communication Technology, BUITEMS, Quetta 87300, Pakistan
| | - Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur 603203, India
| | - Yan Chai Hum
- Department of Mechatronics and Biomedical Engineering (DMBE), Lee Kong Chian Faculty of Engineering and Science (LKC FES), Universiti Tunku Abdul Rahman (UTAR), Jalan Sungai Long, Bandar Sungai Long, Cheras, Kajang 43000, Malaysia
| | - Azira Khalil
- Faculty of Science and Technology, Universiti Sains Islam Malaysia (USIM), Nilai 71800, Malaysia
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur 50603, Malaysia
- Correspondence:
| |
Collapse
|
6
|
Böttcher B, Beller E, Busse A, Cantré D, Yücel S, Öner A, Ince H, Weber MA, Meinel FG. Fully automated quantification of left ventricular volumes and function in cardiac MRI: clinical evaluation of a deep learning-based algorithm. Int J Cardiovasc Imaging 2020; 36:2239-2247. [PMID: 32677023 PMCID: PMC7568707 DOI: 10.1007/s10554-020-01935-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Accepted: 07/06/2020] [Indexed: 12/18/2022]
Abstract
To investigate the performance of a deep learning-based algorithm for fully automated quantification of left ventricular (LV) volumes and function in cardiac MRI. We retrospectively analysed MR examinations of 50 patients (74% men, median age 57 years). The most common indications were known or suspected ischemic heart disease, cardiomyopathies or myocarditis. Fully automated analysis of LV volumes and function was performed using a deep learning-based algorithm. The analysis was subsequently corrected by a senior cardiovascular radiologist. Manual volumetric analysis was performed by two radiology trainees. Volumetric results were compared using Bland–Altman statistics and intra-class correlation coefficient. The frequency of clinically relevant differences was analysed using re-classification rates. The fully automated volumetric analysis was completed in a median of 8 s. With expert review and corrections, the analysis required a median of 110 s. Median time required for manual analysis was 3.5 min for a cardiovascular imaging fellow and 9 min for a radiology resident (p < 0.0001 for all comparisons). The correlation between fully automated results and expert-corrected results was very strong with intra-class correlation coefficients of 0.998 for end-diastolic volume, 0.997 for end-systolic volume, 0.899 for stroke volume, 0.972 for ejection fraction and 0.991 for myocardial mass (all p < 0.001). Clinically meaningful differences between fully automated and expert corrected results occurred in 18% of cases, comparable to the rate between the two manual readers (20%). Deep learning-based fully automated analysis of LV volumes and function is feasible, time-efficient and highly accurate. Clinically relevant corrections are required in a minority of cases.
Collapse
Affiliation(s)
- Benjamin Böttcher
- Institute of Diagnostic and Interventional Radiology, Paediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Ebba Beller
- Institute of Diagnostic and Interventional Radiology, Paediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Anke Busse
- Institute of Diagnostic and Interventional Radiology, Paediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Daniel Cantré
- Institute of Diagnostic and Interventional Radiology, Paediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Seyrani Yücel
- Department of Internal Medicine, Divison of Cardiology, University Medical Center Rostock, Rostock, Germany
| | - Alper Öner
- Department of Internal Medicine, Divison of Cardiology, University Medical Center Rostock, Rostock, Germany
| | - Hüseyin Ince
- Department of Internal Medicine, Divison of Cardiology, University Medical Center Rostock, Rostock, Germany
| | - Marc-André Weber
- Institute of Diagnostic and Interventional Radiology, Paediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Felix G Meinel
- Institute of Diagnostic and Interventional Radiology, Paediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany.
| |
Collapse
|