1
|
Boneš E, Gergolet M, Bohak C, Lesar Ž, Marolt M. Automatic Segmentation and Alignment of Uterine Shapes from 3D Ultrasound Data. Comput Biol Med 2024; 178:108794. [PMID: 38941903 DOI: 10.1016/j.compbiomed.2024.108794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 06/18/2024] [Accepted: 06/19/2024] [Indexed: 06/30/2024]
Abstract
BACKGROUND The uterus is the most important organ in the female reproductive system. Its shape plays a critical role in fertility and pregnancy outcomes. Advances in medical imaging, such as 3D ultrasound, have significantly improved the exploration of the female genital tract, thereby enhancing gynecological healthcare. Despite well-documented data for organs like the liver and heart, large-scale studies on the uterus are lacking. Existing classifications, such as VCUAM and ESHRE/ESGE, provide different definitions for normal uterine shapes but are not based on real-world measurements. Moreover, the lack of comprehensive datasets significantly hinders research in this area. Our research, part of the larger NURSE study, aims to fill this gap by establishing the shape of a normal uterus using real-world 3D vaginal ultrasound scans. This will facilitate research into uterine shape abnormalities associated with infertility and recurrent miscarriages. METHODS We developed an automated system for the segmentation and alignment of uterine shapes from 3D ultrasound data, which consists of two steps: automatic segmentation of the uteri in 3D ultrasound scans using deep learning techniques, and alignment of the resulting shapes with standard geometrical approaches, enabling the extraction of the normal shape for future analysis. The system was trained and validated on a comprehensive dataset of 3D ultrasound images from multiple medical centers. Its performance was evaluated by comparing the automated results with manual annotations provided by expert clinicians. RESULTS The presented approach demonstrated high accuracy in segmenting and aligning uterine shapes from 3D ultrasound data. The segmentation achieved an average Dice similarity coefficient (DSC) of 0.90. Our method for aligning uterine shapes showed minimal translation and rotation errors compared to traditional methods, with the preliminary average shape exhibiting characteristics consistent with expert findings of a normal uterus. CONCLUSION We have presented an approach to automatically segment and align uterine shapes from 3D ultrasound data. We trained a deep learning nnU-Net model that achieved high accuracy and proposed an alignment method using a combination of standard geometrical techniques. Additionally, we have created a publicly available dataset of 3D transvaginal ultrasound volumes with manual annotations of uterine cavities to support further research and development in this field. The dataset and the trained models are available at https://github.com/UL-FRI-LGM/UterUS.
Collapse
Affiliation(s)
- Eva Boneš
- University of Ljubljana, Faculty of Computer and Information Science, Večna pot 113, Ljubljana, 1000, Slovenia.
| | - Marco Gergolet
- University of Ljubljana, Faculty of Medicine, Vrazov trg 2, Ljubljana, 1000, Slovenia.
| | - Ciril Bohak
- University of Ljubljana, Faculty of Computer and Information Science, Večna pot 113, Ljubljana, 1000, Slovenia; King Abdullah University of Science and Technology, Visual Computing Center, Thuwal, 23955-6900, Saudi Arabia.
| | - Žiga Lesar
- University of Ljubljana, Faculty of Computer and Information Science, Večna pot 113, Ljubljana, 1000, Slovenia.
| | - Matija Marolt
- University of Ljubljana, Faculty of Computer and Information Science, Večna pot 113, Ljubljana, 1000, Slovenia.
| |
Collapse
|
2
|
Yoo SW, Yang S, Kim JE, Huh KH, Lee SS, Heo MS, Yi WJ. CACSNet for automatic robust classification and segmentation of carotid artery calcification on panoramic radiographs using a cascaded deep learning network. Sci Rep 2024; 14:13894. [PMID: 38886356 PMCID: PMC11183138 DOI: 10.1038/s41598-024-64265-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 06/06/2024] [Indexed: 06/20/2024] Open
Abstract
Stroke is one of the major causes of death worldwide, and is closely associated with atherosclerosis of the carotid artery. Panoramic radiographs (PRs) are routinely used in dental practice, and can be used to visualize carotid artery calcification (CAC). The purpose of this study was to automatically and robustly classify and segment CACs with large variations in size, shape, and location, and those overlapping with anatomical structures based on deep learning analysis of PRs. We developed a cascaded deep learning network (CACSNet) consisting of classification and segmentation networks for CACs on PRs. This network was trained on ground truth data accurately determined with reference to CT images using the Tversky loss function with optimized weights by balancing between precision and recall. CACSNet with EfficientNet-B4 achieved an AUC of 0.996, accuracy of 0.985, sensitivity of 0.980, and specificity of 0.988 in classification for normal or abnormal PRs. Segmentation performances for CAC lesions were 0.595 for the Jaccard index, 0.722 for the Dice similarity coefficient, 0.749 for precision, and 0.756 for recall. Our network demonstrated superior classification performance to previous methods based on PRs, and had comparable segmentation performance to studies based on other imaging modalities. Therefore, CACSNet can be used for robust classification and segmentation of CAC lesions that are morphologically variable and overlap with surrounding structures over the entire posterior inferior region of the mandibular angle on PRs.
Collapse
Affiliation(s)
- Suh-Woo Yoo
- Department of Oral and Maxillofacial Radiology, School of Dentistry, Seoul National University, Seoul, Korea
| | - Su Yang
- Department of Applied Bioengineering, Graduate School of Convergence Science and Technology, Seoul National University, Seoul, Korea
| | - Jo-Eun Kim
- Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Korea
| | - Kyung-Hoe Huh
- Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Korea
| | - Sam-Sun Lee
- Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Korea
| | - Min-Suk Heo
- Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Korea
| | - Won-Jin Yi
- Department of Applied Bioengineering, Graduate School of Convergence Science and Technology, Seoul National University, Seoul, Korea.
- Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Korea.
| |
Collapse
|
3
|
Bhagawati M, Paul S, Mantella L, Johri AM, Laird JR, Singh IM, Singh R, Garg D, Fouda MM, Khanna NN, Cau R, Abraham A, Al-Maini M, Isenovic ER, Sharma AM, Fernandes JFE, Chaturvedi S, Karla MK, Nicolaides A, Saba L, Suri JS. Deep learning approach for cardiovascular disease risk stratification and survival analysis on a Canadian cohort. THE INTERNATIONAL JOURNAL OF CARDIOVASCULAR IMAGING 2024; 40:1283-1303. [PMID: 38678144 DOI: 10.1007/s10554-024-03100-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 04/02/2024] [Indexed: 04/29/2024]
Abstract
The quantification of carotid plaque has been routinely used to predict cardiovascular risk in cardiovascular disease (CVD) and coronary artery disease (CAD). To determine how well carotid plaque features predict the likelihood of CAD and cardiovascular (CV) events using deep learning (DL) and compare against the machine learning (ML) paradigm. The participants in this study consisted of 459 individuals who had undergone coronary angiography, contrast-enhanced ultrasonography, and focused carotid B-mode ultrasound. Each patient was tracked for thirty days. The measurements on these patients consisted of maximum plaque height (MPH), total plaque area (TPA), carotid intima-media thickness (cIMT), and intraplaque neovascularization (IPN). CAD risk and CV event stratification were performed by applying eight types of DL-based models. Univariate and multivariate analysis was also conducted to predict the most significant risk predictors. The DL's model effectiveness was evaluated by the area-under-the-curve measurement while the CV event prediction was evaluated using the Cox proportional hazard model (CPHM) and compared against the DL-based concordance index (c-index). IPN showed a substantial ability to predict CV events (p < 0.0001). The best DL system improved by 21% (0.929 vs. 0.762) over the best ML system. DL-based CV event prediction showed a ~ 17% increase in DL-based c-index compared to the CPHM (0.86 vs. 0.73). CAD and CV incidents were linked to IPN and carotid imaging characteristics. For survival analysis and CAD prediction, the DL-based system performs superior to ML-based models.
Collapse
Affiliation(s)
- Mrinalini Bhagawati
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong, India
| | - Sudip Paul
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong, India
| | - Laura Mantella
- Division of Cardiology, Department of Medicine, University of Toronto, Toronto, Canada
| | - Amer M Johri
- Division of Cardiology, Department of Medicine, Queen's University, Kingston, Canada
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, 94574, USA
| | - Inder M Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, 95661, USA
| | - Rajesh Singh
- Division of Research and Innovation, UTI, Uttaranchal University, Dehradun, India
| | - Deepak Garg
- School of Cowereter Science and Artificial Intelligence, SR University, Warangal, Telangana, 506371, India
| | - Mostafa M Fouda
- Department of ECE, Idaho State University, Pocatello, ID, 83209, USA
| | | | - Riccardo Cau
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138, Cagliari, Italy
| | | | - Mostafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON, Canada
| | - Esma R Isenovic
- Department of Radiobiology and Molecular Genetics, National Institute of The Republic of Serbia, University of Belgrade, 11001, Belgrade, Serbia
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, 22904, USA
| | | | - Seemant Chaturvedi
- Department of Neurology & Stroke Program, University of Maryland, Baltimore, MD, USA
| | - Mannudeep K Karla
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia, Cyprus
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138, Cagliari, Italy
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, 95661, USA.
- Department of ECE, Idaho State University, Pocatello, ID, 83209, USA.
- Department of CE, Graphic Era Deemed to be University, 248002, Dehradun, India.
| |
Collapse
|
4
|
Singh J, Khanna NN, Rout RK, Singh N, Laird JR, Singh IM, Kalra MK, Mantella LE, Johri AM, Isenovic ER, Fouda MM, Saba L, Fatemi M, Suri JS. GeneAI 3.0: powerful, novel, generalized hybrid and ensemble deep learning frameworks for miRNA species classification of stationary patterns from nucleotides. Sci Rep 2024; 14:7154. [PMID: 38531923 DOI: 10.1038/s41598-024-56786-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 03/11/2024] [Indexed: 03/28/2024] Open
Abstract
Due to the intricate relationship between the small non-coding ribonucleic acid (miRNA) sequences, the classification of miRNA species, namely Human, Gorilla, Rat, and Mouse is challenging. Previous methods are not robust and accurate. In this study, we present AtheroPoint's GeneAI 3.0, a powerful, novel, and generalized method for extracting features from the fixed patterns of purines and pyrimidines in each miRNA sequence in ensemble paradigms in machine learning (EML) and convolutional neural network (CNN)-based deep learning (EDL) frameworks. GeneAI 3.0 utilized five conventional (Entropy, Dissimilarity, Energy, Homogeneity, and Contrast), and three contemporary (Shannon entropy, Hurst exponent, Fractal dimension) features, to generate a composite feature set from given miRNA sequences which were then passed into our ML and DL classification framework. A set of 11 new classifiers was designed consisting of 5 EML and 6 EDL for binary/multiclass classification. It was benchmarked against 9 solo ML (SML), 6 solo DL (SDL), 12 hybrid DL (HDL) models, resulting in a total of 11 + 27 = 38 models were designed. Four hypotheses were formulated and validated using explainable AI (XAI) as well as reliability/statistical tests. The order of the mean performance using accuracy (ACC)/area-under-the-curve (AUC) of the 24 DL classifiers was: EDL > HDL > SDL. The mean performance of EDL models with CNN layers was superior to that without CNN layers by 0.73%/0.92%. Mean performance of EML models was superior to SML models with improvements of ACC/AUC by 6.24%/6.46%. EDL models performed significantly better than EML models, with a mean increase in ACC/AUC of 7.09%/6.96%. The GeneAI 3.0 tool produced expected XAI feature plots, and the statistical tests showed significant p-values. Ensemble models with composite features are highly effective and generalized models for effectively classifying miRNA sequences.
Collapse
Affiliation(s)
- Jaskaran Singh
- Department of Computer Science, Graphic Era Deemed to be University, Dehradun, Uttarakhand, India
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Ranjeet K Rout
- Department of Computer Science and Engineering, NIT Srinagar, Hazratbal, Srinagar, India
| | - Narpinder Singh
- Department of Food Science, Graphic Era Deemed to be University, Dehradun, Uttarakhand, India
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Inder M Singh
- Advanced Cardiac and Vascular Institute, Sacramento, CA, USA
| | - Mannudeep K Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, 02115, USA
| | - Laura E Mantella
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Amer M Johri
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Esma R Isenovic
- Laboratory for Molecular Genetics and Radiobiology, University of Belgrade, Belgrade, Serbia
| | - Mostafa M Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
| | - Luca Saba
- Department of Neurology, University of Cagliari, Cagliari, Italy
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, 55905, USA
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint LLC, Roseville, CA, 95661, USA.
| |
Collapse
|
5
|
Ding J, Zhou R, Fang X, Wang F, Wang J, Gan H, Fenster A. An image registration-based self-supervised Su-Net for carotid plaque ultrasound image segmentation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 244:107957. [PMID: 38061113 DOI: 10.1016/j.cmpb.2023.107957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Revised: 11/17/2023] [Accepted: 11/27/2023] [Indexed: 01/26/2024]
Abstract
BACKGROUND AND OBJECTIVES Total Plaque Area (TPA) measurement is critical for early diagnosis and intervention of carotid atherosclerosis in individuals with high risk for stroke. The delineation of the carotid plaques is necessary for TPA measurement, and deep learning methods can automatically segment the plaque and measure TPA from carotid ultrasound images. A large number of labeled images is essential for training a good deep learning model, but it is very difficult to collect such large labeled datasets for carotid image segmentation in clinical practice. Self-supervised learning can provide a possible solution to improve the deep-learning models on small labeled training datasets by designing a pretext task to pre-train the models without using the segmentation masks. However, the existing self-supervised learning methods do not consider the feature presentations of object contours. METHODS In this paper, we propose an image registration-based self-supervised learning method and a stacked U-Net (SSL-SU-Net) for carotid plaque ultrasound image segmentation, which can better exploit the semantic features of carotid plaque contours in self-supervised task training. RESULTS Our network was trained on different numbers of labeled images (n = 10, 33, 50 and 100 subjects) and tested on 44 subjects from the SPARC dataset (n = 144, London, Canada). The network trained on the entire SPARC dataset was then directly applied to an independent dataset collected in Zhongnan hospital (n = 497, Wuhan, China). For the 44 subjects tested on the SPARC dataset, our method yielded a DSC of 80.25-89.18% and the produced TPA measurements, which were strongly correlated with manual segmentation (r = 0.965-0.995, ρ< 0.0001). For the Zhongnan dataset, the DSC was 90.3% and algorithm TPAs were strongly correlated with manual TPAs (r = 0.985, ρ< 0.0001). CONCLUSIONS The results demonstrate that our proposed method yielded excellent performance and good generalization ability when trained on a small labeled dataset, facilitating the use of deep learning in carotid ultrasound image analysis and clinical practice. The code of our algorithm is available https://github.com/a610lab/Registration-SSL.
Collapse
Affiliation(s)
- Jing Ding
- School of Computer Science, Hubei University of Technology, Wuhan, Hubei 430068, China
| | - Ran Zhou
- School of Computer Science, Hubei University of Technology, Wuhan, Hubei 430068, China.
| | - Xiaoyue Fang
- School of Computer Science, Hubei University of Technology, Wuhan, Hubei 430068, China
| | - Furong Wang
- Liyuan Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei 430074, China
| | - Ji Wang
- School of Computer Science, Hubei University of Technology, Wuhan, Hubei 430068, China
| | - Haitao Gan
- School of Computer Science, Hubei University of Technology, Wuhan, Hubei 430068, China.
| | - Aaron Fenster
- Imaging Research Laboratories, Robarts Research Institute, Western University, London N6A 5K8, Ontario, Canada
| |
Collapse
|
6
|
Wulamu A, Luo J, Chen S, Zheng H, Wang T, Yang R, Jiao L, Zhang T. CASMatching strategy for automated detection and quantification of carotid artery stenosis based on digital subtraction angiography. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 243:107871. [PMID: 37925855 DOI: 10.1016/j.cmpb.2023.107871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 09/16/2023] [Accepted: 10/15/2023] [Indexed: 11/07/2023]
Abstract
BACKGROUND AND OBJECTIVE Automated detection and quantification of carotid artery stenosis is a crucial task in establishing a computer-aided diagnostic system for brain diseases. Digital subtraction angiography (DSA) is known as the "gold standard" for carotid stenosis diagnosis. It is commonly used to identify carotid artery stenosis and measure morphological indices of the stenosis. However, using deep learning to detect stenosis based on DSA images and further quantitatively predicting the morphological indices remain a challenge due the absence of prior work. In this paper, we propose a quantitative method for predicting morphological indices of carotid stenosis. METHODS Our method adopts a two-stage pipeline, first locating regions suitable for predicting morphological indices by object detection model, and then using a regression model to predict indices. A novel Carotid Artery Stenosis Matching (CASMatching) strategy is introduced into the object detection to model the matching relationship between a stenosis and multiple normal vessel segments. The proposed Match-ness branch predicts a Match-ness score for each normal vessel segment to indicate the degree of matching to the stenosis. A novel Direction Distance-IoU (2DIoU) loss based on the Distance-IoU loss is proposed to make the model focused more on the bounding box regression in the direction of vessel extension. After detection, the normal vessel segment with the highest Match-ness score and the stenosis are intercepted from the original image, then fed into a regression model to predict morphological indices and calculate the degree of stenosis. RESULTS Our method is trained and evaluated on a dataset collected from three different manufacturers' monoplane X-ray systems. The results show that the proposed components in the object detector substantially improve the detection performance of normal vascular segments. For the prediction of morphological indices, our model achieves Mean Absolute Error of 0.378, 0.221, 4.9 on reference vessel diameter (RVD), minimum lumen diameter (MLD) and stenosis degree. CONCLUSIONS Our method can precisely localize the carotid stenosis and the normal vessel segment suitable for predicting RVD of the stenosis, and further achieve accurate quantification, providing a novel solution for the quantification of carotid artery stenosis.
Collapse
Affiliation(s)
- Aziguli Wulamu
- Department of Computer, School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing, China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China.
| | - Jichang Luo
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China
| | - Saian Chen
- Department of Computer, School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing, China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China
| | - Han Zheng
- Education Department of Guangxi Zhuang Autonomous Region, Key Laboratory of AI and Information Processing (Hechi University), Hechi, Guangxi 546300, China.
| | - Tao Wang
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China
| | - Renjie Yang
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China
| | - Liqun Jiao
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China; China International Neuroscience Institute (China-INI), Beijing, China; Department of Interventional Radiology, Xuanwu Hospital, Capital Medical University, Beijing, China.
| | - Taohong Zhang
- Department of Computer, School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing, China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China.
| |
Collapse
|
7
|
Jagadeesan K, Palanisamy G. Atherosclerosis plaque tissue classification using self-attention-based conditional variational auto-encoder generative adversarial network using OCT plaque image. BIOMED ENG-BIOMED TE 2023; 68:633-649. [PMID: 37401612 DOI: 10.1515/bmt-2022-0286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 05/08/2023] [Indexed: 07/05/2023]
Abstract
Adults with coronary artery disease often have atherosclerosis, this is defined as the accumulation of plaque in the tissues of the arterial wall. Cardiologists utilize optical coherence tomography (OCT), a light-based imaging method, to examine the layers of intracoronary tissue along pathological formations, such as plaque accumulation. Intracoronary cross-sectional images produced by state-of-the-art catheter-based imaging scheme have 10-15 µm high resolution. Nevertheless, interpretation of the obtained images depends on the operator, which takes a lot of time and is exceedingly error-prone from one observer to another. OCT image post-processing that automatically and accurately tags coronary plaques can help the technique become more widely used and lower the diagnostic error rate. To overcome these problems, Atherosclerosis plaque tissue classification using Self-Attention-Based Conditional Variational Auto-Encoder Generative Adversarial Network (APC-OCTPI-SACVAGAN) is proposed which classifies the Atherosclerosis plaque images as Fibro calcific plaque, Fibro atheroma, Thrombus, Fibrous plaque and Micro-vessel. The proposed APC-OCTPI-SACVAGAN technique is executed in MATLAB. The efficiency of proposed APC-OCTPI-SACVAGAN method attains 16.19 %, 17.93 %, 19.81 % and 1.57 % higher accuracy; 16.92 %, 11.54 %, 5.29 % and 1.946 % higher Area under curve; and 28.06 %, 25.32 %, 32.19 % and 39.185 % lower computational time comparing to the existing methods respectively.
Collapse
Affiliation(s)
- Kowsalyadevi Jagadeesan
- Research Scholar, Department of Computer Science and Engineering, College of Engineering Guindy, Anna University, Chennai, Tamil Nadu, India
| | - Geetha Palanisamy
- Department of Computer Science and Engineering, College of Engineering Guindy, Anna University, Chennai, Tamil Nadu, India
| |
Collapse
|
8
|
Gao L, Li J, Zhang R, Bekele HH, Wang J, Cheng Y, Deng H. MMGan: a multimodal MR brain tumor image segmentation method. Front Hum Neurosci 2023; 17:1275795. [PMID: 38116237 PMCID: PMC10728273 DOI: 10.3389/fnhum.2023.1275795] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 11/13/2023] [Indexed: 12/21/2023] Open
Abstract
Computer-aided diagnosis has emerged as a rapidly evolving field, garnering increased attention in recent years. At the forefront of this field is the segmentation of lesions in medical images, which is a critical preliminary stage in subsequent treatment procedures. Among the most challenging tasks in medical image analysis is the accurate and automated segmentation of brain tumors in various modalities of brain tumor MRI. In this article, we present a novel end-to-end network architecture called MMGan, which combines the advantages of residual learning and generative adversarial neural networks inspired by classical generative adversarial networks. The segmenter in the MMGan network, which has a U-Net architecture, is constructed using a deep residual network instead of the conventional convolutional neural network. The dataset used for this study is the BRATS dataset from the Brain Tumor Segmentation Challenge at the Medical Image Computing and Computer Assisted Intervention Society. Our proposed method has been extensively tested, and the results indicate that this MMGan framework is more efficient and stable for segmentation tasks. On BRATS 2019, the segmentation algorithm improved accuracy and sensitivity in whole tumor, tumor core, and enhanced tumor segmentation. Particularly noteworthy is the higher dice score of 0.86 achieved by our proposed method in tumor core segmentation, surpassing those of stateof-the-art models. This study improves the accuracy and sensitivity of the tumor segmentation task, which we believe is significant for medical image analysis. And it should be further improved by replacing different loss functions such as cross-entropy loss function and other methods.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Hongxia Deng
- Department of Artificial Intelligence, College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, China
| |
Collapse
|
9
|
Kumari V, Kumar N, Kumar K S, Kumar A, Skandha SS, Saxena S, Khanna NN, Laird JR, Singh N, Fouda MM, Saba L, Singh R, Suri JS. Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look. J Cardiovasc Dev Dis 2023; 10:485. [PMID: 38132653 PMCID: PMC10743870 DOI: 10.3390/jcdd10120485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 10/15/2023] [Accepted: 11/07/2023] [Indexed: 12/23/2023] Open
Abstract
BACKGROUND AND MOTIVATION Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias. METHODS Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework. FINDINGS AND CONCLUSIONS UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.
Collapse
Affiliation(s)
- Vandana Kumari
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Naresh Kumar
- Department of Applied Computational Science and Engineering, G L Bajaj Institute of Technology and Management, Greater Noida 201310, India
| | - Sampath Kumar K
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Ashish Kumar
- School of CSET, Bennett University, Greater Noida 201310, India;
| | - Sanagala S. Skandha
- Department of CSE, CMR College of Engineering and Technology, Hyderabad 501401, India;
| | - Sanjay Saxena
- Department of Computer Science and Engineering, IIT Bhubaneswar, Bhubaneswar 751003, India;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era, Deemed to be University, Dehradun 248002, India;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09100 Cagliari, Italy;
| | - Rajesh Singh
- Department of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, India;
| | - Jasjit S. Suri
- Stroke Diagnostics and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Computer Science & Engineering, Graphic Era, Deemed to be University, Dehradun 248002, India
- Monitoring and Diagnosis Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
10
|
Khanna NN, Singh M, Maindarkar M, Kumar A, Johri AM, Mentella L, Laird JR, Paraskevas KI, Ruzsa Z, Singh N, Kalra MK, Fernandes JFE, Chaturvedi S, Nicolaides A, Rathore V, Singh I, Teji JS, Al-Maini M, Isenovic ER, Viswanathan V, Khanna P, Fouda MM, Saba L, Suri JS. Polygenic Risk Score for Cardiovascular Diseases in Artificial Intelligence Paradigm: A Review. J Korean Med Sci 2023; 38:e395. [PMID: 38013648 PMCID: PMC10681845 DOI: 10.3346/jkms.2023.38.e395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 10/15/2023] [Indexed: 11/29/2023] Open
Abstract
Cardiovascular disease (CVD) related mortality and morbidity heavily strain society. The relationship between external risk factors and our genetics have not been well established. It is widely acknowledged that environmental influence and individual behaviours play a significant role in CVD vulnerability, leading to the development of polygenic risk scores (PRS). We employed the PRISMA search method to locate pertinent research and literature to extensively review artificial intelligence (AI)-based PRS models for CVD risk prediction. Furthermore, we analyzed and compared conventional vs. AI-based solutions for PRS. We summarized the recent advances in our understanding of the use of AI-based PRS for risk prediction of CVD. Our study proposes three hypotheses: i) Multiple genetic variations and risk factors can be incorporated into AI-based PRS to improve the accuracy of CVD risk predicting. ii) AI-based PRS for CVD circumvents the drawbacks of conventional PRS calculators by incorporating a larger variety of genetic and non-genetic components, allowing for more precise and individualised risk estimations. iii) Using AI approaches, it is possible to significantly reduce the dimensionality of huge genomic datasets, resulting in more accurate and effective disease risk prediction models. Our study highlighted that the AI-PRS model outperformed traditional PRS calculators in predicting CVD risk. Furthermore, using AI-based methods to calculate PRS may increase the precision of risk predictions for CVD and have significant ramifications for individualized prevention and treatment plans.
Collapse
Affiliation(s)
- Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
- Asia Pacific Vascular Society, New Delhi, India
| | - Manasvi Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
- Bennett University, Greater Noida, India
| | - Mahesh Maindarkar
- Asia Pacific Vascular Society, New Delhi, India
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
- School of Bioengineering Sciences and Research, Maharashtra Institute of Technology's Art, Design and Technology University, Pune, India
| | | | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Canada
| | - Laura Mentella
- Department of Medicine, Division of Cardiology, University of Toronto, Toronto, Canada
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA, USA
| | | | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, Szeged, Hungary
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era Deemed to be University, Dehradun, Uttarakhand, India
| | | | | | - Seemant Chaturvedi
- Department of Neurology & Stroke Program, University of Maryland, Baltimore, MD, USA
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Cyprus
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, USA
| | - Inder Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | - Jagjit S Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, USA
| | - Mostafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON, Canada
| | - Esma R Isenovic
- Department of Radiobiology and Molecular Genetics, National Institute of The Republic of Serbia, University of Belgrade, Beograd, Serbia
| | | | - Puneet Khanna
- Department of Anaesthesiology, AIIMS, New Delhi, India
| | - Mostafa M Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, Cagliari, Italy
| | - Jasjit S Suri
- Asia Pacific Vascular Society, New Delhi, India
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
- Department of Computer Engineering, Graphic Era Deemed to be University, Dehradun, India.
| |
Collapse
|
11
|
Zhang H, Meng Z, Ru J, Meng Y, Wang K. Application and prospects of AI-based radiomics in ultrasound diagnosis. Vis Comput Ind Biomed Art 2023; 6:20. [PMID: 37828411 PMCID: PMC10570254 DOI: 10.1186/s42492-023-00147-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 09/20/2023] [Indexed: 10/14/2023] Open
Abstract
Artificial intelligence (AI)-based radiomics has attracted considerable research attention in the field of medical imaging, including ultrasound diagnosis. Ultrasound imaging has unique advantages such as high temporal resolution, low cost, and no radiation exposure. This renders it a preferred imaging modality for several clinical scenarios. This review includes a detailed introduction to imaging modalities, including Brightness-mode ultrasound, color Doppler flow imaging, ultrasound elastography, contrast-enhanced ultrasound, and multi-modal fusion analysis. It provides an overview of the current status and prospects of AI-based radiomics in ultrasound diagnosis, highlighting the application of AI-based radiomics to static ultrasound images, dynamic ultrasound videos, and multi-modal ultrasound fusion analysis.
Collapse
Affiliation(s)
- Haoyan Zhang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Zheling Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Jinyu Ru
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Yaqing Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Kun Wang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China.
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China.
| |
Collapse
|
12
|
Ayoub M, Liao Z, Li L, Wong KKL. HViT: Hybrid vision inspired transformer for the assessment of carotid artery plaque by addressing the cross-modality domain adaptation problem in MRI. Comput Med Imaging Graph 2023; 109:102295. [PMID: 37717365 DOI: 10.1016/j.compmedimag.2023.102295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 08/24/2023] [Accepted: 08/24/2023] [Indexed: 09/19/2023]
Abstract
BACKGROUND Medical image classification is crucial for accurate and efficient diagnosis, and deep learning frameworks have shown significant potential in this area. When a general learning deep model is directly deployed to a new dataset with heterogeneous features, the effect of domain shifts is usually ignored, which degrades the performance of deep learning models and leads to inaccurate predictions. PURPOSE This study aims to propose a framework that utilized the cross-modality domain adaptation and accurately diagnose and classify MRI scans and domain knowledge into stable and vulnerable plaque categories by a modified Vision Transformer (ViT) model for the classification of MRI scans and transformer model for domain knowledge classification. METHODS This study proposes a Hybrid Vision Inspired Transformer (HViT) framework that employs a convolutional layer for image pre-processing and normalization and a 3D convolutional layer to enable ViT to classify 3D images. Our proposed HViT framework introduces a slim design with a multi-branch network and channel attention, improving patch embedding extraction and information learning. Auxiliary losses target shallow features, linking them with deeper ones, enhancing information gain, and model generalization. Furthermore, replacing the MLP Head with RNN enables better backpropagation for improved performance. Moreover, we utilized a modified transformer model with LSTM positional encoding and Golve word vector to classify domain knowledge. By using ensemble learning techniques, specifically stacking ensemble learning with hard and soft prediction, we combine the predictive power of both models to address the cross-modality domain adaptation problem and improve overall performance. RESULTS The proposed framework achieved an accuracy of 94.32% for carotid artery plaque classification into stable and vulnerable plaque by addressing the cross-modality domain adaptation problem and improving overall performance. CONCLUSION The model was further evaluated using an independent dataset acquired from different hardware protocols. The results demonstrate that the proposed deep learning model significantly improves the generalization ability across different MRI scans acquired from different hardware protocols without requiring additional calibration data.
Collapse
Affiliation(s)
- Muhammad Ayoub
- School of Computer Science and Engineering, Central South University, Changsha 410017, Hunan, China
| | - Zhifang Liao
- School of Computer Science and Engineering, Central South University, Changsha 410017, Hunan, China.
| | - Lifeng Li
- Department of Radiology, The Affiliated Changsha Central Hospital, Hengyang Medical school, University of South China, Changsha 410017, China
| | - Kelvin K L Wong
- Department of Mechanical Engineering, College of Engineering, University of Saskatchewan, Saskatoon, SK S7N 5A9, Canada.
| |
Collapse
|
13
|
Ottakath N, Al-Maadeed S, Zughaier SM, Elharrouss O, Mohammed HH, Chowdhury MEH, Bouridane A. Ultrasound-Based Image Analysis for Predicting Carotid Artery Stenosis Risk: A Comprehensive Review of the Problem, Techniques, Datasets, and Future Directions. Diagnostics (Basel) 2023; 13:2614. [PMID: 37568976 PMCID: PMC10417708 DOI: 10.3390/diagnostics13152614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 07/25/2023] [Accepted: 07/25/2023] [Indexed: 08/13/2023] Open
Abstract
The carotid artery is a major blood vessel that supplies blood to the brain. Plaque buildup in the arteries can lead to cardiovascular diseases such as atherosclerosis, stroke, ruptured arteries, and even death. Both invasive and non-invasive methods are used to detect plaque buildup in the arteries, with ultrasound imaging being the first line of diagnosis. This paper presents a comprehensive review of the existing literature on ultrasound image analysis methods for detecting and characterizing plaque buildup in the carotid artery. The review includes an in-depth analysis of datasets; image segmentation techniques for the carotid artery plaque area, lumen area, and intima-media thickness (IMT); and plaque measurement, characterization, classification, and stenosis grading using deep learning and machine learning. Additionally, the paper provides an overview of the performance of these methods, including challenges in analysis, and future directions for research.
Collapse
Affiliation(s)
- Najmath Ottakath
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | - Somaya Al-Maadeed
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | | | - Omar Elharrouss
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | - Hanadi Hassen Mohammed
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | | | - Ahmed Bouridane
- Centre for Data Analytics and Cybersecurity, University of Sharjah, Sharjah 27272, United Arab Emirates;
| |
Collapse
|
14
|
Singh J, Singh N, Fouda MM, Saba L, Suri JS. Attention-Enabled Ensemble Deep Learning Models and Their Validation for Depression Detection: A Domain Adoption Paradigm. Diagnostics (Basel) 2023; 13:2092. [PMID: 37370987 DOI: 10.3390/diagnostics13122092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 06/08/2023] [Accepted: 06/12/2023] [Indexed: 06/29/2023] Open
Abstract
Depression is increasingly prevalent, leading to higher suicide risk. Depression detection and sentimental analysis of text inputs in cross-domain frameworks are challenging. Solo deep learning (SDL) and ensemble deep learning (EDL) models are not robust enough. Recently, attention mechanisms have been introduced in SDL. We hypothesize that attention-enabled EDL (aeEDL) architectures are superior compared to attention-not-enabled SDL (aneSDL) or aeSDL models. We designed EDL-based architectures with attention blocks to build eleven kinds of SDL model and five kinds of EDL model on four domain-specific datasets. We scientifically validated our models by comparing "seen" and "unseen" paradigms (SUP). We benchmarked our results against the SemEval (2016) sentimental dataset and established reliability tests. The mean increase in accuracy for EDL over their corresponding SDL components was 4.49%. Regarding the effect of attention block, the increase in the mean accuracy (AUC) of aeSDL over aneSDL was 2.58% (1.73%), and the increase in the mean accuracy (AUC) of aeEDL over aneEDL was 2.76% (2.80%). When comparing EDL vs. SDL for non-attention and attention, the mean aneEDL was greater than aneSDL by 4.82% (3.71%), and the mean aeEDL was greater than aeSDL by 5.06% (4.81%). For the benchmarking dataset (SemEval), the best-performing aeEDL model (ALBERT+BERT-BiLSTM) was superior to the best aeSDL (BERT-BiLSTM) model by 3.86%. Our scientific validation and robust design showed a difference of only 2.7% in SUP, thereby meeting the regulatory constraints. We validated all our hypotheses and further demonstrated that aeEDL is a very effective and generalized method for detecting symptoms of depression in cross-domain settings.
Collapse
Affiliation(s)
- Jaskaran Singh
- Department of Computer Science, Graphic Era, Deemed to be University, Dehradun 248002, India
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era, Deemed to be University, Dehradun 248002, India
| | - Mostafa M Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Luca Saba
- Department of Neurology, University of Cagliari, 09124 Cagliari, Italy
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 94203, USA
| |
Collapse
|
15
|
Collins GC, Rojas SS, Bercu ZL, Desai JP, Lindsey BD. Supervised segmentation for guiding peripheral revascularization with forward-viewing, robotically steered ultrasound guidewire. Med Phys 2023; 50:3459-3474. [PMID: 36906877 PMCID: PMC10272103 DOI: 10.1002/mp.16350] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 01/19/2023] [Accepted: 02/26/2023] [Indexed: 03/13/2023] Open
Abstract
BACKGROUND Approximately 500 000 patients present with critical limb ischemia (CLI) each year in the U.S., requiring revascularization to avoid amputation. While peripheral arteries can be revascularized via minimally invasive procedures, 25% of cases with chronic total occlusions are unsuccessful due to inability to route the guidewire beyond the proximal occlusion. Improvements to guidewire navigation would lead to limb salvage in a greater number of patients. PURPOSE Integrating ultrasound imaging into the guidewire could enable direct visualization of routes for guidewire advancement. In order to navigate a robotically-steerable guidewire with integrated imaging beyond a chronic occlusion proximal to the symptomatic lesion for revascularization, acquired ultrasound images must be segmented to visualize the path for guidewire advancement. METHODS The first approach for automated segmentation of viable paths through occlusions in peripheral arteries is demonstrated in simulations and experimentally-acquired data with a forward-viewing, robotically-steered guidewire imaging system. B-mode ultrasound images formed via synthetic aperture focusing (SAF) were segmented using a supervised approach (U-net architecture). A total of 2500 simulated images were used to train the classifier to distinguish the vessel wall and occlusion from viable paths for guidewire advancement. First, the size of the synthetic aperture resulting in the highest classification performance was determined in simulations (90 test images) and compared with traditional classifiers (global thresholding, local adaptive thresholding, and hierarchical classification). Next, classification performance as a function of the diameter of the remaining lumen (0.5 to 1.5 mm) in the partially-occluded artery was tested using both simulated (60 test images at each of 7 diameters) and experimental data sets. Experimental test data sets were acquired in four 3D-printed phantoms from human anatomy and six ex vivo porcine arteries. Accuracy of classifying the path through the artery was evaluated using microcomputed tomography of phantoms and ex vivo arteries as a ground truth for comparison. RESULTS An aperture size of 3.8 mm resulted in the best-performing classification based on sensitivity and Jaccard index, with a significant increase in Jaccard index (p < 0.05) as aperture diameter increased. In comparing the performance of the supervised classifier and traditional classification strategies with simulated test data, sensitivity and F1 score for U-net were 0.95 ± 0.02 and 0.96 ± 0.01, respectively, compared to 0.83 ± 0.03 and 0.41 ± 0.13 for the best-performing conventional approach, hierarchical classification. In simulated test images, sensitivity (p < 0.05) and Jaccard index both increased with increasing artery diameter (p < 0.05). Classification of images acquired in artery phantoms with remaining lumen diameters ≥ 0.75 mm resulted in accuracies > 90%, while mean accuracy decreased to 82% when artery diameter decreased to 0.5 mm. For testing in ex vivo arteries, average binary accuracy, F1 score, Jaccard index, and sensitivity each exceeded 0.9. CONCLUSIONS Segmentation of ultrasound images of partially-occluded peripheral arteries acquired with a forward-viewing, robotically-steered guidewire system was demonstrated for the first-time using representation learning. This could represent a fast, accurate approach for guiding peripheral revascularization.
Collapse
Affiliation(s)
- Graham C. Collins
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA, 30309
| | - Stephan Strassle Rojas
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA, 30309
| | - Zachary L. Bercu
- Interventional Radiology, Emory University School of Medicine, Atlanta, GA, USA, 30308
| | - Jaydev P. Desai
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA, 30309
| | - Brooks D. Lindsey
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA, 30309
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA, 30309
| |
Collapse
|
16
|
An adaptively weighted ensemble of multiple CNNs for carotid ultrasound image segmentation. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
|
17
|
Prediction of O-6-methylguanine-DNA methyltransferase and overall survival of the patients suffering from glioblastoma using MRI-based hybrid radiomics signatures in machine and deep learning framework. Neural Comput Appl 2023. [DOI: 10.1007/s00521-023-08405-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
|
18
|
Arsenescu T, Chifor R, Marita T, Santoma A, Lebovici A, Duma D, Vacaras V, Badea AF. 3D Ultrasound Reconstructions of the Carotid Artery and Thyroid Gland Using Artificial-Intelligence-Based Automatic Segmentation-Qualitative and Quantitative Evaluation of the Segmentation Results via Comparison with CT Angiography. SENSORS (BASEL, SWITZERLAND) 2023; 23:2806. [PMID: 36905009 PMCID: PMC10007177 DOI: 10.3390/s23052806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 02/27/2023] [Accepted: 02/28/2023] [Indexed: 06/18/2023]
Abstract
The aim of this study was to evaluate the feasibility of a noninvasive and low-operator-dependent imaging method for carotid-artery-stenosis diagnosis. A previously developed prototype for 3D ultrasound scans based on a standard ultrasound machine and a pose reading sensor was used for this study. Working in a 3D space and processing data using automatic segmentation lowers operator dependency. Additionally, ultrasound imaging is a noninvasive diagnosis method. Artificial intelligence (AI)-based automatic segmentation of the acquired data was performed for the reconstruction and visualization of the scanned area: the carotid artery wall, the carotid artery circulated lumen, soft plaque, and calcified plaque. A qualitative evaluation was conducted via comparing the US reconstruction results with the CT angiographies of healthy and carotid-artery-disease patients. The overall scores for the automated segmentation using the MultiResUNet model for all segmented classes in our study were 0.80 for the IoU and 0.94 for the Dice. The present study demonstrated the potential of the MultiResUNet-based model for 2D-ultrasound-image automated segmentation for atherosclerosis diagnosis purposes. Using 3D ultrasound reconstructions may help operators achieve better spatial orientation and evaluation of segmentation results.
Collapse
Affiliation(s)
- Tudor Arsenescu
- Computer Science Department, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania
- Chifor Research SRL, 400068 Cluj-Napoca, Romania
| | - Radu Chifor
- Chifor Research SRL, 400068 Cluj-Napoca, Romania
- Department of Preventive Dentistry, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400083 Cluj-Napoca, Romania
| | - Tiberiu Marita
- Computer Science Department, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania
| | - Andrei Santoma
- Computer Science Department, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania
| | - Andrei Lebovici
- Radiology, Surgical Specialties Department, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400006 Cluj-Napoca, Romania
- Radiology and Imaging Department, Cluj County Emergency Clinical Hospital, 400006 Cluj-Napoca, Romania
| | - Daniel Duma
- Radiology and Imaging Department, Cluj County Emergency Clinical Hospital, 400006 Cluj-Napoca, Romania
| | - Vitalie Vacaras
- Department of Neurosciences, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania
- Neurology Department, Cluj County Emergency Hospital, 400012 Cluj-Napoca, Romania
| | - Alexandru Florin Badea
- Anatomy and Embryology, Faculty of General Medicine, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400006 Cluj-Napoca, Romania
| |
Collapse
|
19
|
Xie J, Li Y, Xu X, Wei J, Li H, Wu S, Chen H. CPTV: Classification by tracking of carotid plaque in ultrasound videos. Comput Med Imaging Graph 2023; 104:102175. [PMID: 36630795 DOI: 10.1016/j.compmedimag.2022.102175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 11/16/2022] [Accepted: 12/27/2022] [Indexed: 12/31/2022]
Abstract
The risk assessment of carotid plaque is strongly related to the plaque echo status in ultrasound. However, the echo classification of carotid plaques based on ultrasound remains challenging due to the changes in plaque shape and semantics, along with the complex vascular environment. This study proposed a framework for Classification of Plaque by Tracking Videos (CPTV). To the best of our knowledge, this is the first study on plaque classification by tracking ultrasound video rather than a sonographic view, which achieves accurate localization and stable echo classification. In the tracking task, Multi-scale Decoupling Tracking (MDTrack) module including Multi-scale Dilated Encoder (MDE) and Internal-Exterior Feature Decoupling (IEFD) was proposed to solve the problems caused by shape and semantic variations to achieve accurate plaque localization in ultrasound. In the classification task, the Tracking-assisted 3D Attention (T3D-Attention) module included recombination and 3D-Attention extracted plaque features and echo-related features in the vascular environment. The experiments demonstrated that the performance of CPTV is better than current mainstream tracking and classification methods, indicating that the tracking-assistance classification is a kind of enhancement method with high universality and stability in the plaque in ultrasound.
Collapse
Affiliation(s)
- Jiang Xie
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China.
| | - Ying Li
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China
| | - Xiaochun Xu
- School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China
| | - Jinzhu Wei
- School of Medicine, Shanghai University, Shanghai 200444, China
| | - Haozhe Li
- College of Letters and Science, Department of Statistics and Applied Probability, University of California, Santa Barbara (UCSB), CA 93106, USA
| | - Shuo Wu
- Department of Neurology, Luodian Hospital, Baoshan District, Shanghai 201908, China
| | - Haibing Chen
- Department of Ultrasound Diagnosis, Luodian Hospital, Baoshan District, Shanghai 201908, China.
| |
Collapse
|
20
|
Chen H, Yu MA, Chen C, Zhou K, Qi S, Chen Y, Xiao R. FDE-net: Frequency-domain enhancement network using dynamic-scale dilated convolution for thyroid nodule segmentation. Comput Biol Med 2023; 153:106514. [PMID: 36628913 DOI: 10.1016/j.compbiomed.2022.106514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 12/22/2022] [Accepted: 12/31/2022] [Indexed: 01/05/2023]
Abstract
Thyroid nodules, a common disease of endocrine system, have a probability of nearly 10% to turn into malignant nodules and thus pose a serious threat to health. Automatic segmentation of thyroid nodules is of great importance for clinicopathological diagnosis. This work proposes FDE-Net, a combined segmental frequency domain enhancement and dynamic scale cavity convolutional network for thyroid nodule segmentation. In FDE-Net, traditional image omics method is introduced to enhance the feature image in the segmented frequency domain. Such an approach reduces the influence of noise and strengthens the detail and contour information of the image. The proposed method introduces a cascade cross-scale attention module, which addresses the insensitivity of the network to the change in target scale by fusing the features of different receptive fields and improves the ability of the network to identify multiscale target regions. It repeatedly uses the high-dimensional feature image to improve segmentation accuracy in accordance with the simple structure of thyroid nodules. In this study, 1355 ultrasound images are used for training and testing. Quantitative evaluation results showed that the Dice coefficient of FDE-Net in thyroid nodule segmentation was 83.54%, which is better than other methods. Therefore, FDE-Net can enable the accurate and rapid segmentation of thyroid nodules.
Collapse
Affiliation(s)
- Hongyu Chen
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Ming-An Yu
- Department of Interventional Medicine, China-Japan Friendship Hospital, Beijing, 100029, China
| | - Cheng Chen
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Kangneng Zhou
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Siyu Qi
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Yunqing Chen
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China
| | - Ruoxiu Xiao
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, China; Shunde Innovation School, University of Science and Technology Beijing, Foshan, 100024, China.
| |
Collapse
|
21
|
Zaid T, Biradar N, Sonth MV, Gowre SC, Gadgay B. FDADE: Flow direction algorithm with differential evolution for measurement of intima-media thickness of the carotid artery in ultrasound images. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104350] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
22
|
Saxena S, Jena B, Mohapatra B, Gupta N, Kalra M, Scartozzi M, Saba L, Suri JS. Fused deep learning paradigm for the prediction of o6-methylguanine-DNA methyltransferase genotype in glioblastoma patients: A neuro-oncological investigation. Comput Biol Med 2023; 153:106492. [PMID: 36621191 DOI: 10.1016/j.compbiomed.2022.106492] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 11/29/2022] [Accepted: 12/27/2022] [Indexed: 01/06/2023]
Abstract
BACKGROUND The O6-methylguanine-DNA methyltransferase (MGMT) is a deoxyribonucleic acid (DNA) repairing enzyme that has been established as an essential clinical brain tumor biomarker for Glioblastoma Multiforme (GBM). Knowing the status of MGMT methylation biomarkers using multi-parametric MRI (mp-MRI) helps neuro-oncologists to analyze GBM and its treatment plan. METHOD The hand-crafted radiomics feature extraction of GBM's subregions, such as edema(ED), tumor core (TC), and enhancing tumor (ET) in the machine learning (ML) framework, was investigated using support vector machine(SVM), K-Nearest Neighbours (KNN), random forest (RF), LightGBM, and extreme gradient boosting (XGB). For tissue-level analysis of the promotor genes in GBM, we used the deep residual neural network (ResNet-18) with 3D architecture, followed by EfficientNet-based investigation for variants as B0 and B1. Lastly, we analyzed the fused deep learning (FDL) framework that combines ML and DL frameworks. RESULT Structural mp-MRI consisting of T1, T2, FLAIR, and T1GD having a size of 400 and 185 patients, respectively, for discovery and replication cohorts. Using the CV protocol in the ResNet-3D framework, MGMT methylation status prediction in mp-MRI gave the AUC of 0.753 (p < 0.0001) and 0.72 (p < 0.0001) for the discovery and replication cohort, respectively. We presented that the FDL is ∼7% superior to solo DL and ∼15% to solo ML. CONCLUSION The proposed study aims to provide solutions for building an efficient predictive model of MGMT for GBM patients using deep radiomics features obtained from mp-MRI with the end-to-end ResNet-18 3D and FDL imaging signatures.
Collapse
Affiliation(s)
- Sanjay Saxena
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Biswajit Jena
- Department of Computer Science & Engineering, Institute of Technical Education and Research, SOA Deemed to be University, Bhubaneswar, India
| | - Bibhabasu Mohapatra
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Neha Gupta
- Bharati Vidyapeeth's College of Engineering, Paschim Vihar, New Delhi, India
| | - Manudeep Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, 02114, USA
| | - Mario Scartozzi
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Luca Saba
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™ LLC, Roseville, CA, USA; Knowledge Engineering Centre, Global Biomedical Technologies, Inc, Roseville, CA, USA.
| |
Collapse
|
23
|
Ikromjanov K, Bhattacharjee S, Sumon RI, Hwang YB, Rahman H, Lee MJ, Kim HC, Park E, Cho NH, Choi HK. Region Segmentation of Whole-Slide Images for Analyzing Histological Differentiation of Prostate Adenocarcinoma Using Ensemble EfficientNetB2 U-Net with Transfer Learning Mechanism. Cancers (Basel) 2023; 15:cancers15030762. [PMID: 36765719 PMCID: PMC9913745 DOI: 10.3390/cancers15030762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Revised: 01/18/2023] [Accepted: 01/23/2023] [Indexed: 01/28/2023] Open
Abstract
Recent advances in computer-aided detection via deep learning (DL) now allow for prostate cancer to be detected automatically and recognized with extremely high accuracy, much like other medical diagnoses and prognoses. However, researchers are still limited by the Gleason scoring system. The histopathological analysis involved in assigning the appropriate score is a rigorous, time-consuming manual process that is constrained by the quality of the material and the pathologist's level of expertise. In this research, we implemented a DL model using transfer learning on a set of histopathological images to segment cancerous and noncancerous areas in whole-slide images (WSIs). In this approach, the proposed Ensemble U-net model was applied for the segmentation of stroma, cancerous, and benign areas. The WSI dataset of prostate cancer was collected from the Kaggle repository, which is publicly available online. A total of 1000 WSIs were used for region segmentation. From this, 8100 patch images were used for training, and 900 for testing. The proposed model demonstrated an average dice coefficient (DC), intersection over union (IoU), and Hausdorff distance of 0.891, 0.811, and 15.9, respectively, on the test set, with corresponding masks of patch images. The manipulation of the proposed segmentation model improves the ability of the pathologist to predict disease outcomes, thus enhancing treatment efficacy by isolating the cancerous regions in WSIs.
Collapse
Affiliation(s)
- Kobiljon Ikromjanov
- Department of Digital Anti-Aging Healthcare, u-AHRC, Inje University, Gimhae 50834, Republic of Korea
| | - Subrata Bhattacharjee
- Department of Computer Engineering, u-AHRC, Inje University, Gimhae 50834, Republic of Korea
| | - Rashadul Islam Sumon
- Department of Digital Anti-Aging Healthcare, u-AHRC, Inje University, Gimhae 50834, Republic of Korea
| | - Yeong-Byn Hwang
- Department of Digital Anti-Aging Healthcare, u-AHRC, Inje University, Gimhae 50834, Republic of Korea
| | - Hafizur Rahman
- Department of Digital Anti-Aging Healthcare, u-AHRC, Inje University, Gimhae 50834, Republic of Korea
| | - Myung-Jae Lee
- JLK Artificial Intelligence R&D Center, Seoul 06141, Republic of Korea
| | - Hee-Cheol Kim
- Department of Digital Anti-Aging Healthcare, u-AHRC, Inje University, Gimhae 50834, Republic of Korea
| | - Eunhyang Park
- Department of Pathology, Yonsei University College of Medicine, Seoul 03722, Republic of Korea
| | - Nam-Hoon Cho
- Department of Pathology, Yonsei University College of Medicine, Seoul 03722, Republic of Korea
| | - Heung-Kook Choi
- Department of Computer Engineering, u-AHRC, Inje University, Gimhae 50834, Republic of Korea
- JLK Artificial Intelligence R&D Center, Seoul 06141, Republic of Korea
- Correspondence: ; Tel.: +82-10-6733-3437
| |
Collapse
|
24
|
Economics of Artificial Intelligence in Healthcare: Diagnosis vs. Treatment. Healthcare (Basel) 2022; 10:healthcare10122493. [PMID: 36554017 PMCID: PMC9777836 DOI: 10.3390/healthcare10122493] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 12/03/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022] Open
Abstract
Motivation: The price of medical treatment continues to rise due to (i) an increasing population; (ii) an aging human growth; (iii) disease prevalence; (iv) a rise in the frequency of patients that utilize health care services; and (v) increase in the price. Objective: Artificial Intelligence (AI) is already well-known for its superiority in various healthcare applications, including the segmentation of lesions in images, speech recognition, smartphone personal assistants, navigation, ride-sharing apps, and many more. Our study is based on two hypotheses: (i) AI offers more economic solutions compared to conventional methods; (ii) AI treatment offers stronger economics compared to AI diagnosis. This novel study aims to evaluate AI technology in the context of healthcare costs, namely in the areas of diagnosis and treatment, and then compare it to the traditional or non-AI-based approaches. Methodology: PRISMA was used to select the best 200 studies for AI in healthcare with a primary focus on cost reduction, especially towards diagnosis and treatment. We defined the diagnosis and treatment architectures, investigated their characteristics, and categorized the roles that AI plays in the diagnostic and therapeutic paradigms. We experimented with various combinations of different assumptions by integrating AI and then comparing it against conventional costs. Lastly, we dwell on three powerful future concepts of AI, namely, pruning, bias, explainability, and regulatory approvals of AI systems. Conclusions: The model shows tremendous cost savings using AI tools in diagnosis and treatment. The economics of AI can be improved by incorporating pruning, reduction in AI bias, explainability, and regulatory approvals.
Collapse
|
25
|
Cardiovascular/Stroke Risk Stratification in Diabetic Foot Infection Patients Using Deep Learning-Based Artificial Intelligence: An Investigative Study. J Clin Med 2022; 11:jcm11226844. [PMID: 36431321 PMCID: PMC9693632 DOI: 10.3390/jcm11226844] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 11/15/2022] [Accepted: 11/16/2022] [Indexed: 11/22/2022] Open
Abstract
A diabetic foot infection (DFI) is among the most serious, incurable, and costly to treat conditions. The presence of a DFI renders machine learning (ML) systems extremely nonlinear, posing difficulties in CVD/stroke risk stratification. In addition, there is a limited number of well-explained ML paradigms due to comorbidity, sample size limits, and weak scientific and clinical validation methodologies. Deep neural networks (DNN) are potent machines for learning that generalize nonlinear situations. The objective of this article is to propose a novel investigation of deep learning (DL) solutions for predicting CVD/stroke risk in DFI patients. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) search strategy was used for the selection of 207 studies. We hypothesize that a DFI is responsible for increased morbidity and mortality due to the worsening of atherosclerotic disease and affecting coronary artery disease (CAD). Since surrogate biomarkers for CAD, such as carotid artery disease, can be used for monitoring CVD, we can thus use a DL-based model, namely, Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) for CVD/stroke risk prediction in DFI patients, which combines covariates such as office and laboratory-based biomarkers, carotid ultrasound image phenotype (CUSIP) lesions, along with the DFI severity. We confirmed the viability of CVD/stroke risk stratification in the DFI patients. Strong designs were found in the research of the DL architectures for CVD/stroke risk stratification. Finally, we analyzed the AI bias and proposed strategies for the early diagnosis of CVD/stroke in DFI patients. Since DFI patients have an aggressive atherosclerotic disease, leading to prominent CVD/stroke risk, we, therefore, conclude that the DL paradigm is very effective for predicting the risk of CVD/stroke in DFI patients.
Collapse
|
26
|
Yuan Y, Li C, Zhang K, Hua Y, Zhang J. HRU-Net: A Transfer Learning Method for Carotid Artery Plaque Segmentation in Ultrasound Images. Diagnostics (Basel) 2022; 12:diagnostics12112852. [PMID: 36428911 PMCID: PMC9689104 DOI: 10.3390/diagnostics12112852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 11/09/2022] [Accepted: 11/13/2022] [Indexed: 11/19/2022] Open
Abstract
Carotid artery stenotic plaque segmentation in ultrasound images is a crucial means for the analysis of plaque components and vulnerability. However, segmentation of severe stenotic plaques remains a challenging task because of the heterogeneities of inter-plaques and intra-plaques, and obscure boundaries of plaques. In this paper, we propose an automated HRU-Net transfer learning method for segmenting carotid plaques, using the limited images. The HRU-Net is based on the U-Net encoder−decoder paradigm, and cross-domain knowledge is transferred for plaque segmentation by fine-tuning the pretrained ResNet-50. Moreover, a cropped-blood-vessel image augmentation is customized for the plaque position constraint during training only. Moreover, hybrid atrous convolutions (HACs) are designed to derive diverse long-range dependences for refined plaque segmentation that are used on high-level semantic layers to exploit the implicit discrimination features. The experiments are performed on 115 images; Firstly, the 10-fold cross-validation, using 40 images with severe stenosis plaques, shows that the proposed method outperforms some of the state-of-the-art CNN-based methods on Dice, IoU, Acc, and modified Hausdorff distance (MHD) metrics; the improvements on metrics of Dice and MHD are statistically significant (p < 0.05). Furthermore, our HRU-Net transfer learning method shows fine generalization performance on 75 new images with varying degrees of plaque stenosis, and it may be used as an alternative for automatic noisy plaque segmentation in carotid ultrasound images clinically.
Collapse
Affiliation(s)
- Yanchao Yuan
- School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
- National Engineering Research Center of Telemedicine and Telehealth, Xuanwu Hospital, Capital Medical University, Beijing 100053, China
- Hefei Innovation Research Institute, Beihang University, Hefei 230012, China
| | - Cancheng Li
- School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
- Hefei Innovation Research Institute, Beihang University, Hefei 230012, China
| | - Ke Zhang
- Department of Vascular Ultrasonography, Xuanwu Hospital, Capital Medical University, Beijing 100053, China
| | - Yang Hua
- Department of Vascular Ultrasonography, Xuanwu Hospital, Capital Medical University, Beijing 100053, China
- Beijing Diagnostic Center of Vascular Ultrasound, Beijing 100053, China
- Center of Vascular Ultrasonography, Beijing Institute of Brain Disorders, Collaborative Innovation Center for Brain Disorders, Capital Medical University, Beijing 100069, China
- Correspondence: (Y.H.); (J.Z.)
| | - Jicong Zhang
- School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
- Hefei Innovation Research Institute, Beihang University, Hefei 230012, China
- Correspondence: (Y.H.); (J.Z.)
| |
Collapse
|
27
|
Johri AM, Singh KV, Mantella LE, Saba L, Sharma A, Laird JR, Utkarsh K, Singh IM, Gupta S, Kalra MS, Suri JS. Deep learning artificial intelligence framework for multiclass coronary artery disease prediction using combination of conventional risk factors, carotid ultrasound, and intraplaque neovascularization. Comput Biol Med 2022; 150:106018. [PMID: 36174330 DOI: 10.1016/j.compbiomed.2022.106018] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 08/06/2022] [Accepted: 08/20/2022] [Indexed: 11/23/2022]
Abstract
OBJECTIVE Cardiovascular disease (CVD) is a major healthcare challenge and therefore early risk assessment is vital. Previous assessment techniques use either "conventional CVD risk calculators (CCVRC)" or machine learning (ML) paradigms. These techniques are ad-hoc, unreliable, not fully automated, and have variabilities. We, therefore, introduce AtheroEdge-MCDLAI (AE3.0DL) windows-based platform using multiclass Deep Learning (DL) system. METHODS Data was collected on 500 patients having both carotid ultrasound and corresponding coronary angiography scores (CAS), measured as stenosis in coronary arteries and considered as the gold standard. A total of 39 covariates were used, clubbed into three clusters, namely (i) Office-based: age, gender, body mass index, smoker, hypertension, systolic blood pressure, and diastolic blood pressure; (ii) Laboratory-based: Hyperlipidemia, hemoglobin A1c, and estimated glomerular filtration rate; and (iii) Carotid ultrasound image phenotypes: maximum plaque height, total plaque area, and intra-plaque neovascularization. Baseline characteristics for four classes (target labels) having significant (p < 0.0001) values were calculated using Chi-square and ANOVA. For handling the cohort's imbalance in the risk classes, AE3.0DL used the synthetic minority over-sampling technique (SMOTE). AE3.0DL used Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) DL models and the performance (accuracy and area-under-the-curve) was computed using 10-fold cross-validation (90% training, 10% testing) frameworks. AE3.0DL was validated and benchmarked. RESULTS The AE3.0DL using RNN and LSTM showed an accuracy and AUC (p < 0.0001) pairs as (95.00% and 0.98), and (95.34% and 0.99), respectively, and showed an improvement of 32.93% and 9.94% against CCVRC and ML, respectively. AE3.0DL runs in <1 s. CONCLUSION DL algorithms are a powerful paradigm for coronary artery disease (CAD) risk prediction and CVD risk stratification.
Collapse
Affiliation(s)
- Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, ON, Canada
| | | | - Laura E Mantella
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | | | | | - Suneet Gupta
- Department of Computer Science, Bennett University, Gr. Noida, India
| | - Manudeep S Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA, 02114, USA
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA; Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA, USA.
| |
Collapse
|
28
|
Far wall plaque segmentation and area measurement in common and internal carotid artery ultrasound using U-series architectures: An unseen Artificial Intelligence paradigm for stroke risk assessment. Comput Biol Med 2022; 149:106017. [DOI: 10.1016/j.compbiomed.2022.106017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 08/10/2022] [Accepted: 08/20/2022] [Indexed: 12/18/2022]
|
29
|
Attention-Based UNet Deep Learning Model for Plaque Segmentation in Carotid Ultrasound for Stroke Risk Stratification: An Artificial Intelligence Paradigm. J Cardiovasc Dev Dis 2022; 9:jcdd9100326. [PMID: 36286278 PMCID: PMC9604424 DOI: 10.3390/jcdd9100326] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2022] [Revised: 09/06/2022] [Accepted: 09/14/2022] [Indexed: 11/17/2022] Open
Abstract
Stroke and cardiovascular diseases (CVD) significantly affect the world population. The early detection of such events may prevent the burden of death and costly surgery. Conventional methods are neither automated nor clinically accurate. Artificial Intelligence-based methods of automatically detecting and predicting the severity of CVD and stroke in their early stages are of prime importance. This study proposes an attention-channel-based UNet deep learning (DL) model that identifies the carotid plaques in the internal carotid artery (ICA) and common carotid artery (CCA) images. Our experiments consist of 970 ICA images from the UK, 379 CCA images from diabetic Japanese patients, and 300 CCA images from post-menopausal women from Hong Kong. We combined both CCA images to form an integrated database of 679 images. A rotation transformation technique was applied to 679 CCA images, doubling the database for the experiments. The cross-validation K5 (80% training: 20% testing) protocol was applied for accuracy determination. The results of the Attention-UNet model are benchmarked against UNet, UNet++, and UNet3P models. Visual plaque segmentation showed improvement in the Attention-UNet results compared to the other three models. The correlation coefficient (CC) value for Attention-UNet is 0.96, compared to 0.93, 0.96, and 0.92 for UNet, UNet++, and UNet3P models. Similarly, the AUC value for Attention-UNet is 0.97, compared to 0.964, 0.966, and 0.965 for other models. Conclusively, the Attention-UNet model is beneficial in segmenting very bright and fuzzy plaque images that are hard to diagnose using other methods. Further, we present a multi-ethnic, multi-center, racial bias-free study of stroke risk assessment.
Collapse
|
30
|
Segmentation-Based Classification Deep Learning Model Embedded with Explainable AI for COVID-19 Detection in Chest X-ray Scans. Diagnostics (Basel) 2022; 12:diagnostics12092132. [PMID: 36140533 PMCID: PMC9497601 DOI: 10.3390/diagnostics12092132] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 08/26/2022] [Accepted: 08/30/2022] [Indexed: 12/16/2022] Open
Abstract
Background and Motivation: COVID-19 has resulted in a massive loss of life during the last two years. The current imaging-based diagnostic methods for COVID-19 detection in multiclass pneumonia-type chest X-rays are not so successful in clinical practice due to high error rates. Our hypothesis states that if we can have a segmentation-based classification error rate <5%, typically adopted for 510 (K) regulatory purposes, the diagnostic system can be adapted in clinical settings. Method: This study proposes 16 types of segmentation-based classification deep learning-based systems for automatic, rapid, and precise detection of COVID-19. The two deep learning-based segmentation networks, namely UNet and UNet+, along with eight classification models, namely VGG16, VGG19, Xception, InceptionV3, Densenet201, NASNetMobile, Resnet50, and MobileNet, were applied to select the best-suited combination of networks. Using the cross-entropy loss function, the system performance was evaluated by Dice, Jaccard, area-under-the-curve (AUC), and receiver operating characteristics (ROC) and validated using Grad-CAM in explainable AI framework. Results: The best performing segmentation model was UNet, which exhibited the accuracy, loss, Dice, Jaccard, and AUC of 96.35%, 0.15%, 94.88%, 90.38%, and 0.99 (p-value <0.0001), respectively. The best performing segmentation-based classification model was UNet+Xception, which exhibited the accuracy, precision, recall, F1-score, and AUC of 97.45%, 97.46%, 97.45%, 97.43%, and 0.998 (p-value <0.0001), respectively. Our system outperformed existing methods for segmentation-based classification models. The mean improvement of the UNet+Xception system over all the remaining studies was 8.27%. Conclusion: The segmentation-based classification is a viable option as the hypothesis (error rate <5%) holds true and is thus adaptable in clinical practice.
Collapse
|
31
|
Zhu C, Wang X, Chen S, Teng Z, Bai C, Huang X, Xia M, Shao Z, Gu Z, Sun P. Complex carotid artery segmentation in multi-contrast MR sequences by improved optimal surface graph cuts based on flow line learning. Med Biol Eng Comput 2022; 60:2693-2706. [DOI: 10.1007/s11517-022-02622-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 04/28/2022] [Indexed: 11/30/2022]
|
32
|
Suri JS, Agarwal S, Saba L, Chabert GL, Carriero A, Paschè A, Danna P, Mehmedović A, Faa G, Jujaray T, Singh IM, Khanna NN, Laird JR, Sfikakis PP, Agarwal V, Teji JS, R Yadav R, Nagy F, Kincses ZT, Ruzsa Z, Viskovic K, Kalra MK. Multicenter Study on COVID-19 Lung Computed Tomography Segmentation with varying Glass Ground Opacities using Unseen Deep Learning Artificial Intelligence Paradigms: COVLIAS 1.0 Validation. J Med Syst 2022; 46:62. [PMID: 35988110 PMCID: PMC9392994 DOI: 10.1007/s10916-022-01850-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 08/02/2022] [Indexed: 11/09/2022]
Abstract
Variations in COVID-19 lesions such as glass ground opacities (GGO), consolidations, and crazy paving can compromise the ability of solo-deep learning (SDL) or hybrid-deep learning (HDL) artificial intelligence (AI) models in predicting automated COVID-19 lung segmentation in Computed Tomography (CT) from unseen data leading to poor clinical manifestations. As the first study of its kind, “COVLIAS 1.0-Unseen” proves two hypotheses, (i) contrast adjustment is vital for AI, and (ii) HDL is superior to SDL. In a multicenter study, 10,000 CT slices were collected from 72 Italian (ITA) patients with low-GGO, and 80 Croatian (CRO) patients with high-GGO. Hounsfield Units (HU) were automatically adjusted to train the AI models and predict from test data, leading to four combinations—two Unseen sets: (i) train-CRO:test-ITA, (ii) train-ITA:test-CRO, and two Seen sets: (iii) train-CRO:test-CRO, (iv) train-ITA:test-ITA. COVILAS used three SDL models: PSPNet, SegNet, UNet and six HDL models: VGG-PSPNet, VGG-SegNet, VGG-UNet, ResNet-PSPNet, ResNet-SegNet, and ResNet-UNet. Two trained, blinded senior radiologists conducted ground truth annotations. Five types of performance metrics were used to validate COVLIAS 1.0-Unseen which was further benchmarked against MedSeg, an open-source web-based system. After HU adjustment for DS and JI, HDL (Unseen AI) > SDL (Unseen AI) by 4% and 5%, respectively. For CC, HDL (Unseen AI) > SDL (Unseen AI) by 6%. The COVLIAS-MedSeg difference was < 5%, meeting regulatory guidelines.Unseen AI was successfully demonstrated using automated HU adjustment. HDL was found to be superior to SDL.
Collapse
|
33
|
Khanna NN, Maindarkar M, Puvvula A, Paul S, Bhagawati M, Ahluwalia P, Ruzsa Z, Sharma A, Munjral S, Kolluri R, Krishnan PR, Singh IM, Laird JR, Fatemi M, Alizad A, Dhanjil SK, Saba L, Balestrieri A, Faa G, Paraskevas KI, Misra DP, Agarwal V, Sharma A, Teji J, Al-Maini M, Nicolaides A, Rathore V, Naidu S, Liblik K, Johri AM, Turk M, Sobel DW, Pareek G, Miner M, Viskovic K, Tsoulfas G, Protogerou AD, Mavrogeni S, Kitas GD, Fouda MM, Kalra MK, Suri JS. Vascular Implications of COVID-19: Role of Radiological Imaging, Artificial Intelligence, and Tissue Characterization: A Special Report. J Cardiovasc Dev Dis 2022; 9:jcdd9080268. [PMID: 36005433 PMCID: PMC9409845 DOI: 10.3390/jcdd9080268] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Revised: 07/30/2022] [Accepted: 08/09/2022] [Indexed: 12/15/2022] Open
Abstract
The SARS-CoV-2 virus has caused a pandemic, infecting nearly 80 million people worldwide, with mortality exceeding six million. The average survival span is just 14 days from the time the symptoms become aggressive. The present study delineates the deep-driven vascular damage in the pulmonary, renal, coronary, and carotid vessels due to SARS-CoV-2. This special report addresses an important gap in the literature in understanding (i) the pathophysiology of vascular damage and the role of medical imaging in the visualization of the damage caused by SARS-CoV-2, and (ii) further understanding the severity of COVID-19 using artificial intelligence (AI)-based tissue characterization (TC). PRISMA was used to select 296 studies for AI-based TC. Radiological imaging techniques such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound were selected for imaging of the vasculature infected by COVID-19. Four kinds of hypotheses are presented for showing the vascular damage in radiological images due to COVID-19. Three kinds of AI models, namely, machine learning, deep learning, and transfer learning, are used for TC. Further, the study presents recommendations for improving AI-based architectures for vascular studies. We conclude that the process of vascular damage due to COVID-19 has similarities across vessel types, even though it results in multi-organ dysfunction. Although the mortality rate is ~2% of those infected, the long-term effect of COVID-19 needs monitoring to avoid deaths. AI seems to be penetrating the health care industry at warp speed, and we expect to see an emerging role in patient care, reduce the mortality and morbidity rate.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India
| | - Mahesh Maindarkar
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Annu’s Hospitals for Skin and Diabetes, Nellore 524101, India
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Mrinalini Bhagawati
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India
| | - Zoltan Ruzsa
- Invasive Cardiology Division, Faculty of Medicine, University of Szeged, 6720 Szeged, Hungary
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22904, USA
| | - Smiksha Munjral
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Raghu Kolluri
- Ohio Health Heart and Vascular, Columbus, OH 43214, USA
| | | | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - Surinder K. Dhanjil
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138 Cagliari, Italy
| | - Antonella Balestrieri
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria, 09124 Cagliari, Italy
| | | | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India
| | - Aman Sharma
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India
| | - Jagjit Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, 2408 Nicosia, Cyprus
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA 95119, USA
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA
| | - Kiera Liblik
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany
| | - David W. Sobel
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece
| | - Athanasios D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 17674 Athens, Greece
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Manudeep K. Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
- Correspondence: ; Tel.: +1-916-749-5628
| |
Collapse
|
34
|
Li B, Wu F, Liu S, Tang J, Li G, Zhong M, Guan X. CA‐Unet++: An improved structure for medical CT scanning based on the Unet++ Architecture. INT J INTELL SYST 2022. [DOI: 10.1002/int.22969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Bo Li
- School of Information Engineering East China Jiaotong University Nanchang China
- School of Electronic Information Engineering Shanghai DianJi University Shanghai China
| | - Fei Wu
- School of Information Engineering East China Jiaotong University Nanchang China
| | - Sikai Liu
- School of Information Engineering East China Jiaotong University Nanchang China
| | - Jinhong Tang
- School of Information Engineering East China Jiaotong University Nanchang China
| | - GuangHui Li
- School of Information Engineering East China Jiaotong University Nanchang China
| | - Meiling Zhong
- School of Materials Science and Engineering East China Jiaotong University Nanchang China
| | - Xiaohui Guan
- The National Engineering Research Center for Bioengineering Drugs and the Technologies Nanchang University Nanchang China
| |
Collapse
|
35
|
Skandha SS, Agarwal M, Utkarsh K, Gupta SK, Koppula VK, Suri JS. A novel genetic algorithm-based approach for compression and acceleration of deep learning convolution neural network: an application in computer tomography lung cancer data. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07567-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
36
|
Agarwal M, Agarwal S, Saba L, Chabert GL, Gupta S, Carriero A, Pasche A, Danna P, Mehmedovic A, Faa G, Shrivastava S, Jain K, Jain H, Jujaray T, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Sobel DW, Miner M, Balestrieri A, Sfikakis PP, Tsoulfas G, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Yadav RR, Nagy F, Kincses ZT, Ruzsa Z, Naidu S, Viskovic K, Kalra MK, Suri JS. Eight pruning deep learning models for low storage and high-speed COVID-19 computed tomography lung segmentation and heatmap-based lesion localization: A multicenter study using COVLIAS 2.0. Comput Biol Med 2022; 146:105571. [PMID: 35751196 PMCID: PMC9123805 DOI: 10.1016/j.compbiomed.2022.105571] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 04/05/2022] [Accepted: 04/26/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND COVLIAS 1.0: an automated lung segmentation was designed for COVID-19 diagnosis. It has issues related to storage space and speed. This study shows that COVLIAS 2.0 uses pruned AI (PAI) networks for improving both storage and speed, wiliest high performance on lung segmentation and lesion localization. METHOD ology: The proposed study uses multicenter ∼9,000 CT slices from two different nations, namely, CroMed from Croatia (80 patients, experimental data), and NovMed from Italy (72 patients, validation data). We hypothesize that by using pruning and evolutionary optimization algorithms, the size of the AI models can be reduced significantly, ensuring optimal performance. Eight different pruning techniques (i) differential evolution (DE), (ii) genetic algorithm (GA), (iii) particle swarm optimization algorithm (PSO), and (iv) whale optimization algorithm (WO) in two deep learning frameworks (i) Fully connected network (FCN) and (ii) SegNet were designed. COVLIAS 2.0 was validated using "Unseen NovMed" and benchmarked against MedSeg. Statistical tests for stability and reliability were also conducted. RESULTS Pruning algorithms (i) FCN-DE, (ii) FCN-GA, (iii) FCN-PSO, and (iv) FCN-WO showed improvement in storage by 92.4%, 95.3%, 98.7%, and 99.8% respectively when compared against solo FCN, and (v) SegNet-DE, (vi) SegNet-GA, (vii) SegNet-PSO, and (viii) SegNet-WO showed improvement by 97.1%, 97.9%, 98.8%, and 99.2% respectively when compared against solo SegNet. AUC > 0.94 (p < 0.0001) on CroMed and > 0.86 (p < 0.0001) on NovMed data set for all eight EA model. PAI <0.25 s per image. DenseNet-121-based Grad-CAM heatmaps showed validation on glass ground opacity lesions. CONCLUSIONS Eight PAI networks that were successfully validated are five times faster, storage efficient, and could be used in clinical settings.
Collapse
Affiliation(s)
- Mohit Agarwal
- Department of Computer Science Engineering, Bennett University, India
| | - Sushant Agarwal
- Department of Computer Science Engineering, PSIT, Kanpur, India; Advanced Knowledge Engineering Centre, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Gian Luca Chabert
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Suneet Gupta
- Department of Computer Science Engineering, Bennett University, India
| | - Alessandro Carriero
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Alessio Pasche
- Depart of Radiology, "Maggiore della Carità" Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100, Novara, Italy
| | - Pietro Danna
- Depart of Radiology, "Maggiore della Carità" Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100, Novara, Italy
| | | | - Gavino Faa
- Department of Pathology - AOU of Cagliari, Italy
| | - Saurabh Shrivastava
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Kanishka Jain
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Harsh Jain
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India
| | - Tanay Jujaray
- Dept of Molecular, Cell and Developmental Biology, University of California, Santa Cruz, CA, USA
| | | | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | - Amer M Johri
- Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - David W Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), Cagliari, Italy
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - George Tsoulfas
- Aristoteleion University of Thessaloniki, Thessaloniki, Greece
| | | | | | - George D Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK; Arthritis Research UK Epidemiology Unit, Manchester University, Manchester, UK
| | - Jagjit S Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, USA
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, Canada
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and Univ. of Nicosia Medical School, Cyprus
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, USA
| | | | - Mostafa Fatemi
- Dept. of Physiology & Biomedical Engg., Mayo Clinic College of Medicine and Science, MN, USA
| | - Azra Alizad
- Dept. of Radiology, Mayo Clinic College of Medicine and Science, MN, USA
| | | | | | - Frence Nagy
- Department of Radiology, University of Szeged, 6725, Hungary
| | | | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, Budapest, Hungary
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN, USA
| | | | - Manudeep K Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Jasjit S Suri
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad, 244001, India; Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, USA.
| |
Collapse
|
37
|
Deep Learning Paradigm for Cardiovascular Disease/Stroke Risk Stratification in Parkinson’s Disease Affected by COVID-19: A Narrative Review. Diagnostics (Basel) 2022; 12:diagnostics12071543. [PMID: 35885449 PMCID: PMC9324237 DOI: 10.3390/diagnostics12071543] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2022] [Revised: 06/14/2022] [Accepted: 06/16/2022] [Indexed: 11/16/2022] Open
Abstract
Background and Motivation: Parkinson’s disease (PD) is one of the most serious, non-curable, and expensive to treat. Recently, machine learning (ML) has shown to be able to predict cardiovascular/stroke risk in PD patients. The presence of COVID-19 causes the ML systems to become severely non-linear and poses challenges in cardiovascular/stroke risk stratification. Further, due to comorbidity, sample size constraints, and poor scientific and clinical validation techniques, there have been no well-explained ML paradigms. Deep neural networks are powerful learning machines that generalize non-linear conditions. This study presents a novel investigation of deep learning (DL) solutions for CVD/stroke risk prediction in PD patients affected by the COVID-19 framework. Method: The PRISMA search strategy was used for the selection of 292 studies closely associated with the effect of PD on CVD risk in the COVID-19 framework. We study the hypothesis that PD in the presence of COVID-19 can cause more harm to the heart and brain than in non-COVID-19 conditions. COVID-19 lung damage severity can be used as a covariate during DL training model designs. We, therefore, propose a DL model for the estimation of, (i) COVID-19 lesions in computed tomography (CT) scans and (ii) combining the covariates of PD, COVID-19 lesions, office and laboratory arterial atherosclerotic image-based biomarkers, and medicine usage for the PD patients for the design of DL point-based models for CVD/stroke risk stratification. Results: We validated the feasibility of CVD/stroke risk stratification in PD patients in the presence of a COVID-19 environment and this was also verified. DL architectures like long short-term memory (LSTM), and recurrent neural network (RNN) were studied for CVD/stroke risk stratification showing powerful designs. Lastly, we examined the artificial intelligence bias and provided recommendations for early detection of CVD/stroke in PD patients in the presence of COVID-19. Conclusion: The DL is a very powerful tool for predicting CVD/stroke risk in PD patients affected by COVID-19.
Collapse
|
38
|
COVLIAS 2.0-cXAI: Cloud-Based Explainable Deep Learning System for COVID-19 Lesion Localization in Computed Tomography Scans. Diagnostics (Basel) 2022; 12:diagnostics12061482. [PMID: 35741292 PMCID: PMC9221733 DOI: 10.3390/diagnostics12061482] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 06/07/2022] [Accepted: 06/13/2022] [Indexed: 02/07/2023] Open
Abstract
Background: The previous COVID-19 lung diagnosis system lacks both scientific validation and the role of explainable artificial intelligence (AI) for understanding lesion localization. This study presents a cloud-based explainable AI, the “COVLIAS 2.0-cXAI” system using four kinds of class activation maps (CAM) models. Methodology: Our cohort consisted of ~6000 CT slices from two sources (Croatia, 80 COVID-19 patients and Italy, 15 control patients). COVLIAS 2.0-cXAI design consisted of three stages: (i) automated lung segmentation using hybrid deep learning ResNet-UNet model by automatic adjustment of Hounsfield units, hyperparameter optimization, and parallel and distributed training, (ii) classification using three kinds of DenseNet (DN) models (DN-121, DN-169, DN-201), and (iii) validation using four kinds of CAM visualization techniques: gradient-weighted class activation mapping (Grad-CAM), Grad-CAM++, score-weighted CAM (Score-CAM), and FasterScore-CAM. The COVLIAS 2.0-cXAI was validated by three trained senior radiologists for its stability and reliability. The Friedman test was also performed on the scores of the three radiologists. Results: The ResNet-UNet segmentation model resulted in dice similarity of 0.96, Jaccard index of 0.93, a correlation coefficient of 0.99, with a figure-of-merit of 95.99%, while the classifier accuracies for the three DN nets (DN-121, DN-169, and DN-201) were 98%, 98%, and 99% with a loss of ~0.003, ~0.0025, and ~0.002 using 50 epochs, respectively. The mean AUC for all three DN models was 0.99 (p < 0.0001). The COVLIAS 2.0-cXAI showed 80% scans for mean alignment index (MAI) between heatmaps and gold standard, a score of four out of five, establishing the system for clinical settings. Conclusions: The COVLIAS 2.0-cXAI successfully showed a cloud-based explainable AI system for lesion localization in lung CT scans.
Collapse
|
39
|
Saba L, Antignani PL, Gupta A, Cau R, Paraskevas KI, Poredos P, Wasserman B, Kamel H, Avgerinos ED, Salgado R, Caobelli F, Aluigi L, Savastano L, Brown M, Hatsukami T, Hussein E, Suri JS, Mansilha A, Wintermark M, Staub D, Montequin JF, Rodriguez RTT, Balu N, Pitha J, Kooi ME, Lal BK, Spence JD, Lanzino G, Marcus HS, Mancini M, Chaturvedi S, Blinc A. International Union of Angiology (IUA) consensus paper on imaging strategies in atherosclerotic carotid artery imaging: From basic strategies to advanced approaches. Atherosclerosis 2022; 354:23-40. [DOI: 10.1016/j.atherosclerosis.2022.06.1014] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 06/10/2022] [Accepted: 06/14/2022] [Indexed: 12/24/2022]
|
40
|
Li Y, Zhao H, Gan T, Liu Y, Zou L, Xu T, Chen X, Fan C, Wu M. Automated Multi-View Multi-Modal Assessment of COVID-19 Patients Using Reciprocal Attention and Biomedical Transform. Front Public Health 2022; 10:886958. [PMID: 35692335 PMCID: PMC9174692 DOI: 10.3389/fpubh.2022.886958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 04/20/2022] [Indexed: 11/13/2022] Open
Abstract
Automated severity assessment of coronavirus disease 2019 (COVID-19) patients can help rationally allocate medical resources and improve patients' survival rates. The existing methods conduct severity assessment tasks mainly on a unitary modal and single view, which is appropriate to exclude potential interactive information. To tackle the problem, in this paper, we propose a multi-view multi-modal model to automatically assess the severity of COVID-19 patients based on deep learning. The proposed model receives multi-view ultrasound images and biomedical indices of patients and generates comprehensive features for assessment tasks. Also, we propose a reciprocal attention module to acquire the underlying interactions between multi-view ultrasound data. Moreover, we propose biomedical transform module to integrate biomedical data with ultrasound data to produce multi-modal features. The proposed model is trained and tested on compound datasets, and it yields 92.75% for accuracy and 80.95% for recall, which is the best performance compared to other state-of-the-art methods. Further ablation experiments and discussions conformably indicate the feasibility and advancement of the proposed model.
Collapse
Affiliation(s)
- Yanhan Li
- Electronic Information School, Wuhan University, Wuhan, China
| | - Hongyun Zhao
- Department of Gastroenterology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
- Chongqing Key Laboratory of Ultrasound Molecular Imaging, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Tian Gan
- Department of Ultrasound, Zhongnan Hospital of Wuhan University, Wuhan, China
| | - Yang Liu
- School of Economics and Management, Wuhan University, Wuhan, China
| | - Lian Zou
- Electronic Information School, Wuhan University, Wuhan, China
| | - Ting Xu
- Department of Ultrasound, Zhongnan Hospital of Wuhan University, Wuhan, China
| | - Xuan Chen
- Beijing Genomics Institute (BGI) Research, Shenzhen, China
| | - Cien Fan
- Electronic Information School, Wuhan University, Wuhan, China
- *Correspondence: Cien Fan
| | - Meng Wu
- Department of Ultrasound, Zhongnan Hospital of Wuhan University, Wuhan, China
- Meng Wu
| |
Collapse
|
41
|
Suri JS, Agarwal S, Chabert GL, Carriero A, Paschè A, Danna PSC, Saba L, Mehmedović A, Faa G, Singh IM, Turk M, Chadha PS, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sobel DW, Balestrieri A, Sfikakis PP, Tsoulfas G, Protogerou AD, Misra DP, Agarwal V, Kitas GD, Teji JS, Al-Maini M, Dhanjil SK, Nicolaides A, Sharma A, Rathore V, Fatemi M, Alizad A, Krishnan PR, Nagy F, Ruzsa Z, Fouda MM, Naidu S, Viskovic K, Kalra MK. COVLIAS 1.0 Lesion vs. MedSeg: An Artificial Intelligence Framework for Automated Lesion Segmentation in COVID-19 Lung Computed Tomography Scans. Diagnostics (Basel) 2022; 12:diagnostics12051283. [PMID: 35626438 PMCID: PMC9141749 DOI: 10.3390/diagnostics12051283] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2022] [Revised: 05/18/2022] [Accepted: 05/19/2022] [Indexed: 02/01/2023] Open
Abstract
Background: COVID-19 is a disease with multiple variants, and is quickly spreading throughout the world. It is crucial to identify patients who are suspected of having COVID-19 early, because the vaccine is not readily available in certain parts of the world. Methodology: Lung computed tomography (CT) imaging can be used to diagnose COVID-19 as an alternative to the RT-PCR test in some cases. The occurrence of ground-glass opacities in the lung region is a characteristic of COVID-19 in chest CT scans, and these are daunting to locate and segment manually. The proposed study consists of a combination of solo deep learning (DL) and hybrid DL (HDL) models to tackle the lesion location and segmentation more quickly. One DL and four HDL models—namely, PSPNet, VGG-SegNet, ResNet-SegNet, VGG-UNet, and ResNet-UNet—were trained by an expert radiologist. The training scheme adopted a fivefold cross-validation strategy on a cohort of 3000 images selected from a set of 40 COVID-19-positive individuals. Results: The proposed variability study uses tracings from two trained radiologists as part of the validation. Five artificial intelligence (AI) models were benchmarked against MedSeg. The best AI model, ResNet-UNet, was superior to MedSeg by 9% and 15% for Dice and Jaccard, respectively, when compared against MD 1, and by 4% and 8%, respectively, when compared against MD 2. Statistical tests—namely, the Mann−Whitney test, paired t-test, and Wilcoxon test—demonstrated its stability and reliability, with p < 0.0001. The online system for each slice was <1 s. Conclusions: The AI models reliably located and segmented COVID-19 lesions in CT scans. The COVLIAS 1.0Lesion lesion locator passed the intervariability test.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
- Correspondence: ; Tel.: +1-(916)-749-5628
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA;
- Department of Computer Science Engineering, PSIT, Kanpur 209305, India
| | - Gian Luca Chabert
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Alessandro Carriero
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale (UPO), Via Solaroli 17, 28100 Novara, Italy;
| | - Alessio Paschè
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Pietro S. C. Danna
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Armin Mehmedović
- University Hospital for Infectious Diseases, 10000 Zagreb, Croatia; (A.M.); (K.V.)
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy;
| | - Inder M. Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, 27753 Delmenhorst, Germany;
| | - Paramjit S. Chadha
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA; (I.M.S.); (P.S.C.)
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, 17674 Athens, Greece;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Martin Miner
- Men’s Health Center, Miriam Hospital, Providence, RI 02906, USA;
| | - David W. Sobel
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA; (G.P.); (D.W.S.)
| | - Antonella Balestrieri
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09124 Cagliari, Italy; (G.L.C.); (A.P.); (P.S.C.D.); (L.S.); (A.B.)
| | - Petros P. Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, 15772 Athens, Greece;
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece;
| | - Athanasios D. Protogerou
- Cardiovascular Prevention and Research Unit, Department of Pathophysiology, National & Kapodistrian University of Athens, 15772 Athens, Greece;
| | - Durga Prasanna Misra
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - Vikas Agarwal
- Department of Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India; (D.P.M.); (V.A.)
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON L4Z 4C4, Canada;
| | | | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia 2408, Cyprus;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Vijay Rathore
- AtheroPoint LLC, Roseville, CA 95661, USA; (S.K.D.); (V.R.)
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA;
| | | | - Ferenc Nagy
- Internal Medicine Department, University of Szeged, 6725 Szeged, Hungary;
| | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, 6725 Szeged, Hungary;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Subbaram Naidu
- Electrical Engineering Department, University of Minnesota, Duluth, MN 55812, USA;
| | - Klaudija Viskovic
- University Hospital for Infectious Diseases, 10000 Zagreb, Croatia; (A.M.); (K.V.)
| | - Manudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA;
| |
Collapse
|
42
|
Khanna NN, Maindarkar M, Saxena A, Ahluwalia P, Paul S, Srivastava SK, Cuadrado-Godia E, Sharma A, Omerzu T, Saba L, Mavrogeni S, Turk M, Laird JR, Kitas GD, Fatemi M, Barqawi AB, Miner M, Singh IM, Johri A, Kalra MM, Agarwal V, Paraskevas KI, Teji JS, Fouda MM, Pareek G, Suri JS. Cardiovascular/Stroke Risk Assessment in Patients with Erectile Dysfunction-A Role of Carotid Wall Arterial Imaging and Plaque Tissue Characterization Using Artificial Intelligence Paradigm: A Narrative Review. Diagnostics (Basel) 2022; 12:1249. [PMID: 35626404 PMCID: PMC9141739 DOI: 10.3390/diagnostics12051249] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/14/2022] [Accepted: 05/15/2022] [Indexed: 12/12/2022] Open
Abstract
PURPOSE The role of erectile dysfunction (ED) has recently shown an association with the risk of stroke and coronary heart disease (CHD) via the atherosclerotic pathway. Cardiovascular disease (CVD)/stroke risk has been widely understood with the help of carotid artery disease (CTAD), a surrogate biomarker for CHD. The proposed study emphasizes artificial intelligence-based frameworks such as machine learning (ML) and deep learning (DL) that can accurately predict the severity of CVD/stroke risk using carotid wall arterial imaging in ED patients. METHODS Using the PRISMA model, 231 of the best studies were selected. The proposed study mainly consists of two components: (i) the pathophysiology of ED and its link with coronary artery disease (COAD) and CHD in the ED framework and (ii) the ultrasonic-image morphological changes in the carotid arterial walls by quantifying the wall parameters and the characterization of the wall tissue by adapting the ML/DL-based methods, both for the prediction of the severity of CVD risk. The proposed study analyzes the hypothesis that ML/DL can lead to an accurate and early diagnosis of the CVD/stroke risk in ED patients. Our finding suggests that the routine ED patient practice can be amended for ML/DL-based CVD/stroke risk assessment using carotid wall arterial imaging leading to fast, reliable, and accurate CVD/stroke risk stratification. SUMMARY We conclude that ML and DL methods are very powerful tools for the characterization of CVD/stroke in patients with varying ED conditions. We anticipate a rapid growth of these tools for early and better CVD/stroke risk management in ED patients.
Collapse
Affiliation(s)
- Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Mahesh Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Ajit Saxena
- Department of Urology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - Puneet Ahluwalia
- Max Institute of Cancer Care, Max Super Specialty Hospital, New Delhi 110017, India;
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.M.); (S.P.)
| | - Saurabh K. Srivastava
- College of Computing Sciences and IT, Teerthanker Mahaveer University, Moradabad 244001, India;
| | - Elisa Cuadrado-Godia
- Department of Neurology, Hospital del Mar Medical Research Institute, 08003 Barcelona, Spain;
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA 22908, USA;
| | - Tomaz Omerzu
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09124 Cagliari, Italy;
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Centre, 176 74 Athens, Greece;
| | - Monika Turk
- Department of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia; (T.O.); (M.T.)
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK;
- Arthritis Research UK Epidemiology Unit, Manchester University, Manchester M13 9PL, UK
| | - Mostafa Fatemi
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, NY 55905, USA;
| | - Al Baha Barqawi
- Division of Urology, Department of Surgery, University of Colorado Anschutz Medical Campus, Aurora, CO 80045, USA;
| | - Martin Miner
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | | | - Vikas Agarwal
- Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow 226014, India;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| | - Jagjit S. Teji
- Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, RI 02912, USA;
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint, Roseville, CA 95661, USA;
| |
Collapse
|
43
|
Cardiovascular Risk Stratification in Diabetic Retinopathy via Atherosclerotic Pathway in COVID-19/non-COVID-19 Frameworks using Artificial Intelligence Paradigm: A Narrative Review. Diagnostics (Basel) 2022; 12:diagnostics12051234. [PMID: 35626389 PMCID: PMC9140106 DOI: 10.3390/diagnostics12051234] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 05/11/2022] [Accepted: 05/11/2022] [Indexed: 11/18/2022] Open
Abstract
Diabetes is one of the main causes of the rising cases of blindness in adults. This microvascular complication of diabetes is termed diabetic retinopathy (DR) and is associated with an expanding risk of cardiovascular events in diabetes patients. DR, in its various forms, is seen to be a powerful indicator of atherosclerosis. Further, the macrovascular complication of diabetes leads to coronary artery disease (CAD). Thus, the timely identification of cardiovascular disease (CVD) complications in DR patients is of utmost importance. Since CAD risk assessment is expensive for low-income countries, it is important to look for surrogate biomarkers for risk stratification of CVD in DR patients. Due to the common genetic makeup between the coronary and carotid arteries, low-cost, high-resolution imaging such as carotid B-mode ultrasound (US) can be used for arterial tissue characterization and risk stratification in DR patients. The advent of artificial intelligence (AI) techniques has facilitated the handling of large cohorts in a big data framework to identify atherosclerotic plaque features in arterial ultrasound. This enables timely CVD risk assessment and risk stratification of patients with DR. Thus, this review focuses on understanding the pathophysiology of DR, retinal and CAD imaging, the role of surrogate markers for CVD, and finally, the CVD risk stratification of DR patients. The review shows a step-by-step cyclic activity of how diabetes and atherosclerotic disease cause DR, leading to the worsening of CVD. We propose a solution to how AI can help in the identification of CVD risk. Lastly, we analyze the role of DR/CVD in the COVID-19 framework.
Collapse
|
44
|
Suri JS, Paul S, Maindarkar MA, Puvvula A, Saxena S, Saba L, Turk M, Laird JR, Khanna NN, Viskovic K, Singh IM, Kalra M, Krishnan PR, Johri A, Paraskevas KI. Cardiovascular/Stroke Risk Stratification in Parkinson's Disease Patients Using Atherosclerosis Pathway and Artificial Intelligence Paradigm: A Systematic Review. Metabolites 2022; 12:metabo12040312. [PMID: 35448500 PMCID: PMC9033076 DOI: 10.3390/metabo12040312] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 03/25/2022] [Accepted: 03/29/2022] [Indexed: 12/20/2022] Open
Abstract
Parkinson’s disease (PD) is a severe, incurable, and costly condition leading to heart failure. The link between PD and cardiovascular disease (CVD) is not available, leading to controversies and poor prognosis. Artificial Intelligence (AI) has already shown promise for CVD/stroke risk stratification. However, due to a lack of sample size, comorbidity, insufficient validation, clinical examination, and a lack of big data configuration, there have been no well-explained bias-free AI investigations to establish the CVD/Stroke risk stratification in the PD framework. The study has two objectives: (i) to establish a solid link between PD and CVD/stroke; and (ii) to use the AI paradigm to examine a well-defined CVD/stroke risk stratification in the PD framework. The PRISMA search strategy selected 223 studies for CVD/stroke risk, of which 54 and 44 studies were related to the link between PD-CVD, and PD-stroke, respectively, 59 studies for joint PD-CVD-Stroke framework, and 66 studies were only for the early PD diagnosis without CVD/stroke link. Sequential biological links were used for establishing the hypothesis. For AI design, PD risk factors as covariates along with CVD/stroke as the gold standard were used for predicting the CVD/stroke risk. The most fundamental cause of CVD/stroke damage due to PD is cardiac autonomic dysfunction due to neurodegeneration that leads to heart failure and its edema, and this validated our hypothesis. Finally, we present the novel AI solutions for CVD/stroke risk prediction in the PD framework. The study also recommends strategies for removing the bias in AI for CVD/stroke risk prediction using the PD framework.
Collapse
Affiliation(s)
- Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Correspondence: ; Tel.: +1-(916)-749-5628
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Maheshrao A. Maindarkar
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (S.P.); (M.A.M.)
| | - Anudeep Puvvula
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
- Annu’s Hospitals for Skin & Diabetes, Gudur 524101, India
| | - Sanjay Saxena
- Department of CSE, International Institute of Information Technology, Bhuneshwar 751003, India;
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09121 Cagliari, Italy;
| | - Monika Turk
- Deparment of Neurology, University Medical Centre Maribor, 1262 Maribor, Slovenia;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India;
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (A.P.); (I.M.S.)
| | - Mannudeep Kalra
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA;
| | | | - Amer Johri
- Department of Medicine, Division of Cardiology, Queen’s University, Kingston, ON K7L 3N6, Canada;
| | - Kosmas I. Paraskevas
- Department of Vascular Surgery, Central Clinic of Athens, 106 80 Athens, Greece;
| |
Collapse
|
45
|
Nillmani, Jain PK, Sharma N, Kalra MK, Viskovic K, Saba L, Suri JS. Four Types of Multiclass Frameworks for Pneumonia Classification and Its Validation in X-ray Scans Using Seven Types of Deep Learning Artificial Intelligence Models. Diagnostics (Basel) 2022; 12:652. [PMID: 35328205 PMCID: PMC8946935 DOI: 10.3390/diagnostics12030652] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 03/04/2022] [Accepted: 03/04/2022] [Indexed: 12/31/2022] Open
Abstract
Background and Motivation: The novel coronavirus causing COVID-19 is exceptionally contagious, highly mutative, decimating human health and life, as well as the global economy, by consistent evolution of new pernicious variants and outbreaks. The reverse transcriptase polymerase chain reaction currently used for diagnosis has major limitations. Furthermore, the multiclass lung classification X-ray systems having viral, bacterial, and tubercular classes—including COVID-19—are not reliable. Thus, there is a need for a robust, fast, cost-effective, and easily available diagnostic method. Method: Artificial intelligence (AI) has been shown to revolutionize all walks of life, particularly medical imaging. This study proposes a deep learning AI-based automatic multiclass detection and classification of pneumonia from chest X-ray images that are readily available and highly cost-effective. The study has designed and applied seven highly efficient pre-trained convolutional neural networks—namely, VGG16, VGG19, DenseNet201, Xception, InceptionV3, NasnetMobile, and ResNet152—for classification of up to five classes of pneumonia. Results: The database consisted of 18,603 scans with two, three, and five classes. The best results were using DenseNet201, VGG16, and VGG16, respectively having accuracies of 99.84%, 96.7%, 92.67%; sensitivity of 99.84%, 96.63%, 92.70%; specificity of 99.84, 96.63%, 92.41%; and AUC of 1.0, 0.97, 0.92 (p < 0.0001 for all), respectively. Our system outperformed existing methods by 1.2% for the five-class model. The online system takes <1 s while demonstrating reliability and stability. Conclusions: Deep learning AI is a powerful paradigm for multiclass pneumonia classification.
Collapse
Affiliation(s)
- Nillmani
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Pankaj K. Jain
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Neeraj Sharma
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02115, USA;
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy;
| | - Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint, Roseville, CA 95661, USA
- Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| |
Collapse
|
46
|
Carotid Ultrasound Boundary Study (CUBS): Technical considerations on an open multi-center analysis of computerized measurement systems for intima-media thickness measurement on common carotid artery longitudinal B-mode ultrasound scans. Comput Biol Med 2022; 144:105333. [DOI: 10.1016/j.compbiomed.2022.105333] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 02/02/2022] [Accepted: 02/16/2022] [Indexed: 01/17/2023]
|
47
|
FRDD-Net: Automated Carotid Plaque Ultrasound Images Segmentation Using Feature Remapping and Dense Decoding. SENSORS 2022; 22:s22030887. [PMID: 35161631 PMCID: PMC8838852 DOI: 10.3390/s22030887] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 01/18/2022] [Accepted: 01/19/2022] [Indexed: 11/17/2022]
Abstract
Automated segmentation and evaluation of carotid plaques ultrasound images is of great significance for the diagnosis and early intervention of high-risk groups of cardiovascular and cerebrovascular diseases. However, it remains challenging to develop such solutions due to the relatively low quality of ultrasound images and heterogenous characteristics of carotid plaques. To address those problems, in this paper, we propose a novel deep convolutional neural network, FRDD-Net, with an encoder–decoder architecture to automatically segment carotid plaques. We propose the feature remapping modules (FRMs) and incorporate them into the encoding and decoding blocks to ameliorate the reliability of acquired features. We also propose a new dense decoding mechanism as part of the decoder, thus promoting the utilization efficiency of encoded features. Additionally, we construct a compound loss function to train our network to further enhance its robustness in the face of numerous cases. We train and test our network in multiple carotid plaque ultrasound datasets and our method yields the best performance compared to other state-of-the-art methods. Further ablation studies consistently show the advancement of our proposed architecture.
Collapse
|
48
|
A machine learning framework for risk prediction of multi-label cardiovascular events based on focused carotid plaque B-Mode ultrasound: A Canadian study. Comput Biol Med 2022; 140:105102. [PMID: 34973521 DOI: 10.1016/j.compbiomed.2021.105102] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2021] [Revised: 11/29/2021] [Accepted: 11/29/2021] [Indexed: 12/17/2022]
Abstract
MOTIVATION Machine learning (ML) algorithms can provide better cardiovascular event (CVE) prediction. However, ML algorithms are mostly explored for predicting a single CVE at a time. The objective of this study is to design and develop an ML-based system to predict multi-label CVEs, such as (i) coronary artery disease, (ii) acute coronary syndrome, and (iii) a composite CVE-a class of AtheroEdge 3.0 (ML) system. METHODS Focused carotid B-mode ultrasound and coronary angiography are performed on a group of 459 participants consisting of three cardiovascular labels. Initially, 23 risk predictors comprising (i) patients' demographics, (ii) clinical blood-biomarkers, and (iii) carotid ultrasound image-based phenotypes are collected. Six types of classification techniques comprising (a) four problem transformation methods (PTM) and (b) two algorithm adaptation methods (AAM) are used for multi-label CVE prediction. The performance of the proposed system is evaluated for accuracy, sensitivity, specificity, F1-score, and area-under-the-curve (AUC) using 10-fold cross-validation. The proposed system is also verified using another database of 522 participants. RESULTS For the primary database, PTM demonstrated a better multi-label CVE prediction than AAM (mean accuracy: 80.89% vs. 62.83%, mean AUC: 0.89 vs. 0.63), validating our hypothesis. The PTM-based binary relevance (BR) technique provided optimal performance in multi-label CVE prediction. The overall multi-label classification accuracy, sensitivity, specificity, F1-score, and AUC using BR are 81.2 ± 3.01%, 76.5 ± 8.8%, 83.8 ± 3.8%, 75.37 ± 5.8%, and 0.89 ± 0.02 (p < 0.0001), respectively. When used on the second Canadian database with seven cardiovascular events (acute coronary syndrome, myocardial infarction, angina, stroke, transient ischemic attack, heart failure, and death), the proposed system showed an accuracy of 96.36 ± 0.87% (AUC: 0.61 ± 0.06, p < 0.0001). CONCLUSION ML-based multi-label classification algorithms, such as binary relevance, yielded the best predictions for three cardiovascular endpoints.
Collapse
|
49
|
Chen G, Dai Y, Zhang J, Yin X, Cui L. MBANet: Multi-branch aware network for kidney ultrasound images segmentation. Comput Biol Med 2021; 141:105140. [PMID: 34922172 DOI: 10.1016/j.compbiomed.2021.105140] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Revised: 12/11/2021] [Accepted: 12/11/2021] [Indexed: 12/18/2022]
Abstract
Due to the influence of kidney morphology, heterogeneous structure and image quality, segmenting kidney in ultrasound images is challenging. To alleviate this challenge, we proposed a novel deep neural network architecture, namely Multi-branch Aware Network (MBANet), to segment kidney accurately and robustly. MBANet mainly consists of multi-scale feature pyramid (MSFP), multi-branch encoders (MBE) and master decoder. The design of MSFP can make the network more accessible to different kinds of class details at different scales. The information exchange between MBE can reduce the loss of feature information and improve the segmentation accuracy of the network. In addition, we designed a multi-scale fusion block (MFBlock) in the MBE to further extract and fuse more refined multi-scale image information. In order to further improve the robustness of MBANet, this paper also designed a step-by-step training mechanism. We validated the proposed approach and compared to several state-of-the-art approaches on the same kidney ultrasound datasets using six quantitative metrics. The results of our method on the six indicators of pixel accuracy (PA), intersection over union (IoU), precision, recall, specificity and F1-score (F1) are 98.83%, 92.38%, 97.10%, 95.03%, 99.46% and 0.9601, respectively. Compared with the comparison method, the average values on the six indicators are improved by about 2%. The evaluation results and segmentation results demonstrate that the proposed approach achieves the best overall performance on kidney ultrasound images segmentation.
Collapse
Affiliation(s)
- Gongping Chen
- The Institute of Robotics and Automatic Information System, Tianjin Key Laboratory of Intelligent Robotics, College of Artificial Intelligence, Nankai University, Tianjin, 300350, China.
| | - Yu Dai
- The Institute of Robotics and Automatic Information System, Tianjin Key Laboratory of Intelligent Robotics, College of Artificial Intelligence, Nankai University, Tianjin, 300350, China.
| | - Jianxun Zhang
- The Institute of Robotics and Automatic Information System, Tianjin Key Laboratory of Intelligent Robotics, College of Artificial Intelligence, Nankai University, Tianjin, 300350, China
| | - Xiaotao Yin
- Department of Urology, Civil Aviation General Hospital, Beijing, 100123, China
| | - Liang Cui
- Department of Urology, Fourth Medical Center of Chinese PLA General Hospital, Beijing, 10048, China
| |
Collapse
|
50
|
A hybrid deep learning paradigm for carotid plaque tissue characterization and its validation in multicenter cohorts using a supercomputer framework. Comput Biol Med 2021; 141:105131. [PMID: 34922173 DOI: 10.1016/j.compbiomed.2021.105131] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2021] [Revised: 11/20/2021] [Accepted: 12/09/2021] [Indexed: 12/12/2022]
Abstract
BACKGROUND Early and automated detection of carotid plaques prevents strokes, which are the second leading cause of death worldwide according to the World Health Organization. Artificial intelligence (AI) offers automated solutions for plaque tissue characterization. Recently, solo deep learning (SDL) models have been used, but they do not take advantage of the tandem connectivity offered by AI's hybrid nature. Therefore, this study explores the use of hybrid deep learning (HDL) models in a multicenter framework, making this study the first of its kind. METHODS We hypothesize that HDL techniques perform better than SDL and transfer learning (TL) techniques. We propose two kinds of HDL frameworks: (i) the fusion of two SDLs (Inception with ResNet) or (ii) 10 other kinds of tandem models that fuse SDL with ML. The system Atheromatic™ 2.0HDL (AtheroPoint, CA, USA) was designed on an augmentation framework and three kinds of loss functions (cross-entropy, hinge, and mean-square-error) during training to determine the best optimization paradigm. These 11 combined HDL models were then benchmarked against one SDL model and five types of TL models; thus, this study considers a total of 17 AI models. RESULTS Among the 17 AI models, the best performing HDL system was that comprising CNN and decision tree (DT), as its accuracy and area-under-the-curve were 99.78 ± 1.05% and 0.99 (p<0.0001), respectively. These values are 6.4% and 3.2% better than those recorded for the SDL and TL models, respectively. We validated the performance of the HDL models with diagnostics odds ratio (DOR) and Cohen and Kappa statistics; here, HDL outperformed DL and TL by 23% and 7%, respectively. The online system ran in <2 s. CONCLUSION HDL is a fast, reliable, and effective tool for characterizing the carotid plaque for early stroke risk stratification.
Collapse
|