1
|
Pu Q, Tian J, Wei D, Shu Q, Sun M, Zhao L. Multifunctional aggregation network of cell nuclei segmentation aiming histopathological diagnosis assistance: A new MA-Net construction. PLoS One 2024; 19:e0308326. [PMID: 39241001 PMCID: PMC11379384 DOI: 10.1371/journal.pone.0308326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 07/22/2024] [Indexed: 09/08/2024] Open
Abstract
Automated diagnostic systems can enhance the accuracy and efficiency of pathological diagnoses, nuclear segmentation plays a crucial role in computer-aided diagnosis systems for histopathology. However, achieving accurate nuclear segmentation is challenging due to the complex background tissue structures and significant variations in cell morphology and size in pathological images. In this study, we have proposed a U-Net based deep learning model, called MA-Net(Multifunctional Aggregation Network), to accurately segmenting nuclei from H&E stained images. In contrast to previous studies that focused on improving a single module of the network, we applied feature fusion modules, attention gate units, and atrous spatial pyramid pooling to the encoder and decoder, skip connections, and bottleneck of U-Net, respectively, to enhance the network's performance in nuclear segmentation. The dice coefficient loss was used during model training to enhance the network's ability to segment small objects. We applied the proposed MA-Net to multiple public datasets, and comprehensive results showed that this method outperforms the original U-Net method and other state-of-the-art methods in nuclei segmentation tasks. The source code of our work can be found in https://github.com/LinaZhaoAIGroup/MA-Net.
Collapse
Affiliation(s)
- Qiumei Pu
- School of Information Engineering, Minzu University of China, Beijing, China
| | - Jinglong Tian
- School of Information Engineering, Minzu University of China, Beijing, China
| | - Donghao Wei
- School of Information Engineering, Minzu University of China, Beijing, China
| | - Qingming Shu
- Department of Pathology, Third Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Minghui Sun
- Key Laboratory for Biomedical Effects of Nanomaterials and Nanosafety, Institute of High Energy Physics, Chinese Academy of Sciences, Beijing, China
| | - Lina Zhao
- Key Laboratory for Biomedical Effects of Nanomaterials and Nanosafety, Institute of High Energy Physics, Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
2
|
Mobini N, Capra D, Colarieti A, Zanardo M, Baselli G, Sardanelli F. Deep transfer learning for detection of breast arterial calcifications on mammograms: a comparative study. Eur Radiol Exp 2024; 8:80. [PMID: 39004645 PMCID: PMC11247067 DOI: 10.1186/s41747-024-00478-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Accepted: 05/03/2024] [Indexed: 07/16/2024] Open
Abstract
INTRODUCTION Breast arterial calcifications (BAC) are common incidental findings on routine mammograms, which have been suggested as a sex-specific biomarker of cardiovascular disease (CVD) risk. Previous work showed the efficacy of a pretrained convolutional network (CNN), VCG16, for automatic BAC detection. In this study, we further tested the method by a comparative analysis with other ten CNNs. MATERIAL AND METHODS Four-view standard mammography exams from 1,493 women were included in this retrospective study and labeled as BAC or non-BAC by experts. The comparative study was conducted using eleven pretrained convolutional networks (CNNs) with varying depths from five architectures including Xception, VGG, ResNetV2, MobileNet, and DenseNet, fine-tuned for the binary BAC classification task. Performance evaluation involved area under the receiver operating characteristics curve (AUC-ROC) analysis, F1-score (harmonic mean of precision and recall), and generalized gradient-weighted class activation mapping (Grad-CAM++) for visual explanations. RESULTS The dataset exhibited a BAC prevalence of 194/1,493 women (13.0%) and 581/5,972 images (9.7%). Among the retrained models, VGG, MobileNet, and DenseNet demonstrated the most promising results, achieving AUC-ROCs > 0.70 in both training and independent testing subsets. In terms of testing F1-score, VGG16 ranked first, higher than MobileNet (0.51) and VGG19 (0.46). Qualitative analysis showed that the Grad-CAM++ heatmaps generated by VGG16 consistently outperformed those produced by others, offering a finer-grained and discriminative localization of calcified regions within images. CONCLUSION Deep transfer learning showed promise in automated BAC detection on mammograms, where relatively shallow networks demonstrated superior performances requiring shorter training times and reduced resources. RELEVANCE STATEMENT Deep transfer learning is a promising approach to enhance reporting BAC on mammograms and facilitate developing efficient tools for cardiovascular risk stratification in women, leveraging large-scale mammographic screening programs. KEY POINTS • We tested different pretrained convolutional networks (CNNs) for BAC detection on mammograms. • VGG and MobileNet demonstrated promising performances, outperforming their deeper, more complex counterparts. • Visual explanations using Grad-CAM++ highlighted VGG16's superior performance in localizing BAC.
Collapse
Affiliation(s)
- Nazanin Mobini
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Milan, Italy
| | - Davide Capra
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy.
| | - Anna Colarieti
- Radiology Unit, IRCCS Policlinico San Donato, Via Morandi 30, 20097, San Donato Milanese, Italy
| | - Moreno Zanardo
- Radiology Unit, IRCCS Policlinico San Donato, Via Morandi 30, 20097, San Donato Milanese, Italy
| | - Giuseppe Baselli
- Department of Electronics, Information, and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Francesco Sardanelli
- Radiology Unit, IRCCS Policlinico San Donato, Via Morandi 30, 20097, San Donato Milanese, Italy
- Lega Italiana per la lotta contro i Tumori (LILT) Milano Monza Brianza, Milan, Italy
| |
Collapse
|
3
|
AlJabri M, Alghamdi M, Collado-Mesa F, Abdel-Mottaleb M. Recurrent attention U-Net for segmentation and quantification of breast arterial calcifications on synthesized 2D mammograms. PeerJ Comput Sci 2024; 10:e2076. [PMID: 38855260 PMCID: PMC11157579 DOI: 10.7717/peerj-cs.2076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 04/30/2024] [Indexed: 06/11/2024]
Abstract
Breast arterial calcifications (BAC) are a type of calcification commonly observed on mammograms and are generally considered benign and not associated with breast cancer. However, there is accumulating observational evidence of an association between BAC and cardiovascular disease, the leading cause of death in women. We present a deep learning method that could assist radiologists in detecting and quantifying BAC in synthesized 2D mammograms. We present a recurrent attention U-Net model consisting of encoder and decoder modules that include multiple blocks that each use a recurrent mechanism, a recurrent mechanism, and an attention module between them. The model also includes a skip connection between the encoder and the decoder, similar to a U-shaped network. The attention module was used to enhance the capture of long-range dependencies and enable the network to effectively classify BAC from the background, whereas the recurrent blocks ensured better feature representation. The model was evaluated using a dataset containing 2,000 synthesized 2D mammogram images. We obtained 99.8861% overall accuracy, 69.6107% sensitivity, 66.5758% F-1 score, and 59.5498% Jaccard coefficient, respectively. The presented model achieved promising performance compared with related models.
Collapse
Affiliation(s)
- Manar AlJabri
- Department of Computer Science and Artificial Intelligence, Umm Al-Qura University, Makkah, Makkah, Saudi Arabia
- King Abdul Aziz University, Jeddah, Makkah, Saudi Arabia
| | - Manal Alghamdi
- Department of Computer Science and Artificial Intelligence, Umm Al-Qura University, Makkah, Makkah, Saudi Arabia
| | - Fernando Collado-Mesa
- Department of Radiology, Miller School of Medicine, University of Miami, Miami, Florida, United States
| | - Mohamed Abdel-Mottaleb
- Department of Electrical and Computer Engineering, University of Miami, Miami, Florida, United States
| |
Collapse
|
4
|
Peng P, Wu D, Huang LJ, Wang J, Zhang L, Wu Y, Jiang Y, Lu Z, Lai KW, Xia K. Application of Semi-supervised Fuzzy Clustering Based on Knowledge Weighting and Cluster Center Learning to Mammary Molybdenum Target Image Segmentation. Interdiscip Sci 2024; 16:39-57. [PMID: 37486420 DOI: 10.1007/s12539-023-00580-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 07/02/2023] [Accepted: 07/03/2023] [Indexed: 07/25/2023]
Abstract
Breast cancer is commonly diagnosed with mammography. Using image segmentation algorithms to separate lesion areas in mammography can facilitate diagnosis by doctors and reduce their workload, which has important clinical significance. Because large, accurately labeled medical image datasets are difficult to obtain, traditional clustering algorithms are widely used in medical image segmentation as an unsupervised model. Traditional unsupervised clustering algorithms have limited learning knowledge. Moreover, some semi-supervised fuzzy clustering algorithms cannot fully mine the information of labeled samples, which results in insufficient supervision. When faced with complex mammography images, the above algorithms cannot accurately segment lesion areas. To address this, a semi-supervised fuzzy clustering based on knowledge weighting and cluster center learning (WSFCM_V) is presented. According to prior knowledge, three learning modes are proposed: a knowledge weighting method for cluster centers, Euclidean distance weights for unlabeled samples, and learning from the cluster centers of labeled sample sets. These strategies improve the clustering performance. On real breast molybdenum target images, the WSFCM_V algorithm is compared with currently popular semi-supervised and unsupervised clustering algorithms. WSFCM_V has the best evaluation index values. Experimental results demonstrate that compared with the existing clustering algorithms, WSFCM_V has a higher segmentation accuracy than other clustering algorithms, both for larger lesion regions like tumor areas and for smaller lesion areas like calcification point areas.
Collapse
Affiliation(s)
- Peng Peng
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, 214122, Jiangsu, China
| | - Danping Wu
- The Changshu Affiliated Hospital of Soochow University, Suzhou, 215500, Jiangsu, China
| | - Li-Jun Huang
- The Changshu Affiliated Hospital of Soochow University, Suzhou, 215500, Jiangsu, China
| | - Jianqiang Wang
- The Changshu Affiliated Hospital of Soochow University, Suzhou, 215500, Jiangsu, China
| | - Li Zhang
- The Changshu Affiliated Hospital of Soochow University, Suzhou, 215500, Jiangsu, China
| | - Yue Wu
- The Changshu Affiliated Hospital of Soochow University, Suzhou, 215500, Jiangsu, China
| | - Yizhang Jiang
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, 214122, Jiangsu, China
| | - Zhihua Lu
- Department of Radiology, Dushu Lake Hospital Affiliated to Soochow University, Medical Center of Soochow University, Suzhou Dushu Lake Hospital, Suzhou, 215123, Jiangsu, China
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 50603, Kuala Lumpur, Malaysia
| | - Kaijian Xia
- The Changshu Affiliated Hospital of Soochow University, Suzhou, 215500, Jiangsu, China.
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 50603, Kuala Lumpur, Malaysia.
| |
Collapse
|
5
|
Song Q, diFlorio-Alexander RM, Sieberg RT, Dwan D, Boyce W, Stumetz K, Patel SD, Karagas MR, MacKenzie TA, Hassanpour S. Automated classification of fat-infiltrated axillary lymph nodes on screening mammograms. Br J Radiol 2023; 96:20220835. [PMID: 37751215 PMCID: PMC10607412 DOI: 10.1259/bjr.20220835] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 06/06/2023] [Accepted: 07/16/2023] [Indexed: 09/27/2023] Open
Abstract
OBJECTIVE Fat-infiltrated axillary lymph nodes (LNs) are unique sites for ectopic fat deposition. Early studies showed a strong correlation between fatty LNs and obesity-related diseases. Confirming this correlation requires large-scale studies, hindered by scarce labeled data. With the long-term goal of developing a rapid and generalizable tool to aid data labeling, we developed an automated deep learning (DL)-based pipeline to classify the status of fatty LNs on screening mammograms. METHODS Our internal data set included 886 mammograms from a tertiary academic medical institution, with a binary status of the fat-infiltrated LNs based on the size and morphology of the largest visible axillary LN. A two-stage DL model training and fine-tuning pipeline was developed to classify the fat-infiltrated LN status using the internal training and development data set. The model was evaluated on a held-out internal test set and a subset of the Digital Database for Screening Mammography. RESULTS Our model achieved 0.97 (95% CI: 0.94-0.99) accuracy and 1.00 (95% CI: 1.00-1.00) area under the receiver operator characteristic curve on 264 internal testing mammograms, and 0.82 (95% CI: 0.77-0.86) accuracy and 0.87 (95% CI: 0.82-0.91) area under the receiver operator characteristic curve on 70 external testing mammograms. CONCLUSION This study confirmed the feasibility of using a DL model for fat-infiltrated LN classification. The model provides a practical tool to identify fatty LNs on mammograms and to allow for future large-scale studies to evaluate the role of fatty LNs as an imaging biomarker of obesity-associated pathologies. ADVANCES IN KNOWLEDGE Our study is the first to classify fatty LNs using an automated DL approach.
Collapse
Affiliation(s)
- Qingyuan Song
- Department of Biomedical Data Science, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, United States
| | | | - Ryan T. Sieberg
- Department of Radiology, School of Medicine, University of California, San Francisco, California, United States
| | - Dennis Dwan
- Department of Internal Medicine, Carney Hospital, Dorchester, Massachusetts, United States
| | - William Boyce
- Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, United States
| | - Kyle Stumetz
- Department of Radiology, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire, United States
| | - Sohum D. Patel
- Department of Radiology, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire, United States
| | - Margaret R. Karagas
- Department of Epidemiology, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, United States
| | - Todd A. MacKenzie
- Department of Biomedical Data Science, Geisel School of Medicine, Dartmouth College, Lebanon, New Hampshire, United States
| | | |
Collapse
|
6
|
Jiang X, Hu Z, Wang S, Zhang Y. Deep Learning for Medical Image-Based Cancer Diagnosis. Cancers (Basel) 2023; 15:3608. [PMID: 37509272 PMCID: PMC10377683 DOI: 10.3390/cancers15143608] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 07/10/2023] [Accepted: 07/10/2023] [Indexed: 07/30/2023] Open
Abstract
(1) Background: The application of deep learning technology to realize cancer diagnosis based on medical images is one of the research hotspots in the field of artificial intelligence and computer vision. Due to the rapid development of deep learning methods, cancer diagnosis requires very high accuracy and timeliness as well as the inherent particularity and complexity of medical imaging. A comprehensive review of relevant studies is necessary to help readers better understand the current research status and ideas. (2) Methods: Five radiological images, including X-ray, ultrasound (US), computed tomography (CT), magnetic resonance imaging (MRI), positron emission computed tomography (PET), and histopathological images, are reviewed in this paper. The basic architecture of deep learning and classical pretrained models are comprehensively reviewed. In particular, advanced neural networks emerging in recent years, including transfer learning, ensemble learning (EL), graph neural network, and vision transformer (ViT), are introduced. Five overfitting prevention methods are summarized: batch normalization, dropout, weight initialization, and data augmentation. The application of deep learning technology in medical image-based cancer analysis is sorted out. (3) Results: Deep learning has achieved great success in medical image-based cancer diagnosis, showing good results in image classification, image reconstruction, image detection, image segmentation, image registration, and image synthesis. However, the lack of high-quality labeled datasets limits the role of deep learning and faces challenges in rare cancer diagnosis, multi-modal image fusion, model explainability, and generalization. (4) Conclusions: There is a need for more public standard databases for cancer. The pre-training model based on deep neural networks has the potential to be improved, and special attention should be paid to the research of multimodal data fusion and supervised paradigm. Technologies such as ViT, ensemble learning, and few-shot learning will bring surprises to cancer diagnosis based on medical images.
Collapse
Grants
- RM32G0178B8 BBSRC
- MC_PC_17171 MRC, UK
- RP202G0230 Royal Society, UK
- AA/18/3/34220 BHF, UK
- RM60G0680 Hope Foundation for Cancer Research, UK
- P202PF11 GCRF, UK
- RP202G0289 Sino-UK Industrial Fund, UK
- P202ED10, P202RE969 LIAS, UK
- P202RE237 Data Science Enhancement Fund, UK
- 24NN201 Fight for Sight, UK
- OP202006 Sino-UK Education Fund, UK
- RM32G0178B8 BBSRC, UK
- 2023SJZD125 Major project of philosophy and social science research in colleges and universities in Jiangsu Province, China
Collapse
Affiliation(s)
- Xiaoyan Jiang
- School of Mathematics and Information Science, Nanjing Normal University of Special Education, Nanjing 210038, China; (X.J.); (Z.H.)
| | - Zuojin Hu
- School of Mathematics and Information Science, Nanjing Normal University of Special Education, Nanjing 210038, China; (X.J.); (Z.H.)
| | - Shuihua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK;
| | - Yudong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK;
| |
Collapse
|
7
|
Alloqmani A, Abushark YB, Khan AI. Anomaly Detection of Breast Cancer Using Deep Learning. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2023; 48:1-26. [PMID: 37361464 PMCID: PMC10258083 DOI: 10.1007/s13369-023-07945-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Accepted: 03/27/2023] [Indexed: 06/28/2023]
Abstract
Cancer is one of the deadliest diseases facing humanity, one of the which is breast cancer, and it can be considered one of the primary causes of death for most women. Early detection and treatment can significantly improve outcomes and reduce the death rate and treatment costs. This article proposes an efficient and accurate deep learning-based anomaly detection framework. The framework aims to recognize breast abnormalities (benign and malignant) by considering normal data. Also, we address the problem of imbalanced data, which can be claimed to be a popular issue in the medical field. The framework consists of two stages: (1) data pre-processing (i.e., image pre-processing); and (2) feature extraction through the adoption of a MobileNetV2 pre-trained model. After that classification step, a single-layer perceptron is used. Two public datasets were used for the evaluation: INbreast and MIAS. The experimental results showed that the proposed framework is efficient and accurate in detecting anomalies (e.g., 81.40% to 97.36% in terms of area under the curve). As per the evaluation results, the proposed framework outperforms recent and relevant works and overcomes their limitations.
Collapse
Affiliation(s)
- Ahad Alloqmani
- Computer Science Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Yoosef B. Abushark
- Computer Science Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Asif Irshad Khan
- Computer Science Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia
| |
Collapse
|
8
|
Ajani SN, Mulla RA, Limkar S, Ashtagi R, Wagh SK, Pawar ME. DLMBHCO: design of an augmented bioinspired deep learning-based multidomain body parameter analysis via heterogeneous correlative body organ analysis. Soft comput 2023:1-21. [PMID: 37362266 PMCID: PMC10248994 DOI: 10.1007/s00500-023-08613-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/23/2023] [Indexed: 06/28/2023]
Abstract
Progressive organ-level disorders in the human body are often correlated with diseases in other body parts. For instance, liver diseases can be linked with heart issues, while cancers can be linked with brain diseases (or psychological conditions). Defining such correlations is a complex task, and existing deep learning models that perform this task either showcase lower accuracy or are non-comprehensive when applied to real-time scenarios. To overcome these issues, this text proposes design of an augmented bioinspired deep learning-based multidomain body parameter analysis via heterogeneous correlative body organ analysis. The proposed model initially collects temporal and spatial data scans for different body parts and uses a multidomain feature extraction engine to convert these scans into vector sets. These vectors are processed by a Bacterial Foraging Optimizer (BFO), which assists in identification of highly variant feature sets, which are individually classified into different disease categories. A fusion of Inception Net, XCeption Net, and GoogLeNet Models is used to perform these classifications. The classified categories are linked with other disease types via temporal analysis of blood reports. The temporal analysis engine uses Modified Analytical Hierarchical Processing (MAHP) Model for calculating inter-organ disease dependency probabilities. Based on these probabilities, the model is able to generate a patient-level correlation map, which can be used by clinical experts to suggest remedial treatments, due to which the model was able to identify correlations between brain disorders and kidneys, heart diseases and lungs, heart diseases and liver, brain diseases and different types of cancers with high efficiency when evaluated under clinical scenarios. When validated on MITBIH, DEAP, CT Kidney, RIDER, and PLCO data samples, it was observed that the proposed model was capable of improving accuracy of correlation by 8.5%, while improving precision and recall by 3.2% when compared with existing correlation models under similar clinical scenarios.
Collapse
Affiliation(s)
- Samir N. Ajani
- Department of Computer Science & Engineering (Data Science), St. Vincent Pallotti College of Engineering and Technology, Nagpur, Maharashtra India
| | - Rais Allauddin Mulla
- Department of Computer Engineering, Vasantdada Patil Pratishthan College of Engineering and Visual Arts, Mumbai, Maharashtra India
| | - Suresh Limkar
- Department of Artificial Intelligence and Data Science, AISSMS Institute of Information Technology, Pune, Maharashtra India
| | - Rashmi Ashtagi
- Department of Computer Engineering, Vishwakarma Institute of Technology, Bibwewadi, Pune, 411037 Maharashtra India
| | - Sharmila K. Wagh
- Department of Computer Engineering, Modern Education Society’s College of Engineering, Pune, Maharashtra India
| | - Mahendra Eknath Pawar
- Department of Computer Engineering, Vasantdada Patil Pratishthan College of Engineering and Visual Arts, Mumbai, Maharashtra India
| |
Collapse
|
9
|
Wang Z, Zheng J, Jiang P, Gao D. Sk-Conv and SPP-based UNet for lesion segmentation of coronary optical coherence tomography. Technol Health Care 2023; 31:347-355. [PMID: 37066935 DOI: 10.3233/thc-236030] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/18/2023]
Abstract
BACKGROUND Coronary artery disease (CAD) manifests with a blockage the coronary arteries, usually due to plaque buildup, and has a serious impact on the human life. Atherosclerotic plaques, including fibrous plaques, lipid plaques, and calcified plaques can lead to occurrence of CAD. Optical coherence tomography (OCT) is employed in the clinical practice as it clearly provides a detailed display of the lesion plaques, thereby assessing the patient's condition. Analyzing the OCT images manually is a very tedious and time-consuming task for the clinicians. Therefore, automatic segmentation of the coronary OCT images is necessary. OBJECTIVE In view of the good utility of Unet network in the segmentation of medical images, the present study proposed the development of a Unet network based on Sk-Conv and spatial pyramid pooling modules to segment the coronary OCT images. METHODS In order to extract multi-scale features, these two modules were added at the bottom of UNet. Meanwhile, ablation experiments are designed to verify each module is effective. RESULTS After testing, our model achieves 0.8935 on f1 score and 0.7497 on mIOU. Compared to the current advanced models, our model performs better. CONCLUSION Our model achieves good results on OCT sequences.
Collapse
Affiliation(s)
- Zhan Wang
- School of Software, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Jiawei Zheng
- Department of Cardiovascular Medicine, Second Affiliated Hospital of Xi'an, Jiaotong University, Xi'an, Shaanxi, China
| | - Peilin Jiang
- School of Software, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Dengfeng Gao
- Department of Cardiovascular Medicine, Second Affiliated Hospital of Xi'an, Jiaotong University, Xi'an, Shaanxi, China
| |
Collapse
|
10
|
Ibrahim M, Suleiman ME, Gandomkar Z, Tavakoli Taba A, Arnott C, Jorm L, Barraclough JY, Barbieri S, Brennan PC. Associations of Breast Arterial Calcifications with Cardiovascular Disease. J Womens Health (Larchmt) 2023; 32:529-545. [PMID: 36930147 DOI: 10.1089/jwh.2022.0394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/18/2023] Open
Abstract
Cardiovascular diseases (CVD), including coronary artery disease (CAD), continue to be the leading cause of global mortality among women. While traditional CVD/CAD prevention tools play a significant role in reducing morbidity and mortality among both men and women, current tools for preventing CVD/CAD rely on traditional risk factor-based algorithms that often underestimate CVD/CAD risk in women compared with men. In recent years, some studies have suggested that breast arterial calcifications (BAC), which are benign calcifications seen in mammograms, may be linked to CVD/CAD. Considering that millions of women older than 40 years undergo annual screening mammography for breast cancer as a regular activity, innovative risk prediction factors for CVD/CAD involving mammographic data could offer a gender-specific and convenient solution. Such factors that may be independent of, or complementary to, current risk models without extra cost or radiation exposure are worthy of detailed investigation. This review aims to discuss relevant studies examining the association between BAC and CVD/CAD and highlights some of the issues related to previous studies' design such as sample size, population types, method of assessing BAC and CVD/CAD, definition of cardiovascular events, and other confounding factors. The work may also offer insights for future CVD risk prediction research directions using routine mammograms and radiomic features other than BAC such as breast density and macrocalcifications.
Collapse
Affiliation(s)
- Mu'ath Ibrahim
- Faculty of Medicine and Health, Sydney School of Health Sciences, The University of Sydney, Sydney, Australia
| | - Mo'ayyad E Suleiman
- Faculty of Medicine and Health, Sydney School of Health Sciences, The University of Sydney, Sydney, Australia
| | - Ziba Gandomkar
- Faculty of Medicine and Health, Sydney School of Health Sciences, The University of Sydney, Sydney, Australia
| | - Amir Tavakoli Taba
- Faculty of Medicine and Health, Sydney School of Health Sciences, The University of Sydney, Sydney, Australia
| | - Clare Arnott
- Cardiovascular Program, The George Institute for Global Health, Newtown, Australia
- Department of Cardiology, Royal Prince Alfred Hospital, Camperdown, Australia
| | - Louisa Jorm
- Faculty of Medicine and Health, University of New South Wales, Sydney, Australia
- Centre for Big Data Research in Health, University of New South Wales, Sydney, Australia
| | - Jennifer Y Barraclough
- Cardiovascular Program, The George Institute for Global Health, Newtown, Australia
- Faculty of Medicine and Health, University of New South Wales, Sydney, Australia
| | - Sebastiano Barbieri
- Centre for Big Data Research in Health, University of New South Wales, Sydney, Australia
| | - Patrick C Brennan
- Faculty of Medicine and Health, Sydney School of Health Sciences, The University of Sydney, Sydney, Australia
| |
Collapse
|
11
|
Relationship between Arterial Calcifications on Mammograms and Cardiovascular Events: A Twenty-Three Year Follow-Up Retrospective Cohort Study. Biomedicines 2022; 10:biomedicines10123227. [PMID: 36551983 PMCID: PMC9776346 DOI: 10.3390/biomedicines10123227] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 12/05/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022] Open
Abstract
PURPOSE Breast arterial calcifications (BAC) have been associated with cardiovascular diseases. We aimed to examine whether the presence of BAC could predict the development of cardiovascular events in the very long term, as evidence has suggested. PATIENTS AND METHODS We conducted a 23-year follow-up retrospective cohort study considering women specifically studied for breast cancer. After reviewing the mammograms of 1759 women, we selected 128 patients with BAC and an equal number of women without BAC. RESULTS Women with BAC had higher relative risk (RR) for cardiovascular events, globally 1.66 (95% CI): 1.31-2.10 vs. 0.53 (0.39-0.72), and individually for ischemic heart disease 3.25 (1.53-6.90) vs. 0.85 (0.77-0.94), hypertensive heart disease 2.85 (1.59-5.09) vs. 0.79 (0.69-0.89), valvular heart disease 2.19 (1.28-3.75) vs. 0.83 (0.73-0.94), congestive heart failure 2.06 (1.19-3.56) vs. 0.85 (0.75-0.96), peripheral vascular disease 2.8 (1.42-5.52) vs. 0.85 (0.76-0.94), atrial fibrillation 1.83 (1.09-3.08) vs. 0.86 (0.76-0.98), and lacunar infarction 2.23 (1.21-4.09) vs. 0.86 (0.77-0.96). Cox's multivariate analysis, also considering classical risk factors, indicated that this BAC was significantly and independently associated with survival (both cardiovascular event-free and specific survival; 1.94 (1.38-2.73) and 6.6 (2.4-18.4)). CONCLUSIONS Our data confirm the strong association of BAC on mammograms and the development cardiovascular events, but also evidence the association of BAC with cardiovascular event-free and specific survival.
Collapse
|
12
|
Wang H, Sun Y, Zhu J, Zhuang Y, Song B. Diffusion-weighted imaging-based radiomics for predicting 1-year ischemic stroke recurrence. Front Neurol 2022; 13:1012896. [PMID: 36388230 PMCID: PMC9649925 DOI: 10.3389/fneur.2022.1012896] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2022] [Accepted: 10/05/2022] [Indexed: 11/30/2022] Open
Abstract
Purpose To investigate radiomics based on DWI (diffusion-weighted imaging) for predicting 1-year ischemic stroke recurrence. Methods A total of 1,580 ischemic stroke patients were enrolled in this retrospective study conducted from January 2018 to April 2021. Demographic and clinical characteristics were compared between recurrence and non-recurrence groups. On DWI, lesions were segmented using a 2D U-Net automatic segmentation network. Further, radiomics feature extraction was done using the segmented mask matrix on DWI and the corresponding ADC map. Additionally, radiomics features were extracted. The study participants were divided into a training cohort (n = 157, 57 recurrence patients, and 100 non-recurrence patients) and a test cohort (n = 846, 28 recurrence patients, 818 non-recurrence patients). A sparse representation feature selection model was performed to select features. Further classification was accomplished using a recurrent neural network (RNN). The area under the receiver operating characteristic curve values was obtained for model performance. Results A total of 1,003 ischemic stroke patients (682 men and 321 women; mean age: 65.90 ± 12.44 years) were included in the final analysis. About 85 patients (8.5%) recurred in 1 year, and patients in the recurrence group were older than the non-recurrence group (P = 0.003). The stroke subtype was significantly different between recurrence and non-recurrence groups, and cardioembolic stroke (11.3%) and large artery atherosclerosis patients (10.3%) showed a higher recurrence percentage (P = 0.005). Secondary prevention after discharge (statins, antiplatelets, and anticoagulants) was found significantly different between the two groups (P = 0.004). The area under the curve (AUC) of clinical-based model and radiomics-based model were 0.675 (95% CI: 0.643–0.707) and 0.779 (95% CI: 0.750–0.807), respectively. With an AUC of 0.847 (95% CI: 0.821–0.870), the model that combined clinical and radiomic characteristics performed better. Conclusion DWI-based radiomics could help to predict 1-year ischemic stroke recurrence.
Collapse
|
13
|
Number of Convolution Layers and Convolution Kernel Determination and Validation for Multilayer Convolutional Neural Network: Case Study in Breast Lesion Screening of Mammographic Images. Processes (Basel) 2022. [DOI: 10.3390/pr10091867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Mammography is a low-dose X-ray imaging technique that can detect breast tumors, cysts, and calcifications, which can aid in detecting potential breast cancer in the early stage and reduce the mortality rate. This study employed a multilayer convolutional neural network (MCNN) to screen breast lesions with mammographic images. Within the region of interest, a specific bounding box is used to extract feature maps before automatic image segmentation and feature classification are conducted. These include three classes, namely, normal, benign tumor, and malignant tumor. Multiconvolution processes with kernel convolution operations have noise removal and sharpening effects that are better than other image processing methods, which can strengthen the features of the desired object and contour and increase the classifier’s classification accuracy. However, excessive convolution layers and kernel convolution operations will increase the computational complexity, computational time, and training time for training the classifier. Thus, this study aimed to determine a suitable number of convolution layers and kernels to achieve a classifier with high learning performance and classification accuracy, with a case study in the breast lesion screening of mammographic images. The Mammographic Image Analysis Society Digital Mammogram Database (United Kingdom National Breast Screening Program) was used for experimental tests to determine the number of convolution layers and kernels. The optimal classifier’s performance is evaluated using accuracy (%), precision (%), recall (%), and F1 score to test and validate the most suitable MCNN model architecture.
Collapse
|
14
|
|
15
|
Breast Lesions Screening of Mammographic Images with 2D Spatial and 1D Convolutional Neural Network-Based Classifier. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157516] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Mammography is a first-line imaging examination that employs low-dose X-rays to rapidly screen breast tumors, cysts, and calcifications. This study proposes a two-dimensional (2D) spatial and one-dimensional (1D) convolutional neural network (CNN) to early detect possible breast lesions (tumors) to reduce patients’ mortality rates and to develop a classifier for use in mammographic images on regions of interest where breast lesions (tumors) may likely occur. The 2D spatial fractional-order convolutional processes are used to strengthen and sharpen the lesions’ features, denoise, and improve the feature extraction processes. Then, an automatic extraction task is performed using a specific bounding box to sequentially pick out feature patterns from each mammographic image. The multi-round 1D kernel convolutional processes can also strengthen and denoise 1D feature signals and assist in the identification of the differentiation levels of normality and abnormality signals. In the classification layer, a gray relational analysis-based classifier is used to screen the possible lesions, including normal (Nor), benign (B), and malignant (M) classes. The classifier development for clinical applications can reduce classifier’s training time, computational complexity level, computational time, and achieve a more accurate rate for meeting clinical/medical purpose. Mammographic images were selected from the mammographic image analysis society image database for experimental tests on breast lesions screening and K-fold cross-validations were performed. The experimental results showed promising performance in quantifying the classifier’s outcome for medical purpose evaluation in terms of recall (%), precision (%), accuracy (%), and F1 score.
Collapse
|
16
|
Hou R, Peng Y, Grimm LJ, Ren Y, Mazurowski MA, Marks JR, King LM, Maley CC, Hwang ES, Lo JY. Anomaly Detection of Calcifications in Mammography Based on 11,000 Negative Cases. IEEE Trans Biomed Eng 2022; 69:1639-1650. [PMID: 34788216 DOI: 10.1109/tbme.2021.3126281] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
In mammography, calcifications are one of the most common signs of breast cancer. Detection of such lesions is an active area of research for computer-aided diagnosis and machine learning algorithms. Due to limited numbers of positive cases, many supervised detection models suffer from overfitting and fail to generalize. We present a one-class, semi-supervised framework using a deep convolutional autoencoder trained with over 50,000 images from 11,000 negative-only cases. Since the model learned from only normal breast parenchymal features, calcifications produced large signals when comparing the residuals between input and reconstruction output images. As a key advancement, a structural dissimilarity index was used to suppress non-structural noises. Our selected model achieved pixel-based AUROC of 0.959 and AUPRC of 0.676 during validation, where calcification masks were defined in a semi-automated process. Although not trained directly on any cancers, detection performance of calcification lesions on 1,883 testing images (645 malignant and 1238 negative) achieved 75% sensitivity at 2.5 false positives per image. Performance plateaued early when trained with only a fraction of the cases, and greater model complexity or a larger dataset did not improve performance. This study demonstrates the potential of this anomaly detection approach to detect mammographic calcifications in a semi-supervised manner with efficient use of a small number of labeled images, and may facilitate new clinical applications such as computer-aided triage and quality improvement.
Collapse
|
17
|
Dense Convolutional Network and Its Application in Medical Image Analysis. BIOMED RESEARCH INTERNATIONAL 2022; 2022:2384830. [PMID: 35509707 PMCID: PMC9060995 DOI: 10.1155/2022/2384830] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 03/23/2022] [Indexed: 12/28/2022]
Abstract
Dense convolutional network (DenseNet) is a hot topic in deep learning research in recent years, which has good applications in medical image analysis. In this paper, DenseNet is summarized from the following aspects. First, the basic principle of DenseNet is introduced; second, the development of DenseNet is summarized and analyzed from five aspects: broaden DenseNet structure, lightweight DenseNet structure, dense unit, dense connection mode, and attention mechanism; finally, the application research of DenseNet in the field of medical image analysis is summarized from three aspects: pattern recognition, image segmentation, and object detection. The network structures of DenseNet are systematically summarized in this paper, which has certain positive significance for the research and development of DenseNet.
Collapse
|
18
|
Aljabri M, AlAmir M, AlGhamdi M, Abdel-Mottaleb M, Collado-Mesa F. Towards a better understanding of annotation tools for medical imaging: a survey. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:25877-25911. [PMID: 35350630 PMCID: PMC8948453 DOI: 10.1007/s11042-022-12100-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 08/04/2021] [Accepted: 01/03/2022] [Indexed: 05/07/2023]
Abstract
Medical imaging refers to several different technologies that are used to view the human body to diagnose, monitor, or treat medical conditions. It requires significant expertise to efficiently and correctly interpret the images generated by each of these technologies, which among others include radiography, ultrasound, and magnetic resonance imaging. Deep learning and machine learning techniques provide different solutions for medical image interpretation including those associated with detection and diagnosis. Despite the huge success of deep learning algorithms in image analysis, training algorithms to reach human-level performance in these tasks depends on the availability of large amounts of high-quality training data, including high-quality annotations to serve as ground-truth. Different annotation tools have been developed to assist with the annotation process. In this survey, we present the currently available annotation tools for medical imaging, including descriptions of graphical user interfaces (GUI) and supporting instruments. The main contribution of this study is to provide an intensive review of the popular annotation tools and show their successful usage in annotating medical imaging dataset to guide researchers in this area.
Collapse
Affiliation(s)
- Manar Aljabri
- Department of Computer Science, Umm Al-Qura University, Mecca, Saudi Arabia
| | - Manal AlAmir
- Department of Computer Science, Umm Al-Qura University, Mecca, Saudi Arabia
| | - Manal AlGhamdi
- Department of Computer Science, Umm Al-Qura University, Mecca, Saudi Arabia
| | | | - Fernando Collado-Mesa
- Department of Radiology, University of Miami Miller School of Medicine, Florida, FL USA
| |
Collapse
|
19
|
Channel pruning guided by global channel relation. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03198-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
20
|
Breast Cancer Calcifications: Identification Using a Novel Segmentation Approach. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:9905808. [PMID: 34659451 PMCID: PMC8514925 DOI: 10.1155/2021/9905808] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 09/12/2021] [Accepted: 09/21/2021] [Indexed: 12/23/2022]
Abstract
Breast cancer is a strong risk factor of cancer amongst women. One in eight women suffers from breast cancer. It is a life-threatening illness and is utterly dreadful. The root cause which is the breast cancer agent is still under research. There are, however, certain potentially dangerous factors like age, genetics, obesity, birth control, cigarettes, and tablets. Breast cancer is often a malignant tumor that begins in the breast cells and eventually spreads to the surrounding tissue. If detected early, the illness may be reversible. The probability of preservation diminishes as the number of measurements increases. Numerous imaging techniques are used to identify breast cancer. This research examines different breast cancer detection strategies via the use of imaging techniques, data mining techniques, and various characteristics, as well as a brief comparative analysis of the existing breast cancer detection system. Breast cancer mortality will be significantly reduced if it is identified and treated early. There are technological difficulties linked to scans and people's inconsistency with breast cancer. In this study, we introduced a form of breast cancer diagnosis. There are different methods involved to collect and analyze details. In the preprocessing stage, the input data picture is filtered by using a window or by cropping. Segmentation can be performed using k-means algorithm. This study is aimed at identifying the calcifications found in bosom cancer in the last phase. The suggested approach is already implemented in MATLAB, and it produces reliable performance.
Collapse
|
21
|
Oza P, Sharma P, Patel S, Bruno A. A Bottom-Up Review of Image Analysis Methods for Suspicious Region Detection in Mammograms. J Imaging 2021; 7:190. [PMID: 34564116 PMCID: PMC8466003 DOI: 10.3390/jimaging7090190] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Revised: 09/09/2021] [Accepted: 09/14/2021] [Indexed: 11/17/2022] Open
Abstract
Breast cancer is one of the most common death causes amongst women all over the world. Early detection of breast cancer plays a critical role in increasing the survival rate. Various imaging modalities, such as mammography, breast MRI, ultrasound and thermography, are used to detect breast cancer. Though there is a considerable success with mammography in biomedical imaging, detecting suspicious areas remains a challenge because, due to the manual examination and variations in shape, size, other mass morphological features, mammography accuracy changes with the density of the breast. Furthermore, going through the analysis of many mammograms per day can be a tedious task for radiologists and practitioners. One of the main objectives of biomedical imaging is to provide radiologists and practitioners with tools to help them identify all suspicious regions in a given image. Computer-aided mass detection in mammograms can serve as a second opinion tool to help radiologists avoid running into oversight errors. The scientific community has made much progress in this topic, and several approaches have been proposed along the way. Following a bottom-up narrative, this paper surveys different scientific methodologies and techniques to detect suspicious regions in mammograms spanning from methods based on low-level image features to the most recent novelties in AI-based approaches. Both theoretical and practical grounds are provided across the paper sections to highlight the pros and cons of different methodologies. The paper's main scope is to let readers embark on a journey through a fully comprehensive description of techniques, strategies and datasets on the topic.
Collapse
Affiliation(s)
- Parita Oza
- Computer Science and Engineering Department, School of Technology, Pandit Deendayal Energy University, Gandhinagar 382007, India; (P.S.); (S.P.)
| | - Paawan Sharma
- Computer Science and Engineering Department, School of Technology, Pandit Deendayal Energy University, Gandhinagar 382007, India; (P.S.); (S.P.)
| | - Samir Patel
- Computer Science and Engineering Department, School of Technology, Pandit Deendayal Energy University, Gandhinagar 382007, India; (P.S.); (S.P.)
| | - Alessandro Bruno
- Department of Computing and Informatics, Bournemouth University, Poole, Dorset BH12 5BB, UK
| |
Collapse
|
22
|
Mahmud T, Rahman MA, Fattah SA, Kung SY. CovSegNet: A Multi Encoder-Decoder Architecture for Improved Lesion Segmentation of COVID-19 Chest CT Scans. IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE 2021; 2:283-297. [PMID: 37981918 PMCID: PMC8545036 DOI: 10.1109/tai.2021.3064913] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 01/08/2021] [Accepted: 03/01/2021] [Indexed: 11/21/2023]
Abstract
Automatic lung lesion segmentation of chest computer tomography (CT) scans is considered a pivotal stage toward accurate diagnosis and severity measurement of COVID-19. Traditional U-shaped encoder-decoder architecture and its variants suffer from diminutions of contextual information in pooling/upsampling operations with increased semantic gaps among encoded and decoded feature maps as well as instigate vanishing gradient problems for its sequential gradient propagation that result in suboptimal performance. Moreover, operating with 3-D CT volume poses further limitations due to the exponential increase of computational complexity making the optimization difficult. In this article, an automated COVID-19 lesion segmentation scheme is proposed utilizing a highly efficient neural network architecture, namely CovSegNet, to overcome these limitations. Additionally, a two-phase training scheme is introduced where a deeper 2-D network is employed for generating region-of-interest (ROI)-enhanced CT volume followed by a shallower 3-D network for further enhancement with more contextual information without increasing computational burden. Along with the traditional vertical expansion of Unet, we have introduced horizontal expansion with multistage encoder-decoder modules for achieving optimum performance. Additionally, multiscale feature maps are integrated into the scale transition process to overcome the loss of contextual information. Moreover, a multiscale fusion module is introduced with a pyramid fusion scheme to reduce the semantic gaps between subsequent encoder/decoder modules while facilitating the parallel optimization for efficient gradient propagation. Outstanding performances have been achieved in three publicly available datasets that largely outperform other state-of-the-art approaches. The proposed scheme can be easily extended for achieving optimum segmentation performances in a wide variety of applications. Impact Statement-With lower sensitivity (60-70%), elongated testing time, and a dire shortage of testing kits, traditional RTPCR based COVID-19 diagnostic scheme heavily relies on postCT based manual inspection for further investigation. Hence, automating the process of infected lesions extraction from chestCT volumes will be major progress for faster accurate diagnosis of COVID-19. However, in challenging conditions with diffused, blurred, and varying shaped edges of COVID-19 lesions, conventional approaches fail to provide precise segmentation of lesions that can be deleterious for false estimation and loss of information. The proposed scheme incorporating an efficient neural network architecture (CovSegNet) overcomes the limitations of traditional approaches that provide significant improvement of performance (8.4% in averaged dice measurement scale) over two datasets. Therefore, this scheme can be an effective, economical tool for the physicians for faster infection analysis to greatly reduce the spread and massive death toll of this deadly virus through mass-screening.
Collapse
Affiliation(s)
- Tanvir Mahmud
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and TechnologyDhaka1000Bangladesh
| | - Md Awsafur Rahman
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and TechnologyDhaka1000Bangladesh
| | - Shaikh Anowarul Fattah
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and TechnologyDhaka1000Bangladesh
| | - Sun-Yuan Kung
- Department of Electrical EngineeringPrinceton UniversityPrincetonNJ08544USA
| |
Collapse
|