1
|
Luo Y, Xu Y, Wang C, Li Q, Fu C, Jiang H. ResNeXt-CC: a novel network based on cross-layer deep-feature fusion for white blood cell classification. Sci Rep 2024; 14:18439. [PMID: 39117714 PMCID: PMC11310349 DOI: 10.1038/s41598-024-69076-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Accepted: 07/31/2024] [Indexed: 08/10/2024] Open
Abstract
Accurate diagnosis of white blood cells from cytopathological images is a crucial step in evaluating leukaemia. In recent years, image classification methods based on fully convolutional networks have drawn extensive attention and achieved competitive performance in medical image classification. In this paper, we propose a white blood cell classification network called ResNeXt-CC for cytopathological images. First, we transform cytopathological images from the RGB color space to the HSV color space so as to precisely extract the texture features, color changes and other details of white blood cells. Second, since cell classification primarily relies on distinguishing local characteristics, we design a cross-layer deep-feature fusion module to enhance our ability to extract discriminative information. Third, the efficient attention mechanism based on the ECANet module is used to promote the feature extraction capability of cell details. Finally, we combine the modified softmax loss function and the central loss function to train the network, thereby effectively addressing the problem of class imbalance and improving the network performance. The experimental results on the C-NMC 2019 dataset show that our proposed method manifests obvious advantages over the existing classification methods, including ResNet-50, Inception-V3, Densenet121, VGG16, Cross ViT, Token-to-Token ViT, Deep ViT, and simple ViT about 5.5-20.43% accuracy, 3.6-23.56% F1-score, 3.5-25.71% AUROC and 8.1-36.98% specificity, respectively.
Collapse
Affiliation(s)
- Yang Luo
- School of Artificial Intelligence, Anshan Normal University, Anshan, 114007, Liaoning, China
| | - Ying Xu
- Anshan Central Hospital, Anshan, 114000, Liaoning, China
| | - Changbin Wang
- School of Artificial Intelligence, Anshan Normal University, Anshan, 114007, Liaoning, China
| | - Qiuju Li
- School of Artificial Intelligence, Anshan Normal University, Anshan, 114007, Liaoning, China
| | - Chong Fu
- School of Computer Science and Engineering, Northeastern University, Shenyang, 110819, Liaoning, China
- Engineering Research Center of Security Technology of Complex Network System, Ministry of Education, Shenyang, 110819, Liaoning, China
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, 110819, Liaoning, China
| | - Hongyang Jiang
- Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, 518055, Guangdong, China.
| |
Collapse
|
2
|
Luo Y, Wang Y, Zhao Y, Guan W, Shi H, Fu C, Jiang H. A lightweight network based on dual-stream feature fusion and dual-domain attention for white blood cells segmentation. Front Oncol 2023; 13:1223353. [PMID: 37731631 PMCID: PMC10507331 DOI: 10.3389/fonc.2023.1223353] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 08/04/2023] [Indexed: 09/22/2023] Open
Abstract
Introduction Accurate white blood cells segmentation from cytopathological images is crucial for evaluating leukemia. However, segmentation is difficult in clinical practice. Given the very large numbers of cytopathological images to be processed, diagnosis becomes cumbersome and time consuming, and diagnostic accuracy is also closely related to experts' experience, fatigue and mood and so on. Besides, fully automatic white blood cells segmentation is challenging for several reasons. There exists cell deformation, blurred cell boundaries, and cell color differences, cells overlapping or adhesion. Methods The proposed method improves the feature representation capability of the network while reducing parameters and computational redundancy by utilizing the feature reuse of Ghost module to reconstruct a lightweight backbone network. Additionally, a dual-stream feature fusion network (DFFN) based on the feature pyramid network is designed to enhance detailed information acquisition. Furthermore, a dual-domain attention module (DDAM) is developed to extract global features from both frequency and spatial domains simultaneously, resulting in better cell segmentation performance. Results Experimental results on ALL-IDB and BCCD datasets demonstrate that our method outperforms existing instance segmentation networks such as Mask R-CNN, PointRend, MS R-CNN, SOLOv2, and YOLACT with an average precision (AP) of 87.41%, while significantly reducing parameters and computational cost. Discussion Our method is significantly better than the current state-of-the-art single-stage methods in terms of both the number of parameters and FLOPs, and our method has the best performance among all compared methods. However, the performance of our method is still lower than the two-stage instance segmentation algorithms. in future work, how to design a more lightweight network model while ensuring a good accuracy will become an important problem.
Collapse
Affiliation(s)
- Yang Luo
- School of Mathematics and Information Science, Anshan Normal University, Anshan, Liaoning, China
| | - Yingwei Wang
- School of Mathematics and Information Science, Anshan Normal University, Anshan, Liaoning, China
| | - Yongda Zhao
- School of Mathematics and Information Science, Anshan Normal University, Anshan, Liaoning, China
| | - Wei Guan
- School of Applied Technology, Anshan Normal University, Anshan, Liaoning, China
| | - Hanfeng Shi
- Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, Guangdong, China
| | - Chong Fu
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
- Engineering Research Center of Security Technology of Complex Network System, Ministry of Education, Shenyang, China
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, China
| | - Hongyang Jiang
- Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, Guangdong, China
| |
Collapse
|
3
|
Single Channel Image Enhancement (SCIE) of White Blood Cells Based on Virtual Hexagonal Filter (VHF) Designed over Square Trellis. J Pers Med 2022; 12:jpm12081232. [PMID: 36013181 PMCID: PMC9410214 DOI: 10.3390/jpm12081232] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 07/06/2022] [Accepted: 07/12/2022] [Indexed: 11/17/2022] Open
Abstract
White blood cells (WBCs) are the important constituent of a blood cell. These blood cells are responsible for defending the body against infections. Abnormalities identified in WBC smears lead to the diagnosis of disease types such as leukocytosis, hepatitis, and immune system disorders. Digital image analysis for infection detection at an early stage can help fast and precise diagnosis, as compared to manual inspection. Sometimes, acquired blood cell smear images from an L2-type microscope are of very low quality. The manual handling, haziness, and dark areas of the image become problematic for an efficient and accurate diagnosis. Therefore, WBC image enhancement needs attention for an effective diagnosis of the disease. This paper proposed a novel virtual hexagonal trellis (VHT)-based image filtering method for WBC image enhancement and contrast adjustment. In this method, a filter named the virtual hexagonal filter (VHF), of size 3 × 3, and based on a hexagonal structure, is formulated by using the concept of the interpolation of real and square grid pixels. This filter is convolved with WBC ALL-IBD images for enhancement and contrast adjustment. The proposed filter improves the results both visually and statically. A comparison with existing image enhancement approaches proves the validity of the proposed work.
Collapse
|
4
|
Xu W, Xie Y, Zhang X, Li W. Cerebral Angiography under Artificial Intelligence Algorithm in the Design of Nursing Cooperation Plan for Intracranial Aneurysm Patients in Craniotomy Clipping. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:2182931. [PMID: 35860187 PMCID: PMC9293491 DOI: 10.1155/2022/2182931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 06/19/2022] [Accepted: 06/21/2022] [Indexed: 11/18/2022]
Abstract
This research was to investigate the value of indocyanine green angiography (ICGA) based on maximum interclass variance (Otsu) method in the nursing plan of intracranial aneurysm clipping (ICAC) for intracranial aneurysm patients. An Otsu algorithm was selected to optimize the original images with the optimal threshold. In addition, the algorithm was applied to ICGA images of 86 patients with intracranial aneurysms, who were randomly divided into an experimental group (using ICGA + ICAC+ perioperative nursing) and a control group (ICAC + conventional nursing), to observe the clinical indicators, treatment, complications, nursing satisfaction, and quality of life of patients in two groups. The results showed that the mean square error (MSE), structural similarity (SSIM), and shape error (SE) were 3.71, 0.84, and 0.47, respectively. The length of hospital stay in the experimental group (19.9 ± 3.5 days) was significantly shorter than that in the control group (23.2 ± 3.0 days), the rate of excellent treatment was significantly higher than that in the control group, and the incidence of complications was lower. WHOQOL-BREF scores of the two groups after nursing intervention were higher than before, and the score in the experimental group was higher than the control group. In addition, the nursing satisfaction was also significantly higher in the experimental group, and the difference was statistically significant (P < 0.05). In conclusion, ICGA based on the Otsu method could effectively evaluate the cerebrovascular morphology during craniotomy and ICAP and improve the surgical efficacy. Combined with perioperative nursing intervention, it could greatly reduce the incidence of postoperative complications, improve the treatment effect and quality of life, and enhance the long-term prognosis.
Collapse
Affiliation(s)
- Wenhui Xu
- Operation Room, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, 310000 Zhejiang, China
| | - Yanan Xie
- Anesthesia Operation Center, Hainan Hospital of PLA General Hospital, Sanya, 572013 Hainan, China
| | - Xu Zhang
- Operation Room, Zhejiang Provincial People's Hospital, Hangzhou, 310000 Zhejiang, China
| | - Wei Li
- Operation Room, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou, 310000 Zhejiang, China
| |
Collapse
|
5
|
Bian X, Pan H, Zhang K, Chen C, Liu P, Shi K. NeDSeM: Neutrosophy Domain-Based Segmentation Method for Malignant Melanoma Images. ENTROPY 2022; 24:e24060783. [PMID: 35741504 PMCID: PMC9222744 DOI: 10.3390/e24060783] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 05/23/2022] [Accepted: 05/30/2022] [Indexed: 02/07/2023]
Abstract
Skin lesion segmentation is the first and indispensable step of malignant melanoma recognition and diagnosis. At present, most of the existing skin lesions segmentation techniques often used traditional methods like optimum thresholding, etc., and deep learning methods like U-net, etc. However, the edges of skin lesions in malignant melanoma images are gradually changed in color, and this change is nonlinear. The existing methods can not effectively distinguish banded edges between lesion areas and healthy skin areas well. Aiming at the uncertainty and fuzziness of banded edges, the neutrosophic set theory is used in this paper which is better than fuzzy theory to deal with banded edge segmentation. Therefore, we proposed a neutrosophy domain-based segmentation method that contains six steps. Firstly, an image is converted into three channels and the pixel matrix of each channel is obtained. Secondly, the pixel matrixes are converted into Neutrosophic Set domain by using the neutrosophic set conversion method to express the uncertainty and fuzziness of banded edges of malignant melanoma images. Thirdly, a new Neutrosophic Entropy model is proposed to combine the three memberships according to some rules by using the transformations in the neutrosophic space to comprehensively express three memberships and highlight the banded edges of the images. Fourthly, the feature augment method is established by the difference of three components. Fifthly, the dilation is used on the neutrosophic entropy matrixes to fill in the noise region. Finally, the image that is represented by transformed matrix is segmented by the Hierarchical Gaussian Mixture Model clustering method to obtain the banded edge of the image. Qualitative and quantitative experiments are performed on malignant melanoma image dataset to evaluate the performance of the NeDSeM method. Compared with some state-of-the-art methods, our method has achieved good results in terms of performance and accuracy.
Collapse
|
6
|
Machine learning-based identification of craniosynostosis in newborns. MACHINE LEARNING WITH APPLICATIONS 2022. [DOI: 10.1016/j.mlwa.2022.100292] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
|