1
|
Lin C, Chen Y, Feng S, Huang M. A multibranch and multiscale neural network based on semantic perception for multimodal medical image fusion. Sci Rep 2024; 14:17609. [PMID: 39080442 PMCID: PMC11289490 DOI: 10.1038/s41598-024-68183-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 07/22/2024] [Indexed: 08/02/2024] Open
Abstract
Medical imaging is indispensable for accurate diagnosis and effective treatment, with modalities like MRI and CT providing diverse yet complementary information. Traditional image fusion methods, while essential in consolidating information from multiple modalities, often suffer from poor image quality and loss of crucial details due to inadequate handling of semantic information and limited feature extraction capabilities. This paper introduces a novel medical image fusion technique leveraging unsupervised image segmentation to enhance the semantic understanding of the fusion process. The proposed method, named DUSMIF, employs a multi-branch, multi-scale deep learning architecture that integrates advanced attention mechanisms to refine the feature extraction and fusion processes. An innovative approach that utilizes unsupervised image segmentation to extract semantic information is introduced, which is then integrated into the fusion process. This not only enhances the semantic relevance of the fused images but also improves the overall fusion quality. The paper proposes a sophisticated network structure that extracts and fuses features at multiple scales and across multiple branches. This structure is designed to capture a comprehensive range of image details and contextual information, significantly improving the fusion outcomes. Multiple attention mechanisms are incorporated to selectively emphasize important features and integrate them effectively across different modalities and scales. This approach ensures that the fused images maintain high quality and detail fidelity. A joint loss function combining content loss, structural similarity loss, and semantic loss is formulated. This function not only guides the network in preserving image brightness and texture but also ensures that the fused image closely resembles the source images in both content and structure. The proposed method demonstrates superior performance over existing fusion techniques in objective assessments and subjective evaluations, confirming its effectiveness in enhancing the diagnostic utility of fused medical images.
Collapse
Affiliation(s)
- Cong Lin
- School of Information and Communication Engineering, Hainan University, Haikou, 570228, Hainan, China
| | - Yinjie Chen
- School of Information and Communication Engineering, Hainan University, Haikou, 570228, Hainan, China
| | - Siling Feng
- School of Information and Communication Engineering, Hainan University, Haikou, 570228, Hainan, China.
| | - Mengxing Huang
- School of Information and Communication Engineering, Hainan University, Haikou, 570228, Hainan, China.
| |
Collapse
|
2
|
Wu M, Peng H, Liu Z, Wang J. Seizure Detection of EEG Signals Based on Multi-Channel Long- and Short-Term Memory-Like Spiking Neural Model. Int J Neural Syst 2024:2450051. [PMID: 39004932 DOI: 10.1142/s0129065724500515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/16/2024]
Abstract
Seizure is a common neurological disorder that usually manifests itself in recurring seizure, and these seizures can have a serious impact on a person's life and health. Therefore, early detection and diagnosis of seizure is crucial. In order to improve the efficiency of early detection and diagnosis of seizure, this paper proposes a new seizure detection method, which is based on discrete wavelet transform (DWT) and multi-channel long- and short-term memory-like spiking neural P (LSTM-SNP) model. First, the signal is decomposed into 5 levels by using DWT transform to obtain the features of the components at different frequencies, and a series of time-frequency features in wavelet coefficients are extracted. Then, these different features are used to train a multi-channel LSTM-SNP model and perform seizure detection. The proposed method achieves a high seizure detection accuracy on the CHB-MIT dataset: 98.25% accuracy, 98.22% specificity and 97.59% sensitivity. This indicates that the proposed epilepsy detection method can show competitive detection performance.
Collapse
Affiliation(s)
- Min Wu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Zhicai Liu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu 610039, P. R. China
| |
Collapse
|
3
|
Zhou C, Ye L, Peng H, Liu Z, Wang J, Ramírez-De-Arellano A. A Parallel Convolutional Network Based on Spiking Neural Systems. Int J Neural Syst 2024; 34:2450022. [PMID: 38487872 DOI: 10.1142/s0129065724500229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2024]
Abstract
Deep convolutional neural networks have shown advanced performance in accurately segmenting images. In this paper, an SNP-like convolutional neuron structure is introduced, abstracted from the nonlinear mechanism in nonlinear spiking neural P (NSNP) systems. Then, a U-shaped convolutional neural network named SNP-like parallel-convolutional network, or SPC-Net, is constructed for segmentation tasks. The dual-convolution concatenate (DCC) and dual-convolution addition (DCA) network blocks are designed, respectively, in the encoder and decoder stages. The two blocks employ parallel convolution with different kernel sizes to improve feature representation ability and make full use of spatial detail information. Meanwhile, different feature fusion strategies are used to fuse their features to achieve feature complementarity and augmentation. Furthermore, a dual-scale pooling (DSP) module in the bottleneck is designed to improve the feature extraction capability, which can extract multi-scale contextual information and reduce information loss while extracting salient features. The SPC-Net is applied in medical image segmentation tasks and is compared with several recent segmentation methods on the GlaS and CRAG datasets. The proposed SPC-Net achieves 90.77% DICE coefficient, 83.76% IoU score and 83.93% F1 score, 86.33% ObjDice coefficient, 135.60 Obj-Hausdorff distance, respectively. The experimental results show that the proposed model can achieve good segmentation performance.
Collapse
Affiliation(s)
- Chi Zhou
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Lulin Ye
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Zhicai Liu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu 610039, P. R. China
| | - Antonio Ramírez-De-Arellano
- Research Group of Natural Computing, Department of Computer Science and Artificial Intelligence, University of Seville, Sevilla 41012, Spain
| |
Collapse
|
4
|
Liang L, Gao Z. SharDif: Sharing and Differential Learning for Image Fusion. ENTROPY (BASEL, SWITZERLAND) 2024; 26:57. [PMID: 38248182 PMCID: PMC10814104 DOI: 10.3390/e26010057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/06/2024] [Accepted: 01/08/2024] [Indexed: 01/23/2024]
Abstract
Image fusion is the generation of an informative image that contains complementary information from the original sensor images, such as texture details and attentional targets. Existing methods have designed a variety of feature extraction algorithms and fusion strategies to achieve image fusion. However, these methods ignore the extraction of common features in the original multi-source images. The point of view proposed in this paper is that image fusion is to retain, as much as possible, the useful shared features and complementary differential features of the original multi-source images. Shared and differential learning methods for infrared and visible light image fusion are proposed. An encoder with shared weights is used to extract shared common features contained in infrared and visible light images, and the other two encoder blocks are used to extract differential features of infrared images and visible light images, respectively. Effective learning of shared and differential features is achieved through weight sharing and loss functions. Then, the fusion of shared features and differential features is achieved via a weighted fusion strategy based on an entropy-weighted attention mechanism. The experimental results demonstrate the effectiveness of the proposed model with its algorithm. Compared with the-state-of-the-art methods, the significant advantage of the proposed method is that it retains the structural information of the original image and has better fusion accuracy and visual perception effect.
Collapse
Affiliation(s)
- Lei Liang
- College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China;
- Low Speed Aerodynamics Institute, China Aerodynamics Research and Development Center, Mianyang 621000, China
| | - Zhisheng Gao
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, China
| |
Collapse
|
5
|
Peng H, Xiong X, Wu M, Wang J, Yang Q, Orellana-Martín D, Pérez-Jiménez MJ. Reservoir computing models based on spiking neural P systems for time series classification. Neural Netw 2024; 169:274-281. [PMID: 37918270 DOI: 10.1016/j.neunet.2023.10.041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 09/12/2023] [Accepted: 10/25/2023] [Indexed: 11/04/2023]
Abstract
Nonlinear spiking neural P (NSNP) systems are neural-like membrane computing models with nonlinear spiking mechanisms. Because of this nonlinear spiking mechanism, NSNP systems can show rich nonlinear dynamics. Reservoir computing (RC) is a novel recurrent neural network (RNN) and can overcome some shortcomings of traditional RNNs. Based on NSNP systems, we developed two RC variants for time series classification, RC-SNP and RC-RMS-SNP, which are without and integrated with reservoir model space (RMS), respectively. The two RC variants use NSNP systems as the reservoirs and can be easily implemented in the RC framework. The proposed two RC variants were evaluated on 17 benchmark time series classification datasets and compared with 16 state-of-the-art or baseline classification models. The comparison results demonstrate the effectiveness of the proposed two RC variants for time series classification tasks.
Collapse
Affiliation(s)
- Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China.
| | - Xin Xiong
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China
| | - Min Wu
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu, 610039, China
| | - Qian Yang
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China
| | - David Orellana-Martín
- Research Group of Natural Computing, Department of Computer Science and Artificial Intelligence, University of Seville, Sevilla, 41012, Spain
| | - Mario J Pérez-Jiménez
- Research Group of Natural Computing, Department of Computer Science and Artificial Intelligence, University of Seville, Sevilla, 41012, Spain
| |
Collapse
|
6
|
Liu Q, Long L, Peng H, Wang J, Yang Q, Song X, Riscos-Nunez A, Perez-Jimenez MJ. Gated Spiking Neural P Systems for Time Series Forecasting. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:6227-6236. [PMID: 34936560 DOI: 10.1109/tnnls.2021.3134792] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Spiking neural P (SNP) systems are a class of neural-like computing models, abstracted by the mechanism of spiking neurons. This article proposes a new variant of SNP systems, called gated spiking neural P (GSNP) systems, which are composed of gated neurons. Two gated mechanisms are introduced in the nonlinear spiking mechanism of GSNP systems, consisting of a reset gate and a consumption gate. The two gates are used to control the updating of states in neurons. Based on gated neurons, a prediction model for time series is developed, known as the GSNP model. Several benchmark univariate and multivariate time series are used to evaluate the proposed GSNP model and to compare several state-of-the-art prediction models. The comparison results demonstrate the availability and effectiveness of GSNP for time series forecasting.
Collapse
|
7
|
Sanaullah, Koravuna S, Rückert U, Jungeblut T. Evaluation of Spiking Neural Nets-Based Image Classification Using the Runtime Simulator RAVSim. Int J Neural Syst 2023; 33:2350044. [PMID: 37604777 DOI: 10.1142/s0129065723500442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/23/2023]
Abstract
Spiking Neural Networks (SNNs) help achieve brain-like efficiency and functionality by building neurons and synapses that mimic the human brain's transmission of electrical signals. However, optimal SNN implementation requires a precise balance of parametric values. To design such ubiquitous neural networks, a graphical tool for visualizing, analyzing, and explaining the internal behavior of spikes is crucial. Although some popular SNN simulators are available, these tools do not allow users to interact with the neural network during simulation. To this end, we have introduced the first runtime interactive simulator, called Runtime Analyzing and Visualization Simulator (RAVSim),a developed to analyze and dynamically visualize the behavior of SNNs, allowing end-users to interact, observe output concentration reactions, and make changes directly during the simulation. In this paper, we present RAVSim with the current implementation of runtime interaction using the LIF neural model with different connectivity schemes, an image classification model using SNNs, and a dataset creation feature. Our main objective is to primarily investigate binary classification using SNNs with RGB images. We created a feed-forward network using the LIF neural model for an image classification algorithm and evaluated it by using RAVSim. The algorithm classifies faces with and without masks, achieving an accuracy of 91.8% using 1000 neurons in a hidden layer, 0.0758 MSE, and an execution time of ∼10[Formula: see text]min on the CPU. The experimental results show that using RAVSim not only increases network design speed but also accelerates user learning capability.
Collapse
Affiliation(s)
- Sanaullah
- Department of Engineering and Mathematics, Bielefeld University of Applied Science, Bielefeld, Germany
| | - Shamini Koravuna
- Department of Cognitive Interaction Technology Center, Bielefeld University, Bielefeld, Germany
| | - Ulrich Rückert
- Department of Cognitive Interaction Technology Center, Bielefeld University, Bielefeld, Germany
| | - Thorsten Jungeblut
- Department of Engineering and Mathematics, Bielefeld University of Applied Science, Bielefeld, Germany
| |
Collapse
|
8
|
Liu Q, Huang Y, Yang Q, Peng H, Wang J. An Attention-Aware Long Short-Term Memory-Like Spiking Neural Model for Sentiment Analysis. Int J Neural Syst 2023; 33:2350037. [PMID: 37303084 DOI: 10.1142/s0129065723500375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
LSTM-SNP model is a recently developed long short-term memory (LSTM) network, which is inspired from the mechanisms of spiking neural P (SNP) systems. In this paper, LSTM-SNP is utilized to propose a novel model for aspect-level sentiment analysis, termed as ALS model. The LSTM-SNP model has three gates: reset gate, consumption gate and generation gate. Moreover, attention mechanism is integrated with LSTM-SNP model. The ALS model can better capture the sentiment features in the text to compute the correlation between context and aspect words. To validate the effectiveness of the ALS model for aspect-level sentiment analysis, comparison experiments with 17 baseline models are conducted on three real-life data sets. The experimental results demonstrate that the ALS model has a simpler structure and can achieve better performance compared to these baseline models.
Collapse
Affiliation(s)
- Qian Liu
- School of Computer and Software Engineering, Xihua University, P. R. China
| | - Yanping Huang
- School of Computer and Software Engineering, Xihua University, P. R. China
| | - Qian Yang
- School of Computer and Software Engineering, Xihua University, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, P. R. China
| |
Collapse
|
9
|
Dinh PH. Combining spectral total variation with dynamic threshold neural P systems for medical image fusion. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104343] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
10
|
Spiking Neural P System with Synaptic Vesicles and Applications in Multiple Brain Metastasis Segmentation. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.01.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
|
11
|
Yadav AS, Kumar S, Karetla GR, Cotrina-Aliaga JC, Arias-Gonzáles JL, Kumar V, Srivastava S, Gupta R, Ibrahim S, Paul R, Naik N, Singla B, Tatkar NS. A Feature Extraction Using Probabilistic Neural Network and BTFSC-Net Model with Deep Learning for Brain Tumor Classification. J Imaging 2022; 9:jimaging9010010. [PMID: 36662108 PMCID: PMC9865827 DOI: 10.3390/jimaging9010010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 12/21/2022] [Accepted: 12/28/2022] [Indexed: 01/03/2023] Open
Abstract
BACKGROUND AND OBJECTIVES Brain Tumor Fusion-based Segments and Classification-Non-enhancing tumor (BTFSC-Net) is a hybrid system for classifying brain tumors that combine medical image fusion, segmentation, feature extraction, and classification procedures. MATERIALS AND METHODS to reduce noise from medical images, the hybrid probabilistic wiener filter (HPWF) is first applied as a preprocessing step. Then, to combine robust edge analysis (REA) properties in magnetic resonance imaging (MRI) and computed tomography (CT) medical images, a fusion network based on deep learning convolutional neural networks (DLCNN) is developed. Here, the brain images' slopes and borders are detected using REA. To separate the sick region from the color image, adaptive fuzzy c-means integrated k-means (HFCMIK) clustering is then implemented. To extract hybrid features from the fused image, low-level features based on the redundant discrete wavelet transform (RDWT), empirical color features, and texture characteristics based on the gray-level cooccurrence matrix (GLCM) are also used. Finally, to distinguish between benign and malignant tumors, a deep learning probabilistic neural network (DLPNN) is deployed. RESULTS according to the findings, the suggested BTFSC-Net model performed better than more traditional preprocessing, fusion, segmentation, and classification techniques. Additionally, 99.21% segmentation accuracy and 99.46% classification accuracy were reached using the proposed BTFSC-Net model. CONCLUSIONS earlier approaches have not performed as well as our presented method for image fusion, segmentation, feature extraction, classification operations, and brain tumor classification. These results illustrate that the designed approach performed more effectively in terms of enhanced quantitative evaluation with better accuracy as well as visual performance.
Collapse
Affiliation(s)
- Arun Singh Yadav
- Department of Computer Science, University of Lucknow, Lucknow 226007, Uttar Pradesh, India
| | - Surendra Kumar
- Department of Computer Application, Marwadi University, Rajkot 360003, Gujrat, India
| | - Girija Rani Karetla
- School of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, NSW 2751, Australia
| | | | - José Luis Arias-Gonzáles
- Department of Business, Pontificia Universidad Católica del Perú, Av. Universitaria 1801, San Miguel 15088, Peru
| | - Vinod Kumar
- Department of Computer Applications, ABES Engineering College, Ghaziabad 201009, Uttar Pradesh, India
| | - Satyajee Srivastava
- Department of Computer Science and Engineering, University of Engineering and Technology Roorkee, Roorkee 247667, Uttarakhand, India
| | - Reena Gupta
- Department of Pharmacognosy, Institute of Pharmaceutical Research, GLA University, Mathura 281406, Uttar Pradesh, India
| | - Sufyan Ibrahim
- Neuro-Informatics Laboratory, Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55905, USA
| | - Rahul Paul
- Department of Radiation Oncology, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02115, USA
- iTRUE (International Training and Research in Uro-Oncology and Endourology) Group, Manipal 576104, Karnataka, India
| | - Nithesh Naik
- iTRUE (International Training and Research in Uro-Oncology and Endourology) Group, Manipal 576104, Karnataka, India
- Department of Mechanical and Industrial Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, Karnataka, India
- Curiouz TechLab Private Limited, BIRAC-BioNEST, Manipal Government of Karnataka Bioincubator, Manipal 576104, Karnataka, India
- Correspondence: ; Tel.: +91-83-1087-4339
| | - Babita Singla
- Chitkara Business School, Chitkara University, Chandigarh 140401, Punjab, India
| | - Nisha S. Tatkar
- Department of Postgraduate Diploma in Management, Institute of PGDM, Mumbai Education Trust, Mumbai 400050, Maharashtra, India
| |
Collapse
|
12
|
Huang Y, Peng H, Liu Q, Yang Q, Wang J, Orellana-Martín D, Pérez-Jiménez MJ. Attention-enabled gated spiking neural P model for aspect-level sentiment classification. Neural Netw 2022; 157:437-443. [DOI: 10.1016/j.neunet.2022.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Revised: 10/19/2022] [Accepted: 11/03/2022] [Indexed: 11/11/2022]
|
13
|
Ramprasad MVS, Rahman MZU, Bayleyegn MD. A Deep Probabilistic Sensing and Learning Model for Brain Tumor Classification With Fusion-Net and HFCMIK Segmentation. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2022; 3:178-188. [PMID: 36712319 PMCID: PMC9870266 DOI: 10.1109/ojemb.2022.3217186] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 10/14/2022] [Accepted: 10/17/2022] [Indexed: 11/06/2022] Open
Abstract
Goal: Implementation of an artificial intelli gence-based medical diagnosis tool for brain tumor classification, which is called the BTFSC-Net. Methods: Medical images are preprocessed using a hybrid probabilistic wiener filter (HPWF) The deep learning convolutional neural network (DLCNN) was utilized to fuse MRI and CT images with robust edge analysis (REA) properties, which are used to identify the slopes and edges of source images. Then, hybrid fuzzy c-means integrated k-means (HFCMIK) clustering is used to segment the disease affected region from the fused image. Further, hybrid features such as texture, colour, and low-level features are extracted from the fused image by using gray-level cooccurrence matrix (GLCM), redundant discrete wavelet transform (RDWT) descriptors. Finally, a deep learning based probabilistic neural network (DLPNN) is used to classify malignant and benign tumors. The BTFSC-Net attained 99.21% of segmentation accuracy and 99.46% of classification accuracy. Conclusions: The simulations showed that BTFSC-Net outperformed as compared to existing methods.
Collapse
Affiliation(s)
- M V S Ramprasad
- Koneru Lakshmaiah Education FoundationK L University Guntur 522302 India
- GITAM (Deemed to be University) Visakhapatnam AP 522502 India
| | - Md Zia Ur Rahman
- Department of Electronics and Communication Engineering, Koneru Lakshmaiah Education FoundationK L University Vaddeswaram Guntur 522502 India
| | | |
Collapse
|
14
|
Deep Learning-Based CT Imaging for the Diagnosis of Liver Tumor. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3045370. [PMID: 35755728 PMCID: PMC9225866 DOI: 10.1155/2022/3045370] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Revised: 05/05/2022] [Accepted: 05/14/2022] [Indexed: 12/24/2022]
Abstract
The objective of this research was to investigate the application value of deep learning-based computed tomography (CT) images in the diagnosis of liver tumors. Fifty-eight patients with liver tumors were selected, and their CT images were segmented using a convolutional neural network (CNN) algorithm. The segmentation results were quantitatively evaluated using the Dice similarity coefficient (DSC), precision, and recall. All the patients were examined and diagnosed by CT enhanced delayed scan technique, and the CT scan results were compared with the pathological findings. The results showed that the DSC, precision, and recall of the CNN algorithm reached 0.987, 0.967, and 0.954, respectively. The images segmented by the CNN were clearer. The diagnostic result of the examination on 56 cases by CT enhanced delay scanning was consistent with that of pathological diagnosis. According to the result of pathological diagnosis, there were 6 cases with hepatic cyst, 9 with hepatic hemangioma, 12 cases with liver metastasis, 10 cases with hepatoblastoma, 3 cases with focal nodular hyperplasia, and 18 cases with primary liver cancer. The result of CT enhanced delay scanning on 58 patients was consistent with that of pathological diagnosis, and the total diagnostic coincidence rate reached 96.55%. In conclusion, the CNN algorithm can perform accurate and efficient segmentation, with high resolution, providing a more scientific basis for the segmentation of liver tumors in CT images. CT enhanced scanning technology has a good effect on the diagnosis and differentiation of liver tumor patients, with high diagnostic coincidence rate. It has important value for the diagnosis of liver tumor and is worthy of clinical application.
Collapse
|
15
|
Liu Y, Zhao Y. Spiking Neural P Systems with Membrane Potentials, Inhibitory Rules, and Anti-Spikes. ENTROPY 2022; 24:e24060834. [PMID: 35741554 PMCID: PMC9222486 DOI: 10.3390/e24060834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 06/04/2022] [Accepted: 06/14/2022] [Indexed: 02/04/2023]
Abstract
Spiking neural P systems (SN P systems for short) realize the high abstraction and simulation of the working mechanism of the human brain, and adopts spikes for information encoding and processing, which are regarded as one of the third-generation neural network models. In the nervous system, the conduction of excitation depends on the presence of membrane potential (also known as the transmembrane potential difference), and the conduction of excitation on neurons is the conduction of action potentials. On the basis of the SN P systems with polarizations, in which the neuron-associated polarization is the trigger condition of the rule, the concept of neuronal membrane potential is introduced into systems. The obtained variant of the SN P system features charge accumulation and computation within neurons in quantity, as well as transmission between neurons. In addition, there are inhibitory synapses between neurons that inhibit excitatory transmission, and as such, synapses cause postsynaptic neurons to generate inhibitory postsynaptic potentials. Therefore, to make the model better fit the biological facts, inhibitory rules and anti-spikes are also adopted to obtain the spiking neural P systems with membrane potentials, inhibitory rules, and anti-spikes (referred to as the MPAIRSN P systems). The Turing universality of the MPAIRSN P systems as number generating and accepting devices is demonstrated. On the basis of the above working mechanism of the system, a small universal MPAIRSN P system with 95 neurons for computing functions is designed. The comparisons with other SN P models conclude that fewer neurons are required by the MPAIRSN P systems to realize universality.
Collapse
|
16
|
Gatti M, Leporati A, Zandron C. On Spiking Neural Membrane Systems with Neuron and Synapse Creation. Int J Neural Syst 2022; 32:2250036. [DOI: 10.1142/s0129065722500368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
17
|
Intelligence Classification Algorithm-Based Drug-Resistant Pulmonary Tuberculosis Computed Tomography Imaging Features and Influencing Factors. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3141807. [PMID: 35634067 PMCID: PMC9135543 DOI: 10.1155/2022/3141807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Revised: 03/30/2022] [Accepted: 04/27/2022] [Indexed: 11/18/2022]
Abstract
The drug resistance and influencing factors of patients with pulmonary tuberculosis were investigated, and a dual attention dilated residual network (DADRN) algorithm was proposed. The algorithm was applied to process and analyze lung computed tomography (CT) images of 400 included patients with pulmonary tuberculosis. Besides, sparse code book algorithm and bag of visual word (BOVW) algorithms were introduced and compared, and the influencing factors of pulmonary tuberculosis drug resistance were analyzed. The results demonstrated that the localization precision of lung consolidation, nodules, and cavities by the DADRN algorithm reached 91.2%, 92.5%, and 93.8%, respectively. The recall rate of the three algorithms amounted to 83.55%, 84.5%, and 86.4%, respectively. Both localization precision and recall rate of the DADRN algorithm were higher than those of other two algorithms (
). The drug resistance rate of streptomycin, isoniazid, and rifampin of the patients aged between 40 and 59 was all higher than those of the patients in other age groups. The drug resistance rate of streptomycin, isoniazid, and rifampin of retreated patients was all higher than those of patients initially treated. The drug resistance rate of streptomycin, isoniazid, and rifampin of the patients with tuberculosis contact was all higher than those of the patients without tuberculosis contact (
). Based on the above results, the accuracy of CT images processed by dual attention-based dilated residual classification network algorithm was higher than that processed by other two algorithms. Age, medical history, and history of exposure to tuberculosis were the influencing factors of the drug resistance of patients with pulmonary tuberculosis.
Collapse
|
18
|
Zhao Y, Liu Y, Liu X, Sun M, Qi F, Zheng Y. Self-adapting spiking neural P systems with refractory period and propagation delay. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.12.107] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
19
|
Multimodal medical image fusion based on multichannel coupled neural P systems and max-cloud models in spectral total variation domain. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.01.059] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
20
|
Shao C, Sun A, Xue H, Di X. Three-Dimensional Ultrasound Images in the Assessment of Bladder Tumor Health Monitoring under Deep Learning Algorithms. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:9170274. [PMID: 35371287 PMCID: PMC8967503 DOI: 10.1155/2022/9170274] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 02/21/2022] [Accepted: 03/04/2022] [Indexed: 11/17/2022]
Abstract
This study was aimed at exploring the application value of three-dimensional (3D) ultrasound based on deep learning and continued nursing health monitoring (CNHM) mode in promoting the recovery of bladder cancer patients after surgery. 60 patients who underwent muscular noninvasive superficial bladder cancer and bladder perfusion treatment were selected as the research objects. The patients were randomly divided into two groups: an experimental group (30 cases) and a control group (30 cases). Patients in the experimental group adopted a CNHM model during the bladder perfusion treatment. The patients in control group adopted ordinary health monitoring mode. All patients underwent 3D ultrasound examination, and all images were processed using the convolutional neural network (CNN) algorithm. All patients were followed up regularly within 12 after the treatment. The imaging data, quality of life, satisfaction, and complications of the two groups of patients were compared in each time period. The ultrasound image processed by the CNN algorithm was clearer than that processed by the original method, showing higher image quality and more prominent lesion features. After 12 months of health monitoring intervention, the overall health status, scores of various functional areas, and score of functional subscales of the experimental group were greatly higher than those of the control group, and the differences were statistically significant (P < 0.05). The incidence of adverse reactions in the experimental group was much lower than that in the control group, and the difference was statistically obvious (P < 0.05). The comparison of the recurrence rate between the two groups of patients in each time period was statistically significant. The satisfaction score of the experimental group was much higher than the score of the control group, showing statistically significant difference (P < 0.05). CNN algorithm showed high application value in 3D ultrasound image processing, and the CNHM model was very beneficial to the postoperative recovery of bladder cancer patients.
Collapse
Affiliation(s)
- Changhua Shao
- Department of Ultrasound, Tengzhou Central People's Hospital, No. 181 Xingtan Road, Tengzhou City 277599, Shandong Province, China
| | - Aichun Sun
- Department of Ultrasound, Zaozhuang Traditional Chinese Medicine Hospital, No. 2666 Taihang Mountain South Road, Xuecheng District, Zaozhuang City 277100 Shandong Province, China
| | - Hanwen Xue
- Department of Ultrasound, Tengzhou Central People's Hospital, No. 181 Xingtan Road, Tengzhou City 277599, Shandong Province, China
| | - Xianqiang Di
- Department of Ultrasound, Tengzhou Central People's Hospital, No. 181 Xingtan Road, Tengzhou City 277599, Shandong Province, China
| |
Collapse
|
21
|
Towards Accurate Skin Lesion Classification across All Skin Categories Using a PCNN Fusion-Based Data Augmentation Approach. COMPUTERS 2022. [DOI: 10.3390/computers11030044] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Deep learning models yield remarkable results in skin lesions analysis. However, these models require considerable amounts of data, while accessibility to the images with annotated skin lesions is often limited, and the classes are often imbalanced. Data augmentation is one way to alleviate the lack of labeled data and class imbalance. This paper proposes a new data augmentation method based on image fusion technique to construct large dataset on all existing tones. The fusion method consists of a pulse-coupled neural network fusion strategy in a non-subsampled shearlet transform domain and consists of three steps: decomposition, fusion, and reconstruction. The dermoscopic dataset is obtained by combining ISIC2019 and ISIC2020 Challenge datasets. A comparative study with current algorithms was performed to access the effectiveness of the proposed one. The first experiment results indicate that the proposed algorithm best preserves the lesion dermoscopic structure and skin tones features. The second experiment, which consisted of training a convolutional neural network model with the augmented dataset, indicates a more significant increase in accuracy by 15.69%, and 15.38% respectively for tanned, and brown skin categories. The model precision, recall, and F1-score have also been increased. The obtained results indicate that the proposed augmentation method is suitable for dermoscopic images and can be used as a solution to the lack of dark skin images in the dataset.
Collapse
|
22
|
Long L, Liu Q, Peng H, Yang Q, Luo X, Wang J, Song X. A Time Series Forecasting Approach Based on Nonlinear Spiking Neural Systems. Int J Neural Syst 2022; 32:2250020. [PMID: 35258438 DOI: 10.1142/s0129065722500204] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Nonlinear spiking neural P (NSNP) systems are a recently developed theoretical model, which is abstracted by nonlinear spiking mechanism of biological neurons. NSNP systems have a nonlinear structure and the potential to describe nonlinear dynamic systems. Based on NSNP systems, a novel time series forecasting approach is developed in this paper. During the training phase, a time series is first converted to frequency domain by using a redundant wavelet transform, and then according to the frequency data, an NSNP system is automatically constructed and adaptively trained in frequency domain. Then, the well-trained NSNP system can automatically generate sequence data for future time as the prediction results. Eight benchmark time series data sets and two real-life time series data sets are utilized to compare the proposed approach with several state-of-the-art forecasting approaches. The comparison results demonstrate availability and effectiveness of the proposed forecasting approach.
Collapse
Affiliation(s)
- Lifan Long
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Qian Liu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Qian Yang
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Xiaohui Luo
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Jun Wang
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Xiaoxiao Song
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| |
Collapse
|
23
|
An unsupervised segmentation method based on dynamic threshold neural P systems for color images. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.12.058] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
24
|
Hua Y, Shu X, Wang Z, Zhang L. Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation. Int J Neural Syst 2022; 32:2250016. [DOI: 10.1142/s0129065722500162] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Semi-supervised learning reduces overfitting and facilitates medical image segmentation by regularizing the learning of limited well-annotated data with the knowledge provided by a large amount of unlabeled data. However, there are many misuses and underutilization of data in conventional semi-supervised methods. On the one hand, the model will deviate from the empirical distribution under the training of numerous unlabeled data. On the other hand, the model treats labeled and unlabeled data differently and does not consider inter-data information. In this paper, a semi-supervised method is proposed to exploit unlabeled data to further narrow the gap between the semi-supervised model and its fully-supervised counterpart. Specifically, the architecture of the proposed method is based on the mean-teacher framework, and the uncertainty estimation module is improved to impose constraints of consistency and guide the selection of feature representation vectors. Notably, a voxel-level supervised contrastive learning module is devised to establish a contrastive relationship between feature representation vectors, whether from labeled or unlabeled data. The supervised manner ensures that the network learns the correct knowledge, and the dense contrastive relationship further extracts information from unlabeled data. The above overcomes data misuse and underutilization in semi-supervised frameworks. Moreover, it favors the feature representation with intra-class compactness and inter-class separability and gains extra performance. Extensive experimental results on the left atrium dataset from Atrial Segmentation Challenge demonstrate that the proposed method has superior performance over the state-of-the-art methods.
Collapse
Affiliation(s)
- Yu Hua
- College of Computer Science, Sichuan University, Section 4, Southern 1st Ring Rd, Chengdu, Sichuan 610065, P. R. China
| | - Xin Shu
- College of Computer Science, Sichuan University, Section 4, Southern 1st Ring Rd, Chengdu, Sichuan 610065, P. R. China
| | - Zizhou Wang
- College of Computer Science, Sichuan University, Section 4, Southern 1st Ring Rd, Chengdu, Sichuan 610065, P. R. China
| | - Lei Zhang
- College of Computer Science, Sichuan University, Section 4, Southern 1st Ring Rd, Chengdu, Sichuan 610065, P. R. China
| |
Collapse
|
25
|
Arco JE, Ortiz A, Ramírez J, Zhang YD, Górriz JM. Tiled Sparse Coding in Eigenspaces for Image Classification. Int J Neural Syst 2021; 32:2250007. [PMID: 34967705 DOI: 10.1142/s0129065722500071] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The automation in the diagnosis of medical images is currently a challenging task. The use of Computer Aided Diagnosis (CAD) systems can be a powerful tool for clinicians, especially in situations when hospitals are overflowed. These tools are usually based on artificial intelligence (AI), a field that has been recently revolutionized by deep learning approaches. blackThese alternatives usually obtain a large performance based on complex solutions, leading to a high computational cost and the need of having large databases. In this work, we propose a classification framework based on sparse coding. Images are blackfirst partitioned into different tiles, and a dictionary is built after applying PCA to these tiles. The original signals are then transformed as a linear combination of the elements of the dictionary. blackThen, they are reconstructed by iteratively deactivating the elements associated with each component. Classification is finally performed employing as features the subsequent reconstruction errors. Performance is evaluated in a real context where distinguishing between four different pathologies: control versus bacterial pneumonia versus viral pneumonia versus COVID-19. blackOur system differentiates between pneumonia patients and controls with an accuracy of 97.74%, whereas in the 4-class context the accuracy is 86.73%. The excellent results and the pioneering use of sparse coding in this scenario evidence that our proposal can assist clinicians when their workload is high.
Collapse
Affiliation(s)
- Juan E Arco
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Andrés Ortiz
- Department of Communications Engineering, University of Malaga 29010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Javier Ramírez
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Yu-Dong Zhang
- School of Informatics, University of Leicester, Leicester LE1 7RH, UK
| | - Juan M Górriz
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| |
Collapse
|
26
|
Abstract
As third-generation neural network models, spiking neural P systems (SNP) have distributed parallel computing capabilities with good performance. In recent years, artificial neural networks have received widespread attention due to their powerful information processing capabilities, which is an effective combination of a class of biological neural networks and mathematical models. However, SNP systems have some shortcomings in numerical calculations. In order to improve the incompletion of current SNP systems in dealing with certain real data technology in this paper, we use neural network structure and data processing methods for reference. Combining them with membrane computing, spiking neural membrane computing models (SNMC models) are proposed. In SNMC models, the state of each neuron is a real number, and the neuron contains the input unit and the threshold unit. Additionally, there is a new style of rules for neurons with time delay. The way of consuming spikes is controlled by a nonlinear production function, and the produced spike is determined based on a comparison between the value calculated by the production function and the critical value. In addition, the Turing universality of the SNMC model as a number generator and acceptor is proved.
Collapse
|
27
|
Liu M, Zhao F, Jiang X, Zhang H, Zhou H. Parallel Binary Image Cryptosystem Via Spiking Neural Networks Variants. Int J Neural Syst 2021; 32:2150014. [PMID: 33637028 DOI: 10.1142/s0129065721500143] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Due to the inefficiency of multiple binary images encryption, a parallel binary image encryption framework based on the typical variants of spiking neural networks, spiking neural P (SNP) systems is proposed in this paper. More specifically, the two basic units in the proposed image cryptosystem, the permutation unit and the diffusion unit, are designed through SNP systems with multiple channels and polarizations (SNP-MCP systems), and SNP systems with astrocyte-like control (SNP-ALC systems), respectively. Different from the serial computing of the traditional image permutation/diffusion unit, SNP-MCP-based permutation/SNP-ALC-based diffusion unit can realize parallel computing through the parallel use of rules inside the neurons. Theoretical analysis results confirm the high efficiency of the binary image proposed cryptosystem. Security analysis experiments demonstrate the security of the proposed cryptosystem.
Collapse
Affiliation(s)
- Mingzhe Liu
- State Key Laboratory of Geohazard Prevention and Geoenvironment Protection, Chengdu University of Technology, Chengdu 610051, P. R. China
| | - Feixiang Zhao
- State Key Laboratory of Geohazard Prevention and Geoenvironment Protection, Chengdu University of Technology, Chengdu 610051, P. R. China
| | - Xin Jiang
- State Key Laboratory of Geohazard Prevention and Geoenvironment Protection, Chengdu University of Technology, Chengdu 610051, P. R. China
| | - Hong Zhang
- State Key Laboratory of Geohazard Prevention and Geoenvironment Protection, Chengdu University of Technology, Chengdu 610051, P. R. China
| | - Helen Zhou
- School of Engineering, Manukau Institute of Technology, Auckland 1150, New Zealand
| |
Collapse
|
28
|
Faragallah OS, El-Hoseny H, El-Shafai W, El-Rahman WA, El-Sayed HS, El-Rabaie ESM, El-Samie FEA, Geweid GGN. A Comprehensive Survey Analysis for Present Solutions of Medical Image Fusion and Future Directions. IEEE ACCESS 2021; 9:11358-11371. [DOI: 10.1109/access.2020.3048315] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Affiliation(s)
- Osama S. Faragallah
- Department of Information Technology, College of Computers and Information Technology, Taif University, Taif, Saudi Arabia
| | - Heba El-Hoseny
- Department of Electronics and Electrical Communication Engineering, Al-Obour High Institute for Engineering and Technology, Al-Obour, Egypt
| | - Walid El-Shafai
- Department of Electronics and Communication Engineering, Faculty of Electronic Engineering, Menofia University, Menouf, Egypt
| | - Wael Abd El-Rahman
- Department of Electrical Engineering, Faculty of Engineering, Benha University, Benha, Egypt
| | - Hala S. El-Sayed
- Department of Electrical Engineering, Faculty of Engineering, Menoufia University, Shebeen El-Kom, Egypt
| | - El-Sayed M. El-Rabaie
- Department of Electronics and Communication Engineering, Faculty of Electronic Engineering, Menofia University, Menouf, Egypt
| | - Fathi E. Abd El-Samie
- Department of Electronics and Communication Engineering, Faculty of Electronic Engineering, Menofia University, Menouf, Egypt
| | - Gamal G. N. Geweid
- Department of Electrical Engineering, Faculty of Engineering, Benha University, Benha, Egypt
| |
Collapse
|