1
|
Li B, Zhang L, Liu J, Peng H, Wang Q, Liu J. Multi-focus image fusion with parameter adaptive dual channel dynamic threshold neural P systems. Neural Netw 2024; 179:106603. [PMID: 39146717 DOI: 10.1016/j.neunet.2024.106603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 07/06/2024] [Accepted: 08/05/2024] [Indexed: 08/17/2024]
Abstract
Multi-focus image fusion (MFIF) is an important technique that aims to combine the focused regions of multiple source images into a fully clear image. Decision-map methods are widely used in MFIF to maximize the preservation of information from the source images. While many decision-map methods have been proposed, they often struggle with difficulties in determining focus and non-focus boundaries, further affecting the quality of the fused images. Dynamic threshold neural P (DTNP) systems are computational models inspired by biological spiking neurons, featuring dynamic threshold and spiking mechanisms to better distinguish focused and unfocused regions for decision map generation. However, original DTNP systems require manual parameter configuration and have only one stimulus. Therefore, they are not suitable to be used directly for generating high-precision decision maps. To overcome these limitations, we propose a variant called parameter adaptive dual channel DTNP (PADCDTNP) systems. Inspired by the spiking mechanisms of PADCDTNP systems, we further develop a new MFIF method. As a new neural model, PADCDTNP systems adaptively estimate parameters according to multiple external inputs to produce decision maps with robust boundaries, resulting in high-quality fusion results. Comprehensive experiments on the Lytro/MFFW/MFI-WHU dataset show that our method achieves advanced performance and yields comparable results to the fourteen representative MFIF methods. In addition, compared to the standard DTNP systems, PADCDTNP systems improve the fusion performance and fusion efficiency on the three datasets by 5.69% and 86.03%, respectively. The codes for both the proposed method and the comparison methods are released at https://github.com/MorvanLi/MFIF-PADCDTNP.
Collapse
Affiliation(s)
- Bo Li
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China; Ministry of Education Key Laboratory of Intelligent Networks and Network Security, Xi'an Jiaotong University, Xi'an, 710049, China
| | - Lingling Zhang
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China; Ministry of Education Key Laboratory of Intelligent Networks and Network Security, Xi'an Jiaotong University, Xi'an, 710049, China.
| | - Jun Liu
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China; Shaanxi Province Key Laboratory of Big Data Knowledge Engineering, Xi'an Jiaotong University, Xi'an, 710049, China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu, Sichuan, 610039, China
| | | | - Jiaqi Liu
- Henan University of Chinese Medicine, Henan, 450046, China
| |
Collapse
|
2
|
Ye L, Zhou C, Peng H, Wang J, Liu Z, Yang Q. Multi-level feature interaction image super-resolution network based on convolutional nonlinear spiking neural model. Neural Netw 2024; 177:106366. [PMID: 38744112 DOI: 10.1016/j.neunet.2024.106366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2023] [Revised: 03/26/2024] [Accepted: 05/03/2024] [Indexed: 05/16/2024]
Abstract
Image super-resolution (ISR) is designed to recover lost detail information from low-resolution images, resulting in high-quality and high-definition high-resolution images. In the existing single ISR (SISR) methods based on convolutional neural networks (CNN), however, most of the models cannot effectively combine global and local information and are also easy to ignore the correlation between different hierarchical feature information. To address these problems, this study proposes a multi-level feature interactive image super-resolution network, which is constructed by the convolutional units inspired by nonlinear spiking mechanism in nonlinear spiking neural P systems, including shallow feature processing, deep feature extraction and fusion, and reconstruction modules. The different omni domain self-attention blocks are introduced to extract global information in the deep feature extraction and fusion stage and formed a feature enhancement module having a Transformer structure using a novel convolutional unit for extracting local information. Furthermore, to adaptively fuse features between different hierarchies, we design a multi-level feature fusion module, which not only can adaptively fuse features between different hierarchies, but also can better interact with contextual information. The proposed model is compared with 16 state-of-the-art or baseline models on five benchmark datasets. The experimental results show that the proposed model not only achieves good reconstruction performance, but also strikes a good balance between model parameters and performance.
Collapse
Affiliation(s)
- Lulin Ye
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China
| | - Chi Zhou
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China.
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu, 610039, China
| | - Zhicai Liu
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China
| | - Qian Yang
- School of Computer and Software Engineering, Xihua University, Chengdu, 610039, China
| |
Collapse
|
3
|
Wu M, Peng H, Liu Z, Wang J. Seizure Detection of EEG Signals Based on Multi-Channel Long- and Short-Term Memory-Like Spiking Neural Model. Int J Neural Syst 2024:2450051. [PMID: 39004932 DOI: 10.1142/s0129065724500515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/16/2024]
Abstract
Seizure is a common neurological disorder that usually manifests itself in recurring seizure, and these seizures can have a serious impact on a person's life and health. Therefore, early detection and diagnosis of seizure is crucial. In order to improve the efficiency of early detection and diagnosis of seizure, this paper proposes a new seizure detection method, which is based on discrete wavelet transform (DWT) and multi-channel long- and short-term memory-like spiking neural P (LSTM-SNP) model. First, the signal is decomposed into 5 levels by using DWT transform to obtain the features of the components at different frequencies, and a series of time-frequency features in wavelet coefficients are extracted. Then, these different features are used to train a multi-channel LSTM-SNP model and perform seizure detection. The proposed method achieves a high seizure detection accuracy on the CHB-MIT dataset: 98.25% accuracy, 98.22% specificity and 97.59% sensitivity. This indicates that the proposed epilepsy detection method can show competitive detection performance.
Collapse
Affiliation(s)
- Min Wu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Zhicai Liu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu 610039, P. R. China
| |
Collapse
|
4
|
Fu J, Peng H, Li B, Liu Z, Lugu R, Wang J, Ramírez-de-Arellano A. Multitask Adversarial Networks Based on Extensive Nonlinear Spiking Neuron Models. Int J Neural Syst 2024; 34:2450032. [PMID: 38624267 DOI: 10.1142/s0129065724500321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/17/2024]
Abstract
Deep learning technology has been successfully used in Chest X-ray (CXR) images of COVID-19 patients. However, due to the characteristics of COVID-19 pneumonia and X-ray imaging, the deep learning methods still face many challenges, such as lower imaging quality, fewer training samples, complex radiological features and irregular shapes. To address these challenges, this study first introduces an extensive NSNP-like neuron model, and then proposes a multitask adversarial network architecture based on ENSNP-like neurons for chest X-ray images of COVID-19, called MAE-Net. The MAE-Net serves two tasks: (i) converting low-quality CXR images to high-quality images; (ii) classifying CXR images of COVID-19. The adversarial architecture of MAE-Net uses two generators and two discriminators, and two new loss functions have been introduced to guide the optimization of the network. The MAE-Net is tested on four benchmark COVID-19 CXR image datasets and compared them with eight deep learning models. The experimental results show that the proposed MAE-Net can enhance the conversion quality and the accuracy of image classification results.
Collapse
Affiliation(s)
- Jun Fu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Bing Li
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Zhicai Liu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Rikong Lugu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu 610039, P. R. China
| | - Antonio Ramírez-de-Arellano
- Research Group of Natural Computing, Department of Computer Science and Artificial Intelligence, University of Seville, Sevilla 41012, Spain
| |
Collapse
|
5
|
Zhou C, Ye L, Peng H, Liu Z, Wang J, Ramírez-De-Arellano A. A Parallel Convolutional Network Based on Spiking Neural Systems. Int J Neural Syst 2024; 34:2450022. [PMID: 38487872 DOI: 10.1142/s0129065724500229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2024]
Abstract
Deep convolutional neural networks have shown advanced performance in accurately segmenting images. In this paper, an SNP-like convolutional neuron structure is introduced, abstracted from the nonlinear mechanism in nonlinear spiking neural P (NSNP) systems. Then, a U-shaped convolutional neural network named SNP-like parallel-convolutional network, or SPC-Net, is constructed for segmentation tasks. The dual-convolution concatenate (DCC) and dual-convolution addition (DCA) network blocks are designed, respectively, in the encoder and decoder stages. The two blocks employ parallel convolution with different kernel sizes to improve feature representation ability and make full use of spatial detail information. Meanwhile, different feature fusion strategies are used to fuse their features to achieve feature complementarity and augmentation. Furthermore, a dual-scale pooling (DSP) module in the bottleneck is designed to improve the feature extraction capability, which can extract multi-scale contextual information and reduce information loss while extracting salient features. The SPC-Net is applied in medical image segmentation tasks and is compared with several recent segmentation methods on the GlaS and CRAG datasets. The proposed SPC-Net achieves 90.77% DICE coefficient, 83.76% IoU score and 83.93% F1 score, 86.33% ObjDice coefficient, 135.60 Obj-Hausdorff distance, respectively. The experimental results show that the proposed model can achieve good segmentation performance.
Collapse
Affiliation(s)
- Chi Zhou
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Lulin Ye
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Zhicai Liu
- School of Computer and Software Engineering, Xihua University, Chengdu 610039, P. R. China
| | - Jun Wang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu 610039, P. R. China
| | - Antonio Ramírez-De-Arellano
- Research Group of Natural Computing, Department of Computer Science and Artificial Intelligence, University of Seville, Sevilla 41012, Spain
| |
Collapse
|
6
|
Hewamalage H, Ackermann K, Bergmeir C. Forecast evaluation for data scientists: common pitfalls and best practices. Data Min Knowl Discov 2022; 37:788-832. [PMID: 36504672 PMCID: PMC9718476 DOI: 10.1007/s10618-022-00894-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 11/07/2022] [Indexed: 12/03/2022]
Abstract
Recent trends in the Machine Learning (ML) and in particular Deep Learning (DL) domains have demonstrated that with the availability of massive amounts of time series, ML and DL techniques are competitive in time series forecasting. Nevertheless, the different forms of non-stationarities associated with time series challenge the capabilities of data-driven ML models. Furthermore, due to the domain of forecasting being fostered mainly by statisticians and econometricians over the years, the concepts related to forecast evaluation are not the mainstream knowledge among ML researchers. We demonstrate in our work that as a consequence, ML researchers oftentimes adopt flawed evaluation practices which results in spurious conclusions suggesting methods that are not competitive in reality to be seemingly competitive. Therefore, in this work we provide a tutorial-like compilation of the details associated with forecast evaluation. This way, we intend to impart the information associated with forecast evaluation to fit the context of ML, as means of bridging the knowledge gap between traditional methods of forecasting and adopting current state-of-the-art ML techniques.We elaborate the details of the different problematic characteristics of time series such as non-normality and non-stationarities and how they are associated with common pitfalls in forecast evaluation. Best practices in forecast evaluation are outlined with respect to the different steps such as data partitioning, error calculation, statistical testing, and others. Further guidelines are also provided along selecting valid and suitable error measures depending on the specific characteristics of the dataset at hand.
Collapse
Affiliation(s)
- Hansika Hewamalage
- School of Computer Science & Engineering, University of New South Wales, Sydney, Australia
| | - Klaus Ackermann
- SoDa Labs and Department of Econometrics & Business Statistics, Monash Business School, Monash University, Melbourne, Australia
| | - Christoph Bergmeir
- Department of Data Science and AI, Faculty of IT, Monash University, Melbourne, Australia
| |
Collapse
|
7
|
Liu Y, Zhao Y. Spiking Neural P Systems with Membrane Potentials, Inhibitory Rules, and Anti-Spikes. ENTROPY 2022; 24:e24060834. [PMID: 35741554 PMCID: PMC9222486 DOI: 10.3390/e24060834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 06/04/2022] [Accepted: 06/14/2022] [Indexed: 02/04/2023]
Abstract
Spiking neural P systems (SN P systems for short) realize the high abstraction and simulation of the working mechanism of the human brain, and adopts spikes for information encoding and processing, which are regarded as one of the third-generation neural network models. In the nervous system, the conduction of excitation depends on the presence of membrane potential (also known as the transmembrane potential difference), and the conduction of excitation on neurons is the conduction of action potentials. On the basis of the SN P systems with polarizations, in which the neuron-associated polarization is the trigger condition of the rule, the concept of neuronal membrane potential is introduced into systems. The obtained variant of the SN P system features charge accumulation and computation within neurons in quantity, as well as transmission between neurons. In addition, there are inhibitory synapses between neurons that inhibit excitatory transmission, and as such, synapses cause postsynaptic neurons to generate inhibitory postsynaptic potentials. Therefore, to make the model better fit the biological facts, inhibitory rules and anti-spikes are also adopted to obtain the spiking neural P systems with membrane potentials, inhibitory rules, and anti-spikes (referred to as the MPAIRSN P systems). The Turing universality of the MPAIRSN P systems as number generating and accepting devices is demonstrated. On the basis of the above working mechanism of the system, a small universal MPAIRSN P system with 95 neurons for computing functions is designed. The comparisons with other SN P models conclude that fewer neurons are required by the MPAIRSN P systems to realize universality.
Collapse
|