Parallel Binary Image Cryptosystem Via Spiking Neural Networks Variants

Referring Image Segmentation with Multi-Modal Feature Interaction and Alignment Based on Convolutional Nonlinear Spiking Neural Membrane Systems

Referring image segmentation aims to accurately align image pixels and text features for object segmentation based on natural language descriptions. This paper proposes NSNPRIS (convolutional nonlinear spiking neural P systems for referring image segmentation), a novel model based on convolutional nonlinear spiking neural P systems. NSNPRIS features NSNPFusion and Language Gate modules to enhance feature interaction during encoding, along with an NSNPDecoder for feature alignment and decoding. Experimental results on RefCOCO, RefCOCO[Formula: see text], and G-Ref datasets demonstrate that NSNPRIS performs better than mainstream methods. Our contributions include advances in the alignment of pixel and textual features and the improvement of segmentation accuracy.

Asynchronous Numerical Spiking Neural Membrane Systems with Local Synchronization

Since the spiking neural P system (SN P system) was proposed in 2006, it has become a research hotspot in the field of membrane computing. The SN P system performs computations through the encoding, processing, and transmission of spiking information and can be regarded as a third-generation neural network. As a variant of the SN P system, the global asynchronous numerical spiking neural P system (ANSN P system) is adaptable to a broader range of application scenarios. However, in biological neuroscience, some neurons work synchronously within a community to perform specific functions in the brain. Inspired by this, our work investigates a global asynchronous spiking neural P system (ANSN P system) that incorporates certain local synchronous neuron sets. Within these local synchronous sets, neurons must execute their production functions simultaneously, thereby reducing dependence on thresholds and enhancing control uncertainty in ANSN P systems. By analyzing the ADD, SUB, and FIN modules in the generating mode, as well as the INPUT and ADD modules in the accepting mode, this paper demonstrates the novel system's computational capacity as both a generator and an acceptor. Additionally, this paper compares each module to those in other SN P systems, considering the maximum number of neurons and rules per neuron. The results show that this new ANSN P system is at least as effective as the existing SN P systems.

An Optimization Numerical Spiking Neural Membrane System with Adaptive Multi-Mutation Operators for Brain Tumor Segmentation

Magnetic Resonance Imaging (MRI) is an important diagnostic technique for brain tumors due to its ability to generate images without tissue damage or skull artifacts. Therefore, MRI images are widely used to achieve the segmentation of brain tumors. This paper is the first attempt to discuss the use of optimization spiking neural P systems to improve the threshold segmentation of brain tumor images. To be specific, a threshold segmentation approach based on optimization numerical spiking neural P systems with adaptive multi-mutation operators (ONSNPSamos) is proposed to segment brain tumor images. More specifically, an ONSNPSamo with a multi-mutation strategy is introduced to balance exploration and exploitation abilities. At the same time, an approach combining the ONSNPSamo and connectivity algorithms is proposed to address the brain tumor segmentation problem. Our experimental results from CEC 2017 benchmarks (basic, shifted and rotated, hybrid, and composition function optimization problems) demonstrate that the ONSNPSamo is better than or close to 12 optimization algorithms. Furthermore, case studies from BraTS 2019 show that the approach combining the ONSNPSamo and connectivity algorithms can more effectively segment brain tumor images than most algorithms involved.

Hypergraph-Based Numerical Spiking Neural Membrane Systems with Novel Repartition Protocols

The classic spiking neural P (SN P) systems abstract the real biological neural network into a simple structure based on graphs, where neurons can only communicate on the plane. This study proposes the hypergraph-based numerical spiking neural membrane (HNSNM) systems with novel repartition protocols. Through the introduction of hypergraphs, the HNSNM systems can characterize the high-order relationships among neurons and extend the traditional neuron structure to high-dimensional nonlinear spaces. The HNSNM systems also abstract two biological mechanisms of synapse creation and pruning, and use plasticity rules with repartition protocols to achieve planar, hierarchical and spatial communications among neurons in hypergraph neuron structures. Through imitating register machines, the Turing universality of the HNSNM systems is proved by using them as number generating and accepting devices. A universal HNSNM system consisting of 41 neurons is constructed to compute arbitrary functions. By solving NP-complete problems using the subset sum problem as an example, the computational efficiency and effectiveness of HNSNM systems are verified.

Multiple-in-Single-Out Object Detector Leveraging Spiking Neural Membrane Systems and Multiple Transformers

Most existing multi-scale object detectors depend on multi-level feature maps. The Feature Pyramid Networks (FPN) is a significant architecture for object detection that utilizes these multi-level feature maps. However, the use of FPN also increases the detector's complexity. For object detection methods that only use a single-level feature map, the detection performance is limited to some extent because the single-level feature map cannot balance deep semantic information and shallow detail information. We introduce a novel detector - the Spiking Neural P Multiple-in-Single-out (SNPMiSo) detector to address these challenges. The SNPMiSo detector is constructed based on SNP-like neurons. In SNPMiSo, we employ two kinds of Transformers to boost the important features across different-level feature maps separately. After enhancing the features, we use an incremental upsampling module to upsample and merge the two feature maps. This combined feature map is input into the NAF dilated residual module and the NAF dual-branch detection head. This process allows us to extract multi-scale features and carry out detection tasks. Our tests show promising results: On the COCO dataset, SNPMiSo attains an Average Precision (AP) of 38.7, an improvement of 1.0 AP over YOLOF. In addition, SNPMiSo demonstrates a quicker detection speed, outperforming some advanced multi-level and single-level object detectors.

Sparse Spiking Neural-Like Membrane Systems on Graphics Processing Units

The parallel simulation of Spiking Neural P systems is mainly based on a matrix representation, where the graph inherent to the neural model is encoded in an adjacency matrix. The simulation algorithm is based on a matrix-vector multiplication, which is an operation efficiently implemented on parallel devices. However, when the graph of a Spiking Neural P system is not fully connected, the adjacency matrix is sparse and hence, lots of computing resources are wasted in both time and memory domains. For this reason, two compression methods for the matrix representation were proposed in a previous work, but they were not implemented nor parallelized on a simulator. In this paper, they are implemented and parallelized on GPUs as part of a new Spiking Neural P system with delays simulator. Extensive experiments are conducted on high-end GPUs (RTX2080 and A100 80GB), and it is concluded that they outperform other solutions based on state-of-the-art GPU libraries when simulating Spiking Neural P systems.

Multitask Adversarial Networks Based on Extensive Nonlinear Spiking Neuron Models

Deep learning technology has been successfully used in Chest X-ray (CXR) images of COVID-19 patients. However, due to the characteristics of COVID-19 pneumonia and X-ray imaging, the deep learning methods still face many challenges, such as lower imaging quality, fewer training samples, complex radiological features and irregular shapes. To address these challenges, this study first introduces an extensive NSNP-like neuron model, and then proposes a multitask adversarial network architecture based on ENSNP-like neurons for chest X-ray images of COVID-19, called MAE-Net. The MAE-Net serves two tasks: (i) converting low-quality CXR images to high-quality images; (ii) classifying CXR images of COVID-19. The adversarial architecture of MAE-Net uses two generators and two discriminators, and two new loss functions have been introduced to guide the optimization of the network. The MAE-Net is tested on four benchmark COVID-19 CXR image datasets and compared them with eight deep learning models. The experimental results show that the proposed MAE-Net can enhance the conversion quality and the accuracy of image classification results.

Modular Spiking Neural Membrane Systems for Image Classification

A variant of membrane computing models called Spiking Neural P systems (SNP systems) closely mimics the structure and behavior of biological neurons. As third-generation neural networks, SNP systems have flexible architectures allowing the design of bio-inspired machine learning algorithms. This paper proposes Modular Spiking Neural P (MSNP) systems to solve image classification problems, a novel SNP system to be applied in scenarios where hundreds or even thousands of different classes are considered. A main issue to face in such situations is related to the structural complexity of the network. MSNP systems devised in this work allow to approach the general classification problem by dividing it in smaller parts, that are then faced by single entities of the network. As a benchmark dataset, the Oxford Flowers 102 dataset is considered, consisting of more than 8000 pictures of flowers belonging to the 102 species commonly found in the UK. These classes sometimes present large variations within them, may be also very similar to one another, and different images of the same subject may differ a lot. The work describes the architecture of the MSNP system, based on modules focusing on a specific class, their training phase, and the evaluation of the model both concerning result accuracy as well as energy consumption. Experimental results on image classification problems show that the model achieves good results, but is strongly connected to image quality, mainly depending on the frequency of images, remarkable changes of pose, images not centered, and subject mostly not shown.

Entropy-Weighted Numerical Gradient Optimization Spiking Neural System for Biped Robot Control

The optimization of robot controller parameters is a crucial task for enhancing robot performance, yet it often presents challenges due to the complexity of multi-objective, multi-dimensional multi-parameter optimization. This paper introduces a novel approach aimed at efficiently optimizing robot controller parameters to enhance its motion performance. While spiking neural P systems have shown great potential in addressing optimization problems, there has been limited research and validation concerning their application in continuous numerical, multi-objective, and multi-dimensional multi-parameter contexts. To address this research gap, our paper proposes the Entropy-Weighted Numerical Gradient Optimization Spiking Neural P System, which combines the strengths of entropy weighting and spiking neural P systems. First, the introduction of entropy weighting eliminates the subjectivity of weight selection, enhancing the objectivity and reproducibility of the optimization process. Second, our approach employs parallel gradient descent to achieve efficient multi-dimensional multi-parameter optimization searches. In conclusion, validation results on a biped robot simulation model show that our method markedly enhances walking performance compared to traditional approaches and other optimization algorithms. We achieved a velocity mean absolute error at least 35% lower than other methods, with a displacement error two orders of magnitude smaller. This research provides an effective new avenue for performance optimization in the field of robotics.

Spiking Neural Membrane Systems with Adaptive Synaptic Time Delay

Spiking neural membrane systems (or spiking neural P systems, SNP systems) are a new type of computation model which have attracted the attention of plentiful scholars for parallelism, time encoding, interpretability and extensibility. The original SNP systems only consider the time delay caused by the execution of rules within neurons, but not caused by the transmission of spikes via synapses between neurons and its adaptive adjustment. In view of the importance of time delay for SNP systems, which are a time encoding computation model, this study proposes SNP systems with adaptive synaptic time delay (ADSNP systems) based on the dynamic regulation mechanism of synaptic transmission delay in neural systems. In ADSNP systems, besides neurons, astrocytes that can generate adenosine triphosphate (ATP) are introduced. After receiving spikes, astrocytes convert spikes into ATP and send ATP to the synapses controlled by them to change the synaptic time delays. The Turing universality of ADSNP systems in number generating and accepting modes is proved. In addition, a small universal ADSNP system using 93 neurons and astrocytes is given. The superiority of the ADSNP system is demonstrated by comparison with the six variants. Finally, an ADSNP system is constructed for credit card fraud detection, which verifies the feasibility of the ADSNP system for solving real-world problems. By considering the adaptive synaptic delay, ADSNP systems better restore the process of information transmission in biological neural networks, and enhance the adaptability of SNP systems, making the control of time more accurate.

Evaluation of Spiking Neural Nets-Based Image Classification Using the Runtime Simulator RAVSim

Spiking Neural Networks (SNNs) help achieve brain-like efficiency and functionality by building neurons and synapses that mimic the human brain's transmission of electrical signals. However, optimal SNN implementation requires a precise balance of parametric values. To design such ubiquitous neural networks, a graphical tool for visualizing, analyzing, and explaining the internal behavior of spikes is crucial. Although some popular SNN simulators are available, these tools do not allow users to interact with the neural network during simulation. To this end, we have introduced the first runtime interactive simulator, called Runtime Analyzing and Visualization Simulator (RAVSim),a developed to analyze and dynamically visualize the behavior of SNNs, allowing end-users to interact, observe output concentration reactions, and make changes directly during the simulation. In this paper, we present RAVSim with the current implementation of runtime interaction using the LIF neural model with different connectivity schemes, an image classification model using SNNs, and a dataset creation feature. Our main objective is to primarily investigate binary classification using SNNs with RGB images. We created a feed-forward network using the LIF neural model for an image classification algorithm and evaluated it by using RAVSim. The algorithm classifies faces with and without masks, achieving an accuracy of 91.8% using 1000 neurons in a hidden layer, 0.0758 MSE, and an execution time of ∼10[Formula: see text]min on the CPU. The experimental results show that using RAVSim not only increases network design speed but also accelerates user learning capability.

Multimodal Image Fusion for X-ray Grating Interferometry

X-ray grating interferometry (XGI) can provide multiple image modalities. It does so by utilizing three different contrast mechanisms-attenuation, refraction (differential phase-shift), and scattering (dark-field)-in a single dataset. Combining all three imaging modalities could create new opportunities for the characterization of material structure features that conventional attenuation-based methods are unable probe. In this study, we proposed an image fusion scheme based on the non-subsampled contourlet transform and spiking cortical model (NSCT-SCM) to combine the tri-contrast images retrieved from XGI. It incorporated three main steps: (i) image denoising based on Wiener filtering, (ii) the NSCT-SCM tri-contrast fusion algorithm, and (iii) image enhancement using contrast-limited adaptive histogram equalization, adaptive sharpening, and gamma correction. The tri-contrast images of the frog toes were used to validate the proposed approach. Moreover, the proposed method was compared with three other image fusion methods by several figures of merit. The experimental evaluation results highlighted the efficiency and robustness of the proposed scheme, with less noise, higher contrast, more information, and better details.

Performance Evaluation of Error-Correcting Output Coding Based on Noisy and Noiseless Binary Classifiers

Error-correcting output coding (ECOC) is a method for constructing a multi-valued classifier using a combination of given binary classifiers. ECOC can estimate the correct category by other binary classifiers even if the output of some binary classifiers is incorrect based on the framework of the coding theory. The code word table representing the combination of these binary classifiers is important in ECOC. ECOC is known to perform well experimentally on real data. However, the complexity of the classification problem makes it difficult to analyze the classification performance in detail. For this reason, theoretical analysis of ECOC has not been conducted. In this study, if a binary classifier outputs the estimated posterior probability with errors, then this binary classifier is said to be noisy. In contrast, if a binary classifier outputs the true posterior probability, then this binary classifier is said to be noiseless. For a theoretical analysis of ECOC, we discuss the optimality for the code word table with noiseless binary classifiers and the error rate for one with noisy binary classifiers. This evaluation result shows that the Hamming distance of the code word table is an important indicator.