Constructing an Associative Memory System Using Spiking Neural Network

Bio-inspired computational memory model of the Hippocampus: An approach to a neuromorphic spike-based Content-Addressable Memory

The brain has computational capabilities that surpass those of modern systems, being able to solve complex problems efficiently in a simple way. Neuromorphic engineering aims to mimic biology in order to develop new systems capable of incorporating such capabilities. Bio-inspired learning systems continue to be a challenge that must be solved, and much work needs to be done in this regard. Among all brain regions, the hippocampus stands out as an autoassociative short-term memory with the capacity to learn and recall memories from any fragment of them. These characteristics make the hippocampus an ideal candidate for developing bio-inspired learning systems that, in addition, resemble content-addressable memories. Therefore, in this work we propose a bio-inspired spiking content-addressable memory model based on the CA3 region of the hippocampus with the ability to learn, forget and recall memories, both orthogonal and non-orthogonal, from any fragment of them. The model was implemented on the SpiNNaker hardware platform using Spiking Neural Networks. A set of experiments based on functional, stress and applicability tests were performed to demonstrate its correct functioning. This work presents the first hardware implementation of a fully-functional bio-inspired spiking hippocampal content-addressable memory model, paving the way for the development of future more complex neuromorphic systems.

Circuit-based neuromodulation enhances delayed recall in amnestic mild cognitive impairment

BACKGROUND

This study aimed to investigate the efficacy of circuits-based paired associative stimulation (PAS) in adults with amnestic mild cognitive impairment (aMCI).

METHODS

We conducted a parallel-group, randomised, controlled clinical trial. Initially, a cohort of healthy subjects was recruited to establish the cortical-hippocampal circuits by tracking white matter fibre connections using diffusion tensor imaging. Subsequently, patients diagnosed with aMCI, matched for age and education, were randomly allocated in a 1:1 ratio to undergo a 2-week intervention, either circuit-based PAS or sham PAS. Additionally, we explored the relationship between changes in cognitive performance and the functional connectivity (FC) of cortical-hippocampal circuits.

RESULTS

FCs between hippocampus and precuneus and between hippocampus and superior frontal gyrus (orbital part) were most closely associated with the Auditory Verbal Learning Test (AVLT)_N5 score in 42 aMCI patients, thus designated as target circuits. The AVLT_N5 score improved from 2.43 (1.43) to 5.29 (1.98) in the circuit-based PAS group, compared with 2.52 (1.44) to 3.86 (2.39) in the sham PAS group (p=0.003; Cohen's d=0.97). A significant decrease was noted in FC between the left hippocampus and left precuneus in the circuit-based PAS group from baseline to postintervention (p=0.013). Using a generalised linear model, significant group×FC interaction effects for the improvements in AVLT_N5 scores were found within the circuit-based PAS group (B=3.4, p=0.017).

CONCLUSIONS

Circuit-based PAS effectively enhances long-term delayed recall in adults diagnosed with aMCI, which includes individuals aged 50-80 years. This enhancement is potentially linked to the decreased functional connectivity between the left hippocampus and left precuneus.

TRIAL REGISTRATION NUMBER

ChiCTR2100053315; Chinese Clinical Trial Registry.

Spiking neural networks for physiological and speech signals: a review

The integration of Spiking Neural Networks (SNNs) into the analysis and interpretation of physiological and speech signals has emerged as a groundbreaking approach, offering enhanced performance and deeper insights into the underlying biological processes. This review aims to summarize key advances, methodologies, and applications of SNNs within these domains, highlighting their unique ability to mimic the temporal dynamics and efficiency of the human brain. We dive into the core principles of SNNs, their neurobiological underpinnings, and the computational advantages they bring to signal processing, particularly in handling the temporal and spatial complexities inherent in physiological and speech data. Comparative analyses with conventional neural network models are presented to underscore the superior efficiency, lower power consumption, and higher temporal resolution of SNNs. The review further explores challenges and future prospects, highlighting the potential of SNNs to revolutionize wearable healthcare monitoring systems, neuroprosthetic devices, and natural language processing technologies. By providing a comprehensive overview of current strategies, this review aims to inspire innovative approaches in the field, fostering advances in real-time and energy-efficient processing of complex biological signals.

SSTE: Syllable-Specific Temporal Encoding to FORCE-learn audio sequences with an associative memory approach

The circuitry and pathways in the brains of humans and other species have long inspired researchers and system designers to develop accurate and efficient systems capable of solving real-world problems and responding in real-time. We propose the Syllable-Specific Temporal Encoding (SSTE) to learn vocal sequences in a reservoir of Izhikevich neurons, by forming associations between exclusive input activities and their corresponding syllables in the sequence. Our model converts the audio signals to cochleograms using the CAR-FAC model to simulate a brain-like auditory learning and memorization process. The reservoir is trained using a hardware-friendly approach to FORCE learning. Reservoir computing could yield associative memory dynamics with far less computational complexity compared to RNNs. The SSTE-based learning enables competent accuracy and stable recall of spatiotemporal sequences with fewer reservoir inputs compared with existing encodings in the literature for similar purpose, offering resource savings. The encoding points to syllable onsets and allows recalling from a desired point in the sequence, making it particularly suitable for recalling subsets of long vocal sequences. The SSTE demonstrates the capability of learning new signals without forgetting previously memorized sequences and displays robustness against occasional noise, a characteristic of real-world scenarios. The components of this model are configured to improve resource consumption and computational intensity, addressing some of the cost-efficiency issues that might arise in future implementations aiming for compactness and real-time, low-power operation. Overall, this model proposes a brain-inspired pattern generation network for vocal sequences that can be extended with other bio-inspired computations to explore their potentials for brain-like auditory perception. Future designs could inspire from this model to implement embedded devices that learn vocal sequences and recall them as needed in real-time. Such systems could acquire language and speech, operate as artificial assistants, and transcribe text to speech, in the presence of natural noise and corruption on audio data.

Genome-wide SNP discovery and genotyping delineates potential QTLs underlying major yield-attributing traits in buckwheat

Buckwheat (Fagopyrum spp.) is an important nutritional and nutraceutical-rich pseudo-cereal crop. Despite its obvious potential as a functional food, buckwheat has not been fully harnessed due to its low yield, self-incompatibility, increased seed cracking, limited seed set, lodging, and frost susceptibility. The inadequate availability of genomics resources in buckwheat is one of the major reasons for this. In the present study, genome-wide association mapping (GWAS) was conducted to identify loci associated with various morphological and yield-related traits in buckwheat. High throughput genotyping by sequencing led to the identification of 34,978 single nucleotide polymorphisms that were distributed across eight chromosomes. Population structure analysis grouped the genotypes into three sub-populations. The genotypes were also characterized for various qualitative and quantitative traits at two diverse locations, the analysis of which revealed a significant difference in the mean values. The association analysis revealed a total of 71 significant marker-trait associations across eight chromosomes. The candidate genes were identified near 100 Kb of quantitative trait loci (QTLs), providing insights into several metabolic and biosynthetic pathways. The integration of phenology and GWAS in the present study is useful to uncover the consistent genomic regions, related markers associated with various yield-related traits, and potential candidate genes having implications for being utilized in molecular breeding for the improvement of economically important traits in buckwheat. Moreover, the identified QTLs will assist in tracking the desirable alleles of target genes within the buckwheat breeding populations/germplasm.

Spiking neural network-based computational modeling of episodic memory

In this research article, a spiking neural network-based simulation of the hippocampus is performed to model the functionalities of episodic memory. The purpose of the simulation is to find a computational model through the biological architecture of the hippocampus and correct values for their architectural biological parameters to support the episodic memory functionalities. The episodic store of the model is represented by the collection of events, where each event is further subdivided into coactive activities of experience. The model has tried to mimic the three functionalities of episodic memory, which are pattern separation, pattern association, and their recallings. In pattern separation model used the dentate biological connectivity to generate almost different output patterns corresponding to similar input patterns to reduce interference between two similar memory traces so that ambiguity can be reduced during recalling. In pattern association, an STDP based event encoding and forgetting mechanism are used to mimic the encoding function of the CA3 region in which the coactive activities get associated with each other. A decoder is proposed based on CA1, which can answer the stored event related queries. Along with these functionalities model also supports recalling and encoding based forgetting. Experimental work is performed on the model for the given set of events to check for the pattern separation efficiency, pattern completion efficiency and to check the capability of decoding the answer. An empirical analysis of the results is done and compared with the SMRITI model of episodic memory.

Anti-Disturbance of Scale-Free Spiking Neural Network against Impulse Noise

The bio-brain presents robustness function to external stimulus through its self-adaptive regulation and neural information processing. Drawing from the advantages of the bio-brain to investigate the robustness function of a spiking neural network (SNN) is conducive to the advance of brain-like intelligence. However, the current brain-like model is insufficient in biological rationality. In addition, its evaluation method for anti-disturbance performance is inadequate. To explore the self-adaptive regulation performance of a brain-like model with more biological rationality under external noise, a scale-free spiking neural network(SFSNN) is constructed in this study. Then, the anti-disturbance ability of the SFSNN against impulse noise is investigated, and the anti-disturbance mechanism is further discussed. Our simulation results indicate that: (i) our SFSNN has anti-disturbance ability against impulse noise, and the high-clustering SFSNN outperforms the low-clustering SFSNN in terms of anti-disturbance performance. (ii) The neural information processing in the SFSNN under external noise is clarified, which is a dynamic chain effect of the neuron firing, the synaptic weight, and the topological characteristic. (iii) Our discussion hints that an intrinsic factor of the anti-disturbance ability is the synaptic plasticity, and the network topology is a factor that affects the anti-disturbance ability at the level of performance.

Pseudo-transistors for emerging neuromorphic electronics

Artificial synaptic devices are the cornerstone of neuromorphic electronics. The development of new artificial synaptic devices and the simulation of biological synaptic computational functions are important tasks in the field of neuromorphic electronics. Although two-terminal memristors and three-terminal synaptic transistors have exhibited significant capabilities in the artificial synapse, more stable devices and simpler integration are needed in practical applications. Combining the configuration advantages of memristors and transistors, a novel pseudo-transistor is proposed. Here, recent advances in the development of pseudo-transistor-based neuromorphic electronics in recent years are reviewed. The working mechanisms, device structures and materials of three typical pseudo-transistors, including tunneling random access memory (TRAM), memflash and memtransistor, are comprehensively discussed. Finally, the future development and challenges in this field are emphasized.

Entropic associative memory for manuscript symbols

Manuscript symbols can be stored, recognized and retrieved from an entropic digital memory that is associative and distributed but yet declarative; memory retrieval is a constructive operation, memory cues to objects not contained in the memory are rejected directly without search, and memory operations can be performed through parallel computations. Manuscript symbols, both letters and numerals, are represented in Associative Memory Registers that have an associated entropy. The memory recognition operation obeys an entropy trade-off between precision and recall, and the entropy level impacts on the quality of the objects recovered through the memory retrieval operation. The present proposal is contrasted in several dimensions with neural networks models of associative memory. We discuss the operational characteristics of the entropic associative memory for retrieving objects with both complete and incomplete information, such as severe occlusions. The experiments reported in this paper add evidence on the potential of this framework for developing practical applications and computational models of natural memory.

Developing Intelligent Robots that Grasp Affordance

Humans and robots operating in unstructured environments both need to classify objects through haptic exploration and use them in various tasks, but currently they differ greatly in their strategies for acquiring such capabilities. This review explores nascent technologies that promise more convergence. A novel form of artificial intelligence classifies objects according to sensory percepts during active exploration and decides on efficient sequences of exploratory actions to identify objects. Representing objects according to the collective experience of manipulating them provides a substrate for discovering causality and affordances. Such concepts that generalize beyond explicit training experiences are an important aspect of human intelligence that has eluded robots. For robots to acquire such knowledge, they will need an extended period of active exploration and manipulation similar to that employed by infants. The efficacy, efficiency and safety of such behaviors depends on achieving smooth transitions between movements that change quickly from exploratory to executive to reflexive. Animals achieve such smoothness by using a hierarchical control scheme that is fundamentally different from those of conventional robotics. The lowest level of that hierarchy, the spinal cord, starts to self-organize during spontaneous movements in the fetus. This allows its connectivity to reflect the mechanics of the musculoskeletal plant, a bio-inspired process that could be used to adapt spinal-like middleware for robots. Implementation of these extended and essential stages of fetal and infant development is impractical, however, for mechatronic hardware that does not heal and replace itself like biological tissues. Instead such development can now be accomplished in silico and then cloned into physical robots, a strategy that could transcend human performance.

Spatio-Temporal Sequential Memory Model With Mini-Column Neural Network

Memory is an intricate process involving various faculties of the brain and is a central component in human cognition. However, the exact mechanism that brings about memory in our brain remains elusive and the performance of the existing memory models is not satisfactory. To overcome these problems, this paper puts forward a brain-inspired spatio-temporal sequential memory model based on spiking neural networks (SNNs). Inspired by the structure of the neocortex, the proposed model is structured by many mini-columns composed of biological spiking neurons. Each mini-column represents one memory item, and the firing of different spiking neurons in the mini-column depends on the context of the previous inputs. The Spike-Timing-Dependant Plasticity (STDP) is used to update the connections between excitatory neurons and formulates association between two memory items. In addition, the inhibitory neurons are employed to prevent incorrect prediction, which contributes to improving the retrieval accuracy. Experimental results demonstrate that the proposed model can effectively store a huge number of data and accurately retrieve them when sufficient context is provided. This work not only provides a new memory model but also suggests how memory could be formulated with excitatory/inhibitory neurons, spike-based encoding, and mini-column structure.

An entropic associative memory

Natural memories are associative, declarative and distributed, and memory retrieval is a constructive operation. In addition, cues of objects that are not contained in the memory are rejected directly. Symbolic computing memories resemble natural memories in their declarative character, and information can be stored and recovered explicitly; however, they are reproductive rather than constructive, and lack the associative and distributed properties. Sub-symbolic memories developed within the connectionist or artificial neural networks paradigm are associative and distributed, but lack the declarative property, the capability of rejecting objects that are not included in the memory, and memory retrieval is also reproductive. In this paper we present a memory model that sustains the five properties of natural memories. We use Relational-Indeterminate Computing to model associative memory registers that hold distributed representations of individual objects. This mode of computing has an intrinsic computing entropy which measures the indeterminacy of representations. This parameter determines the operational characteristics of the memory. Associative registers are embedded in an architecture that maps concrete images expressed in modality specific buffers into abstract representations and vice versa. The framework has been used to model a visual memory holding the representations of hand-written digits. The system has been tested with a set of memory recognition and retrieval experiments with complete and severely occluded images. The results show that there is a range of entropy values, not too low and not too high, in which associative memory registers have a satisfactory performance. The experiments were implemented in a simulation using a standard computer with a GPU, but a parallel architecture may be built where the memory operations would take a very reduced number of computing steps.

How Neuronal Noises Influence the Spiking Neural Networks's Cognitive Learning Process: A Preliminary Study

In neuroscience, the Default Mode Network (DMN), also known as the default network or the default-state network, is a large-scale brain network known to have highly correlated activities that are distinct from other networks in the brain. Many studies have revealed that DMNs can influence other cognitive functions to some extent. This paper is motivated by this idea and intends to further explore on how DMNs could help Spiking Neural Networks (SNNs) on image classification problems through an experimental study. The approach emphasizes the bionic meaning on model selection and parameters settings. For modeling, we select Leaky Integrate-and-Fire (LIF) as the neuron model, Additive White Gaussian Noise (AWGN) as the input DMN, and design the learning algorithm based on Spike-Timing-Dependent Plasticity (STDP). Then, we experiment on a two-layer SNN to evaluate the influence of DMN on classification accuracy, and on a three-layer SNN to examine the influence of DMN on structure evolution, where the results both appear positive. Finally, we discuss possible directions for future works.