The Design of Memristive Circuit for Affective Multi-Associative Learning

Memristor-based circuit design of episodic memory neural network and its application in hurricane category prediction

Episodic memory, as a type of long-term memory (LTM), is used to learn and store the unique personal experience. Based on the episodic memory biological mechanism, this paper proposes a bionic episodic memory memristive neural network circuit. The proposed memristive neural network circuit includes a neocortical module, a parahippocampal module and a hippocampus module. The neocortical module with the two paths structure is used to receive the sensory signal, and is also used to separate and transmit the spatial information and the non-spatial information involved in the sensory signal. The parahippocampal module is composed of the parahippocampal cortex-MEA and the perirhinal cortex-LEA, which receives the two types of information from the neocortical module respectively. As the last module, the hippocampus module receives and integrates the output information of the parahippocampal module as well as generates the corresponding episodic memory. Meanwhile, the specific scenario information with the certain temporal signal from the generated episodic memory is also extracted by the hippocampus module. The simulation results in PSPICE show that the proposed memristive neural network circuit can generate the various episodic memories and extract the specific scenario information successfully. By configuring the memristor parameters, the proposed bionic episodic memory memristive neural network circuit can be applied to the hurricane category prediction, which verifies the feasibility of this work.

The Framework and Memristive Circuit Design for Multisensory Mutual Associative Memory Networks

In this work, we propose a multisensory mutual associative memory networks framework and memristive circuit to mimic the ability of the biological brain to make associations of information received simultaneously. The circuit inspired by neural mechanisms of associative memory cells mainly consists of three modules: 1) the storage neurons module, which encodes external multimodal information into the firing rate of spikes; 2) the synapse module, which uses the nonvolatility memristor to achieve weight adjustment and associative learning; and 3) the retrieval neuron module, which feeds the retrieval signal output from each sensory pathway to other sensory pathways, so that achieve mutual association and retrieval between multiple modalities. Different from other one-to-one or many-to-one unidirectional associative memory work, this circuit achieves bidirectional association from multiple modalities to multiple modalities. In addition, we simulate the acquisition, extinction, recovery, transmission, and consolidation properties of associative memory. The circuit is applied to cross-modal association of image and audio recognition results, and episodic memory is simulated, where multiple images in a scene are intramodal associated. With power and area analysis, the circuit is validated as hardware-friendly. Further research to extend this work into large-scale associative memory networks, combined with visual-auditory-tactile-gustatory sensory sensors, is promising for application in intelligent robotic platforms to facilitate the development of neuromorphic systems and brain-like intelligence.

Memristive neural network circuit implementation of associative learning with overshadowing and blocking

In the field of second language acquisition, overshadowing and blocking by cue competition effects in classical conditioning affect the learning and expression of human cognitive associations. In this work, a memristive neural network circuit based on neurobiological mechanisms is proposed, which consists of synapse module, neuron module, and control module. In particular, the designed network introduces an inhibitory interneuron to divide memristive synapses into excitatory and inhibitory memristive synapses, so as to mimic synaptic plasticity better. In addition, the proposed circuit can implement six functions of second language acquisition conditioning, including learning, overshadowing, blocking, recovery from overshadowing, recovery from blocking, and long-term effect of overshadowing over time leading to blocking. Overshadowing, which denotes that the more salient stimulus overshadows the learning of the less salient stimulus when two stimuli differ in salience, reduces the associative strength acquired by the less salient stimulus. Blocking, which indicates that pretraining on one stimulus blocks learning about a second stimulus, inhibits the associative strength acquired by a second stimulus. Finally, the correctness and effectiveness of implementing functions mentioned above are verified by the simulation results in PSPICE. Through further research, the proposed circuit is applied to bionic devices such as social robots or educational robots, which can address language and cognitive disorders via assisted learning and training.

Memristive competitive hopfield neural network for image segmentation application

Image segmentation implementation provides simplified and effective feature information of image. Neural network algorithms have made significant progress in the application of image segmentation task. However, few studies focus on the implementation of hardware circuits with high-efficiency analog calculations and parallel operations for image segmentation problem. In this paper, a memristor-based competitive Hopfield neural network circuit is proposed to deal with the image segmentation problem. In this circuit, the memristive cross array is applied to store synaptic weights and perform matrix operations. The competition module based on the Winner-take-all mechanism is composed of the competition neurons and the competition control circuit, which simplifies the energy function of the Hopfield neural network and realizes the output function. Operational amplifiers and ABM modules are used to integrate operations and process external input information, respectively. Based on these designs, the circuit can automatically implement iteration and update of data. A series of PSPICE simulations are designed to verify the image segmentation capability of this circuit. Comparative experimental results and analysis show that this circuit has effective improvements both in processing speed and segmentation accuracy compared with other methods. Moreover, the proposed circuit shows good robustness to noise and memristive variation.

Memristor-Based Neural Network Circuit With Multimode Generalization and Differentiation on Pavlov Associative Memory

Most of the classical conditioning laws implemented by existing circuits are involved in learning and forgetting between only three neurons, and the problems between multiple neurons are not considered. In this article, a multimode generalization and differentiation circuit for the Pavlov associative memory is proposed based on memristors. The designed circuit is mainly composed of voltage control modules, synaptic neuron modules, and inhibition modules. The secondary differentiation is accomplished through the process of associative learning and forgetting among multiple neurons. The process of multiple generalization and differentiation is realized based on the nonvolatility and thresholding properties of memristors. The extinction inhibition and differentiation inhibition in forgetting is considered through the inhibition modules. The Pavlov associative memory neural network with multimodal generalization and differentiation may provide a reference for the further development of brain-like intelligence.

Memristive Circuit Design of Brain-Like Emotional Learning and Generation

In this work, a bionic memristive circuit with the functions of emotional learning and generation is proposed, which can perform brain-like emotional learning and generation based on various types of input information. The proposed circuit is designed based on the brain emotional learning theory in the limbic system, which mainly includes three layers of design: 1) the bottom layer is the design of the basic unit modules, such as neuron and synapse; 2) the middle layer is the design of the functional modules related to emotional learning in the limbic system, such as the amygdala, thalamus, and so on; and 3) the top layer is the design of the overall circuit, which is used to realize the function of the emotional generation. A 2-D emotional space composed of valence and arousal signals is adopted. According to the above bottom-up circuit design method, the valence and arousal signals can be generated, respectively, by designing corresponding emotional learning circuits, so as to form continuous emotions. The volatile and nonvolatile memristors are mainly used to mimic the functions of the neuron and synapse at the bottom layer of the circuit to achieve the core emotional learning function of the middle layer, thereby constructing a brain-like information processing architecture to realize the function of the emotional generation in the top layer. The simulation results in PSPICE show that the proposed circuit can learn and generate emotions like humans. If the proposed circuit is applied to a humanoid robot platform through further research, the robot may have the ability of personalized emotional interaction with humans, so that it can be effectively used in emotional companionship and other aspects.

Memristive Circuit Implementation of Operant Cascaded With Classical Conditioning

Classical conditioning (CC) and operant conditioning (OC), also known as associative memory, are two of the most fundamental and critical learning mechanisms in the biological brain. However, the existing designs of associative memory memristive circuits mainly focus on CC, and few studies have used memristors to imitate OC at the behavioral level, as well as the OC-CC cascaded associative memories that are widespread in biological learning processes. This work proposes an OC-CC cascaded circuit composed of OC and CC circuits. With the OC memristive circuit, bio-like functions such as random exploration, feedback learning, experience memory, and experience-based decision-making are achieved, which enables the circuit to continuously reshape its own memories and actions to adapt to changing environments. By cascading it with the CC memristive circuit that has the functions of associative learning, forgetting, generalization, and differentiation, the OC-CC cascaded circuit implements richer associative memories and has stronger environmental adaptability. Finally, the proposed circuits can perform on-line in-situ learning and in-memory computing. This is a more brain-like processing method, which is different from the von Neumann architecture. The simulation results of the proposed circuits in PSPICE show that they can simulate the above functions and have advantages in power consumption and hardware overhead. This work provides a possible realization idea for large-scale bionic learning.

Memristor-Based Neural Network Circuit of Emotion Congruent Memory With Mental Fatigue and Emotion Inhibition

Most memristor-based neural networks only consider a single mode of memory or emotion, but ignore the relationship between emotion and memory. In this paper, a memristor-based neural network circuit of emotion congruent memory is proposed and verified by the simulation results. The designed circuit consists of a memory module, an emotion module and an association neuron module. Varieties of memory and emotion functions are considered. The functions such as learning, forgetting, variable rate and emotion generation are implemented by the circuit. Furthermore, mental fatigue and emotion inhibition which are two important self-protective measures of the brain are realized in this paper on the basis of emotion congruent memory. Finally, the paper also considers the congruence between emotion and memory materials and the regulation of emotion on memory. The neural network circuit of emotion congruent memory can provide more references for the application of memristor.