Reliability of neuronal information conveyed by unreliable neuristor-based leaky integrate-and-fire neurons: a model study

Energy controls wave propagation in a neural network with spatial stimuli

Nervous system has distinct anisotropy and some intrinsic biophysical properties enable neurons present various firing modes in neural activities. In presence of realistic electromagnetic fields, non-uniform radiation activates these neurons with energy diversity. By using a feasible model, energy function is obtained to predict the growth of synaptic connections of these neurons. Distribution of average value of the Hamilton energy function vs. intensity of noisy disturbance can predict the occurrence of coherence resonance, which the neural activities show high regularity by applying noisy disturbance with moderate intensity. From physical viewpoint, the average energy value has similar role average power for the neuron. Non-uniform spatial disturbance is applied and energy is injected into the neural network, statistical synchronization factor is calculated to predict the network synchronization stability and wave propagation. The intensity for field coupling is adaptively controlled by energy diversity between adjacent neurons. Local energy balance will terminate further growth of the coupling intensity; otherwise, heterogeneity is formed in the network due to energy diversity. Furthermore, memristive channel current is introduced into the neuron model for perceiving the effect of electromagnetic induction and radiation, and a memristive neuron is obtained. The circuit implement of memristive circuit depends on the connection to a magnetic flux-controlled memristor into the mentioned neural circuit in an additive branch circuit. The connection and activation of this memristive neural network are controlled under external spatial electromagnetic radiation by capturing enough field energy. Continuous energy collection and exchange generate energy diversity and synaptic connection is created to regulate the synchronous firing patterns and energy balance.

Biological function simulation in neuromorphic devices: from synapse and neuron to behavior

As the boom of data storage and processing, brain-inspired computing provides an effective approach to solve the current problem. Various emerging materials and devices have been reported to promote the development of neuromorphic computing. Thereinto, the neuromorphic device represented by memristor has attracted extensive research due to its outstanding property to emulate the brain's functions from synaptic plasticity, sensory-memory neurons to some intelligent behaviors of living creatures. Herein, we mainly review the progress of these brain functions mimicked by neuromorphic devices, concentrating on synapse (i.e. various synaptic plasticity trigger by electricity and/or light), neurons (including the various sensory nervous system) and intelligent behaviors (such as conditioned reflex represented by Pavlov's dog experiment). Finally, some challenges and prospects related to neuromorphic devices are presented.

A VO2 Neuristor Based on Microstrip Line Coupling

The neuromorphic network based on artificial neurons and synapses can solve computational difficulties, and its energy efficiency is incomparable to the traditional von Neumann architecture. As a new type of circuit component, nonvolatile memristors are very similar to biological synapses in structure and function. Only one memristor can simulate the function of a synapse. Therefore, memristors provide a new way to build hardware-based artificial neural networks. To build such an artificial neural network, in addition to the artificial synapses, artificial neurons are also needed to realize the distribution of information and the adjustment of synaptic weights. As the VO₂ volatile local active memristor is complementary to nonvolatile memristors, it can be used to simulate the function of neurons. However, determining how to better realize the function of neurons with simple circuits is one of the current key problems to be solved in this field. This paper considers the influence of distribution parameters on circuit performance under the action of high-frequency and high-speed signals. Two Mott VO₂ memristor units are connected and coupled with microstrip lines to simulate the Hodgkin-Huxley neuron model. It is found that the proposed memristor neuron based on microstrip lines shows the characteristics of neuron action potential: amplification and threshold.

Bifurcation and Entropy Analysis of a Chaotic Spike Oscillator Circuit Based on the S-Switch

This paper presents a model and experimental study of a chaotic spike oscillator based on a leaky integrate-and-fire (LIF) neuron, which has a switching element with an S-type current-voltage characteristic (S-switch). The oscillator generates spikes of the S-switch in the form of chaotic pulse position modulation driven by the feedback with rate coding instability of LIF neuron. The oscillator model with piecewise function of the S-switch has resistive feedback using a second order filter. The oscillator circuit is built on four operational amplifiers and two field-effect transistors (MOSFETs) that form an S-switch based on a Schmitt trigger, an active RC filter and a matching amplifier. We investigate the bifurcation diagrams of the model and the circuit and calculate the entropy of oscillations. For the analog circuit, the "regular oscillation-chaos" transition is analysed in a series of tests initiated by a step voltage in the matching amplifier. Entropy values are used to estimate the average time for the transition of oscillations to chaos and the degree of signal correlation of the transition mode of different tests. Study results can be applied in various reservoir computing applications, for example, in choosing and configuring the LogNNet network reservoir circuits.

Emerging Artificial Neuron Devices for Probabilistic Computing

In recent decades, artificial intelligence has been successively employed in the fields of finance, commerce, and other industries. However, imitating high-level brain functions, such as imagination and inference, pose several challenges as they are relevant to a particular type of noise in a biological neuron network. Probabilistic computing algorithms based on restricted Boltzmann machine and Bayesian inference that use silicon electronics have progressed significantly in terms of mimicking probabilistic inference. However, the quasi-random noise generated from additional circuits or algorithms presents a major challenge for silicon electronics to realize the true stochasticity of biological neuron systems. Artificial neurons based on emerging devices, such as memristors and ferroelectric field-effect transistors with inherent stochasticity can produce uncertain non-linear output spikes, which may be the key to make machine learning closer to the human brain. In this article, we present a comprehensive review of the recent advances in the emerging stochastic artificial neurons (SANs) in terms of probabilistic computing. We briefly introduce the biological neurons, neuron models, and silicon neurons before presenting the detailed working mechanisms of various SANs. Finally, the merits and demerits of silicon-based and emerging neurons are discussed, and the outlook for SANs is presented.

Biological plausibility and stochasticity in scalable VO2 active memristor neurons

Neuromorphic networks of artificial neurons and synapses can solve computationally hard problems with energy efficiencies unattainable for von Neumann architectures. For image processing, silicon neuromorphic processors outperform graphic processing units in energy efficiency by a large margin, but deliver much lower chip-scale throughput. The performance-efficiency dilemma for silicon processors may not be overcome by Moore's law scaling of silicon transistors. Scalable and biomimetic active memristor neurons and passive memristor synapses form a self-sufficient basis for a transistorless neural network. However, previous demonstrations of memristor neurons only showed simple integrate-and-fire behaviors and did not reveal the rich dynamics and computational complexity of biological neurons. Here we report that neurons built with nanoscale vanadium dioxide active memristors possess all three classes of excitability and most of the known biological neuronal dynamics, and are intrinsically stochastic. With the favorable size and power scaling, there is a path toward an all-memristor neuromorphic cortical computer.

Nonvolatile Memory Materials for Neuromorphic Intelligent Machines

Recent progress in deep learning extends the capability of artificial intelligence to various practical tasks, making the deep neural network (DNN) an extremely versatile hypothesis. While such DNN is virtually built on contemporary data centers of the von Neumann architecture, physical (in part) DNN of non-von Neumann architecture, also known as neuromorphic computing, can remarkably improve learning and inference efficiency. Particularly, resistance-based nonvolatile random access memory (NVRAM) highlights its handy and efficient application to the multiply-accumulate (MAC) operation in an analog manner. Here, an overview is given of the available types of resistance-based NVRAMs and their technological maturity from the material- and device-points of view. Examples within the strategy are subsequently addressed in comparison with their benchmarks (virtual DNN in deep learning). A spiking neural network (SNN) is another type of neural network that is more biologically plausible than the DNN. The successful incorporation of resistance-based NVRAM in SNN-based neuromorphic computing offers an efficient solution to the MAC operation and spike timing-based learning in nature. This strategy is exemplified from a material perspective. Intelligent machines are categorized according to their architecture and learning type. Also, the functionality and usefulness of NVRAM-based neuromorphic computing are addressed.

Neural-like computing with populations of superparamagnetic basis functions

In neuroscience, population coding theory demonstrates that neural assemblies can achieve fault-tolerant information processing. Mapped to nanoelectronics, this strategy could allow for reliable computing with scaled-down, noisy, imperfect devices. Doing so requires that the population components form a set of basis functions in terms of their response functions to inputs, offering a physical substrate for computing. Such a population can be implemented with CMOS technology, but the corresponding circuits have high area or energy requirements. Here, we show that nanoscale magnetic tunnel junctions can instead be assembled to meet these requirements. We demonstrate experimentally that a population of nine junctions can implement a basis set of functions, providing the data to achieve, for example, the generation of cursive letters. We design hybrid magnetic-CMOS systems based on interlinked populations of junctions and show that they can learn to realize non-linear variability-resilient transformations with a low imprint area and low power.

Population coding, where populations of artificial neurons process information collectively can facilitate robust data processing, but require high circuit overheads. Here, the authors realize this approach with reduced circuit area and power consumption, by utilizing superparamagnetic tunnel junction based neurons.

Leaky Integrate-and-Fire Neuron Circuit Based on Floating-Gate Integrator

The artificial spiking neural network (SNN) is promising and has been brought to the notice of the theoretical neuroscience and neuromorphic engineering research communities. In this light, we propose a new type of artificial spiking neuron based on leaky integrate-and-fire (LIF) behavior. A distinctive feature of the proposed FG-LIF neuron is the use of a floating-gate (FG) integrator rather than a capacitor-based one. The relaxation time of the charge on the FG relies mainly on the tunnel barrier profile, e.g., barrier height and thickness (rather than the area). This opens up the possibility of large-scale integration of neurons. The circuit simulation results offered biologically plausible spiking activity (<100 Hz) with a capacitor of merely 6 fF, which is hosted in an FG metal-oxide-semiconductor field-effect transistor. The FG-LIF neuron also has the advantage of low operation power (<30 pW/spike). Finally, the proposed circuit was subject to possible types of noise, e.g., thermal noise and burst noise. The simulation results indicated remarkable distributional features of interspike intervals that are fitted to Gamma distribution functions, similar to biological neurons in the neocortex.

Relaxation oscillator-realized artificial electronic neurons, their responses, and noise

A proof-of-concept relaxation oscillator-based leaky integrate-and-fire (ROLIF) neuron circuit is realized by using an amorphous chalcogenide-based threshold switch and non-ideal operational amplifier (op-amp). The proposed ROLIF neuron offers biologically plausible features such as analog-type encoding, signal amplification, unidirectional synaptic transmission, and Poisson noise. The synaptic transmission between pre- and postsynaptic neurons is achieved through a passive synapse (simple resistor). The synaptic resistor coupled to the non-ideal op-amp realizes excitatory postsynaptic potential (EPSP) evolution that evokes postsynaptic neuron spiking. In an attempt to generalize our proposed model, we theoretically examine ROLIF neuron circuits adopting different non-ideal op-amps having different gains and slew rates. The simulation results indicate the importance of gain in postsynaptic neuron spiking, irrespective of the slew rate (as long as the rate exceeds a particular value), providing the basis for the ROLIF neuron circuit design. Eventually, the behavior of a postsynaptic neuron in connection to multiple presynaptic neurons via synapses is highlighted in terms of EPSP evolution amid simultaneously incident asynchronous presynaptic spikes, which in fact reveals an important role of the random noise in spatial integration.

A memristive spiking neuron with firing rate coding

Perception, decisions, and sensations are all encoded into trains of action potentials in the brain. The relation between stimulus strength and all-or-nothing spiking of neurons is widely believed to be the basis of this coding. This initiated the development of spiking neuron models; one of today's most powerful conceptual tool for the analysis and emulation of neural dynamics. The success of electronic circuit models and their physical realization within silicon field-effect transistor circuits lead to elegant technical approaches. Recently, the spectrum of electronic devices for neural computing has been extended by memristive devices, mainly used to emulate static synaptic functionality. Their capabilities for emulations of neural activity were recently demonstrated using a memristive neuristor circuit, while a memristive neuron circuit has so far been elusive. Here, a spiking neuron model is experimentally realized in a compact circuit comprising memristive and memcapacitive devices based on the strongly correlated electron material vanadium dioxide (VO₂) and on the chemical electromigration cell Ag/TiO_2−x/Al. The circuit can emulate dynamical spiking patterns in response to an external stimulus including adaptation, which is at the heart of firing rate coding as first observed by E.D. Adrian in 1926.