A silicon neuron

Reconfigurable Artificial Synapses Based on Ambipolar Environmentally Stable Tellurium for Neuromorphic Computing

Neuromorphic computing, a promising solution to the von Neumann bottleneck, is paving the way for next-generation computing and sensing systems. However, most studies of artificial synapses mimic only static plasticity, which is far from achieving the complex behaviors of the human brain. Here, we report a reliable neuromorphic computing system that integrates a top floating gate memory architecture and uses peculiar ambipolar tellurium (Te) as a channel material to fabricate reliable nonvolatile memory cells. The memory device clearly exhibits exceptional retention (∼104 s) and endurance (∼104 cycles) properties for ambipolar memory with on/off ratios of 108 (electrons) and 106 (holes). Furthermore, we have also achieved reconfigurable excitatory and inhibitory synapse functions based on a Te ambipolarity device and explored its application in neuromorphic computing for recognition of different levels of complexity images with high accuracy generally above 90%, demonstrating its potential in neuromorphic computing. These findings highlight the prospects of ambipolar Te memory for advancing the future in memory computing hardware.

A Review of Nanowire Devices Applied in Simulating Neuromorphic Computing

With the rapid advancement of artificial intelligence and machine learning technologies, the demand for enhanced device computing capabilities has significantly increased. Neuromorphic computing, an emerging computational paradigm inspired by the human brain, has garnered growing attention as a promising research frontier. Inspired by the human brain's functionality, this technology mimics the behavior of neurons and synapses to enable efficient, low-power computing. Unlike conventional digital systems, this approach offers a potentially superior alternative. This article delves into the application of nanowire materials (and devices) in neuromorphic computing simulations: First, it introduces the synthesis and preparation methods of nanowire materials. Then, it analyzes in detail the key role of nanowire devices in constructing artificial neural networks, especially their advantages in simulating the functions of neurons and synapses. Compared with traditional silicon-based material devices, it focuses on how nanowire devices can achieve higher connection density and lower energy consumption, thereby enabling new types of neuromorphic computing. Finally, it looks forward to the application potential of nanowire devices in the field of future neuromorphic computing, expecting them to become a key force in promoting the development of intelligent computing, with extensive application prospects in the fields of informatics and medicine.

Single-transistor organic electrochemical neurons

Neuromorphic devices that mimic the energy-efficient sensing and processing capabilities of biological neurons hold significant promise for developing bioelectronic systems capable of precise sensing and adaptive stimulus-response. However, current silicon-based technologies lack biocompatibility and rely on operational principles that differ from those of biological neurons. Organic electrochemical neurons (OECNs) address these shortcomings but typically require multiple components, limiting their integration density and scalability. Here, we report a single-transistor OECN (1T-OECN) that leverages the hysteretic switching of organic electrochemical memtransistors (OECmTs) based on poly(benzimidazobenzophenanthroline). By tuning the electrolyte and driving voltage, the OECmTs switch between high- and low-resistance states, enabling action potential generation, dynamic spiking, and logic operations within a single device with dimensions comparable to biological neurons. The compact 1T-OECN design (~180 µm2 footprint) supports high-density integration, achieving over 62,500 neurons/cm2 on flexible substrates. This advancement highlights the potential for scalable, bio-inspired neuromorphic computing and seamless integration with biological systems.

The road to commercial success for neuromorphic technologies

Neuromorphic technologies adapt biological neural principles to synthesise high-efficiency computational devices, characterised by continuous real-time operation and sparse event-based communication. After several false starts, a confluence of advances now promises widespread commercial adoption. Gradient-based training of deep spiking neural networks is now an off-the-shelf technique for building general-purpose Neuromorphic applications, with open-source tools underwritten by theoretical results. Analog and mixed-signal Neuromorphic circuit designs are being replaced by digital equivalents in newer devices, simplifying application deployment while maintaining computational benefits. Designs for in-memory computing are also approaching commercial maturity. Solving two key problems-how to program general Neuromorphic applications; and how to deploy them at scale-clears the way to commercial success of Neuromorphic processors. Ultra-low-power Neuromorphic technology will find a home in battery-powered systems, local compute for internet-of-things devices, and consumer wearables. Inspiration from uptake of tensor processors and GPUs can help the field overcome remaining hurdles.

Two-Dimensional Materials for Brain-Inspired Computing Hardware

Recent breakthroughs in brain-inspired computing promise to address a wide range of problems from security to healthcare. However, the current strategy of implementing artificial intelligence algorithms using conventional silicon hardware is leading to unsustainable energy consumption. Neuromorphic hardware based on electronic devices mimicking biological systems is emerging as a low-energy alternative, although further progress requires materials that can mimic biological function while maintaining scalability and speed. As a result of their diverse unique properties, atomically thin two-dimensional (2D) materials are promising building blocks for next-generation electronics including nonvolatile memory, in-memory and neuromorphic computing, and flexible edge-computing systems. Furthermore, 2D materials achieve biorealistic synaptic and neuronal responses that extend beyond conventional logic and memory systems. Here, we provide a comprehensive review of the growth, fabrication, and integration of 2D materials and van der Waals heterojunctions for neuromorphic electronic and optoelectronic devices, circuits, and systems. For each case, the relationship between physical properties and device responses is emphasized followed by a critical comparison of technologies for different applications. We conclude with a forward-looking perspective on the key remaining challenges and opportunities for neuromorphic applications that leverage the fundamental properties of 2D materials and heterojunctions.

An organic electrochemical neuron for a neuromorphic perception system

Human perception systems are highly refined, relying on an adaptive, plastic, and event-driven network of sensory neurons. Drawing inspiration from Nature, neuromorphic perception systems hold tremendous potential for efficient multisensory signal processing in the physical world; however, the development of an efficient artificial neuron with a widely calibratable spiking range and reduced footprint remains challenging. Here, we report an efficient organic electrochemical neuron (OECN) with reduced footprint (<37 mm2) based on high-performance vertical OECT (vOECT) complementary circuitry enabled by an advanced n-type polymer for balanced p-/n-type vOECT performance. The OECN exhibits outstanding neuronal characteristics, capable of producing spikes with a widely calibratable state-of-the art firing frequency range of 0.130 to 147.1 Hz. Leveraging this capability, we develop a neuromorphic perception system that integrates mechanical sensors with the OECN and integrates them with an artificial synapse for tactile perception. The system successfully encodes tactile stimulations into frequency-dependent spikes, which are further converted into postsynaptic responses. This bioinspired design demonstrates significant potential to advance cyborg and neuromorphic systems, providing them with perceptual capabilities.

Compact Physical Implementation of Spiking Neural Network Using Ambipolar WSe2 n-Type/p-Type Ferroelectric Field-Effect Transistor

Spiking neural networks (SNNs) are attracting increasing interests for their ability to emulate biological processes, offering energy-efficient computation and event-driven processing. Currently, no devices are known to combine both neuronal and synaptic functions. This study presents an experimental demonstration of an ambipolar WSe2 n-type/p-type ferroelectric field-effect transistor (n/p-FeFET) integrated with ferroelectric Hf0.5Zr0.5O2 (HZO) to achieve both volatile and nonvolatile properties in a single device. The nonvolatile n-FeFET, driven by the stable ferroelectric properties of HZO, exhibits highly linear synaptic behavior. In contrast, the volatile p-FeFET, influenced by electron self-compensation in the ambipolar WSe2, enables self-resetting leaky-integrate-and-fire neurons. Integrating neuronal and synaptic functions in the same device allows for compact neuromorphic computing applications. Additionally, simulations of SNNs using experimentally calibrated synaptic and neuronal models achieved a 93.8% accuracy in MNIST digit recognition. This innovative approach advances the development of SNNs with high biomimetic fidelity and reduced hardware costs.

Low power nanoscale S-FED based single ended sense amplifier applied in integrate and fire neuron circuit

Current advancements in neuromorphic computing systems are focused on decreasing power consumption and enriching computational functions. Correspondingly, state-of-the-art system-on-chip developers are encouraged to design nanoscale devices with minimum power dissipation and high-speed operation. This paper deals with designing a sense amplifier based on side-contacted field-effect diodes to reduce the power-delay product (PDP) and the noise susceptibility, as critical factors in neuron circuits. Our findings reveal that both static and dynamic power consumption of the S-FED-based sense amplifier, equal to 1.86 μW and 1.92 fW/GHz, are × 243.03 and × 332.83 lower than those of the conventional CMOS counterpart, respectively. While the sense-amplifier circuit based on CMOS technology undergoes an output voltage deviation of 170.97 mV, the proposed S-FED-based one enjoys a minor output deviation of 27.31 mV. Meanwhile, the superior HIGH-level and LOW-level noise margins of the S-FED-based sense amplifier to the CMOS counterparts (∆NMH = 70 mV and ∆NML = 120 mV), respectively, can ensure the system-level operation stability of the former one. Subsequent to the attainment of an area-efficient, low-power, and high-speed S-FED-based sense amplifier (PDP = 187.75 × 10-18 W s) as a fundamental building block, devising an innovative integrate-and-fire neuron circuit based on S-FED paves the way to realize a new generation of neuromorphic architectures. To shed light on this context, an S-FED-based integrate-and-fire neuron circuit is designed and analyzed utilizing a sense amplifier and feedback loop to enhance spiking voltage and subsequent noise immunity in addition to an about fourfold increase in firing frequency compared to CMOS-based ones.

Ultralow Power Electronic Analog of a Biological Fitzhugh-Nagumo Neuron

Here, we introduce an electronic circuit that mimics the functionality of a biological spiking neuron following the Fitzhugh-Nagumo (FN) model. The circuit consists of a tunnel diode that exhibits negative differential resistance (NDR) and an active inductive element implemented by a single MOSFET. The FN neuron converts a DC voltage excitation into voltage spikes analogous to biological action potentials. We predict an energy cost of 2 aJ/cycle through detailed simulation and modeling for these FN neurons. Such an FN neuron is CMOS compatible and enables ultralow power oscillatory and spiking neural network hardware. We demonstrate that FN neurons can be used for oscillator-based computing in a coupled oscillator network to form an oscillator Ising machine (OIM) that can solve computationally hard NP-complete max-cut problems while showing robustness toward process variations.

In-Sensor Computing Realization Using Fully CMOS-Compatible TiN/HfOx-Based Neuristor Array

With the evolution of artificial intelligence, the explosive growth of data from sensory terminals gives rise to severe energy-efficiency bottleneck issues due to cumbersome data interactions among sensory, memory, and computing modules. Heterogeneous integration methods such as chiplet technology can significantly reduce unnecessary data movement; however, they fail to address the fundamental issue of the substantial time and energy overheads resulting from the physical separation of computing and sensory components. Brain-inspired in-sensor neuromorphic computing (ISNC) has plenty of room for such data-intensive applications. However, one key obstacle in developing ISNC systems is the lack of compatibility between material systems and manufacturing processes deployed in sensors and computing units. This study successfully addresses this challenge by implementing fully CMOS-compatible TiN/HfOx-based neuristor array. The developed ISNC system demonstrates several advantageous features, including multilevel analogue modulation, minimal dispersion, and no significant degradation in conductance (@125 °C). These characteristics enable stable and reproducible neuromorphic computing. Additionally, the device exhibits modulatable sensory and multi-store memory processes. Furthermore, the system achieves information recognition with a high accuracy rate of 93%, along with frequency selectivity and notable activity-dependent plasticity. This work provides a promising route to affordable and highly efficient sensory neuromorphic systems.

A Highly Reliable Molybdenum Disulfide-Based Synaptic Memristor Using a Copper Migration-Controlled Structure

Memristors are drawing attention as neuromorphic hardware components because of their non-volatility and analog programmability. In particular, electrochemical metallization (ECM) memristors are extensively researched because of their linear conductance controllability. Two-dimensional materials as switching medium of ECM memristors give advantages of fast speed, low power consumption, and high switching uniformity. However, the multistate retention in the switching conductance range for the long-term reliable neuromorphic system has not been achieved using two-dimensional materials-based ECM memristors. In this study, the copper migration-controlled ECM memristor showing excellent multistate retention characteristics in the switching conductance range using molybdenum disulfide (MoS2 ) and aluminum oxide (Al2 O3 ) is proposed. The fabricated device exhibits gradual resistive switching with low switching voltage (<0.5 V), uniform switching (σ/µ ∼ 0.07), and a wide switching range (>12). Importantly, excellent reliabilities with robustness to cycling stress and retention over 104 s for more than 5-bit states in the switching conductance range are achieved. Moreover, the contribution of the Al2 O3 layer to the retention characteristic is investigated through filament morphology observation using transmission electron microscopy (TEM) and copper migration component analysis. This study provides a practical approach to developing highly reliable memristors with exceptional switching performance.

Photonic online learning: a perspective

Emerging neuromorphic hardware promises to solve certain problems faster and with higher energy efficiency than traditional computing by using physical processes that take place at the device level as the computational primitives in neural networks. While initial results in photonic neuromorphic hardware are very promising, such hardware requires programming or "training" that is often power-hungry and time-consuming. In this article, we examine the online learning paradigm, where the machinery for training is built deeply into the hardware itself. We argue that some form of online learning will be necessary if photonic neuromorphic hardware is to achieve its true potential.

Ion-tunable antiambipolarity in mixed ion-electron conducting polymers enables biorealistic organic electrochemical neurons

Biointegrated neuromorphic hardware holds promise for new protocols to record/regulate signalling in biological systems. Making such artificial neural circuits successful requires minimal device/circuit complexity and ion-based operating mechanisms akin to those found in biology. Artificial spiking neurons, based on silicon-based complementary metal-oxide semiconductors or negative differential resistance device circuits, can emulate several neural features but are complicated to fabricate, not biocompatible and lack ion-/chemical-based modulation features. Here we report a biorealistic conductance-based organic electrochemical neuron (c-OECN) using a mixed ion-electron conducting ladder-type polymer with stable ion-tunable antiambipolarity. The latter is used to emulate the activation/inactivation of sodium channels and delayed activation of potassium channels of biological neurons. These c-OECNs can spike at bioplausible frequencies nearing 100 Hz, emulate most critical biological neural features, demonstrate stochastic spiking and enable neurotransmitter-/amino acid-/ion-based spiking modulation, which is then used to stimulate biological nerves in vivo. These combined features are impossible to achieve using previous technologies.

Noise-activated barrier crossing in multiattractor dissipative neural networks

Noise-activated transitions between coexisting attractors are investigated in a chaotic spiking network. At low noise level, attractor hopping consists of discrete bifurcation events that conserve the memory of initial conditions. When the escape probability becomes comparable to the intrabasin hopping probability, the lifetime of attractors is given by a detailed balance where the less coherent attractors act as a sink for the more coherent ones. In this regime, the escape probability follows an activation law allowing us to assign pseudoactivation energies to limit cycle attractors. These pseudoenergies introduce a useful metric for evaluating the resilience of biological rhythms to perturbations.

Neural oscillation of single silicon nanowire neuron device with no external bias voltage

In this study, we perform simulations to demonstrate neural oscillations in a single silicon nanowire neuron device comprising a gated p–n–p–n diode structure with no external bias lines. The neuron device emulates a biological neuron using interlinked positive and negative feedback loops, enabling neural oscillations with a high firing frequency of ~ 8 MHz and a low energy consumption of ~ 4.5 × 10⁻¹⁵ J. The neuron device provides a high integration density and low energy consumption for neuromorphic hardware. The periodic and aperiodic patterns of the neural oscillations depend on the amplitudes of the analog and digital input signals. Furthermore, the device characteristics, energy band diagram, and leaky integrate-and-fire operation of the neuron device are discussed.

Embodied neuromorphic intelligence

The design of robots that interact autonomously with the environment and exhibit complex behaviours is an open challenge that can benefit from understanding what makes living beings fit to act in the world. Neuromorphic engineering studies neural computational principles to develop technologies that can provide a computing substrate for building compact and low-power processing systems. We discuss why endowing robots with neuromorphic technologies - from perception to motor control - represents a promising approach for the creation of robots which can seamlessly integrate in society. We present initial attempts in this direction, highlight open challenges, and propose actions required to overcome current limitations.

Surrogate gradients for analog neuromorphic computing

Neuromorphic systems aim to accomplish efficient computation in electronics by mirroring neurobiological principles. Taking advantage of neuromorphic technologies requires effective learning algorithms capable of instantiating high-performing neural networks, while also dealing with inevitable manufacturing variations of individual components, such as memristors or analog neurons. We present a learning framework resulting in bioinspired spiking neural networks with high performance, low inference latency, and sparse spike-coding schemes, which also self-corrects for device mismatch. We validate our approach on the BrainScaleS-2 analog spiking neuromorphic system, demonstrating state-of-the-art accuracy, low latency, and energy efficiency. Our work sketches a path for building powerful neuromorphic processors that take advantage of emerging analog technologies.

To rapidly process temporal information at a low metabolic cost, biological neurons integrate inputs as an analog sum, but communicate with spikes, binary events in time. Analog neuromorphic hardware uses the same principles to emulate spiking neural networks with exceptional energy efficiency. However, instantiating high-performing spiking networks on such hardware remains a significant challenge due to device mismatch and the lack of efficient training algorithms. Surrogate gradient learning has emerged as a promising training strategy for spiking networks, but its applicability for analog neuromorphic systems has not been demonstrated. Here, we demonstrate surrogate gradient learning on the BrainScaleS-2 analog neuromorphic system using an in-the-loop approach. We show that learning self-corrects for device mismatch, resulting in competitive spiking network performance on both vision and speech benchmarks. Our networks display sparse spiking activity with, on average, less than one spike per hidden neuron and input, perform inference at rates of up to 85,000 frames per second, and consume less than 200 mW. In summary, our work sets several benchmarks for low-energy spiking network processing on analog neuromorphic hardware and paves the way for future on-chip learning algorithms.

The thermodynamic theory of action potential propagation: a sound basis for unification of the physics of nerve impulses

The thermodynamic theory of action potential propagation challenges the conventional understanding of the nerve signal as an exclusively electrical phenomenon. Often misunderstood as to its basic tenets and predictions, the thermodynamic theory is virtually ignored in mainstream neuroscience. Addressing a broad audience of neuroscientists, we here attempt to stimulate interest in the theory. We do this by providing a concise overview of its background, discussion of its intimate connection to Albert Einstein's treatment of the thermodynamics of interfaces and outlining its potential contribution to the building of a physical brain theory firmly grounded in first principles and the biophysical reality of individual nerve cells. As such, the paper does not attempt to advocate the superiority of the thermodynamic theory over any other approach to model the nerve impulse, but is meant as an open invitation to the neuroscience community to experimentally test the assumptions and predictions of the theory on their validity.

Stochastic Spiking Behavior in Neuromorphic Networks Enables True Random Number Generation

There is currently a great deal of interest in the use of nanoscale devices to emulate the behaviors of neurons and synapses and to facilitate brain-inspired computation. Here, it is shown that percolating networks of nanoparticles exhibit stochastic spiking behavior that is strikingly similar to that observed in biological neurons. The spiking rate can be controlled by the input stimulus, similar to "rate coding" in biology, and the distributions of times between events are log-normal, providing insights into the atomic-scale spiking mechanism. The stochasticity of the spiking behavior is then used for true random number generation, and the high quality of the generated random bit-streams is demonstrated, opening up promising routes toward integration of neuromorphic computing with secure information processing.

A Functional Spiking Neural Network of Ultra Compact Neurons

We demonstrate that recently introduced ultra-compact neurons (UCN) with a minimal number of components can be interconnected to implement a functional spiking neural network. For concreteness we focus on the Jeffress model, which is a classic neuro-computational model proposed in the 40’s to explain the sound directionality detection by animals and humans. In addition, we introduce a long-axon neuron, whose architecture is inspired by the Hodgkin-Huxley axon delay-line and where the UCNs implement the nodes of Ranvier. We then interconnect two of those neurons to an output layer of UCNs, which detect coincidences between spikes propagating down the long-axons. This functional spiking neural neuron circuit with biological relevance is built from identical UCN blocks, which are simple enough to be made with off-the-shelf electronic components. Our work realizes a new, accessible and affordable physical model platform, where neuroscientists can construct arbitrary mid-size spiking neuronal networks in a lego-block like fashion that work in continuous time. This should enable them to address in a novel experimental manner fundamental questions about the nature of the neural code and to test predictions from mathematical models and algorithms of basic neurobiology research. The present work aims at opening a new experimental field of basic research in Spiking Neural Networks to a potentially large community, which is at the crossroads of neurobiology, dynamical systems, theoretical neuroscience, condensed matter physics, neuromorphic engineering, artificial intelligence, and complex systems.

A 2D material-based floating gate device with linear synaptic weight update

Neuromorphic computing is of great interest among researchers interested in overcoming the von Neumann computing bottleneck. A synaptic device, one of the key components to realize a neuromorphic system, has a weight that indicates the strength of the connection between two neurons, and updating this weight must have linear and symmetric characteristics. Especially, a transistor-type device has a gate terminal, separating the processes of reading and updating the conductivity, used as a synaptic weight to prevent sneak path current issues during synaptic operations. In this study, we fabricate a top-gated flash memory device based on two-dimensional (2D) materials, MoS2 and graphene, as a channel and a floating gate, respectively, and Al2O3 and HfO2 to increase the tunneling efficiency. We demonstrate the linear weight updates and repeatable characteristics of applying negative/positive pulses, and also emulate spike timing-dependent plasticity (STDP), one of the learning rules in a spiking neural network (SNN).

Neuromorphic Engineering: From Biological to Spike-Based Hardware Nervous Systems

The human brain is a sophisticated, high-performance biocomputer that processes multiple complex tasks in parallel with high efficiency and remarkably low power consumption. Scientists have long been pursuing an artificial intelligence (AI) that can rival the human brain. Spiking neural networks based on neuromorphic computing platforms simulate the architecture and information processing of the intelligent brain, providing new insights for building AIs. The rapid development of materials engineering, device physics, chip integration, and neuroscience has led to exciting progress in neuromorphic computing with the goal of overcoming the von Neumann bottleneck. Herein, fundamental knowledge related to the structures and working principles of neurons and synapses of the biological nervous system is reviewed. An overview is then provided on the development of neuromorphic hardware systems, from artificial synapses and neurons to spike-based neuromorphic computing platforms. It is hoped that this review will shed new light on the evolution of brain-like computing.

Plasticity and Adaptation in Neuromorphic Biohybrid Systems

Neuromorphic systems take inspiration from the principles of biological information processing to form hardware platforms that enable the large-scale implementation of neural networks. The recent years have seen both advances in the theoretical aspects of spiking neural networks for their use in classification and control tasks and a progress in electrophysiological methods that is pushing the frontiers of intelligent neural interfacing and signal processing technologies. At the forefront of these new technologies, artificial and biological neural networks are tightly coupled, offering a novel "biohybrid" experimental framework for engineers and neurophysiologists. Indeed, biohybrid systems can constitute a new class of neuroprostheses opening important perspectives in the treatment of neurological disorders. Moreover, the use of biologically plausible learning rules allows forming an overall fault-tolerant system of co-developing subsystems. To identify opportunities and challenges in neuromorphic biohybrid systems, we discuss the field from the perspectives of neurobiology, computational neuroscience, and neuromorphic engineering.

Implementation of an electrically modifiable artificial synapse based on ferroelectric field-effect transistors using Al-doped HfO2 thin films

Human brain-like synaptic behaviors of the ferroelectric field-effect transistors (FeFETs) were emulated by introducing the metal-ferroelectric-metal-insulator-semiconductor (MFMIS) gate stacks employing Al-doped HfO2 (Al:HfO2) ferroelectric thin films even at a low operation voltage. The synaptic plasticity of the MFMIS-FETs could be gradually modulated by the partial polarization characteristics of the Al:HfO2 thin films, which were examined to be dependent on the applied pulse conditions. Based on the ferroelectric polarization switching dynamics of the Al:HfO2 thin films, the proposed devices successfully emulate biological synaptic functions, including excitatory post-synaptic current (EPSC), paired-pulse facilitation (PPF), and spike timing-dependent plasticity (STDP). The channel conductance of the FeFETs could be controlled by partially switching the ferroelectric polarization of the Al:HfO2 gate insulators by means of pulse-number and pulse-amplitude modulations. Furthermore, the 3 × 3 array integrated with the Al:HfO2 MFMIS-FETs was also fabricated, in which electrically modifiable weighted-sum operation could be well verified in the 3 × 3 synapse array configuration.

Biologically Relevant Dynamical Behaviors Realized in an Ultra-Compact Neuron Model

We demonstrate a variety of biologically relevant dynamical behaviors building on a recently introduced ultra-compact neuron (UCN) model. We provide the detailed circuits which all share a common basic block that realizes the leaky-integrate-and-fire (LIF) spiking behavior. All circuits have a small number of active components and the basic block has only three, two transistors and a silicon controlled rectifier (SCR). We also demonstrate that numerical simulations can faithfully represent the variety of spiking behavior and can be used for further exploration of dynamical behaviors. Taking Izhikevich’s set of biologically relevant behaviors as a reference, our work demonstrates that a circuit of a LIF neuron model can be used as a basis to implement a large variety of relevant spiking patterns. These behaviors may be useful to construct neural networks that can capture complex brain dynamics or may also be useful for artificial intelligence applications. Our UCN model can therefore be considered the electronic circuit counterpart of Izhikevich’s (2003) mathematical neuron model, sharing its two seemingly contradicting features, extreme simplicity and rich dynamical behavior.

Long-range temporal correlations in scale-free neuromorphic networks

Biological neuronal networks are the computing engines of the mammalian brain. These networks exhibit structural characteristics such as hierarchical architectures, small-world attributes, and scale-free topologies, providing the basis for the emergence of rich temporal characteristics such as scale-free dynamics and long-range temporal correlations. Devices that have both the topological and the temporal features of a neuronal network would be a significant step toward constructing a neuromorphic system that can emulate the computational ability and energy efficiency of the human brain. Here we use numerical simulations to show that percolating networks of nanoparticles exhibit structural properties that are reminiscent of biological neuronal networks, and then show experimentally that stimulation of percolating networks by an external voltage stimulus produces temporal dynamics that are self-similar, follow power-law scaling, and exhibit long-range temporal correlations. These results are expected to have important implications for the development of neuromorphic devices, especially for those based on the concept of reservoir computing.

Biological neuronal networks exhibit well-defined properties such as hierarchical structures and scale-free topologies, as well as a high degree of local clustering and short path lengths between nodes. These structural properties are intimately connected to the observed long-range temporal correlations in the network dynamics. Fabrication of artificial networks with similar structural properties would facilitate brain-like (“neuromorphic”) computing. Here we show experimentally that percolating networks of nanoparticles exhibit similar long-range temporal correlations to those of biological neuronal networks and use simulations to demonstrate that the dynamics arise from an underlying scale-free network architecture. We discuss similarities between the biological and percolating systems and highlight the potential for the percolating networks to be used in neuromorphic computing applications.

A Parasitic Resistance-Adapted Programming Scheme for Memristor Crossbar-Based Neuromorphic Computing Systems

Memristor crossbar arrays without selector devices, such as complementary-metal oxide semiconductor (CMOS) devices, are a potential for realizing neuromorphic computing systems. However, wire resistance of metal wires is one of the factors that degrade the performance of memristor crossbar circuits. In this work, we propose a wire resistance modeling method and a parasitic resistance-adapted programming scheme to reduce the impact of wire resistance in a memristor crossbar-based neuromorphic computing system. The equivalent wire resistances for the cells are estimated by analyzing the crossbar circuit using the superposition theorem. For the conventional programming scheme, the connection matrix composed of the target memristance values is used for crossbar array programming. In the proposed parasitic resistance-adapted programming scheme, the connection matrix is updated before it is used for crossbar array programming to compensate the equivalent wire resistance. The updated connection matrix is obtained by subtracting the equivalent connection matrix from the original connection matrix. The circuit simulations are performed to test the proposed wire resistance modeling method and the parasitic resistance-adapted programming scheme. The simulation results showed that the discrepancy of the output voltages of the crossbar between the conventional wire resistance modeling method and the proposed wire resistance modeling method is as low as 2.9% when wire resistance varied from 0.5 to 3.0 Ω. The recognition rate of the memristor crossbar with the conventional programming scheme is 99%, 95%, 81%, and 65% when wire resistance is set to be 1.5, 2.0, 2.5, and 3.0 Ω, respectively. By contrast, the memristor crossbar with the proposed parasitic resistance-adapted programming scheme can maintain the recognition as high as 100% when wire resistance is as high as 3.0 Ω.

Optimal solid state neurons

Bioelectronic medicine is driving the need for neuromorphic microcircuits that integrate raw nervous stimuli and respond identically to biological neurons. However, designing such circuits remains a challenge. Here we estimate the parameters of highly nonlinear conductance models and derive the ab initio equations of intracellular currents and membrane voltages embodied in analog solid-state electronics. By configuring individual ion channels of solid-state neurons with parameters estimated from large-scale assimilation of electrophysiological recordings, we successfully transfer the complete dynamics of hippocampal and respiratory neurons in silico. The solid-state neurons are found to respond nearly identically to biological neurons under stimulation by a wide range of current injection protocols. The optimization of nonlinear models demonstrates a powerful method for programming analog electronic circuits. This approach offers a route for repairing diseased biocircuits and emulating their function with biomedical implants that can adapt to biofeedback.

Solving visual pollution with deep learning: A new nexus in environmental management

Visual pollution is a relatively new concern amidst the existing plethora of mainstream environmental pollution, recommending the necessity for research to conceptualize, formalize, quantify and assess it from different dimensions. The purpose of this study is to create a new field of automated visual pollutant classification, harnessing the technological prowess of the 21^st century for applications in environmental management. From the wide range of visual pollutants, four categories have been considered viz. (i) billboards and signage, (ii) telephone and communication wires, (iii) network and communication towers and (iv) street litter. The deep learning model used in this study simulates the human learning experience in the context of image recognition for visual pollutant classification by training and testing a convolutional neural network with several layers of artificial neurons. Data augmentation using image processing techniques and a train-test split ratio of 80:20 have been used. Training accuracy of 95% and validation accuracy of 85% have been achieved by the deep learning model. The results indicate that the upper limit of accuracy i.e. the asymptote, depends on the dataset size for this type of task. This study has several applications in environmental management. For example, the deployment of the trained model for processing of video/live footage from smartphone applications, closed-circuit television and drones/unmanned aerial vehicles can be applied for both the removal and management of visual pollutants in the natural and built environment. Furthermore, generating the 'visual pollution score/index' of urban regions such as towns and cities will create a new 'metric/indicator' in the field of urban environmental management.

Oxide Neuromorphic Transistors Gated by Polyvinyl Alcohol Solid Electrolytes with Ultralow Power Consumption

Neuromorphic devices and systems with ultralow power consumption are important in building artificial intelligent systems. Here, indium tin oxide (ITO)-based oxide neuromorphic transistors are fabricated using poly(vinyl alcohol) (PVA)-based proton-conducting electrolytes as gate dielectrics. The electrical performances of the transistors can be modulated with the ITO channel thickness. Fundamental synaptic functions, including excitatory postsynaptic current, paired-pulse facilitation, and multistore memory, are successfully emulated. Most importantly, the PVA-gated neuromorphic devices demonstrate ultralow energy consumption of ∼1.16 fJ with ultrahigh sensitivity of ∼5.4 dB, as is very important for neuromorphic engineering applications. Because of the inherent environmental-friendly characteristics of PVA, the devices possess security biocompatibility. Thus, the proposed PVA-gated oxide neuromorphic transistors may find potential applications in "green" ultrasensitive neuromorphic systems and efficient electronic biological interfaces.

Neuromorphic Functions of Light in Parity-Time-Symmetric Systems

As an elementary processor of neural networks, a neuron performs exotic dynamic functions, such as bifurcation, repetitive firing, and oscillation quenching. To achieve ultrafast neuromorphic signal processing, the realization of photonic equivalents to neuronal dynamic functions has attracted considerable attention. However, despite the nonconservative nature of neurons due to energy exchange between intra- and extra-cellular regions through ion channels, the critical role of non-Hermitian physics in the photonic analogy of a neuron has been neglected. Here, a neuromorphic non-Hermitian photonic system ruled by parity-time symmetry is presented. For a photonic platform that induces the competition between saturable gain and loss channels, dynamical phases are classified with respect to parity-time symmetry and stability. In each phase, unique oscillation quenching functions and nonreciprocal oscillations of light fields are revealed as photonic equivalents of neuronal dynamic functions. The proposed photonic system for neuronal functionalities will become a fundamental building block for light-based neural signal processing.

Self-Doping Memristors with Equivalently Synaptic Ion Dynamics for Neuromorphic Computing

The accumulation and extrusion of Ca²⁺ ions in the pre- and post-synaptic terminals play crucial roles in initiating short- and long-term plasticity (STP and LTP) in biological synapses, respectively. Mimicking these synaptic behaviors by electronic devices represents a vital step toward realization of neuromorphic computing. However, the majority of reported synaptic devices usually focus on the emulation of qualitatively synaptic behaviors; devices that can truly emulate the physical behavior of the synaptic Ca²⁺ ion dynamics in STP and LTP are rarely reported. In this work, Ag/Ag:Ta₂O₅/Pt self-doping memristors were developed to equivalently emulate the Ca²⁺ ion dynamics of biological synapses. With conductive filaments from double sources, these memristors produced unique double-switching behavior under voltage sweeps and demonstrated several essential synaptic behaviors under pulse stimuli, including STP, LTP, STP to LTP transition, and spike-rate-dependent plasticity. Experimental results and nanoparticle dynamic simulations both showed that Ag atoms from double sources could mimic Ca²⁺ dynamics in the pre- and post-synaptic terminals under stimuli. A perceptron network with an STP to LTP transition layer based on the self-doping memristors was also introduced and evaluated; simulations showed that this network could solve noisy figure recognition tasks efficiently. All of these results indicate that the self-doping memristors are promising components for future hardware creation of neuromorphic systems and emulate the characteristics of the brain.

Optimized Real-Time Biomimetic Neural Network on FPGA for Bio-hybridization

Neurological diseases can be studied by performing bio-hybrid experiments using a real-time biomimetic Spiking Neural Network (SNN) platform. The Hodgkin-Huxley model offers a set of equations including biophysical parameters which can serve as a base to represent different classes of neurons and affected cells. Also, connecting the artificial neurons to the biological cells would allow us to understand the effect of the SNN stimulation using different parameters on nerve cells. Thus, designing a real-time SNN could useful for the study of simulations of some part of the brain. Here, we present a different approach to optimize the Hodgkin-Huxley equations adapted for Field Programmable Gate Array (FPGA) implementation. The equations of the conductance have been unified to allow the use of same functions with different parameters for all ionic channels. The low resources and high-speed implementation also include features, such as synaptic noise using the Ornstein-Uhlenbeck process and different synapse receptors including AMPA, GABAa, GABAb, and NMDA receptors. The platform allows real-time modification of the neuron parameters and can output different cortical neuron families like Fast Spiking (FS), Regular Spiking (RS), Intrinsically Bursting (IB), and Low Threshold Spiking (LTS) neurons using a Digital to Analog Converter (DAC). Gaussian distribution of the synaptic noise highlights similarities with the biological noise. Also, cross-correlation between the implementation and the model shows strong correlations, and bifurcation analysis reproduces similar behavior compared to the original Hodgkin-Huxley model. The implementation of one core of calculation uses 3% of resources of the FPGA and computes in real-time 500 neurons with 25,000 synapses and synaptic noise which can be scaled up to 15,000 using all resources. This is the first step toward neuromorphic system which can be used for the simulation of bio-hybridization and for the study of neurological disorders or the advanced research on neuroprosthesis to regain lost function.

Fiber echo state network analogue for high-bandwidth dual-quadrature signal processing

All-optical platforms for recurrent neural networks can offer higher computational speed and energy efficiency. To produce a major advance in comparison with currently available digital signal processing methods, the new system would need to have high bandwidth and operate both signal quadratures (power and phase). Here we propose a fiber echo state network analogue (FESNA) - the first optical technology that provides both high (beyond previous limits) bandwidth and dual-quadrature signal processing. We demonstrate applicability of the designed system for prediction tasks and for the mitigation of distortions in optical communication systems with multilevel dual-quadrature encoded signals.

Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain

Neuromorphic engineering (NE) encompasses a diverse range of approaches to information processing that are inspired by neurobiological systems, and this feature distinguishes neuromorphic systems from conventional computing systems. The brain has evolved over billions of years to solve difficult engineering problems by using efficient, parallel, low-power computation. The goal of NE is to design systems capable of brain-like computation. Numerous large-scale neuromorphic projects have emerged recently. This interdisciplinary field was listed among the top 10 technology breakthroughs of 2014 by the MIT Technology Review and among the top 10 emerging technologies of 2015 by the World Economic Forum. NE has two-way goals: one, a scientific goal to understand the computational properties of biological neural systems by using models implemented in integrated circuits (ICs); second, an engineering goal to exploit the known properties of biological systems to design and implement efficient devices for engineering applications. Building hardware neural emulators can be extremely useful for simulating large-scale neural models to explain how intelligent behavior arises in the brain. The principal advantages of neuromorphic emulators are that they are highly energy efficient, parallel and distributed, and require a small silicon area. Thus, compared to conventional CPUs, these neuromorphic emulators are beneficial in many engineering applications such as for the porting of deep learning algorithms for various recognitions tasks. In this review article, we describe some of the most significant neuromorphic spiking emulators, compare the different architectures and approaches used by them, illustrate their advantages and drawbacks, and highlight the capabilities that each can deliver to neural modelers. This article focuses on the discussion of large-scale emulators and is a continuation of a previous review of various neural and synapse circuits (Indiveri et al., 2011). We also explore applications where these emulators have been used and discuss some of their promising future applications.

Illumination Time Dependent Learning in Dye Sensitized Solar Cells

Learning through vision is an essential skill for intelligent machines. In an attempt to implement this highly complex feature at low energy cost, a dye-sensitized solar cell is proposed that learns using illumination time as a cue. Particularly, the device alters its photocurrent and memorizes this change in dependence of light exposure duration. This behavior parallels synaptic learning that also requires continuous or repeated electrical stimuli as triggers. Therefore, such optically learning solar cells may serve as promising building blocks in optoelectronic neural networks, potentially enabling visually learning electronics operating at negligible energy consumption and minimal hardware complexity.

A Mixed-Signal Structured AdEx Neuron for Accelerated Neuromorphic Cores

Here, we describe a multicompartment neuron circuit based on the adaptive-exponential I&F (AdEx) model, developed for the second-generation BrainScaleS hardware. Based on an existing modular leaky integrate-and-fire (LIF) architecture designed in 65-nm CMOS, the circuit features exponential spike generation, neuronal adaptation, intercompartmental connections as well as a conductance-based reset. The design reproduces a diverse set of firing patterns observed in cortical pyramidal neurons. Further, it enables the emulation of sodium and calcium spikes, as well as N-methyl-D-aspartate plateau potentials known from apical and thin dendrites. We characterize the AdEx circuit extensions and exemplify how the interplay between passive and nonlinear active signal processing enhances the computational capabilities of single (but structured) on-chip neurons.

Spikeling: A low-cost hardware implementation of a spiking neuron for neuroscience teaching and outreach

Understanding how neurons encode and compute information is fundamental to our study of the brain, but opportunities for hands-on experience with neurophysiological techniques on live neurons are scarce in science education. Here, we present Spikeling, an open source in silico implementation of a spiking neuron that costs £25 and mimics a wide range of neuronal behaviours for classroom education and public neuroscience outreach. Spikeling is based on an Arduino microcontroller running the computationally efficient Izhikevich model of a spiking neuron. The microcontroller is connected to input ports that simulate synaptic excitation or inhibition, to dials controlling current injection and noise levels, to a photodiode that makes Spikeling light sensitive, and to a light-emitting diode (LED) and speaker that allows spikes to be seen and heard. Output ports provide access to variables such as membrane potential for recording in experiments or digital signals that can be used to excite other connected Spikelings. These features allow for the intuitive exploration of the function of neurons and networks mimicking electrophysiological experiments. We also report our experience of using Spikeling as a teaching tool for undergraduate and graduate neuroscience education in Nigeria and the United Kingdom.

Artificial Synaptic Emulators Based on MoS2 Flash Memory Devices with Double Floating Gates

We fabricated MoS₂-based flash memory devices by stacking MoS₂ and hexagonal boron nitride (hBN) layers on an hBN/Au substrate and demonstrated that these devices can emulate various biological synaptic functions, including potentiation and depression processes, spike-rate-dependent plasticity, and spike-timing dependent plasticity. In particular, compared to a flash memory device prepared on an hBN substrate, the device fabricated on the hBN/Au exhibited considerably more symmetric and linear bidirectional gradual conductance change curves, which may be attributed to the device structure incorporating double floating gate. For the device on the hBN/Au, electron transfers may occur between the floating gate MoS₂ and Au, as well as between the floating gate MoS₂ and the channel MoS₂, allowing for more control over electron tunneling and injection. To test our hypothesis, we also fabricated a MoS₂-based flash memory device on an hBN/Pd substrate and found behavior similar to the device fabricated on hBN/Au. Our results demonstrate that flexible synaptic electronics may be implemented using MoS₂-based flash memory devices with double floating gates.

Breaking Liebig's Law: An Advanced Multipurpose Neuromorphic Engine

We present a massively-parallel scalable multi-purpose neuromorphic engine. All existing neuromorphic hardware systems suffer from Liebig’s law (that the performance of the system is limited by the component in shortest supply) as they have fixed numbers of dedicated neurons and synapses for specific types of plasticity. For any application, it is always the availability of one of these components that limits the size of the model, leaving the others unused. To overcome this problem, our engine adopts a unique novel architecture: an array of identical components, each of which can be configured as a leaky-integrate-and-fire (LIF) neuron, a learning-synapse, or an axon with trainable delay. Spike timing dependent plasticity (STDP) and spike timing dependent delay plasticity (STDDP) are the two supported learning rules. All the parameters are stored in the SRAMs such that runtime reconfiguration is supported. As a proof of concept, we have implemented a prototype system with 16 neural engines, each of which consists of 32768 (32k) components, yielding half a million components, on an entry level FPGA (Altera Cyclone V). We verified the prototype system with measurement results. To demonstrate that our neuromorphic engine is a high performance and scalable digital design, we implemented it using TSMC 28nm HPC technology. Place and route results using Cadence Innovus with a clock frequency of 2.5 GHz show that this engine achieves an excellent area efficiency of 1.68 μm² per component: 256k (2¹⁸) components in a silicon area of 650 μm × 680 μm (∼0.44 mm², the utilization of the silicon area is 98.7%). The power consumption of this engine is 37 mW, yielding a power efficiency of 0.92 pJ per synaptic operation (SOP).

Capacitive neural network with neuro-transistors

Experimental demonstration of resistive neural networks has been the recent focus of hardware implementation of neuromorphic computing. Capacitive neural networks, which call for novel building blocks, provide an alternative physical embodiment of neural networks featuring a lower static power and a better emulation of neural functionalities. Here, we develop neuro-transistors by integrating dynamic pseudo-memcapacitors as the gates of transistors to produce electronic analogs of the soma and axon of a neuron, with “leaky integrate-and-fire” dynamics augmented by a signal gain on the output. Paired with non-volatile pseudo-memcapacitive synapses, a Hebbian-like learning mechanism is implemented in a capacitive switching network, leading to the observed associative learning. A prototypical fully integrated capacitive neural network is built and used to classify inputs of signals.

Though memristors can potentially emulate neuron and synapse functionality, useful signal energy is lost to Joule heating. Here, the authors demonstrate neuro-transistors with a pseudo-memcapacitive gate that actively process signals via energy-efficient capacitively-coupled neural networks.

Hodgkin-Huxley Neuron and FPAA Dynamics

We present the experimental silicon results on the dynamics of a Hodgkin-Huxley neuron implemented on a reconfigurable platform. The circuit has been inspired by the similarity between biology and silicon, by modeling ion channels and their time constants. Another significant motivation behind this paper is to make the system available to circuit designers as well as users in the neuroscience community. The open-source tool infrastructure and a remote system ease the accessibility of our system to a number of users. We demonstrate the reproducibility of the results by replicating the dynamics across different boards along with responses from different inputs and with different parameters. The reconfigurability enables one to make use of a single primary design to obtain a variety of results. The measurements are taken from the system compiled on a field programmable analog array fabricated on a 350-nm process.

Dual Mechanism for the Emergence of Synchronization in Inhibitory Neural Networks

During cognitive tasks cortical microcircuits synchronize to bind stimuli into unified perception. The emergence of coherent rhythmic activity is thought to be inhibition-driven and stimulation-dependent. However, the exact mechanisms of synchronization remain unknown. Recent optogenetic experiments have identified two neuron sub-types as the likely inhibitory vectors of synchronization. Here, we show that local networks mimicking the soma-targeting properties observed in fast-spiking interneurons and the dendrite-projecting properties observed in somatostatin interneurons synchronize through different mechanisms which may provide adaptive advantages by combining flexibility and robustness. We probed the synchronization phase diagrams of small all-to-all inhibitory networks in-silico as a function of inhibition delay, neurotransmitter kinetics, timings and intensity of stimulation. Inhibition delay is found to induce coherent oscillations over a broader range of experimental conditions than high-frequency entrainment. Inhibition delay boosts network capacity (ln2)^−N-fold by stabilizing locally coherent oscillations. This work may inform novel therapeutic strategies for moderating pathological cortical oscillations.

Optoelectronic system for brain neuronal network stimulation

We propose an optoelectronic system for stimulation of living neurons. The system consists of an electronic circuit based on the FitzHugh–Nagumo model, an optical fiber, and a photoelectrical converter. We used this system for electrical stimulation of hippocampal living neurons in acute hippocampal brain slices (350-μm thick) obtained from a 20–28 days old C57BL/6 mouse or a Wistar rat. The main advantage of our system over other similar stimulators is that it contains an optical fiber for signal transmission instead of metallic wires. The fiber is placed between the electronic circuit and stimulated neurons and provides galvanic isolation from external electrical and magnetic fields. The use of the optical fiber allows avoiding electromagnetic noise and current flows which could affect metallic wires. Furthermore, it gives us the possibility to simulate “synaptic plasticity” by adaptive signal transfer through optical fiber. The proposed optoelectronic system (hybrid neural circuit) provides a very high efficiency in stimulating hippocampus neurons and can be used for restoring brain activity in particular regions or replacing brain parts (neuroprosthetics) damaged due to a trauma or neurodegenerative diseases.

Inhibition delay increases neural network capacity through Stirling transform

Inhibitory neural networks are found to encode high volumes of information through delayed inhibition. We show that inhibition delay increases storage capacity through a Stirling transform of the minimum capacity which stabilizes locally coherent oscillations. We obtain both the exact and asymptotic formulas for the total number of dynamic attractors. Our results predict a (ln2)^{-N}-fold increase in capacity for an N-neuron network and demonstrate high-density associative memories which host a maximum number of oscillations in analog neural devices.

Mimicking Synaptic Plasticity and Neural Network Using Memtranstors

Artificial synaptic devices that mimic the functions of biological synapses have drawn enormous interest because of their potential in developing brain-inspired computing. Current studies are focusing on memristive devices in which the change of the conductance state is used to emulate synaptic behaviors. Here, a new type of artificial synaptic devices based on the memtranstor is demonstrated, which is a fundamental circuit memelement in addition to the memristor, memcapacitor, and meminductor. The state of transtance (presented by the magnetoelectric voltage) in memtranstors acting as the synaptic weight can be tuned continuously with a large number of nonvolatile levels by engineering the applied voltage pulses. Synaptic behaviors including the long-term potentiation, long-term depression, and spiking-time-dependent plasticity are implemented in memtranstors made of Ni/0.7Pb(Mg_1/3 Nb_2/3 )O₃ -0.3PbTiO₃ /Ni multiferroic heterostructures. Simulations reveal the capability of pattern learning in a memtranstor network. The work elucidates the promise of memtranstors as artificial synaptic devices with low energy consumption.