Phase-change memtransistive synapses for mixed-plasticity neural computations

Single neuromorphic memristor closely emulates multiple synaptic mechanisms for energy efficient neural networks

Biological neural networks do not only include long-term memory and weight multiplication capabilities, as commonly assumed in artificial neural networks, but also more complex functions such as short-term memory, short-term plasticity, and meta-plasticity - all collocated within each synapse. Here, we demonstrate memristive nano-devices based on SrTiO3 that inherently emulate all these synaptic functions. These memristors operate in a non-filamentary, low conductance regime, which enables stable and energy efficient operation. They can act as multi-functional hardware synapses in a class of bio-inspired deep neural networks (DNN) that make use of both long- and short-term synaptic dynamics and are capable of meta-learning or learning-to-learn. The resulting bio-inspired DNN is then trained to play the video game Atari Pong, a complex reinforcement learning task in a dynamic environment. Our analysis shows that the energy consumption of the DNN with multi-functional memristive synapses decreases by about two orders of magnitude as compared to a pure GPU implementation. Based on this finding, we infer that memristive devices with a better emulation of the synaptic functionalities do not only broaden the applicability of neuromorphic computing, but could also improve the performance and energy costs of certain artificial intelligence applications.

An Organic Optoelectronic Synapse with Multilevel Memory Enabled by Gate Modulation

Artificial synaptic devices are emerging as contenders for next-generation computing systems due to their combined advantages of self-adaptive learning mechanisms, high parallel computation capabilities, adjustable memory level, and energy efficiency. Optoelectronic devices are particularly notable for their responsiveness to both voltage inputs and light exposure, making them attractive for dynamic modulation. However, engineering devices with reconfigurable synaptic plasticity and multilevel memory within a singular configuration present a fundamental challenge. Here, we have established an organic transistor-based synaptic device that exhibits both volatile and nonvolatile memory characteristics, modulated through gate voltage together with light stimuli. Our device demonstrates a range of synaptic behaviors, including both short/long-term plasticity (STP and LTP) as well as STP-LTP transitions. Further, as an encoding unit, it delivers exceptional read current levels, achieving a program/erase current ratio exceeding 105, with excellent repeatability. Additionally, a prototype 4 × 4 matrix demonstrates potential in practical neuromorphic systems, showing capabilities in the perception, processing, and memory retention of image inputs.

Efficient Spiking Neural Networks with Biologically Similar Lithium-Ion Memristor Neurons

Benefiting from the brain-inspired event-driven feature and asynchronous sparse coding approach, spiking neural networks (SNNs) are becoming a potentially energy-efficient replacement for conventional artificial neural networks. However, neuromorphic devices used to construct SNNs persistently result in considerable energy consumption owing to the absence of sufficient biological parallels. Drawing inspiration from the transport nature of Na+ and K+ in synapses, here, a Li-based memristor (LixAlOy) was proposed to emulate the biological synapse, leveraging the similarity of Li as a homologous main group element to Na and K. The Li-based memristor exhibits ∼8 ns ultrafast operating speed, 1.91 and 0.72 linearity conductance modulation, and reproducible switching behavior, enabled by lithium vacancies forming a conductive filament mechanism. Moreover, these memristors are capable of simulating fundamental behaviors of a biological synapse, including long-term potentiation and long-term depression behaviors. Most importantly, a threshold-tunable leaky integrate-and-fire (TT-LIF) neuron is built using LixAlOy memristors, successfully integrating synaptic signals from both temporal and spatial levels and achieving an optimal threshold of SNNs. A computationally efficient TT-LIF-based SNN algorithm is also implemented for image recognition schemes, featuring a high recognition rate of 90.1% and an ultralow firing rate of 0.335%, which is 4 times lower than those of other memristor-based SNNs. Our studies reveal the ion dynamics mechanism of the LixAlOy memristor and confirm its potential in rapid switching and the construction of SNNs.

Ultrasoft and High-Adhesion Block Copolymers for Neuromorphic Computing

The "von Neumann bottleneck" is a formidable challenge in conventional computing, driving exploration into artificial synapses. Organic semiconductor materials show promise but are hindered by issues such as poor adhesion and a high elastic modulus. Here, we combine polyisoindigo-bithiophene (PIID-2T) with grafted poly(dimethylsiloxane) (PDMS) to synthesize the triblock-conjugated polymer (PIID-2T-PDMS). The polymer exhibited substantial enhancements in adhesion (4.8-68.8 nN) and reductions in elastic modulus (1.6-0.58 GPa) while maintaining the electrical characteristics of PIID-2T. The three-terminal organic synaptic transistor (three-terminal p-type organic artificial synapse (TPOAS)), constructed using PIID-2T-PDMS, exhibits an unprecedented analog switching range of 276×, surpassing previous records, and a remarkable memory on-off ratio of 106. Moreover, the device displays outstanding operational stability, retaining 99.6% of its original current after 1600 write-read events in the air. Notably, TPOAS replicates key biological synaptic behaviors, including paired-pulse facilitation (PPF), short-term plasticity (STP), and long-term plasticity (LTP). Simulations using handwritten digital data sets reveal an impressive recognition accuracy of 91.7%. This study presents a polyisoindigo-bithiophene-based block copolymer that offers enhanced adhesion, reduced elastic modulus, and high-performance artificial synapses, paving the way for the next generation of neuromorphic computing systems.

SHIP: a computational framework for simulating and validating novel technologies in hardware spiking neural networks

Investigations in the field of spiking neural networks (SNNs) encompass diverse, yet overlapping, scientific disciplines. Examples range from purely neuroscientific investigations, researches on computational aspects of neuroscience, or applicative-oriented studies aiming to improve SNNs performance or to develop artificial hardware counterparts. However, the simulation of SNNs is a complex task that can not be adequately addressed with a single platform applicable to all scenarios. The optimization of a simulation environment to meet specific metrics often entails compromises in other aspects. This computational challenge has led to an apparent dichotomy of approaches, with model-driven algorithms dedicated to the detailed simulation of biological networks, and data-driven algorithms designed for efficient processing of large input datasets. Nevertheless, material scientists, device physicists, and neuromorphic engineers who develop new technologies for spiking neuromorphic hardware solutions would find benefit in a simulation environment that borrows aspects from both approaches, thus facilitating modeling, analysis, and training of prospective SNN systems. This manuscript explores the numerical challenges deriving from the simulation of spiking neural networks, and introduces SHIP, Spiking (neural network) Hardware In PyTorch, a numerical tool that supports the investigation and/or validation of materials, devices, small circuit blocks within SNN architectures. SHIP facilitates the algorithmic definition of the models for the components of a network, the monitoring of states and output of the modeled systems, and the training of the synaptic weights of the network, by way of user-defined unsupervised learning rules or supervised training techniques derived from conventional machine learning. SHIP offers a valuable tool for researchers and developers in the field of hardware-based spiking neural networks, enabling efficient simulation and validation of novel technologies.

Wide-Range Synaptic Current Responses with a Liquid Ga Electrode via a Surface Redox Reaction in a NaOH Solution at Different Molar Concentrations

A liquid Ga-based synaptic device with two-terminal electrodes is demonstrated in NaOH solutions at 50 °C. The proposed electrochemical redox device using the liquid Ga electrode in the NaOH solution can emulate various biological synapses that require different decay constants. The device exhibits a wide range of current decay times from 60 to 320 ms at different NaOH mole concentrations from 0.2 to 1.6 M. This research marks a step forward in the development of flexible and biocompatible neuromorphic devices that can be utilized for a range of applications where different synaptic strengths are required lasting from a few milliseconds to seconds.

Memcapacitor Crossbar Array with Charge Trap NAND Flash Structure for Neuromorphic Computing

The progress of artificial intelligence and the development of large-scale neural networks have significantly increased computational costs and energy consumption. To address these challenges, researchers are exploring low-power neural network implementation approaches and neuromorphic computing systems are being highlighted as potential candidates. Specifically, the development of high-density and reliable synaptic devices, which are the key elements of neuromorphic systems, is of particular interest. In this study, an 8 × 16 memcapacitor crossbar array that combines the technological maturity of flash cells with the advantages of NAND flash array structure is presented. The analog properties of the array with high reliability are experimentally demonstrated, and vector-matrix multiplication with extremely low error is successfully performed. Additionally, with the capability of weight fine-tuning characteristics, a spiking neural network for CIFAR-10 classification via off-chip learning at the wafer level is implemented. These experimental results demonstrate a high level of accuracy of 92.11%, with less than a 1.13% difference compared to software-based neural networks (93.24%).

Emerging Iontronic Neural Devices for Neuromorphic Sensory Computing

Living organisms have a very mysterious and powerful sensory computing system based on ion activity. Interestingly, studies on iontronic devices in the past few years have proposed a promising platform for simulating the sensing and computing functions of living organisms, because: 1) iontronic devices can generate, store, and transmit a variety of signals by adjusting the concentration and spatiotemporal distribution of ions, which analogs to how the brain performs intelligent functions by alternating ion flux and polarization; 2) through ionic-electronic coupling, iontronic devices can bridge the biosystem with electronics and offer profound implications for soft electronics; 3) with the diversity of ions, iontronic devices can be designed to recognize specific ions or molecules by customizing the charge selectivity, and the ionic conductivity and capacitance can be adjusted to respond to external stimuli for a variety of sensing schemes, which can be more difficult for electron-based devices. This review provides a comprehensive overview of emerging neuromorphic sensory computing by iontronic devices, highlighting representative concepts of both low-level and high-level sensory computing and introducing important material and device breakthroughs. Moreover, iontronic devices as a means of neuromorphic sensing and computing are discussed regarding the pending challenges and future directions.

Microstructure characterization, phase transition, and device application of phase-change memory materials

Phase-change memory (PCM), recently developed as the storage-class memory in a computer system, is a new non-volatile memory technology. In addition, the applications of PCM in a non-von Neumann computing, such as neuromorphic computing and in-memory computing, are being investigated. Although PCM-based devices have been extensively studied, several concerns regarding the electrical, thermal, and structural dynamics of phase-change devices remain. In this article, aiming at PCM devices, a comprehensive review of PCM materials is provided, including the primary PCM device mechanics that underpin read and write operations, physics-based modeling initiatives and experimental characterization of the many features examined in nanoscale PCM devices. Finally, this review will propose a prognosis on a few unsolved challenges and highlight research areas of further investigation.

Organic Memristor-Based Flexible Neural Networks with Bio-Realistic Synaptic Plasticity for Complex Combinatorial Optimization

Hardware neural networks with mechanical flexibility are promising next-generation computing systems for smart wearable electronics. Several studies have been conducted on flexible neural networks for practical applications; however, developing systems with complete synaptic plasticity for combinatorial optimization remains challenging. In this study, the metal-ion injection density is explored as a diffusive parameter of the conductive filament in organic memristors. Additionally, a flexible artificial synapse with bio-realistic synaptic plasticity is developed using organic memristors that have systematically engineered metal-ion injections, for the first time. In the proposed artificial synapse, short-term plasticity (STP), long-term plasticity, and homeostatic plasticity are independently achieved and are analogous to their biological counterparts. The time windows of the STP and homeostatic plasticity are controlled by the ion-injection density and electric-signal conditions, respectively. Moreover, stable capabilities for complex combinatorial optimization in the developed synapse arrays are demonstrated under spike-dependent operations. This effective concept for realizing flexible neuromorphic systems for complex combinatorial optimization is an essential building block for achieving a new paradigm of wearable smart electronics associated with artificial intelligent systems.

Sonopiezoelectric Nanomedicine and Materdicine

Endogenous electric field is ubiquitous in a multitude of important living activities such as bone repair, cell signal transduction, and nerve regeneration, signifying that regulating the electric field in organisms is highly beneficial to maintain organism health. As an emerging and promising research direction, piezoelectric nanomedicine and materdicine precisely activated by ultrasound with synergetic advantages of deep tissue penetration, remote spatiotemporal selectivity, and mechanical-electrical energy interconversion, have been progressively utilized for disease treatment and tissue repair by participating in the modulation of endogenous electric field. This specific nanomedicine utilizing piezoelectric effect activated by ultrasound is typically regarded as "sonopiezoelectric nanomedicine". This comprehensive review summarizes and discusses the substantially employed sonopiezoelectric nanomaterials and nanotherapies to provide an insight into the internal mechanism of the corresponding biological behavior/effect of sonopiezoelectric biomaterials in versatile disease treatments. This review primarily focuses on the sonopiezoelectric biomaterials for biosensing, drug delivery, tumor therapy, tissue regeneration, antimicrobia, and further illuminates the underlying sonopiezoelectric mechanism. In addition, the challenges and developments/prospects of sonopiezoelectric nanomedicine are analyzed for promoting the further clinical translation. It is earnestly expected that this kind of nanomedicine/biomaterials-enabled sonopiezoelectric technology will provoke the comprehensive investigation and promote the clinical development of the next-generation multifunctional materdicine.

Short-term synaptic plasticity in emerging devices for neuromorphic computing

Neuromorphic computing is a promising computing paradigm toward building next-generation artificial intelligence machines, in which diverse types of synaptic plasticity play an active role in information processing. Compared to long-term plasticity (LTP) forming the foundation of learning and memory, short-term plasticity (STP) is essential for critical computational functions. So far, the practical applications of LTP have been widely investigated, whereas the implementation of STP in hardware is still elusive. Here, we review the development of STP by bridging the physics in emerging devices and biological behaviors. We explore the computational functions of various STP in biology and review their recent progress. Finally, we discuss the main challenges of introducing STP into synaptic devices and offer the potential approaches to utilize STP to enrich systems' capabilities. This review is expected to provide prospective ideas for implementing STP in emerging devices and may promote the construction of high-level neuromorphic machines.

Dynamic machine vision with retinomorphic photomemristor-reservoir computing

Dynamic machine vision requires recognizing the past and predicting the future of a moving object based on present vision. Current machine vision systems accomplish this by processing numerous image frames or using complex algorithms. Here, we report motion recognition and prediction in recurrent photomemristor networks. In our system, a retinomorphic photomemristor array, working as dynamic vision reservoir, embeds past motion frames as hidden states into the present frame through inherent dynamic memory. The informative present frame facilitates accurate recognition of past and prediction of future motions with machine learning algorithms. This in-sensor motion processing capability eliminates redundant data flows and promotes real-time perception of moving objects for dynamic machine vision.

Ligand-Triggered Self-Assembly of Flexible Carbon Dot Nanoribbons for Optoelectronic Memristor Devices and Neuromorphic Computing

Carbon dots (CDs) are widely utilized in sensing, energy storage, and catalysis due to their excellent optical, electrical and semiconducting properties. However, attempts to optimize their optoelectronic performance through high-order manipulation have met with little success to date. In this study, through efficient packing of individual CDs in two-dimensions, the synthesis of flexible CDs ribbons is demonstrated technically. Electron microscopies and molecular dynamics simulations, show the assembly of CDs into ribbons results from the tripartite balance of π-π attractions, hydrogen bonding, and halogen bonding forces provided by the superficial ligands. The obtained ribbons are flexible and show excellent stability against UV irradiation and heating. CDs ribbons offer outstanding performance as active layer material in transparent flexible memristors, with the developed devices providing excellent data storage, retention capabilities, and fast optoelectronic responses. A memristor device with a thickness of 8 µm shows good data retention capability even after 10⁴ cycles of bending. Furthermore, the device functions effectively as a neuromorphic computing system with integrated storage and computation capabilities, with the response speed of the device being less than 5.5 ns. These properties create an optoelectronic memristor with rapid Chinese character learning capability. This work lays the foundation for wearable artificial intelligence.

Technology Roadmap for Flexible Sensors

Humans rely increasingly on sensors to address grand challenges and to improve quality of life in the era of digitalization and big data. For ubiquitous sensing, flexible sensors are developed to overcome the limitations of conventional rigid counterparts. Despite rapid advancement in bench-side research over the last decade, the market adoption of flexible sensors remains limited. To ease and to expedite their deployment, here, we identify bottlenecks hindering the maturation of flexible sensors and propose promising solutions. We first analyze challenges in achieving satisfactory sensing performance for real-world applications and then summarize issues in compatible sensor-biology interfaces, followed by brief discussions on powering and connecting sensor networks. Issues en route to commercialization and for sustainable growth of the sector are also analyzed, highlighting environmental concerns and emphasizing nontechnical issues such as business, regulatory, and ethical considerations. Additionally, we look at future intelligent flexible sensors. In proposing a comprehensive roadmap, we hope to steer research efforts towards common goals and to guide coordinated development strategies from disparate communities. Through such collaborative efforts, scientific breakthroughs can be made sooner and capitalized for the betterment of humanity.

The Effect of Carbon Doping on the Crystal Structure and Electrical Properties of Sb2Te3

As a new generation of non-volatile memory, phase change random access memory (PCRAM) has the potential to fill the hierarchical gap between DRAM and NAND FLASH in computer storage. Sb₂Te₃, one of the candidate materials for high-speed PCRAM, has high crystallization speed and poor thermal stability. In this work, we investigated the effect of carbon doping on Sb₂Te₃. It was found that the FCC phase of C-doped Sb₂Te₃ appeared at 200 °C and began to transform into the HEX phase at 25 °C, which is different from the previous reports where no FCC phase was observed in C-Sb₂Te₃. Based on the experimental observation and first-principles density functional theory calculation, it is found that the formation energy of FCC-Sb₂Te₃ structure decreases gradually with the increase in C doping concentration. Moreover, doped C atoms tend to form C molecular clusters in sp² hybridization at the grain boundary of Sb₂Te₃, which is similar to the layered structure of graphite. And after doping C atoms, the thermal stability of Sb₂Te₃ is improved. We have fabricated the PCRAM device cell array of a C-Sb₂Te₃ alloy, which has an operating speed of 5 ns, a high thermal stability (10-year data retention temperature 138.1 °C), a low device power consumption (0.57 pJ), a continuously adjustable resistance value, and a very low resistance drift coefficient.

Chalcogenide optomemristors for multi-factor neuromorphic computation

Neuromorphic hardware that emulates biological computations is a key driver of progress in AI. For example, memristive technologies, including chalcogenide-based in-memory computing concepts, have been employed to dramatically accelerate and increase the efficiency of basic neural operations. However, powerful mechanisms such as reinforcement learning and dendritic computation require more advanced device operations involving multiple interacting signals. Here we show that nano-scaled films of chalcogenide semiconductors can perform such multi-factor in-memory computation where their tunable electronic and optical properties are jointly exploited. We demonstrate that ultrathin photoactive cavities of Ge-doped Selenide can emulate synapses with three-factor neo-Hebbian plasticity and dendrites with shunting inhibition. We apply these properties to solve a maze game through on-device reinforcement learning, as well as to provide a single-neuron solution to linearly inseparable XOR implementation.

Some types of machine learning rely on the interaction between multiple signals, which requires new devices for efficient implementation. Here, Sarwat et al demonstrate a memristor that is both optically and electronically active, enabling computational models such as three factor learning.