Memristor-based biomimetic compound eye for real-time collision detection

A Biomimetic Visual Detection Model: Event-Driven LGMDs Implemented With Fractional Spiking Neuron Circuits

OBJECTIVE

Lobula giant motion detectors (LGMDs) in locusts effectively predict collisions and trigger avoidance, with potential applications in autonomous driving and UAVs. Research on LGMD characteristics splits into two views: one focusing on the presynaptic visual pathway, the other on the postsynaptic LGMD neurons. Both perspectives have support, leading to two computational models, but they lack a biophysical description of the individual LGMD neuron behavior. This paper aims to mimic and explain LGMD behavior based on fractional spiking neurons (FSNs) and construct a biomimetic visual model for the LGMD compatible with these characteristics.

METHODS

We implement the visual model using an event camera to simulate photoreceptors and follow the ON/OFF visual pathway, incorporating lateral inhibition to mimic the LGMD system from the bottom up. Second, most computational models of motion perception use only the dendrites within the LGMD neurons as the ideal pathway for linear summation, ignoring dendritic effects inducing neuronal properties. Thus, we introduce FSN circuits by altering dendritic morphological parameters to simulate multi-scale spike frequency adaptation (SFA) observed in LGMDs. Additionally, we add one more circuit of dendritic trees into the FSNs to be compatible with the postsynaptic feed-forward inhibition (FFI) in LGMD neurons, providing a novel explanatory and predictive model.

RESULTS

We test that the event-driven biomimetic visual model can achieve collision detection and looming selection in different complex scenes, especially fast-moving objects.

Electronically Reconfigurable Memristive Neuron Capable of Operating in Both Excitation and Inhibition Modes

Threshold switching (TS) memristors are promising candidates for artificial neurons in neuromorphic systems. However, they often lack biological plausibility, typically functioning solely in an excitation mode. The absence of an inhibitory mode limits neurons' ability to synergistically process both excitatory and inhibitory synaptic signals. To address this limitation, we propose a novel memristive neuron capable of operating in both excitation and inhibition modes. The memristor's threshold voltage can be reversibly tuned using voltages of different polarities because of its bipolar TS behavior, enabling the device to function as an electronically reconfigurable bi-mode neuron. A variety of neuronal activities such as all-or-nothing behavior and tunable firing probability are mimicked under both excitatory and inhibitory stimuli. Furthermore, we develop a self-adaptive neuromorphic vision sensor based on bi-mode neurons, demonstrating effective object recognition in varied lighting conditions. Thus, our bi-mode neuron offers a versatile platform for constructing neuromorphic systems with rich functionality.

Hemispherical Retina Emulated by Plasmonic Optoelectronic Memristors with All-Optical Modulation for Neuromorphic Stereo Vision

Binocular stereo vision relies on imaging disparity between two hemispherical retinas, which is essential to acquire image information in three dimensional environment. Therefore, retinomorphic electronics with structural and functional similarities to biological eyes are always highly desired to develop stereo vision perception system. In this work, a hemispherical optoelectronic memristor array based on Ag-TiO2 nanoclusters/sodium alginate film is developed to realize binocular stereo vision. All-optical modulation induced by plasmonic thermal effect and optical excitation in Ag-TiO2 nanoclusters is exploited to realize in-pixel image sensing and storage. Wide field of view (FOV) and spatial angle detection are experimentally demonstrated owing to the device arrangement and incident-angle-dependent characteristics in hemispherical geometry. Furthermore, depth perception and motion detection based on binocular disparity have been realized by constructing two retinomorphic memristive arrays. The results demonstrated in this work provide a promising strategy to develop all-optically controlled memristor and promote the future development of binocular vision system with in-sensor architecture.

Recent advances in flexible memristors for advanced computing and sensing

Conventional computing systems based on von Neumann architecture face challenges such as high power consumption and limited data processing capability. Improving device performance via scaling guided by Moore's Law becomes increasingly difficult. Emerging memristors can provide a promising solution for achieving high-performance computing systems with low power consumption. In particular, the development of flexible memristors is an important topic for wearable electronics, which can lead to intelligent systems in daily life with high computing capacity and efficiency. Here, recent advances in flexible memristors are reviewed, from operating mechanisms and typical materials to representative applications. Potential directions and challenges for future study in this area are also discussed.

Crossmodal sensory neurons based on high-performance flexible memristors for human-machine in-sensor computing system

Constructing crossmodal in-sensor processing system based on high-performance flexible devices is of great significance for the development of wearable human-machine interfaces. A bio-inspired crossmodal in-sensor computing system can perform real-time energy-efficient processing of multimodal signals, alleviating data conversion and transmission between different modules in conventional chips. Here, we report a bio-inspired crossmodal spiking sensory neuron (CSSN) based on a flexible VO2 memristor, and demonstrate a crossmodal in-sensor encoding and computing system for wearable human-machine interfaces. We demonstrate excellent performance in the VO2 memristor including endurance (>1012), uniformity (0.72% for cycle-to-cycle variations and 3.73% for device-to-device variations), speed (<30 ns), and flexibility (bendable to a curvature radius of 1 mm). A flexible hardware processing system is implemented based on the CSSN, which can directly perceive and encode pressure and temperature bimodal information into spikes, and then enables the real-time haptic-feedback for human-machine interaction. We successfully construct a crossmodal in-sensor spiking reservoir computing system via the CSSNs, which can achieve dynamic objects identification with a high accuracy of 98.1% and real-time signal feedback. This work provides a feasible approach for constructing flexible bio-inspired crossmodal in-sensor computing systems for wearable human-machine interfaces.

Recent advances in artificial neuromorphic applications based on perovskite composites

High-performance perovskite materials with excellent physical, electronic, and optical properties play a significant role in artificial neuromorphic devices. However, the development of perovskites in microelectronics is inevitably hindered by their intrinsic non-ideal properties, such as high defect density, environmental sensitivity, and toxicity. By leveraging materials engineering, integrating various materials with perovskites to leverage their mutual strengths presents great potential to enhance ion migration, energy level alignment, photoresponsivity, and surface passivation, thereby advancing optoelectronic and neuromorphic device development. This review initially provides an overview of perovskite materials across different dimensions, highlighting their physical properties and detailing their applications and metrics in two- and three-terminal devices. Subsequently, we comprehensively summarize the application of perovskites in combination with other materials, including organics, nanomaterials, oxides, ferroelectrics, and crystalline porous materials (CPMs), to develop advanced devices such as memristors, transistors, photodetectors, sensors, light-emitting diodes (LEDs), and artificial neuromorphic systems. Lastly, we outline the challenges and future research directions in synthesizing perovskite composites for neuromorphic devices. Through the review and analysis, we aim to broaden the utilization of perovskites and their composites in neuromorphic research, offering new insights and approaches for grasping the intricate physical working mechanisms and functionalities of perovskites.

Development of Bio-Voltage Operated Humidity-Sensory Neurons Comprising Self-Assembled Peptide Memristors

Biomimetic humidity sensors offer a low-power approach for respiratory monitoring in early lung-disease diagnosis. However, balancing miniaturization and energy efficiency remains challenging. This study addresses this issue by introducing a bioinspired humidity-sensing neuron comprising a self-assembled peptide nanowire (NW) memristor with unique proton-coupled ion transport. The proposed neuron shows a low Ag+ activation energy owing to the NW and redox activity of the tyrosine (Tyr)-rich peptide in the system, facilitating ultralow electric-field-driven threshold switching and a high energy efficiency. Additionally, Ag+ migration in the system can be controlled by a proton source owing to the hydrophilic nature of the phenolic hydroxyl group in Tyr, enabling the humidity-based control of the conductance state of the memristor. Furthermore, a memristor-based neuromorphic perception neuron that can encode humidity signals into spikes is proposed. The spiking characteristics of this neuron can be modulated to emulate the strength-modulated spike-frequency characteristics of biological neurons. A three-layer spiking neural network with input neurons comprising these highly tunable humidity perception neurons shows an accuracy of 92.68% in lung-disease diagnosis. This study paves the way for developing bioinspired self-assembly strategies to construct neuromorphic perception systems, bridging the gap between artificial and biological sensing and processing paradigms.

Adaptive Processing Enabled by Sodium Alginate Based Complementary Memristor for Neuromorphic Sensory System

Adaptive processing allows sensory systems to autonomically adjust their sensitivity with exposure to a constant sensory stimulus and thus organisms to adapt to environmental variations. Bioinspired electronics with adaptive functions are highly desirable for the development of neuromorphic sensory systems (NSSs). Herein, the functions of desensitization and sensitivity changing with background intensity (i.e., Weber's law), as two fundamental cues of sensory adaptation, are biorealistically demonstrated in an Ag nanowire (NW)-embedded sodium alginate (SA) based complementary memristor. In particular, Weber's law is experimentally emulated in a single complementary memristor. Furthermore, three types of adaptive NSS unit are constructed to realize a multiple perceptual capability that processes the stimuli of illuminance, temperature, and pressure signals. Taking neuromorphic vision as an example, scotopic and photopic adaptation functions are well reproduced for image enhancement against dark and bright backgrounds. Importantly, an NSS system with multisensory integration function is demonstrated by combining light and pressure spikes, where the accuracy of pattern recognition is obviously enhanced relative to that of an individual sense. This work offers a new strategy for developing neuromorphic electronics with adaptive functions and paves the way toward developing a highly efficient NSS.

A Photoelectrochemical Retinomorphic Synapse

Reproducing human visual functions with artificial devices is a long-standing goal of the neuromorphic domain. However, emulating the chemical language communication of the visual system in fluids remains a grand challenge. Here, a "multi-color" hydrogel-based photoelectrochemical retinomorphic synapse is reported with unique chemical-ionic-electrical signaling in an aqueous electrolyte that enables, e.g., color perception and biomolecule-mediated synaptic plasticity. Based on the specific enzyme-catalyzed chromogenic reactions, three multifunctional colored hydrogels are developed, which can not only synergize with the Bi2S3 photogate to recognize the primary colors but also synergize with a given polymeric channel to promote the long-term memory of the system. A synaptic array is further constructed for sensing color images and biomolecule-coded information communication. Taking advantage of the versatile biochemistry, the biochemical-driven reversible photoelectric response of the cone cell is further mimicked. This work introduces rich chemical designs into retinomorphic devices, providing a perspective for replicating the human visual system in fluids.

Coexistance of the Negative Photoconductance Effect and Analogue Switching Memory in the CuPc Organic Memristor for Neuromorphic Vision Computing

A bioinspired in-sensing computing paradigm using emerging photoelectronic memristors pursues multifunctionality with low power consumption and high efficiency for processing large amounts of sensing information. An organic semiconductor memristor strategy based on the CuPc functional layer integrates a negative photoconductance (NPC) effect and an analogue switching memory (ASM) effect in the same pixel. The NPC effect, present in the pure capacitance state at low bias voltage, provides high-performance short/long-term synaptic plasticity modulable by light pulse parameters. The interface charge effect along with defeat site trapping and detrapping is responsible for the pure capacitance effect and the NPC effect, with electron tunneling and electric-field-driven band dynamics responsible for ASM. This work reveals an organic memristor approach for hardware implementation of a neuromorphic vision computing system, emulating retinal bipolar cells via light-dominated NPC and electrically induced ASM with stable, tunable conductance states.

An artificial visual neuron with multiplexed rate and time-to-first-spike coding

Human visual neurons rely on event-driven, energy-efficient spikes for communication, while silicon image sensors do not. The energy-budget mismatch between biological systems and machine vision technology has inspired the development of artificial visual neurons for use in spiking neural network (SNN). However, the lack of multiplexed data coding schemes reduces the ability of artificial visual neurons in SNN to emulate the visual perception ability of biological systems. Here, we present an artificial visual spiking neuron that enables rate and temporal fusion (RTF) coding of external visual information. The artificial neuron can code visual information at different spiking frequencies (rate coding) and enables precise and energy-efficient time-to-first-spike (TTFS) coding. This multiplexed sensory coding scheme could improve the computing capability and efficacy of artificial visual neurons. A hardware-based SNN with the RTF coding scheme exhibits good consistency with real-world ground truth data and achieves highly accurate steering and speed predictions for self-driving vehicles in complex conditions. The multiplexed RTF coding scheme demonstrates the feasibility of developing highly efficient spike-based neuromorphic hardware.

All-Photolithography Fabrication of Ion-Gated Flexible Organic Transistor Array for Multimode Neuromorphic Computing

Organic ion-gated transistors (OIGTs) demonstrate commendable performance for versatile neuromorphic systems. However, due to the fragility of organic materials to organic solvents, efficient and reliable all-photolithography methods for scalable manufacturing of high-density OIGT arrays with multimode neuromorphic functions are still missing, especially when all active layers are patterned in high-density. Here, a flexible high-density (9662 devices per cm2) OIGT array with high yield and minimal device-to-device variation is fabricated by a modified all-photolithography method. The unencapsulated flexible array can withstand 1000 times' bending at a radius of 1 mm, and 3 months' storage test in air, without obvious performance degradation. More interesting, the OIGTs can be configured between volatile and nonvolatile modes, suitable for constructing reservoir computing systems to achieve high accuracy in classifying handwritten digits with low training costs. This work proposes a promising design of organic and flexible electronics for affordable neuromorphic systems, encompassing both array and algorithm aspects.

Reconfigurable Ag/HfO2/NiO/Pt Memristors with Stable Synchronous Synaptic and Neuronal Functions for Renewable Homogeneous Neuromorphic Computing System

Artificial synapses and bionic neurons offer great potential in highly efficient computing paradigms. However, complex requirements for specific electronic devices in neuromorphic computing have made memristors face the challenge of process simplification and universality. Herein, reconfigurable Ag/HfO2/NiO/Pt memristors are designed for feasible switching between volatile and nonvolatile modes by compliance current controlled Ag filaments, which enables stable and reconfigurable synaptic and neuronal functions. A neuromorphic computing system effectively replicates the biological synaptic weight alteration and continuously accomplishes excitation and reset of artificial neurons, which consist of bionic synapses and artificial neurons based on isotype Ag/HfO2/NiO/Pt memristors. This reconfigurable electrical performance of the Ag/HfO2/NiO/Pt memristors takes advantage of simplified hardware design and delivers integrated circuits with high density, which exhibits great potency for future neural networks.

Fully Memristive Elementary Motion Detectors for a Maneuver Prediction

Insects can efficiently perform object motion detection via a specialized neural circuit, called an elementary motion detector (EMD). In contrast, conventional machine vision systems require significant computational resources for dynamic motion processing. Here, a fully memristive EMD (M-EMD) is presented that implements the Hassenstein-Reichardt (HR) correlator, a biological model of the EMD. The M-EMD consists of a simple Wye (Y) configuration, including a static resistor, a dynamic memristor, and a Mott memristor. The resistor and dynamic memristor introduce different signal delays, enabling spatio-temporal signal integration in the subsequent Mott memristor, resulting in a direction-selective response. In addition, a neuromorphic system is developed employing the M-EMDs to predict a lane-changing maneuver by vehicles on the road. The system achieved a high accuracy (> 87%) in predicting future lane-changing maneuvers on the Next Generation Simulation (NGSIM) dataset while reducing the computational cost by 92.9% compared to the conventional neuromorphic system without the M-EMD, suggesting its strong potential for edge-level computing.

A bionic self-driven retinomorphic eye with ionogel photosynaptic retina

Bioinspired bionic eyes should be self-driving, repairable and conformal to arbitrary geometries. Such eye would enable wide-field detection and efficient visual signal processing without requiring external energy, along with retinal transplantation by replacing dysfunctional photoreceptors with healthy ones for vision restoration. A variety of artificial eyes have been constructed with hemispherical silicon, perovskite and heterostructure photoreceptors, but creating zero-powered retinomorphic system with transplantable conformal features remains elusive. By combining neuromorphic principle with retinal and ionoelastomer engineering, we demonstrate a self-driven hemispherical retinomorphic eye with elastomeric retina made of ionogel heterojunction as photoreceptors. The receptor driven by photothermoelectric effect shows photoperception with broadband light detection (365 to 970 nm), wide field-of-view (180°) and photosynaptic (paired-pulse facilitation index, 153%) behaviors for biosimilar visual learning. The retinal photoreceptors are transplantable and conformal to any complex surface, enabling visual restoration for dynamic optical imaging and motion tracking.

Neuromorphic antennal sensory system

Insect antennae facilitate the nuanced detection of vibrations and deflections, and the non-contact perception of magnetic or chemical stimuli, capabilities not found in mammalian skin. Here, we report a neuromorphic antennal sensory system that emulates the structural, functional, and neuronal characteristics of ant antennae. Our system comprises electronic antennae sensor with three-dimensional flexible structures that detects tactile and magnetic stimuli. The integration of artificial synaptic devices adsorbed with solution-processable MoS2 nanoflakes enables synaptic processing of sensory information. By emulating the architecture of receptor-neuron pathway, our system realizes hardware-level, spatiotemporal perception of tactile contact, surface pattern, and magnetic field (detection limits: 1.3 mN, 50 μm, 9.4 mT). Vibrotactile-perception tasks involving profile and texture classifications were accomplished with high accuracy (> 90%), surpassing human performance in "blind" tactile explorations. Magneto-perception tasks including magnetic navigation and touchless interaction were successfully completed. Our work represents a milestone for neuromorphic sensory systems and biomimetic perceptual intelligence.

Technology and Integration Roadmap for Optoelectronic Memristor

Optoelectronic memristors (OMs) have emerged as a promising optoelectronic Neuromorphic computing paradigm, opening up new opportunities for neurosynaptic devices and optoelectronic systems. These OMs possess a range of desirable features including minimal crosstalk, high bandwidth, low power consumption, zero latency, and the ability to replicate crucial neurological functions such as vision and optical memory. By incorporating large-scale parallel synaptic structures, OMs are anticipated to greatly enhance high-performance and low-power in-memory computing, effectively overcoming the limitations of the von Neumann bottleneck. However, progress in this field necessitates a comprehensive understanding of suitable structures and techniques for integrating low-dimensional materials into optoelectronic integrated circuit platforms. This review aims to offer a comprehensive overview of the fundamental performance, mechanisms, design of structures, applications, and integration roadmap of optoelectronic synaptic memristors. By establishing connections between materials, multilayer optoelectronic memristor units, and monolithic optoelectronic integrated circuits, this review seeks to provide insights into emerging technologies and future prospects that are expected to drive innovation and widespread adoption in the near future.

Miniature bioinspired artificial compound eyes: microfabrication technologies, photodetection and applications

As an outstanding visual system for insects and crustaceans to cope with the challenges of survival, compound eye has many unique advantages, such as wide field of view, rapid response, infinite depth of field, low aberration and fast motion capture. However, the complex composition of their optical systems also presents significant challenges for manufacturing. With the continuous development of advanced materials, complex 3D manufacturing technologies and flexible electronic detectors, various ingenious and sophisticated compound eye imaging systems have been developed. This paper provides a comprehensive review on the microfabrication technologies, photoelectric detection and functional applications of miniature artificial compound eyes. Firstly, a brief introduction to the types and structural composition of compound eyes in the natural world is provided. Secondly, the 3D forming manufacturing techniques for miniature compound eyes are discussed. Subsequently, some photodetection technologies for miniature curved compound eye imaging are introduced. Lastly, with reference to the existing prototypes of functional applications for miniature compound eyes, the future development of compound eyes is prospected.

PbS/CsPbBr3 Heterojunction for Broadband Neuromorphic Vision Sensing

Neuromorphic light sensors with analogue-domain image processing capability hold promise for overcoming the energy efficiency limitations and latency of von Neumann architecture-based vision chips. Recently, metal halide perovskites, with strong light-matter interaction, long carrier diffusion length, and exceptional photoelectric conversion efficiencies, exhibit reconfigurable photoresponsivity due to their intrinsic ion migration effect, which is expected to advance the development of visual sensors. However, suffering from a large bandgap, it is challenging to achieve highly tunable responsivity simultaneously with a wide-spectrum response in perovskites, which will significantly enhance the image recognition accuracy through the machine learning algorithm. Herein, we demonstrate a broadband neuromorphic visual sensor from visible (Vis) to near-infrared (NIR) by coupling all-inorganic metal halide perovskites (CsPbBr3) with narrow-bandgap lead sulfide (PbS). The PbS/CsPbBr3 heterostructure is composed of high-quality single crystals of PbS and CsPbBr3. Interestingly, the ion migration of CsPbBr3 with the implementation of an electric field induces the energy band dynamic bending at the interface of the PbS/CsPbBr3 heterojunction, leading to reversible, multilevel, and linearly tunable photoresponsivity. Furthermore, the reconfigurable and broadband photoresponse in the PbS/CsPbBr3 heterojunction allows convolutional neuronal network processing for pattern recognition and edge enhancements from the Vis to the NIR waveband, suggesting the great potential of the PbS/CsPbBr3 heterostructure in artificial intelligent vision sensing.

Hierarchies in Visual Pathway: Functions and Inspired Artificial Vision

The development of artificial intelligence has posed a challenge to machine vision based on conventional complementary metal-oxide semiconductor (CMOS) circuits owing to its high latency and inefficient power consumption originating from the data shuffling between memory and computation units. Gaining more insights into the function of every part of the visual pathway for visual perception can bring the capabilities of machine vision in terms of robustness and generality. Hardware acceleration of more energy-efficient and biorealistic artificial vision highly necessitates neuromorphic devices and circuits that are able to mimic the function of each part of the visual pathway. In this paper, we review the structure and function of the entire class of visual neurons from the retina to the primate visual cortex within reach (Chapter 2) are reviewed. Based on the extraction of biological principles, the recent hardware-implemented visual neurons located in different parts of the visual pathway are discussed in detail in Chapters 3 and 4. Furthermore, valuable applications of inspired artificial vision in different scenarios (Chapter 5) are provided. The functional description of the visual pathway and its inspired neuromorphic devices/circuits are expected to provide valuable insights for the design of next-generation artificial visual perception systems.

Ga2O3 Bipolar Heterojunction-Based Optoelectronic Synapse Array with Visual Attention

The human brain efficiently processes only a fraction of visual information, a phenomenon termed attentional control, resulting in energy savings and heightened adaptability. Translating this mechanism into artificial visual neurons holds promise for constructing energy-efficient, bioinspired visual systems. Here, we propose a self-rectifying artificial visual neuron (SEVN) based on a NiO/Ga2O3 bipolar heterojunction with attentional control on patterns with a target color. The device exhibits short-term potentiation (STP) with quantum point contact (QPC) traits at low bias and transitions to long-term potentiation (LTP) at high bias, particularly facilitated by electron capture in deep defects upon ultraviolet (UV) exposure. With the utilization of two wavelengths of light upon the target and interference part of CAPTCHA to simulate top-down attentional control, the recognition accuracy is enhanced from 74 to 84%. These findings have the potential to augment the visual capability of neuromorphic systems with implications for diverse applications, including cybersecurity, healthcare, and machine vision.

Towards Artificial Visual Sensory System: Organic Optoelectronic Synaptic Materials and Devices

Developing an artificial visual sensory system requires optoelectronic materials and devices that can mimic the behavior of biological synapses. Organic/polymeric semiconductors have emerged as promising candidates for optoelectronic synapses due to their tunable optoelectronic properties, mechanic flexibility, and biological compatibility. In this review, we discuss the recent progress in organic optoelectronic synaptic materials and devices, including their design principles, working mechanisms, and applications. We also highlight the challenges and opportunities in this field and provide insights into potential applications of these materials and devices in next-generation artificial visual systems. By leveraging the advances in organic optoelectronic materials and devices, we can envision its future development in artificial intelligence.

Achieving Reliable and Ultrafast Memristors via Artificial Filaments in Silk Fibroin

The practical implementation of memristors in neuromorphic computing and biomimetic sensing suffers from unexpected temporal and spatial variations due to the stochastic formation and rupture of conductive filaments (CFs). Here, the biocompatible silk fibroin (SF) is patterned with an on-demand nanocone array by using thermal scanning probe lithography (t-SPL) to guide and confine the growth of CFs in the silver/SF/gold (Ag/SF/Au) memristor. Benefiting from the high fabrication controllability, cycle-to-cycle (temporal) standard deviation of the set voltage for the structured memristor is significantly reduced by ≈95.5% (from 1.535 to 0.0686 V) and the device-to-device (spatial) standard deviation is also reduced to 0.0648 V. Besides, the statistical relationship between the structural nanocone design and the resultant performance is confirmed, optimizing at the small operation voltage (≈0.5 V) and current (100 nA), ultrafast switching speed (sub-100 ns), large on/off ratio (104 ), and the smallest switching slope (SS < 0.01 mV dec-1 ). Finally, the short-term plasticity and leaky integrated-and-fire behavior are emulated, and a reliable thermal nociceptor system is demonstrated for practical neuromorphic applications.

Self-Rectifying Memristors for Three-Dimensional In-Memory Computing

Costly data movement in terms of time and energy in traditional von Neumann systems is exacerbated by emerging information technologies related to artificial intelligence. In-memory computing (IMC) architecture aims to address this problem. Although the IMC hardware prototype represented by a memristor is developed rapidly and performs well, the sneak path issue is a critical and unavoidable challenge prevalent in large-scale and high-density crossbar arrays, particularly in three-dimensional (3D) integration. As a perfect solution to the sneak-path issue, a self-rectifying memristor (SRM) is proposed for 3D integration because of its superior integration density. To date, SRMs have performed well in terms of power consumption (aJ level) and scalability (>102  Mbit). Moreover, SRM-configured 3D integration is considered an ideal hardware platform for 3D IMC. This review focuses on the progress in SRMs and their applications in 3D memory, IMC, neuromorphic computing, and hardware security. The advantages, disadvantages, and optimization strategies of SRMs in diverse application scenarios are illustrated. Challenges posed by physical mechanisms, fabrication processes, and peripheral circuits, as well as potential solutions at the device and system levels, are also discussed.

Full hardware implementation of neuromorphic visual system based on multimodal optoelectronic resistive memory arrays for versatile image processing

In-sensor and near-sensor computing are becoming the next-generation computing paradigm for high-density and low-power sensory processing. To fulfil a high-density and efficient neuromorphic visual system with fully hierarchical emulation of the retina and visual cortex, emerging multimodal neuromorphic devices for multi-stage processing and a fully hardware-implemented system with versatile image processing functions are still lacking and highly desirable. Here we demonstrate an emerging multimodal-multifunctional resistive random-access memory (RRAM) device array based on modified silk fibroin protein (MSFP), exhibiting both optoelectronic RRAM (ORRAM) mode featured by unique negative and positive photoconductance memory and electrical RRAM (ERRAM) mode featured by analogue resistive switching. A full hardware implementation of the artificial visual system with versatile image processing functions is realised for the first time, including ORRAM mode array for the in-sensor image pre-processing (contrast enhancement, background denoising, feature extraction) and ERRAM mode array for near-sensor high-level image recognition, which hugely improves the integration density, and simply the circuit design and the fabrication and integration complexity.

Nanoarchitectonics on Electrosynthesis and Assembly of Conjugated Metallopolymers

In contrast to edge-on and face-on orientations, end-on uniaxial conjugated polymers have the theoretical possibility of providing a macroscopic crystalline film. However, their fabrication is insurmountable due to sluggishly thermodynamic equilibrium states. Herein, we report the programmatic pathway to fabricate nanoarchitectonics on end-on uniaxial conjugated metallopolymers by surface-initiated simultaneous electrosynthesis and assembly. Self-assembled monolayer (SAM) with bottom-up oriented electroactive molecules as a temple allows orientation, stacking, and reactive addition of monomers triggered by switching alternative redox reactions as well as crystallization of small molecules. Repeating the same reaction can repair the unreactive site on the SAM and dynamically and statistically ensure maximum iterative coverage with ideal linear coefficients between optical or electrical responses and iterative times. The resulting nanoarchitectonics on uniaxially assembled end-on polymers over centimeter-sized areas have a subnanometer-uniform morphology and exhibit ultrahigh modulus as well as an inorganic indium tin oxides and the highest conductance among conjugated molecular monolayers. Their memristive devices provide quantitative electrical and optical responses as a function of molecular length, bias, and iterative junctions. Precise processing of nanoarchitectonics as an electrically assisted assembly or printing technique can present sophisticated optoelectric functions and dimensional batch-to-batch consistency for micro-sized organic materials and electronics.

Adaptive Neural Activation and Neuromorphic Processing via Drain-Injection Threshold-Switching Float Gate Transistor Memory

Hetero-modulated neural activation is vital for adaptive information processing and learning that occurs in brain. To implement brain-inspired adaptive processing, previously various neurotransistors oriented for synaptic functions are extensively explored, however, the emulation of nonlinear neural activation and hetero-modulated behaviors are not possible due to the lack of threshold switching behavior in a conventional transistor structure. Here, a 2D van der Waals float gate transistor (FGT) that exhibits steep threshold switching behavior, and the emulation of hetero-modulated neuron functions (integrate-and-fire, sigmoid type activation) for adaptive sensory processing, are reported. Unlike conventional FGTs, the threshold switching behavior stems from impact ionization in channel and the coupled charge injection to float gate. When a threshold is met, a sub-30 mV dec-1 increase of transistor conductance by more than four orders is triggered with a typical switch time of approximately milliseconds. Essentially, by feeding light sensing signal as the modulation input, it is demonstrated that two typical tasks that rely on adaptive neural activation, including collision avoidance and adaptive visual perception, can be realized. These results may shed light on the emulation of rich hetero-modulating behaviors in biological neurons and the realization of biomimetic neuromorphic processing at low hardware cost.

Novel Semiconductive Ternary Hybrid Heterostructures for Artificial Optoelectronic Synapses

Synaptic devices that mimic biological synapses are considered as promising candidates for brain-inspired devices, offering the functionalities in neuromorphic computing. However, modulation of emerging optoelectronic synaptic devices has rarely been reported. Herein, a semiconductive ternary hybrid heterostructure is prepared with a D-D'-A configuration by introducing polyoxometalate (POM) as an additional electroactive donor (D') into a metalloviologen-based D-A framework. The obtained material features an unprecedented porous 8-connected bcu-net that accommodates nanoscale [α-SiW12 O40 ]4- counterions, displaying uncommon optoelectronic responses. Besides, the fabricated synaptic device based on this material can achieve dual-modulation of synaptic plasticity due to the synergetic effect of electron reservoir POM and photoinduced electron transfer. And it can successfully simulate learning and memory processes similar to those in biological systems. The result provides a facile and effective strategy to customize multi-modality artificial synapses in the field of crystal engineering, which opens a new direction for developing high-performance neuromorphic devices.

Trainable Bilingual Synaptic Functions in Bio-enabled Synaptic Transistors

The signal transmission of the nervous system is regulated by neurotransmitters. Depending on the type of neurotransmitter released by presynaptic neurons, neuron cells can either be excited or inhibited. Maintaining a balance between excitatory and inhibitory synaptic responses is crucial for the nervous system's versatility, elasticity, and ability to perform parallel computing. On the way to mimic the brain's versatility and plasticity traits, creating a preprogrammed balance between excitatory and inhibitory responses is required. Despite substantial efforts to investigate the balancing of the nervous system, a complex circuit configuration has been suggested to simulate the interaction between excitatory and inhibitory synapses. As a meaningful approach, an optoelectronic synapse for balancing the excitatory and inhibitory responses assisted by light mediation is proposed here by deploying humidity-sensitive chiral nematic phases of known polysaccharide cellulose nanocrystals. The environment-induced pitch tuning changes the polarization of the helicoidal organization, affording different hysteresis effects with the subsequent excitatory and inhibitory nonvolatile behavior in the bio-electrolyte-gated transistors. By applying voltage pulses combined with stimulation of chiral light, the artificial optoelectronic synapse tunes not only synaptic functions but also learning pathways and color recognition. These multifunctional bio-based synaptic field-effect transistors exhibit potential for enhanced parallel neuromorphic computing and robot vision technology.

An Artificial Olfactory System Based on a Chemi-Memristive Device

Technologies based on the fusion of gas sensors and neuromorphic computing to mimic the olfactory system have immense potential. However, the implementation of neuromorphic olfactory systems remains in a state of infancy because conventional gas sensors lack the necessary functions. Therefore, this study proposes a hysteretic "chemi-memristive gas sensor" based on oxygen vacancy chemi-memristive dynamics that differ from that of conventional gas sensors. After the memristive switching operation, the redox reaction with the external gas molecules is enhanced, resulting in the generation and elimination of oxygen vacancies that induce rapid current changes. In addition, the pre-generated oxygen vacancies enhance the post-sensing properties. Therefore, fast responses, short recovery times, and hysteretic gas response are achieved by the proposed sensor at room temperature. Based on the advantageous functionality of the sensor, device-level olfactory systems that can monitor the history of input gas stimuli are experimentally demonstrated as a potential application. Moreover, analog conductance modulation induced by oxidizing and reducing gases enables the conversion of external gas stimuli into synaptic weights and hence the realization of typical synaptic functionalities without an additional device or circuit. The proposed chemi-memristive device represents an advance in the bioinspired technology adopted in creating artificial intelligence systems.

Emerging Iontronic Neural Devices for Neuromorphic Sensory Computing

Living organisms have a very mysterious and powerful sensory computing system based on ion activity. Interestingly, studies on iontronic devices in the past few years have proposed a promising platform for simulating the sensing and computing functions of living organisms, because: 1) iontronic devices can generate, store, and transmit a variety of signals by adjusting the concentration and spatiotemporal distribution of ions, which analogs to how the brain performs intelligent functions by alternating ion flux and polarization; 2) through ionic-electronic coupling, iontronic devices can bridge the biosystem with electronics and offer profound implications for soft electronics; 3) with the diversity of ions, iontronic devices can be designed to recognize specific ions or molecules by customizing the charge selectivity, and the ionic conductivity and capacitance can be adjusted to respond to external stimuli for a variety of sensing schemes, which can be more difficult for electron-based devices. This review provides a comprehensive overview of emerging neuromorphic sensory computing by iontronic devices, highlighting representative concepts of both low-level and high-level sensory computing and introducing important material and device breakthroughs. Moreover, iontronic devices as a means of neuromorphic sensing and computing are discussed regarding the pending challenges and future directions.

A self-tuning PID controller based on analog-digital hybrid computing with a double-gate SnS2 memtransistor

Most commercial drones utilize a traditional proportional-integral-derivative (PID) controller because of its design simplicity. However, the traditional PID controller has certain limitations in terms of optimality and robustness; it is difficult to actively adjust the PID gains under some disturbances. In this study, we demonstrated an analog-digital hybrid computing platform based on double-gate SnS2 memtransistors to implement a self-tuning/energy-efficient PID controller in drones. The customized analog circuit with memtransistors executes the PID control algorithm with low power consumption; we experimentally verified that the energy consumption of the proposed hybrid computing-based PID controller is only 63% of that of the traditional PID controller. In addition, the precise tunability of analog conductance states in the memtransistor proved to be capable of reconfiguring the performance of the PID controller, where the developed self-tuning algorithm can automatically find the optimal PID control performance.

Double-Glued Multi-Focal Bionic Compound Eye Camera

Compound eye cameras are a vital component of bionics. Compound eye lenses are currently used in light field cameras, monitoring imaging, medical endoscopes, and other fields. However, the resolution of the compound eye lens is still low at the moment, which has an impact on the application scene. Photolithography and negative pressure molding were used to create a double-glued multi-focal bionic compound eye camera in this study. The compound eye camera has 83 microlenses, with ommatidium diameters ranging from 400 μm to 660 μm, and a 92.3 degree field-of-view angle. The double-gluing structure significantly improves the optical performance of the compound eye lens, and the spatial resolution of the ommatidium is 57.00 lp mm-1. Additionally, the measurement of speed is investigated. This double-glue compound eye camera has numerous potential applications in the military, machine vision, and other fields.

Vertically integrated spiking cone photoreceptor arrays for color perception

The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose a metal oxide-based vertically integrated spiking cone photoreceptor array, which can directly transduce persistent lights into spike trains at a certain rate according to the input wavelengths. Such spiking cone photoreceptors have an ultralow power consumption of less than 400 picowatts per spike in visible light, which is very close to biological cones. In this work, lights with three wavelengths were exploited as pseudo-three-primary colors to form 'colorful' images for recognition tasks, and the device with the ability to discriminate mixed colors shows better accuracy. Our results would enable hardware spiking neural networks with biologically plausible visual perception and provide great potential for the development of dynamic vision sensors.

Carbon Nanodots Memristor: An Emerging Candidate toward Artificial Biosynapse and Human Sensory Perception System

In the era of big data and artificial intelligence (AI), advanced data storage and processing technologies are in urgent demand. The innovative neuromorphic algorithm and hardware based on memristor devices hold a promise to break the von Neumann bottleneck. In recent years, carbon nanodots (CDs) have emerged as a new class of nano-carbon materials, which have attracted widespread attention in the applications of chemical sensors, bioimaging, and memristors. The focus of this review is to summarize the main advances of CDs-based memristors, and their state-of-the-art applications in artificial synapses, neuromorphic computing, and human sensory perception systems. The first step is to systematically introduce the synthetic methods of CDs and their derivatives, providing instructive guidance to prepare high-quality CDs with desired properties. Then, the structure-property relationship and resistive switching mechanism of CDs-based memristors are discussed in depth. The current challenges and prospects of memristor-based artificial synapses and neuromorphic computing are also presented. Moreover, this review outlines some promising application scenarios of CDs-based memristors, including neuromorphic sensors and vision, low-energy quantum computation, and human-machine collaboration.

Biocompatible Material-Based Flexible Biosensors: From Materials Design to Wearable/Implantable Devices and Integrated Sensing Systems

Human beings have a greater need to pursue life and manage personal or family health in the context of the rapid growth of artificial intelligence, big data, the Internet of Things, and 5G/6G technologies. The application of micro biosensing devices is crucial in connecting technology and personalized medicine. Here, the progress and current status from biocompatible inorganic materials to organic materials and composites are reviewed and the material-to-device processing is described. Next, the operating principles of pressure, chemical, optical, and temperature sensors are dissected and the application of these flexible biosensors in wearable/implantable devices is discussed. Different biosensing systems acting in vivo and in vitro, including signal communication and energy supply are then illustrated. The potential of in-sensor computing for applications in sensing systems is also discussed. Finally, some essential needs for commercial translation are highlighted and future opportunities for flexible biosensors are considered.

Pseudo-transistors for emerging neuromorphic electronics

Artificial synaptic devices are the cornerstone of neuromorphic electronics. The development of new artificial synaptic devices and the simulation of biological synaptic computational functions are important tasks in the field of neuromorphic electronics. Although two-terminal memristors and three-terminal synaptic transistors have exhibited significant capabilities in the artificial synapse, more stable devices and simpler integration are needed in practical applications. Combining the configuration advantages of memristors and transistors, a novel pseudo-transistor is proposed. Here, recent advances in the development of pseudo-transistor-based neuromorphic electronics in recent years are reviewed. The working mechanisms, device structures and materials of three typical pseudo-transistors, including tunneling random access memory (TRAM), memflash and memtransistor, are comprehensively discussed. Finally, the future development and challenges in this field are emphasized.

Synapse-Mimetic Hardware-Implemented Resistive Random-Access Memory for Artificial Neural Network

Memristors mimic synaptic functions in advanced electronics and image sensors, thereby enabling brain-inspired neuromorphic computing to overcome the limitations of the von Neumann architecture. As computing operations based on von Neumann hardware rely on continuous memory transport between processing units and memory, fundamental limitations arise in terms of power consumption and integration density. In biological synapses, chemical stimulation induces information transfer from the pre- to the post-neuron. The memristor operates as resistive random-access memory (RRAM) and is incorporated into the hardware for neuromorphic computing. Hardware composed of synaptic memristor arrays is expected to lead to further breakthroughs owing to their biomimetic in-memory processing capabilities, low power consumption, and amenability to integration; these aspects satisfy the upcoming demands of artificial intelligence for higher computational loads. Among the tremendous efforts toward achieving human-brain-like electronics, layered 2D materials have demonstrated significant potential owing to their outstanding electronic and physical properties, facile integration with other materials, and low-power computing. This review discusses the memristive characteristics of various 2D materials (heterostructures, defect-engineered materials, and alloy materials) used in neuromorphic computing for image segregation or pattern recognition. Neuromorphic computing, the most powerful artificial networks for complicated image processing and recognition, represent a breakthrough in artificial intelligence owing to their enhanced performance and lower power consumption compared with von Neumann architectures. A hardware-implemented CNN with weight control based on synaptic memristor arrays is expected to be a promising candidate for future electronics in society, offering a solution based on non-von Neumann hardware. This emerging paradigm changes the computing algorithm using entirely hardware-connected edge computing and deep neural networks.

Biological function simulation in neuromorphic devices: from synapse and neuron to behavior

As the boom of data storage and processing, brain-inspired computing provides an effective approach to solve the current problem. Various emerging materials and devices have been reported to promote the development of neuromorphic computing. Thereinto, the neuromorphic device represented by memristor has attracted extensive research due to its outstanding property to emulate the brain's functions from synaptic plasticity, sensory-memory neurons to some intelligent behaviors of living creatures. Herein, we mainly review the progress of these brain functions mimicked by neuromorphic devices, concentrating on synapse (i.e. various synaptic plasticity trigger by electricity and/or light), neurons (including the various sensory nervous system) and intelligent behaviors (such as conditioned reflex represented by Pavlov's dog experiment). Finally, some challenges and prospects related to neuromorphic devices are presented.

Intelligent matter endows reconfigurable temperature and humidity sensations for in-sensor computing

Data-centric tactics with in-sensor computing go beyond the conventional computing-centric tactic that is suffering from processing latency and excessive energy consumption. The multifunctional intelligent matter with dynamic smart responses to environmental variations paves the way to implement data-centric tactics with high computing efficiency. However, intelligent matter with humidity and temperature sensitivity has not been reported. In this work, a design is demonstrated based on a single memristive device to achieve reconfigurable temperature and humidity sensations. Opposite temperature sensations at the low resistance state (LRS) and high resistance state (HRS) were observed for low-level sensory data processing. Integrated devices mimicking intelligent electronic skin (e-skin) can work in three modes to adapt to different scenarios. Additionally, the device acts as a humidity-sensory artificial synapse that can implement high-level cognitive in-sensor computing. The intelligent matter with reconfigurable temperature and humidity sensations is promising for energy-efficient artificial intelligence (AI) systems.

A review of memristor: material and structure design, device performance, applications and prospects

With the booming growth of artificial intelligence (AI), the traditional von Neumann computing architecture based on complementary metal oxide semiconductor devices are facing memory wall and power wall. Memristor based in-memory computing can potentially overcome the current bottleneck of computer and achieve hardware breakthrough. In this review, the recent progress of memory devices in material and structure design, device performance and applications are summarized. Various resistive switching materials, including electrodes, binary oxides, perovskites, organics, and two-dimensional materials, are presented and their role in the memristor are discussed. Subsequently, the construction of shaped electrodes, the design of functional layer and other factors influencing the device performance are analyzed. We focus on the modulation of the resistances and the effective methods to enhance the performance. Furthermore, synaptic plasticity, optical-electrical properties, the fashionable applications in logic operation and analog calculation are introduced. Finally, some critical issues such as the resistive switching mechanism, multi-sensory fusion, system-level optimization are discussed.

Emerging memristive neurons for neuromorphic computing and sensing

Inspired by the principles of the biological nervous system, neuromorphic engineering has brought a promising alternative approach to intelligence computing with high energy efficiency and low consumption. As pivotal components of neuromorphic system, artificial spiking neurons are powerful information processing units and can achieve highly complex nonlinear computations. By leveraging the switching dynamic characteristics of memristive device, memristive neurons show rich spiking behaviors with simple circuit. This report reviews the memristive neurons and their applications in neuromorphic sensing and computing systems. The switching mechanisms that endow memristive devices with rich dynamics and nonlinearity are highlighted, and subsequently various nonlinear spiking neuron behaviors emulated in these memristive devices are reviewed. Then, recent development is introduced on neuromorphic system with memristive neurons for sensing and computing. Finally, we discuss challenges and outlooks of the memristive neurons toward high-performance neuromorphic hardware systems and provide an insightful perspective for the development of interactive neuromorphic electronic systems.

A Hemispherical Image Sensor Array Fabricated with Organic Photomemory Transistors

Hemispherical image sensors simplify lens designs, reduce optical aberrations, and improve image resolution for compact wide-field-of-view cameras. To achieve hemispherical image sensors, organic materials are promising candidates due to the following advantages: tunability of optoelectronic/spectral response and low-temperature low-cost processes. Here, a photolithographic process is developed to prepare a hemispherical image sensor array using organic thin film photomemory transistors with a density of 308 pixels per square centimeter. This design includes only one photomemory transistor as a single active pixel, in contrast to the conventional pixel architecture, consisting of select/readout/reset transistors and a photodiode. The organic photomemory transistor, comprising light-sensitive organic semiconductor and charge-trapping dielectric, is able to achieve a linear photoresponse (light intensity range, from 1 to 50 W m^-2 ), along with a responsivity as high as 1.6 A W^-1 (wavelength = 465 nm) for a dark current of 0.24 A m^-2 (drain voltage = -1.5 V). These observed values represent the best responsivity for similar dark currents among all the reported hemispherical image sensor arrays to date. A transfer method was further developed that does not damage organic materials for hemispherical organic photomemory transistor arrays. These developed techniques are scalable and are amenable for other high-resolution 3D organic semiconductor devices.

Inorganic Halide Perovskite Quantum Dots: A Versatile Nanomaterial Platform for Electronic Applications

Metal halide perovskites have generated significant attention in recent years because of their extraordinary physical properties and photovoltaic performance. Among these, inorganic perovskite quantum dots (QDs) stand out for their prominent merits, such as quantum confinement effects, high photoluminescence quantum yield, and defect-tolerant structures. Additionally, ligand engineering and an all-inorganic composition lead to a robust platform for ambient-stable QD devices. This review presents the state-of-the-art research progress on inorganic perovskite QDs, emphasizing their electronic applications. In detail, the physical properties of inorganic perovskite QDs will be introduced first, followed by a discussion of synthesis methods and growth control. Afterwards, the emerging applications of inorganic perovskite QDs in electronics, including transistors and memories, will be presented. Finally, this review will provide an outlook on potential strategies for advancing inorganic perovskite QD technologies.

Progress of Materials and Devices for Neuromorphic Vision Sensors

The latest developments in bio-inspired neuromorphic vision sensors can be summarized in 3 keywords: smaller, faster, and smarter. (1) Smaller: Devices are becoming more compact by integrating previously separated components such as sensors, memory, and processing units. As a prime example, the transition from traditional sensory vision computing to in-sensor vision computing has shown clear benefits, such as simpler circuitry, lower power consumption, and less data redundancy. (2) Swifter: Owing to the nature of physics, smaller and more integrated devices can detect, process, and react to input more quickly. In addition, the methods for sensing and processing optical information using various materials (such as oxide semiconductors) are evolving. (3) Smarter: Owing to these two main research directions, we can expect advanced applications such as adaptive vision sensors, collision sensors, and nociceptive sensors. This review mainly focuses on the recent progress, working mechanisms, image pre-processing techniques, and advanced features of two types of neuromorphic vision sensors based on near-sensor and in-sensor vision computing methodologies.

Neurorobotic approaches to emulate human motor control with the integration of artificial synapse

The advancement of electronic devices has enabled researchers to successfully emulate human synapses, thereby promoting the development of the research field of artificial synapse integrated soft robots. This paper proposes an artificial reciprocal inhibition system that can successfully emulate the human motor control mechanism through the integration of artificial synapses. The proposed system is composed of artificial synapses, load transistors, voltage/current amplifiers, and a soft actuator to demonstrate the muscle movement. The speed, range, and direction of the soft actuator movement can be precisely controlled via the preset input voltages with different amplitudes, numbers, and signs (positive or negative). The artificial reciprocal inhibition system can impart lifelike motion to soft robots and is a promising tool to enable the successful integration of soft robots or prostheses in a living body.

Emulating the Signal Transmission in a Neural System Using Polymer Membranes

Neurons are vital components of the brain. When stimulated by neurotransmitters at the dendrites, neurons deliver signals as changes in the membrane potential by ion movement. The signal transmission of a nervous system exhibits a high energy efficiency. These characteristics of neurons are being exploited to develop efficient neuromorphic computing systems. In this study, we develop chemical synapses for neuromorphic devices and emulate the signaling processes in a nervous system using a polymer membrane, in which the ionic permeability can be controlled. The polymer membrane comprises poly(diallyl-dimethylammonium chloride) and poly(3-sulfopropyl acrylate potassium salt), which have positive and negative charges, respectively. The ionic permeability of the polymer membrane is controlled by the injection of a neurotransmitter solution. This device emulates the signal transmission behavior of biological neurons depending on the concentration of the injected neurotransmitter solution. The proposed artificial neuronal signaling device can facilitate the development of bio-realistic neuromorphic devices.

van der Waals Semiconductor Empowered Vertical Color Sensor

Biomimetic artificial vision is receiving significant attention nowadays, particularly for the development of neuromorphic electronic devices, artificial intelligence, and microrobotics. Nevertheless, color recognition, the most critical vision function, is missed in the current research due to the difficulty of downscaling of the prevailing color sensing devices. Conventional color sensors typically adopt a lateral color sensing channel layout and consume a large amount of physical space, whereas compact designs suffer from an unsatisfactory color detection accuracy. In this work, we report a van der Waals semiconductor-empowered vertical color sensing structure with the emphasis on compact device profile and precise color recognition capability. More attractive, we endow color sensor hardware with the function of chromatic aberration correction, which can simplify the design of an optical lens system and, in turn, further downscales the artificial vision systems. Also, the dimension of a multiple pixel prototype device in our study confirms the scalability and practical potentials of our developed device architecture toward the above applications.

An Artificial Reflex Arc That Perceives Afferent Visual and Tactile Information and Controls Efferent Muscular Actions

Neural perception and action-inspired electronics is becoming important for interactive human-machine interfaces and intelligent robots. A system that implements neuromorphic environmental information coding, synaptic signal processing, and motion control is desired. We report a neuroinspired artificial reflex arc that possesses visual and somatosensory dual afferent nerve paths and an efferent nerve path to control artificial muscles. A self-powered photoelectric synapse between the afferent and efferent nerves was used as the key information processor. The artificial reflex arc successfully responds to external visual and tactile information and controls the actions of artificial muscle in response to these external stimuli and thus emulates reflex activities through a full reflex arc. The visual and somatosensory information is encoded as impulse spikes, the frequency of which exhibited a sublinear dependence on the obstacle proximity or pressure stimuli. The artificial reflex arc suggests a promising strategy toward developing soft neurorobotic systems and prostheses.

Versatile memristor for memory and neuromorphic computing

The memristor is a promising candidate to implement high-density memory and neuromorphic computing. Based on the characteristic retention time, memristors are classified into volatile and non-volatile types. However, a single memristor generally provides a specific function based on electronic performances, which poses roadblocks for further developing novel circuits. Versatile memristors exhibiting both volatile and non-volatile properties can provide multiple functions covering non-volatile memory and neuromorphic computing. In this work, a versatile memristor with volatile/non-volatile bifunctional properties was developed. Non-volatile functionality with a storage window of 4.0 × 10⁵ was obtained. Meanwhile, the device can provide threshold volatile functionalities with a storage window of 7.0 × 10⁴ and a rectification ratio of 4.0 × 10⁴. The leaky integrate-and-fire (LIF) neuron model and artificial synapse based on the device have been studied. Such a versatile memristor enables non-volatile memory, selectors, artificial neurons, and artificial synapses, which will provide advantages regarding circuit simplification, fabrication processes, and manufacturing costs.