In-sensor reservoir computing system for latent fingerprint recognition with deep ultraviolet photo-synapses and memristor array

A nonconjugated radical polymer enables bimodal memory and in-sensor computing operation

This study reports intrinsic multimodal memristivity of a nonconjugated radical polymer with ambient stability. Organic memristive devices represent powerful candidates for biorealistic data storage and processing. However, there exists a substantial knowledge gap in realizing the synthetic biorealistic systems capable of effectively emulating the cooperative and multimodal activation processes in biological systems. In addition, conventional organic memristive materials are centered on conjugated small and macromolecules, making them synthetically challenging or difficult to process. In this work, we first describe the intrinsic resistive switching of the radical polymer that resulted in an exceptional state retention of >105 s and on/off ratio of >106. Next, we demonstrate its bimodal cooperative switching, in response to the proton accumulation as a biological input. Last, we expand our system toward an advanced in-sensor computing system. Our research demonstrates a nonconjugated radical polymer with intrinsic memristivity, which is directly applicable to future electronics including data storage, neuromorphics, and in-sensor computing.

A Plasmonic Optoelectronic Resistive Random-Access Memory for In-Sensor Color Image Cryptography

The optoelectronic resistive random-access memory (RRAM) with the integrated function of perception, storage and intrinsic randomness displays promising applications in the hardware level in-sensor image cryptography. In this work, 2D hexagonal boron nitride based optoelectronic RRAM is fabricated with semitransparent noble metal (Ag or Au) as top electrodes, which can simultaneous capture color image and generate physically unclonable function (PUF) key for in-sensor color image cryptography. Surface plasmons of noble metals enable the strong light absorption to realize an efficient modulation of filament growth at nanoscale. Resistive switching curves show that the optical stimuli can impede the filament aggregation and promote the filament annihilation, which originates from photothermal effects and photogenerated hot electrons in localized surface plasmon resonance of noble metals. By selecting noble metals, the optoelectronic RRAM array can respond to distinct wavelengths and mimic the biological dichromatic cone cells to perform the color perception. Due to the intrinsic and high-quality randomness, the optoelectronic RRAM can produce a PUF key in every exposure cycle, which can be applied in the reconfigurable cryptography. The findings demonstrate an effective strategy to build optoelectronic RRAM for in-sensor color image cryptography applications.

Towards mixed physical node reservoir computing: light-emitting synaptic reservoir system with dual photoelectric output

Memristor-based physical reservoir computing holds significant potential for efficiently processing complex spatiotemporal data, which is crucial for advancing artificial intelligence. However, owing to the single physical node mapping characteristic of traditional memristor reservoir computing, it inevitably induces high repeatability of eigenvalues to a certain extent and significantly limits the efficiency and performance of memristor-based reservoir computing for complex tasks. Hence, this work firstly reports an artificial light-emitting synaptic (LES) device with dual photoelectric output for reservoir computing, and a reservoir system with mixed physical nodes is proposed. The system effectively transforms the input signal into two eigenvalue outputs using a mixed physical node reservoir comprising distinct physical quantities, namely optical output with nonlinear optical effects and electrical output with memory characteristics. Unlike previously reported memristor-based reservoir systems, which pursue rich reservoir states in one physical dimension, our mixed physical node reservoir system can obtain reservoir states in two physical dimensions with one input without increasing the number and types of devices. The recognition rate of the artificial light-emitting synaptic reservoir system can achieve 97.22% in MNIST recognition. Furthermore, the recognition task of multichannel images can be realized through the nonlinear mapping of the photoelectric dual reservoir, resulting in a recognition accuracy of 99.25%. The mixed physical node reservoir computing proposed in this work is promising for implementing the development of photoelectric mixed neural networks and material-algorithm collaborative design.

Tunable synaptic behaviors of solution-processed InGaO films for artificial visual systems

Due to their persistent photoconductivity, amorphous metal oxide thin films are promising for construction of artificial visual systems. In this work, large-scale, uniformly distributed amorphous InGaO thin films with an adjustable In/Ga ratio and thickness are prepared successfully by a low-cost environmentally friendly and easy-to-handle solution process for constructing artificial visual systems. With the increase of the In/Ga ratio and film thickness, the number of oxygen vacancies increases, along with the increase of post-synaptic current triggered by illumination, benefiting the transition of short-term plasticity to long-term plasticity. With an optimal In/Ga ratio and film thickness, the conductance response difference at a decay of 0 s between the 1st and the 10th views of a 5 × 5 array InGaO thin film transistor is up to 2.88 μA, along with an increase in the Idecay 30s/Idecay 0s ratio from 45.24% to 53.24%, resulting in a high image clarity and non-volatile artificial visual memory. Furthermore, a three-layer artificial vision network is constructed to evaluate the image recognition capability, exhibiting an accuracy of up to 91.32%. All results promise low-cost and easy-to-handle amorphous InGaO thin films for future visual information processing and image recognition.

Pre-sensor computing with compact multilayer optical neural network

Moving computation units closer to sensors is becoming a promising approach to addressing bottlenecks in computing speed, power consumption, and data storage. Pre-sensor computing with optical neural networks (ONNs) allows extensive processing. However, the lack of nonlinear activation and dependence on laser input limits the computational capacity, practicality, and scalability. A compact and passive multilayer ONN (MONN) is proposed, which has two convolution layers and an inserted nonlinear layer, performing pre-sensor computations with designed passive masks and a quantum dot film for incoherent light. MONN has an optical length as short as 5 millimeters, two orders of magnitude smaller than state-of-the-art lens-based ONNs. MONN outperforms linear single-layer ONN across various vision tasks, off-loading up to 95% of computationally expensive operations into optics from electronics. Motivated by MONN, a paradigm is emerging for mobile vision, fulfilling the demands for practicality, miniaturization, and low power consumption.

Dynamic memristor for physical reservoir computing

Reservoir computing (RC) has attracted considerable attention for its efficient handling of temporal signals and lower training costs. As a nonlinear dynamic system, RC can map low-dimensional inputs into high-dimensional spaces and implement classification using a simple linear readout layer. The memristor exhibits complex dynamic characteristics due to its internal physical processes, which renders them an ideal choice for the implementation of physical reservoir computing (PRC) systems. This review focuses on PRC systems based on memristors, explaining the resistive switching mechanism at the device level and emphasizing the tunability of their dynamic behavior. The development of memristor-based reservoir computing systems is highlighted, along with discussions on the challenges faced by this field and potential future research directions.

Integrating ultraviolet sensing and memory functions in gallium nitride-based optoelectronic devices

Optoelectronic devices present a promising avenue for emulating the human visual system. However, existing devices struggle to maintain optical image information after removing external stimuli, preventing the integration of image perception and memory. The development of optoelectronic memory devices offers a feasible solution to bridge this gap. Simultaneously, the artificial vision for perceiving and storing ultraviolet (UV) images is particularly important because UV light carries information imperceptible to the naked eye. This study introduces a multi-level UV optoelectronic memory based on gallium nitride (GaN), seamlessly integrating UV sensing and memory functions within a single device. The embedded SiO2 side-gates around source and drain regions effectively extend the lifetime of photo-generated carriers, enabling dual-mode storage of UV signals in terms of threshold voltage and ON-state current. The optoelectronic memory demonstrates excellent robustness with the retention time exceeding 4 × 104 s and programming/erasing cycles surpassing 1 × 105. Adjusting the gate voltage achieves five distinct storage states, each characterized by excellent retention, and efficiently modulates erasure times for rapid erasure. Furthermore, the integration of the GaN optoelectronic memory array successfully captures and stably stores specific UV images for over 7 days. The study marks a significant stride in optoelectronic memories, showcasing their potential in applications requiring prolonged retention.

Development of Bio-Voltage Operated Humidity-Sensory Neurons Comprising Self-Assembled Peptide Memristors

Biomimetic humidity sensors offer a low-power approach for respiratory monitoring in early lung-disease diagnosis. However, balancing miniaturization and energy efficiency remains challenging. This study addresses this issue by introducing a bioinspired humidity-sensing neuron comprising a self-assembled peptide nanowire (NW) memristor with unique proton-coupled ion transport. The proposed neuron shows a low Ag+ activation energy owing to the NW and redox activity of the tyrosine (Tyr)-rich peptide in the system, facilitating ultralow electric-field-driven threshold switching and a high energy efficiency. Additionally, Ag+ migration in the system can be controlled by a proton source owing to the hydrophilic nature of the phenolic hydroxyl group in Tyr, enabling the humidity-based control of the conductance state of the memristor. Furthermore, a memristor-based neuromorphic perception neuron that can encode humidity signals into spikes is proposed. The spiking characteristics of this neuron can be modulated to emulate the strength-modulated spike-frequency characteristics of biological neurons. A three-layer spiking neural network with input neurons comprising these highly tunable humidity perception neurons shows an accuracy of 92.68% in lung-disease diagnosis. This study paves the way for developing bioinspired self-assembly strategies to construct neuromorphic perception systems, bridging the gap between artificial and biological sensing and processing paradigms.

Multidimensional Deep Ultraviolet (DUV) Synapses Based on Organic/Perovskite Semiconductor Heterojunction Transistors for Antispoofing Facial Recognition Systems

Reliably discerning real human faces from fake ones, known as antispoofing, is crucial for facial recognition systems. While neuromorphic systems offer integrated sensing-memory-processing functions, they still struggle with efficient antispoofing techniques. Here we introduce a neuromorphic facial recognition system incorporating multidimensional deep ultraviolet (DUV) optoelectronic synapses to address these challenges. To overcome the complexity and high cost of producing DUV synapses using traditional wide-bandgap semiconductors, we developed a low-temperature (≤70 °C) solution process for fabricating DUV synapses based on PEA2PbBr4/C8-BTBT heterojunction field-effect transistors. This method enables the large-scale (4-in.), uniform, and transparent production of DUV synapses. These devices respond to both DUV and visible light, showing multidimensional features. Leveraging the unique ability of the multidimensional DUV synapse (MDUVS) to discriminate real human skin from artificial materials, we have achieved robust neuromorphic facial recognition with antispoofing capability, successfully identifying genuine human faces with an accuracy exceeding 92%.

Enhancement-Mode Carbon Nanotube Optoelectronic Synaptic Transistors with Large and Controllable Threshold Voltage Modulation Window for Broadband Flexible Vision Systems

The development of large-scale integration of optoelectronic neuromorphic devices with ultralow power consumption and broadband responses is essential for high-performance bionics vision systems. In this work, we developed a strategy to construct large-scale (40 × 30) enhancement-mode carbon nanotube optoelectronic synaptic transistors with ultralow power consumption (33.9 aJ per pulse) and broadband responses (from 365 to 620 nm) using low-work function yttrium (Y)-gate electrodes and the mixture of eco-friendly photosensitive Ag2S quantum dots (QDs) and ionic liquids (ILs)-cross-linking-poly(4-vinylphenol) (PVP) (ILs-c-PVP) as the dielectric layers. Solution-processable carbon nanotube thin-film transistors (TFTs) showed enhancement-mode characteristics with the wide and controllable threshold voltage window (-1 V∼0 V) owing to use of the low-work-function Y-gate electrodes. It is noted that carbon nanotube optoelectronic synaptic transistors exhibited high on/off ratios (>106), small hysteresis and low operating voltage (≤2 V), and enhancement mode even under the illumination of ultraviolet (UV, 365 nm), blue (450 nm), and green (550 nm) to red (620 nm) pulse lights when introducing eco-friendly Ag2S QDs in dielectric layers, demonstrating that they have the strong fault-tolerant ability for the threshold voltage drifts caused by various manufacturing scenarios. Furthermore, some important bionic functions including a high paired pulse facilitation index (PPF index, up to 290%), learning and memory function with the long duration (200 s), and rapid recovery (2 s). Pavlov's dog experiment (retention time up to 20 min) and visual memory forgetting experiments (the duration of high current for 180 s) are also demonstrated. Significantly, the optoelectronic synaptic transistors can be used to simulate the adaptive process of vision in varying light conditions, and we demonstrated the dynamic transition of light adaptation to dark adaptation based on light-induced conditional behavior. This work undoubtedly provides valuable insights for the future development of artificial vision systems.

Pyroelectric Photoconductive Diode for Highly Sensitive and Fast DUV Detection

Detecting high-energy photons from the deep ultraviolet (DUV) to X-rays is vital in security, medicine, industry, and science. Wide bandgap (WBG) semiconductors exhibit great potential for detecting high-energy photons. However, the implementation of highly sensitive and high-speed detectors based on WBG semiconductors has been a huge challenge due to the inevitable deep level traps and the lack of appropriate device structure engineering. Here, a sensitive and fast pyroelectric photoconductive diode (PPD), which couples the interface pyroelectric effect with the photoconductive effect based on tailored polycrystal Ga-rich GaOx (PGR-GaOx) Schottky photodiode, is first proposed. The PPD device exhibits ultrahigh detection performance for DUV and X-ray light. The responsivity for DUV light and sensitivity for X-ray are up to 104 A W-1 and 105 µC Gyair -1 cm-2, respectively. Especially, the interface pyroelectric effect induced by polar symmetry in the depletion region of the PGR-GaOx can significantly improve the response speed of the device by 105 times. Furthermore, the potential of the device is demonstrated for imaging enhancement systems with low power consumption and high sensitivity. This work fully excavates the potential of the pyroelectric effect for detectors and provides a novel design strategy to achieve sensitive and high-speed detectors.

A Self-Oscillated Organic Synapse for In-Memory Two-Factor Authentication

Entering the era of AI 2.0, bio-inspired target recognition facilitates life. However, target recognition may suffer from some risks when the target is hijacked. Therefore, it is significantly important to provide an encryption process prior to neuromorphic computing. In this work, enlightened from time-varied synaptic rule, an in-memory asymmetric encryption as pre-authentication is utilized with subsequent convolutional neural network (ConvNet) for target recognition, achieving in-memory two-factor authentication (IM-2FA). The unipolar self-oscillated synaptic behavior is adopted to function as in-memory asymmetric encryption, which can greatly decrease the complexity of the peripheral circuit compared to bipolar stimulation. Results show that without passing the encryption process with suitable weights at the correct time, the ConvNet for target recognition will not work properly with an extremely low accuracy lower than 0.86%, thus effectively blocking out the potential risks of involuntary access. When a set of correct weights is evolved at a suitable time, a recognition rate as high as 99.82% can be implemented for target recognition, which verifies the effectiveness of the IM-2FA strategy.

Toward Intelligent Display with Neuromorphic Technology

In the era of the Internet and the Internet of Things, display technology has evolved significantly toward full-scene display and realistic display. Incorporating "intelligence" into displays is a crucial technical approach to meet the demands of this development. Traditional display technology relies on distributed hardware systems to achieve intelligent displays but encounters challenges stemming from the physical separation of sensing, processing, and light-emitting modules. The high energy consumption and data transformation delays limited the development of intelligence display, breaking the physical separation is crucial to overcoming the bottlenecks of intelligence display technology. Inspired by the biological neural system, neuromorphic technology with all-in-one features is widely employed across various fields. It proves effective in reducing system power consumption, facilitating frequent data transformation, and enabling cross-scene integration. Neuromorphic technology shows great potential to overcome display technology bottlenecks, realizing the full-scene display and realistic display with high efficiency and low power consumption. This review offers a comprehensive summary of recent advancements in the application of neuromorphic technology in displays, with a focus on interoperability. This work delves into its state-of-the-art designs and potential future developments aimed at revolutionizing display technology.

Reservoir Computing Based on Oxygen-Vacancy-Mediated X-ray Optical Synaptic Device for Medical CT Bone Diagnosis

Recognition and judgment of X-ray computed tomography (CT) images play a crucial role in medical diagnosis and disease prevention. However, the storage and calculation of the X-ray imaging system applied in the traditional CT diagnosis is separate, and the pathological judgment is based on doctors' experience, which will affect the timeliness and accuracy of decision-making. In this paper, a simple-structured reservoir computing network (RC) is proposed based on Ga2O3 X-ray optical synaptic devices to recognize medical skeletal CT images with high accuracy. Through oxygen vacancy engineering, Ga2O3 X-ray optical synaptic devices with adjustable photocurrent gain and a persistent photoconductivity effect were obtained. By using the Ga2O3 X-ray optical synaptic device as a reservoir, we constructed an RC network for medical skeletal CT diagnosis and verified its image recognition capability using the MNIST data set with an accuracy of 78.08%. In the elbow skeletal CT image recognition task, the recognition rate is as high as 100%. This work constructs a simple-structured RC network for X-ray image recognition, which is of great significance in applications in medical fields.

Reconfigurable Ag/HfO2/NiO/Pt Memristors with Stable Synchronous Synaptic and Neuronal Functions for Renewable Homogeneous Neuromorphic Computing System

Artificial synapses and bionic neurons offer great potential in highly efficient computing paradigms. However, complex requirements for specific electronic devices in neuromorphic computing have made memristors face the challenge of process simplification and universality. Herein, reconfigurable Ag/HfO2/NiO/Pt memristors are designed for feasible switching between volatile and nonvolatile modes by compliance current controlled Ag filaments, which enables stable and reconfigurable synaptic and neuronal functions. A neuromorphic computing system effectively replicates the biological synaptic weight alteration and continuously accomplishes excitation and reset of artificial neurons, which consist of bionic synapses and artificial neurons based on isotype Ag/HfO2/NiO/Pt memristors. This reconfigurable electrical performance of the Ag/HfO2/NiO/Pt memristors takes advantage of simplified hardware design and delivers integrated circuits with high density, which exhibits great potency for future neural networks.

Reconfigurable optoelectronic transistors for multimodal recognition

Biological nervous system outperforms in both dynamic and static information perception due to their capability to integrate the sensing, memory and processing functions. Reconfigurable neuromorphic transistors, which can be used to emulate different types of biological analogues in a single device, are important for creating compact and efficient neuromorphic computing networks, but their design remains challenging due to the need for opposing physical mechanisms to achieve different functions. Here we report a neuromorphic electrolyte-gated transistor that can be reconfigured to perform physical reservoir and synaptic functions. The device exhibits dynamics with tunable time-scales under optical and electrical stimuli. The nonlinear volatile property is suitable for reservoir computing, which can be used for multimodal pre-processing. The nonvolatility and programmability of the device through ion insertion/extraction achieved via electrolyte gating, which are required to realize synaptic functions, are verified. The device's superior performance in mimicking human perception of dynamic and static multisensory information based on the reconfigurable neuromorphic functions is also demonstrated. The present study provides an exciting paradigm for the realization of multimodal reconfigurable devices and opens an avenue for mimicking biological multisensory fusion.

CO2 Stress-Driven Room Temperature Ferromagnetism of Ultrathin 2D Gallium Oxide

Spintronic devices work by manipulating the spin of electrons other than charge transfer, which is of revolutionary significance and can largely reduce energy consumption in the future. Herein, ultrathin two-dimensional (2D) non-van der Waals (non-vdW) γ-Ga2O3 with room temperature ferromagnetism is successfully obtained by using supercritical CO2 (SC CO2). The stress effect of SC CO2 under different pressures selectively modulates the orientation and strength of covalent bonds, leading to the change of atomic structure including lattice expansion, introduction of O vacancy, and transition of Ga-O coordination (GaO4 and GaO6). Magnetic measurements show that pristine γ-Ga2O3 is nonferromagnetic, whereas the SC CO2 treated γ-Ga2O3 exhibits obvious ferromagnetic behavior with an optimal magnetization of 0.025 emu g-1 and a Curie temperature of 300 K.

Task-Adaptive Neuromorphic Computing Using Reconfigurable Organic Neuristors with Tunable Plasticity and Logic-in-Memory Operations

The brain's function can be dynamically reconfigured through a unified neuron-synapse architecture, enabling task-adaptive network-level topology for energy-efficient learning and inferencing. Here, we demonstrate an organic neuristor utilizing a ferroelectric-electrolyte dielectric interface. This neuristor enables tunable short- to long-term plasticity and reconfigurable logic-in-memory functions by controlling the interfacial interaction between electrolyte ions and ferroelectric dipoles. Notably, the short-term plasticity of the organic neuristor allows for power-efficient reservoir computing in edge-computing scenarios, exhibiting impressive recognition accuracy, including images (90.6%) and acoustic signals (97.7%). For high-performance computing tasks, the neuristor based on long-term plasticity and logic-in-memory operations can construct all of the hardware circuits of a binarized neural network (BNN) within a unified framework. The BNN demonstrates excellent noise tolerance, achieving high recognition accuracies of 99.2% and 86.4% on the MNIST and CIFAR-10 data sets, respectively. Consequently, our research sheds light on the development of power-efficient artificial intelligence systems.

Technology and Integration Roadmap for Optoelectronic Memristor

Optoelectronic memristors (OMs) have emerged as a promising optoelectronic Neuromorphic computing paradigm, opening up new opportunities for neurosynaptic devices and optoelectronic systems. These OMs possess a range of desirable features including minimal crosstalk, high bandwidth, low power consumption, zero latency, and the ability to replicate crucial neurological functions such as vision and optical memory. By incorporating large-scale parallel synaptic structures, OMs are anticipated to greatly enhance high-performance and low-power in-memory computing, effectively overcoming the limitations of the von Neumann bottleneck. However, progress in this field necessitates a comprehensive understanding of suitable structures and techniques for integrating low-dimensional materials into optoelectronic integrated circuit platforms. This review aims to offer a comprehensive overview of the fundamental performance, mechanisms, design of structures, applications, and integration roadmap of optoelectronic synaptic memristors. By establishing connections between materials, multilayer optoelectronic memristor units, and monolithic optoelectronic integrated circuits, this review seeks to provide insights into emerging technologies and future prospects that are expected to drive innovation and widespread adoption in the near future.

Toward a Brain-Neuromorphics Interface

Brain-computer interfaces (BCIs) that enable human-machine interaction have immense potential in restoring or augmenting human capabilities. Traditional BCIs are realized based on complementary metal-oxide-semiconductor (CMOS) technologies with complex, bulky, and low biocompatible circuits, and suffer with the low energy efficiency of the von Neumann architecture. The brain-neuromorphics interface (BNI) would offer a promising solution to advance the BCI technologies and shape the interactions with machineries. Neuromorphic devices and systems are able to provide substantial computation power with extremely high energy-efficiency by implementing in-materia computing such as in situ vector-matrix multiplication (VMM) and physical reservoir computing. Recent progresses on integrating neuromorphic components with sensing and/or actuating modules, give birth to the neuromorphic afferent nerve, efferent nerve, sensorimotor loop, and so on, which has advanced the technologies for future neurorobotics by achieving sophisticated sensorimotor capabilities as the biological system. With the development on the compact artificial spiking neuron and bioelectronic interfaces, the seamless communication between a BNI and a bioentity is reasonably expectable. In this review, the upcoming BNIs are profiled by introducing the brief history of neuromorphics, reviewing the recent progresses on related areas, and discussing the future advances and challenges that lie ahead.

An Infrared Near-Sensor Reservoir Computing System Based on Large-Dynamic-Space Memristor with Tens of Thousands of States for Dynamic Gesture Perception

To efficiently process the massive amount of sensor data, it is demanding to develop a new paradigm. Inspired by neurobiological systems, an infrared near-senor reservoir computing (RC) system, consisting of infrared sensors and memristors based on single-crystalline LiTaO3 and LiNbO3 (LN) thin film respectively, is demonstrated. The analog memristor is used as a reservoir in the RC system to process sensor signals with spatiotemporal characteristics. LN crystal structure stacked with oxygen octahedra provides favorable conditions for reliable Mott variable-range hopping conduction, which provides the memristor with tens of thousands of reservoir states within a large dynamic range. With the characteristics, the analog sensor signals with high data fidelity can be directly fed to the memristive reservoir, and the spatiotemporal features can be separated and mapped. The system demonstrated a dynamic gesture perception task, achieving an accuracy of 99.6%, which highlights the great application potential of the memristor in signal sensor processing and will advance the application of artificial intelligence in sensor systems. Crystal ion slicing techniques are used to fabricate a single-crystalline thin film for both the memristor and sensor, which opens up the possibility of realizing monolithic integration of a memristor-based near-sensor computing system.

Hierarchies in Visual Pathway: Functions and Inspired Artificial Vision

The development of artificial intelligence has posed a challenge to machine vision based on conventional complementary metal-oxide semiconductor (CMOS) circuits owing to its high latency and inefficient power consumption originating from the data shuffling between memory and computation units. Gaining more insights into the function of every part of the visual pathway for visual perception can bring the capabilities of machine vision in terms of robustness and generality. Hardware acceleration of more energy-efficient and biorealistic artificial vision highly necessitates neuromorphic devices and circuits that are able to mimic the function of each part of the visual pathway. In this paper, we review the structure and function of the entire class of visual neurons from the retina to the primate visual cortex within reach (Chapter 2) are reviewed. Based on the extraction of biological principles, the recent hardware-implemented visual neurons located in different parts of the visual pathway are discussed in detail in Chapters 3 and 4. Furthermore, valuable applications of inspired artificial vision in different scenarios (Chapter 5) are provided. The functional description of the visual pathway and its inspired neuromorphic devices/circuits are expected to provide valuable insights for the design of next-generation artificial visual perception systems.

Toward grouped-reservoir computing: organic neuromorphic vertical transistor with distributed reservoir states for efficient recognition and prediction

Reservoir computing has attracted considerable attention due to its low training cost. However, existing neuromorphic hardware, focusing mainly on shallow-reservoir computing, faces challenges in providing adequate spatial and temporal scales characteristic for effective computing. Here, we report an ultra-short channel organic neuromorphic vertical transistor with distributed reservoir states. The carrier dynamics used to map signals are enriched by coupled multivariate physics mechanisms, while the vertical architecture employed greatly increases the feedback intensity of the device. Consequently, the device as a reservoir, effectively mapping sequential signals into distributed reservoir state space with 1152 reservoir states, and the range ratio of temporal and spatial characteristics can simultaneously reach 2640 and 650, respectively. The grouped-reservoir computing based on the device can simultaneously adapt to different spatiotemporal task, achieving recognition accuracy over 94% and prediction correlation over 95%. This work proposes a new strategy for developing high-performance reservoir computing networks.

Ga2O3 Bipolar Heterojunction-Based Optoelectronic Synapse Array with Visual Attention

The human brain efficiently processes only a fraction of visual information, a phenomenon termed attentional control, resulting in energy savings and heightened adaptability. Translating this mechanism into artificial visual neurons holds promise for constructing energy-efficient, bioinspired visual systems. Here, we propose a self-rectifying artificial visual neuron (SEVN) based on a NiO/Ga2O3 bipolar heterojunction with attentional control on patterns with a target color. The device exhibits short-term potentiation (STP) with quantum point contact (QPC) traits at low bias and transitions to long-term potentiation (LTP) at high bias, particularly facilitated by electron capture in deep defects upon ultraviolet (UV) exposure. With the utilization of two wavelengths of light upon the target and interference part of CAPTCHA to simulate top-down attentional control, the recognition accuracy is enhanced from 74 to 84%. These findings have the potential to augment the visual capability of neuromorphic systems with implications for diverse applications, including cybersecurity, healthcare, and machine vision.

Unveiling intra-person fingerprint similarity via deep contrastive learning

Fingerprint biometrics are integral to digital authentication and forensic science. However, they are based on the unproven assumption that no two fingerprints, even from different fingers of the same person, are alike. This renders them useless in scenarios where the presented fingerprints are from different fingers than those on record. Contrary to this prevailing assumption, we show above 99.99% confidence that fingerprints from different fingers of the same person share very strong similarities. Using deep twin neural networks to extract fingerprint representation vectors, we find that these similarities hold across all pairs of fingers within the same person, even when controlling for spurious factors like sensor modality. We also find evidence that ridge orientation, especially near the fingerprint center, explains a substantial part of this similarity, whereas minutiae used in traditional methods are almost nonpredictive. Our experiments suggest that, in some situations, this relationship can increase forensic investigation efficiency by almost two orders of magnitude.

Energy-Efficient ReS2-Based Optoelectronic Synapse for 3D Object Reconstruction and Recognition

The neuromorphic vision system (NVS) equipped with optoelectronic synapses integrates perception, storage, and processing and is expected to address the issues of traditional machine vision. However, owing to their lack of stereo vision, existing NVSs focus on 2D image processing, which makes it difficult to solve problems such as spatial cognition errors and low-precision interpretation. Consequently, inspired by the human visual system, an NVS with stereo vision is developed to achieve 3D object recognition, depending on the prepared ReS2 optoelectronic synapse with 12.12 fJ ultralow power consumption. This device exhibits excellent optical synaptic plasticity derived from the persistent photoconductivity effect. As the cornerstone for 3D vision, color planar information is successfully discriminated and stored in situ at the sensor end, benefiting from its wavelength-dependent plasticity in the visible region. Importantly, the dependence of the channel conductance on the target distance is experimentally revealed, implying that the structure information on the object can be directly captured and stored by the synapse. The 3D image of the object is successfully reconstructed via fusion of its planar and depth images. Therefore, the proposed 3D-NVS based on ReS2 synapses for 3D objects achieves a recognition accuracy of 97.0%, which is much higher than that for 2D objects (32.6%), demonstrating its strong ability to prevent 2D-photo spoofing in applications such as face payment, entrance guard systems, and others.

On-chip phonon-magnon reservoir for neuromorphic computing

Reservoir computing is a concept involving mapping signals onto a high-dimensional phase space of a dynamical system called "reservoir" for subsequent recognition by an artificial neural network. We implement this concept in a nanodevice consisting of a sandwich of a semiconductor phonon waveguide and a patterned ferromagnetic layer. A pulsed write-laser encodes input signals into propagating phonon wavepackets, interacting with ferromagnetic magnons. The second laser reads the output signal reflecting a phase-sensitive mix of phonon and magnon modes, whose content is highly sensitive to the write- and read-laser positions. The reservoir efficiently separates the visual shapes drawn by the write-laser beam on the nanodevice surface in an area with a size comparable to a single pixel of a modern digital camera. Our finding suggests the phonon-magnon interaction as a promising hardware basis for realizing on-chip reservoir computing in future neuromorphic architectures.

Multifunctional Eu(III)-modified HOFs: roxarsone and aristolochic acid carcinogen monitoring and latent fingerprint identification based on artificial intelligence

The exploration of multifunctional materials and intelligent technologies used for fluorescence sensing and latent fingerprint (LFP) identification is a research hotspot of material science. In this study, an emerging crystalline luminescent material, Eu3+-functionalized hydrogen-bonded organic framework (Eu@HOF-BTB, Eu@1), is fabricated successfully. Eu@1 can emit purple red fluorescence with a high photoluminescence quantum yield of 36.82%. Combined with artificial intelligence (AI) algorithms including support vector machine, principal component analysis, and hierarchical clustering analysis, Eu@1 as a sensor can concurrently distinguish two carcinogens, roxarsone and aristolochic acid, based on different mechanisms. The sensing process exhibits high selectivity, high efficiency, and excellent anti-interference. Meanwhile, Eu@1 is also an excellent eikonogen for LFP identification with high-resolution and high-contrast. Based on an automatic fingerprint identification system, the simultaneous differentiation of two fingerprint images is achieved. Moreover, a simulation experiment of criminal arrest is conducted. By virtue of the Alexnet-based fingerprint analysis platform of AI, unknown LFPs can be compared with a database to identify the criminal within one second with over 90% recognition accuracy. With AI technology, HOFs are applied for the first time in the LFP identification field, which provides a new material and solution for investigators to track criminal clues and handle cases efficiently.

Resistive switching transparent SnO2 thin film sensitive to light and humidity

Designing and manufacturing memristor devices with simple and less complicated methods is highly promising for their future development. Here, an Ag/SnO2/FTO(F-SnO2) structure is used through the deposition of the SnO2 layer attained by its sol via the air-brush method on an FTO substrate. This structure was investigated in terms of the memristive characteristics. The negative differential resistance (NDR) effect was observed in environment humidity conditions. In this structure, valance change memory and electrometalization change memory mechanisms cause the current peak in the NDR region by forming an OH- conductive filament. In addition, the photoconductivity effect was found under light illumination and this structure shows the positive photoconductance effect by increasing the conductivity. Memristivity was examined for up to 100 cycles and significant stability was observed as a valuable advantage for neuromorphic computing. Our study conveys a growth mechanism of an optical memristor that is sensitive to light and humidity suitable for sensing applications.

Retina-inspired organic neuromorphic vision sensor with polarity modulation for decoding light information

The neuromorphic vision sensor (NeuVS), which is based on organic field-effect transistors (OFETs), uses polar functional groups (PFGs) in polymer dielectrics as interfacial units to control charge carriers. However, the mechanism of modulating charge transport on basis of PFGs in devices is unclear. Here, the carboxyl group is introduced into polymer dielectrics in this study, and it can induce the charge transfer process at the semiconductor/dielectric interfaces for effective carrier transport, giving rise to the best device mobility up to 20 cm2 V-1 s-1 at a low operating voltage of -1 V. Furthermore, the polarity modulation effect could further increase the optical figures of merit in NeuVS devices by at least an order of magnitude more than the devices using carboxyl group-free polymer dielectrics. Additionally, devices containing carboxyl groups improved image sensing for light information decoding with 52 grayscale signals and memory capabilities at an incredibly low power consumption of 1.25 fJ/spike. Our findings provide insight into the production of high-performance polymer dielectrics for NeuVS devices.

Interface-type tunable oxygen ion dynamics for physical reservoir computing

Reservoir computing can more efficiently be used to solve time-dependent tasks than conventional feedforward network owing to various advantages, such as easy training and low hardware overhead. Physical reservoirs that contain intrinsic nonlinear dynamic processes could serve as next-generation dynamic computing systems. High-efficiency reservoir systems require nonlinear and dynamic responses to distinguish time-series input data. Herein, an interface-type dynamic transistor gated by an Hf0.5Zr0.5O2 (HZO) film was introduced to perform reservoir computing. The channel conductance of Mott material La0.67Sr0.33MnO3 (LSMO) can effectively be modulated by taking advantage of the unique coupled property of the polarization process and oxygen migration in hafnium-based ferroelectrics. The large positive value of the oxygen vacancy formation energy and negative value of the oxygen affinity energy resulted in the spontaneous migration of accumulated oxygen ions in the HZO films to the channel, leading to the dynamic relaxation process. The modulation of the channel conductance was found to be closely related to the current state, identified as the origin of the nonlinear response. In the time series recognition and prediction tasks, the proposed reservoir system showed an extremely low decision-making error. This work provides a promising pathway for exploiting dynamic ion systems for high-performance neural network devices.

In-Sensor Computing Realization Using Fully CMOS-Compatible TiN/HfOx-Based Neuristor Array

With the evolution of artificial intelligence, the explosive growth of data from sensory terminals gives rise to severe energy-efficiency bottleneck issues due to cumbersome data interactions among sensory, memory, and computing modules. Heterogeneous integration methods such as chiplet technology can significantly reduce unnecessary data movement; however, they fail to address the fundamental issue of the substantial time and energy overheads resulting from the physical separation of computing and sensory components. Brain-inspired in-sensor neuromorphic computing (ISNC) has plenty of room for such data-intensive applications. However, one key obstacle in developing ISNC systems is the lack of compatibility between material systems and manufacturing processes deployed in sensors and computing units. This study successfully addresses this challenge by implementing fully CMOS-compatible TiN/HfOx-based neuristor array. The developed ISNC system demonstrates several advantageous features, including multilevel analogue modulation, minimal dispersion, and no significant degradation in conductance (@125 °C). These characteristics enable stable and reproducible neuromorphic computing. Additionally, the device exhibits modulatable sensory and multi-store memory processes. Furthermore, the system achieves information recognition with a high accuracy rate of 93%, along with frequency selectivity and notable activity-dependent plasticity. This work provides a promising route to affordable and highly efficient sensory neuromorphic systems.

Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction

Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardware implementation of a neuro-inspired vision system also requires the fulfilment of detecting and recognizing moving targets. Here, we demonstrated a neuro-inspired optical sensor based on two-dimensional NbS2/MoS2 hybrid films, which featured remarkable photo-induced conductance plasticity and low electrical energy consumption. A neuro-inspired optical sensor array with 10 × 10 NbS2/MoS2 phototransistors enabled highly integrated functions of sensing, memory, and contrast enhancement capabilities for static images, which benefits convolutional neural network (CNN) with a high image recognition accuracy. More importantly, in-sensor trajectory registration of moving light spots was experimentally implemented such that the post-processing could yield a high restoration accuracy. Our neuro-inspired optical sensor array could provide a fascinating platform for the implementation of high-performance artificial vision systems.

All-Optical Data Processing with Photon-Avalanching Nanocrystalline Photonic Synapse

Data processing and storage in electronic devices are typically performed as a sequence of elementary binary operations. Alternative approaches, such as neuromorphic or reservoir computing, are rapidly gaining interest where data processing is relatively slow, but can be performed in a more comprehensive way or massively in parallel, like in neuronal circuits. Here, time-domain all-optical information processing capabilities of photon-avalanching (PA) nanoparticles at room temperature are discovered. Demonstrated functionality resembles properties found in neuronal synapses, such as: paired-pulse facilitation and short-term internal memory, in situ plasticity, multiple inputs processing, and all-or-nothing threshold response. The PA-memory-like behavior shows capability of machine-learning-algorithm-free feature extraction and further recognition of 2D patterns with simple 2 input artificial neural network. Additionally, high nonlinearity of luminescence intensity in response to photoexcitation mimics and enhances spike-timing-dependent plasticity that is coherent in nature with the way a sound source is localized in animal neuronal circuits. Not only are yet unexplored fundamental properties of photon-avalanche luminescence kinetics studied, but this approach, combined with recent achievements in photonics, light confinement and guiding, promises all-optical data processing, control, adaptive responsivity, and storage on photonic chips.

Broadband sensory networks with locally stored responsivities for neuromorphic machine vision

As the most promising candidates for the implementation of in-sensor computing, retinomorphic vision sensors can constitute built-in neural networks and directly implement multiply-and-accumulation operations using responsivities as the weights. However, existing retinomorphic vision sensors mainly use a sustained gate bias to maintain the responsivity due to its volatile nature. Here, we propose an ion-induced localized-field strategy to develop retinomorphic vision sensors with nonvolatile tunable responsivity in both positive and negative regimes and construct a broadband and reconfigurable sensory network with locally stored weights to implement in-sensor convolutional processing in spectral range of 400 to 1800 nanometers. In addition to in-sensor computing, this retinomorphic device can implement in-memory computing benefiting from the nonvolatile tunable conductance, and a complete neuromorphic visual system involving front-end in-sensor computing and back-end in-memory computing architectures has been constructed, executing supervised and unsupervised learning tasks as demonstrations. This work paves the way for the development of high-speed and low-power neuromorphic machine vision for time-critical and data-intensive applications.

Emerging Iontronic Neural Devices for Neuromorphic Sensory Computing

Living organisms have a very mysterious and powerful sensory computing system based on ion activity. Interestingly, studies on iontronic devices in the past few years have proposed a promising platform for simulating the sensing and computing functions of living organisms, because: 1) iontronic devices can generate, store, and transmit a variety of signals by adjusting the concentration and spatiotemporal distribution of ions, which analogs to how the brain performs intelligent functions by alternating ion flux and polarization; 2) through ionic-electronic coupling, iontronic devices can bridge the biosystem with electronics and offer profound implications for soft electronics; 3) with the diversity of ions, iontronic devices can be designed to recognize specific ions or molecules by customizing the charge selectivity, and the ionic conductivity and capacitance can be adjusted to respond to external stimuli for a variety of sensing schemes, which can be more difficult for electron-based devices. This review provides a comprehensive overview of emerging neuromorphic sensory computing by iontronic devices, highlighting representative concepts of both low-level and high-level sensory computing and introducing important material and device breakthroughs. Moreover, iontronic devices as a means of neuromorphic sensing and computing are discussed regarding the pending challenges and future directions.

A Review of Fingerprint Sensors: Mechanism, Characteristics, and Applications

Identification technology based on biometrics is a branch of research that employs the unique individual traits of humans to authenticate identity, which is the most secure method of identification based on its exceptional high dependability and stability of human biometrics. Common biometric identifiers include fingerprints, irises, and facial sounds, among others. In the realm of biometric recognition, fingerprint recognition has gained success with its convenient operation and fast identif ication speed. Different fingerprint collecting techniques, which supply fingerprint information for fingerprint identification systems, have attracted a significant deal of interest in authentication technology regarding fingerprint identification systems. This work presents several fingerprint acquisition techniques, such as optical capacitive and ultrasonic, and analyzes acquisition types and structures. In addition, the pros and drawbacks of various sensor types, as well as the limits and benefits of optical, capacitive, and ultrasonic kinds, are discussed. It is the necessary stage for the application of the Internet of Things (IoT).

Vertically integrated spiking cone photoreceptor arrays for color perception

The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose a metal oxide-based vertically integrated spiking cone photoreceptor array, which can directly transduce persistent lights into spike trains at a certain rate according to the input wavelengths. Such spiking cone photoreceptors have an ultralow power consumption of less than 400 picowatts per spike in visible light, which is very close to biological cones. In this work, lights with three wavelengths were exploited as pseudo-three-primary colors to form 'colorful' images for recognition tasks, and the device with the ability to discriminate mixed colors shows better accuracy. Our results would enable hardware spiking neural networks with biologically plausible visual perception and provide great potential for the development of dynamic vision sensors.

Short-term synaptic plasticity in emerging devices for neuromorphic computing

Neuromorphic computing is a promising computing paradigm toward building next-generation artificial intelligence machines, in which diverse types of synaptic plasticity play an active role in information processing. Compared to long-term plasticity (LTP) forming the foundation of learning and memory, short-term plasticity (STP) is essential for critical computational functions. So far, the practical applications of LTP have been widely investigated, whereas the implementation of STP in hardware is still elusive. Here, we review the development of STP by bridging the physics in emerging devices and biological behaviors. We explore the computational functions of various STP in biology and review their recent progress. Finally, we discuss the main challenges of introducing STP into synaptic devices and offer the potential approaches to utilize STP to enrich systems' capabilities. This review is expected to provide prospective ideas for implementing STP in emerging devices and may promote the construction of high-level neuromorphic machines.