1
|
Choi H, Baek S, Jung H, Kang T, Lee S, Jeon J, Jang BC, Lee S. Spiking Neural Network Integrated with Impact Ionization Field-Effect Transistor Neuron and a Ferroelectric Field-Effect Transistor Synapse. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024:e2406970. [PMID: 39233555 DOI: 10.1002/adma.202406970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Revised: 08/02/2024] [Indexed: 09/06/2024]
Abstract
The integration of artificial spiking neurons based on steep-switching logic devices and artificial synapses with neuromorphic functions enables an energy-efficient computer architecture that mimics the human brain well, known as a spiking neural network (SNN). 2D materials with impact ionization or ferroelectric characteristics have the potential for use in such devices. However, research on 2D spiking neurons remains limited and investigations of 2D artificial synapses far more common. An innovative 2D spiking neuron is implemented using a WSe2 impact ionization transistor (I2FET), while a spiking neural network is formed by combining it with a 2D ferroelectric synaptic device (FeFET). The suggested 2D spiking neuron demonstrates precise spiking behavior that closely resembles that of actual neurons. In addition, it achieves a low energy consumption of 2 pJ/spike. The better impact ionization properties of WSe2 are responsible for this efficiency. Furthermore, an all-2D SNN consisting of 2D I2FET neurons and 2D FeFET synapses is constructed, which achieves high accuracy of 87.5% in a face classification task by unsupervised learning. The integration of a 2D SNN with 2D steep-switching spiking neuronal devices and 2D synaptic devices shows great potential for the development of neuromorphic systems with improved energy efficiency and computational capabilities.
Collapse
Affiliation(s)
- Haeju Choi
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon, 16419, South Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Sungpyo Baek
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon, 16419, South Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Hanggyo Jung
- Department of Semiconductor Convergence Engineering, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Taeho Kang
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon, 16419, South Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Sangmin Lee
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon, 16419, South Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Jongwook Jeon
- School of Electronic and Electrical Engineering, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Byung Chul Jang
- School of Electronic and Electrical Engineering, Kyungpook National University, Daegu, 41566, South Korea
| | - Sungjoo Lee
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon, 16419, South Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon, 16419, South Korea
- Department of Nano Engineering, Sungkyunkwan University, Suwon, 16419, South Korea
| |
Collapse
|
2
|
Hu L, Li Z, Shao J, Cheng P, Wang J, Vasilakos AV, Zhang L, Chai Y, Ye Z, Zhuge F. Electronically Reconfigurable Memristive Neuron Capable of Operating in Both Excitation and Inhibition Modes. NANO LETTERS 2024; 24:10865-10873. [PMID: 39142648 PMCID: PMC11378334 DOI: 10.1021/acs.nanolett.4c02470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/16/2024]
Abstract
Threshold switching (TS) memristors are promising candidates for artificial neurons in neuromorphic systems. However, they often lack biological plausibility, typically functioning solely in an excitation mode. The absence of an inhibitory mode limits neurons' ability to synergistically process both excitatory and inhibitory synaptic signals. To address this limitation, we propose a novel memristive neuron capable of operating in both excitation and inhibition modes. The memristor's threshold voltage can be reversibly tuned using voltages of different polarities because of its bipolar TS behavior, enabling the device to function as an electronically reconfigurable bi-mode neuron. A variety of neuronal activities such as all-or-nothing behavior and tunable firing probability are mimicked under both excitatory and inhibitory stimuli. Furthermore, we develop a self-adaptive neuromorphic vision sensor based on bi-mode neurons, demonstrating effective object recognition in varied lighting conditions. Thus, our bi-mode neuron offers a versatile platform for constructing neuromorphic systems with rich functionality.
Collapse
Affiliation(s)
- Lingxiang Hu
- Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
| | - Zongxiao Li
- Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
| | - Jiale Shao
- Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
| | - Peihong Cheng
- Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
- School of Electronic and Information Engineering, Ningbo University of Technology, Ningbo 315211, China
| | - Jingrui Wang
- Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
- School of Electronic and Information Engineering, Ningbo University of Technology, Ningbo 315211, China
| | | | - Li Zhang
- Healthcare Engineering Centre, School of Engineering, Temasek Polytechnic, Tampines Avenue, 529757, Singapore
| | - Yang Chai
- Department of Applied Physics, The Hong Kong Polytechnic University, Hong Kong 999077, China
| | - Zhizhen Ye
- Institute of Wenzhou, Zhejiang University, Wenzhou 325006, China
- State Key Laboratory of Silicon and Advanced Semiconductor Materials, School of Materials Science and Engineering, Zhejiang University, Hangzhou 310027, China
| | - Fei Zhuge
- Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
- Institute of Wenzhou, Zhejiang University, Wenzhou 325006, China
- Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200072, China
| |
Collapse
|
3
|
Li Z, Li Z, Tang W, Yao J, Dou Z, Gong J, Li Y, Zhang B, Dong Y, Xia J, Sun L, Jiang P, Cao X, Yang R, Miao X, Yang R. Crossmodal sensory neurons based on high-performance flexible memristors for human-machine in-sensor computing system. Nat Commun 2024; 15:7275. [PMID: 39179548 PMCID: PMC11344147 DOI: 10.1038/s41467-024-51609-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Accepted: 08/13/2024] [Indexed: 08/26/2024] Open
Abstract
Constructing crossmodal in-sensor processing system based on high-performance flexible devices is of great significance for the development of wearable human-machine interfaces. A bio-inspired crossmodal in-sensor computing system can perform real-time energy-efficient processing of multimodal signals, alleviating data conversion and transmission between different modules in conventional chips. Here, we report a bio-inspired crossmodal spiking sensory neuron (CSSN) based on a flexible VO2 memristor, and demonstrate a crossmodal in-sensor encoding and computing system for wearable human-machine interfaces. We demonstrate excellent performance in the VO2 memristor including endurance (>1012), uniformity (0.72% for cycle-to-cycle variations and 3.73% for device-to-device variations), speed (<30 ns), and flexibility (bendable to a curvature radius of 1 mm). A flexible hardware processing system is implemented based on the CSSN, which can directly perceive and encode pressure and temperature bimodal information into spikes, and then enables the real-time haptic-feedback for human-machine interaction. We successfully construct a crossmodal in-sensor spiking reservoir computing system via the CSSNs, which can achieve dynamic objects identification with a high accuracy of 98.1% and real-time signal feedback. This work provides a feasible approach for constructing flexible bio-inspired crossmodal in-sensor computing systems for wearable human-machine interfaces.
Collapse
Affiliation(s)
- Zhiyuan Li
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| | - Zhongshao Li
- State Key Laboratory of High Performance Ceramics and Superfine Microstructure, Shanghai Institute of Ceramics, Chinese Academy of Sciences, Shanghai, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, China
| | - Wei Tang
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
| | - Jiaping Yao
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
| | - Zhipeng Dou
- State Key Laboratory of Catalysis, CAS Center for Excellence in Nanoscience, Dalian Institute of Chemical Physics, Chinese Academy of Sciences, Dalian, China
| | - Junjie Gong
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
| | - Yongfei Li
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
| | - Beining Zhang
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
| | - Yunxiao Dong
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
| | - Jian Xia
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China
| | - Lin Sun
- State Key Laboratory of Catalysis, CAS Center for Excellence in Nanoscience, Dalian Institute of Chemical Physics, Chinese Academy of Sciences, Dalian, China
| | - Peng Jiang
- State Key Laboratory of Catalysis, CAS Center for Excellence in Nanoscience, Dalian Institute of Chemical Physics, Chinese Academy of Sciences, Dalian, China
| | - Xun Cao
- State Key Laboratory of High Performance Ceramics and Superfine Microstructure, Shanghai Institute of Ceramics, Chinese Academy of Sciences, Shanghai, China.
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, China.
| | - Rui Yang
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China.
- Hubei Yangtze Memory Laboratories, Wuhan, China.
| | - Xiangshui Miao
- School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan, China.
- Hubei Yangtze Memory Laboratories, Wuhan, China.
| | - Ronggui Yang
- State Key Laboratory of Coal Combustion, School of Energy and Power Engineering, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
4
|
Zhang Y, Zhang W, Wang S, Lin N, Yu Y, He Y, Wang B, Jiang H, Lin P, Xu X, Qi X, Wang Z, Zhang X, Shang D, Liu Q, Cheng KT, Liu M. Semantic memory-based dynamic neural network using memristive ternary CIM and CAM for 2D and 3D vision. SCIENCE ADVANCES 2024; 10:eado1058. [PMID: 39141720 PMCID: PMC11323881 DOI: 10.1126/sciadv.ado1058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Accepted: 07/08/2024] [Indexed: 08/16/2024]
Abstract
The brain is dynamic, associative, and efficient. It reconfigures by associating the inputs with past experiences, with fused memory and processing. In contrast, AI models are static, unable to associate inputs with past experiences, and run on digital computers with physically separated memory and processing. We propose a hardware-software co-design, a semantic memory-based dynamic neural network using a memristor. The network associates incoming data with the past experience stored as semantic vectors. The network and the semantic memory are physically implemented on noise-robust ternary memristor-based computing-in-memory (CIM) and content-addressable memory (CAM) circuits, respectively. We validate our co-designs, using a 40-nm memristor macro, on ResNet and PointNet++ for classifying images and three-dimensional points from the MNIST and ModelNet datasets, which achieves not only accuracy on par with software but also a 48.1 and 15.9% reduction in computational budget. Moreover, it delivers a 77.6 and 93.3% reduction in energy consumption.
Collapse
Affiliation(s)
- Yue Zhang
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Institute of the Mind, the University of Hong Kong, Hong Kong, China
| | - Woyu Zhang
- Key Laboratory of Microelectronic Devices and Integrated Technology, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100049, China
- Key Lab of Fabrication Technologies for Integrated Circuits, Chinese Academy of Sciences, Beijing 100049, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Shaocong Wang
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Institute of the Mind, the University of Hong Kong, Hong Kong, China
| | - Ning Lin
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Institute of the Mind, the University of Hong Kong, Hong Kong, China
| | - Yifei Yu
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Institute of the Mind, the University of Hong Kong, Hong Kong, China
| | - Yangu He
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Institute of the Mind, the University of Hong Kong, Hong Kong, China
| | - Bo Wang
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Institute of the Mind, the University of Hong Kong, Hong Kong, China
| | - Hao Jiang
- State Key Laboratory of Integrated Chips and Systems, Frontier Institute of Chip and System, Fudan University, Shanghai 200433, China
| | - Peng Lin
- College of Computer Science and Technology, Zhejiang University, Zhejiang 310027, China
| | - Xiaoxin Xu
- Key Laboratory of Microelectronic Devices and Integrated Technology, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100049, China
- Key Lab of Fabrication Technologies for Integrated Circuits, Chinese Academy of Sciences, Beijing 100049, China
| | - Xiaojuan Qi
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
| | - Zhongrui Wang
- Department of Electrical and Electronic Engineering, the University of Hong Kong, Hong Kong, China
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Institute of the Mind, the University of Hong Kong, Hong Kong, China
| | - Xumeng Zhang
- State Key Laboratory of Integrated Chips and Systems, Frontier Institute of Chip and System, Fudan University, Shanghai 200433, China
| | - Dashan Shang
- Key Laboratory of Microelectronic Devices and Integrated Technology, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100049, China
- Key Lab of Fabrication Technologies for Integrated Circuits, Chinese Academy of Sciences, Beijing 100049, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Qi Liu
- Key Laboratory of Microelectronic Devices and Integrated Technology, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100049, China
- State Key Laboratory of Integrated Chips and Systems, Frontier Institute of Chip and System, Fudan University, Shanghai 200433, China
| | - Kwang-Ting Cheng
- ACCESS - AI Chip Center for Emerging Smart Systems, InnoHK Centers, Hong Kong Science Park, Hong Kong, China
- Department of Electronic and Computer Engineering, the Hong Kong University of Science and Technology, Hong Kong, China
| | - Ming Liu
- Key Laboratory of Microelectronic Devices and Integrated Technology, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100049, China
- State Key Laboratory of Integrated Chips and Systems, Frontier Institute of Chip and System, Fudan University, Shanghai 200433, China
| |
Collapse
|
5
|
Lim JG, Park SJ, Lee SM, Jeong Y, Kim J, Lee S, Park J, Hwang GW, Lee KS, Park S, Jang HJ, Ju BK, Park JK, Kim I. Hybrid CMOS-Memristor synapse circuits for implementing Ca ion-based plasticity model. Sci Rep 2024; 14:17915. [PMID: 39095461 PMCID: PMC11297293 DOI: 10.1038/s41598-024-68359-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Accepted: 07/23/2024] [Indexed: 08/04/2024] Open
Abstract
Neuromorphic computing research is being actively pursued to address the challenges posed by the need for energy-efficient processing of big data. One of the promising approaches to tackle the challenges is the hardware implementation of spiking neural networks (SNNs) with bio-plausible learning rules. Numerous research works have been done to implement the SNN hardware with different synaptic plasticity rules to emulate human brain operations. While a standard spike-timing-dependent-plasticity (STDP) rule is emulated in many SNN hardware, the various STDP rules found in the biological brain have rarely been implemented in hardware. This study proposes a CMOS-memristor hybrid synapse circuit for the hardware implementation of a Ca ion-based plasticity model to emulate the various STDP curves. The memristor was adopted as a memory device in the CMOS synapse circuit because memristors have been identified as promising candidates for analog non-volatile memory devices in terms of energy efficiency and scalability. The circuit design was divided into four sub-blocks based on biological behavior, exploiting the non-volatile and analog state properties of memristors. The circuit was designed to vary weights using an H-bridge circuit structure and PWM modulation. The various STDP curves have been emulated in one CMOS-memristor hybrid circuit, and furthermore a simple neural network operation was demonstrated for associative learning such as Pavlovian conditioning. The proposed circuit is expected to facilitate large-scale operations for neuromorphic computing through its scale-up.
Collapse
Affiliation(s)
- Jae Gwang Lim
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
- School of Electrical Engineering, Korea University, Seoul, 02841, South Korea
| | - Sung-Jae Park
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
- Department of Micro/Nano Systems, Korea University, Seoul, 02841, South Korea
| | - Sang Min Lee
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
- Department of Micro/Nano Systems, Korea University, Seoul, 02841, South Korea
| | - Yeonjoo Jeong
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Jaewook Kim
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Suyoun Lee
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Jongkil Park
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Gyu Weon Hwang
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Kyeong-Seok Lee
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Seongsik Park
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Hyun Jae Jang
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea
| | - Byeong-Kwon Ju
- School of Electrical Engineering, Korea University, Seoul, 02841, South Korea.
- Department of Micro/Nano Systems, Korea University, Seoul, 02841, South Korea.
| | - Jong Keuk Park
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea.
| | - Inho Kim
- Center for Semiconductor Technology, Korea Institute of Science and Technology, Seoul, 02792, South Korea.
| |
Collapse
|
6
|
Ren H, Li F, Wang M, Liu G, Li D, Wang R, Chen Y, Tang Y, Wang Y, Jin R, Huang Q, Xing L, Chen X, Wang J, Guo C, Zhu B. An Ion-Mediated Spiking Chemical Neuron based on Mott Memristor. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2403678. [PMID: 38887824 DOI: 10.1002/adma.202403678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 05/31/2024] [Indexed: 06/20/2024]
Abstract
Artificial spiking neurons capable of interpreting ionic information into electrical spikes are critical to mimic biological signaling systems. Mott memristors are attractive for constructing artificial spiking neurons due to their simple structure, low energy consumption, and rich neural dynamics. However, challenges remain in achieving ion-mediated spiking and biohybrid-interfacing in Mott neurons. Here, a biomimetic spiking chemical neuron (SCN) utilizing an NbOx Mott memristor and oxide field-effect transistor-type chemical sensor is introduced. The SCN exhibits both excitation and inhibition spiking behaviors toward ionic concentrations akin to biological neural systems. It demonstrates spiking responses across physiological and pathological Na+ concentrations (1-200 × 10-3 m). The Na+-mediated SCN enables both frequency encoding and time-to-first-spike coding schemes, illustrating the rich neural dynamics of Mott neuron. In addition, the SCN interfaced with L929 cells facilitates real-time modulation of ion-mediated spiking under both normal and salty cellular microenvironments.
Collapse
Affiliation(s)
- Huihui Ren
- School of Materials and Engineering, Zhejiang University, Hangzhou, 310027, China
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Fanfan Li
- School of Materials and Engineering, Zhejiang University, Hangzhou, 310027, China
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Min Wang
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Guolei Liu
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Dingwei Li
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Rui Wang
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Yitong Chen
- School of Materials and Engineering, Zhejiang University, Hangzhou, 310027, China
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Yingjie Tang
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Yan Wang
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Ran Jin
- School of Materials and Engineering, Zhejiang University, Hangzhou, 310027, China
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Qi Huang
- Westlake Institute for Optoelectronics, Hangzhou, 311421, China
| | - Lixiang Xing
- Westlake Institute for Optoelectronics, Hangzhou, 311421, China
| | - Xiaopeng Chen
- Enovated3D (Hangzhou) Technology Development Co. Ltd., Hangzhou, 310051, China
| | - Juan Wang
- College of Environmental & Resource Sciences, Zhejiang University, Hangzhou, 310058, China
| | - Chengchen Guo
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
| | - Bowen Zhu
- Key Laboratory of 3D Micro/Nano Fabrication and Characterization of Zhejiang Province, School of Engineering, Westlake University, Hangzhou, 310024, China
- Westlake Institute for Optoelectronics, Hangzhou, 311421, China
| |
Collapse
|
7
|
Lee SW, Yun SY, Han JK, Nho YH, Jeon SB, Choi YK. Spike-Based Neuromorphic Hardware for Dynamic Tactile Perception with a Self-Powered Mechanoreceptor Array. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024:e2402175. [PMID: 38981031 DOI: 10.1002/advs.202402175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 06/27/2024] [Indexed: 07/11/2024]
Abstract
A self-powered mechanoreceptor array is demonstrated using four mechanoreceptor cells for recognition of dynamic touch gestures. Each cell consists of a triboelectric nanogenerator (TENG) for touch sensing and a bi-stable resistor (biristor) for spike encoding. It produces informative spike signals by sensing a force of an external touch and encoding the force into the number of spikes. An array of the mechanoreceptor cells is utilized to monitor various touch gestures and it successfully generated spike signals corresponding to all the gestures. To validate the practicality of the mechanoreceptor array, a spiking neural network (SNN), highly attractive for power consumption compared to the conventional von Neumann architecture, is used for the identification of touch gestures. The measured spiking signals are reflected as inputs for the SNN simulations. Consequently, touch gestures are classified with a high accuracy rate of 92.5%. The proposed mechanoreceptor array emerges as a promising candidate for a building block of tactile in-sensor computing in the era of the Internet of Things (IoT), due to the low cost and high manufacturability of the TENG. This eliminates the need for a power supply, coupled with the intrinsic high throughput of the Si-based biristor employing complementary metal-oxide-semiconductor (CMOS) technology.
Collapse
Affiliation(s)
- Sang-Won Lee
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Seong-Yun Yun
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Joon-Kyu Han
- System Semiconductor Engineering and Department of Electronic Engineering, Sogang University, 35 Baekbeom-ro, Mapo-gu, Seoul, 04107, Republic of Korea
| | - Young-Hoon Nho
- Department of Neurosurgery, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Seung-Bae Jeon
- Department of Electronic Engineering, Hanbat National University, 125 Dongseo-daero, Yuseong-gu, Daejeon, 34158, Republic of Korea
| | - Yang-Kyu Choi
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| |
Collapse
|
8
|
Wang K, Ren S, Jia Y, Yan X. An Ultrasensitive Biomimetic Optic Afferent Nervous System with Circadian Learnability. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2309489. [PMID: 38468430 DOI: 10.1002/advs.202309489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 02/04/2024] [Indexed: 03/13/2024]
Abstract
The optic afferent nervous system (OANS) plays a significant role in generating vision and circadian behaviors based on light detection and signals from the endocrine system. However, the bionic simulation of this photochemically mediated behavior is still a challenge for neuromorphic devices. Herein, stimuli of neurotransmitters at ultralow concentrations and illumination are coupled to artificial synapses with the aid of biofunctionalized heterojunction and tunneling to successfully simulate a circadian neural response. Furthermore, the mechanisms underlying the photosensitive synaptic current in response to stimuli are described. Interestingly, this OANS is demonstrated to be capable of mimicking normal and abnormal circadian learnability by combining the measured synaptic current with a three-layer spike neural network. Strong theoretical and experimental evidence, as well as applications, are provided for the proposed biomimetic OANS to demonstrate that it can reproduce biological circadian behavior, thus establishing it as a promising candidate for future neuromorphic intelligent robots.
Collapse
Affiliation(s)
- Kaiyang Wang
- College of Electronic Information and Optical Engineering, Nankai University, Tianjin, 300071, P. R. China
| | - Shuhui Ren
- College of Electronic Information and Optical Engineering, Nankai University, Tianjin, 300071, P. R. China
| | - Yunfang Jia
- College of Electronic Information and Optical Engineering, Nankai University, Tianjin, 300071, P. R. China
| | - Xiaobing Yan
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electron and Information Engineering, Hebei University, Baoding, 071002, P. R. China
| |
Collapse
|
9
|
Zhang X, Liu D, Liu S, Cai Y, Shan L, Chen C, Chen H, Liu Y, Guo T, Chen H. Toward Intelligent Display with Neuromorphic Technology. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2401821. [PMID: 38567884 DOI: 10.1002/adma.202401821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Revised: 03/19/2024] [Indexed: 04/16/2024]
Abstract
In the era of the Internet and the Internet of Things, display technology has evolved significantly toward full-scene display and realistic display. Incorporating "intelligence" into displays is a crucial technical approach to meet the demands of this development. Traditional display technology relies on distributed hardware systems to achieve intelligent displays but encounters challenges stemming from the physical separation of sensing, processing, and light-emitting modules. The high energy consumption and data transformation delays limited the development of intelligence display, breaking the physical separation is crucial to overcoming the bottlenecks of intelligence display technology. Inspired by the biological neural system, neuromorphic technology with all-in-one features is widely employed across various fields. It proves effective in reducing system power consumption, facilitating frequent data transformation, and enabling cross-scene integration. Neuromorphic technology shows great potential to overcome display technology bottlenecks, realizing the full-scene display and realistic display with high efficiency and low power consumption. This review offers a comprehensive summary of recent advancements in the application of neuromorphic technology in displays, with a focus on interoperability. This work delves into its state-of-the-art designs and potential future developments aimed at revolutionizing display technology.
Collapse
Affiliation(s)
- Xianghong Zhang
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Di Liu
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Shuai Liu
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Yongjie Cai
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Liuting Shan
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Cong Chen
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Huimei Chen
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Yaqian Liu
- School of Electronics and Information, Zhengzhou University of Light Industry, Zhengzhou, Henan, 450002, China
| | - Tailiang Guo
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| | - Huipeng Chen
- Institute of Optoelectronic Display, National and Local United Engineering Lab of Flat Panel Display Technology, Fuzhou University, Fuzhou, 350002, China
- Fujian Science and Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, Fujian, 350100, China
| |
Collapse
|
10
|
Chen J, Liu X, Liu C, Tang L, Bu T, Jiang B, Qing Y, Xie Y, Wang Y, Shan Y, Li R, Ye C, Liao L. Reconfigurable Ag/HfO 2/NiO/Pt Memristors with Stable Synchronous Synaptic and Neuronal Functions for Renewable Homogeneous Neuromorphic Computing System. NANO LETTERS 2024; 24:5371-5378. [PMID: 38647348 DOI: 10.1021/acs.nanolett.4c01319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/25/2024]
Abstract
Artificial synapses and bionic neurons offer great potential in highly efficient computing paradigms. However, complex requirements for specific electronic devices in neuromorphic computing have made memristors face the challenge of process simplification and universality. Herein, reconfigurable Ag/HfO2/NiO/Pt memristors are designed for feasible switching between volatile and nonvolatile modes by compliance current controlled Ag filaments, which enables stable and reconfigurable synaptic and neuronal functions. A neuromorphic computing system effectively replicates the biological synaptic weight alteration and continuously accomplishes excitation and reset of artificial neurons, which consist of bionic synapses and artificial neurons based on isotype Ag/HfO2/NiO/Pt memristors. This reconfigurable electrical performance of the Ag/HfO2/NiO/Pt memristors takes advantage of simplified hardware design and delivers integrated circuits with high density, which exhibits great potency for future neural networks.
Collapse
Affiliation(s)
- Jiaqi Chen
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
| | - Xingqiang Liu
- Changsha Semiconductor Technology and Application Research Institute, Engineering Research Center of Advanced Semiconductor Technology, College of Semiconductor (College of Integrated Circuit), Hunan University, Changsha 410082, China
| | - Chang Liu
- Key Laboratory for Micro/Nano Optoelectronic Devices of Ministry of Education & Hunan Provincial Key Laboratory of Low-Dimensional Structural Physics and Devices, School of Physics and Electronics, Hunan University, Changsha 410082, China
| | - Lin Tang
- Key Laboratory for Micro/Nano Optoelectronic Devices of Ministry of Education & Hunan Provincial Key Laboratory of Low-Dimensional Structural Physics and Devices, School of Physics and Electronics, Hunan University, Changsha 410082, China
| | - Tong Bu
- Key Laboratory for Micro/Nano Optoelectronic Devices of Ministry of Education & Hunan Provincial Key Laboratory of Low-Dimensional Structural Physics and Devices, School of Physics and Electronics, Hunan University, Changsha 410082, China
| | - Bei Jiang
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
- Changsha Semiconductor Technology and Application Research Institute, Engineering Research Center of Advanced Semiconductor Technology, College of Semiconductor (College of Integrated Circuit), Hunan University, Changsha 410082, China
| | - Yahui Qing
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
| | - Yulu Xie
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
| | - Yong Wang
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
| | - Yongtao Shan
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
| | - Ruxin Li
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
| | - Cong Ye
- Key Laboratory of Intelligent Sensing System and Security, Ministry of Education, School of Microelectronics, Hubei University, Wuhan 430062, China
| | - Lei Liao
- Changsha Semiconductor Technology and Application Research Institute, Engineering Research Center of Advanced Semiconductor Technology, College of Semiconductor (College of Integrated Circuit), Hunan University, Changsha 410082, China
| |
Collapse
|
11
|
Fida AA, Mittal S, Khanday FA. Mott memristor based stochastic neurons for probabilistic computing. NANOTECHNOLOGY 2024; 35:295201. [PMID: 38593756 DOI: 10.1088/1361-6528/ad3c4b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2023] [Accepted: 04/09/2024] [Indexed: 04/11/2024]
Abstract
Many studies suggest that probabilistic spiking in biological neural systems is beneficial as it aids learning and provides Bayesian inference-like dynamics. If appropriately utilised, noise and stochasticity in nanoscale devices can benefit neuromorphic systems. In this paper, we build a stochastic leaky integrate and fire (LIF) neuron, utilising a Mott memristor's inherent stochastic switching dynamics. We demonstrate that the developed LIF neuron is capable of biological neural dynamics. We leverage these characteristics of the proposed LIF neuron by integrating it into a population-coded spiking neural network and a spiking restricted Boltzmann machine (sRBM), thereby showcasing its ability to implement probabilistic learning and inference. The sRBM achieves a software-comparable accuracy of 87.13%. Unlike CMOS-based probabilistic neurons, our design does not require any external noise sources. The designed neurons are highly energy efficient and ultra-compact, requiring only three components: a resistor, a capacitor and a memristor device.
Collapse
Affiliation(s)
- Aabid Amin Fida
- Electronics and Communication Engineering, Indian Institute of Technology, Roorkee, Uttrakhand, India
| | - Sparsh Mittal
- Electronics and Communication Engineering, Indian Institute of Technology, Roorkee, Uttrakhand, India
| | - Farooq Ahmad Khanday
- Electronics and Instrumentation Technology, University of Kashmir, Srinagar, J&K, India
| |
Collapse
|
12
|
Galloni AR, Yuan Y, Zhu M, Yu H, Bisht RS, Wu CTM, Grienberger C, Ramanathan S, Milstein AD. Neuromorphic one-shot learning utilizing a phase-transition material. Proc Natl Acad Sci U S A 2024; 121:e2318362121. [PMID: 38630718 PMCID: PMC11047090 DOI: 10.1073/pnas.2318362121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 03/25/2024] [Indexed: 04/19/2024] Open
Abstract
Design of hardware based on biological principles of neuronal computation and plasticity in the brain is a leading approach to realizing energy- and sample-efficient AI and learning machines. An important factor in selection of the hardware building blocks is the identification of candidate materials with physical properties suitable to emulate the large dynamic ranges and varied timescales of neuronal signaling. Previous work has shown that the all-or-none spiking behavior of neurons can be mimicked by threshold switches utilizing material phase transitions. Here, we demonstrate that devices based on a prototypical metal-insulator-transition material, vanadium dioxide (VO2), can be dynamically controlled to access a continuum of intermediate resistance states. Furthermore, the timescale of their intrinsic relaxation can be configured to match a range of biologically relevant timescales from milliseconds to seconds. We exploit these device properties to emulate three aspects of neuronal analog computation: fast (~1 ms) spiking in a neuronal soma compartment, slow (~100 ms) spiking in a dendritic compartment, and ultraslow (~1 s) biochemical signaling involved in temporal credit assignment for a recently discovered biological mechanism of one-shot learning. Simulations show that an artificial neural network using properties of VO2 devices to control an agent navigating a spatial environment can learn an efficient path to a reward in up to fourfold fewer trials than standard methods. The phase relaxations described in our study may be engineered in a variety of materials and can be controlled by thermal, electrical, or optical stimuli, suggesting further opportunities to emulate biological learning in neuromorphic hardware.
Collapse
Affiliation(s)
- Alessandro R. Galloni
- Department of Neuroscience and Cell Biology, Robert Wood Johnson Medical School, Rutgers, The State University of New Jersey, Piscataway, NJ08854
- Center for Advanced Biotechnology and Medicine, Rutgers, The State University of New Jersey, Piscataway, NJ08854
| | - Yifan Yuan
- Department of Electrical and Computer Engineering, Rutgers, The State University of New Jersey, Piscataway, NJ08854
| | - Minning Zhu
- Department of Electrical and Computer Engineering, Rutgers, The State University of New Jersey, Piscataway, NJ08854
| | - Haoming Yu
- School of Materials Engineering, Purdue University, West Lafayette, IN47907
| | - Ravindra S. Bisht
- Department of Electrical and Computer Engineering, Rutgers, The State University of New Jersey, Piscataway, NJ08854
| | - Chung-Tse Michael Wu
- Department of Electrical and Computer Engineering, Rutgers, The State University of New Jersey, Piscataway, NJ08854
| | - Christine Grienberger
- Department of Neuroscience, Brandeis University, Waltham, MA02453
- Department of Biology and Volen National Center for Complex Systems, Brandeis University, Waltham, MA02453
| | - Shriram Ramanathan
- Department of Electrical and Computer Engineering, Rutgers, The State University of New Jersey, Piscataway, NJ08854
| | - Aaron D. Milstein
- Department of Neuroscience and Cell Biology, Robert Wood Johnson Medical School, Rutgers, The State University of New Jersey, Piscataway, NJ08854
- Center for Advanced Biotechnology and Medicine, Rutgers, The State University of New Jersey, Piscataway, NJ08854
| |
Collapse
|
13
|
Ahsan R, Wu Z, Jalal SA, Kapadia R. Ultralow Power Electronic Analog of a Biological Fitzhugh-Nagumo Neuron. ACS OMEGA 2024; 9:18062-18071. [PMID: 38680341 PMCID: PMC11044232 DOI: 10.1021/acsomega.3c09936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 03/14/2024] [Accepted: 03/26/2024] [Indexed: 05/01/2024]
Abstract
Here, we introduce an electronic circuit that mimics the functionality of a biological spiking neuron following the Fitzhugh-Nagumo (FN) model. The circuit consists of a tunnel diode that exhibits negative differential resistance (NDR) and an active inductive element implemented by a single MOSFET. The FN neuron converts a DC voltage excitation into voltage spikes analogous to biological action potentials. We predict an energy cost of 2 aJ/cycle through detailed simulation and modeling for these FN neurons. Such an FN neuron is CMOS compatible and enables ultralow power oscillatory and spiking neural network hardware. We demonstrate that FN neurons can be used for oscillator-based computing in a coupled oscillator network to form an oscillator Ising machine (OIM) that can solve computationally hard NP-complete max-cut problems while showing robustness toward process variations.
Collapse
Affiliation(s)
- Ragib Ahsan
- Department of Electrical
and Computer Engineering, University of
Southern California, Los Angeles 90089-0001, United
States
| | - Zezhi Wu
- Department of Electrical
and Computer Engineering, University of
Southern California, Los Angeles 90089-0001, United
States
| | - Seyedeh Atiyeh
Abbasi Jalal
- Department of Electrical
and Computer Engineering, University of
Southern California, Los Angeles 90089-0001, United
States
| | - Rehan Kapadia
- Department of Electrical
and Computer Engineering, University of
Southern California, Los Angeles 90089-0001, United
States
| |
Collapse
|
14
|
Duan X, Cao Z, Gao K, Yan W, Sun S, Zhou G, Wu Z, Ren F, Sun B. Memristor-Based Neuromorphic Chips. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2310704. [PMID: 38168750 DOI: 10.1002/adma.202310704] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Revised: 12/15/2023] [Indexed: 01/05/2024]
Abstract
In the era of information, characterized by an exponential growth in data volume and an escalating level of data abstraction, there has been a substantial focus on brain-like chips, which are known for their robust processing power and energy-efficient operation. Memristors are widely acknowledged as the optimal electronic devices for the realization of neuromorphic computing, due to their innate ability to emulate the interconnection and information transfer processes witnessed among neurons. This review paper focuses on memristor-based neuromorphic chips, which provide an extensive description of the working principle and characteristic features of memristors, along with their applications in the realm of neuromorphic chips. Subsequently, a thorough discussion of the memristor array, which serves as the pivotal component of the neuromorphic chip, as well as an examination of the present mainstream neural networks, is delved. Furthermore, the design of the neuromorphic chip is categorized into three crucial sections, including synapse-neuron cores, networks on chip (NoC), and neural network design. Finally, the key performance metrics of the chip is highlighted, as well as the key metrics related to the memristor devices are employed to realize both the synaptic and neuronal components.
Collapse
Affiliation(s)
- Xuegang Duan
- National Local Joint Engineering Research Center for Precision Surgery & Regenerative Medicine, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Department of hepatobiliary surgery, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Frontier Institute of Science and Technology (FIST), Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Micro-and Nano-technology Research Center, State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Zelin Cao
- National Local Joint Engineering Research Center for Precision Surgery & Regenerative Medicine, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Department of hepatobiliary surgery, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Frontier Institute of Science and Technology (FIST), Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Micro-and Nano-technology Research Center, State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Kaikai Gao
- National Local Joint Engineering Research Center for Precision Surgery & Regenerative Medicine, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Department of hepatobiliary surgery, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Frontier Institute of Science and Technology (FIST), Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Micro-and Nano-technology Research Center, State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Wentao Yan
- National Local Joint Engineering Research Center for Precision Surgery & Regenerative Medicine, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Department of hepatobiliary surgery, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Frontier Institute of Science and Technology (FIST), Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Micro-and Nano-technology Research Center, State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Siyu Sun
- Frontier Institute of Science and Technology (FIST), Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Micro-and Nano-technology Research Center, State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Guangdong Zhou
- College of Artificial Intelligence, Brain-inspired Computing & Intelligent Control of Chongqing Key Lab, Southwest University, Chongqing, 400715, China
| | - Zhenhua Wu
- School of Mechanical Engineering, Shanghai Jiao Tong University, 800 DongChuan Rd, Shanghai, 200240, China
| | - Fenggang Ren
- National Local Joint Engineering Research Center for Precision Surgery & Regenerative Medicine, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Department of hepatobiliary surgery, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Bai Sun
- National Local Joint Engineering Research Center for Precision Surgery & Regenerative Medicine, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Department of hepatobiliary surgery, the First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Frontier Institute of Science and Technology (FIST), Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
- Micro-and Nano-technology Research Center, State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| |
Collapse
|
15
|
Shi T, Zhang H, Cui S, Liu J, Gu Z, Wang Z, Yan X, Liu Q. Stochastic neuro-fuzzy system implemented in memristor crossbar arrays. SCIENCE ADVANCES 2024; 10:eadl3135. [PMID: 38517972 PMCID: PMC10959402 DOI: 10.1126/sciadv.adl3135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 02/16/2024] [Indexed: 03/24/2024]
Abstract
Neuro-symbolic artificial intelligence has garnered considerable attention amid increasing industry demands for high-performance neural networks that are interpretable and adaptable to previously unknown problem domains with minimal reconfiguration. However, implementing neuro-symbolic hardware is challenging due to the complexity in symbolic knowledge representation and calculation. We experimentally demonstrated a memristor-based neuro-fuzzy hardware based on TiN/TaOx/HfOx/TiN chips that is superior to its silicon-based counterpart in terms of throughput and energy efficiency by using array topological structure for knowledge representation and physical laws for computing. Intrinsic memristor variability is fully exploited to increase robustness in knowledge representation. A hybrid in situ training strategy is proposed for error minimizing in training. The hardware adapts easier to a previously unknown environment, achieving ~6.6 times faster convergence and ~6 times lower error than deep learning. The hardware energy efficiency is over two orders of magnitude greater than field-programmable gate arrays. This research greatly extends the capability of memristor-based neuromorphic computing systems in artificial intelligence.
Collapse
Affiliation(s)
- Tuo Shi
- State Key Lab of Fabrication Technologies for Integrated Circuits, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China
- Research Center for Intelligent Computing Hardware, Zhejiang Laboratory, Hangzhou 311122, China
| | - Hui Zhang
- Research Center for Intelligent Computing Hardware, Zhejiang Laboratory, Hangzhou 311122, China
| | - Shiyu Cui
- Research Center for Intelligent Computing Hardware, Zhejiang Laboratory, Hangzhou 311122, China
| | - Jinchang Liu
- Research Center for Intelligent Computing Hardware, Zhejiang Laboratory, Hangzhou 311122, China
| | - Zixi Gu
- Research Center for Intelligent Computing Hardware, Zhejiang Laboratory, Hangzhou 311122, China
| | - Zhanfeng Wang
- Key Laboratory of Brain-like Neuromorphic Devices and Systems of Hebei Province, Hebei University, Baoding 071002, P. R. China
| | - Xiaobing Yan
- Key Laboratory of Brain-like Neuromorphic Devices and Systems of Hebei Province, Hebei University, Baoding 071002, P. R. China
| | - Qi Liu
- Frontier Institute of Chip and System, Fudan University, Shanghai 200433, China
| |
Collapse
|
16
|
Jeon JW, Park B, Jang YH, Lee SH, Jeon S, Han J, Ryoo SK, Kim KD, Shim SK, Cheong S, Choi W, Jeon G, Kim S, Yoo C, Han JK, Hwang CS. Vertically Stackable Ovonic Threshold Switch Oscillator Using Atomic Layer Deposited Ge 0.6Se 0.4 Film for High-Density Artificial Neural Networks. ACS APPLIED MATERIALS & INTERFACES 2024. [PMID: 38491936 DOI: 10.1021/acsami.3c18625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/18/2024]
Abstract
Nanodevice oscillators (nano-oscillators) have received considerable attention to implement in neuromorphic computing as hardware because they can significantly improve the device integration density and energy efficiency compared to complementary metal oxide semiconductor circuit-based oscillators. This work demonstrates vertically stackable nano-oscillators using an ovonic threshold switch (OTS) for high-density neuromorphic hardware. A vertically stackable Ge0.6Se0.4 OTS-oscillator (VOTS-OSC) is fabricated with a vertical crossbar array structure by growing Ge0.6Se0.4 film conformally on a contact hole structure using atomic layer deposition. The VOTS-OSC can be vertically integrated onto peripheral circuits without causing thermal damage because the fabrication temperature is <400 °C. The fabricated device exhibits oscillation characteristics, which can serve as leaky integrate-and-fire neurons in spiking neural networks (SNNs) and coupled oscillators in oscillatory neural networks (ONNs). For practical applications, pattern recognition and vertex coloring are demonstrated with SNNs and ONNs, respectively, using semiempirical simulations. This structure increases the oscillator integration density significantly, enabling complex tasks with a large number of oscillators. Moreover, it can enhance the computational speed of neural networks due to its rapid switching speed.
Collapse
Affiliation(s)
- Jeong Woo Jeon
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Byongwoo Park
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Yoon Ho Jang
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Soo Hyung Lee
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Sangmin Jeon
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Janguk Han
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Seung Kyu Ryoo
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Kyung Do Kim
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Sung Keun Shim
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Sunwoo Cheong
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Wonho Choi
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Gwangsik Jeon
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Sungjin Kim
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Chanyoung Yoo
- Department of Materials Science and Engineering, Stanford University, Stanford, California 94305, United States
| | - Joon-Kyu Han
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Cheol Seong Hwang
- Department of Materials Science and Engineering and Inter-University Semiconductor Research Center, Seoul National University, Gwanak-ro 1, Daehagdong, Gwanak-gu, Seoul 08826, Republic of Korea
| |
Collapse
|
17
|
Yun SY, Han JK, Choi YK. A Nanoscale Bistable Resistor for an Oscillatory Neural Network. NANO LETTERS 2024; 24:2751-2757. [PMID: 38259042 DOI: 10.1021/acs.nanolett.3c04539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Coupled oscillators construct an oscillatory neural network (ONN) by mimicking the interactions among neurons in the human brain. This work demonstrates a fully CMOS-based oscillator consisting of a bistable resistor (biristor), which shares a structure identical with that of a metal-oxide-semiconductor field-effect transistor, except for the use of a gate electrode. The biristor-based oscillator (birillator) generates oscillating voltage signals in the form of spikes due to a single transistor latch phenomenon. When two birillators are connected with a coupling capacitor, they become synchronized with a phase difference of 180°. These coupled oscillation characteristics are experimentally investigated for an ONN. As practical applications of the ONN with coupled birillators, edge detection and vertex coloring are conducted by encoding information into phase differences between them. The proposed fully CMOS-based birillators are advantageous for low power consumption, high CMOS compatibility, and a compact footprint area.
Collapse
Affiliation(s)
- Seong-Yun Yun
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Joon-Kyu Han
- System Semiconductor Engineering and Department of Electronic Engineering, Sogang University, 35 Baekbeom-ro, Mapo-gu, Seoul 04107, Republic of Korea
| | - Yang-Kyu Choi
- School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| |
Collapse
|
18
|
Wang J, Ilyas N, Ren Y, Ji Y, Li S, Li C, Liu F, Gu D, Ang KW. Technology and Integration Roadmap for Optoelectronic Memristor. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2307393. [PMID: 37739413 DOI: 10.1002/adma.202307393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 09/10/2023] [Indexed: 09/24/2023]
Abstract
Optoelectronic memristors (OMs) have emerged as a promising optoelectronic Neuromorphic computing paradigm, opening up new opportunities for neurosynaptic devices and optoelectronic systems. These OMs possess a range of desirable features including minimal crosstalk, high bandwidth, low power consumption, zero latency, and the ability to replicate crucial neurological functions such as vision and optical memory. By incorporating large-scale parallel synaptic structures, OMs are anticipated to greatly enhance high-performance and low-power in-memory computing, effectively overcoming the limitations of the von Neumann bottleneck. However, progress in this field necessitates a comprehensive understanding of suitable structures and techniques for integrating low-dimensional materials into optoelectronic integrated circuit platforms. This review aims to offer a comprehensive overview of the fundamental performance, mechanisms, design of structures, applications, and integration roadmap of optoelectronic synaptic memristors. By establishing connections between materials, multilayer optoelectronic memristor units, and monolithic optoelectronic integrated circuits, this review seeks to provide insights into emerging technologies and future prospects that are expected to drive innovation and widespread adoption in the near future.
Collapse
Affiliation(s)
- Jinyong Wang
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, P. R. China
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore, 117576, Singapore
| | - Nasir Ilyas
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, P. R. China
| | - Yujing Ren
- Department of Chemical and Biomolecular Engineering, National University of Singapore, Singapore, 117585, Singapore
| | - Yun Ji
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore, 117576, Singapore
| | - Sifan Li
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore, 117576, Singapore
| | - Changcun Li
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, P. R. China
| | - Fucai Liu
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, P. R. China
| | - Deen Gu
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, P. R. China
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu, 611731, P. R. China
| | - Kah-Wee Ang
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore, 117576, Singapore
- Institute of Materials Research and Engineering, A*STAR, Singapore, 138634, Singapore
| |
Collapse
|
19
|
Liu C, Tiw PJ, Zhang T, Wang Y, Cai L, Yuan R, Pan Z, Yue W, Tao Y, Yang Y. VO 2 memristor-based frequency converter with in-situ synthesize and mix for wireless internet-of-things. Nat Commun 2024; 15:1523. [PMID: 38374302 PMCID: PMC10876666 DOI: 10.1038/s41467-024-45923-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 02/07/2024] [Indexed: 02/21/2024] Open
Abstract
Wireless internet-of-things (WIoT) with data acquisition sensors are evolving rapidly and the demand for transmission efficiency is growing rapidly. Frequency converter that synthesizes signals at different frequencies and mixes them with sensor datastreams is a key component for efficient wireless transmission. However, existing frequency converters employ separate synthesize and mix circuits with complex digital and analog circuits using complementary metal-oxide semiconductor (CMOS) devices, naturally incurring excessive latency and energy consumption. Here we report a highly uniform and calibratable VO2 memristor oscillator, based on which we build memristor-based frequency converter using 8[Formula: see text]8 VO2 array that can realize in-situ frequency synthesize and mix with help of compact periphery circuits. We investigate the self-oscillation based on negative differential resistance of VO2 memristors and the programmability with different driving currents and calibration resistances, demonstrating capabilities of such frequency converter for in-situ frequency synthesize and mix for 2 ~ 8 channels with frequencies up to 48 kHz for low frequency transmission link. When transmitting classical sensor data (acoustic, vision and spatial) in an end-to-end WIoT experimental setup, our VO2-based memristive frequency converter presents up to 1.45× ~ 1.94× power enhancement with only 0.02 ~ 0.21 dB performance degradations compared with conventional CMOS-based frequency converter. This work highlights the potential in solving frequency converter's speed and energy efficiency problems in WIoT using high crystalline quality epitaxially grown VO2 and calibratable VO2-based oscillator array, revealing a promising direction for next-generation WIoT system design.
Collapse
Affiliation(s)
- Chang Liu
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Pek Jun Tiw
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Teng Zhang
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Yanghao Wang
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Lei Cai
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Rui Yuan
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Zelun Pan
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Wenshuo Yue
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Yaoyu Tao
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China.
- Center for Brain Inspired Chips, Institute for Artificial Intelligence, Frontiers Science Center for Nano-optoelectronics, Peking University, Beijing, 100871, China.
| | - Yuchao Yang
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China.
- Center for Brain Inspired Chips, Institute for Artificial Intelligence, Frontiers Science Center for Nano-optoelectronics, Peking University, Beijing, 100871, China.
- School of Electronic and Computer Engineering, Peking University, Shenzhen, 518055, China.
- Center for Brain Inspired Intelligence, Chinese Institute for Brain Research (CIBR), Beijing, Beijing, 102206, China.
| |
Collapse
|
20
|
Jeong SH, Oh S, Kwon O, Kim DH, Seo HY, Park W, Cho B. Reliable synaptic plasticity of InGaZnO transistor with TiO 2interlayer. NANOTECHNOLOGY 2023; 35:115202. [PMID: 38091622 DOI: 10.1088/1361-6528/ad1540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 12/13/2023] [Indexed: 12/30/2023]
Abstract
We demonstrate an InGaZnO (IGZO)-based synaptic transistor with a TiO2buffer layer. The structure of the synaptic transistor with TiO2inserted between the Ti metal electrode and an IGZO semiconductor channel O2trapping layer produces a large hysteresis window, which is crucial for achieving synaptic functionality. The Ti/TiO2/IGZO synaptic transistor exhibits reliable synaptic plasticity features such as excitatory post-synaptic current, paired-pulse facilitation, and potentiation and depression, originating from the reversible charge trapping and detrapping in the TiO2layer. Finally, the pattern recognition accuracy of Modified National Institute of Standards and Technology handwritten digit images was modeled using CrossSim simulation software. The simulation results present a high image recognition accuracy of ∼89%. Therefore, this simple approach using an oxide buffer layer can aid the implementation of high-performance synaptic devices for neuromorphic computing systems.
Collapse
Affiliation(s)
- Soo-Hong Jeong
- Department of Advanced Material Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
- Department of Urban, Energy, and Environmental Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
| | - Seyoung Oh
- Department of Advanced Material Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
- Department of Urban, Energy, and Environmental Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
| | - Ojun Kwon
- Department of Advanced Material Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
- Department of Urban, Energy, and Environmental Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
| | - Do Hyeong Kim
- Department of Advanced Material Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
- Department of Urban, Energy, and Environmental Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
| | - Hyun Young Seo
- Department of Advanced Material Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
- Department of Urban, Energy, and Environmental Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
| | - Woojin Park
- Department of Advanced Material Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
- Department of Urban, Energy, and Environmental Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
| | - Byungjin Cho
- Department of Advanced Material Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
- Department of Urban, Energy, and Environmental Engineering, Chungbuk National University, Chungdae-ro 1, Seowon-Gu, Cheongju, Chungbuk 28644, Republic of Korea
| |
Collapse
|
21
|
Wang H, Lu Y, Liu S, Yu J, Hu M, Li S, Yang R, Watanabe K, Taniguchi T, Ma Y, Miao X, Zhuge F, He Y, Zhai T. Adaptive Neural Activation and Neuromorphic Processing via Drain-Injection Threshold-Switching Float Gate Transistor Memory. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2309099. [PMID: 37953691 DOI: 10.1002/adma.202309099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 11/06/2023] [Indexed: 11/14/2023]
Abstract
Hetero-modulated neural activation is vital for adaptive information processing and learning that occurs in brain. To implement brain-inspired adaptive processing, previously various neurotransistors oriented for synaptic functions are extensively explored, however, the emulation of nonlinear neural activation and hetero-modulated behaviors are not possible due to the lack of threshold switching behavior in a conventional transistor structure. Here, a 2D van der Waals float gate transistor (FGT) that exhibits steep threshold switching behavior, and the emulation of hetero-modulated neuron functions (integrate-and-fire, sigmoid type activation) for adaptive sensory processing, are reported. Unlike conventional FGTs, the threshold switching behavior stems from impact ionization in channel and the coupled charge injection to float gate. When a threshold is met, a sub-30 mV dec-1 increase of transistor conductance by more than four orders is triggered with a typical switch time of approximately milliseconds. Essentially, by feeding light sensing signal as the modulation input, it is demonstrated that two typical tasks that rely on adaptive neural activation, including collision avoidance and adaptive visual perception, can be realized. These results may shed light on the emulation of rich hetero-modulating behaviors in biological neurons and the realization of biomimetic neuromorphic processing at low hardware cost.
Collapse
Affiliation(s)
- Han Wang
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Yuanlong Lu
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Shangbo Liu
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Jun Yu
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Man Hu
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Sainan Li
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Rui Yang
- Hubei Yangtze Memory Laboratory, School of Integrated circuits, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Kenji Watanabe
- Research Center for Electronic and Optical Materials, National Institute for Materials Science, 1-1 Namiki, Tsukuba, 305-0044, Japan
| | - Takashi Taniguchi
- Research Center for Materials Nanoarchitectonics, National Institute for Materials Science, Namiki, Tsukuba, 305-0044, Japan
| | - Ying Ma
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Xiangshui Miao
- Hubei Yangtze Memory Laboratory, School of Integrated circuits, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Fuwei Zhuge
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| | - Yuhui He
- Hubei Yangtze Memory Laboratory, School of Integrated circuits, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Tianyou Zhai
- State Key Laboratory of Materials Processing and Die and Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology (HUST), Wuhan, 430074, China
| |
Collapse
|
22
|
Zhao J, Tong L, Niu J, Fang Z, Pei Y, Zhou Z, Sun Y, Wang Z, Wang H, Lou J, Yan X. A bidirectional thermal sensory leaky integrate-and-fire (LIF) neuron model based on bipolar NbO x volatile threshold devices with ultra-low operating current. NANOSCALE 2023; 15:17599-17608. [PMID: 37874690 DOI: 10.1039/d3nr03034b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/26/2023]
Abstract
Brain-like artificial intelligence (AI) will become the main form and important platform in future computing. It will play an important and unique role in simulating brain functions, efficiently implementing AI algorithms, and improving computing power. Developing artificial neurons that can send facilitation/depression signals to artificial synapses, sense, and process temperature information is of great significance for achieving more efficient and compact brain-like computing systems. Herein, we have constructed a NbOx bipolar volatile threshold memristor, which could be operated by 1 μA ultra-low current and up to ∼104 switching ratios. By using a leaky integrate-and-fire (LIF) artificial neuron model, a bipolar LIF artificial neuron is constructed, which can realize the conventional threshold-driven firing, all-or-nothing spiking, refractory periods, and intensity-modulated frequency response bidirectionally at the positive/negative voltage stimulation, which will give the artificial synapse facilitation/depression signals. Furthermore, this bipolar LIF neuron can also explore different temperatures to output different signals, which could be constructed as a more compact thermal sensory neuron to avoid external harm to artificial robots. This study is of great significance for improving the computational efficiency of the system more effectively, achieving high integration density and low energy consumption artificial neural networks to meet the needs of brain-like neural computing.
Collapse
Affiliation(s)
- Jianhui Zhao
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Liang Tong
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Jiangzhen Niu
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Ziliang Fang
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Yifei Pei
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Physics Science and Technology, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China
| | - Zhenyu Zhou
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Yong Sun
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Zhongrong Wang
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Hong Wang
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Jianzhong Lou
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
| | - Xiaobing Yan
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China.
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Physics Science and Technology, Institute of Life Science and Green Development, Hebei University, Baoding 071002, China
| |
Collapse
|
23
|
Li J, Abbas H, Ang DS, Ali A, Ju X. Emerging memristive artificial neuron and synapse devices for the neuromorphic electronics era. NANOSCALE HORIZONS 2023; 8:1456-1484. [PMID: 37615055 DOI: 10.1039/d3nh00180f] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/25/2023]
Abstract
Growth of data eases the way to access the world but requires increasing amounts of energy to store and process. Neuromorphic electronics has emerged in the last decade, inspired by biological neurons and synapses, with in-memory computing ability, extenuating the 'von Neumann bottleneck' between the memory and processor and offering a promising solution to reduce the efforts both in data storage and processing, thanks to their multi-bit non-volatility, biology-emulated characteristics, and silicon compatibility. This work reviews the recent advances in emerging memristive devices for artificial neuron and synapse applications, including memory and data-processing ability: the physics and characteristics are discussed first, i.e., valence changing, electrochemical metallization, phase changing, interfaced-controlling, charge-trapping, ferroelectric tunnelling, and spin-transfer torquing. Next, we propose a universal benchmark for the artificial synapse and neuron devices on spiking energy consumption, standby power consumption, and spike timing. Based on the benchmark, we address the challenges, suggest the guidelines for intra-device and inter-device design, and provide an outlook for the neuromorphic applications of resistive switching-based artificial neuron and synapse devices.
Collapse
Affiliation(s)
- Jiayi Li
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Haider Abbas
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Diing Shenp Ang
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Asif Ali
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Xin Ju
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Singapore 138634
| |
Collapse
|
24
|
Guo Y, Duan W, Liu X, Wang X, Wang L, Duan S, Ma C, Li H. Generative complex networks within a dynamic memristor with intrinsic variability. Nat Commun 2023; 14:6134. [PMID: 37783711 PMCID: PMC10545788 DOI: 10.1038/s41467-023-41921-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 09/21/2023] [Indexed: 10/04/2023] Open
Abstract
Artificial neural networks (ANNs) have gained considerable momentum in the past decade. Although at first the main task of the ANN paradigm was to tune the connection weights in fixed-architecture networks, there has recently been growing interest in evolving network architectures toward the goal of creating artificial general intelligence. Lagging behind this trend, current ANN hardware struggles for a balance between flexibility and efficiency but cannot achieve both. Here, we report on a novel approach for the on-demand generation of complex networks within a single memristor where multiple virtual nodes are created by time multiplexing and the non-trivial topological features, such as small-worldness, are generated by exploiting device dynamics with intrinsic cycle-to-cycle variability. When used for reservoir computing, memristive complex networks can achieve a noticeable increase in memory capacity a and respectable performance boost compared to conventional reservoirs trivially implemented as fully connected networks. This work expands the functionality of memristors for ANN computing.
Collapse
Affiliation(s)
- Yunpeng Guo
- Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, Beijing, 100084, China
| | - Wenrui Duan
- School of Instrument Science and Opto Electronics Engineering, Laboratory of Intelligent Microsystems, Beijing Information Science & Technology University, Beijing, 100101, China.
| | - Xue Liu
- Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, Beijing, 100084, China.
- School of Integrated Circuits, Tsinghua University, Beijing, 100084, China.
| | - Xinxin Wang
- Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, Beijing, 100084, China
| | - Lidan Wang
- School of Artificial Intelligence, Southwest University, Chongqing, 400715, China
| | - Shukai Duan
- School of Artificial Intelligence, Southwest University, Chongqing, 400715, China
| | - Cheng Ma
- Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, Beijing, 100084, China.
| | - Huanglong Li
- Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, Beijing, 100084, China.
- Chinese Institute for Brain Research, Beijing, 102206, China.
| |
Collapse
|
25
|
Zhao J, Ran Y, Pei Y, Wei Y, Sun J, Zhang Z, Wang J, Zhou Z, Wang Z, Sun Y, Yan X. Memristors based on NdNiO 3 nanocrystals film as sensory neurons for neuromorphic computing. MATERIALS HORIZONS 2023; 10:4521-4531. [PMID: 37555245 DOI: 10.1039/d3mh00835e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/10/2023]
Abstract
By mimicking the behavior of the human brain, artificial neural systems offer the possibility to further improve computing efficiency and solve the von Neumann bottleneck. In particular, neural systems with perceptual capability expand the application field and lay a good foundation for the construction of perceptual storage and computational systems. However, research on neurons with perceptual functions is still relatively scarce, with most works focusing on optoelectronic synapses. The neuron is important for neuromorphic computing systems because neurons output excitatory or inhibitory stimuli to regulate the weight of synapses. Therefore, the construction of sensory neurons is crucial to expand the application range of brain-like neural computing. Here, an artificial sensory neuron is proposed, which is constructed using a photosensitive bipolar threshold switching memristor based on NdNiO3 (NNO) nanocrystals. These metallic phase nanocrystals can not only enhance the local electric field, but also act as a reservoir for defects (VoS) to guide the growth of conductive filaments and stabilize the performance of the device. They present stable bipolar threshold switching behavior with a low 120 nW set power, and the operating voltages decreased in light due to photocarrier action. A leaky integrate firing (LIF) neuron has been realized, which achieved key biological neuron functions, such as all-or-nothing spiking, threshold-driven firing, refractory period, and spiking frequency modulation. The LIF neurons receiving optical inputs have the properties of an artificial sensory neuron. It could regulate the spiking output frequency at different light densities, which could be used for a ship approaching a port. This work provides a promising hardware implementation towards constructing high-performance artificial intelligence to assist ships at night in a sensory system.
Collapse
Affiliation(s)
- Jianhui Zhao
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Yunfeng Ran
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Yifei Pei
- Hebei Key Laboratory of Optic-Electronic Information Materials, College of Physics Science and Technology, Hebei University, Baoding 071002, People's Republic of China
| | - Yiheng Wei
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Jiameng Sun
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Zixuan Zhang
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Jiacheng Wang
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Zhenyu Zhou
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Zhongrong Wang
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Yong Sun
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| | - Xiaobing Yan
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electronic and Information Engineering, Hebei University, Baoding 071002, People's Republic of China.
| |
Collapse
|
26
|
Bednarkiewicz A, Szalkowski M, Majak M, Korczak Z, Misiak M, Maćkowski S. All-Optical Data Processing with Photon-Avalanching Nanocrystalline Photonic Synapse. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2304390. [PMID: 37572370 DOI: 10.1002/adma.202304390] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 08/01/2023] [Indexed: 08/14/2023]
Abstract
Data processing and storage in electronic devices are typically performed as a sequence of elementary binary operations. Alternative approaches, such as neuromorphic or reservoir computing, are rapidly gaining interest where data processing is relatively slow, but can be performed in a more comprehensive way or massively in parallel, like in neuronal circuits. Here, time-domain all-optical information processing capabilities of photon-avalanching (PA) nanoparticles at room temperature are discovered. Demonstrated functionality resembles properties found in neuronal synapses, such as: paired-pulse facilitation and short-term internal memory, in situ plasticity, multiple inputs processing, and all-or-nothing threshold response. The PA-memory-like behavior shows capability of machine-learning-algorithm-free feature extraction and further recognition of 2D patterns with simple 2 input artificial neural network. Additionally, high nonlinearity of luminescence intensity in response to photoexcitation mimics and enhances spike-timing-dependent plasticity that is coherent in nature with the way a sound source is localized in animal neuronal circuits. Not only are yet unexplored fundamental properties of photon-avalanche luminescence kinetics studied, but this approach, combined with recent achievements in photonics, light confinement and guiding, promises all-optical data processing, control, adaptive responsivity, and storage on photonic chips.
Collapse
Affiliation(s)
- Artur Bednarkiewicz
- Institute of Low Temperature and Structure Research, Polish Academy of Sciences, ul. Okólna 2, Wroclaw, 50-422, Poland
| | - Marcin Szalkowski
- Institute of Low Temperature and Structure Research, Polish Academy of Sciences, ul. Okólna 2, Wroclaw, 50-422, Poland
- Nanophotonics Group, Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, 87-100, Toruń, ul. Grudziądzka 5, Poland
| | - Martyna Majak
- Institute of Low Temperature and Structure Research, Polish Academy of Sciences, ul. Okólna 2, Wroclaw, 50-422, Poland
| | - Zuzanna Korczak
- Institute of Low Temperature and Structure Research, Polish Academy of Sciences, ul. Okólna 2, Wroclaw, 50-422, Poland
| | - Małgorzata Misiak
- Institute of Low Temperature and Structure Research, Polish Academy of Sciences, ul. Okólna 2, Wroclaw, 50-422, Poland
| | - Sebastian Maćkowski
- Nanophotonics Group, Institute of Physics, Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University in Toruń, 87-100, Toruń, ul. Grudziądzka 5, Poland
| |
Collapse
|
27
|
Han J, Lee J, Kim Y, Kim YB, Yun S, Lee S, Yu J, Lee KJ, Myung H, Choi Y. 3D Neuromorphic Hardware with Single Thin-Film Transistor Synapses Over Single Thin-Body Transistor Neurons by Monolithic Vertical Integration. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2302380. [PMID: 37712147 PMCID: PMC10602577 DOI: 10.1002/advs.202302380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 07/24/2023] [Indexed: 09/16/2023]
Abstract
Neuromorphic hardware with a spiking neural network (SNN) can significantly enhance the energy efficiency for artificial intelligence (AI) functions owing to its event-driven and spatiotemporally sparse operations. However, an artificial neuron and synapse based on complex complementary metal-oxide-semiconductor (CMOS) circuits limit the scalability and energy efficiency of neuromorphic hardware. In this work, a neuromorphic module is demonstrated composed of synapses over neurons realized by monolithic vertical integration. The synapse at top is a single thin-film transistor (1TFT-synapse) made of poly-crystalline silicon film and the neuron at bottom is another single transistor (1T-neuron) made of single-crystalline silicon. Excimer laser annealing (ELA) is applied to activate dopants for the 1TFT-synapse at the top and rapid thermal annealing (RTA) is applied to do so for the 1T-neuron at the bottom. Internal electro-thermal annealing (ETA) via the generation of Joule heat is also used to enhance the endurance of the 1TFT-synapse without transferring heat to the 1T-neuron at the bottom. As neuromorphic vision sensing, classification of American Sign Language (ASL) is conducted with the fabricated neuromorphic module. Its classification accuracy on ASL is ≈92.3% even after 204 800 update pulses.
Collapse
Affiliation(s)
- Joon‐Kyu Han
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Jung‐Woo Lee
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
- SK Hynix Inc.Icheon17336Republic of Korea
| | - Yeeun Kim
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Young Bin Kim
- Department of Materials Science and EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Seong‐Yun Yun
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Sang‐Won Lee
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Ji‐Man Yu
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Keon Jae Lee
- Department of Materials Science and EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Hyun Myung
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| | - Yang‐Kyu Choi
- School of Electrical EngineeringKorea Advanced Institute of Science and Technology (KAIST)291 Daehak‐ro, Yuseong‐guDaejeon34141Republic of Korea
| |
Collapse
|
28
|
Qiu E, Salev P, Torres F, Navarro H, Dynes RC, Schuller IK. Stochastic transition in synchronized spiking nanooscillators. Proc Natl Acad Sci U S A 2023; 120:e2303765120. [PMID: 37695901 PMCID: PMC10515151 DOI: 10.1073/pnas.2303765120] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 07/29/2023] [Indexed: 09/13/2023] Open
Abstract
This work reports that synchronization of Mott material-based nanoscale coupled spiking oscillators can be drastically different from that in conventional harmonic oscillators. We investigated the synchronization of spiking nanooscillators mediated by thermal interactions due to the close physical proximity of the devices. Controlling the driving voltage enables in-phase 1:1 and 2:1 integer synchronization modes between neighboring oscillators. Transition between these two integer modes occurs through an unusual stochastic synchronization regime instead of the loss of spiking coherence. In the stochastic synchronization regime, random length spiking sequences belonging to the 1:1 and 2:1 integer modes are intermixed. The occurrence of this stochasticity is an important factor that must be taken into account in the design of large-scale spiking networks for hardware-level implementation of novel computational paradigms such as neuromorphic and stochastic computing.
Collapse
Affiliation(s)
- Erbin Qiu
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA92093
- Department of Physics, Center for Advanced Nanoscience, University of California San Diego, La Jolla, CA92093
| | - Pavel Salev
- Department of Physics and Astronomy, University of Denver, Denver, CO80208
| | - Felipe Torres
- Departamento de Física, Facultad de Ciencias, Universidad de Chile, Santiago7800024, Chile
| | - Henry Navarro
- Department of Physics, Center for Advanced Nanoscience, University of California San Diego, La Jolla, CA92093
| | - Robert C. Dynes
- Department of Physics, Center for Advanced Nanoscience, University of California San Diego, La Jolla, CA92093
| | - Ivan K. Schuller
- Department of Physics, Center for Advanced Nanoscience, University of California San Diego, La Jolla, CA92093
| |
Collapse
|
29
|
Park TJ, Deng S, Manna S, Islam ANMN, Yu H, Yuan Y, Fong DD, Chubykin AA, Sengupta A, Sankaranarayanan SKRS, Ramanathan S. Complex Oxides for Brain-Inspired Computing: A Review. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2203352. [PMID: 35723973 DOI: 10.1002/adma.202203352] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 06/02/2022] [Indexed: 06/15/2023]
Abstract
The fields of brain-inspired computing, robotics, and, more broadly, artificial intelligence (AI) seek to implement knowledge gleaned from the natural world into human-designed electronics and machines. In this review, the opportunities presented by complex oxides, a class of electronic ceramic materials whose properties can be elegantly tuned by doping, electron interactions, and a variety of external stimuli near room temperature, are discussed. The review begins with a discussion of natural intelligence at the elementary level in the nervous system, followed by collective intelligence and learning at the animal colony level mediated by social interactions. An important aspect highlighted is the vast spatial and temporal scales involved in learning and memory. The focus then turns to collective phenomena, such as metal-to-insulator transitions (MITs), ferroelectricity, and related examples, to highlight recent demonstrations of artificial neurons, synapses, and circuits and their learning. First-principles theoretical treatments of the electronic structure, and in situ synchrotron spectroscopy of operating devices are then discussed. The implementation of the experimental characteristics into neural networks and algorithm design is then revewed. Finally, outstanding materials challenges that require a microscopic understanding of the physical mechanisms, which will be essential for advancing the frontiers of neuromorphic computing, are highlighted.
Collapse
Affiliation(s)
- Tae Joon Park
- School of Materials Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Sunbin Deng
- School of Materials Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Sukriti Manna
- Center for Nanoscale Materials, Argonne National Laboratory, Argonne, IL, 60439, USA
| | - A N M Nafiul Islam
- Department of Electrical Engineering, The Pennsylvania State University, University Park, PA, 16802, USA
| | - Haoming Yu
- School of Materials Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Yifan Yuan
- School of Materials Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Dillon D Fong
- Materials Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA
| | - Alexander A Chubykin
- Department of Biological Sciences, Purdue Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN, 47907, USA
| | - Abhronil Sengupta
- Department of Electrical Engineering, The Pennsylvania State University, University Park, PA, 16802, USA
| | - Subramanian K R S Sankaranarayanan
- Center for Nanoscale Materials, Argonne National Laboratory, Argonne, IL, 60439, USA
- Department of Mechanical and Industrial Engineering, University of Illinois Chicago, Chicago, IL, 60607, USA
| | - Shriram Ramanathan
- School of Materials Engineering, Purdue University, West Lafayette, IN, 47907, USA
| |
Collapse
|
30
|
Liu H, Qin Y, Chen HY, Wu J, Ma J, Du Z, Wang N, Zou J, Lin S, Zhang X, Zhang Y, Wang H. Artificial Neuronal Devices Based on Emerging Materials: Neuronal Dynamics and Applications. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2205047. [PMID: 36609920 DOI: 10.1002/adma.202205047] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 12/02/2022] [Indexed: 06/17/2023]
Abstract
Artificial neuronal devices are critical building blocks of neuromorphic computing systems and currently the subject of intense research motivated by application needs from new computing technology and more realistic brain emulation. Researchers have proposed a range of device concepts that can mimic neuronal dynamics and functions. Although the switching physics and device structures of these artificial neurons are largely different, their behaviors can be described by several neuron models in a more unified manner. In this paper, the reports of artificial neuronal devices based on emerging volatile switching materials are reviewed from the perspective of the demonstrated neuron models, with a focus on the neuronal functions implemented in these devices and the exploitation of these functions for computational and sensing applications. Furthermore, the neuroscience inspirations and engineering methods to enrich the neuronal dynamics that remain to be implemented in artificial neuronal devices and networks toward realizing the full functionalities of biological neurons are discussed.
Collapse
Affiliation(s)
- Hefei Liu
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Yuan Qin
- Center for Power Electronics Systems, Bradley Department of Electrical and Computer Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA, 24060, USA
| | - Hung-Yu Chen
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Jiangbin Wu
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Jiahui Ma
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Zhonghao Du
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Nan Wang
- Mork Family Department of Chemical Engineering and Materials Science, University of Southern California, Los Angeles, CA, 90089, USA
| | - Jingyi Zou
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Sen Lin
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Xu Zhang
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Yuhao Zhang
- Center for Power Electronics Systems, Bradley Department of Electrical and Computer Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA, 24060, USA
| | - Han Wang
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, 90089, USA
- Mork Family Department of Chemical Engineering and Materials Science, University of Southern California, Los Angeles, CA, 90089, USA
| |
Collapse
|
31
|
Chen S, Zhang T, Tappertzhofen S, Yang Y, Valov I. Electrochemical-Memristor-Based Artificial Neurons and Synapses-Fundamentals, Applications, and Challenges. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2301924. [PMID: 37199224 DOI: 10.1002/adma.202301924] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/22/2023] [Indexed: 05/19/2023]
Abstract
Artificial neurons and synapses are considered essential for the progress of the future brain-inspired computing, based on beyond von Neumann architectures. Here, a discussion on the common electrochemical fundamentals of biological and artificial cells is provided, focusing on their similarities with the redox-based memristive devices. The driving forces behind the functionalities and the ways to control them by an electrochemical-materials approach are presented. Factors such as the chemical symmetry of the electrodes, doping of the solid electrolyte, concentration gradients, and excess surface energy are discussed as essential to understand, predict, and design artificial neurons and synapses. A variety of two- and three-terminal memristive devices and memristive architectures are presented and their application for solving various problems is shown. The work provides an overview of the current understandings on the complex processes of neural signal generation and transmission in both biological and artificial cells and presents the state-of-the-art applications, including signal transmission between biological and artificial cells. This example is showcasing the possibility for creating bioelectronic interfaces and integrating artificial circuits in biological systems. Prospectives and challenges of the modern technology toward low-power, high-information-density circuits are highlighted.
Collapse
Affiliation(s)
- Shaochuan Chen
- Institute of Materials in Electrical Engineering 2 (IWE2), RWTH Aachen University, Sommerfeldstraße 24, 52074, Aachen, Germany
| | - Teng Zhang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Stefan Tappertzhofen
- Chair for Micro- and Nanoelectronics, Department of Electrical Engineering and Information Technology, TU Dortmund University, Martin-Schmeisser-Weg 4-6, D-44227, Dortmund, Germany
| | - Yuchao Yang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), School of Integrated Circuits, Peking University, Beijing, 100871, China
- School of Electronic and Computer Engineering, Peking University, Shenzhen, 518055, China
- Center for Brain Inspired Intelligence, Chinese Institute for Brain Research (CIBR), Beijing, 102206, China
| | - Ilia Valov
- Peter Grünberg Institute (PGI-7), Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425, Jülich, Germany
- Institute of Electrochemistry and Energy Systems "Acad. E. Budewski", Bulgarian Academy of Sciences, Acad. G. Bonchev 10, 1113, Sofia, Bulgaria
| |
Collapse
|
32
|
Li X, Zhong Y, Chen H, Tang J, Zheng X, Sun W, Li Y, Wu D, Gao B, Hu X, Qian H, Wu H. A Memristors-Based Dendritic Neuron for High-Efficiency Spatial-Temporal Information Processing. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2203684. [PMID: 35735048 DOI: 10.1002/adma.202203684] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 06/06/2022] [Indexed: 06/15/2023]
Abstract
Diverse microscopic ionic dynamics help mediate the ability of a biological neural network to handle complex tasks with low energy consumption. Thus, rich internal ionic dynamics in memristors based on transition metal oxide are expected to provide a unique and useful platform for implementing energy-efficient neuromorphic computing. To this end, a titanium oxide (TiOx )-based interface-type dynamic memristor and an niobium oxide (NbOx )-based Mott memristor are integrated as an artificial dendrite and spike-firing soma, respectively, to construct a dendritic neuron unit for realizing high-efficiency spatial-temporal information processing. Further, a dendritic neural network is hardware-implemented for spatial-temporal information processing to highlight the computational advantages achieved by incorporating dendritic functions in the network. Human motion recognition is demonstrated using the Nanyang Technological University-Red Green Blue (NTU-RGB) dataset as a benchmark spatial-temporal task; it shows a nearly 20% improvement in accuracy for the memristors-based hardware incorporating dendrites and a 1000× advantage in power efficiency compared to that of the graphics processing unit (GPU). The dendritic neuron developed in this study can be considered a critical building block for implementing more bio-plausible neural networks that can manage complex spatial-temporal tasks with high efficiency.
Collapse
Affiliation(s)
- Xinyi Li
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Yanan Zhong
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu, 215123, China
| | - Hang Chen
- Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China
| | - Jianshi Tang
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Xiaojian Zheng
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Wen Sun
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Yang Li
- Department of Internet of Things Technology and Application, China Mobile Research Institute, Beijing, 100053, China
| | - Dong Wu
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Bin Gao
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Xiaolin Hu
- Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China
| | - He Qian
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Huaqiang Wu
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| |
Collapse
|
33
|
Yuan R, Tiw PJ, Cai L, Yang Z, Liu C, Zhang T, Ge C, Huang R, Yang Y. A neuromorphic physiological signal processing system based on VO 2 memristor for next-generation human-machine interface. Nat Commun 2023; 14:3695. [PMID: 37344448 DOI: 10.1038/s41467-023-39430-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Accepted: 06/08/2023] [Indexed: 06/23/2023] Open
Abstract
Physiological signal processing plays a key role in next-generation human-machine interfaces as physiological signals provide rich cognition- and health-related information. However, the explosion of physiological signal data presents challenges for traditional systems. Here, we propose a highly efficient neuromorphic physiological signal processing system based on VO2 memristors. The volatile and positive/negative symmetric threshold switching characteristics of VO2 memristors are leveraged to construct a sparse-spiking yet high-fidelity asynchronous spike encoder for physiological signals. Besides, the dynamical behavior of VO2 memristors is utilized in compact Leaky Integrate and Fire (LIF) and Adaptive-LIF (ALIF) neurons, which are incorporated into a decision-making Long short-term memory Spiking Neural Network. The system demonstrates superior computing capabilities, needing only small-sized LSNNs to attain high accuracies of 95.83% and 99.79% in arrhythmia classification and epileptic seizure detection, respectively. This work highlights the potential of memristors in constructing efficient neuromorphic physiological signal processing systems and promoting next-generation human-machine interfaces.
Collapse
Affiliation(s)
- Rui Yuan
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Pek Jun Tiw
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Lei Cai
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Zhiyu Yang
- School of Electronic and Computer Engineering, Peking University, Shenzhen, 518055, China
| | - Chang Liu
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Teng Zhang
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Chen Ge
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Ru Huang
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Yuchao Yang
- Beijing Advanced Innovation Center for Integrated Circuits, School of Integrated Circuits, Peking University, Beijing, 100871, China.
- School of Electronic and Computer Engineering, Peking University, Shenzhen, 518055, China.
- Center for Brain Inspired Chips, Institute for Artificial Intelligence, Frontiers Science Center for Nano-optoelectronics, Peking University, Beijing, 100871, China.
- Center for Brain Inspired Intelligence, Chinese Institute for Brain Research (CIBR), Beijing, Beijing, 102206, China.
| |
Collapse
|
34
|
Park W, Kim G, In JH, Rhee H, Song H, Park J, Martinez A, Kim KM. High Amplitude Spike Generator in Au Nanodot-Incorporated NbO x Mott Memristor. NANO LETTERS 2023; 23:5399-5407. [PMID: 36930534 DOI: 10.1021/acs.nanolett.2c04599] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
NbOx-based Mott memristors exhibit fast threshold switching behaviors, making them suitable for spike generators in neuromorphic computing and stochastic clock generators in security devices. In these applications, a high output spike amplitude is necessary for threshold level control and accurate signal detection. Here, we propose a materialwise solution to obtain the high amplitude spikes by inserting Au nanodots into the NbOx device. The Au nanodots enable increasing the threshold voltage by modulating the oxygen contents at the electrode-oxide interface, providing a higher ON current compared to nanodot-free NbOx devices. Also, the reduction of the local switching region volume decreases the thermal capacitance of the system, allowing the maximum spike amplitude generation. Consequently, the Au nanodot incorporation increases the spike amplitude of the NbOx device by 6 times, without any additional external circuit elements. The results are systematically supported by both a numerical model and a finite-element-method-based multiphysics model.
Collapse
Affiliation(s)
- Woojoon Park
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Gwangmin Kim
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Jae Hyun In
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Hakseung Rhee
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Hanchan Song
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Juseong Park
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Alba Martinez
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Kyung Min Kim
- Department of Materials Science and Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| |
Collapse
|
35
|
Won UY, An Vu Q, Park SB, Park MH, Dam Do V, Park HJ, Yang H, Lee YH, Yu WJ. Multi-neuron connection using multi-terminal floating-gate memristor for unsupervised learning. Nat Commun 2023; 14:3070. [PMID: 37244897 DOI: 10.1038/s41467-023-38667-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 05/10/2023] [Indexed: 05/29/2023] Open
Abstract
Multi-terminal memristor and memtransistor (MT-MEMs) has successfully performed complex functions of heterosynaptic plasticity in synapse. However, theses MT-MEMs lack the ability to emulate membrane potential of neuron in multiple neuronal connections. Here, we demonstrate multi-neuron connection using a multi-terminal floating-gate memristor (MT-FGMEM). The variable Fermi level (EF) in graphene allows charging and discharging of MT-FGMEM using horizontally distant multiple electrodes. Our MT-FGMEM demonstrates high on/off ratio over 105 at 1000 s retention about ~10,000 times higher than other MT-MEMs. The linear behavior between current (ID) and floating gate potential (VFG) in triode region of MT-FGMEM allows for accurate spike integration at the neuron membrane. The MT-FGMEM fully mimics the temporal and spatial summation of multi-neuron connections based on leaky-integrate-and-fire (LIF) functionality. Our artificial neuron (150 pJ) significantly reduces the energy consumption by 100,000 times compared to conventional neurons based on silicon integrated circuits (11.7 μJ). By integrating neurons and synapses using MT-FGMEMs, a spiking neurosynaptic training and classification of directional lines functioned in visual area one (V1) is successfully emulated based on neuron's LIF and synapse's spike-timing-dependent plasticity (STDP) functions. Simulation of unsupervised learning based on our artificial neuron and synapse achieves a learning accuracy of 83.08% on the unlabeled MNIST handwritten dataset.
Collapse
Affiliation(s)
- Ui Yeon Won
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, 16419, South Korea
- Hyundai motors group, Electronic Devices research Team, Uiwang, 16082, South Korea
| | - Quoc An Vu
- IBS Center for Integrated Nanostructure Physics, Institute for Basic Science, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Sung Bum Park
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Mi Hyang Park
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Van Dam Do
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, 16419, South Korea
| | - Hyun Jun Park
- Display R&D Group, Mobile Communication Business, Samsung Electronics, Suwon, 16677, South Korea
| | - Heejun Yang
- Department of Physics, Korea Advanced Institute of Science and Technology, Daejeon, 34141, South Korea
| | - Young Hee Lee
- IBS Center for Integrated Nanostructure Physics, Institute for Basic Science, Sungkyunkwan University, Suwon, 16419, South Korea.
- Department of Energy Science, Sungkyunkwan University, Suwon, 16419, South Korea.
| | - Woo Jong Yu
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, 16419, South Korea.
| |
Collapse
|
36
|
Amin Fida A, Khanday FA, Mittal S. An active memristor based rate-coded spiking neural network. Neurocomputing 2023. [DOI: 10.1016/j.neucom.2023.02.038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/04/2023]
|
37
|
Deng S, Yu H, Park TJ, Islam AN, Manna S, Pofelski A, Wang Q, Zhu Y, Sankaranarayanan SK, Sengupta A, Ramanathan S. Selective area doping for Mott neuromorphic electronics. SCIENCE ADVANCES 2023; 9:eade4838. [PMID: 36930716 PMCID: PMC10022892 DOI: 10.1126/sciadv.ade4838] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 02/16/2023] [Indexed: 06/18/2023]
Abstract
The cointegration of artificial neuronal and synaptic devices with homotypic materials and structures can greatly simplify the fabrication of neuromorphic hardware. We demonstrate experimental realization of vanadium dioxide (VO2) artificial neurons and synapses on the same substrate through selective area carrier doping. By locally configuring pairs of catalytic and inert electrodes that enable nanoscale control over carrier density, volatility or nonvolatility can be appropriately assigned to each two-terminal Mott memory device per lithographic design, and both neuron- and synapse-like devices are successfully integrated on a single chip. Feedforward excitation and inhibition neural motifs are demonstrated at hardware level, followed by simulation of network-level handwritten digit and fashion product recognition tasks with experimental characteristics. Spatially selective electron doping opens up previously unidentified avenues for integration of emerging correlated semiconductors in electronic device technologies.
Collapse
Affiliation(s)
- Sunbin Deng
- School of Materials Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Haoming Yu
- School of Materials Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Tae Joon Park
- School of Materials Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - A. N. M. Nafiul Islam
- School of Electrical Engineering and Computer Science, The Pennsylvania State University, University Park, PA 16802, USA
| | - Sukriti Manna
- Center for Nanoscale Materials, Argonne National Laboratory, Lemont, IL 60439, USA
- Department of Mechanical and Industrial Engineering, University of Illinois, Chicago, IL 60607, USA
| | - Alexandre Pofelski
- Department of Condensed Matter Physics and Materials Science, Brookhaven National Laboratory, Upton, NY 11973, USA
| | - Qi Wang
- School of Materials Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Yimei Zhu
- Department of Condensed Matter Physics and Materials Science, Brookhaven National Laboratory, Upton, NY 11973, USA
| | - Subramanian K. R. S. Sankaranarayanan
- Center for Nanoscale Materials, Argonne National Laboratory, Lemont, IL 60439, USA
- Department of Mechanical and Industrial Engineering, University of Illinois, Chicago, IL 60607, USA
| | - Abhronil Sengupta
- School of Electrical Engineering and Computer Science, The Pennsylvania State University, University Park, PA 16802, USA
| | - Shriram Ramanathan
- School of Materials Engineering, Purdue University, West Lafayette, IN 47907, USA
| |
Collapse
|
38
|
Chen H, Li H, Ma T, Han S, Zhao Q. Biological function simulation in neuromorphic devices: from synapse and neuron to behavior. SCIENCE AND TECHNOLOGY OF ADVANCED MATERIALS 2023; 24:2183712. [PMID: 36926202 PMCID: PMC10013381 DOI: 10.1080/14686996.2023.2183712] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 02/06/2023] [Accepted: 02/11/2023] [Indexed: 06/18/2023]
Abstract
As the boom of data storage and processing, brain-inspired computing provides an effective approach to solve the current problem. Various emerging materials and devices have been reported to promote the development of neuromorphic computing. Thereinto, the neuromorphic device represented by memristor has attracted extensive research due to its outstanding property to emulate the brain's functions from synaptic plasticity, sensory-memory neurons to some intelligent behaviors of living creatures. Herein, we mainly review the progress of these brain functions mimicked by neuromorphic devices, concentrating on synapse (i.e. various synaptic plasticity trigger by electricity and/or light), neurons (including the various sensory nervous system) and intelligent behaviors (such as conditioned reflex represented by Pavlov's dog experiment). Finally, some challenges and prospects related to neuromorphic devices are presented.
Collapse
Affiliation(s)
- Hui Chen
- Heart Center of Henan Provincial People’s Hospital, Central China Fuwai Hospital, Central China Fuwai Hospital of Zhengzhou University, Zhengzhou, P. R. China
| | - Huilin Li
- Henan Key Laboratory of Photovoltaic Materials, Henan University, Kaifeng, P. R. China
| | - Ting Ma
- Henan Key Laboratory of Photovoltaic Materials, Henan University, Kaifeng, P. R. China
| | - Shuangshuang Han
- Henan Key Laboratory of Photovoltaic Materials, Henan University, Kaifeng, P. R. China
| | - Qiuping Zhao
- Heart Center of Henan Provincial People’s Hospital, Central China Fuwai Hospital, Central China Fuwai Hospital of Zhengzhou University, Zhengzhou, P. R. China
| |
Collapse
|
39
|
Wang S, Li Y, Wang D, Zhang W, Chen X, Dong D, Wang S, Zhang X, Lin P, Gallicchio C, Xu X, Liu Q, Cheng KT, Wang Z, Shang D, Liu M. Echo state graph neural networks with analogue random resistive memory arrays. NAT MACH INTELL 2023. [DOI: 10.1038/s42256-023-00609-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/15/2023]
Abstract
AbstractRecent years have witnessed a surge of interest in learning representations of graph-structured data, with applications from social networks to drug discovery. However, graph neural networks, the machine learning models for handling graph-structured data, face significant challenges when running on conventional digital hardware, including the slowdown of Moore’s law due to transistor scaling limits and the von Neumann bottleneck incurred by physically separated memory and processing units, as well as a high training cost. Here we present a hardware–software co-design to address these challenges, by designing an echo state graph neural network based on random resistive memory arrays, which are built from low-cost, nanoscale and stackable resistors for efficient in-memory computing. This approach leverages the intrinsic stochasticity of dielectric breakdown in resistive switching to implement random projections in hardware for an echo state network that effectively minimizes the training complexity thanks to its fixed and random weights. The system demonstrates state-of-the-art performance on both graph classification using the MUTAG and COLLAB datasets and node classification using the CORA dataset, achieving 2.16×, 35.42× and 40.37× improvements in energy efficiency for a projected random resistive memory-based hybrid analogue–digital system over a state-of-the-art graphics processing unit and 99.35%, 99.99% and 91.40% reductions of backward pass complexity compared with conventional graph learning. The results point to a promising direction for next-generation artificial intelligence systems for graph learning.
Collapse
|
40
|
Li Z, Tang W, Zhang B, Yang R, Miao X. Emerging memristive neurons for neuromorphic computing and sensing. SCIENCE AND TECHNOLOGY OF ADVANCED MATERIALS 2023; 24:2188878. [PMID: 37090846 PMCID: PMC10120469 DOI: 10.1080/14686996.2023.2188878] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Inspired by the principles of the biological nervous system, neuromorphic engineering has brought a promising alternative approach to intelligence computing with high energy efficiency and low consumption. As pivotal components of neuromorphic system, artificial spiking neurons are powerful information processing units and can achieve highly complex nonlinear computations. By leveraging the switching dynamic characteristics of memristive device, memristive neurons show rich spiking behaviors with simple circuit. This report reviews the memristive neurons and their applications in neuromorphic sensing and computing systems. The switching mechanisms that endow memristive devices with rich dynamics and nonlinearity are highlighted, and subsequently various nonlinear spiking neuron behaviors emulated in these memristive devices are reviewed. Then, recent development is introduced on neuromorphic system with memristive neurons for sensing and computing. Finally, we discuss challenges and outlooks of the memristive neurons toward high-performance neuromorphic hardware systems and provide an insightful perspective for the development of interactive neuromorphic electronic systems.
Collapse
Affiliation(s)
- Zhiyuan Li
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| | - Wei Tang
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| | - Beining Zhang
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| | - Rui Yang
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
- CONTACT Rui Yang School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan430074, China; Hubei Yangtze Memory Laboratories, Wuhan 430205, China
| | - Xiangshui Miao
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| |
Collapse
|
41
|
Yang J, Zhang F, Xiao HM, Wang ZP, Xie P, Feng Z, Wang J, Mao J, Zhou Y, Han ST. A Perovskite Memristor with Large Dynamic Space for Analog-Encoded Image Recognition. ACS NANO 2022; 16:21324-21333. [PMID: 36519795 DOI: 10.1021/acsnano.2c09569] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Reservoir computing (RC) is a computational architecture capable of efficiently processing temporal information, which allows low-cost hardware implementation. However, the previously reported memristor-based RC mostly utilized binarized data sets to reduce the difficulty of signal processing of the memristor, which inevitably induces data distortion to a certain extent, leading to poor network computing performance. Here, we report on a RC system in a fully memristive architecture based on solution-processed perovskite memristors. The perovskite memristor exhibits 10000 conductance states with a modulation range of more than 4 orders of magnitude. The obtained tens of thousands of finely spaced conductance states with a near-ideal analog property provide a sufficiently large dynamic range and enough intermediate states, which were further applied as a reservoir to map the feature information on different sequential inputs in an analog way. The computing capability of the image classification task of a Fashion-MNIST data set with a high recognition accuracy of up to 90.1% shows that the excellent analog and short-term properties of our perovskite memristor allow the hardware implementation of neuromorphic computing with a reduced training cost.
Collapse
Affiliation(s)
- Jiaqin Yang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Fan Zhang
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Hao-Min Xiao
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Zhan-Peng Wang
- Institute for Advanced Study, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Peng Xie
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Zihao Feng
- Institute for Advanced Study, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Junjie Wang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Jingyu Mao
- Department of Physics, National University of Singapore, Singapore 117542, Singapore
| | - Ye Zhou
- Institute for Advanced Study, Shenzhen University, Shenzhen 518060, People's Republic of China
| | - Su-Ting Han
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518060, People's Republic of China
| |
Collapse
|
42
|
Li H, Hu J, Chen A, Wang C, Chen L, Tian F, Zhou J, Zhao Y, Chen J, Tong Y, Loh KP, Xu Y, Zhang Y, Hasan T, Yu B. Single-Transistor Neuron with Excitatory-Inhibitory Spatiotemporal Dynamics Applied for Neuronal Oscillations. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2022; 34:e2207371. [PMID: 36217845 DOI: 10.1002/adma.202207371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 10/02/2022] [Indexed: 06/16/2023]
Abstract
Brain-inspired neuromorphic computing systems with the potential to drive the next wave of artificial intelligence demand a spectrum of critical components beyond simple characteristics. An emerging research trend is to achieve advanced functions with ultracompact neuromorphic devices. In this work, a single-transistor neuron is demonstrated that implements excitatory-inhibitory (E-I) spatiotemporal integration and a series of essential neuron behaviors. Neuronal oscillations, the fundamental mode of neuronal communication, that construct high-dimensional population code to achieve efficient computing in the brain, can also be demonstrated by the neuron transistors. The highly scalable E-I neuron can be the basic building block for implementing core neuronal circuit motifs and large-scale architectural plans to replicate energy-efficient neural computations, forming the foundation of future integrated neuromorphic systems.
Collapse
Affiliation(s)
- Hanxi Li
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| | - Jiayang Hu
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| | - Anzhe Chen
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| | - Chenhao Wang
- School of Materials Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Li Chen
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| | - Feng Tian
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
- Joint Institute of Zhejiang University and University of Illinois at Urbana-Champaign, Zhejiang University, Haining, 314400, China
| | - Jiachao Zhou
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| | - Yuda Zhao
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| | - Jinrui Chen
- Cambridge Graphene Centre, Cambridge University Engineering Department, Cambridge, CB3 0FA, UK
| | - Yi Tong
- Technology Development Department, Gusu Laboratory of Materials, Suzhou, 215000, China
| | - Kian Ping Loh
- Department of Chemistry, National University of Singapore, Singapore, 119077, Singapore
| | - Yang Xu
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
- Joint Institute of Zhejiang University and University of Illinois at Urbana-Champaign, Zhejiang University, Haining, 314400, China
| | - Yishu Zhang
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| | - Tawfique Hasan
- Cambridge Graphene Centre, Cambridge University Engineering Department, Cambridge, CB3 0FA, UK
| | - Bin Yu
- School of Micro-Nano Electronics, Zhejiang University, Hangzhou, 310027, China
- ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou, 310027, China
| |
Collapse
|
43
|
Puri V, Kanojia N, Sharma A, Huanbutta K, Dheer D, Sangnim T. Natural product-based pharmacological studies for neurological disorders. Front Pharmacol 2022; 13:1011740. [PMID: 36419628 PMCID: PMC9676372 DOI: 10.3389/fphar.2022.1011740] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Accepted: 10/18/2022] [Indexed: 11/07/2023] Open
Abstract
Central nervous system (CNS) disorders and diseases are expected to rise sharply in the coming years, partly because of the world's aging population. Medicines for the treatment of the CNS have not been successfully made. Inadequate knowledge about the brain, pharmacokinetic and dynamic errors in preclinical studies, challenges with clinical trial design, complexity and variety of human brain illnesses, and variations in species are some potential scenarios. Neurodegenerative diseases (NDDs) are multifaceted and lack identifiable etiological components, and the drugs developed to treat them did not meet the requirements of those who anticipated treatments. Therefore, there is a great demand for safe and effective natural therapeutic adjuvants. For the treatment of NDDs and other memory-related problems, many herbal and natural items have been used in the Ayurvedic medical system. Anxiety, depression, Parkinson's, and Alzheimer's diseases (AD), as well as a plethora of other neuropsychiatric disorders, may benefit from the use of plant and food-derived chemicals that have antidepressant or antiepileptic properties. We have summarized the present level of knowledge about natural products based on topological evidence, bioinformatics analysis, and translational research in this review. We have also highlighted some clinical research or investigation that will help us select natural products for the treatment of neurological conditions. In the present review, we have explored the potential efficacy of phytoconstituents against neurological diseases. Various evidence-based studies and extensive recent investigations have been included, which will help pharmacologists reduce the progression of neuronal disease.
Collapse
Affiliation(s)
- Vivek Puri
- Chitkara School of Pharmacy, Chitkara University, Baddi, Himachal Pradesh, India
| | - Neha Kanojia
- Chitkara School of Pharmacy, Chitkara University, Baddi, Himachal Pradesh, India
| | - Ameya Sharma
- Chitkara School of Pharmacy, Chitkara University, Baddi, Himachal Pradesh, India
| | - Kampanart Huanbutta
- School of Pharmacy, Eastern Asia University, Rangsit, Pathum Thani, Thailand
| | - Divya Dheer
- Chitkara School of Pharmacy, Chitkara University, Baddi, Himachal Pradesh, India
| | - Tanikan Sangnim
- Faculty of Pharmaceutical Sciences, Burapha University, Muang, Chon Buri, Thailand
| |
Collapse
|
44
|
Wang D, Wang Z, Xu N, Liu L, Lin H, Zhao X, Jiang S, Lin W, Gao N, Liu M, Xing G. Synergy of Spin-Orbit Torque and Built-In Field in Magnetic Tunnel Junctions with Tilted Magnetic Anisotropy: Toward Tunable and Reliable Spintronic Neurons. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2203006. [PMID: 35927016 PMCID: PMC9596820 DOI: 10.1002/advs.202203006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/21/2022] [Revised: 07/09/2022] [Indexed: 06/15/2023]
Abstract
Owing to programmable nonlinear dynamics, magnetic domain wall (DW)-based devices can be configured to function as spintronic neurons, promising to execute sophisticated tasks as a human brain. Developing energy-efficient, CMOS compatible, reliable, and tunable spintronic neurons to emulate brain-inspired processes has been a key research goal for decades. Here, a new type of DW device is reported with biological neuron characteristics driven by the synergistic interaction between spin-orbit torque and built-in field (Hbuilt-in ) in magnetic tunnel junctions, enabling time- and energy-efficient leaky-integrate-and-fire and self-reset neuromorphic implementations. A tilted magnetic anisotropic free layer is proposed and further executed to mitigate the DW retrograde motion by suppressing the Walker breakdown. Complementary experiments and micromagnetic co-simulation results show that the integrating/leaking time of the developed spintronic neuron can be tuned to 12/15 ns with an integrating power consumption of 65 µW, which is 36× and 1.84× time and energy efficient than the state-of-the-art alternatives, respectively. Moreover, the spatial distribution of Hbuilt-in can be modulated by adjusting the width and compensation of the reference layer, facilitating tunable activation function generator exploration. Such architecture demonstrates great potential in both fundamental research and new trajectories of technology advancement for spintronic neuron hardware applications.
Collapse
Affiliation(s)
- Di Wang
- Key Laboratory of Microelectronic Devices and Integrated TechnologyInstitute of MicroelectronicsChinese Academy of SciencesBeijing100029China
- School of Integrated CircuitsUniversity of Chinese Academy of SciencesBeijing100049China
| | - Ziwei Wang
- Key Laboratory of Microelectronic Devices and Integrated TechnologyInstitute of MicroelectronicsChinese Academy of SciencesBeijing100029China
- School of Integrated CircuitsUniversity of Chinese Academy of SciencesBeijing100049China
| | - Nuo Xu
- Department of Electrical Engineering and Computer SciencesUniversity of CaliforniaBerkeleyCA94720USA
| | - Long Liu
- Key Laboratory of Microelectronic Devices and Integrated TechnologyInstitute of MicroelectronicsChinese Academy of SciencesBeijing100029China
- School of Integrated CircuitsUniversity of Chinese Academy of SciencesBeijing100049China
| | - Huai Lin
- Key Laboratory of Microelectronic Devices and Integrated TechnologyInstitute of MicroelectronicsChinese Academy of SciencesBeijing100029China
- School of Integrated CircuitsUniversity of Chinese Academy of SciencesBeijing100049China
| | - Xuefeng Zhao
- Key Laboratory of Microelectronic Devices and Integrated TechnologyInstitute of MicroelectronicsChinese Academy of SciencesBeijing100029China
- School of MicroelectronicsUniversity of Science and Technology of ChinaHefei230026China
| | - Sheng Jiang
- School of MicroelectronicsNorthwestern Polytechnical UniversityXi'an710072China
| | - Weinan Lin
- Department of PhysicsXiamen UniversityXiamen361005China
| | - Nan Gao
- School of MicroelectronicsUniversity of Science and Technology of ChinaHefei230026China
| | - Ming Liu
- School of Integrated CircuitsUniversity of Chinese Academy of SciencesBeijing100049China
| | - Guozhong Xing
- Key Laboratory of Microelectronic Devices and Integrated TechnologyInstitute of MicroelectronicsChinese Academy of SciencesBeijing100029China
- School of Integrated CircuitsUniversity of Chinese Academy of SciencesBeijing100049China
| |
Collapse
|
45
|
Wang W, Gao S, Wang Y, Li Y, Yue W, Niu H, Yin F, Guo Y, Shen G. Advances in Emerging Photonic Memristive and Memristive-Like Devices. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2105577. [PMID: 35945187 PMCID: PMC9534950 DOI: 10.1002/advs.202105577] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 06/06/2022] [Indexed: 05/19/2023]
Abstract
Possessing the merits of high efficiency, low consumption, and versatility, emerging photonic memristive and memristive-like devices exhibit an attractive future in constructing novel neuromorphic computing and miniaturized bionic electronic system. Recently, the potential of various emerging materials and structures for photonic memristive and memristive-like devices has attracted tremendous research efforts, generating various novel theories, mechanisms, and applications. Limited by the ambiguity of the mechanism and the reliability of the material, the development and commercialization of such devices are still rare and in their infancy. Therefore, a detailed and systematic review of photonic memristive and memristive-like devices is needed to further promote its development. In this review, the resistive switching mechanisms of photonic memristive and memristive-like devices are first elaborated. Then, a systematic investigation of the active materials, which induce a pivotal influence in the overall performance of photonic memristive and memristive-like devices, is highlighted and evaluated in various indicators. Finally, the recent advanced applications are summarized and discussed. In a word, it is believed that this review provides an extensive impact on many fields of photonic memristive and memristive-like devices, and lay a foundation for academic research and commercial applications.
Collapse
Affiliation(s)
- Wenxiao Wang
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Song Gao
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Yaqi Wang
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Yang Li
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Wenjing Yue
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Hongsen Niu
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Feifei Yin
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Yunjian Guo
- School of Information Science and EngineeringShandong Provincial Key Laboratory of Network Based Intelligent ComputingUniversity of JinanJinan250022China
| | - Guozhen Shen
- School of Integrated Circuits and ElectronicsBeijing Institute of TechnologyBeijing100081China
| |
Collapse
|
46
|
Yuan M, Luo X, Hu J, Wang S. Projective quasi-synchronization of coupled memristive neural networks with uncertainties and impulsive effect. Front Neurorobot 2022; 16:985312. [PMID: 36160287 PMCID: PMC9500366 DOI: 10.3389/fnbot.2022.985312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Accepted: 08/15/2022] [Indexed: 11/13/2022] Open
Abstract
The dynamic behavior of memristive neural networks (MNNs), including synchronization, effectively keeps the robotic stability against numerous uncertainties from the mimic of the human brain. However, it is challenging to perform projective quasi-synchronization of coupled MNNs with low-consumer control devices. This is partly because complete synchronization is difficult to realize under various projective factors and parameter mismatch. This article aims to investigate projective quasi-synchronization from the perspective of the controller. Here, two approaches are considered to find the event-triggered scheme for lag synchronization of coupled MNNs. In the first approach, the projective quasi-synchronization issue is formulated for coupled MNNs for the first time, where the networks are combined with time-varying delays and uncertainties under the constraints imposed by the frequency of controller updates within limited system communication resources. It is shown that our methods can avoid the Zeno-behavior under the newly determined triggered functions. In the second approach, following classical methods, a novel projective quasi-synchronization criterion that combines the nonlinear property of the memristor and the framework of Lyapunov-Krasovskii functional (LKF) is proposed. Simulation results indicate that the proposed two approaches are useful for coupled MNNs, and they have less control cost for different types of quasi-synchronization.
Collapse
Affiliation(s)
- Manman Yuan
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China
- Shunde Graduate School, University of Science and Technology Beijing, Foshan, China
- Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China
| | - Xiong Luo
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China
- Shunde Graduate School, University of Science and Technology Beijing, Foshan, China
- Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China
| | - Jun Hu
- School of Economics and Management, Fuzhou University, Fuzhou, China
| | - Songxin Wang
- School of Information Management and Engineering, Shanghai University of Finance and Economics, Shanghai, China
| |
Collapse
|
47
|
A calibratable sensory neuron based on epitaxial VO 2 for spike-based neuromorphic multisensory system. Nat Commun 2022; 13:3973. [PMID: 35803938 PMCID: PMC9270461 DOI: 10.1038/s41467-022-31747-w] [Citation(s) in RCA: 49] [Impact Index Per Article: 24.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 06/29/2022] [Indexed: 11/08/2022] Open
Abstract
Neuromorphic perception systems inspired by biology have tremendous potential in efficiently processing multi-sensory signals from the physical world, but a highly efficient hardware element capable of sensing and encoding multiple physical signals is still lacking. Here, we report a spike-based neuromorphic perception system consisting of calibratable artificial sensory neurons based on epitaxial VO2, where the high crystalline quality of VO2 leads to significantly improved cycle-to-cycle uniformity. A calibration resistor is introduced to optimize device-to-device consistency, and to adapt the VO2 neuron to different sensors with varied resistance level, a scaling resistor is further incorporated, demonstrating cross-sensory neuromorphic perception component that can encode illuminance, temperature, pressure and curvature signals into spikes. These components are utilized to monitor the curvatures of fingers, thereby achieving hand gesture classification. This study addresses the fundamental cycle-to-cycle and device-to-device variation issues of sensory neurons, therefore promoting the construction of neuromorphic perception systems for e-skin and neurorobotics.
Collapse
|
48
|
Fang X, Tan Y, Zhang F, Duan S, Wang L. Transient Response and Firing Behaviors of Memristive Neuron Circuit. Front Neurosci 2022; 16:922086. [PMID: 35812218 PMCID: PMC9257141 DOI: 10.3389/fnins.2022.922086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2022] [Accepted: 05/30/2022] [Indexed: 11/13/2022] Open
Abstract
The signal transmission mechanism of the Resistor-Capacitor (RC) circuit is similar to the intracellular and extracellular signal propagating mechanism of the neuron. Thus, the RC circuit can be utilized as the circuit model of the neuron cell membrane. However, resistors are electronic components with the fixed-resistance and have no memory properties. A memristor is a promising neuro-morphological electronic device with nonvolatile, switching, and nonlinear characteristics. First of all, we consider replacing the resistor in the RC neuron circuit with a memristor, which is named the Memristor-Capacitor (MC) circuit, then the MC neuron model is constructed. We compare the charging and discharging processes between the RC and MC neuron circuits. Secondly, two models are compared under the different external stimuli. Finally, the synchronous and asynchronous activities of the RC and MC neuron circuits are performed. Extensive experimental results suggest that the charging and discharging speed of the MC neuron circuit is faster than that of the RC neuron circuit. Given sufficient time and proper external stimuli, the RC and MC neuron circuits can produce the action potentials. The synchronous and asynchronous phenomena in the two neuron circuits reproduce nonlinear dynamic behaviors of the biological neurons.
Collapse
Affiliation(s)
- Xiaoyan Fang
- College of Artificial Intelligence, Southwest University, Chongqing, China
| | - Yao Tan
- Department of Big Data and Machine Learning, Chongqing University of Technology, Chongqing, China
| | - Fengqing Zhang
- College of Artificial Intelligence, Southwest University, Chongqing, China
| | - Shukai Duan
- College of Artificial Intelligence, Southwest University, Chongqing, China
| | - Lidan Wang
- College of Artificial Intelligence, Southwest University, Chongqing, China
- *Correspondence: Lidan Wang
| |
Collapse
|
49
|
Zhao X, Chai C, Qin J, Guo Y, Wang C, Gao R, Cong Y, Song Y. NiFe Alloy Electrocatalysts toward Efficient Alkaline Hydrogen Oxidation. Eur J Inorg Chem 2022. [DOI: 10.1002/ejic.202200242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Xinwei Zhao
- Dalian University of Technology State Key Laboratory of Fine Chemicals, School of Chemical Engineering CHINA
| | - Chunxiao Chai
- Dalian University of Technology State Key Laboratory of Fine Chemicals, School of Chemical Engineering, CHINA
| | - Jiaqi Qin
- Dalian University of Technology State Key Laboratory of Fine Chemicals, School of Chemical Engineering CHINA
| | - Yizheng Guo
- Dalian University of Technology State Key Laboratory of Fine Chemicals, School of Chemical Engineering CHINA
| | - Chunxiao Wang
- Dalian University of Technology State Key Laboratory of Fine Chemicals, School of Chemical Engineering CHINA
| | - Rui Gao
- Dalian University of Technology State Key Laboratory of Fine Chemicals, School of Chemical Engineering CHINA
| | - Yuanyuan Cong
- Lanzhou University of Technology School of Petrochemical Technology CHINA
| | - Yujiang Song
- Dalian University of Technology State Key Laboratory of Fine Chemicals 2 Linggong Road116024中国 116024 Dalian CHINA
| |
Collapse
|
50
|
Wang X, Li H. A complementary resistive switching neuron. NANOTECHNOLOGY 2022; 33:355201. [PMID: 35605579 DOI: 10.1088/1361-6528/ac7241] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 05/22/2022] [Indexed: 06/15/2023]
Abstract
The complementary resistive switching (CRS) memristor has originally been proposed for use as the storage element or artificial synapse in large-scale crossbar array with the capability of solving the sneak path problem, but its usage has mainly been hampered by the inherent destructiveness of the read operation (switching '1' state to 'ON' or '0' state). Taking a different perspective on this 'undesired' property, we here report on the inherent behavioral similarity between the CRS memristor and a leaky integrate-and-fire (LIF) neuron which is another basic neural computing element, in addition to synapse. In particular, the mechanism behind the undesired read destructiveness for storage element and artificial synapse can be exploited to naturally realize the LIF and the ensuing spontaneous repolarization processes, followed by a refractory period. By means of this biological similarity, we demonstrate a Pt/Ta2O5-x/TaOy/Ta CRS memristor that can exhibit these neuronal behaviors and perform various fundamental neuronal operations, including additive/subtractive operations and coincidence detection. These results suggest that the CRS neuron, with its bio-interpretability, is a useful addition to the family of memristive neurons.
Collapse
Affiliation(s)
- Xinxin Wang
- Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, Beijing, 100084, People's Republic of China
| | - Huanglong Li
- Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, Beijing, 100084, People's Republic of China
- Chinese Institute for Brain Research, Beijing 102206, People's Republic of China
| |
Collapse
|