1
|
Zhuge C, Zhang Y, Jiang J, Li X, Zhao Y, Fu Y, Wang Q, He D. Reliable Low-Current and Multilevel Memristive Electrochemical Neuromorphic Devices with Semi-Metal Sb Filament. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2024; 20:e2400599. [PMID: 38860549 DOI: 10.1002/smll.202400599] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 06/01/2024] [Indexed: 06/12/2024]
Abstract
Memristors are used in artificial neural networks owing to their exceptional integration capabilities and scalability. However, traditional memristors are hampered by limited resistance states and randomness, which curtails their application. The migration of metal ions critically influences the number of conductance states and the linearity of weight updates. Semi-metal filaments can provide subquantum conductance changes to the memristors due to the smaller single-atom conductance, such as Sb (≈0.01 G0 = 7.69 × 10-7 S). Here, a memristor featuring an active electrode composed of semi-metal Sb is introduced for the first time. This memristor demonstrates precise conductance control, a large on/off ratio, consistent switching, and prolonged retention exceeding 105 s. Density functional theory (DFT) calculations and characterization methods reveal the formation of Sb filaments during a set process. The interaction between Sb and O within the dielectric layer facilitates the Sb filaments' ability to preserve their morphology in the absence of electric fields.
Collapse
Affiliation(s)
- Chenyu Zhuge
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| | - Yukun Zhang
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| | - Jiandong Jiang
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| | - Xiang Li
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| | - Yanfei Zhao
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| | - Yujun Fu
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| | - Qi Wang
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| | - Deyan He
- School of Materials and Energy, Lanzhou University, Lanzhou, 730000, China
| |
Collapse
|
2
|
Park J, Kumar A, Zhou Y, Oh S, Kim JH, Shi Y, Jain S, Hota G, Qiu E, Nagle AL, Schuller IK, Schuman CD, Cauwenberghs G, Kuzum D. Multi-level, forming and filament free, bulk switching trilayer RRAM for neuromorphic computing at the edge. Nat Commun 2024; 15:3492. [PMID: 38664381 PMCID: PMC11045755 DOI: 10.1038/s41467-024-46682-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Accepted: 03/06/2024] [Indexed: 04/28/2024] Open
Abstract
CMOS-RRAM integration holds great promise for low energy and high throughput neuromorphic computing. However, most RRAM technologies relying on filamentary switching suffer from variations and noise, leading to computational accuracy loss, increased energy consumption, and overhead by expensive program and verify schemes. We developed a filament-free, bulk switching RRAM technology to address these challenges. We systematically engineered a trilayer metal-oxide stack and investigated the switching characteristics of RRAM with varying thicknesses and oxygen vacancy distributions to achieve reliable bulk switching without any filament formation. We demonstrated bulk switching at megaohm regime with high current nonlinearity, up to 100 levels without compliance current. We developed a neuromorphic compute-in-memory platform and showcased edge computing by implementing a spiking neural network for an autonomous navigation/racing task. Our work addresses challenges posed by existing RRAM technologies and paves the way for neuromorphic computing at the edge under strict size, weight, and power constraints.
Collapse
Affiliation(s)
- Jaeseoung Park
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA
| | - Ashwani Kumar
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA
| | - Yucheng Zhou
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA
| | - Sangheon Oh
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA
| | - Jeong-Hoon Kim
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA
| | - Yuhan Shi
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA
| | - Soumil Jain
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Gopabandhu Hota
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA
| | - Erbin Qiu
- Department of Physics, University of California San Diego, La Jolla, CA, USA
| | - Amelie L Nagle
- Department of Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Ivan K Schuller
- Department of Physics, University of California San Diego, La Jolla, CA, USA
| | - Catherine D Schuman
- Department of Electrical Engineering and Computer Science, University of Tennessee, Knoxville, TN, USA
| | - Gert Cauwenberghs
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Duygu Kuzum
- Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA.
| |
Collapse
|
3
|
Kim D, Lee CB, Park KK, Bang H, Truong PL, Lee J, Jeong BH, Kim H, Won SM, Kim DH, Lee D, Ko JH, Baac HW, Kim K, Park HJ. Highly Reliable 3D Channel Memory and Its Application in a Neuromorphic Sensory System for Hand Gesture Recognition. ACS NANO 2023; 17:24826-24840. [PMID: 38060577 DOI: 10.1021/acsnano.3c05493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2023]
Abstract
Brain-inspired neuromorphic computing systems, based on a crossbar array of two-terminal multilevel resistive random-access memory (RRAM), have attracted attention as promising technologies for processing large amounts of unstructured data. However, the low reliability and inferior conductance tunability of RRAM, caused by uncontrollable metal filament formation in the uneven switching medium, result in lower accuracy compared to the software neural network (SW-NN). In this work, we present a highly reliable CoOx-based multilevel RRAM with an optimized crystal size and density in the switching medium, providing a three-dimensional (3D) grain boundary (GB) network. This design enhances the reliability of the RRAM by improving the cycle-to-cycle endurance and device-to-device stability of the I-V characteristics with minimal variation. Furthermore, the designed 3D GB-channel RRAM (3D GB-RRAM) exhibits excellent conductance tunability, demonstrating high symmetricity (624), low nonlinearity (βLTP/βLTD ∼ 0.20/0.39), and a large dynamic range (Gmax/Gmin ∼ 31.1). The cyclic stability of long-term potentiation and depression also exceeds 100 cycles (105 voltage pulses), and the relative standard deviation of Gmax/Gmin is only 2.9%. Leveraging these superior reliability and performance attributes, we propose a neuromorphic sensory system for finger motion tracking and hand gesture recognition as a potential elemental technology for the metaverse. This system consists of a stretchable double-layered photoacoustic strain sensor and a crossbar array neural network. We perform training and recognition tasks on ultrasonic patterns associated with finger motion and hand gestures, attaining a recognition accuracy of 97.9% and 97.4%, comparable to that of SW-NN (99.8% and 98.7%).
Collapse
Affiliation(s)
- Dohyung Kim
- Department of Organic and Nano Engineering & Human-Tech Convergence Program, Hanyang University, Seoul 04763, Korea
| | - Cheong Beom Lee
- Department of Chemical Engineering, Hanyang University, Seoul 04763, Korea
| | - Kyu Kwan Park
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Korea
| | - Hyeonsu Bang
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Korea
| | - Phuoc Loc Truong
- Department of Mechanical Engineering, Gachon University, Gyeonggi 13120, Korea
| | - Jongmin Lee
- Department of Organic and Nano Engineering & Human-Tech Convergence Program, Hanyang University, Seoul 04763, Korea
| | - Bum Ho Jeong
- Department of Organic and Nano Engineering & Human-Tech Convergence Program, Hanyang University, Seoul 04763, Korea
| | - Hakjun Kim
- Department of Organic and Nano Engineering & Human-Tech Convergence Program, Hanyang University, Seoul 04763, Korea
| | - Sang Min Won
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Korea
| | - Do Hwan Kim
- Department of Chemical Engineering, Hanyang University, Seoul 04763, Korea
| | - Daeho Lee
- Department of Mechanical Engineering, Gachon University, Gyeonggi 13120, Korea
| | - Jong Hwan Ko
- College of Information and Communication Engineering, Sungkyunkwan University, Suwon 16419, Korea
| | - Hyoung Won Baac
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Korea
| | - Kyeounghak Kim
- Department of Chemical Engineering, Hanyang University, Seoul 04763, Korea
| | - Hui Joon Park
- Department of Organic and Nano Engineering & Human-Tech Convergence Program, Hanyang University, Seoul 04763, Korea
| |
Collapse
|
4
|
Li J, Abbas H, Ang DS, Ali A, Ju X. Emerging memristive artificial neuron and synapse devices for the neuromorphic electronics era. NANOSCALE HORIZONS 2023; 8:1456-1484. [PMID: 37615055 DOI: 10.1039/d3nh00180f] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/25/2023]
Abstract
Growth of data eases the way to access the world but requires increasing amounts of energy to store and process. Neuromorphic electronics has emerged in the last decade, inspired by biological neurons and synapses, with in-memory computing ability, extenuating the 'von Neumann bottleneck' between the memory and processor and offering a promising solution to reduce the efforts both in data storage and processing, thanks to their multi-bit non-volatility, biology-emulated characteristics, and silicon compatibility. This work reviews the recent advances in emerging memristive devices for artificial neuron and synapse applications, including memory and data-processing ability: the physics and characteristics are discussed first, i.e., valence changing, electrochemical metallization, phase changing, interfaced-controlling, charge-trapping, ferroelectric tunnelling, and spin-transfer torquing. Next, we propose a universal benchmark for the artificial synapse and neuron devices on spiking energy consumption, standby power consumption, and spike timing. Based on the benchmark, we address the challenges, suggest the guidelines for intra-device and inter-device design, and provide an outlook for the neuromorphic applications of resistive switching-based artificial neuron and synapse devices.
Collapse
Affiliation(s)
- Jiayi Li
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Haider Abbas
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Diing Shenp Ang
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Asif Ali
- School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798.
| | - Xin Ju
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Singapore 138634
| |
Collapse
|
5
|
Haensch W, Raghunathan A, Roy K, Chakrabarti B, Phatak CM, Wang C, Guha S. Compute in-Memory with Non-Volatile Elements for Neural Networks: A Review from a Co-Design Perspective. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2204944. [PMID: 36579797 DOI: 10.1002/adma.202204944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 11/01/2022] [Indexed: 06/17/2023]
Abstract
Deep learning has become ubiquitous, touching daily lives across the globe. Today, traditional computer architectures are stressed to their limits in efficiently executing the growing complexity of data and models. Compute-in-memory (CIM) can potentially play an important role in developing efficient hardware solutions that reduce data movement from compute-unit to memory, known as the von Neumann bottleneck. At its heart is a cross-bar architecture with nodal non-volatile-memory elements that performs an analog multiply-and-accumulate operation, enabling the matrix-vector-multiplications repeatedly used in all neural network workloads. The memory materials can significantly influence final system-level characteristics and chip performance, including speed, power, and classification accuracy. With an over-arching co-design viewpoint, this review assesses the use of cross-bar based CIM for neural networks, connecting the material properties and the associated design constraints and demands to application, architecture, and performance. Both digital and analog memory are considered, assessing the status for training and inference, and providing metrics for the collective set of properties non-volatile memory materials will need to demonstrate for a successful CIM technology.
Collapse
Affiliation(s)
- Wilfried Haensch
- Materials Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA
| | - Anand Raghunathan
- Department of Electrical Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Kaushik Roy
- Department of Electrical Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Bhaswar Chakrabarti
- Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, Tamil Nadu, 600036, India
| | - Charudatta M Phatak
- Materials Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA
| | - Cheng Wang
- Department of Electrical Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Supratik Guha
- Materials Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA
- Pritzker School of Molecular Engineering, University of Chicago, Chicago, IL, 60637, USA
| |
Collapse
|
6
|
Zhang H, Jiang B, Cheng C, Huang B, Zhang H, Chen R, Xu J, Huang Y, Chen H, Pei W, Chai Y, Zhou F. A Self-Rectifying Synaptic Memristor Array with Ultrahigh Weight Potentiation Linearity for a Self-Organizing-Map Neural Network. NANO LETTERS 2023; 23:3107-3115. [PMID: 37042482 DOI: 10.1021/acs.nanolett.2c03624] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Two-terminal self-rectifying (SR)-synaptic memristors are preeminent candidates for high-density and efficient neuromorphic computing, especially for future three-dimensional integrated systems, which can self-suppress the sneak path current in crossbar arrays. However, SR-synaptic memristors face the critical challenges of nonlinear weight potentiation and steep depression, hindering their application in conventional artificial neural networks (ANNs). Here, a SR-synaptic memristor (Pt/NiOx/WO3-x:Ti/W) and cross-point array with sneak path current suppression features and ultrahigh-weight potentiation linearity up to 0.9997 are introduced. The image contrast enhancement and background filtering are demonstrated on the basis of the device array. Moreover, an unsupervised self-organizing map (SOM) neural network is first developed for orientation recognition with high recognition accuracy (0.98) and training efficiency and high resilience toward both noises and steep synaptic depression. These results solve the challenges of SR memristors in the conventional ANN, extending the possibilities of large-scale oxide SR-synaptic arrays for high-density, efficient, and accurate neuromorphic computing.
Collapse
Affiliation(s)
- Hengjie Zhang
- School of Microelectronics, Southern University of Science and Technology, Shenzhen 518000, People's Republic of China
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Biyi Jiang
- School of Microelectronics, Southern University of Science and Technology, Shenzhen 518000, People's Republic of China
- Department of Applied Physics, The Hong Kong Polytechnic University, Hong Kong SAR 999077, People's Republic of China
| | - Chuantong Cheng
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Beiju Huang
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Huan Zhang
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Run Chen
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Jiayi Xu
- School of Microelectronics, Southern University of Science and Technology, Shenzhen 518000, People's Republic of China
| | - Yulong Huang
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Hongda Chen
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Weihua Pei
- The State Key Laboratory on Integrated Optoelectronics, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, People's Republic of China
- College of Materials Science and Optoelectronic Technology, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
| | - Yang Chai
- Department of Applied Physics, The Hong Kong Polytechnic University, Hong Kong SAR 999077, People's Republic of China
| | - Feichi Zhou
- School of Microelectronics, Southern University of Science and Technology, Shenzhen 518000, People's Republic of China
| |
Collapse
|
7
|
Khan AI, Yu H, Zhang H, Goggin JR, Kwon H, Wu X, Perez C, Neilson KM, Asheghi M, Goodson KE, Vora PM, Davydov A, Takeuchi I, Pop E. Energy Efficient Neuro-Inspired Phase-Change Memory Based on Ge 4 Sb 6 Te 7 as a Novel Epitaxial Nanocomposite. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023:e2300107. [PMID: 36720651 DOI: 10.1002/adma.202300107] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Indexed: 06/17/2023]
Abstract
Phase-change memory (PCM) is a promising candidate for neuro-inspired, data-intensive artificial intelligence applications, which relies on the physical attributes of PCM materials including gradual change of resistance states and multilevel operation with low resistance drift. However, achieving these attributes simultaneously remains a fundamental challenge for PCM materials such as Ge2 Sb2 Te5 , the most commonly used material. Here bi-directional gradual resistance changes with ≈10× resistance window using low energy pulses are demonstrated in nanoscale PCM devices based on Ge4 Sb6 Te7 , a new phase-change nanocomposite material . These devices show 13 resistance levels with low resistance drift for the first 8 levels, a resistance on/off ratio of ≈1000, and low variability. These attributes are enabled by the unique microstructural and electro-thermal properties of Ge4 Sb6 Te7 , a nanocomposite consisting of epitaxial SbTe nanoclusters within the Ge-Sb-Te matrix, and a higher crystallization but lower melting temperature than Ge2 Sb2 Te5 . These results advance the pathway toward energy-efficient analog computing using PCM.
Collapse
Affiliation(s)
- Asir Intisar Khan
- Department of Electrical Engineering, Stanford University, Stanford, CA, 94305, USA
| | - Heshan Yu
- Department of Materials Science and Engineering, University of Maryland, College Park, MD, 20742, USA
| | - Huairuo Zhang
- Materials Science and Engineering Division, National Institute of Standards and Technology, Gaithersburg, MD, 20899, USA
- Theiss Research, Inc., La Jolla, CA, 92037, USA
| | - John R Goggin
- Department of Physics and Astronomy, George Mason University, Fairfax, VA, 22030, USA
- Quantum Science and Engineering Center, George Mason University, Fairfax, VA, 22030, USA
| | - Heungdong Kwon
- Department of Mechanical Engineering, Stanford University, Stanford, CA, 94305, USA
| | - Xiangjin Wu
- Department of Electrical Engineering, Stanford University, Stanford, CA, 94305, USA
| | - Christopher Perez
- Department of Mechanical Engineering, Stanford University, Stanford, CA, 94305, USA
| | - Kathryn M Neilson
- Department of Electrical Engineering, Stanford University, Stanford, CA, 94305, USA
| | - Mehdi Asheghi
- Department of Mechanical Engineering, Stanford University, Stanford, CA, 94305, USA
| | - Kenneth E Goodson
- Department of Mechanical Engineering, Stanford University, Stanford, CA, 94305, USA
| | - Patrick M Vora
- Department of Physics and Astronomy, George Mason University, Fairfax, VA, 22030, USA
- Quantum Science and Engineering Center, George Mason University, Fairfax, VA, 22030, USA
| | - Albert Davydov
- Materials Science and Engineering Division, National Institute of Standards and Technology, Gaithersburg, MD, 20899, USA
- Quantum Science and Engineering Center, George Mason University, Fairfax, VA, 22030, USA
| | - Ichiro Takeuchi
- Department of Materials Science and Engineering, University of Maryland, College Park, MD, 20742, USA
| | - Eric Pop
- Department of Electrical Engineering, Stanford University, Stanford, CA, 94305, USA
- Department of Materials Science & Engineering, Stanford University, Stanford, CA, 94305, USA
- Precourt Institute for Energy, Stanford University, Stanford, CA, 94305, USA
| |
Collapse
|
8
|
Hu B, Guan ZH, Chen G, Chen CLP. Neuroscience and Network Dynamics Toward Brain-Inspired Intelligence. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:10214-10227. [PMID: 33909581 DOI: 10.1109/tcyb.2021.3071110] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
This article surveys the interdisciplinary research of neuroscience, network science, and dynamic systems, with emphasis on the emergence of brain-inspired intelligence. To replicate brain intelligence, a practical way is to reconstruct cortical networks with dynamic activities that nourish the brain functions, instead of using only artificial computing networks. The survey provides a complex network and spatiotemporal dynamics (abbr. network dynamics) perspective for understanding the brain and cortical networks and, furthermore, develops integrated approaches of neuroscience and network dynamics toward building brain-inspired intelligence with learning and resilience functions. Presented are fundamental concepts and principles of complex networks, neuroscience, and hybrid dynamic systems, as well as relevant studies about the brain and intelligence. Other promising research directions, such as brain science, data science, quantum information science, and machine behavior are also briefly discussed toward future applications.
Collapse
|
9
|
Jang J, Gi S, Yeo I, Choi S, Jang S, Ham S, Lee B, Wang G. A Learning-Rate Modulable and Reliable TiO x Memristor Array for Robust, Fast, and Accurate Neuromorphic Computing. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2201117. [PMID: 35666073 PMCID: PMC9353447 DOI: 10.1002/advs.202201117] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Revised: 05/11/2022] [Indexed: 05/19/2023]
Abstract
Realization of memristor-based neuromorphic hardware system is important to achieve energy efficient bigdata processing and artificial intelligence in integrated device system-level. In this sense, uniform and reliable titanium oxide (TiOx ) memristor array devices are fabricated to be utilized as constituent device element in hardware neural network, representing passive matrix array structure enabling vector-matrix multiplication process between multisignal and trained synaptic weight. In particular, in situ convolutional neural network hardware system is designed and implemented using a multiple 25 × 25 TiOx memristor arrays and the memristor device parameters are developed to bring global constant voltage programming scheme for entire cells in crossbar array without any voltage tuning peripheral circuit such as transistor. Moreover, the learning rate modulation during in situ hardware training process is successfully achieved due to superior TiOx memristor performance such as threshold uniformity (≈2.7%), device yield (> 99%), repetitive stability (≈3000 spikes), low asymmetry value of ≈1.43, ambient stability (6 months), and nonlinear pulse response. The learning rate modulable fast-converging in situ training based on direct memristor operation shows five times less training iterations and reduces training energy compared to the conventional hardware in situ training at ≈95.2% of classification accuracy.
Collapse
Affiliation(s)
- Jingon Jang
- KU‐KIST Graduate School of Converging Science and TechnologyKorea University145, Anam‐ro, Seongbuk‐guSeoul02841Republic of Korea
| | - Sanggyun Gi
- School of Electrical Engineering and Computer ScienceGwangju Institute of Science and Technology123, Cheomdangwagi‐ro, Buk‐gu, Gwangju, Republic of KoreaBuk‐gu61005Republic of Korea
| | - Injune Yeo
- School of Electrical Engineering and Computer ScienceGwangju Institute of Science and Technology123, Cheomdangwagi‐ro, Buk‐gu, Gwangju, Republic of KoreaBuk‐gu61005Republic of Korea
| | - Sanghyeon Choi
- KU‐KIST Graduate School of Converging Science and TechnologyKorea University145, Anam‐ro, Seongbuk‐guSeoul02841Republic of Korea
| | - Seonghoon Jang
- KU‐KIST Graduate School of Converging Science and TechnologyKorea University145, Anam‐ro, Seongbuk‐guSeoul02841Republic of Korea
| | - Seonggil Ham
- KU‐KIST Graduate School of Converging Science and TechnologyKorea University145, Anam‐ro, Seongbuk‐guSeoul02841Republic of Korea
| | - Byunggeun Lee
- School of Electrical Engineering and Computer ScienceGwangju Institute of Science and Technology123, Cheomdangwagi‐ro, Buk‐gu, Gwangju, Republic of KoreaBuk‐gu61005Republic of Korea
| | - Gunuk Wang
- KU‐KIST Graduate School of Converging Science and TechnologyKorea University145, Anam‐ro, Seongbuk‐guSeoul02841Republic of Korea
- Department of Integrative Energy EngineeringKorea University145, Anam‐ro, Seongbuk‐guSeoul02841Republic of Korea
- Center for Neuromorphic EngineeringKorea Institute of Science and Technology5, Hwarang‐ro 14‐gil, Seongbuk‐guSeoul02792Republic of Korea
| |
Collapse
|
10
|
Andreeva NV, Ryndin EA, Mazing DS, Vilkov OY, Luchinin VV. Organismic Memristive Structures With Variable Functionality for Neuroelectronics. Front Neurosci 2022; 16:913618. [PMID: 35774561 PMCID: PMC9238295 DOI: 10.3389/fnins.2022.913618] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Accepted: 05/16/2022] [Indexed: 11/13/2022] Open
Abstract
In this paper, we report an approach to design nanolayered memristive compositions based on TiO2/Al2O3 bilayer structures with analog non-volatile and volatile tuning of the resistance. The structure of the TiO2 layer drives the physical mechanism underlying the non-volatile resistance switching, which can be changed from electronic to ionic, enabling the synaptic behavior emulation. The presence of the anatase phase in the amorphous TiO2 layer induces the resistive switching mechanism due to electronic processes. In this case, the switching of the resistance within the range of seven orders of magnitude is experimentally observed. In the bilayer with amorphous titanium dioxide, the participation of ionic processes in the switching mechanism results in narrowing the tuning range down to 2–3 orders of magnitude and increasing the operating voltages. In this way, a combination of TiO2/Al2O3 bilayers with inert electrodes enables synaptic behavior emulation, while active electrodes induce the neuronal behavior caused by cation density variation in the active Al2O3 layer of the structure. We consider that the proposed approach could help to explore the memristive capabilities of nanolayered compositions in a more functional way, enabling implementation of artificial neural network algorithms at the material level and simplifying neuromorphic layouts, while maintaining all benefits of neuromorphic architectures.
Collapse
Affiliation(s)
- Natalia V. Andreeva
- Department of Micro- and Nanoelectronics, Faculty of Electronics, Saint Petersburg State Electrotechnical University “LETI”, Saint Petersburg, Russia
- *Correspondence: Natalia V. Andreeva,
| | - Eugeny A. Ryndin
- Department of Micro- and Nanoelectronics, Faculty of Electronics, Saint Petersburg State Electrotechnical University “LETI”, Saint Petersburg, Russia
| | - Dmitriy S. Mazing
- Department of Micro- and Nanoelectronics, Faculty of Electronics, Saint Petersburg State Electrotechnical University “LETI”, Saint Petersburg, Russia
| | - Oleg Y. Vilkov
- Department of Solid State Electronics, Saint Petersburg State University, Saint Petersburg, Russia
| | - Victor V. Luchinin
- Department of Micro- and Nanoelectronics, Faculty of Electronics, Saint Petersburg State Electrotechnical University “LETI”, Saint Petersburg, Russia
| |
Collapse
|
11
|
Banerjee W, Kashir A, Kamba S. Hafnium Oxide (HfO 2 ) - A Multifunctional Oxide: A Review on the Prospect and Challenges of Hafnium Oxide in Resistive Switching and Ferroelectric Memories. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2022; 18:e2107575. [PMID: 35510954 DOI: 10.1002/smll.202107575] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 03/24/2022] [Indexed: 06/14/2023]
Abstract
Hafnium oxide (HfO2 ) is one of the mature high-k dielectrics that has been standing strong in the memory arena over the last two decades. Its dielectric properties have been researched rigorously for the development of flash memory devices. In this review, the application of HfO2 in two main emerging nonvolatile memory technologies is surveyed, namely resistive random access memory and ferroelectric memory. How the properties of HfO2 equip the former to achieve superlative performance with high-speed reliable switching, excellent endurance, and retention is discussed. The parameters to control HfO2 domains are further discussed, which can unleash the ferroelectric properties in memory applications. Finally, the prospect of HfO2 materials in emerging applications, such as high-density memory and neuromorphic devices are examined, and the various challenges of HfO2 -based resistive random access memory and ferroelectric memory devices are addressed with a future outlook.
Collapse
Affiliation(s)
- Writam Banerjee
- Center for Single Atom-based Semiconductor Device, Department of Material Science and Engineering, Pohang University of Science and Technology (POSTECH), Pohang, 37673, Republic of Korea
| | - Alireza Kashir
- Institute of Physics of the Czech Academy of Sciences, Na Slovance 2, Prague 8, 182 21, Czech Republic
| | - Stanislav Kamba
- Institute of Physics of the Czech Academy of Sciences, Na Slovance 2, Prague 8, 182 21, Czech Republic
| |
Collapse
|
12
|
Krishnaprasad A, Dev D, Han SS, Shen Y, Chung HS, Bae TS, Yoo C, Jung Y, Lanza M, Roy T. MoS 2 Synapses with Ultra-low Variability and Their Implementation in Boolean Logic. ACS NANO 2022; 16:2866-2876. [PMID: 35143159 DOI: 10.1021/acsnano.1c09904] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Brain-inspired computing enabled by memristors has gained prominence over the years due to the nanoscale footprint and reduced complexity for implementing synapses and neurons. The demonstration of complex neuromorphic circuits using conventional materials systems has been limited by high cycle-to-cycle and device-to-device variability. Two-dimensional (2D) materials have been used to realize transparent, flexible, ultra-thin memristive synapses for neuromorphic computing, but with limited knowledge on the statistical variation of devices. In this work, we demonstrate ultra-low-variability synapses using chemical vapor deposited 2D MoS2 as the switching medium with Ti/Au electrodes. These devices, fabricated using a transfer-free process, exhibit ultra-low variability in SET voltage, RESET power distribution, and synaptic weight update characteristics. This ultra-low variability is enabled by the interface rendered by a Ti/Au top contact on Si-rich MoS2 layers of mixed orientation, corroborated by transmission electron microscopy (TEM), electron energy loss spectroscopy (EELS), and X-ray photoelectron spectroscopy (XPS). TEM images further confirm the stability of the device stack even after subjecting the device to 100 SET-RESET cycles. Additionally, we implement logic gates by monolithic integration of MoS2 synapses with MoS2 leaky integrate-and-fire neurons to show the viability of these devices for non-von Neumann computing.
Collapse
Affiliation(s)
- Adithi Krishnaprasad
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida 32816, United States
| | - Durjoy Dev
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida 32816, United States
| | - Sang Sub Han
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida 32816, United States
| | - Yaqing Shen
- Institute of Functional Nano & Soft Materials, Soochow University, Suzhou 215123, China
| | - Hee-Suk Chung
- Analytical Research Division, Korea Basic Science Institute, Jeonju, Jeollabuk-do 54907, South Korea
| | - Tae-Sung Bae
- Analytical Research Division, Korea Basic Science Institute, Jeonju, Jeollabuk-do 54907, South Korea
| | - Changhyeon Yoo
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
| | - Yeonwoong Jung
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida 32816, United States
- Department of Materials Science and Engineering, University of Central Florida, Orlando, Florida 32816, United States
| | - Mario Lanza
- Department of Material Science and Engineering, King Abdullah University of Science and Technology, Thuwal 23955, Saudi Arabia
| | - Tania Roy
- NanoScience Technology Center, University of Central Florida, Orlando, Florida 32826, United States
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida 32816, United States
- Department of Materials Science and Engineering, University of Central Florida, Orlando, Florida 32816, United States
| |
Collapse
|
13
|
Lu XF, Zhang Y, Wang N, Luo S, Peng K, Wang L, Chen H, Gao W, Chen XH, Bao Y, Liang G, Loh KP. Exploring Low Power and Ultrafast Memristor on p-Type van der Waals SnS. NANO LETTERS 2021; 21:8800-8807. [PMID: 34644096 DOI: 10.1021/acs.nanolett.1c03169] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Memristor devices that exhibit high integration density, fast speed, and low power consumption are candidates for neuromorphic devices. Here, we demonstrate a filament-based memristor using p-type SnS as the resistive switching material, exhibiting superlative metrics such as a switching voltage ∼0.2 V, a switching speed faster than 1.5 ns, high endurance switching cycles, and an ultralarge on/off ratio of 108. The device exhibits a power consumption as low as ∼100 fJ per switch. Chip-level simulations of the memristor based on 32 × 32 high-density crossbar arrays with 50 nm feature size reveal on-chip learning accuracy of 87.76% (close to the ideal software accuracy 90%) for CIFAR-10 image classifications. The ultrafast and low energy switching of p-type SnS compared to n-type transition metal dichalcogenides is attributed to the presence of cation vacancies and van der Waals gap that lower the activation barrier for Ag ion migration.
Collapse
Affiliation(s)
- Xiu Fang Lu
- Department of Chemistry, National University of Singapore, Singapore 117543, Singapore
| | - Yishu Zhang
- Department of Chemistry, National University of Singapore, Singapore 117543, Singapore
| | - Naizhou Wang
- Division of Physics and Applied Physics, School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore 637371, Singapore
| | - Sheng Luo
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore 117576, Singapore
| | - Kunling Peng
- Department of Physics and Hefei National Laboratory for Physical Science at Microscale, University of Science and Technology of China, Hefei, Anhui 230026, P. R. China
| | - Lin Wang
- Department of Chemistry, National University of Singapore, Singapore 117543, Singapore
| | - Hao Chen
- Department of Chemistry, National University of Singapore, Singapore 117543, Singapore
| | - Weibo Gao
- Division of Physics and Applied Physics, School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore 637371, Singapore
| | - Xian Hui Chen
- Department of Physics and Hefei National Laboratory for Physical Science at Microscale, University of Science and Technology of China, Hefei, Anhui 230026, P. R. China
| | - Yang Bao
- State Key Laboratory of Luminescence and Applications, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Science, Changchun 130033, China
| | - Gengchiau Liang
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore 117576, Singapore
| | - Kian Ping Loh
- Department of Chemistry, National University of Singapore, Singapore 117543, Singapore
| |
Collapse
|
14
|
A new opportunity for the emerging tellurium semiconductor: making resistive switching devices. Nat Commun 2021; 12:6081. [PMID: 34667171 PMCID: PMC8526830 DOI: 10.1038/s41467-021-26399-1] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Accepted: 10/04/2021] [Indexed: 12/03/2022] Open
Abstract
The development of the resistive switching cross-point array as the next-generation platform for high-density storage, in-memory computing and neuromorphic computing heavily relies on the improvement of the two component devices, volatile selector and nonvolatile memory, which have distinct operating current requirements. The perennial current-volatility dilemma that has been widely faced in various device implementations remains a major bottleneck. Here, we show that the device based on electrochemically active, low-thermal conductivity and low-melting temperature semiconducting tellurium filament can solve this dilemma, being able to function as either selector or memory in respective desired current ranges. Furthermore, we demonstrate one-selector-one-resistor behavior in a tandem of two identical Te-based devices, indicating the potential of Te-based device as a universal array building block. These nonconventional phenomena can be understood from a combination of unique electrical-thermal properties in Te. Preliminary device optimization efforts also indicate large and unique design space for Te-based resistive switching devices. Resistive switching devices have great promise for a wide variety of technological applications. Here, Yang et al demonstrate that electrochemically induced tellurium filament can give rise to resistive switching, and show that devices based on this can provide a number of advantages compared to metallic filament-based devices.
Collapse
|
15
|
Tang Z, Zhu R, Hu R, Chen Y, Wu EQ, Wang H, He J, Huang Q, Chang S. A Multilayer Neural Network Merging Image Preprocessing and Pattern Recognition by Integrating Diffusion and Drift Memristors. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2020.3003377] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
16
|
Oh S, Shi Y, Del Valle J, Salev P, Lu Y, Huang Z, Kalcheim Y, Schuller IK, Kuzum D. Energy-efficient Mott activation neuron for full-hardware implementation of neural networks. NATURE NANOTECHNOLOGY 2021; 16:680-687. [PMID: 33737724 PMCID: PMC8627686 DOI: 10.1038/s41565-021-00874-8] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Accepted: 02/02/2021] [Indexed: 05/09/2023]
Abstract
To circumvent the von Neumann bottleneck, substantial progress has been made towards in-memory computing with synaptic devices. However, compact nanodevices implementing non-linear activation functions are required for efficient full-hardware implementation of deep neural networks. Here, we present an energy-efficient and compact Mott activation neuron based on vanadium dioxide and its successful integration with a conductive bridge random access memory (CBRAM) crossbar array in hardware. The Mott activation neuron implements the rectified linear unit function in the analogue domain. The neuron devices consume substantially less energy and occupy two orders of magnitude smaller area than those of analogue complementary metal-oxide semiconductor implementations. The LeNet-5 network with Mott activation neurons achieves 98.38% accuracy on the MNIST dataset, close to the ideal software accuracy. We perform large-scale image edge detection using the Mott activation neurons integrated with a CBRAM crossbar array. Our findings provide a solution towards large-scale, highly parallel and energy-efficient in-memory computing systems for neural networks.
Collapse
Affiliation(s)
- Sangheon Oh
- Electrical and Computer Engineering Department, University of California San Diego, La Jolla, CA, USA
| | - Yuhan Shi
- Electrical and Computer Engineering Department, University of California San Diego, La Jolla, CA, USA
| | - Javier Del Valle
- Department of Physics, University of California San Diego, La Jolla, CA, USA
| | - Pavel Salev
- Department of Physics, University of California San Diego, La Jolla, CA, USA
| | - Yichen Lu
- Electrical and Computer Engineering Department, University of California San Diego, La Jolla, CA, USA
| | - Zhisheng Huang
- Electrical and Computer Engineering Department, University of California San Diego, La Jolla, CA, USA
| | - Yoav Kalcheim
- Department of Physics, University of California San Diego, La Jolla, CA, USA
| | - Ivan K Schuller
- Department of Physics, University of California San Diego, La Jolla, CA, USA
| | - Duygu Kuzum
- Electrical and Computer Engineering Department, University of California San Diego, La Jolla, CA, USA.
| |
Collapse
|
17
|
Sato H, Shima H, Nokami T, Itoh T, Honma Y, Naitoh Y, Akinaga H, Kinoshita K. Memristors With Controllable Data Volatility by Loading Metal Ion-Added Ionic Liquids. FRONTIERS IN NANOTECHNOLOGY 2021. [DOI: 10.3389/fnano.2021.660563] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023] Open
Abstract
We demonstrate a new memristive device (IL-Memristor), in which an ionic liquid (IL) serve as a material to control the volatility of the resistance. ILs are ultra-low vapor pressure liquids consisting of cations and anions at room temperature, and their introduction into solid-state processes can provide new avenues in electronic device fabrication. Because the device resistance change in IL-Memristor is governed by a Cu filament formation/rupture in IL, we considered that the Cu filament stability affects the data retention characteristics. Therefore, we controlled the data retention time by clarifying the corrosion mechanism and performing the IL material design based on the results. It was found out that the corrosion of Cu filaments in the IL was ruled by the comproportionation reaction, and that the data retention characteristics of the devices varied depending on the valence of Cu ions added to the IL. Actually, IL-Memristors involving Cu(II) and Cu(I) show volatile and non-volatile nature with respect to the programmed resistance value, respectively. Our results showed that data volatility can be controlled through the metal ion species added to the IL. The present work indicates that IL-memristor is suitable for unique applications such as artificial neuron with tunable fading characteristics that is applicable to phenomena with a wide range of timescale.
Collapse
|
18
|
Jang J, Jang S, Choi S, Wang G. Run-off election-based decision method for the training and inference process in an artificial neural network. Sci Rep 2021; 11:895. [PMID: 33441631 PMCID: PMC7806707 DOI: 10.1038/s41598-020-79452-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Accepted: 12/08/2020] [Indexed: 11/09/2022] Open
Abstract
Generally, the decision rule for classifying unstructured data in an artificial neural network system depends on the sequence results of an activation function determined by vector-matrix multiplication between the input bias signal and the analog synaptic weight quantity of each node in a matrix array. Although a sequence-based decision rule can efficiently extract a common feature in a large data set in a short time, it can occasionally fail to classify similar species because it does not intrinsically consider other quantitative configurations of the activation function that affect the synaptic weight update. In this work, we implemented a simple run-off election-based decision rule via an additional filter evaluation to mitigate the confusion from proximity of output activation functions, enabling the improved training and inference performance of artificial neural network system. Using the filter evaluation selected via the difference among common features of classified images, the recognition accuracy achieved for three types of shoe image data sets reached ~ 82.03%, outperforming the maximum accuracy of ~ 79.23% obtained via the sequence-based decision rule in a fully connected single layer network. This training algorithm with an independent filter can precisely supply the output class in the decision step of the fully connected network.
Collapse
Affiliation(s)
- Jingon Jang
- KU-KIST Graduate School of Converging Science and Technology, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea.
| | - Seonghoon Jang
- KU-KIST Graduate School of Converging Science and Technology, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea
| | - Sanghyeon Choi
- KU-KIST Graduate School of Converging Science and Technology, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea
| | - Gunuk Wang
- KU-KIST Graduate School of Converging Science and Technology, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea.
| |
Collapse
|
19
|
Yang JQ, Wang R, Ren Y, Mao JY, Wang ZP, Zhou Y, Han ST. Neuromorphic Engineering: From Biological to Spike-Based Hardware Nervous Systems. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2020; 32:e2003610. [PMID: 33165986 DOI: 10.1002/adma.202003610] [Citation(s) in RCA: 68] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Revised: 07/27/2020] [Indexed: 06/11/2023]
Abstract
The human brain is a sophisticated, high-performance biocomputer that processes multiple complex tasks in parallel with high efficiency and remarkably low power consumption. Scientists have long been pursuing an artificial intelligence (AI) that can rival the human brain. Spiking neural networks based on neuromorphic computing platforms simulate the architecture and information processing of the intelligent brain, providing new insights for building AIs. The rapid development of materials engineering, device physics, chip integration, and neuroscience has led to exciting progress in neuromorphic computing with the goal of overcoming the von Neumann bottleneck. Herein, fundamental knowledge related to the structures and working principles of neurons and synapses of the biological nervous system is reviewed. An overview is then provided on the development of neuromorphic hardware systems, from artificial synapses and neurons to spike-based neuromorphic computing platforms. It is hoped that this review will shed new light on the evolution of brain-like computing.
Collapse
Affiliation(s)
- Jia-Qin Yang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518060, P. R. China
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Ruopeng Wang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518060, P. R. China
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Yi Ren
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Jing-Yu Mao
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Zhan-Peng Wang
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Ye Zhou
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Su-Ting Han
- Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, 518060, P. R. China
| |
Collapse
|
20
|
Choi S, Yang J, Wang G. Emerging Memristive Artificial Synapses and Neurons for Energy-Efficient Neuromorphic Computing. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2020; 32:e2004659. [PMID: 33006204 DOI: 10.1002/adma.202004659] [Citation(s) in RCA: 77] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/08/2020] [Revised: 08/12/2020] [Indexed: 06/11/2023]
Abstract
Memristors have recently attracted significant interest due to their applicability as promising building blocks of neuromorphic computing and electronic systems. The dynamic reconfiguration of memristors, which is based on the history of applied electrical stimuli, can mimic both essential analog synaptic and neuronal functionalities. These can be utilized as the node and terminal devices in an artificial neural network. Consequently, the ability to understand, control, and utilize fundamental switching principles and various types of device architectures of the memristor is necessary for achieving memristor-based neuromorphic hardware systems. Herein, a wide range of memristors and memristive-related devices for artificial synapses and neurons is highlighted. The device structures, switching principles, and the applications of essential synaptic and neuronal functionalities are sequentially presented. Moreover, recent advances in memristive artificial neural networks and their hardware implementations are introduced along with an overview of the various learning algorithms. Finally, the main challenges of the memristive synapses and neurons toward high-performance and energy-efficient neuromorphic computing are briefly discussed. This progress report aims to be an insightful guide for the research on memristors and neuromorphic-based computing.
Collapse
Affiliation(s)
- Sanghyeon Choi
- KU-KIST Graduate School of Converging Science and Technology, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea
| | - Jehyeon Yang
- KU-KIST Graduate School of Converging Science and Technology, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea
| | - Gunuk Wang
- KU-KIST Graduate School of Converging Science and Technology, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul, 02841, Republic of Korea
| |
Collapse
|
21
|
Abstract
Recently, three-terminal synaptic devices have attracted considerable attention owing to their nondestructive weight-update behavior, which is attributed to the completely separated terminals for reading and writing. However, the structural limitations of these devices, such as a low array density and complex line design, are predicted to result in low processing speeds and high energy consumption of the entire system. Here, we propose a vertical three-terminal synapse featuring a remote weight update via ion gel, which is also extendable to a crossbar array structure. This synaptic device exhibits excellent synaptic characteristics, which are achieved via precise control of ion penetration onto the vertical channel through the weight-control terminal. Especially, the applicability of the developed vertical organic synapse array to neuromorphic computing is demonstrated using a simple crossbar synapse array. The proposed synaptic device technology is expected to be an important steppingstone to the development of high-performance and high-density neural networks.
Collapse
|
22
|
Huang H, Xiao Y, Yang R, Yu Y, He H, Wang Z, Guo X. Implementation of Dropout Neuronal Units Based on Stochastic Memristive Devices in Neural Networks with High Classification Accuracy. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2020; 7:2001842. [PMID: 32999852 PMCID: PMC7509653 DOI: 10.1002/advs.202001842] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Indexed: 06/11/2023]
Abstract
Neural networks based on memristive devices have achieved great progress recently. However, memristive synapses with nonlinearity and asymmetry seriously limit the classification accuracy. Moreover, insufficient number of training samples in many cases also have negative effect on the classification accuracy of neural networks due to overfitting. In this work, dropout neuronal units are developed based on stochastic volatile memristive devices of Ag/Ta2O5:Ag/Pt. The memristive neural network using the dropout neuronal units effectively solves the problem of overfitting and mitigates the negative effects of the nonideality of memristive synapses, eventually achieves a classification accuracy comparable to the theoretical limit. The stochastic and volatile switching performances of the Ag/Ta2O5:Ag/Pt device are attributed to the stochastical rupture of the Ag filament under high electrical stress in the Ta2O5 layer, according to the TEM observation and the kinetic Monte Carlo simulation.
Collapse
Affiliation(s)
- He‐Ming Huang
- State Key Laboratory of Material Processing and Die and Mould TechnologyLaboratory of Solid State IonicsSchool of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan430074P. R. China
| | - Yu Xiao
- State Key Laboratory of Material Processing and Die and Mould TechnologyLaboratory of Solid State IonicsSchool of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan430074P. R. China
| | - Rui Yang
- State Key Laboratory of Material Processing and Die and Mould TechnologyLaboratory of Solid State IonicsSchool of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan430074P. R. China
| | - Ye‐Tian Yu
- State Key Laboratory of Material Processing and Die and Mould TechnologyLaboratory of Solid State IonicsSchool of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan430074P. R. China
| | - Hui‐Kai He
- State Key Laboratory of Material Processing and Die and Mould TechnologyLaboratory of Solid State IonicsSchool of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan430074P. R. China
| | - Zhe Wang
- State Key Laboratory of Material Processing and Die and Mould TechnologyLaboratory of Solid State IonicsSchool of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan430074P. R. China
| | - Xin Guo
- State Key Laboratory of Material Processing and Die and Mould TechnologyLaboratory of Solid State IonicsSchool of Materials Science and EngineeringHuazhong University of Science and TechnologyWuhan430074P. R. China
| |
Collapse
|
23
|
Cha JH, Yang SY, Oh J, Choi S, Park S, Jang BC, Ahn W, Choi SY. Conductive-bridging random-access memories for emerging neuromorphic computing. NANOSCALE 2020; 12:14339-14368. [PMID: 32373884 DOI: 10.1039/d0nr01671c] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
With the increasing utilisation of artificial intelligence, there is a renewed demand for the development of novel neuromorphic computing owing to the drawbacks of the existing computing paradigm based on the von Neumann architecture. Extensive studies have been performed on memristors as their electrical nature is similar to those of biological synapses and neurons. However, most hardware-based artificial neural networks (ANNs) have been developed with oxide-based memristors owing to their high compatibility with mature complementary metal-oxide-semiconductor (CMOS) processes. Considering the advantages of conductive-bridging random-access memories (CBRAMs), such as their high scalability, high on-off current with a wide dynamic range, and low off-current, over oxide-based memristors, extensive studies on CBRAMs are required. In this review, the basics of operation of CBRAMs are examined in detail, from the formation of metal nanoclusters to filament bridging. Additionally, state-of-the-art experimental demonstrations of CBRAM-based artificial synapses and neurons are presented. Finally, CBRAM-based ANNs are discussed, including deep neural networks and spiking neural networks, along with other emerging computing applications. This review is expected to pave the way toward further development of large-scale CBRAM array systems.
Collapse
Affiliation(s)
- Jun-Hwe Cha
- School of Electrical Engineering, Graphene/2D Materials Research Center, Center for Advanced Materials Discovery towards 3D Displays, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea.
| | | | | | | | | | | | | | | |
Collapse
|
24
|
Yeon H, Lin P, Choi C, Tan SH, Park Y, Lee D, Lee J, Xu F, Gao B, Wu H, Qian H, Nie Y, Kim S, Kim J. Alloying conducting channels for reliable neuromorphic computing. NATURE NANOTECHNOLOGY 2020; 15:574-579. [PMID: 32514010 DOI: 10.1038/s41565-020-0694-5] [Citation(s) in RCA: 72] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 04/14/2020] [Indexed: 06/11/2023]
Abstract
A memristor1 has been proposed as an artificial synapse for emerging neuromorphic computing applications2,3. To train a neural network in memristor arrays, changes in weight values in the form of device conductance should be distinct and uniform3. An electrochemical metallization (ECM) memory4,5, typically based on silicon (Si), has demonstrated a good analogue switching capability6,7 owing to the high mobility of metal ions in the Si switching medium8. However, the large stochasticity of the ion movement results in switching variability. Here we demonstrate a Si memristor with alloyed conduction channels that shows a stable and controllable device operation, which enables the large-scale implementation of crossbar arrays. The conduction channel is formed by conventional silver (Ag) as a primary mobile metal alloyed with silicidable copper (Cu) that stabilizes switching. In an optimal alloying ratio, Cu effectively regulates the Ag movement, which contributes to a substantial improvement in the spatial/temporal switching uniformity, a stable data retention over a large conductance range and a substantially enhanced programmed symmetry in analogue conductance states. This alloyed memristor allows the fabrication of large-scale crossbar arrays that feature a high device yield and accurate analogue programming capability. Thus, our discovery of an alloyed memristor is a key step paving the way beyond von Neumann computing.
Collapse
Affiliation(s)
- Hanwool Yeon
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Peng Lin
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Chanyeol Choi
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Scott H Tan
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Yongmo Park
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Doyoon Lee
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Jaeyong Lee
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Feng Xu
- Institute of Microelectronics, Tsinghua University, Beijing, China
| | - Bin Gao
- Institute of Microelectronics, Tsinghua University, Beijing, China
| | - Huaqiang Wu
- Institute of Microelectronics, Tsinghua University, Beijing, China
| | - He Qian
- Institute of Microelectronics, Tsinghua University, Beijing, China
| | - Yifan Nie
- Materials Science Division, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
| | - Seyoung Kim
- IBM T. J. Watson Research Center, Yorktown Heights, NY, USA
- Department of Materials Science and Engineering, Pohang University of Science and Technology (POSTECH), Pohang, South Korea
| | - Jeehwan Kim
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA.
| |
Collapse
|
25
|
Shi L, Zheng G, Tian B, Dkhil B, Duan C. Research progress on solutions to the sneak path issue in memristor crossbar arrays. NANOSCALE ADVANCES 2020; 2:1811-1827. [PMID: 36132530 PMCID: PMC9418872 DOI: 10.1039/d0na00100g] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Accepted: 03/10/2020] [Indexed: 05/15/2023]
Abstract
Since the emergence of memristors (or memristive devices), how to integrate them into arrays has been widely investigated. After years of research, memristor crossbar arrays have been proposed and realized with potential applications in nonvolatile memory, logic and neuromorphic computing systems. Despite the promising prospects of memristor crossbar arrays, one of the main obstacles for their development is the so-called sneak-path current causing cross-talk interference between adjacent memory cells and thus may result in misinterpretation which greatly influences the operation of memristor crossbar arrays. Solving the sneak-path current issue, the power consumption of the array will immensely decrease, and the reliability and stability will simultaneously increase. In order to suppress the sneak-path current, various solutions have been provided. So far, some reviews have considered some of these solutions and established a sophisticated classification, including 1D1M, 1T1M, 1S1M (D: diode, M: memristor, T: transistor, S: selector), self-selective and self-rectifying memristors. Recently, a mass of studies have been additionally reported. This review thus attempts to provide a survey on these new findings, by highlighting the latest research progress realized for relieving the sneak-path issue. Here, we first present the concept of the sneak-path current issue and solutions proposed to solve it. Consequently, we select some typical and promising devices, and present their structures and properties in detail. Then, the latest research activities focusing on single-device structures are introduced taking into account the mechanisms underlying these devices. Finally, we summarize the properties and perspectives of these solutions.
Collapse
Affiliation(s)
- Lingyun Shi
- Department of Electronics, Key Laboratory of Polar Materials and Devices (MOE), East China Normal University Shanghai 200241 China
| | - Guohao Zheng
- Department of Electronics, Key Laboratory of Polar Materials and Devices (MOE), East China Normal University Shanghai 200241 China
| | - Bobo Tian
- Department of Electronics, Key Laboratory of Polar Materials and Devices (MOE), East China Normal University Shanghai 200241 China
- Laboratoire Structures, Propriétés et Modélisation des Solides, CentraleSupélec, CNRS-UMR8580, Université Paris-Saclay 91190 Gif-sur-Yvette France
| | - Brahim Dkhil
- Laboratoire Structures, Propriétés et Modélisation des Solides, CentraleSupélec, CNRS-UMR8580, Université Paris-Saclay 91190 Gif-sur-Yvette France
| | - Chungang Duan
- Department of Electronics, Key Laboratory of Polar Materials and Devices (MOE), East China Normal University Shanghai 200241 China
- Collaborative Innovation Center of Extreme Optics, Shanxi University Shanxi 030006 China
| |
Collapse
|
26
|
Ginnaram S, Qiu JT, Maikap S. Controlling Cu Migration on Resistive Switching, Artificial Synapse, and Glucose/Saliva Detection by Using an Optimized AlO x Interfacial Layer in a-CO x -Based Conductive Bridge Random Access Memory. ACS OMEGA 2020; 5:7032-7043. [PMID: 32258939 PMCID: PMC7114759 DOI: 10.1021/acsomega.0c00795] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/22/2020] [Accepted: 03/05/2020] [Indexed: 05/29/2023]
Abstract
The Cu migration is controlled by using an optimized AlO x interfacial layer, and effects on resistive switching performance, artificial synapse, and human saliva detection in an amorphous-oxygenated-carbon (a-CO x )-based CBRAM platform have been investigated for the first time. The 4 nm-thick AlO x layer in the Cu/AlO x /a-CO x /TiN x O y /TiN structure shows consecutive >2000 DC switching, tight distribution of SET/RESET voltages, a long program/erase (P/E) endurance of >109 cycles at a low operation current of 300 μA, and artificial synaptic characteristics under a small pulse width of 100 ns. After a P/E endurance of >108 cycles, the Cu migration is observed by both ex situ high-resolution transmission electron microscopy and energy-dispersive X-ray spectroscopy mapping images. Furthermore, the optimized Cu/AlO x /a-CO x /TiN x O y /TiN CBRAM detects glucose with a low concentration of 1 pM, and real-time measurement of human saliva with a small sample volume of 1 μL is also detected repeatedly in vitro. This is owing to oxidation-reduction of Cu electrode, and the switching mechanism is explored. Therefore, this CBRAM device is beneficial for future artificial intelligence application.
Collapse
Affiliation(s)
- Sreekanth Ginnaram
- Thin
Film Nano Tech. Lab., Department of Electronic Engineering, Chang Gung University (CGU), No. 259, Wen-Hwa 1st Rd., Guishan, Taoyuan 33302, Taiwan
| | - Jiantai Timothy Qiu
- Division
of Gynecology-Oncology, Department of Obstetrics/Gynecology, Chang Gung Memorial Hospital (CGMH), No. 5, Fu-Shing St., Taoyuan 333, Taiwan
- Department
of Biomedical Sciences, School of Medicine, Chang Gung University (CGU), No. 259, Wen-Hwa 1st Rd., Guishan, Taoyuan 33302, Taiwan
| | - Siddheswar Maikap
- Thin
Film Nano Tech. Lab., Department of Electronic Engineering, Chang Gung University (CGU), No. 259, Wen-Hwa 1st Rd., Guishan, Taoyuan 33302, Taiwan
- Division
of Gynecology-Oncology, Department of Obstetrics/Gynecology, Chang Gung Memorial Hospital (CGMH), No. 5, Fu-Shing St., Taoyuan 333, Taiwan
- Department
of Obstetrics and Gynecology, Keelung Chang
Gung Memorial Hospital (CGMH), No. 222, Maijin Rd., Anle, Keelung 204, Taiwan
| |
Collapse
|
27
|
Choi Y, Kim JH, Qian C, Kang J, Hersam MC, Park JH, Cho JH. Gate-Tunable Synaptic Dynamics of Ferroelectric-Coupled Carbon-Nanotube Transistors. ACS APPLIED MATERIALS & INTERFACES 2020; 12:4707-4714. [PMID: 31878774 DOI: 10.1021/acsami.9b17742] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Artificial neural networks (ANNs) based on synaptic devices, which can simultaneously perform processing and storage of data, have superior computing performance compared to conventional von Neumann architectures. Here, we present a ferroelectric coupled artificial synaptic device with reliable weight update and storage properties for ANNs. The artificial synaptic device, which is based on a ferroelectric polymer capacitively coupled with an oxide dielectric via an electric-field-permeable, semiconducting single-walled carbon-nanotube channel, is successfully fabricated by inkjet printing. By controlling the ferroelectric polarization, synaptic dynamics, such as excitatory and inhibitory postsynaptic currents and long-term potentiation/depression characteristics, is successfully implemented in the artificial synaptic device. Furthermore, the constructed ANN, which is designed in consideration of the device-to-device variation within the synaptic array, efficiently executes the tasks of learning and recognition of the Modified National Institute of Standards and Technology numerical patterns.
Collapse
Affiliation(s)
- Yongsuk Choi
- Department of Chemical and Biomolecular Engineering , Yonsei University , Seoul 120-749 , Republic of Korea
| | | | - Chuan Qian
- Department of Chemical and Biomolecular Engineering , Yonsei University , Seoul 120-749 , Republic of Korea
| | | | - Mark C Hersam
- Department of Materials Science and Engineering, Department of Chemistry, and Department of Electrical and Computer Engineering , Northwestern University , Evanston , Illinois 60208 , United States
| | | | - Jeong Ho Cho
- Department of Chemical and Biomolecular Engineering , Yonsei University , Seoul 120-749 , Republic of Korea
| |
Collapse
|
28
|
Le PY, Tran HN, Zhao ZC, McKenzie DR, McCulloch DG, Holland AS, Murdoch BJ, Partridge JG. Tin oxide artificial synapses for low power temporal information processing. NANOTECHNOLOGY 2019; 30:325201. [PMID: 30991363 DOI: 10.1088/1361-6528/ab19c9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Lateral memristors configured with inert Pt contacts and mixed phase tin oxide layers have exhibited immediate, forming-free, low-power bidirectional resistance switching. Activity dependent conductance and relaxation in the low resistance state resembled short term potentiation in biological synapses. After scanning probe microscopy, x-ray photoelectron spectroscopy and electrical measurements, the device characteristics were attributed to Joule heating induced decomposition of the minority SnO phase and formation of a SnO2 conducting filament with higher effective n-type doping. Finally, the devices recognized input voltage pulse sequences and spectral data by returning unique conductance states, suggesting suitability for bio-inspired pattern recognition systems.
Collapse
Affiliation(s)
- Phuong Y Le
- School of Engineering, RMIT University, Melbourne VIC 3001, Australia
| | | | | | | | | | | | | | | |
Collapse
|
29
|
Shi Y, Nguyen L, Oh S, Liu X, Kuzum D. A Soft-Pruning Method Applied During Training of Spiking Neural Networks for In-memory Computing Applications. Front Neurosci 2019; 13:405. [PMID: 31080402 PMCID: PMC6497807 DOI: 10.3389/fnins.2019.00405] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2018] [Accepted: 04/09/2019] [Indexed: 11/13/2022] Open
Abstract
Inspired from the computational efficiency of the biological brain, spiking neural networks (SNNs) emulate biological neural networks, neural codes, dynamics, and circuitry. SNNs show great potential for the implementation of unsupervised learning using in-memory computing. Here, we report an algorithmic optimization that improves energy efficiency of online learning with SNNs on emerging non-volatile memory (eNVM) devices. We develop a pruning method for SNNs by exploiting the output firing characteristics of neurons. Our pruning method can be applied during network training, which is different from previous approaches in the literature that employ pruning on already-trained networks. This approach prevents unnecessary updates of network parameters during training. This algorithmic optimization can complement the energy efficiency of eNVM technology, which offers a unique in-memory computing platform for the parallelization of neural network operations. Our SNN maintains ~90% classification accuracy on the MNIST dataset with up to ~75% pruning, significantly reducing the number of weight updates. The SNN and pruning scheme developed in this work can pave the way toward applications of eNVM based neuro-inspired systems for energy efficient online learning in low power applications.
Collapse
Affiliation(s)
- Yuhan Shi
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Leon Nguyen
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Sangheon Oh
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Xin Liu
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| | - Duygu Kuzum
- Electrical and Computer Engineering Department, University of California, San Diego, San Diego, CA, United States
| |
Collapse
|