1
|
Zhang F, Li C, Li Z, Dong L, Zhao J. Recent progress in three-terminal artificial synapses based on 2D materials: from mechanisms to applications. MICROSYSTEMS & NANOENGINEERING 2023; 9:16. [PMID: 36817330 PMCID: PMC9935897 DOI: 10.1038/s41378-023-00487-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 12/17/2022] [Accepted: 01/03/2023] [Indexed: 06/18/2023]
Abstract
Synapses are essential for the transmission of neural signals. Synaptic plasticity allows for changes in synaptic strength, enabling the brain to learn from experience. With the rapid development of neuromorphic electronics, tremendous efforts have been devoted to designing and fabricating electronic devices that can mimic synapse operating modes. This growing interest in the field will provide unprecedented opportunities for new hardware architectures for artificial intelligence. In this review, we focus on research of three-terminal artificial synapses based on two-dimensional (2D) materials regulated by electrical, optical and mechanical stimulation. In addition, we systematically summarize artificial synapse applications in various sensory systems, including bioplastic bionics, logical transformation, associative learning, image recognition, and multimodal pattern recognition. Finally, the current challenges and future perspectives involving integration, power consumption and functionality are outlined.
Collapse
Affiliation(s)
- Fanqing Zhang
- School of Mechatronical Engineering, Beijing Institute of Technology, 100081 Beijing, China
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, 100081 Beijing, China
| | - Chunyang Li
- School of Mechatronical Engineering, Beijing Institute of Technology, 100081 Beijing, China
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, 100081 Beijing, China
| | - Zhongyi Li
- School of Mechatronical Engineering, Beijing Institute of Technology, 100081 Beijing, China
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, 100081 Beijing, China
| | - Lixin Dong
- Department of Biomedical Engineering, City University of Hong Kong, Kowloon Tong, 999077 Hong Kong, China
| | - Jing Zhao
- School of Mechatronical Engineering, Beijing Institute of Technology, 100081 Beijing, China
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, 100081 Beijing, China
| |
Collapse
|
2
|
Batool S, Idrees M, Zhang SR, Han ST, Zhou Y. Novel charm of 2D materials engineering in memristor: when electronics encounter layered morphology. NANOSCALE HORIZONS 2022; 7:480-507. [PMID: 35343522 DOI: 10.1039/d2nh00031h] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The family of two-dimensional (2D) materials composed of atomically thin layers connected via van der Waals interactions has attracted much curiosity due to a variety of intriguing physical, optical, and electrical characteristics. The significance of analyzing statistics on electrical devices and circuits based on 2D materials is seldom underestimated. Certain requirements must be met to deliver scientific knowledge that is beneficial in the field of 2D electronics: synthesis and fabrication must occur at the wafer level, variations in morphology and lattice alterations must be visible and statistically verified, and device dimensions must be appropriate. The authors discussed the most recent significant concerns of 2D materials in the provided prose and attempted to highlight the prerequisites for synthesis, yield, and mechanism behind device-to-device variability, reliability, and durability benchmarking under memristors characteristics; they also indexed some useful approaches that have already been reported to be advantageous in large-scale production. Commercial applications, on the other hand, will necessitate further effort.
Collapse
Affiliation(s)
- Saima Batool
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China.
- Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, Institute of Microscale Optoelectronics, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Muhammad Idrees
- Additive Manufacturing Institute, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, P. R. China
| | - Shi-Rui Zhang
- Department of Electronic Materials Engineering, Research School of Physics, The Australian National University, Canberra, Australian Capital Territory 2601, Australia
| | - Su-Ting Han
- College of Electronics Science & Technology, Shenzhen University, Shenzhen, 518060, P. R. China
| | - Ye Zhou
- Institute for Advanced Study, Shenzhen University, Shenzhen, 518060, P. R. China.
| |
Collapse
|
3
|
Ge C, Liu CX, Zhou QL, Zhang QH, Du JY, Li JK, Wang C, Gu L, Yang GZ, Jin KJ. A Ferrite Synaptic Transistor with Topotactic Transformation. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2019; 31:e1900379. [PMID: 30924206 DOI: 10.1002/adfm.201902702] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2019] [Revised: 03/14/2019] [Indexed: 05/28/2023]
Abstract
Hardware implementation of artificial synaptic devices that emulate the functions of biological synapses is inspired by the biological neuromorphic system and has drawn considerable interest. Here, a three-terminal ferrite synaptic device based on a topotactic phase transition between crystalline phases is presented. The electrolyte-gating-controlled topotactic phase transformation between brownmillerite SrFeO2.5 and perovskite SrFeO3- δ is confirmed from the examination of the crystal and electronic structure. A synaptic transistor with electrolyte-gated ferrite films by harnessing gate-controllable multilevel conduction states, which originate from many distinct oxygen-deficient perovskite structures of SrFeOx induced by topotactic phase transformation, is successfully constructed. This three-terminal artificial synapse can mimic important synaptic functions, such as synaptic plasticity and spike-timing-dependent plasticity. Simulations of a neural network consisting of ferrite synaptic transistors indicate that the system offers high classification accuracy. These results provide insight into the potential application of advanced topotactic phase transformation materials for designing artificial synapses with high performance.
Collapse
Affiliation(s)
- Chen Ge
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Chang-Xiang Liu
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
- Department of Physics, Capital Normal University, Beijing, 100048, China
| | - Qing-Li Zhou
- Department of Physics, Capital Normal University, Beijing, 100048, China
| | - Qing-Hua Zhang
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jian-Yu Du
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jian-Kun Li
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Can Wang
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
- Songshan Lake Materials Laboratory, Dongguan, 523808, China
| | - Lin Gu
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Guo-Zhen Yang
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
| | - Kui-Juan Jin
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing, 100190, China
- Songshan Lake Materials Laboratory, Dongguan, 523808, China
| |
Collapse
|
4
|
Pedroni BU, Joshi S, Deiss SR, Sheik S, Detorakis G, Paul S, Augustine C, Neftci EO, Cauwenberghs G. Memory-Efficient Synaptic Connectivity for Spike-Timing- Dependent Plasticity. Front Neurosci 2019; 13:357. [PMID: 31110470 PMCID: PMC6499189 DOI: 10.3389/fnins.2019.00357] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2018] [Accepted: 03/28/2019] [Indexed: 11/13/2022] Open
Abstract
Spike-Timing-Dependent Plasticity (STDP) is a bio-inspired local incremental weight update rule commonly used for online learning in spike-based neuromorphic systems. In STDP, the intensity of long-term potentiation and depression in synaptic efficacy (weight) between neurons is expressed as a function of the relative timing between pre- and post-synaptic action potentials (spikes), while the polarity of change is dependent on the order (causality) of the spikes. Online STDP weight updates for causal and acausal relative spike times are activated at the onset of post- and pre-synaptic spike events, respectively, implying access to synaptic connectivity both in forward (pre-to-post) and reverse (post-to-pre) directions. Here we study the impact of different arrangements of synaptic connectivity tables on weight storage and STDP updates for large-scale neuromorphic systems. We analyze the memory efficiency for varying degrees of density in synaptic connectivity, ranging from crossbar arrays for full connectivity to pointer-based lookup for sparse connectivity. The study includes comparison of storage and access costs and efficiencies for each memory arrangement, along with a trade-off analysis of the benefits of each data structure depending on application requirements and budget. Finally, we present an alternative formulation of STDP via a delayed causal update mechanism that permits efficient weight access, requiring no more than forward connectivity lookup. We show functional equivalence of the delayed causal updates to the original STDP formulation, with substantial savings in storage and access costs and efficiencies for networks with sparse synaptic connectivity as typically encountered in large-scale models in computational neuroscience.
Collapse
Affiliation(s)
- Bruno U Pedroni
- Integrated Systems Neuroengineering Laboratory, Department of Bioengineering, University of California, San Diego, La Jolla, CA, United States
| | - Siddharth Joshi
- Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, IN, United States
| | - Stephen R Deiss
- Integrated Systems Neuroengineering Laboratory, Department of Bioengineering, University of California, San Diego, La Jolla, CA, United States
| | | | - Georgios Detorakis
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA, United States
| | - Somnath Paul
- Intel Corporation - Circuit Research Lab, Hillsboro, OR, United States
| | - Charles Augustine
- Intel Corporation - Circuit Research Lab, Hillsboro, OR, United States
| | - Emre O Neftci
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA, United States
| | - Gert Cauwenberghs
- Integrated Systems Neuroengineering Laboratory, Department of Bioengineering, University of California, San Diego, La Jolla, CA, United States
| |
Collapse
|
5
|
Soleimani H, Ahmadi A, Bavandpour M, Sharifipoor O. A generalized analog implementation of piecewise linear neuron models using CCII building blocks. Neural Netw 2013; 51:26-38. [PMID: 24365534 DOI: 10.1016/j.neunet.2013.12.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2012] [Revised: 11/02/2013] [Accepted: 12/04/2013] [Indexed: 11/28/2022]
Abstract
This paper presents a set of reconfigurable analog implementations of piecewise linear spiking neuron models using second generation current conveyor (CCII) building blocks. With the same topology and circuit elements, without W/L modification which is impossible after circuit fabrication, these circuits can produce different behaviors, similar to the biological neurons, both for a single neuron as well as a network of neurons just by tuning reference current and voltage sources. The models are investigated, in terms of analog implementation feasibility and costs, targeting large scale hardware implementations. Results show that, in order to gain the best performance, area and accuracy; these models can be compromised. Simulation results are presented for different neuron behaviors with CMOS 350 nm technology.
Collapse
Affiliation(s)
- Hamid Soleimani
- Electrical Engineering Department, Razi University, Kermanshah, Iran
| | - Arash Ahmadi
- Electrical Engineering Department, Razi University, Kermanshah, Iran.
| | - Mohammad Bavandpour
- Faculty of Electrical Engineering, Sharif University of Technology, Tehran, Iran
| | - Ozra Sharifipoor
- Electrical Engineering Department, Razi University, Kermanshah, Iran
| |
Collapse
|
6
|
Cassidy AS, Georgiou J, Andreou AG. Design of silicon brains in the nano-CMOS era: spiking neurons, learning synapses and neural architecture optimization. Neural Netw 2013; 45:4-26. [PMID: 23886551 DOI: 10.1016/j.neunet.2013.05.011] [Citation(s) in RCA: 80] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2012] [Revised: 05/20/2013] [Accepted: 05/21/2013] [Indexed: 11/30/2022]
Abstract
We present a design framework for neuromorphic architectures in the nano-CMOS era. Our approach to the design of spiking neurons and STDP learning circuits relies on parallel computational structures where neurons are abstracted as digital arithmetic logic units and communication processors. Using this approach, we have developed arrays of silicon neurons that scale to millions of neurons in a single state-of-the-art Field Programmable Gate Array (FPGA). We demonstrate the validity of the design methodology through the implementation of cortical development in a circuit of spiking neurons, STDP synapses, and neural architecture optimization.
Collapse
Affiliation(s)
- Andrew S Cassidy
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.
| | | | | |
Collapse
|
7
|
|
8
|
Smith LS. Neuromorphic systems: past, present and future. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2010; 657:167-82. [PMID: 20020347 DOI: 10.1007/978-0-387-79100-5_9] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/10/2023]
Abstract
Neuromorphic systems are implementations in silicon of elements of neural systems. The idea of electronic implementation is not new, but modern microelectronics has provided opportunities for producing systems for both sensing and neural modelling that can be mass produced straightforwardly. We review the the history of neuromorphic systems, and discuss the range of neuromorphic systems that have been developed. We discuss recent ideas for overcoming some of the problems, particularly providing effective adaptive synapses in large numbers.
Collapse
Affiliation(s)
- Leslie S Smith
- Department of Computing Science and Mathematics, University of Stirling, Stirling, FK9 4LA, UK.
| |
Collapse
|
9
|
Luthon F, Dragomirescu D. A cellular analog network for MRF-based video motion detection. ACTA ACUST UNITED AC 1999. [DOI: 10.1109/81.747202] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
10
|
Serrano-Gotarredona T, Andreou A, Linares-Barranco B. AER image filtering architecture for vision-processing systems. ACTA ACUST UNITED AC 1999. [DOI: 10.1109/81.788808] [Citation(s) in RCA: 64] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
11
|
Canwenberghs G, Waskiewicz J. Focal-plane analog VLSI cellular implementation of the boundary contour system. ACTA ACUST UNITED AC 1999. [DOI: 10.1109/81.747215] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|