51
|
Chen P, Liu F, Lin P, Li P, Xiao Y, Zhang B, Pan G. Open-loop analog programmable electrochemical memory array. Nat Commun 2023; 14:6184. [PMID: 37794039 PMCID: PMC10550916 DOI: 10.1038/s41467-023-41958-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Accepted: 09/21/2023] [Indexed: 10/06/2023] Open
Abstract
Emerging memories have been developed as new physical infrastructures for hosting neural networks owing to their low-power analog computing characteristics. However, accurately and efficiently programming devices in an analog-valued array is still largely limited by the intrinsic physical non-idealities of the devices, thus hampering their applications in in-situ training of neural networks. Here, we demonstrate a passive electrochemical memory (ECRAM) array with many important characteristics necessary for accurate analog programming. Different image patterns can be open-loop and serially programmed into our ECRAM array, achieving high programming accuracies without any feedback adjustments. The excellent open-loop analog programmability has led us to in-situ train a bilayer neural network and reached software-like classification accuracy of 99.4% to detect poisonous mushrooms. The training capability is further studied in simulation for large-scale neural networks such as VGG-8. Our results present a new solution for implementing learning functions in an artificial intelligence hardware using emerging memories.
Collapse
Affiliation(s)
- Peng Chen
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Fenghao Liu
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Peng Lin
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China.
- State Key Laboratory of Brain Machine Intelligence, Zhejiang University, Hangzhou, China.
| | - Peihong Li
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Yu Xiao
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Bihua Zhang
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China
| | - Gang Pan
- College of Computer Science and Technology, Zhejiang University, Hangzhou, China.
- State Key Laboratory of Brain Machine Intelligence, Zhejiang University, Hangzhou, China.
| |
Collapse
|
52
|
Jiang M, Shan K, He C, Li C. Efficient combinatorial optimization by quantum-inspired parallel annealing in analogue memristor crossbar. Nat Commun 2023; 14:5927. [PMID: 37739944 PMCID: PMC10516914 DOI: 10.1038/s41467-023-41647-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 09/11/2023] [Indexed: 09/24/2023] Open
Abstract
Combinatorial optimization problems are prevalent in various fields, but obtaining exact solutions remains challenging due to the combinatorial explosion with increasing problem size. Special-purpose hardware such as Ising machines, particularly memristor-based analog Ising machines, have emerged as promising solutions. However, existing simulate-annealing-based implementations have not fully exploited the inherent parallelism and analog storage/processing features of memristor crossbar arrays. This work proposes a quantum-inspired parallel annealing method that enables full parallelism and improves solution quality, resulting in significant speed and energy improvement when implemented in analog memristor crossbars. We experimentally solved tasks, including unweighted and weighted Max-Cut and traveling salesman problem, using our integrated memristor chip. The quantum-inspired parallel annealing method implemented in memristor-based hardware has demonstrated significant improvements in time- and energy-efficiency compared to previously reported simulated annealing and Ising machine implemented on other technologies. This is because our approach effectively exploits the natural parallelism, analog conductance states, and all-to-all connection provided by memristor technology, promising its potential for solving complex optimization problems with greater efficiency.
Collapse
Affiliation(s)
- Mingrui Jiang
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China
| | - Keyi Shan
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China
| | - Chengping He
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China
| | - Can Li
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China.
| |
Collapse
|
53
|
Yang F, Wei W, Dong X, Zhao Y, Chen J, Chen J, Zhang X, Li Y. Optoelectronic bio-synaptic plasticity on neotype kesterite memristor with switching ratio >104. J Chem Phys 2023; 159:114701. [PMID: 37712793 DOI: 10.1063/5.0167187] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 08/28/2023] [Indexed: 09/16/2023] Open
Abstract
Optoelectronic memristors hold the most potential for realizing next-generation neuromorphic computation; however, memristive devices that can integrate excellent resistive switching and both electrical-/light-induced bio-synaptic behaviors are still challenging to develop. In this study, an artificial optoelectronic synapse is proposed and realized using a kesterite-based memristor with Cu2ZnSn(S,Se)4 (CZTSSe) as the switching material and Mo/Ag as the back/top electrode. Benefiting from unique electrical features and a bi-layered structure of CZTSSe, the memristor exhibits highly stable nonvolatile resistive switching with excellent spatial uniformity, concentrated Set/Reset voltage distribution (variation <0.08/0.02 V), high On/Off ratio (>104), and long retention time (>104 s). A possible mechanism of the switching behavior in such a device is proposed. Furthermore, these memristors successfully achieve essential bio-synaptic functions under both electrical and various visible light (470-655 nm) stimulations, including electrical-induced excitatory postsynaptic current, paired pulse facilitation, long-term potentiation, long-term depression, spike-timing-dependent plasticity, as well as light-stimulated short-/long-term plasticity and learning-forgetting-relearning process. As such, the proposed neotype kesterite-based memristor demonstrates significant potential in facilitating artificial optoelectronic synapses and enabling neuromorphic computation.
Collapse
Affiliation(s)
- Fengxia Yang
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Wenbin Wei
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Xiaofei Dong
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Yun Zhao
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Jiangtao Chen
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Jianbiao Chen
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Xuqiang Zhang
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| | - Yan Li
- Key Laboratory of Atomic and Molecular Physics and Functional Materials of Gansu Province, College of Physics and Electronic Engineering, Northwest Normal University, Lanzhou 730070, China
| |
Collapse
|
54
|
Xie Q, Pan X, Luo W, Shuai Y, Zeng H, Wang J, Liu Y, Yang X, Lv L, Xu J, Yan H, Wu C, Zhang W. Controllable modulation of the oxygen vacancy-induced adjustment of memristive behavior for direct differential operation with transistor-free memristor. NANOSCALE 2023; 15:14257-14265. [PMID: 37602393 DOI: 10.1039/d3nr02395h] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/22/2023]
Abstract
To achieve the goal of neuromorphic computing hardware implementation with extremely high efficiency, low power consumption, and high density, it is necessary to develop transistor-free memristors and implement differential operation without subtraction circuits. In this study, argon ion irradiation was used during the fabrication process of a single crystalline LiNbO3 (LN) thin film to controllably introduce oxygen vacancies (OVs) into the bottom surface, which realized the modulation of OVs based on the excellent environment provided by a single-crystalline thin film. The memristive behavior of memristors was then modulated by regulating the distribution of OVs, and the effect of OVs distributed near the bottom surface of the single crystalline LN thin film on the memristive behavior was analyzed. In this way, two transistor-free memristors with opposite memristive behavior directions were fabricated. Two transistor-free memristors exhibit excellent synaptic plasticity and reliable multilevel resistance states. Based on two transistor-free memristors, a novel differential pair was constructed. Hardware implementations of direct differential operation without subtraction circuits were achieved. This study provides a new pathway to develop a transistor-free memristor and achieve differential operation without subtraction circuits in neuromorphic computing, which will simplify the peripheral circuits, improve integration density, and reduce power consumption and latency.
Collapse
Affiliation(s)
- Qin Xie
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
| | - Xinqiang Pan
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
- Chongqing Institute of Microelectronics Industry Technology, UESTC, Chongqing 401332, P. R. China
| | - Wenbo Luo
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
- Chongqing Institute of Microelectronics Industry Technology, UESTC, Chongqing 401332, P. R. China
| | - Yao Shuai
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
- Chongqing Institute of Microelectronics Industry Technology, UESTC, Chongqing 401332, P. R. China
| | - Huizhong Zeng
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
| | - Jiejun Wang
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
| | - Yuting Liu
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
| | - Xudong Yang
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
| | - Lu Lv
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
| | - Jiaqi Xu
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
| | - Hao Yan
- Chongqing Institute of Microelectronics Industry Technology, UESTC, Chongqing 401332, P. R. China
| | - Chuangui Wu
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
- Chongqing Institute of Microelectronics Industry Technology, UESTC, Chongqing 401332, P. R. China
| | - Wanli Zhang
- State Key Laboratory of Electronic Thin Films and Integrated Devices, University of Electronic Science and Technology of China, Chengdu 611731, P. R. China.
- Chongqing Institute of Microelectronics Industry Technology, UESTC, Chongqing 401332, P. R. China
| |
Collapse
|
55
|
Chen S, Zhang T, Tappertzhofen S, Yang Y, Valov I. Electrochemical-Memristor-Based Artificial Neurons and Synapses-Fundamentals, Applications, and Challenges. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2301924. [PMID: 37199224 DOI: 10.1002/adma.202301924] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/22/2023] [Indexed: 05/19/2023]
Abstract
Artificial neurons and synapses are considered essential for the progress of the future brain-inspired computing, based on beyond von Neumann architectures. Here, a discussion on the common electrochemical fundamentals of biological and artificial cells is provided, focusing on their similarities with the redox-based memristive devices. The driving forces behind the functionalities and the ways to control them by an electrochemical-materials approach are presented. Factors such as the chemical symmetry of the electrodes, doping of the solid electrolyte, concentration gradients, and excess surface energy are discussed as essential to understand, predict, and design artificial neurons and synapses. A variety of two- and three-terminal memristive devices and memristive architectures are presented and their application for solving various problems is shown. The work provides an overview of the current understandings on the complex processes of neural signal generation and transmission in both biological and artificial cells and presents the state-of-the-art applications, including signal transmission between biological and artificial cells. This example is showcasing the possibility for creating bioelectronic interfaces and integrating artificial circuits in biological systems. Prospectives and challenges of the modern technology toward low-power, high-information-density circuits are highlighted.
Collapse
Affiliation(s)
- Shaochuan Chen
- Institute of Materials in Electrical Engineering 2 (IWE2), RWTH Aachen University, Sommerfeldstraße 24, 52074, Aachen, Germany
| | - Teng Zhang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), School of Integrated Circuits, Peking University, Beijing, 100871, China
| | - Stefan Tappertzhofen
- Chair for Micro- and Nanoelectronics, Department of Electrical Engineering and Information Technology, TU Dortmund University, Martin-Schmeisser-Weg 4-6, D-44227, Dortmund, Germany
| | - Yuchao Yang
- Key Laboratory of Microelectronic Devices and Circuits (MOE), School of Integrated Circuits, Peking University, Beijing, 100871, China
- School of Electronic and Computer Engineering, Peking University, Shenzhen, 518055, China
- Center for Brain Inspired Intelligence, Chinese Institute for Brain Research (CIBR), Beijing, 102206, China
| | - Ilia Valov
- Peter Grünberg Institute (PGI-7), Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425, Jülich, Germany
- Institute of Electrochemistry and Energy Systems "Acad. E. Budewski", Bulgarian Academy of Sciences, Acad. G. Bonchev 10, 1113, Sofia, Bulgaria
| |
Collapse
|
56
|
Haensch W, Raghunathan A, Roy K, Chakrabarti B, Phatak CM, Wang C, Guha S. Compute in-Memory with Non-Volatile Elements for Neural Networks: A Review from a Co-Design Perspective. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2204944. [PMID: 36579797 DOI: 10.1002/adma.202204944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 11/01/2022] [Indexed: 06/17/2023]
Abstract
Deep learning has become ubiquitous, touching daily lives across the globe. Today, traditional computer architectures are stressed to their limits in efficiently executing the growing complexity of data and models. Compute-in-memory (CIM) can potentially play an important role in developing efficient hardware solutions that reduce data movement from compute-unit to memory, known as the von Neumann bottleneck. At its heart is a cross-bar architecture with nodal non-volatile-memory elements that performs an analog multiply-and-accumulate operation, enabling the matrix-vector-multiplications repeatedly used in all neural network workloads. The memory materials can significantly influence final system-level characteristics and chip performance, including speed, power, and classification accuracy. With an over-arching co-design viewpoint, this review assesses the use of cross-bar based CIM for neural networks, connecting the material properties and the associated design constraints and demands to application, architecture, and performance. Both digital and analog memory are considered, assessing the status for training and inference, and providing metrics for the collective set of properties non-volatile memory materials will need to demonstrate for a successful CIM technology.
Collapse
Affiliation(s)
- Wilfried Haensch
- Materials Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA
| | - Anand Raghunathan
- Department of Electrical Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Kaushik Roy
- Department of Electrical Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Bhaswar Chakrabarti
- Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai, Tamil Nadu, 600036, India
| | - Charudatta M Phatak
- Materials Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA
| | - Cheng Wang
- Department of Electrical Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Supratik Guha
- Materials Science Division, Argonne National Laboratory, Lemont, IL, 60439, USA
- Pritzker School of Molecular Engineering, University of Chicago, Chicago, IL, 60637, USA
| |
Collapse
|
57
|
Rasch MJ, Mackin C, Le Gallo M, Chen A, Fasoli A, Odermatt F, Li N, Nandakumar SR, Narayanan P, Tsai H, Burr GW, Sebastian A, Narayanan V. Hardware-aware training for large-scale and diverse deep learning inference workloads using in-memory computing-based accelerators. Nat Commun 2023; 14:5282. [PMID: 37648721 PMCID: PMC10469175 DOI: 10.1038/s41467-023-40770-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 08/08/2023] [Indexed: 09/01/2023] Open
Abstract
Analog in-memory computing-a promising approach for energy-efficient acceleration of deep learning workloads-computes matrix-vector multiplications but only approximately, due to nonidealities that often are non-deterministic or nonlinear. This can adversely impact the achievable inference accuracy. Here, we develop an hardware-aware retraining approach to systematically examine the accuracy of analog in-memory computing across multiple network topologies, and investigate sensitivity and robustness to a broad set of nonidealities. By introducing a realistic crossbar model, we improve significantly on earlier retraining approaches. We show that many larger-scale deep neural networks-including convnets, recurrent networks, and transformers-can in fact be successfully retrained to show iso-accuracy with the floating point implementation. Our results further suggest that nonidealities that add noise to the inputs or outputs, not the weights, have the largest impact on accuracy, and that recurrent networks are particularly robust to all nonidealities.
Collapse
Affiliation(s)
- Malte J Rasch
- IBM Research, TJ Watson Research Center, Yorktown Heights, NY, USA.
| | | | | | - An Chen
- IBM Research Almaden, 650 Harry Road, San Jose, CA, USA
| | - Andrea Fasoli
- IBM Research Almaden, 650 Harry Road, San Jose, CA, USA
| | | | - Ning Li
- IBM Research, TJ Watson Research Center, Yorktown Heights, NY, USA
| | | | | | - Hsinyu Tsai
- IBM Research Almaden, 650 Harry Road, San Jose, CA, USA
| | | | | | - Vijay Narayanan
- IBM Research, TJ Watson Research Center, Yorktown Heights, NY, USA
| |
Collapse
|
58
|
Park J, Ha S, Yu T, Neftci E, Cauwenberghs G. A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics. Front Neurosci 2023; 17:1198306. [PMID: 37700751 PMCID: PMC10493285 DOI: 10.3389/fnins.2023.1198306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Accepted: 07/07/2023] [Indexed: 09/14/2023] Open
Abstract
Neuromorphic cognitive computing offers a bio-inspired means to approach the natural intelligence of biological neural systems in silicon integrated circuits. Typically, such circuits either reproduce biophysical neuronal dynamics in great detail as tools for computational neuroscience, or abstract away the biology by simplifying the functional forms of neural computation in large-scale systems for machine intelligence with high integration density and energy efficiency. Here we report a hybrid which offers biophysical realism in the emulation of multi-compartmental neuronal network dynamics at very large scale with high implementation efficiency, and yet with high flexibility in configuring the functional form and the network topology. The integrate-and-fire array transceiver (IFAT) chip emulates the continuous-time analog membrane dynamics of 65 k two-compartment neurons with conductance-based synapses. Fired action potentials are registered as address-event encoded output spikes, while the four types of synapses coupling to each neuron are activated by address-event decoded input spikes for fully reconfigurable synaptic connectivity, facilitating virtual wiring as implemented by routing address-event spikes externally through synaptic routing table. Peak conductance strength of synapse activation specified by the address-event input spans three decades of dynamic range, digitally controlled by pulse width and amplitude modulation (PWAM) of the drive voltage activating the log-domain linear synapse circuit. Two nested levels of micro-pipelining in the IFAT architecture improve both throughput and efficiency of synaptic input. This two-tier micro-pipelining results in a measured sustained peak throughput of 73 Mspikes/s and overall chip-level energy efficiency of 22 pJ/spike. Non-uniformity in digitally encoded synapse strength due to analog mismatch is mitigated through single-point digital offset calibration. Combined with the flexibly layered and recurrent synaptic connectivity provided by hierarchical address-event routing of registered spike events through external memory, the IFAT lends itself to efficient large-scale emulation of general biophysical spiking neural networks, as well as rate-based mapping of rectified linear unit (ReLU) neural activations.
Collapse
Affiliation(s)
- Jongkil Park
- Center for Neuromorphic Engineering, Korea Institute of Science and Technology (KIST), Seoul, Republic of Korea
- Institute for Neural Computation, University of California, San Diego, La Jolla, CA, United States
- Department of Electrical and Computer Engineering, Jacobs School of Engineering, University of California, San Diego, La Jolla, CA, United States
| | - Sohmyung Ha
- Institute for Neural Computation, University of California, San Diego, La Jolla, CA, United States
- Department of Bioengineering, Jacobs School of Engineering, University of California, San Diego, La Jolla, CA, United States
- Division of Engineering, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Theodore Yu
- Institute for Neural Computation, University of California, San Diego, La Jolla, CA, United States
- Department of Electrical and Computer Engineering, Jacobs School of Engineering, University of California, San Diego, La Jolla, CA, United States
| | - Emre Neftci
- Peter Grünberg Institute, Forschungszentrum Jülich, RWTH, Aachen, Germany
| | - Gert Cauwenberghs
- Institute for Neural Computation, University of California, San Diego, La Jolla, CA, United States
- Department of Bioengineering, Jacobs School of Engineering, University of California, San Diego, La Jolla, CA, United States
| |
Collapse
|
59
|
Zhang DL, Wang J, Wu Q, Du Y. Modulating the resistive switching stability of HfO 2-based RRAM through Gd doping engineering: DFT+ U. Phys Chem Chem Phys 2023; 25:22388-22400. [PMID: 37581208 DOI: 10.1039/d3cp02050a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/16/2023]
Abstract
Oxide-based resistive random access memory (RRAM) is standing out in both non-volatile memory and the emerging field of neuromorphic computing, with the consequence of increasing performance demands. Rare-earth doping is often used as an effective means for performance modulation. In this work, the modulation mechanism of the resistive switching (RS) behaviors in trivalent rare-earth Gd-doped HfO2-based RRAM has been carefully investigated using first-principles calculations. The results of electronic structure analysis show that Gd doping would lead to a change in the local geometry of the m-HfO2 defect system and would enhance the Coulomb interaction between the atoms around Gd and oxygen vacancy (VO), which may be one of the reasons for the enhanced conductivity of the HfO2-based RRAM after Gd doping. Thermodynamic and kinetic study results indicate that there is a strong interaction between Gd and its surrounding VO defects, and this strong interaction would not only attract more oxygen vacancies (VOs) to be generated near the dopant Gd, but also increase the migration energy barrier of the +2 charged VOs around the Gd doping site, thus suppressing the random generation of VO filaments, which leads to a better uniformity of the switching parameters during the RS process and improves the performance stability of the devices. The results of this work will provide new insights into modulating the RS behaviors and improving the device performance of HfO2-based RRAM through doping engineering.
Collapse
Affiliation(s)
- Dong-Lan Zhang
- State Key Laboratory of Powder Metallurgy, Central South University, Changsha 410083, China.
| | - Jiong Wang
- State Key Laboratory of Powder Metallurgy, Central South University, Changsha 410083, China.
| | - Qing Wu
- Information and Network Center, Central South University, Changsha, Hunan, 410083, China
| | - Yong Du
- State Key Laboratory of Powder Metallurgy, Central South University, Changsha 410083, China.
| |
Collapse
|
60
|
Ambrogio S, Narayanan P, Okazaki A, Fasoli A, Mackin C, Hosokawa K, Nomura A, Yasuda T, Chen A, Friz A, Ishii M, Luquin J, Kohda Y, Saulnier N, Brew K, Choi S, Ok I, Philip T, Chan V, Silvestre C, Ahsan I, Narayanan V, Tsai H, Burr GW. An analog-AI chip for energy-efficient speech recognition and transcription. Nature 2023; 620:768-775. [PMID: 37612392 PMCID: PMC10447234 DOI: 10.1038/s41586-023-06337-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 06/16/2023] [Indexed: 08/25/2023]
Abstract
Models of artificial intelligence (AI) that have billions of parameters can achieve high accuracy across a range of tasks1,2, but they exacerbate the poor energy efficiency of conventional general-purpose processors, such as graphics processing units or central processing units. Analog in-memory computing (analog-AI)3-7 can provide better energy efficiency by performing matrix-vector multiplications in parallel on 'memory tiles'. However, analog-AI has yet to demonstrate software-equivalent (SWeq) accuracy on models that require many such tiles and efficient communication of neural-network activations between the tiles. Here we present an analog-AI chip that combines 35 million phase-change memory devices across 34 tiles, massively parallel inter-tile communication and analog, low-power peripheral circuitry that can achieve up to 12.4 tera-operations per second per watt (TOPS/W) chip-sustained performance. We demonstrate fully end-to-end SWeq accuracy for a small keyword-spotting network and near-SWeq accuracy on the much larger MLPerf8 recurrent neural-network transducer (RNNT), with more than 45 million weights mapped onto more than 140 million phase-change memory devices across five chips.
Collapse
Affiliation(s)
- S Ambrogio
- IBM Research - Almaden, San Jose, CA, USA.
| | | | - A Okazaki
- IBM Research - Tokyo, Kawasaki, Japan
| | - A Fasoli
- IBM Research - Almaden, San Jose, CA, USA
| | - C Mackin
- IBM Research - Almaden, San Jose, CA, USA
| | | | - A Nomura
- IBM Research - Tokyo, Kawasaki, Japan
| | - T Yasuda
- IBM Research - Tokyo, Kawasaki, Japan
| | - A Chen
- IBM Research - Almaden, San Jose, CA, USA
| | - A Friz
- IBM Research - Almaden, San Jose, CA, USA
| | - M Ishii
- IBM Research - Tokyo, Kawasaki, Japan
| | - J Luquin
- IBM Research - Almaden, San Jose, CA, USA
| | - Y Kohda
- IBM Research - Tokyo, Kawasaki, Japan
| | - N Saulnier
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - K Brew
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - S Choi
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - I Ok
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - T Philip
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - V Chan
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - C Silvestre
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - I Ahsan
- IBM Research - Albany NanoTech Center, Albany, NY, USA
| | - V Narayanan
- IBM Thomas J. Watson Research Center, Yorktown Heights, NY, USA
| | - H Tsai
- IBM Research - Almaden, San Jose, CA, USA
| | - G W Burr
- IBM Research - Almaden, San Jose, CA, USA
| |
Collapse
|
61
|
Schegolev AE, Klenov NV, Gubochkin GI, Kupriyanov MY, Soloviev II. Bio-Inspired Design of Superconducting Spiking Neuron and Synapse. NANOMATERIALS (BASEL, SWITZERLAND) 2023; 13:2101. [PMID: 37513112 PMCID: PMC10383304 DOI: 10.3390/nano13142101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 07/11/2023] [Accepted: 07/17/2023] [Indexed: 07/30/2023]
Abstract
The imitative modelling of processes in the brain of living beings is an ambitious task. However, advances in the complexity of existing hardware brain models are limited by their low speed and high energy consumption. A superconducting circuit with Josephson junctions closely mimics the neuronal membrane with channels involved in the operation of the sodium-potassium pump. The dynamic processes in such a system are characterised by a duration of picoseconds and an energy level of attojoules. In this work, two superconducting models of a biological neuron are studied. New modes of their operation are identified, including the so-called bursting mode, which plays an important role in biological neural networks. The possibility of switching between different modes in situ is shown, providing the possibility of dynamic control of the system. A synaptic connection that mimics the short-term potentiation of a biological synapse is developed and demonstrated. Finally, the simplest two-neuron chain comprising the proposed bio-inspired components is simulated, and the prospects of superconducting hardware biosimilars are briefly discussed.
Collapse
Affiliation(s)
- Andrey E Schegolev
- Skobeltsyn Institute of Nuclear Physics, Lomonosov Moscow State University, 119991 Moscow, Russia
| | - Nikolay V Klenov
- Faculty of Physics, Moscow State University, 119991 Moscow, Russia
- Faculty of Physics, Lobachevsky State University of Nizhny Novgorod, 603950 Nizhny Novgorod, Russia
| | - Georgy I Gubochkin
- Faculty of Physics, Moscow State University, 119991 Moscow, Russia
- Russian Quantum Center, 100 Novaya Street, Skolkovo, 143025 Moscow, Russia
| | - Mikhail Yu Kupriyanov
- Skobeltsyn Institute of Nuclear Physics, Lomonosov Moscow State University, 119991 Moscow, Russia
| | - Igor I Soloviev
- Skobeltsyn Institute of Nuclear Physics, Lomonosov Moscow State University, 119991 Moscow, Russia
- Faculty of Physics, Lobachevsky State University of Nizhny Novgorod, 603950 Nizhny Novgorod, Russia
| |
Collapse
|
62
|
Oh J, Kim S, Lee C, Cha JH, Yang SY, Im SG, Park C, Jang BC, Choi SY. Preventing Vanishing Gradient Problem of Hardware Neuromorphic System by Implementing Imidazole-Based Memristive ReLU Activation Neuron. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2300023. [PMID: 36938884 DOI: 10.1002/adma.202300023] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/02/2023] [Revised: 03/05/2023] [Indexed: 06/16/2023]
Abstract
With advances in artificial intelligent services, brain-inspired neuromorphic systems with synaptic devices are recently attracting significant interest to circumvent the von Neumann bottleneck. However, the increasing trend of deep neural network parameters causes huge power consumption and large area overhead of a nonlinear neuron electronic circuit, and it incurs a vanishing gradient problem. Here, a memristor-based compact and energy-efficient neuron device is presented to implement a rectifying linear unit (ReLU) activation function. To emulate the volatile and gradual switching of the ReLU function, a copolymer memristor with a hybrid structure is proposed using a copolymer/inorganic bilayer. The functional copolymer film developed by introducing imidazole functional groups enables the formation of nanocluster-type pseudo-conductive filaments by boosting the nucleation of Cu nanoclusters, causing gradual switching. The ReLU neuron device is successfully demonstrated by integrating the memristor with amorphous InGaZnO thin-film transistors, and achieves 0.5 pJ of energy consumption based on sub-10 µA operation current and high-speed switching of 650 ns. Furthermore, device-to-system-level simulation using neuron devices on the MNIST dataset demonstrates that the vanishing gradient problem is effectively resolved by five-layer deep neural networks. The proposed neuron device will enable the implementation of high-density and energy-efficient hardware neuromorphic systems.
Collapse
Affiliation(s)
- Jungyeop Oh
- School of Electrical Engineering, Graphene/2D Materials Research Center, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Sungkyu Kim
- Department of Nanotechnology and Advanced Materials Engineering, Sejong University, 209 Neungdong-ro, Gwangjin-gu, Seoul, 05006, Republic of Korea
| | - Changhyeon Lee
- Department of Chemical and Biomolecular Engineering, Graphene/2D Materials Research Center, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Jun-Hwe Cha
- School of Electrical Engineering, Graphene/2D Materials Research Center, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Sang Yoon Yang
- School of Electrical Engineering, Graphene/2D Materials Research Center, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Sung Gap Im
- Department of Chemical and Biomolecular Engineering, Graphene/2D Materials Research Center, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Cheolmin Park
- School of Electrical Engineering, Graphene/2D Materials Research Center, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Byung Chul Jang
- School of Electronics and Electrical Engineering, Kyungpook National University, 41566, 80 Daehakro, Bukgu, Daegu, Republic of Korea
| | - Sung-Yool Choi
- School of Electrical Engineering, Graphene/2D Materials Research Center, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| |
Collapse
|
63
|
Lee HC, Kim J, Kim HR, Kim KH, Park KJ, So JP, Lee JM, Hwang MS, Park HG. Nanograin network memory with reconfigurable percolation paths for synaptic interactions. LIGHT, SCIENCE & APPLICATIONS 2023; 12:118. [PMID: 37188669 DOI: 10.1038/s41377-023-01168-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 04/15/2023] [Accepted: 04/23/2023] [Indexed: 05/17/2023]
Abstract
The development of memory devices with functions that simultaneously process and store data is required for efficient computation. To achieve this, artificial synaptic devices have been proposed because they can construct hybrid networks with biological neurons and perform neuromorphic computation. However, irreversible aging of these electrical devices causes unavoidable performance degradation. Although several photonic approaches to controlling currents have been suggested, suppression of current levels and switching of analog conductance in a simple photonic manner remain challenging. Here, we demonstrated a nanograin network memory using reconfigurable percolation paths in a single Si nanowire with solid core/porous shell and pure solid core segments. The electrical and photonic control of current percolation paths enabled the analog and reversible adjustment of the persistent current level, exhibiting memory behavior and current suppression in this single nanowire device. In addition, the synaptic behaviors of memory and erasure were demonstrated through potentiation and habituation processes. Photonic habituation was achieved using laser illumination on the porous nanowire shell, with a linear decrease in the postsynaptic current. Furthermore, synaptic elimination was emulated using two adjacent devices interconnected on a single nanowire. Therefore, electrical and photonic reconfiguration of the conductive paths in Si nanograin networks will pave the way for next-generation nanodevice technologies.
Collapse
Affiliation(s)
- Hoo-Cheol Lee
- Department of Physics, Korea University, Seoul, 02841, Republic of Korea
| | - Jungkil Kim
- Department of Physics, Jeju National University, Jeju, 63243, Republic of Korea.
| | - Ha-Reem Kim
- Department of Physics, Korea University, Seoul, 02841, Republic of Korea
| | - Kyoung-Ho Kim
- Department of Physics, Chungbuk National University, Cheongju, 28644, Republic of Korea
| | - Kyung-Jun Park
- Department of Physics, Korea University, Seoul, 02841, Republic of Korea
| | - Jae-Pil So
- Department of Physics, Korea University, Seoul, 02841, Republic of Korea
| | - Jung Min Lee
- Department of Physics, Korea University, Seoul, 02841, Republic of Korea
| | - Min-Soo Hwang
- Department of Physics, Korea University, Seoul, 02841, Republic of Korea
| | - Hong-Gyu Park
- Department of Physics, Korea University, Seoul, 02841, Republic of Korea.
| |
Collapse
|
64
|
Zhao H, Liu Z, Tang J, Gao B, Qin Q, Li J, Zhou Y, Yao P, Xi Y, Lin Y, Qian H, Wu H. Energy-efficient high-fidelity image reconstruction with memristor arrays for medical diagnosis. Nat Commun 2023; 14:2276. [PMID: 37081008 PMCID: PMC10119144 DOI: 10.1038/s41467-023-38021-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 04/06/2023] [Indexed: 04/22/2023] Open
Abstract
Medical imaging is an important tool for accurate medical diagnosis, while state-of-the-art image reconstruction algorithms raise critical challenges in massive data processing for high-speed and high-quality imaging. Here, we present a memristive image reconstructor (MIR) to greatly accelerate image reconstruction with discrete Fourier transformation (DFT) by computing-in-memory (CIM) with memristor arrays. A high-accuracy quasi-analogue mapping (QAM) method and generic complex matrix transfer (CMT) scheme was proposed to improve the mapping precision and transfer efficiency, respectively. High-fidelity magnetic resonance imaging (MRI) and computed tomography (CT) image reconstructions were demonstrated, achieving software-equivalent qualities and DICE scores after segmentation with nnU-Net algorithm. Remarkably, our MIR exhibited 153× and 79× improvements in energy efficiency and normalized image reconstruction speed, respectively, compared to graphics processing unit (GPU). This work demonstrates MIR as a promising high-fidelity image reconstruction platform for future medical diagnosis, and also largely extends the application of memristor-based CIM beyond artificial neural networks.
Collapse
Affiliation(s)
- Han Zhao
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Zhengwu Liu
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Jianshi Tang
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China.
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China.
| | - Bin Gao
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Qi Qin
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Jiaming Li
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Ying Zhou
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Peng Yao
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Yue Xi
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Yudeng Lin
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - He Qian
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| | - Huaqiang Wu
- School of Integrated Circuits, Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
- Beijing Innovation Center for Future Chips (ICFC), Tsinghua University, Beijing, 100084, China
| |
Collapse
|
65
|
Sanders LM, Scott RT, Yang JH, Qutub AA, Garcia Martin H, Berrios DC, Hastings JJA, Rask J, Mackintosh G, Hoarfrost AL, Chalk S, Kalantari J, Khezeli K, Antonsen EL, Babdor J, Barker R, Baranzini SE, Beheshti A, Delgado-Aparicio GM, Glicksberg BS, Greene CS, Haendel M, Hamid AA, Heller P, Jamieson D, Jarvis KJ, Komarova SV, Komorowski M, Kothiyal P, Mahabal A, Manor U, Mason CE, Matar M, Mias GI, Miller J, Myers JG, Nelson C, Oribello J, Park SM, Parsons-Wingerter P, Prabhu RK, Reynolds RJ, Saravia-Butler A, Saria S, Sawyer A, Singh NK, Snyder M, Soboczenski F, Soman K, Theriot CA, Van Valen D, Venkateswaran K, Warren L, Worthey L, Zitnik M, Costes SV. Biological research and self-driving labs in deep space supported by artificial intelligence. NAT MACH INTELL 2023. [DOI: 10.1038/s42256-023-00618-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
66
|
Fu T, Fu S, Yao J. Recent progress in bio-voltage memristors working with ultralow voltage of biological amplitude. NANOSCALE 2023; 15:4669-4681. [PMID: 36779566 DOI: 10.1039/d2nr06773k] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Neuromorphic systems built from memristors that emulate bioelectrical information processing in the brain may overcome the limitations of traditional computing architectures. However, functional emulation alone may still not attain all the merits of bio-computation, which uses action potentials of 50-120 mV at least 10 times lower than signal amplitude in conventional electronics to achieve extraordinary power efficiency and effective functional integration. Reducing the functional voltage in memristors to this biological amplitude can thus advance neuromorphic engineering and bio-emulated integration. This review aims to provide a timely update on the effort and progress in this burgeoning research direction, covering the aspects of device material composition, performance, working mechanism, and potential application.
Collapse
Affiliation(s)
- Tianda Fu
- Department of Electrical Computer and Engineering, University of Massachusetts, Amherst, MA 01003, USA.
| | - Shuai Fu
- Institute for Applied Life Sciences (IALS), University of Massachusetts, Amherst, MA 01003, USA
| | - Jun Yao
- Department of Electrical Computer and Engineering, University of Massachusetts, Amherst, MA 01003, USA.
- Institute for Applied Life Sciences (IALS), University of Massachusetts, Amherst, MA 01003, USA
- Department of Biomedical Engineering, University of Massachusetts, Amherst, MA 01003, USA
| |
Collapse
|
67
|
Zahoor F, Hussin FA, Isyaku UB, Gupta S, Khanday FA, Chattopadhyay A, Abbas H. Resistive random access memory: introduction to device mechanism, materials and application to neuromorphic computing. DISCOVER NANO 2023; 18:36. [PMID: 37382679 PMCID: PMC10409712 DOI: 10.1186/s11671-023-03775-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Accepted: 01/17/2023] [Indexed: 06/30/2023]
Abstract
The modern-day computing technologies are continuously undergoing a rapid changing landscape; thus, the demands of new memory types are growing that will be fast, energy efficient and durable. The limited scaling capabilities of the conventional memory technologies are pushing the limits of data-intense applications beyond the scope of silicon-based complementary metal oxide semiconductors (CMOS). Resistive random access memory (RRAM) is one of the most suitable emerging memory technologies candidates that have demonstrated potential to replace state-of-the-art integrated electronic devices for advanced computing and digital and analog circuit applications including neuromorphic networks. RRAM has grown in prominence in the recent years due to its simple structure, long retention, high operating speed, ultra-low-power operation capabilities, ability to scale to lower dimensions without affecting the device performance and the possibility of three-dimensional integration for high-density applications. Over the past few years, research has shown RRAM as one of the most suitable candidates for designing efficient, intelligent and secure computing system in the post-CMOS era. In this manuscript, the journey and the device engineering of RRAM with a special focus on the resistive switching mechanism are detailed. This review also focuses on the RRAM based on two-dimensional (2D) materials, as 2D materials offer unique electrical, chemical, mechanical and physical properties owing to their ultrathin, flexible and multilayer structure. Finally, the applications of RRAM in the field of neuromorphic computing are presented.
Collapse
Affiliation(s)
- Furqan Zahoor
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore
| | - Fawnizu Azmadi Hussin
- Department of Electrical and Electronics Engineering, Universiti Teknologi Petronas, Seri Iskandar, Malaysia
| | - Usman Bature Isyaku
- Department of Electrical and Electronics Engineering, Universiti Teknologi Petronas, Seri Iskandar, Malaysia
| | - Shagun Gupta
- School of Electronics and Communication Engineering, Shri Mata Vaishno Devi University, Katra, India
| | - Farooq Ahmad Khanday
- Department of Electronics & Instrumentation Technology, University of Kashmir, Srinagar, India
| | - Anupam Chattopadhyay
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore
| | - Haider Abbas
- Division of Material Science and Engineering, Hanyang University, Seoul, South Korea
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
68
|
Buckley SM, Tait AN, McCaughan AN, Shastri BJ. Photonic online learning: a perspective. NANOPHOTONICS 2023; 12:833-845. [PMID: 36909290 PMCID: PMC9995662 DOI: 10.1515/nanoph-2022-0553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 10/31/2022] [Accepted: 12/03/2022] [Indexed: 06/18/2023]
Abstract
Emerging neuromorphic hardware promises to solve certain problems faster and with higher energy efficiency than traditional computing by using physical processes that take place at the device level as the computational primitives in neural networks. While initial results in photonic neuromorphic hardware are very promising, such hardware requires programming or "training" that is often power-hungry and time-consuming. In this article, we examine the online learning paradigm, where the machinery for training is built deeply into the hardware itself. We argue that some form of online learning will be necessary if photonic neuromorphic hardware is to achieve its true potential.
Collapse
Affiliation(s)
- Sonia Mary Buckley
- Applied Physics Division, National Institute of Standards and Technology, Boulder, CO80305, USA
| | - Alexander N. Tait
- Department of Physics, Engineering Physics and Astronomy, Queen’s University, Kingston, ON, Canada
| | - Adam N. McCaughan
- Applied Physics Division, National Institute of Standards and Technology, Boulder, CO80305, USA
| | - Bhavin J. Shastri
- Department of Physics, Engineering Physics and Astronomy, Queen’s University, Kingston, ON, Canada
| |
Collapse
|
69
|
Rao M, Tang H, Wu J, Song W, Zhang M, Yin W, Zhuo Y, Kiani F, Chen B, Jiang X, Liu H, Chen HY, Midya R, Ye F, Jiang H, Wang Z, Wu M, Hu M, Wang H, Xia Q, Ge N, Li J, Yang JJ. Thousands of conductance levels in memristors integrated on CMOS. Nature 2023; 615:823-829. [PMID: 36991190 DOI: 10.1038/s41586-023-05759-5] [Citation(s) in RCA: 40] [Impact Index Per Article: 40.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Accepted: 01/25/2023] [Indexed: 03/31/2023]
Abstract
Neural networks based on memristive devices1-3 have the ability to improve throughput and energy efficiency for machine learning4,5 and artificial intelligence6, especially in edge applications7-21. Because training a neural network model from scratch is costly in terms of hardware resources, time and energy, it is impractical to do it individually on billions of memristive neural networks distributed at the edge. A practical approach would be to download the synaptic weights obtained from the cloud training and program them directly into memristors for the commercialization of edge applications. Some post-tuning in memristor conductance could be done afterwards or during applications to adapt to specific situations. Therefore, in neural network applications, memristors require high-precision programmability to guarantee uniform and accurate performance across a large number of memristive networks22-28. This requires many distinguishable conductance levels on each memristive device, not only laboratory-made devices but also devices fabricated in factories. Analog memristors with many conductance states also benefit other applications, such as neural network training, scientific computing and even 'mortal computing'25,29,30. Here we report 2,048 conductance levels achieved with memristors in fully integrated chips with 256 × 256 memristor arrays monolithically integrated on complementary metal-oxide-semiconductor (CMOS) circuits in a commercial foundry. We have identified the underlying physics that previously limited the number of conductance levels that could be achieved in memristors and developed electrical operation protocols to avoid such limitations. These results provide insights into the fundamental understanding of the microscopic picture of memristive switching as well as approaches to enable high-precision memristors for various applications. Fig. 1 HIGH-PRECISION MEMRISTOR FOR NEUROMORPHIC COMPUTING.: a, Proposed scheme of the large-scale application of memristive neural networks for edge computing. Neural network training is performed in the cloud. The obtained weights are downloaded and accurately programmed into a massive number of memristor arrays distributed at the edge, which imposes high-precision requirements on memristive devices. b, An eight-inch wafer with memristors fabricated by a commercial semiconductor manufacturer. c, High-resolution transmission electron microscopy image of the cross-section view of a memristor. Pt and Ta serve as the bottom electrode (BE) and top electrode (TE), respectively. Scale bars, 1 μm and 100 nm (inset). d, Magnification of the memristor material stack. Scale bar, 5 nm. e, As-programmed (blue) and after-denoising (red) currents of a memristor are read by a constant voltage (0.2 V). The denoising process eliminated the large-amplitude RTN observed in the as-programmed state (see Methods). f, Magnification of three nearest-neighbour states after denoising. The current of each state was read by a constant voltage (0.2 V). No large-amplitude RTN was observed, and all of the states can be clearly distinguished. g, An individual memristor on the chip was tuned into 2,048 resistance levels by high-resolution off-chip driving circuitry, and each resistance level was read by a d.c. voltage sweeping from 0 to 0.2 V. The target resistance was set from 50 µS to 4,144 µS with a 2-µS interval between neighbouring levels. All readings at 0.2 V are less than 1 µS from the target conductance. Bottom inset, magnification of the resistance levels. Top inset, experimental results of an entire 256 × 256 array programmed by its 6-bit on-chip circuitry into 64 32 × 32 blocks, and each block is programmed into one of the 64 conductance levels. Each of the 256 × 256 memristors has been previously switched over one million cycles, demonstrating the high endurance and robustness of the devices.
Collapse
Affiliation(s)
- Mingyi Rao
- TetraMem, Fremont, CA, USA
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | - Hao Tang
- Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Jiangbin Wu
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Wenhao Song
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | | | | | - Ye Zhuo
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Fatemeh Kiani
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | - Benjamin Chen
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | | | - Hefei Liu
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Hung-Yu Chen
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Rivu Midya
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | - Fan Ye
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | - Hao Jiang
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | - Zhongrui Wang
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | | | | | - Han Wang
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Qiangfei Xia
- TetraMem, Fremont, CA, USA
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA
| | | | - Ju Li
- Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - J Joshua Yang
- TetraMem, Fremont, CA, USA.
- Department of Electrical and Computer Engineering, University of Massachusetts, Amherst, MA, USA.
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
70
|
Sk MR, Thunder S, Lehninger D, Sanctis S, Raffel Y, Lederer M, Jank MPM, Kämpfe T, De S, Chakrabarti B. Ferroelectric Content-Addressable Memory Cells with IGZO Channel: Impact of Retention Degradation on the Multibit Operation. ACS APPLIED ELECTRONIC MATERIALS 2023; 5:812-820. [PMID: 36873263 PMCID: PMC9979788 DOI: 10.1021/acsaelm.2c01357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 11/25/2022] [Indexed: 06/18/2023]
Abstract
Indium gallium zinc oxide (IGZO)-based ferroelectric thin-film transistors (FeTFTs) are being vigorously investigated for being deployed in computing-in-memory (CIM) applications. Content-addressable memories (CAMs) are the quintessential example of CIM, which conduct a parallel search over a queue or stack to obtain the matched entries for a given input data. CAM cells offer the ability for massively parallel searches in a single clock cycle throughout an entire CAM array for the input query, thereby enabling pattern matching and searching functionality. Therefore, CAM cells are used extensively for pattern matching or search operations in data-centric computing. This paper investigates the impact of retention degradation on IGZO-based FeTFT on the multibit operation in content CAM cell applications. We propose a scalable multibit 1FeTFT-1T-based CAM cell composed of only one FeTFT and one transistor, thus significantly improving the density and energy efficiency compared with conventional complementary metal-oxide-semiconductor (CMOS)-based CAM. We successfully demonstrate the operations of our proposed CAM with storage and search by exploiting the multilevel states of the experimentally calibrated IGZO-based FeTFT devices. We also investigate the impact of retention degradation on the search operation. Our proposed IGZO-based 3-bit and 2-bit CAM cell shows 104 s and 106 s retention, respectively. The single-bit CAM cell shows lifelong (10 years) retention.
Collapse
Affiliation(s)
- Masud Rana Sk
- Indian
Institute of Technology Madras, Chennai600036, India
| | - Sunanda Thunder
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01099, Germany
| | - David Lehninger
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01099, Germany
| | - Shawn Sanctis
- Electron
Devices, Friedrich-Alexander-University
of Erlangen-Nuremberg, Cauerstr. 6, 91058 Erlangen, Germany
| | - Yannick Raffel
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01099, Germany
| | - Maximilian Lederer
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01099, Germany
| | - Michael P. M. Jank
- Fraunhofer-Institut
für Integrierte Systeme und Bauelementetechnologie, Erlangen91058, Germany
| | - Thomas Kämpfe
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01099, Germany
| | - Sourav De
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01099, Germany
| | | |
Collapse
|
71
|
Xiao Y, Jiang B, Zhang Z, Ke S, Jin Y, Wen X, Ye C. A review of memristor: material and structure design, device performance, applications and prospects. SCIENCE AND TECHNOLOGY OF ADVANCED MATERIALS 2023; 24:2162323. [PMID: 36872944 PMCID: PMC9980037 DOI: 10.1080/14686996.2022.2162323] [Citation(s) in RCA: 16] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Revised: 12/09/2022] [Accepted: 12/21/2022] [Indexed: 06/18/2023]
Abstract
With the booming growth of artificial intelligence (AI), the traditional von Neumann computing architecture based on complementary metal oxide semiconductor devices are facing memory wall and power wall. Memristor based in-memory computing can potentially overcome the current bottleneck of computer and achieve hardware breakthrough. In this review, the recent progress of memory devices in material and structure design, device performance and applications are summarized. Various resistive switching materials, including electrodes, binary oxides, perovskites, organics, and two-dimensional materials, are presented and their role in the memristor are discussed. Subsequently, the construction of shaped electrodes, the design of functional layer and other factors influencing the device performance are analyzed. We focus on the modulation of the resistances and the effective methods to enhance the performance. Furthermore, synaptic plasticity, optical-electrical properties, the fashionable applications in logic operation and analog calculation are introduced. Finally, some critical issues such as the resistive switching mechanism, multi-sensory fusion, system-level optimization are discussed.
Collapse
Affiliation(s)
- Yongyue Xiao
- Hubei Key Laboratory of Ferro-& Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, Wuhan, China
| | - Bei Jiang
- Hubei Key Laboratory of Ferro-& Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, Wuhan, China
| | - Zihao Zhang
- Hubei Key Laboratory of Ferro-& Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, Wuhan, China
| | - Shanwu Ke
- Hubei Key Laboratory of Ferro-& Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, Wuhan, China
| | - Yaoyao Jin
- Hubei Key Laboratory of Ferro-& Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, Wuhan, China
| | - Xin Wen
- Faculty of Chemical Technology and Engineering, West Pomeranian University of Technology in Szczecin, Szczecin, Poland
| | - Cong Ye
- Hubei Key Laboratory of Ferro-& Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, Wuhan, China
| |
Collapse
|
72
|
Chekol SA, Nacke R, Aussen S, Hoffmann-Eifert S. SET Kinetics of Ag/HfO 2-Based Diffusive Memristors under Various Counter-Electrode Materials. MICROMACHINES 2023; 14:571. [PMID: 36984978 PMCID: PMC10060002 DOI: 10.3390/mi14030571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 02/21/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
The counter-electrode (CE) material in electrochemical metallization memory (ECM) cells plays a crucial role in the switching process by affecting the reactions at the CE/electrolyte interface. This is due to the different electrocatalytic activity of the CE material towards reduction-oxidation reactions, which determines the metal ion concentration in the electrolyte and ultimately impacts the switching kinetics. In this study, the focus is laid on Pt, TiN, and W, which are relevant in standard chip technology. For these, the influence of CE metal on the switching kinetics of Ag/HfO2-based volatile ECM cells is investigated. Rectangular voltage pulses of different amplitudes were applied, and the SET times were analyzed from the transient curves. The results show that CE material has a significant effect on the SET kinetics, with differences being observed depending on the voltage regime. The formation of interfacial oxides at the CE/electrolyte interface, particularly for non-noble metals, is also discussed in relation to the findings. Overall, this work highlights the important role of the CE material in the switching process of Ag/HfO2-based diffusive memristors and the importance of considering interfacial oxide formation in the design of these devices.
Collapse
Affiliation(s)
- Solomon Amsalu Chekol
- Peter Grünberg Institute (PGI 7 and 10) and JARA-FIT, Forschungszentrum Jülich GmbH, Wilhelm-Johnen-Straße, 52428 Jülich, Germany
- Faculty of Georesources and Materials Engineering, RWTH Aachen University, Intzestraße 1, 52072 Aachen, Germany
| | - Richard Nacke
- Peter Grünberg Institute (PGI 7 and 10) and JARA-FIT, Forschungszentrum Jülich GmbH, Wilhelm-Johnen-Straße, 52428 Jülich, Germany
- Faculty of Mathematics, Computer Science and Natural Sciences, RWTH Aachen University, Templergraben 59, 52062 Aachen, Germany
| | - Stephan Aussen
- Peter Grünberg Institute (PGI 7 and 10) and JARA-FIT, Forschungszentrum Jülich GmbH, Wilhelm-Johnen-Straße, 52428 Jülich, Germany
- Faculty of Mathematics, Computer Science and Natural Sciences, RWTH Aachen University, Templergraben 59, 52062 Aachen, Germany
| | - Susanne Hoffmann-Eifert
- Peter Grünberg Institute (PGI 7 and 10) and JARA-FIT, Forschungszentrum Jülich GmbH, Wilhelm-Johnen-Straße, 52428 Jülich, Germany
| |
Collapse
|
73
|
Li Z, Tang W, Zhang B, Yang R, Miao X. Emerging memristive neurons for neuromorphic computing and sensing. SCIENCE AND TECHNOLOGY OF ADVANCED MATERIALS 2023; 24:2188878. [PMID: 37090846 PMCID: PMC10120469 DOI: 10.1080/14686996.2023.2188878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Inspired by the principles of the biological nervous system, neuromorphic engineering has brought a promising alternative approach to intelligence computing with high energy efficiency and low consumption. As pivotal components of neuromorphic system, artificial spiking neurons are powerful information processing units and can achieve highly complex nonlinear computations. By leveraging the switching dynamic characteristics of memristive device, memristive neurons show rich spiking behaviors with simple circuit. This report reviews the memristive neurons and their applications in neuromorphic sensing and computing systems. The switching mechanisms that endow memristive devices with rich dynamics and nonlinearity are highlighted, and subsequently various nonlinear spiking neuron behaviors emulated in these memristive devices are reviewed. Then, recent development is introduced on neuromorphic system with memristive neurons for sensing and computing. Finally, we discuss challenges and outlooks of the memristive neurons toward high-performance neuromorphic hardware systems and provide an insightful perspective for the development of interactive neuromorphic electronic systems.
Collapse
Affiliation(s)
- Zhiyuan Li
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| | - Wei Tang
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| | - Beining Zhang
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| | - Rui Yang
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
- CONTACT Rui Yang School of Integrated Circuits, Huazhong University of Science and Technology, Wuhan430074, China; Hubei Yangtze Memory Laboratories, Wuhan 430205, China
| | - Xiangshui Miao
- School of Integrated Circuits, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan, China
- Hubei Yangtze Memory Laboratories, Wuhan, China
| |
Collapse
|
74
|
Ha H, Pyo J, Lee Y, Kim S. Non-Volatile Memory and Synaptic Characteristics of TiN/CeO x/Pt RRAM Devices. MATERIALS (BASEL, SWITZERLAND) 2022; 15:9087. [PMID: 36556891 PMCID: PMC9786700 DOI: 10.3390/ma15249087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Revised: 12/13/2022] [Accepted: 12/16/2022] [Indexed: 06/17/2023]
Abstract
In this study, we investigate the synaptic characteristics and the non-volatile memory characteristics of TiN/CeOx/Pt RRAM devices for a neuromorphic system. The thickness and chemical properties of the CeOx are confirmed through TEM, EDS, and XPS analysis. A lot of oxygen vacancies (ions) in CeOx film enhance resistive switching. The stable bipolar resistive switching characteristics, endurance cycling (>100 cycles), and non-volatile properties in the retention test (>10,000 s) are assessed through DC sweep. The filamentary switching model and Schottky emission-based conduction model are presented for TiN/CeOx/Pt RRAM devices in the LRS and HRS. The compliance current (1~5 mA) and reset stop voltage (−1.3~−2.2 V) are used in the set and reset processes, respectively, to implement multi-level cell (MLC) in DC sweep mode. Based on neural activity, a neuromorphic system is performed by electrical stimulation. Accordingly, the pulse responses achieve longer endurance cycling (>10,000 cycles), MLC (potentiation and depression), spike-timing dependent plasticity (STDP), and excitatory postsynaptic current (EPSC) to mimic synapse using TiN/CeOx/Pt RRAM devices.
Collapse
|
75
|
Shu F, Chen X, Yu Z, Gao P, Liu G. Metal-Organic Frameworks-Based Memristors: Materials, Devices, and Applications. MOLECULES (BASEL, SWITZERLAND) 2022; 27:molecules27248888. [PMID: 36558025 PMCID: PMC9788367 DOI: 10.3390/molecules27248888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2022] [Revised: 12/09/2022] [Accepted: 12/11/2022] [Indexed: 12/23/2022]
Abstract
Facing the explosive growth of data, a number of new micro-nano devices with simple structure, low power consumption, and size scalability have emerged in recent years, such as neuromorphic computing based on memristor. The selection of resistive switching layer materials is extremely important for fabricating of high performance memristors. As an organic-inorganic hybrid material, metal-organic frameworks (MOFs) have the advantages of both inorganic and organic materials, which makes the memristors using it as a resistive switching layer show the characteristics of fast erasing speed, outstanding cycling stability, conspicuous mechanical flexibility, good biocompatibility, etc. Herein, the recent advances of MOFs-based memristors in materials, devices, and applications are summarized, especially the potential applications of MOFs-based memristors in data storage and neuromorphic computing. There also are discussions and analyses of the challenges of the current research to provide valuable insights for the development of MOFs-based memristors.
Collapse
Affiliation(s)
- Fan Shu
- Department of Micro/Nano Electronics, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- School of Chemistry and Chemical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xinhui Chen
- Department of Micro/Nano Electronics, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- College of Information Engineering, Jinhua Polytechnic, Jinhua 321017, China
| | - Zhe Yu
- Department of Micro/Nano Electronics, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- School of Materials, Sun Yat-sen University, Guangzhou 510275, China
- Correspondence: (Z.Y.); (P.G.); (G.L.)
| | - Pingqi Gao
- School of Materials, Sun Yat-sen University, Guangzhou 510275, China
- Correspondence: (Z.Y.); (P.G.); (G.L.)
| | - Gang Liu
- Department of Micro/Nano Electronics, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- School of Chemistry and Chemical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- Correspondence: (Z.Y.); (P.G.); (G.L.)
| |
Collapse
|
76
|
Raffel Y, De S, Lederer M, Olivo RR, Hoffmann R, Thunder S, Pirro L, Beyer S, Chohan T, Kämpfe T, Seidel K, Heitmann J. Synergistic Approach of Interfacial Layer Engineering and READ-Voltage Optimization in HfO 2-Based FeFETs for In-Memory-Computing Applications. ACS APPLIED ELECTRONIC MATERIALS 2022; 4:5292-5300. [PMID: 36439397 PMCID: PMC9686141 DOI: 10.1021/acsaelm.2c00771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 09/20/2022] [Indexed: 06/16/2023]
Abstract
This article reports an improvement in the performance of the hafnium oxide-based (HfO2) ferroelectric field-effect transistors (FeFET) achieved by a synergistic approach of interfacial layer (IL) engineering and READ-voltage optimization. FeFET devices with silicon dioxide (SiO2) and silicon oxynitride (SiON) as IL were fabricated and characterized. Although the FeFETs with SiO2 interfaces demonstrated better low-frequency characteristics compared to the FeFETs with SiON interfaces, the latter demonstrated better WRITE endurance and retention. Finally, the neuromorphic simulation was conducted to evaluate the performance of FeFETs with SiO2 and SiON IL as synaptic devices. We observed that the WRITE endurance in both types of FeFETs was insufficient to carry out online neural network training. Therefore, we consider an inference-only operation with offline neural network training. The system-level simulation reveals that the impact of systematic degradation via retention degradation is much more significant for inference-only operation than low-frequency noise. The neural network with FeFETs based on SiON IL in the synaptic core shows 96% accuracy for the inference operation on the handwritten digit from the Modified National Institute of Standards and Technology (MNIST) data set in the presence of flicker noise and retention degradation, which is only a 2.5% deviation from the software baseline.
Collapse
Affiliation(s)
- Yannick Raffel
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | - Sourav De
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | - Maximilian Lederer
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | - Ricardo Revello Olivo
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | - Raik Hoffmann
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | - Sunanda Thunder
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | | | | | | | - Thomas Kämpfe
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | - Konrad Seidel
- Fraunhofer-Institut
für Photonische Mikrosysteme IPMS - Center Nanoelectronic Technologies, Dresden01109, Germany
| | - Johannes Heitmann
- Technische
Universität Bergakademie Freiberg, Freiberg09599, Germany
| |
Collapse
|