1
|
A Framework for Ultra Low-Power Hardware Accelerators Using NNs for Embedded Time Series Classification. JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS 2021. [DOI: 10.3390/jlpea12010002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In embedded applications that use neural networks (NNs) for classification tasks, it is important to not only minimize the power consumption of the NN calculation, but of the whole system. Optimization approaches for individual parts exist, such as quantization of the NN or analog calculation of arithmetic operations. However, there is no holistic approach for a complete embedded system design that is generic enough in the design process to be used for different applications, but specific in the hardware implementation to waste no energy for a given application. Therefore, we present a novel framework that allows an end-to-end ASIC implementation of a low-power hardware for time series classification using NNs. This includes a neural architecture search (NAS), which optimizes the NN configuration for accuracy and energy efficiency at the same time. This optimization targets a custom designed hardware architecture that is derived from the key properties of time series classification tasks. Additionally, a hardware generation tool is used that creates a complete system from the definition of the NN. This system uses local multi-level RRAM memory as weight and bias storage to avoid external memory access. Exploiting the non-volatility of these devices, such a system can use a power-down mode to save significant energy during the data acquisition process. Detection of atrial fibrillation (AFib) in electrocardiogram (ECG) data is used as an example for evaluation of the framework. It is shown that a reduction of more than 95% of the energy consumption compared to state-of-the-art solutions is achieved.
Collapse
|
2
|
Koelewijn AD, Audu M, del-Ama AJ, Colucci A, Font-Llagunes JM, Gogeascoechea A, Hnat SK, Makowski N, Moreno JC, Nandor M, Quinn R, Reichenbach M, Reyes RD, Sartori M, Soekadar S, Triolo RJ, Vermehren M, Wenger C, Yavuz US, Fey D, Beckerle P. Adaptation Strategies for Personalized Gait Neuroprosthetics. Front Neurorobot 2021; 15:750519. [PMID: 34975445 PMCID: PMC8716811 DOI: 10.3389/fnbot.2021.750519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 11/18/2021] [Indexed: 11/13/2022] Open
Abstract
Personalization of gait neuroprosthetics is paramount to ensure their efficacy for users, who experience severe limitations in mobility without an assistive device. Our goal is to develop assistive devices that collaborate with and are tailored to their users, while allowing them to use as much of their existing capabilities as possible. Currently, personalization of devices is challenging, and technological advances are required to achieve this goal. Therefore, this paper presents an overview of challenges and research directions regarding an interface with the peripheral nervous system, an interface with the central nervous system, and the requirements of interface computing architectures. The interface should be modular and adaptable, such that it can provide assistance where it is needed. Novel data processing technology should be developed to allow for real-time processing while accounting for signal variations in the human. Personalized biomechanical models and simulation techniques should be developed to predict assisted walking motions and interactions between the user and the device. Furthermore, the advantages of interfacing with both the brain and the spinal cord or the periphery should be further explored. Technological advances of interface computing architecture should focus on learning on the chip to achieve further personalization. Furthermore, energy consumption should be low to allow for longer use of the neuroprosthesis. In-memory processing combined with resistive random access memory is a promising technology for both. This paper discusses the aforementioned aspects to highlight new directions for future research in gait neuroprosthetics.
Collapse
Affiliation(s)
- Anne D. Koelewijn
- Biomechanical Data Analysis and Creation (BIOMAC) Group, Machine Learning and Data Analytics Lab, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Musa Audu
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Antonio J. del-Ama
- Applied Mathematics, Materials Science and Technology and Electronic Technology Department, Rey Juan Carlos University, Mostoles, Spain
| | - Annalisa Colucci
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Neurosciences, Charité - Universita¨tsmedizin Berlin, Berlin, Germany
| | - Josep M. Font-Llagunes
- Biomechanical Engineering Lab, Department of Mechanical Engineering and Research Centre for Biomedical Engineering, Universitat Politècnica de Catalunya, Barcelona, Spain
- Institut de Recerca Sant Joan de Déu, Esplugues de Llobregat, Spain
| | - Antonio Gogeascoechea
- Department of Biomechanical Engineering, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| | - Sandra K. Hnat
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Nathan Makowski
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Physical Medicine and Rehabilitation, MetroHealth Medical Center, Cleveland, OH, United States
| | - Juan C. Moreno
- Neural Rehabilitation Group, Department of Translational Neuroscience, Cajal Institute, CSIC, Madrid, Spain
| | - Mark Nandor
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Mechanical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Roger Quinn
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Mechanical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Marc Reichenbach
- Chair of Computer Engineering, Brandenburg University of Technology Cottbus-Senftenberg, Cottbus, Germany
- Chair for Computer Architecture, Department of Computer Science, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Ryan-David Reyes
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Massimo Sartori
- Department of Biomechanical Engineering, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| | - Surjo Soekadar
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Neurosciences, Charité - Universita¨tsmedizin Berlin, Berlin, Germany
| | - Ronald J. Triolo
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Mareike Vermehren
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Neurosciences, Charité - Universita¨tsmedizin Berlin, Berlin, Germany
| | - Christian Wenger
- IHP-Leibniz Institut Fuer Innovative Mikroelektronik, Frankfurt (Oder), Germany
| | - Utku S. Yavuz
- Biomedical Signals and Systems Group, University of Twente, Enschede, Netherlands
| | - Dietmar Fey
- Chair for Computer Architecture, Department of Computer Science, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Philipp Beckerle
- Chair of Autonomous Systems and Mechatronics, Department of Electrical Engineering, Artificial Intelligence in Biomedical Engineering, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|