1
|
Donati E, Valle G. Neuromorphic hardware for somatosensory neuroprostheses. Nat Commun 2024; 15:556. [PMID: 38228580 PMCID: PMC10791662 DOI: 10.1038/s41467-024-44723-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Accepted: 01/03/2024] [Indexed: 01/18/2024] Open
Abstract
In individuals with sensory-motor impairments, missing limb functions can be restored using neuroprosthetic devices that directly interface with the nervous system. However, restoring the natural tactile experience through electrical neural stimulation requires complex encoding strategies. Indeed, they are presently limited in effectively conveying or restoring tactile sensations by bandwidth constraints. Neuromorphic technology, which mimics the natural behavior of neurons and synapses, holds promise for replicating the encoding of natural touch, potentially informing neurostimulation design. In this perspective, we propose that incorporating neuromorphic technologies into neuroprostheses could be an effective approach for developing more natural human-machine interfaces, potentially leading to advancements in device performance, acceptability, and embeddability. We also highlight ongoing challenges and the required actions to facilitate the future integration of these advanced technologies.
Collapse
Affiliation(s)
- Elisa Donati
- Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland.
| | - Giacomo Valle
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA.
| |
Collapse
|
2
|
Yang JH, Kim SY, Lim SC. Effects of Sensing Tactile Arrays, Shear Force, and Proprioception of Robot on Texture Recognition. SENSORS (BASEL, SWITZERLAND) 2023; 23:3201. [PMID: 36991912 PMCID: PMC10054873 DOI: 10.3390/s23063201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 03/13/2023] [Accepted: 03/15/2023] [Indexed: 06/19/2023]
Abstract
In robotics, tactile perception is important for fine control using robot grippers and hands. To effectively incorporate tactile perception in robots, it is essential to understand how humans use mechanoreceptors and proprioceptors to perceive texture. Thus, our study aimed to investigate the impact of tactile sensor arrays, shear force, and the positional information of the robot's end effector on its ability to recognize texture. A deep learning network was employed to classify tactile data from 24 different textures that were explored by a robot. The input values of the deep learning network were modified based on variations in the number of channels of the tactile signal, the arrangement of the tactile sensor, the presence or absence of shear force, and the positional information of the robot. By comparing the accuracy of texture recognition, our analysis revealed that tactile sensor arrays more accurately recognized the texture compared to a single tactile sensor. The utilization of shear force and positional information of the robot resulted in an improved accuracy of texture recognition when using a single tactile sensor. Furthermore, an equal number of sensors placed in a vertical arrangement led to a more accurate distinction of textures during exploration when compared to sensors placed in a horizontal arrangement. The results of this study indicate that the implementation of a tactile sensor array should be prioritized over a single sensor for enhanced accuracy in tactile sensing, and the use of integrated data should be considered for single tactile sensing.
Collapse
|
3
|
Texture recognition based on multi-sensory integration of proprioceptive and tactile signals. Sci Rep 2022; 12:21690. [PMID: 36522364 PMCID: PMC9755227 DOI: 10.1038/s41598-022-24640-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Accepted: 11/17/2022] [Indexed: 12/23/2022] Open
Abstract
The sense of touch plays a fundamental role in enabling us to interact with our surrounding environment. Indeed, the presence of tactile feedback in prostheses greatly assists amputees in doing daily tasks. In this line, the present study proposes an integration of artificial tactile and proprioception receptors for texture discrimination under varying scanning speeds. Here, we fabricated a soft biomimetic fingertip including an 8 × 8 array tactile sensor and a piezoelectric sensor to mimic Merkel, Meissner, and Pacinian mechanoreceptors in glabrous skin, respectively. A hydro-elastomer sensor was fabricated as an artificial proprioception sensor (muscle spindles) to assess the instantaneous speed of the biomimetic fingertip. In this study, we investigated the concept of the complex receptive field of RA-I and SA-I afferents for naturalistic textures. Next, to evaluate the synergy between the mechanoreceptors and muscle spindle afferents, ten naturalistic textures were manipulated by a soft biomimetic fingertip at six different speeds. The sensors' outputs were converted into neuromorphic spike trains to mimic the firing pattern of biological mechanoreceptors. These spike responses are then analyzed using machine learning classifiers and neural coding paradigms to explore the multi-sensory integration in real experiments. This synergy between muscle spindle and mechanoreceptors in the proposed neuromorphic system represents a generalized texture discrimination scheme and interestingly irrespective of the scanning speed.
Collapse
|
4
|
Contact Pattern Recognition of a Flexible Tactile Sensor Based on the CNN-LSTM Fusion Algorithm. MICROMACHINES 2022; 13:mi13071053. [PMID: 35888868 PMCID: PMC9317185 DOI: 10.3390/mi13071053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Revised: 06/22/2022] [Accepted: 06/28/2022] [Indexed: 11/17/2022]
Abstract
Recognizing different contact patterns imposed on tactile sensors plays a very important role in human–machine interaction. In this paper, a flexible tactile sensor with great dynamic response characteristics is designed and manufactured based on polyvinylidene fluoride (PVDF) material. Four contact patterns (stroking, patting, kneading, and scratching) are applied to the tactile sensor, and time sequence data of the four contact patterns are collected. After that, a fusion model based on the convolutional neural network (CNN) and the long-short term memory (LSTM) neural network named CNN-LSTM is constructed. It is used to classify and recognize the four contact patterns loaded on the tactile sensor, and the recognition accuracies of the four patterns are 99.60%, 99.67%, 99.07%, and 99.40%, respectively. At last, a CNN model and a random forest (RF) algorithm model are constructed to recognize the four contact patterns based on the same dataset as those for the CNN-LSTM model. The average accuracies of the four contact patterns based on the CNN-LSTM, the CNN, and the RF algorithm are 99.43%, 96.67%, and 91.39%, respectively. All of the experimental results indicate that the CNN-LSTM constructed in this paper has very efficient performance in recognizing and classifying the contact patterns for the flexible tactile sensor.
Collapse
|
5
|
Joolee JB, Uddin MA, Jeon S. Deep multi-model fusion network based real object tactile understanding from haptic data. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03181-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
6
|
Qin L, Zhang Y. A reference spike train-based neurocomputing method for enhanced tactile discrimination of surface roughness. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-06119-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
7
|
Computational approach to understand temporal and spatial tactile transmission processes from mechanical stimuli of the index fingertip to the primary somatosensory cortex. J Neurosci Methods 2021; 359:109215. [PMID: 33957157 DOI: 10.1016/j.jneumeth.2021.109215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Revised: 04/15/2021] [Accepted: 04/29/2021] [Indexed: 11/23/2022]
Abstract
Mechanisms of information transmission using tactile sense are one of major concerns in producing simulated experience in virtual or augmented reality as well as in compensating elderly or impaired people with diminished tactile sensory function. However, important mechanism of the difference of peak latency in the primary somatosensory cortex (SI) between electrical and mechanical stimulations of finger skin is not fully understood. We propose a computational approach to fuse a computational model to simulate temporal and spatial transmission processes from mechanical stimuli to the SI and experimental method using a magnetoencephalograph (MEG). In our model, a tactile model that combined a three-dimensional mechanical model of fingertip skin and a neurophysiological model of a slowly adapting type 1 (SA1) mechanoreceptor was integrated with a somatosensory evoked field (SEF) response model. Electrical and mechanical stimulations were applied to the same locations of the right or left index fingertips of three subjects using a MEG. By identifying parameters of the SEF response model using the electrical stimulation test data, predicted first peak latency due to a mechanical stimulus was identical to its average value obtained from the mechanical stimulation test data, while the spatial map predicted at the multiple SA1 receptors qualitatively corresponded to the MEG image map in the timings of peak latency. This suggests that mechanical change in the skin and neurophysiological responses generate the difference of peak latency in SI between electrical and mechanical stimulations. The computational approach has the potential for detailed investigation of mechanisms of tactile information transmission.
Collapse
|
8
|
Birkoben T, Winterfeld H, Fichtner S, Petraru A, Kohlstedt H. A spiking and adapting tactile sensor for neuromorphic applications. Sci Rep 2020; 10:17260. [PMID: 33057032 PMCID: PMC7560658 DOI: 10.1038/s41598-020-74219-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2019] [Accepted: 09/29/2020] [Indexed: 11/23/2022] Open
Abstract
The ongoing research on and development of increasingly intelligent artificial systems propels the need for bio inspired pressure sensitive spiking circuits. Here we present an adapting and spiking tactile sensor, based on a neuronal model and a piezoelectric field-effect transistor (PiezoFET). The piezoelectric sensor device consists of a metal-oxide semiconductor field-effect transistor comprising a piezoelectric aluminium-scandium-nitride (AlxSc1-xN) layer inside of the gate stack. The so augmented device is sensitive to mechanical stress. In combination with an analogue circuit, this sensor unit is capable of encoding the mechanical quantity into a series of spikes with an ongoing adaptation of the output frequency. This allows for a broad application in the context of robotic and neuromorphic systems, since it enables said systems to receive information from the surrounding environment and provide encoded spike trains for neuromorphic hardware. We present numerical and experimental results on this spiking and adapting tactile sensor.
Collapse
Affiliation(s)
- Tom Birkoben
- Nanoelektronik, Technische Fakultät, Christian-Albrechts-Universität zu Kiel, 24143, Kiel, Germany.
| | - Henning Winterfeld
- Nanoelektronik, Technische Fakultät, Christian-Albrechts-Universität zu Kiel, 24143, Kiel, Germany
| | - Simon Fichtner
- Materials and Processes for Nanosystem Technologies, Technische Fakultät, Christian-Albrechts-Universität zu Kiel, 24143, Kiel, Germany
| | - Adrian Petraru
- Nanoelektronik, Technische Fakultät, Christian-Albrechts-Universität zu Kiel, 24143, Kiel, Germany
| | - Hermann Kohlstedt
- Nanoelektronik, Technische Fakultät, Christian-Albrechts-Universität zu Kiel, 24143, Kiel, Germany.
| |
Collapse
|
9
|
Sankar S, Balamurugan D, Brown A, Ding K, Xu X, Low JH, Yeow CH, Thakor N. Texture Discrimination with a Soft Biomimetic Finger Using a Flexible Neuromorphic Tactile Sensor Array That Provides Sensory Feedback. Soft Robot 2020; 8:577-587. [PMID: 32976080 DOI: 10.1089/soro.2020.0016] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023] Open
Abstract
The compliant nature of soft fingers allows for safe and dexterous manipulation of objects by humans in an unstructured environment. A soft prosthetic finger design with tactile sensing capabilities for texture discrimination and subsequent sensory stimulation has the potential to create a more natural experience for an amputee. In this work, a pneumatically actuated soft biomimetic finger is integrated with a textile neuromorphic tactile sensor array for a texture discrimination task. The tactile sensor outputs were converted into neuromorphic spike trains, which emulate the firing pattern of biological mechanoreceptors. Spike-based features from each taxel compressed the information and were then used as inputs for the support vector machine classifier to differentiate the textures. Our soft biomimetic finger with neuromorphic encoding was able to achieve an average overall classification accuracy of 99.57% over 16 independent parameters when tested on 13 standardized textured surfaces. The 16 parameters were the combination of 4 angles of flexion of the soft finger and 4 speeds of palpation. To aid in the perception of more natural objects and their manipulation, subjects were provided with transcutaneous electrical nerve stimulation to convey a subset of four textures with varied textural information. Three able-bodied subjects successfully distinguished two or three textures with the applied stimuli. This work paves the way for a more human-like prosthesis through a soft biomimetic finger with texture discrimination capabilities using neuromorphic techniques that provide sensory feedback; furthermore, texture feedback has the potential to enhance user experience when interacting with their surroundings.
Collapse
Affiliation(s)
- Sriramana Sankar
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Darshini Balamurugan
- Laboratory for Computational Sensing and Robotics, (LCSR) Johns Hopkins University, Baltimore, Maryland, USA
| | - Alisa Brown
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Keqin Ding
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Xingyuan Xu
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
| | - Jin Huat Low
- Department of Biomedical Engineering, National University of Singapore, Singapore
| | - Chen Hua Yeow
- Department of Biomedical Engineering, National University of Singapore, Singapore
| | - Nitish Thakor
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland, USA.,Department of Biomedical Engineering, National University of Singapore, Singapore.,Singapore Institute for Neurotechnology (SINAPSE) Laboratory, National University of Singapore, Singapore
| |
Collapse
|
10
|
Neuromorphic approach to tactile edge orientation estimation using spatiotemporal similarity. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.04.131] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
11
|
Liu H, Guo D, Sun F, Yang W, Furber S, Sun T. Embodied tactile perception and learning. BRAIN SCIENCE ADVANCES 2020. [DOI: 10.26599/bsa.2020.9050012] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
Various living creatures exhibit embodiment intelligence, which is reflected by a collaborative interaction of the brain, body, and environment. The actual behavior of embodiment intelligence is generated by a continuous and dynamic interaction between a subject and the environment through information perception and physical manipulation. The physical interaction between a robot and the environment is the basis for realizing embodied perception and learning. Tactile information plays a critical role in this physical interaction process. It can be used to ensure safety, stability, and compliance, and can provide unique information that is difficult to capture using other perception modalities. However, due to the limitations of existing sensors and perception and learning methods, the development of robotic tactile research lags significantly behind other sensing modalities, such as vision and hearing, thereby seriously restricting the development of robotic embodiment intelligence. This paper presents the current challenges related to robotic tactile embodiment intelligence and reviews the theory and methods of robotic embodied tactile intelligence. Tactile perception and learning methods for embodiment intelligence can be designed based on the development of new large‐scale tactile array sensing devices, with the aim to make breakthroughs in the neuromorphic computing technology of tactile intelligence.
Collapse
Affiliation(s)
- Huaping Liu
- Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
| | - Di Guo
- Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
| | - Fuchun Sun
- Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
| | - Wuqiang Yang
- Department of Electrical and Electronic Engineering, The University of Manchester, Manchester M13 9 PL, U.K
| | - Steve Furber
- Department of Computer Science, The University of Manchester, Manchester M13 9 PL, U.K
| | - Tengchen Sun
- Beijing Tashan Technology Co., Ltd., Beijing 102300, China
| |
Collapse
|
12
|
Salimi-Nezhad N, Ilbeigi E, Amiri M, Falotico E, Laschi C. A Digital Hardware System for Spiking Network of Tactile Afferents. Front Neurosci 2020; 13:1330. [PMID: 32009869 PMCID: PMC6971225 DOI: 10.3389/fnins.2019.01330] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Accepted: 11/26/2019] [Indexed: 11/13/2022] Open
Abstract
In the present research, we explore the possibility of utilizing a hardware-based neuromorphic approach to develop a tactile sensory system at the level of first-order afferents, which are slowly adapting type 1 (SA-I) and fast adapting type 1 (FA-I) afferents. Four spiking models are used to mimic neural signals of both SA-I and FA-I primary afferents. Next, a digital circuit is designed for each spiking model for both afferents to be implemented on the field-programmable gate array (FPGA). The four different digital circuits are then compared from source utilization point of view to find the minimum cost circuit for creating a population of digital afferents. In this way, the firing responses of both SA-I and FA-I afferents are physically measured in hardware. Finally, a population of 243 afferents consisting of 90 SA-I and 153 FA-I digital neuromorphic circuits are implemented on the FPGA. The FPGA also receives nine inputs from the force sensors through an interfacing board. Therefore, the data of multiple inputs are processed by the spiking network of tactile afferents, simultaneously. Benefiting from parallel processing capabilities of FPGA, the proposed architecture offers a low-cost neuromorphic structure for tactile information processing. Applying machine learning algorithms on the artificial spiking patterns collected from FPGA, we successfully classified three different objects based on the firing rate paradigm. Consequently, the proposed neuromorphic system provides the opportunity for development of new tactile processing component for robotic and prosthetic applications.
Collapse
Affiliation(s)
- Nima Salimi-Nezhad
- Medical Biology Research Center, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Erfan Ilbeigi
- Medical Biology Research Center, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Mahmood Amiri
- Medical Technology Research Center, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Egidio Falotico
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
| | - Cecilia Laschi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy
| |
Collapse
|
13
|
Yi Z, Zhang Y. A spike train distance-based method to evaluate the response of mechanoreceptive afferents. Neural Comput Appl 2019. [DOI: 10.1007/s00521-018-3465-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
14
|
Balamurugan D, Nakagawa-Silva A, Nguyen H, Low JH, Shallal C, Osborn L, Soares AB, Yeow RCH, Thakor N. Texture Discrimination using a Soft Biomimetic Finger for Prosthetic Applications. IEEE Int Conf Rehabil Robot 2019; 2019:380-385. [PMID: 31374659 DOI: 10.1109/icorr.2019.8779442] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Soft robotic fingers have shown great potential for use in prostheses due to their inherent compliant, light, and dexterous nature. Recent advancements in sensor technology for soft robotic systems showcase their ability to perceive and respond to static cues. However, most of the soft fingers for use in prosthetic applications are not equipped with sensors which have the ability to perceive texture like humans can. In this work, we present a dexterous, soft, biomimetic solution which is capable of discrimination of textures. We fabricated a soft finger with two individually controllable degrees of freedom with a tactile sensor embedded at the fingertip. The output of the tac- tile sensor, as texture plates were palpated, was converted into spikes, mimicking the behavior of a biological mechanoreceptor. We explored the spatial properties of the textures captured in the form of spiking patterns by generating spatial event plots and analyzing the similarity between spike trains generated for each texture. Unique features representative of the different textures were then extracted from the spikes and input to a classifier. The textures were successfully classified with an accuracy of 94% when palpating at a rate of 42 mm/s. This work demonstrates the potential of providing amputees with a soft finger with sensing capabilities, which could potentially help discriminate between different objects and surfaces during activities of daily living (ADL) through palpation.
Collapse
|
15
|
Predict Afferent Tactile Neural Signal for Artificial Nerve Based on Finite Element Human Hand Model. INTELLIGENT ROBOTICS AND APPLICATIONS 2019. [DOI: 10.1007/978-3-030-27526-6_12] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
16
|
Salimi-Nezhad N, Amiri M, Falotico E, Laschi C. A Digital Hardware Realization for Spiking Model of Cutaneous Mechanoreceptor. Front Neurosci 2018; 12:322. [PMID: 29937707 PMCID: PMC6003138 DOI: 10.3389/fnins.2018.00322] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2017] [Accepted: 04/25/2018] [Indexed: 11/17/2022] Open
Abstract
Inspired by the biology of human tactile perception, a hardware neuromorphic approach is proposed for spiking model of mechanoreceptors to encode the input force. In this way, a digital circuit is designed for a slowly adapting type I (SA-I) and fast adapting type I (FA-I) mechanoreceptors to be implemented on a low-cost digital hardware, such as field-programmable gate array (FPGA). This system computationally replicates the neural firing responses of both afferents. Then, comparative simulations are shown. The spiking models of mechanoreceptors are first simulated in MATLAB and next the digital neuromorphic circuits simulated in VIVADO are also compared to show that obtained results are in good agreement both quantitatively and qualitatively. Finally, we test the performance of the proposed digital mechanoreceptors in hardware using a prepared experimental set up. Hardware synthesis and physical realization on FPGA indicate that the digital mechanoreceptors are able to replicate essential characteristics of different firing patterns including bursting and spiking responses of the SA-I and FA-I mechanoreceptors. In addition to parallel computation, a main advantage of this method is that the mechanoreceptor digital circuits can be implemented in real-time through low-power neuromorphic hardware. This novel engineering framework is generally suitable for use in robotic and hand-prosthetic applications, so progressing the state of the art for tactile sensing.
Collapse
Affiliation(s)
- Nima Salimi-Nezhad
- Medical Biology Research Center, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Mahmood Amiri
- Medical Biology Research Center, Kermanshah University of Medical Sciences, Kermanshah, Iran.,The BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, Italy
| | - Egidio Falotico
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, Italy
| | - Cecilia Laschi
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, Italy
| |
Collapse
|
17
|
Rasouli M, Chen Y, Basu A, Kukreja SL, Thakor NV. An Extreme Learning Machine-Based Neuromorphic Tactile Sensing System for Texture Recognition. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2018; 12:313-325. [PMID: 29570059 DOI: 10.1109/tbcas.2018.2805721] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
Despite significant advances in computational algorithms and development of tactile sensors, artificial tactile sensing is strikingly less efficient and capable than the human tactile perception. Inspired by efficiency of biological systems, we aim to develop a neuromorphic system for tactile pattern recognition. We particularly target texture recognition as it is one of the most necessary and challenging tasks for artificial sensory systems. Our system consists of a piezoresistive fabric material as the sensor to emulate skin, an interface that produces spike patterns to mimic neural signals from mechanoreceptors, and an extreme learning machine (ELM) chip to analyze spiking activity. Benefiting from intrinsic advantages of biologically inspired event-driven systems and massively parallel and energy-efficient processing capabilities of the ELM chip, the proposed architecture offers a fast and energy-efficient alternative for processing tactile information. Moreover, it provides the opportunity for the development of low-cost tactile modules for large-area applications by integration of sensors and processing circuits. We demonstrate the recognition capability of our system in a texture discrimination task, where it achieves a classification accuracy of 92% for categorization of ten graded textures. Our results confirm that there exists a tradeoff between response time and classification accuracy (and information transfer rate). A faster decision can be achieved at early time steps or by using a shorter time window. This, however, results in deterioration of the classification accuracy and information transfer rate. We further observe that there exists a tradeoff between the classification accuracy and the input spike rate (and thus energy consumption). Our work substantiates the importance of development of efficient sparse codes for encoding sensory data to improve the energy efficiency. These results have a significance for a wide range of wearable, robotic, prosthetic, and industrial applications.
Collapse
|