1
|
Schabron B, Alashqar Z, Fuhrman N, Jibbe K, Desai J. Artificial Neural Network to Detect Human Hand Gestures for a Robotic Arm Control. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:1662-1665. [PMID: 31946215 DOI: 10.1109/embc.2019.8857264] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Assistive technology is critical to improving daily life of those with muscular issues such as Cerebral Palsy and Duchenne Muscular Dystrophy by augmenting their activities of daily living (ADL). Robotic manipulators are one solution for helping with ADL; however, intuitive, accurate interfaces for higher degrees of freedom (DOF) robotic arms are still lacking. An intuitive control system based on artificial neural network (ANN) classification of real-time surface electromyography (sEMG) signals from the user's forearm to detect nine hand gestures and control the movement of the 6 DOF robotic arm is proposed in this paper. The regular machine learning classifiers with the highest classification accuracies were ensemble-bagged trees at 90.3% and cubic SVM at 89.6%, with linear SVM being 84.8%. However, the classifier chosen was a scaled conjugate gradient backpropagation neural network model, with a classification accuracy of 85%, due to accuracy and usability in a Simulink model. The trained ANN model was incorporated into the control system for the robotic arm and tested in virtual environment. Preliminary testing of the robotic arm shows that the forward kinematic control system works well for most hand poses. Future improvements will include more processing of the sEMG signals and training on sEMG data from multiple subjects for a generalized ANN model.
Collapse
|
2
|
Sato Y, Kawase T, Takano K, Spence C, Kansaku K. Body ownership and agency altered by an electromyographically controlled robotic arm. ROYAL SOCIETY OPEN SCIENCE 2018; 5:172170. [PMID: 29892405 PMCID: PMC5990842 DOI: 10.1098/rsos.172170] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Accepted: 04/04/2018] [Indexed: 06/08/2023]
Abstract
Understanding how we consciously experience our bodies is a fundamental issue in cognitive neuroscience. Two fundamental components of this are the sense of body ownership (the experience of the body as one's own) and the sense of agency (the feeling of control over one's bodily actions). These constructs have been used to investigate the incorporation of prostheses. To date, however, no evidence has been provided showing whether representations of ownership and agency in amputees are altered when operating a robotic prosthesis. Here we investigated a robotic arm using myoelectric control, for which the user varied the joint position continuously, in a rubber hand illusion task. Fifteen able-bodied participants and three trans-radial amputees were instructed to contract their wrist flexors/extensors alternately, and to watch the robotic arm move. The sense of ownership in both groups was extended to the robotic arm when the wrists of the real and robotic arm were flexed/extended synchronously, with the effect being smaller when they moved in opposite directions. Both groups also experienced a sense of agency over the robotic arm. These results suggest that these experimental settings induced successful incorporation of the prosthesis, at least for the amputees who took part in the present study.
Collapse
Affiliation(s)
- Yuki Sato
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, 4-1 Namiki, Tokorozawa, Saitama 359-8555, Japan
- Research Organization of Science and Technology, Ritsumeikan University, 1-1-1 Noji-higashi, Kusatsu, Shiga 525-8577, Japan
| | - Toshihiro Kawase
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, 4-1 Namiki, Tokorozawa, Saitama 359-8555, Japan
- Institute of Innovative Research, Tokyo Institute of Technology, 4259 Nagatsuta, Midori, Yokohama, Kanagawa 226-8503, Japan
- Institute of Biomaterials and Bioengineering, Tokyo Medical and Dental University, 2-3-10 Kanda-Surugadai, Chiyoda, Tokyo 101-0062, Japan
| | - Kouji Takano
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, 4-1 Namiki, Tokorozawa, Saitama 359-8555, Japan
| | - Charles Spence
- Crossmodal Research Laboratory, Department of Experimental Psychology, Oxford University, Oxford OX1 3UD, UK
| | - Kenji Kansaku
- Systems Neuroscience Section, Department of Rehabilitation for Brain Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, 4-1 Namiki, Tokorozawa, Saitama 359-8555, Japan
- Brain Science Inspired Life Support Research Center, The University of Electro-Communications, 1-5-1 Chofugaoka, Chofu, Tokyo 182-8585, Japan
- Department of Physiology and Biological Information, Dokkyo Medical University School of Medicine, 880 Kitakobayashi, Mibu, Tochigi 321-0293, Japan
| |
Collapse
|