1
|
Gedela NSS, Radawiec RD, Salim S, Richie J, Chestek C, Draelos A, Pelled G. In vivo electrophysiology recordings and computational modeling can predict octopus arm movement. Bioelectron Med 2025; 11:4. [PMID: 39948616 PMCID: PMC11827351 DOI: 10.1186/s42234-025-00166-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2024] [Accepted: 01/27/2025] [Indexed: 02/16/2025] Open
Abstract
The octopus has many features that make it advantageous for revealing principles of motor circuits and control and predicting behavior. Here, an array of carbon electrodes providing single-unit electrophysiology recordings were implanted into the octopus anterior nerve cord. The number of spikes and arm movements in response to stimulation at different locations along the arm were recorded. We observed that the number of spikes occurring within the first 100 ms after stimulation were predictive of the resultant movement response. Machine learning models showed that temporal electrophysiological features could be used to predict whether an arm movement occurred with 88.64% confidence, and if it was a lateral arm movement or a grasping motion with 75.45% confidence. Both supervised and unsupervised methods were applied to gain streaming measurements of octopus arm movements and how their motor circuitry produces rich movement types in real time. For kinematic analysis, deep learning models and unsupervised dimensionality reduction identified a consistent set of features that could be used to distinguish different types of arm movements. The neural circuits and the computational models identified here generated predictions for how to evoke a particular, complex movement in an orchestrated sequence for an individual motor circuit. This study demonstrates how real-time motor behaviors can be predicted and distinguished, contributing to the development of brain-machine interfaces. The ability to accurately model and predict complex movement patterns has broad implications for advancing technologies in robotics, neuroprosthetics, and artificial intelligence, paving the way for more sophisticated and adaptable systems.
Collapse
Affiliation(s)
| | - Ryan D Radawiec
- Department of Mechanical Engineering, Michigan State University, East Lansing, MI, USA
| | - Sachin Salim
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Julianna Richie
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Cynthia Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Anne Draelos
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA.
- Department of Computational Medicine & Bioinformatics, University of Michigan, Ann Arbor, MI, USA.
| | - Galit Pelled
- Department of Mechanical Engineering, Michigan State University, East Lansing, MI, USA.
- Department of Radiology, Michigan State University, East Lansing, MI, USA.
| |
Collapse
|
2
|
Agudelo-Toro A, Michaels JA, Sheng WA, Scherberger H. Accurate neural control of a hand prosthesis by posture-related activity in the primate grasping circuit. Neuron 2024; 112:4115-4129.e8. [PMID: 39419024 DOI: 10.1016/j.neuron.2024.09.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 03/15/2024] [Accepted: 09/19/2024] [Indexed: 10/19/2024]
Abstract
Brain-computer interfaces (BCIs) have the potential to restore hand movement for people with paralysis, but current devices still lack the fine control required to interact with objects of daily living. Following our understanding of cortical activity during arm reaches, hand BCI studies have focused primarily on velocity control. However, mounting evidence suggests that posture, and not velocity, dominates in hand-related areas. To explore whether this signal can causally control a prosthesis, we developed a BCI training paradigm centered on the reproduction of posture transitions. Monkeys trained with this protocol were able to control a multidimensional hand prosthesis with high accuracy, including execution of the very intricate precision grip. Analysis revealed that the posture signal in the target grasping areas was the main contributor to control. We present, for the first time, neural posture control of a multidimensional hand prosthesis, opening the door for future interfaces to leverage this additional information channel.
Collapse
Affiliation(s)
- Andres Agudelo-Toro
- Neurobiology Laboratory, Deutsches Primatenzentrum GmbH, Göttingen 37077, Germany.
| | - Jonathan A Michaels
- Neurobiology Laboratory, Deutsches Primatenzentrum GmbH, Göttingen 37077, Germany; School of Kinesiology and Health Science, Faculty of Health, York University, Toronto, ON M3J 1P3, Canada
| | - Wei-An Sheng
- Neurobiology Laboratory, Deutsches Primatenzentrum GmbH, Göttingen 37077, Germany; Institute of Biomedical Sciences, Academia Sinica, Taipei 115, Taiwan
| | - Hansjörg Scherberger
- Neurobiology Laboratory, Deutsches Primatenzentrum GmbH, Göttingen 37077, Germany; Faculty of Biology and Psychology, University of Göttingen, Göttingen 37073, Germany.
| |
Collapse
|
3
|
Gedela NSS, Salim S, Radawiec RD, Richie J, Chestek C, Draelos A, Pelled G. Single unit electrophysiology recordings and computational modeling can predict octopus arm movement. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.09.13.612676. [PMID: 39345497 PMCID: PMC11430158 DOI: 10.1101/2024.09.13.612676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 10/01/2024]
Abstract
The octopus simplified nervous system holds the potential to reveal principles of motor circuits and improve brain-machine interface devices through computational modeling with machine learning and statistical analysis. Here, an array of carbon electrodes providing single-unit electrophysiology recordings were implanted into the octopus anterior nerve cord. The number of spikes and arm movements in response to stimulation at different locations along the arm were recorded. We observed that the number of spikes occurring within the first 100ms after stimulation were predictive of the resultant movement response. Computational models showed that temporal electrophysiological features could be used to predict whether an arm movement occurred with 88.64% confidence, and if it was a lateral arm movement or a grasping motion with 75.45% confidence. Both supervised and unsupervised methods were applied to gain streaming measurements of octopus arm movements and how their motor circuitry produces rich movement types in real time. Deep learning models and unsupervised dimension reduction identified a consistent set of features that could be used to distinguish different types of arm movements. These models generated predictions for how to evoke a particular, complex movement in an orchestrated sequence for an individual motor circuit.
Collapse
Affiliation(s)
- Nitish Satya Sai Gedela
- Department of Mechanical Engineering, Michigan State University, East Lansing, MI, United States
| | - Sachin Salim
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
| | - Ryan D Radawiec
- Department of Mechanical Engineering, Michigan State University, East Lansing, MI, United States
| | - Julianna Richie
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
| | - Cynthia Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
| | - Anne Draelos
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
- Department of Computational Medicine & Bioinformatics, University of Michigan, Ann Arbor, MI, United States
| | - Galit Pelled
- Department of Mechanical Engineering, Michigan State University, East Lansing, MI, United States
- Department of Radiology, Michigan State University, East Lansing, MI, United States
| |
Collapse
|
4
|
Alcolea P, Ma X, Bodkin K, Miller LE, Danziger ZC. Less is more: selection from a small set of options improves BCI velocity control. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.06.03.596241. [PMID: 38895473 PMCID: PMC11185569 DOI: 10.1101/2024.06.03.596241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
We designed the discrete direction selection (DDS) decoder for intracortical brain computer interface (iBCI) cursor control and showed that it outperformed currently used decoders in a human-operated real-time iBCI simulator and in monkey iBCI use. Unlike virtually all existing decoders that map between neural activity and continuous velocity commands, DDS uses neural activity to select among a small menu of preset cursor velocities. We compared closed-loop cursor control across four visits by each of 48 naïve, able-bodied human subjects using either DDS or one of three common continuous velocity decoders: direct regression with assist (an affine map from neural activity to cursor velocity), ReFIT, and the velocity Kalman Filter. DDS outperformed all three by a substantial margin. Subsequently, a monkey using an iBCI also had substantially better performance with DDS than with the Wiener filter decoder (direct regression decoder that includes time history). Discretizing the decoded velocity with DDS effectively traded high resolution velocity commands for less tortuous and lower noise trajectories, highlighting the potential benefits of simplifying online iBCI control.
Collapse
Affiliation(s)
- Pedro Alcolea
- Department of Biomedical Engineering, Florida International University, Miami, FL 33199, USA
| | - Xuan Ma
- Department of Neuroscience, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA
| | - Kevin Bodkin
- Department of Neuroscience, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA
| | - Lee E. Miller
- Department of Neuroscience, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA
- Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA
- Department of Biomedical Engineering, McCormick School of Engineering, Northwestern University, Evanston, IL 60208, USA
- Shirley Ryan AbilityLab, Chicago, IL 60611, USA
| | - Zachary C. Danziger
- Department of Biomedical Engineering, Florida International University, Miami, FL 33199, USA
- Department of Rehabilitation Medicine - Division of Physical Therapy, Emory University, Atlanta, GA 30322, USA
- W.H. Coulter Department of Biomedical Engineering, Emory University Atlanta, GA 30322, USA
| |
Collapse
|
5
|
Temmar H, Willsey MS, Costello JT, Mender MJ, Cubillos LH, Lam JL, Wallace DM, Kelberman MM, Patil PG, Chestek CA. Artificial neural network for brain-machine interface consistently produces more naturalistic finger movements than linear methods. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.01.583000. [PMID: 38496403 PMCID: PMC10942378 DOI: 10.1101/2024.03.01.583000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
Brain-machine interfaces (BMI) aim to restore function to persons living with spinal cord injuries by 'decoding' neural signals into behavior. Recently, nonlinear BMI decoders have outperformed previous state-of-the-art linear decoders, but few studies have investigated what specific improvements these nonlinear approaches provide. In this study, we compare how temporally convolved feedforward neural networks (tcFNNs) and linear approaches predict individuated finger movements in open and closed-loop settings. We show that nonlinear decoders generate more naturalistic movements, producing distributions of velocities 85.3% closer to true hand control than linear decoders. Addressing concerns that neural networks may come to inconsistent solutions, we find that regularization techniques improve the consistency of tcFNN convergence by 194.6%, along with improving average performance, and training speed. Finally, we show that tcFNN can leverage training data from multiple task variations to improve generalization. The results of this study show that nonlinear methods produce more naturalistic movements and show potential for generalizing over less constrained tasks. Teaser A neural network decoder produces consistent naturalistic movements and shows potential for real-world generalization through task variations.
Collapse
|
6
|
Wallace DM, Benyamini M, Nason-Tomaszewski SR, Costello JT, Cubillos LH, Mender MJ, Temmar H, Willsey MS, Patil PG, Chestek CA, Zacksenhouse M. Error detection and correction in intracortical brain-machine interfaces controlling two finger groups. J Neural Eng 2023; 20:046037. [PMID: 37567222 PMCID: PMC10594236 DOI: 10.1088/1741-2552/acef95] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/01/2023] [Accepted: 08/11/2023] [Indexed: 08/13/2023]
Abstract
Objective.While brain-machine interfaces (BMIs) are promising technologies that could provide direct pathways for controlling the external world and thus regaining motor capabilities, their effectiveness is hampered by decoding errors. Previous research has demonstrated the detection and correction of BMI outcome errors, which occur at the end of trials. Here we focus on continuous detection and correction of BMI execution errors, which occur during real-time movements.Approach.Two adult male rhesus macaques were implanted with Utah arrays in the motor cortex. The monkeys performed single or two-finger group BMI tasks where a Kalman filter decoded binned spiking-band power into intended finger kinematics. Neural activity was analyzed to determine how it depends not only on the kinematics of the fingers, but also on the distance of each finger-group to its target. We developed a method to detect erroneous movements, i.e. consistent movements away from the target, from the same neural activity used by the Kalman filter. Detected errors were corrected by a simple stopping strategy, and the effect on performance was evaluated.Mainresults.First we show that including distance to target explains significantly more variance of the recorded neural activity. Then, for the first time, we demonstrate that neural activity in motor cortex can be used to detect execution errors during BMI controlled movements. Keeping false positive rate below5%, it was possible to achieve mean true positive rate of28.1%online. Despite requiring 200 ms to detect and react to suspected errors, we were able to achieve a significant improvement in task performance via reduced orbiting time of one finger group.Significance.Neural activity recorded in motor cortex for BMI control can be used to detect and correct BMI errors and thus to improve performance. Further improvements may be obtained by enhancing classification and correction strategies.
Collapse
Affiliation(s)
- Dylan M Wallace
- Department of Robotics, University of Michigan, Ann Arbor, MI, United States of America
| | - Miri Benyamini
- BCI for Rehabilitation Lab., Faculty of Mechanical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| | - Samuel R Nason-Tomaszewski
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Joseph T Costello
- Department of Electrical and Computer Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Luis H Cubillos
- Department of Robotics, University of Michigan, Ann Arbor, MI, United States of America
| | - Matthew J Mender
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Hisham Temmar
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Matthew S Willsey
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Department of Neurosurgery, University of Michigan, Ann Arbor, MI, United States of America
| | - Parag G Patil
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Department of Neurosurgery, University of Michigan, Ann Arbor, MI, United States of America
| | - Cynthia A Chestek
- Department of Robotics, University of Michigan, Ann Arbor, MI, United States of America
- Cortical Neural Prosthetics Lab., Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Department of Electrical and Computer Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Miriam Zacksenhouse
- BCI for Rehabilitation Lab., Faculty of Mechanical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
| |
Collapse
|
7
|
Dong Y, Wang S, Huang Q, Berg RW, Li G, He J. Neural Decoding for Intracortical Brain-Computer Interfaces. CYBORG AND BIONIC SYSTEMS 2023; 4:0044. [PMID: 37519930 PMCID: PMC10380541 DOI: 10.34133/cbsystems.0044] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Accepted: 07/04/2023] [Indexed: 08/01/2023] Open
Abstract
Brain-computer interfaces have revolutionized the field of neuroscience by providing a solution for paralyzed patients to control external devices and improve the quality of daily life. To accurately and stably control effectors, it is important for decoders to recognize an individual's motor intention from neural activity either by noninvasive or intracortical neural recording. Intracortical recording is an invasive way of measuring neural electrical activity with high temporal and spatial resolution. Herein, we review recent developments in neural signal decoding methods for intracortical brain-computer interfaces. These methods have achieved good performance in analyzing neural activity and controlling robots and prostheses in nonhuman primates and humans. For more complex paradigms in motor rehabilitation or other clinical applications, there remains more space for further improvements of decoders.
Collapse
Affiliation(s)
- Yuanrui Dong
- School of Mechatronical Engineering and Beijing Advanced Innovation Center for Intelligent Robots,
Beijing Institute of Technology, Beijing 100081, China
| | - Shirong Wang
- School of Mechatronical Engineering and Beijing Advanced Innovation Center for Intelligent Robots,
Beijing Institute of Technology, Beijing 100081, China
| | - Qiang Huang
- School of Mechatronical Engineering and Beijing Advanced Innovation Center for Intelligent Robots,
Beijing Institute of Technology, Beijing 100081, China
| | - Rune W. Berg
- Department of Neuroscience,
University of Copenhagen, Copenhagen 2200, Denmark
| | - Guanghui Li
- Department of Neuroscience,
University of Copenhagen, Copenhagen 2200, Denmark
| | - Jiping He
- School of Mechatronical Engineering and Beijing Advanced Innovation Center for Intelligent Robots,
Beijing Institute of Technology, Beijing 100081, China
| |
Collapse
|
8
|
Costello JT, Temmar H, Cubillos LH, Mender MJ, Wallace DM, Willsey MS, Patil PG, Chestek CA. Balancing Memorization and Generalization in RNNs for High Performance Brain-Machine Interfaces. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.28.542435. [PMID: 37292755 PMCID: PMC10245969 DOI: 10.1101/2023.05.28.542435] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Brain-machine interfaces (BMIs) can restore motor function to people with paralysis but are currently limited by the accuracy of real-time decoding algorithms. Recurrent neural networks (RNNs) using modern training techniques have shown promise in accurately predicting movements from neural signals but have yet to be rigorously evaluated against other decoding algorithms in a closed-loop setting. Here we compared RNNs to other neural network architectures in real-time, continuous decoding of finger movements using intracortical signals from nonhuman primates. Across one and two finger online tasks, LSTMs (a type of RNN) outperformed convolutional and transformer-based neural networks, averaging 18% higher throughput than the convolution network. On simplified tasks with a reduced movement set, RNN decoders were allowed to memorize movement patterns and matched able-bodied control. Performance gradually dropped as the number of distinct movements increased but did not go below fully continuous decoder performance. Finally, in a two-finger task where one degree-of-freedom had poor input signals, we recovered functional control using RNNs trained to act both like a movement classifier and continuous decoder. Our results suggest that RNNs can enable functional real-time BMI control by learning and generating accurate movement patterns.
Collapse
|
9
|
Basu I, Yousefi A, Crocker B, Zelmann R, Paulk AC, Peled N, Ellard KK, Weisholtz DS, Cosgrove GR, Deckersbach T, Eden UT, Eskandar EN, Dougherty DD, Cash SS, Widge AS. Closed-loop enhancement and neural decoding of cognitive control in humans. Nat Biomed Eng 2023; 7:576-588. [PMID: 34725508 PMCID: PMC9056584 DOI: 10.1038/s41551-021-00804-y] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Accepted: 09/02/2021] [Indexed: 12/20/2022]
Abstract
Deficits in cognitive control-that is, in the ability to withhold a default pre-potent response in favour of a more adaptive choice-are common in depression, anxiety, addiction and other mental disorders. Here we report proof-of-concept evidence that, in participants undergoing intracranial epilepsy monitoring, closed-loop direct stimulation of the internal capsule or striatum, especially the dorsal sites, enhances the participants' cognitive control during a conflict task. We also show that closed-loop stimulation upon the detection of lapses in cognitive control produced larger behavioural changes than open-loop stimulation, and that task performance for single trials can be directly decoded from the activity of a small number of electrodes via neural features that are compatible with existing closed-loop brain implants. Closed-loop enhancement of cognitive control might remediate underlying cognitive deficits and aid the treatment of severe mental disorders.
Collapse
Affiliation(s)
- Ishita Basu
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Ali Yousefi
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
- Departments of Computer Science and Neuroscience, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Britni Crocker
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Rina Zelmann
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Angelique C Paulk
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Noam Peled
- Department of Radiology, MGH/HST Martinos Center for Biomedical Imaging and Harvard Medical School, Boston, MA, USA
| | - Kristen K Ellard
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | | | - G Rees Cosgrove
- Department of Neurological Surgery, Brigham & Womens Hospital, Boston, MA, USA
| | - Thilo Deckersbach
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Uri T Eden
- Department of Mathematics and Statistics, Boston University, Boston, MA, USA
| | - Emad N Eskandar
- Department of Neurological Surgery, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurological Surgery, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Darin D Dougherty
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Alik S Widge
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA.
- Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA.
| |
Collapse
|
10
|
Patel PR, Welle EJ, Letner JG, Shen H, Bullard AJ, Caldwell CM, Vega-Medina A, Richie JM, Thayer HE, Patil PG, Cai D, Chestek CA. Utah array characterization and histological analysis of a multi-year implant in non-human primate motor and sensory cortices. J Neural Eng 2023; 20:10.1088/1741-2552/acab86. [PMID: 36595323 PMCID: PMC9954796 DOI: 10.1088/1741-2552/acab86] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 12/14/2022] [Indexed: 12/15/2022]
Abstract
Objective.The Utah array is widely used in both clinical studies and neuroscience. It has a strong track record of safety. However, it is also known that implanted electrodes promote the formation of scar tissue in the immediate vicinity of the electrodes, which may negatively impact the ability to record neural waveforms. This scarring response has been primarily studied in rodents, which may have a very different response than primate brain.Approach.Here, we present a rare nonhuman primate histological dataset (n= 1 rhesus macaque) obtained 848 and 590 d after implantation in two brain hemispheres. For 2 of 4 arrays that remained within the cortex, NeuN was used to stain for neuron somata at three different depths along the shanks. Images were filtered and denoised, with neurons then counted in the vicinity of the arrays as well as a nearby section of control tissue. Additionally, 3 of 4 arrays were imaged with a scanning electrode microscope to evaluate any materials damage that might be present.Main results.Overall, we found a 63% percent reduction in the number of neurons surrounding the electrode shanks compared to control areas. In terms of materials, the arrays remained largely intact with metal and Parylene C present, though tip breakage and cracks were observed on many electrodes.Significance.Overall, these results suggest that the tissue response in the nonhuman primate brain shows similar neuron loss to previous studies using rodents. Electrode improvements, for example using smaller or softer probes, may therefore substantially improve the tissue response and potentially improve the neuronal recording yield in primate cortex.
Collapse
Affiliation(s)
- Paras R. Patel
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Elissa J. Welle
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Joseph G. Letner
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Hao Shen
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Autumn J. Bullard
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Ciara M. Caldwell
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Alexis Vega-Medina
- Department of Molecular, Cellular, and Developmental Biology, University of Michigan, Ann Arbor, MI 48019, United States of America
- Neuroscience Graduate Program, University of Michigan Medical School, Ann Arbor, MI 48109, United States of America
| | - Julianna M. Richie
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Hope E. Thayer
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
| | - Parag G. Patil
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI 48109, United States of America
- Department of Neurology, University of Michigan Medical School, Ann Arbor, MI 48109, United States of America
- Neuroscience Graduate Program, University of Michigan Medical School, Ann Arbor, MI 48109, United States of America
| | - Dawen Cai
- Neuroscience Graduate Program, University of Michigan Medical School, Ann Arbor, MI 48109, United States of America
- Department of Biophysics, University of Michigan, Ann Arbor, MI 48109, United States of America
- Department of Cell and Developmental Biology, University of Michigan Medical School, Ann Arbor, MI 48019, United States of America
| | - Cynthia A. Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, United States of America
- Neuroscience Graduate Program, University of Michigan Medical School, Ann Arbor, MI 48109, United States of America
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109, United States of America
- Robotics Program, University of Michigan, Ann Arbor, MI 48109, United States of America
| |
Collapse
|
11
|
Willsey MS, Nason-Tomaszewski SR, Ensel SR, Temmar H, Mender MJ, Costello JT, Patil PG, Chestek CA. Real-time brain-machine interface in non-human primates achieves high-velocity prosthetic finger movements using a shallow feedforward neural network decoder. Nat Commun 2022; 13:6899. [PMID: 36371498 PMCID: PMC9653378 DOI: 10.1038/s41467-022-34452-w] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Accepted: 10/25/2022] [Indexed: 11/13/2022] Open
Abstract
Despite the rapid progress and interest in brain-machine interfaces that restore motor function, the performance of prosthetic fingers and limbs has yet to mimic native function. The algorithm that converts brain signals to a control signal for the prosthetic device is one of the limitations in achieving rapid and realistic finger movements. To achieve more realistic finger movements, we developed a shallow feed-forward neural network to decode real-time two-degree-of-freedom finger movements in two adult male rhesus macaques. Using a two-step training method, a recalibrated feedback intention-trained (ReFIT) neural network is introduced to further improve performance. In 7 days of testing across two animals, neural network decoders, with higher-velocity and more natural appearing finger movements, achieved a 36% increase in throughput over the ReFIT Kalman filter, which represents the current standard. The neural network decoders introduced herein demonstrate real-time decoding of continuous movements at a level superior to the current state-of-the-art and could provide a starting point to using neural networks for the development of more naturalistic brain-controlled prostheses.
Collapse
Affiliation(s)
- Matthew S. Willsey
- grid.214458.e0000000086837370Department of Neurosurgery, University of Michigan, Ann Arbor, MI USA ,grid.214458.e0000000086837370Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI USA
| | - Samuel R. Nason-Tomaszewski
- grid.214458.e0000000086837370Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI USA
| | - Scott R. Ensel
- grid.214458.e0000000086837370Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI USA
| | - Hisham Temmar
- grid.214458.e0000000086837370Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI USA
| | - Matthew J. Mender
- grid.214458.e0000000086837370Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI USA
| | - Joseph T. Costello
- grid.214458.e0000000086837370Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI USA
| | - Parag G. Patil
- grid.214458.e0000000086837370Department of Neurosurgery, University of Michigan, Ann Arbor, MI USA ,grid.214458.e0000000086837370Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI USA ,grid.214458.e0000000086837370Neuroscience Graduate Program, University of Michigan Medical School, Ann Arbor, MI USA ,grid.214458.e0000000086837370Department of Anesthesiology, University of Michigan, Ann Arbor, MI USA
| | - Cynthia A. Chestek
- grid.214458.e0000000086837370Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI USA ,grid.214458.e0000000086837370Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI USA ,grid.214458.e0000000086837370Neuroscience Graduate Program, University of Michigan Medical School, Ann Arbor, MI USA ,grid.214458.e0000000086837370Robotics Graduate Program, University of Michigan, Ann Arbor, MI USA ,grid.214458.e0000000086837370Biointerfaces Institute, University of Michigan, Ann Arbor, MI USA
| |
Collapse
|
12
|
An H, Nason-Tomaszewski SR, Lim J, Kwon K, Willsey MS, Patil PG, Kim HS, Sylvester D, Chestek CA, Blaauw D. A Power-Efficient Brain-Machine Interface System With a Sub-mw Feature Extraction and Decoding ASIC Demonstrated in Nonhuman Primates. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2022; 16:395-408. [PMID: 35594208 PMCID: PMC9375520 DOI: 10.1109/tbcas.2022.3175926] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Intracortical brain-machine interfaces have shown promise for restoring function to people with paralysis, but their translation to portable and implantable devices is hindered by their high power consumption. Recent devices have drastically reduced power consumption compared to standard experimental brain-machine interfaces, but still require wired or wireless connections to computing hardware for feature extraction and inference. Here, we introduce a Neural Recording And Decoding (NeuRAD) application specific integrated circuit (ASIC) in 180 nm CMOS that can extract neural spiking features and predict two-dimensional behaviors in real-time. To reduce amplifier and feature extraction power consumption, the NeuRAD has a hardware accelerator for extracting spiking band power (SBP) from intracortical spiking signals and includes an M0 processor with a fixed-point Matrix Acceleration Unit (MAU) for efficient and flexible decoding. We validated device functionality by recording SBP from a nonhuman primate implanted with a Utah microelectrode array and predicting the one- and two-dimensional finger movements the monkey was attempting to execute in closed-loop using a steady-state Kalman filter (SSKF). Using the NeuRAD's real-time predictions, the monkey achieved 100% success rate and 0.82 s mean target acquisition time to control one-dimensional finger movements using just 581 μW. To predict two-dimensional finger movements, the NeuRAD consumed 588 μW to enable the monkey to achieve a 96% success rate and 2.4 s mean acquisition time. By employing SBP, ASIC brain-machine interfaces can close the gap to enable fully implantable therapies for people with paralysis.
Collapse
|
13
|
Costello JT, Nason SR, An H, Lee J, Mender MJ, Temmar H, Wallace DM, Lim J, Willsey MS, Patil PG, Jang T, Phillips JD, Kim HS, Blaauw D, Chestek CA. A low-power communication scheme for wireless, 1000 channel brain-machine interfaces. J Neural Eng 2022; 19. [PMID: 35613546 DOI: 10.1088/1741-2552/ac7352] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Accepted: 05/24/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Brain-machine interfaces (BMIs) have the potential to restore motor function but are currently limited by electrode count and long-term recording stability. These challenges may be solved through the use of free-floating "motes" which wirelessly transmit recorded neural signals, if power consumption can be kept within safe levels when scaling to thousands of motes. Here, we evaluated a pulse-interval modulation (PIM) communication scheme for infrared (IR)-based motes that aims to reduce the wireless data rate and system power consumption. APPROACH To test PIM's ability to efficiently communicate neural information, we simulated the communication scheme in a real-time closed-loop BMI with non-human primates. Additionally, we performed circuit simulations of an IR-based 1000-mote system to calculate communication accuracy and total power consumption. MAIN RESULTS We found that PIM at 1kb/s per channel maintained strong correlations with true firing rate and matched online BMI performance of a traditional wired system. Closed-loop BMI tests suggest that lags as small as 30 ms can have significant performance effects. Finally, unlike other IR communication schemes, PIM is feasible in terms of power, and neural data can accurately be recovered on a receiver using 3mW for 1000 channels. SIGNIFICANCE These results suggest that PIM-based communication could significantly reduce power usage of wireless motes to enable higher channel-counts for high-performance BMIs.
Collapse
Affiliation(s)
- Joseph T Costello
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd, B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Samuel R Nason
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Hyochan An
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Jungho Lee
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Matthew J Mender
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Hisham Temmar
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Dylan M Wallace
- Robotics Institute, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, 48109-1382, UNITED STATES
| | - Jongyup Lim
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Matthew S Willsey
- Department of Neurosurgery, University of Michigan Medical School, 1500 E Medical Center Drive, Ann Arbor, 48109-0624, UNITED STATES
| | - Parag G Patil
- Neurosurgery, University of Michigan, 1500 E Medical Center Drive, Ann Arbor, Michigan, 48109, UNITED STATES
| | - Taekwang Jang
- Department of Information Technology and Electrical Engineering, ETH Zurich, ETH Zurich, Rämistrasse 101, Zurich, 8092, SWITZERLAND
| | - Jamie Dean Phillips
- Department of Electrical and Computer Engineering, University of Delaware, Evans Hall, 139 The Green,, Newark, Delaware, 19716-5600, UNITED STATES
| | - Hun-Seok Kim
- Electrical and Computer Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - David Blaauw
- University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| | - Cynthia A Chestek
- Biomedical Engineering, University of Michigan, 2800 Plymouth Rd B10, Ann Arbor, Michigan, 48109-1382, UNITED STATES
| |
Collapse
|
14
|
Badi M, Wurth S, Scarpato I, Roussinova E, Losanno E, Bogaard A, Delacombaz M, Borgognon S, C Vanc Ara P, Fallegger F, Su DK, Schmidlin E, Courtine G, Bloch J, Lacour SP, Stieglitz T, Rouiller EM, Capogrosso M, Micera S. Intrafascicular peripheral nerve stimulation produces fine functional hand movements in primates. Sci Transl Med 2021; 13:eabg6463. [PMID: 34705521 DOI: 10.1126/scitranslmed.abg6463] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
[Figure: see text].
Collapse
Affiliation(s)
- Marion Badi
- Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics, and Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), 1015 Lausanne, Switzerland
| | - Sophie Wurth
- Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics, and Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), 1015 Lausanne, Switzerland
| | - Ilaria Scarpato
- Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics, and Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), 1015 Lausanne, Switzerland
| | - Evgenia Roussinova
- Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics, and Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), 1015 Lausanne, Switzerland
| | - Elena Losanno
- Biorobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, 56025 Pisa, Italy
| | - Andrew Bogaard
- Department of Neuroscience and Movement Sciences, Platform of Translational Neurosciences, Section of Medicine, Faculty of Sciences and Medicine, University of Fribourg, 1700 Fribourg, Switzerland
| | - Maude Delacombaz
- Department of Neuroscience and Movement Sciences, Platform of Translational Neurosciences, Section of Medicine, Faculty of Sciences and Medicine, University of Fribourg, 1700 Fribourg, Switzerland
| | - Simon Borgognon
- Department of Neuroscience and Movement Sciences, Platform of Translational Neurosciences, Section of Medicine, Faculty of Sciences and Medicine, University of Fribourg, 1700 Fribourg, Switzerland.,Center for Neuroprosthetics and Brain Mind Institute, School of Life Sciences, EPFL, 1015 Lausanne, Switzerland
| | - Paul C Vanc Ara
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering-IMTEK, Bernstein Center Freiburg, and BrainLinks-BrainTools Center, University of Freiburg, 79110 Freiburg, Germany
| | - Florian Fallegger
- Bertarelli Foundation Chair in Neuroprosthetic Technology, Laboratory for Soft Bioelectronics Interface, Institute of Microengineering, Institute of Bioengineering, Centre for Neuroprosthetics, 1202 Geneva, Switzerland
| | - David K Su
- Neurological Surgery, Harborview Medical Center, Seattle, WA 98104, USA
| | - Eric Schmidlin
- Department of Neuroscience and Movement Sciences, Platform of Translational Neurosciences, Section of Medicine, Faculty of Sciences and Medicine, University of Fribourg, 1700 Fribourg, Switzerland
| | - Grégoire Courtine
- Center for Neuroprosthetics and Brain Mind Institute, School of Life Sciences, EPFL, 1015 Lausanne, Switzerland.,Defitech Center for Interventional Neurotherapies (NeuroRestore), EPFL, University Hospital of Lausanne (CHUV), and University of Lausanne (UNIL), 1015 Lausanne, Switzerland
| | - Jocelyne Bloch
- Defitech Center for Interventional Neurotherapies (NeuroRestore), EPFL, University Hospital of Lausanne (CHUV), and University of Lausanne (UNIL), 1015 Lausanne, Switzerland
| | - Stéphanie P Lacour
- Bertarelli Foundation Chair in Neuroprosthetic Technology, Laboratory for Soft Bioelectronics Interface, Institute of Microengineering, Institute of Bioengineering, Centre for Neuroprosthetics, 1202 Geneva, Switzerland
| | - Thomas Stieglitz
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering-IMTEK, Bernstein Center Freiburg, and BrainLinks-BrainTools Center, University of Freiburg, 79110 Freiburg, Germany
| | - Eric M Rouiller
- Department of Neuroscience and Movement Sciences, Platform of Translational Neurosciences, Section of Medicine, Faculty of Sciences and Medicine, University of Fribourg, 1700 Fribourg, Switzerland
| | - Marco Capogrosso
- Department of Neuroscience and Movement Sciences, Platform of Translational Neurosciences, Section of Medicine, Faculty of Sciences and Medicine, University of Fribourg, 1700 Fribourg, Switzerland.,Department of Neurological Surgery, Rehabilitation and Neural Engineering Laboratories, University of Pittsburgh, Pittsburgh, PA 15213, USA
| | - Silvestro Micera
- Bertarelli Foundation Chair in Translational Neuroengineering, Center for Neuroprosthetics, and Institute of Bioengineering, École Polytechnique Fédérale de Lausanne (EPFL), 1015 Lausanne, Switzerland.,Biorobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, 56025 Pisa, Italy
| |
Collapse
|
15
|
Nason SR, Mender MJ, Vaskov AK, Willsey MS, Ganesh Kumar N, Kung TA, Patil PG, Chestek CA. Real-time linear prediction of simultaneous and independent movements of two finger groups using an intracortical brain-machine interface. Neuron 2021; 109:3164-3177.e8. [PMID: 34499856 DOI: 10.1016/j.neuron.2021.08.009] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Revised: 06/07/2021] [Accepted: 08/10/2021] [Indexed: 11/27/2022]
Abstract
Modern brain-machine interfaces can return function to people with paralysis, but current upper extremity brain-machine interfaces are unable to reproduce control of individuated finger movements. Here, for the first time, we present a real-time, high-speed, linear brain-machine interface in nonhuman primates that utilizes intracortical neural signals to bridge this gap. We created a non-prehensile task that systematically individuates two finger groups, the index finger and the middle-ring-small fingers combined. During online brain control, the ReFIT Kalman filter could predict individuated finger group movements with high performance. Next, training ridge regression decoders with individual movements was sufficient to predict untrained combined movements and vice versa. Finally, we compared the postural and movement tuning of finger-related cortical activity to find that individual cortical units simultaneously encode multiple behavioral dimensions. Our results suggest that linear decoders may be sufficient for brain-machine interfaces to execute high-dimensional tasks with the performance levels required for naturalistic neural prostheses.
Collapse
Affiliation(s)
- Samuel R Nason
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| | - Matthew J Mender
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| | - Alex K Vaskov
- Robotics Graduate Program, University of Michigan, Ann Arbor, MI 48109, USA
| | - Matthew S Willsey
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA; Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI 48109, USA
| | - Nishant Ganesh Kumar
- Section of Plastic Surgery, Department of Surgery, University of Michigan, Ann Arbor, MI 48109, USA
| | - Theodore A Kung
- Section of Plastic Surgery, Department of Surgery, University of Michigan, Ann Arbor, MI 48109, USA
| | - Parag G Patil
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA; Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI 48109, USA; Department of Neurology, University of Michigan Medical School, Ann Arbor, MI 48109, USA; Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI 48109, USA
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA; Robotics Graduate Program, University of Michigan, Ann Arbor, MI 48109, USA; Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI 48109, USA; Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109, USA.
| |
Collapse
|
16
|
Abstract
Brain-machine interfaces (BMI) are being developed to restore upper limb function for persons with spinal cord injury or other motor degenerative conditions. BMI and implantable sensors for myoelectric prostheses directly extract information from the central or peripheral nervous system to provide users with high fidelity control of their prosthetic device. Control algorithms have been highly transferable between the 2 technologies but also face common issues. In this review of the current state of the art in each field, the authors point out similarities and differences between the 2 technologies that may guide the implementation of common solutions to these challenges.
Collapse
Affiliation(s)
- Alex K Vaskov
- Robotics Institute, University of Michigan, 2505 Hayward St, Ann Arbor, MI 48109, USA
| | - Cynthia A Chestek
- Robotics Institute, University of Michigan, 2505 Hayward St, Ann Arbor, MI 48109, USA; Department of Biomedical Engineering, University of Michigan, 2200 Bonisteel Blvd, Ann Arbor, MI 48109, USA; Department of Electrical Engineering and Computer Science, University of Michigan, 1301 Beal Ave, Ann Arbor, MI 48109, USA; Neuroscience Graduate Program, University of Michigan, 204 Washtenaw Ave, Ann Arbor, MI 48109, USA.
| |
Collapse
|
17
|
Chiang CH, Wang C, Barth K, Rahimpour S, Trumpis M, Duraivel S, Rachinskiy I, Dubey A, Wingel KE, Wong M, Witham NS, Odell T, Woods V, Bent B, Doyle W, Friedman D, Bihler E, Reiche CF, Southwell DG, Haglund MM, Friedman AH, Lad SP, Devore S, Devinsky O, Solzbacher F, Pesaran B, Cogan G, Viventi J. Flexible, high-resolution thin-film electrodes for human and animal neural research. J Neural Eng 2021; 18:10.1088/1741-2552/ac02dc. [PMID: 34010815 PMCID: PMC8496685 DOI: 10.1088/1741-2552/ac02dc] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 05/19/2021] [Indexed: 11/11/2022]
Abstract
Objective.Brain functions such as perception, motor control, learning, and memory arise from the coordinated activity of neuronal assemblies distributed across multiple brain regions. While major progress has been made in understanding the function of individual neurons, circuit interactions remain poorly understood. A fundamental obstacle to deciphering circuit interactions is the limited availability of research tools to observe and manipulate the activity of large, distributed neuronal populations in humans. Here we describe the development, validation, and dissemination of flexible, high-resolution, thin-film (TF) electrodes for recording neural activity in animals and humans.Approach.We leveraged standard flexible printed-circuit manufacturing processes to build high-resolution TF electrode arrays. We used biocompatible materials to form the substrate (liquid crystal polymer; LCP), metals (Au, PtIr, and Pd), molding (medical-grade silicone), and 3D-printed housing (nylon). We designed a custom, miniaturized, digitizing headstage to reduce the number of cables required to connect to the acquisition system and reduce the distance between the electrodes and the amplifiers. A custom mechanical system enabled the electrodes and headstages to be pre-assembled prior to sterilization, minimizing the setup time required in the operating room. PtIr electrode coatings lowered impedance and enabled stimulation. High-volume, commercial manufacturing enables cost-effective production of LCP-TF electrodes in large quantities.Main Results. Our LCP-TF arrays achieve 25× higher electrode density, 20× higher channel count, and 11× reduced stiffness than conventional clinical electrodes. We validated our LCP-TF electrodes in multiple human intraoperative recording sessions and have disseminated this technology to >10 research groups. Using these arrays, we have observed high-frequency neural activity with sub-millimeter resolution.Significance.Our LCP-TF electrodes will advance human neuroscience research and improve clinical care by enabling broad access to transformative, high-resolution electrode arrays.
Collapse
Affiliation(s)
- Chia-Han Chiang
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- These authors contributed equally to this work
| | - Charles Wang
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- These authors contributed equally to this work
| | - Katrina Barth
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Shervin Rahimpour
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Michael Trumpis
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | | | - Iakov Rachinskiy
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Agrita Dubey
- Center for Neural Science, New York University, NY, NY, United States of America
| | - Katie E Wingel
- Center for Neural Science, New York University, NY, NY, United States of America
| | - Megan Wong
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Nicholas S Witham
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Thomas Odell
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Virginia Woods
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Brinnae Bent
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Werner Doyle
- Department of Neurosurgery, NYU Langone Medical Center, New York City, NY, United States of America
| | - Daniel Friedman
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | | | - Christopher F Reiche
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Derek G Southwell
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Michael M Haglund
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Allan H Friedman
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Shivanand P Lad
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Sasha Devore
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | - Orrin Devinsky
- Department of Neurosurgery, NYU Langone Medical Center, New York City, NY, United States of America
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
- Comprehensive Epilepsy Center, NYU Langone Health, NY, NY, United States of America
| | - Florian Solzbacher
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Materials Science & Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Bijan Pesaran
- Center for Neural Science, New York University, NY, NY, United States of America
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | - Gregory Cogan
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
- Department of Psychology and Neuroscience, Duke University, Durham, NC, United States of America
- Center for Cognitive Neuroscience, Duke University, Durham, NC, United States of America
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, United States of America
| | - Jonathan Viventi
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
- Department of Neurobiology, Duke School of Medicine, Durham, NC, United States of America
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, United States of America
| |
Collapse
|
18
|
Modelling and prediction of the dynamic responses of large-scale brain networks during direct electrical stimulation. Nat Biomed Eng 2021; 5:324-345. [PMID: 33526909 DOI: 10.1038/s41551-020-00666-w] [Citation(s) in RCA: 62] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2019] [Accepted: 11/24/2020] [Indexed: 01/19/2023]
Abstract
Direct electrical stimulation can modulate the activity of brain networks for the treatment of several neurological and neuropsychiatric disorders and for restoring lost function. However, precise neuromodulation in an individual requires the accurate modelling and prediction of the effects of stimulation on the activity of their large-scale brain networks. Here, we report the development of dynamic input-output models that predict multiregional dynamics of brain networks in response to temporally varying patterns of ongoing microstimulation. In experiments with two awake rhesus macaques, we show that the activities of brain networks are modulated by changes in both stimulation amplitude and frequency, that they exhibit damping and oscillatory response dynamics, and that variabilities in prediction accuracy and in estimated response strength across brain regions can be explained by an at-rest functional connectivity measure computed without stimulation. Input-output models of brain dynamics may enable precise neuromodulation for the treatment of disease and facilitate the investigation of the functional organization of large-scale brain networks.
Collapse
|
19
|
Jorge A, Royston DA, Tyler-Kabara EC, Boninger ML, Collinger JL. Classification of Individual Finger Movements Using Intracortical Recordings in Human Motor Cortex. Neurosurgery 2021; 87:630-638. [PMID: 32140722 DOI: 10.1093/neuros/nyaa026] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2019] [Accepted: 12/15/2019] [Indexed: 12/25/2022] Open
Abstract
BACKGROUND Intracortical microelectrode arrays have enabled people with tetraplegia to use a brain-computer interface for reaching and grasping. In order to restore dexterous movements, it will be necessary to control individual fingers. OBJECTIVE To predict which finger a participant with hand paralysis was attempting to move using intracortical data recorded from the motor cortex. METHODS A 31-yr-old man with a C5/6 ASIA B spinal cord injury was implanted with 2 88-channel microelectrode arrays in left motor cortex. Across 3 d, the participant observed a virtual hand flex in each finger while neural firing rates were recorded. A 6-class linear discriminant analysis (LDA) classifier, with 10 × 10-fold cross-validation, was used to predict which finger movement was being performed (flexion/extension of all 5 digits and adduction/abduction of the thumb). RESULTS The mean overall classification accuracy was 67% (range: 65%-76%, chance: 17%), which occurred at an average of 560 ms (range: 420-780 ms) after movement onset. Individually, thumb flexion and thumb adduction were classified with the highest accuracies at 92% and 93%, respectively. The index, middle, ring, and little achieved an accuracy of 65%, 59%, 43%, and 56%, respectively, and, when incorrectly classified, were typically marked as an adjacent finger. The classification accuracies were reflected in a low-dimensional projection of the neural data into LDA space, where the thumb-related movements were most separable from the finger movements. CONCLUSION Classification of intention to move individual fingers was accurately predicted by intracortical recordings from a human participant with the thumb being particularly independent.
Collapse
Affiliation(s)
- Ahmed Jorge
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Dylan A Royston
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, Pennsylvania.,Center for the Neural Basis of Cognition, Pittsburgh, Pennsylvania
| | - Elizabeth C Tyler-Kabara
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, Pennsylvania.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, Pennsylvania.,Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, Pennsylvania.,McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Michael L Boninger
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, Pennsylvania.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, Pennsylvania.,McGowan Institute for Regenerative Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania.,Department of Veterans Affairs, Pittsburgh, Pennsylvania
| | - Jennifer L Collinger
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh, Pittsburgh, Pennsylvania.,Department of Bioengineering, University of Pittsburgh, Pittsburgh, Pennsylvania.,Center for the Neural Basis of Cognition, Pittsburgh, Pennsylvania.,Department of Veterans Affairs, Pittsburgh, Pennsylvania
| |
Collapse
|
20
|
Kim MK, Sohn JW, Kim SP. Decoding Kinematic Information From Primary Motor Cortex Ensemble Activities Using a Deep Canonical Correlation Analysis. Front Neurosci 2020; 14:509364. [PMID: 33177971 PMCID: PMC7596741 DOI: 10.3389/fnins.2020.509364] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2019] [Accepted: 09/22/2020] [Indexed: 12/17/2022] Open
Abstract
The control of arm movements through intracortical brain–machine interfaces (BMIs) mainly relies on the activities of the primary motor cortex (M1) neurons and mathematical models that decode their activities. Recent research on decoding process attempts to not only improve the performance but also simultaneously understand neural and behavioral relationships. In this study, we propose an efficient decoding algorithm using a deep canonical correlation analysis (DCCA), which maximizes correlations between canonical variables with the non-linear approximation of mappings from neuronal to canonical variables via deep learning. We investigate the effectiveness of using DCCA for finding a relationship between M1 activities and kinematic information when non-human primates performed a reaching task with one arm. Then, we examine whether using neural activity representations from DCCA improves the decoding performance through linear and non-linear decoders: a linear Kalman filter (LKF) and a long short-term memory in recurrent neural networks (LSTM-RNN). We found that neural representations of M1 activities estimated by DCCA resulted in more accurate decoding of velocity than those estimated by linear canonical correlation analysis, principal component analysis, factor analysis, and linear dynamical system. Decoding with DCCA yielded better performance than decoding the original FRs using LSTM-RNN (6.6 and 16.0% improvement on average for each velocity and position, respectively; Wilcoxon rank sum test, p < 0.05). Thus, DCCA can identify the kinematics-related canonical variables of M1 activities, thus improving the decoding performance. Our results may help advance the design of decoding models for intracortical BMIs.
Collapse
Affiliation(s)
- Min-Ki Kim
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea
| | - Jeong-Woo Sohn
- Department of Medical Science, College of Medicine, Catholic Kwandong University, Gangneung, South Korea
| | - Sung-Phil Kim
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea
| |
Collapse
|
21
|
Nason SR, Vaskov AK, Willsey MS, Welle EJ, An H, Vu PP, Bullard AJ, Nu CS, Kao JC, Shenoy KV, Jang T, Kim HS, Blaauw D, Patil PG, Chestek CA. A low-power band of neuronal spiking activity dominated by local single units improves the performance of brain-machine interfaces. Nat Biomed Eng 2020; 4:973-983. [PMID: 32719512 DOI: 10.1038/s41551-020-0591-0] [Citation(s) in RCA: 58] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2018] [Accepted: 06/24/2020] [Indexed: 12/18/2022]
Abstract
The large power requirement of current brain-machine interfaces is a major hindrance to their clinical translation. In basic behavioural tasks, the downsampled magnitude of the 300-1,000 Hz band of spiking activity can predict movement similarly to the threshold crossing rate (TCR) at 30 kilo-samples per second. However, the relationship between such a spiking-band power (SBP) and neural activity remains unclear, as does the capability of using the SBP to decode complicated behaviour. By using simulations of recordings of neural activity, here we show that the SBP is dominated by local single-unit spikes with spatial specificity comparable to or better than that of the TCR, and that the SBP correlates better with the firing rates of lower signal-to-noise-ratio units than the TCR. With non-human primates, in an online task involving the one-dimensional decoding of the movement of finger groups and in an offline two-dimensional cursor-control task, the SBP performed equally well or better than the TCR. The SBP may enhance the decoding performance of neural interfaces while enabling substantial cuts in power consumption.
Collapse
Affiliation(s)
- Samuel R Nason
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Alex K Vaskov
- Robotics Graduate Program, University of Michigan, Ann Arbor, MI, USA
| | - Matthew S Willsey
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA.,Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Elissa J Welle
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Hyochan An
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA
| | - Philip P Vu
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Autumn J Bullard
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Chrono S Nu
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| | - Jonathan C Kao
- Department of Electrical and Computer Engineering, University of California, Los Angeles, Los Angeles, CA, USA.,Neurosciences Program, University of California, Los Angeles, Los Angeles, CA, USA
| | - Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA.,Department of Bioengineering, Stanford University, Stanford, CA, USA.,Department of Neurobiology, Stanford University, Stanford, CA, USA.,The Bio-X Program, Stanford University, Stanford, CA, USA.,Wu Tsai Neuroscience Institute, Stanford University, Stanford, CA, USA.,Howard Hughes Medical Institute, Stanford University, Stanford, CA, USA
| | - Taekwang Jang
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA.,Department of Information Technology and Electrical Engineering, ETH Zürich, Zürich, Switzerland
| | - Hun-Seok Kim
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA
| | - David Blaauw
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA
| | - Parag G Patil
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA.,Department of Neurosurgery, University of Michigan Medical School, Ann Arbor, MI, USA.,Department of Neurology, University of Michigan Medical School, Ann Arbor, MI, USA.,Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI, USA
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA. .,Robotics Graduate Program, University of Michigan, Ann Arbor, MI, USA. .,Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA. .,Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI, USA.
| |
Collapse
|
22
|
Premchand B, Toe KK, Wang C, Shaikh S, Libedinsky C, Ang KK, So RQ. Decoding movement direction from cortical microelectrode recordings using an LSTM-based neural network. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:3007-3010. [PMID: 33018638 DOI: 10.1109/embc44109.2020.9175593] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Brain-machine interfaces (BMIs) allow individuals to communicate with computers using neural signals, and Kalman Filter (KF) are prevailingly used to decode movement directions from these neural signals. In this paper, we implemented a multi-layer long short-term memory (LSTM)based artificial neural network (ANN) for decoding BMI neural signals. We collected motor cortical neural signals from a nonhuman primate (NHP), implanted with microelectrode array (MEA) while performing a directional joystick task. Next, we compared the LSTM model in decoding the joystick trajectories from the neural signals against the prevailing KF model. The results showed that the LSTM model yielded significantly improved decoding accuracy measured by mean correlation coefficient (0.84, p < 10-7) than the KF model (0.72). In addition, using a principal component analysis (PCA)-based dimensionality reduction technique yielded slightly deteriorated accuracies for both the LSTM (0.80) and KF (0.70) models, but greatly reduced the computational complexity. The results showed that the LSTM decoding model holds promise to improve decoding in BMIs for paralyzed humans.
Collapse
|
23
|
Vu PP, Chestek CA, Nason SR, Kung TA, Kemp SW, Cederna PS. The future of upper extremity rehabilitation robotics: research and practice. Muscle Nerve 2020; 61:708-718. [PMID: 32413247 PMCID: PMC7868083 DOI: 10.1002/mus.26860] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Revised: 03/03/2020] [Accepted: 03/03/2020] [Indexed: 01/14/2023]
Abstract
The loss of upper limb motor function can have a devastating effect on people's lives. To restore upper limb control and functionality, researchers and clinicians have developed interfaces to interact directly with the human body's motor system. In this invited review, we aim to provide details on the peripheral nerve interfaces and brain-machine interfaces that have been developed in the past 30 years for upper extremity control, and we highlight the challenges that still remain to transition the technology into the clinical market. The findings show that peripheral nerve interfaces and brain-machine interfaces have many similar characteristics that enable them to be concurrently developed. Decoding neural information from both interfaces may lead to novel physiological models that may one day fully restore upper limb motor function for a growing patient population.
Collapse
Affiliation(s)
- Philip P. Vu
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan
- Section of Plastic Surgery, University of Michigan, Ann Arbor, Michigan
| | - Cynthia A. Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan
- Robotics Institute, University of Michigan, Ann Arbor, Michigan
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, Michigan
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, Michigan
| | - Samuel R. Nason
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan
| | - Theodore A. Kung
- Section of Plastic Surgery, University of Michigan, Ann Arbor, Michigan
| | - Stephen W.P. Kemp
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan
- Section of Plastic Surgery, University of Michigan, Ann Arbor, Michigan
| | - Paul S. Cederna
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan
- Section of Plastic Surgery, University of Michigan, Ann Arbor, Michigan
| |
Collapse
|
24
|
Welle EJ, Patel PR, Woods JE, Petrossians A, della Valle E, Vega-Medina A, Richie JM, Cai D, Weiland JD, Chestek CA. Ultra-small carbon fiber electrode recording site optimization and improved in vivo chronic recording yield. J Neural Eng 2020; 17:026037. [PMID: 32209743 PMCID: PMC10771280 DOI: 10.1088/1741-2552/ab8343] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
OBJECTIVE Carbon fiber electrodes may enable better long-term brain implants, minimizing the tissue response commonly seen with silicon-based electrodes. The small diameter fiber may enable high-channel count brain-machine interfaces capable of reproducing dexterous movements. Past carbon fiber electrodes exhibited both high fidelity single unit recordings and a healthy neuronal population immediately adjacent to the recording site. However, the recording yield of our carbon fiber arrays chronically implanted in the brain typically hovered around 30%, for previously unknown reasons. In this paper we investigated fabrication process modifications aimed at increasing recording yield and longevity. APPROACH We tested a new cutting method using a 532nm laser against traditional scissor methods for the creation of the electrode recording site. We verified the efficacy of improved recording sites with impedance measurements and in vivo array recording yield. Additionally, we tested potentially longer-lasting coating alternatives to PEDOT:pTS, including PtIr and oxygen plasma etching. New coatings were evaluated with accelerated soak testing and acute recording. MAIN RESULTS We found that the laser created a consistent, sustainable 257 ± 13.8 µm2 electrode with low 1 kHz impedance (19 ± 4 kΩ with PEDOT:pTS) and low fiber-to-fiber variability. The PEDOT:pTS coated laser cut fibers were found to have high recording yield in acute (97% > 100 µV pp , N = 34 fibers) and chronic (84% > 100 µV pp , day 7; 71% > 100 µV pp , day 63, N = 45 fibers) settings. The laser cut recording sites were good platforms for the PtIr coating and oxygen plasma etching, slowing the increase in 1 kHz impedance compared to PEDOT:pTS in an accelerated soak test. SIGNIFICANCE We have found that laser cut carbon fibers have a high recording yield that can be maintained for over two months in vivo and that alternative coatings perform better than PEDOT:pTS in accelerated aging tests. This work provides evidence to support carbon fiber arrays as a viable approach to high-density, clinically-feasible brain-machine interfaces.
Collapse
Affiliation(s)
- Elissa J Welle
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Paras R Patel
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Joshua E Woods
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, United States of America
| | | | - Elena della Valle
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Alexis Vega-Medina
- Department of Cell and Developmental Biology, University of Michigan, Ann Arbor, MI, United States of America
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI, United States of America
| | - Julianna M Richie
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
| | - Dawen Cai
- Department of Cell and Developmental Biology, University of Michigan, Ann Arbor, MI, United States of America
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI, United States of America
- Biophysics, University of Michigan, Ann Arbor, MI, United States of America
| | - James D Weiland
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Platinum Group Coatings, Pasadena, CA, United States of America
- Robotics Graduate Program, University of Michigan, Ann Arbor, MI, United States of America
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States of America
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, United States of America
- Neuroscience Graduate Program, University of Michigan, Ann Arbor, MI, United States of America
- Robotics Graduate Program, University of Michigan, Ann Arbor, MI, United States of America
| |
Collapse
|
25
|
Barra B, Badi M, Perich MG, Conti S, Mirrazavi Salehian SS, Moreillon F, Bogaard A, Wurth S, Kaeser M, Passeraub P, Milekovic T, Billard A, Micera S, Capogrosso M. A versatile robotic platform for the design of natural, three-dimensional reaching and grasping tasks in monkeys. J Neural Eng 2019; 17:016004. [PMID: 31597123 DOI: 10.1088/1741-2552/ab4c77] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
OBJECTIVE Translational studies on motor control and neurological disorders require detailed monitoring of sensorimotor components of natural limb movements in relevant animal models. However, available experimental tools do not provide a sufficiently rich repertoire of behavioral signals. Here, we developed a robotic platform that enables the monitoring of kinematics, interaction forces, and neurophysiological signals during user-defined upper limb tasks for monkeys. APPROACH We configured the platform to position instrumented objects in a three-dimensional workspace and provide an interactive dynamic force-field. MAIN RESULTS We show the relevance of our platform for fundamental and translational studies with three example applications. First, we study the kinematics of natural grasp in response to variable interaction forces. We then show simultaneous and independent encoding of kinematic and forces in single unit intra-cortical recordings from sensorimotor cortical areas. Lastly, we demonstrate the relevance of our platform to develop clinically relevant brain computer interfaces in a kinematically unconstrained motor task. SIGNIFICANCE Our versatile control structure does not depend on the specific robotic arm used and allows for the design and implementation of a variety of tasks that can support both fundamental and translational studies of motor control.
Collapse
Affiliation(s)
- B Barra
- Department of Neuroscience and Movement Science, Platform of Translational Neurosciences, University of Fribourg, Fribourg, Switzerland. Co-first authors
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
26
|
Volkova K, Lebedev MA, Kaplan A, Ossadtchi A. Decoding Movement From Electrocorticographic Activity: A Review. Front Neuroinform 2019; 13:74. [PMID: 31849632 PMCID: PMC6901702 DOI: 10.3389/fninf.2019.00074] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Accepted: 11/14/2019] [Indexed: 01/08/2023] Open
Abstract
Electrocorticography (ECoG) holds promise to provide efficient neuroprosthetic solutions for people suffering from neurological disabilities. This recording technique combines adequate temporal and spatial resolution with the lower risks of medical complications compared to the other invasive methods. ECoG is routinely used in clinical practice for preoperative cortical mapping in epileptic patients. During the last two decades, research utilizing ECoG has considerably grown, including the paradigms where behaviorally relevant information is extracted from ECoG activity with decoding algorithms of different complexity. Several research groups have advanced toward the development of assistive devices driven by brain-computer interfaces (BCIs) that decode motor commands from multichannel ECoG recordings. Here we review the evolution of this field and its recent tendencies, and discuss the potential areas for future development.
Collapse
Affiliation(s)
- Ksenia Volkova
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
| | - Mikhail A. Lebedev
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
| | - Alexander Kaplan
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
- Center for Biotechnology Development, National Research Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia
- Laboratory for Neurophysiology and Neuro-Computer Interfaces, Faculty of Biology, Lomonosov Moscow State University, Moscow, Russia
| | - Alexei Ossadtchi
- Center for Bioelectric Interfaces, Higher School of Economics, National Research University, Moscow, Russia
| |
Collapse
|
27
|
Deng W, Guan G, Xiao C, Qu G, Xue J, Qin C, Han H, Wang Y. Construction of a comprehensive observer-based scale assessing aging-related health and functioning in captive rhesus macaques. Aging (Albany NY) 2019; 11:6892-6903. [PMID: 31498777 PMCID: PMC6756902 DOI: 10.18632/aging.102219] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2019] [Accepted: 08/13/2019] [Indexed: 12/27/2022]
Abstract
Aging-related health and functioning are difficult to quantify in humans and nonhuman primates. We constructed an observer-based scale for daily application in assessing the aging-related health and functioning of rhesus macaques. Ten items referring to an aging appearance, musculoskeletal aging and aging-related eating behavior were selected through a panel consensus. The Aging-related Health and Functioning Scale (AHFS) was constructed based on these scored items form 57 healthy rhesus macaques. High reliability of the AHFS was shown based on Cronbach’s alpha coefficient (0.877). The structure of the AHFS was validated by three exploratory factors. The largest factor, whose four components were dietary uptake, iliac muscle mass, hair condition and fragility, and sex, explained 50.5% of the variation in aging-related health and functioning scores. The second factor, involving age, tooth loss and tooth wear, explained 15.5% of the variation. The lowest-ranking factor comprised only facial redness and accounted for 10% of the variation. A hierarchical cluster analysis validated the good applicability of the scale in distinct samples. From these scale-scored results, complicated aging phenomena observed in humans, including the sex-survival paradox and the calorie-related health-survival paradox, were both demonstrated in rhesus macaques. Therefore, the AHFS provides a valuable approach for aging-related research.
Collapse
Affiliation(s)
- Wei Deng
- Key Laboratory of Human Disease Comparative Medicine, Chinese Ministry of Health, Beijing Key Laboratory for Animal Models of Emerging and Remerging Infectious Diseases, Institute of Laboratory Animal Science, Chinese Academy of Medical Sciences and Comparative Medicine Center, Peking Union Medical College, Beijing, China
| | - Guoying Guan
- Department of Geriatrics, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Chong Xiao
- Key Laboratory of Human Disease Comparative Medicine, Chinese Ministry of Health, Beijing Key Laboratory for Animal Models of Emerging and Remerging Infectious Diseases, Institute of Laboratory Animal Science, Chinese Academy of Medical Sciences and Comparative Medicine Center, Peking Union Medical College, Beijing, China
| | - Guangjin Qu
- Department of Geriatrics, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Jing Xue
- Key Laboratory of Human Disease Comparative Medicine, Chinese Ministry of Health, Beijing Key Laboratory for Animal Models of Emerging and Remerging Infectious Diseases, Institute of Laboratory Animal Science, Chinese Academy of Medical Sciences and Comparative Medicine Center, Peking Union Medical College, Beijing, China
| | - Chuan Qin
- Key Laboratory of Human Disease Comparative Medicine, Chinese Ministry of Health, Beijing Key Laboratory for Animal Models of Emerging and Remerging Infectious Diseases, Institute of Laboratory Animal Science, Chinese Academy of Medical Sciences and Comparative Medicine Center, Peking Union Medical College, Beijing, China
| | - Hui Han
- Department of Geriatrics, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Yuhong Wang
- Department of Geriatrics, The First Affiliated Hospital of Harbin Medical University, Harbin, China
| |
Collapse
|