1
|
Soldado-Magraner J, Antonietti A, French J, Higgins N, Young MJ, Larrivee D, Monteleone R. Applying the IEEE BRAIN neuroethics framework to intra-cortical brain-computer interfaces. J Neural Eng 2024; 21:022001. [PMID: 38537269 DOI: 10.1088/1741-2552/ad3852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 03/27/2024] [Indexed: 04/05/2024]
Abstract
Objective. Brain-computer interfaces (BCIs) are neuroprosthetic devices that allow for direct interaction between brains and machines. These types of neurotechnologies have recently experienced a strong drive in research and development, given, in part, that they promise to restore motor and communication abilities in individuals experiencing severe paralysis. While a rich literature analyzes the ethical, legal, and sociocultural implications (ELSCI) of these novel neurotechnologies, engineers, clinicians and BCI practitioners often do not have enough exposure to these topics.Approach. Here, we present the IEEE Neuroethics Framework, an international, multiyear, iterative initiative aimed at developing a robust, accessible set of considerations for diverse stakeholders.Main results. Using the framework, we provide practical examples of ELSCI considerations for BCI neurotechnologies. We focus on invasive technologies, and in particular, devices that are implanted intra-cortically for medical research applications.Significance. We demonstrate the utility of our framework in exposing a wide range of implications across different intra-cortical BCI technology modalities and conclude with recommendations on how to utilize this knowledge in the development and application of ethical guidelines for BCI neurotechnologies.
Collapse
Affiliation(s)
- Joana Soldado-Magraner
- Department of Electrical and Computer Engineering and the Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, United States of America
| | - Alberto Antonietti
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano 20131, Italy
| | - Jennifer French
- Neurotech Network, St. Petersburg, FL 33733, United States of America
| | - Nathan Higgins
- School of Psychological Sciences, Monash University, Clayton, VIC 3800, Australia
| | - Michael J Young
- Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, MA 02114, United States of America
| | - Denis Larrivee
- Mind and Brain Institute, University of Navarra Medical School, Pamplona, Navarra 31008, Spain
- Loyola University, Chicago, IL 60611, United States of America
| | - Rebecca Monteleone
- Disability Studies Program, University of Toledo, Toledo, OH 43606, United States of America
| |
Collapse
|
2
|
Lemon R. The Corticospinal System and Amyotrophic Lateral Sclerosis: IFCN handbook chapter. Clin Neurophysiol 2024; 160:56-67. [PMID: 38401191 DOI: 10.1016/j.clinph.2024.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 12/23/2023] [Accepted: 02/03/2024] [Indexed: 02/26/2024]
Abstract
Corticospinal neurons located in motor areas of the cerebral neocortex project corticospinal axons which synapse with the spinal network; a parallel corticobulbar system projects to the cranial motor network and to brainstem motor pathways. The primate corticospinal system has a widespread cortical origin and an extensive range of different fibre diameters, including thick, fast-conducting axons. Direct cortico-motoneuronal (CM) projections from the motor cortex to arm and hand alpha motoneurons are a recent evolutionary feature, that is well developed in dexterous primates and particularly in humans. Many of these projections originate from the caudal subdivision of area 4 ('new' M1: primary motor cortex). They arise from corticospinal neurons of varied soma size, including those with fast- and relatively slow-conducting axons. This CM system has been shown to be involved in the control of skilled movements, carried out with fractionation of the distal extremities and at low force levels. During movement, corticospinal neurons are activated quite differently from 'lower' motoneurons, and there is no simple or fixed functional relationship between a so-called 'upper' motoneuron and its target lower motoneuron. There are key differences in the organisation and function of the corticospinal and CM system in primates versus non-primates, such as rodents. These differences need to be recognized when making the choice of animal model for understanding disorders such as amyotrophic lateral sclerosis (ALS). In this neurodegenerative brain disease there is a selective loss of fast-conducting corticospinal axons, and their synaptic connections, and this is reflected in responses to non-invasive cortical stimuli and measures of cortico-muscular coherence. The loss of CM connections influencing distal limb muscles results in a differential loss of muscle strength or 'split-hand' phenotype. Importantly, there is also a unique impairment in the coordination of skilled hand tasks that require fractionation of digit movement. Scores on validated tests of skilled hand function could be used to assess disease progression.
Collapse
Affiliation(s)
- Roger Lemon
- Department of Clinical and Movement Sciences, Queen Square Institute of Neurology, UCL, London WC1N 3BG, UK.
| |
Collapse
|
3
|
Jordan GA, Vishwanath A, Holguin G, Bartlett MJ, Tapia AK, Winter GM, Sexauer MR, Stopera CJ, Falk T, Cowen SL. Automated system for training and assessing reaching and grasping behaviors in rodents. J Neurosci Methods 2024; 401:109990. [PMID: 37866457 PMCID: PMC10731814 DOI: 10.1016/j.jneumeth.2023.109990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Revised: 09/27/2023] [Accepted: 10/13/2023] [Indexed: 10/24/2023]
Abstract
BACKGROUND Reaching, grasping, and pulling behaviors are studied across species to investigate motor control and problem solving. String pulling is a distinct reaching and grasping behavior that is rapidly learned, requires bimanual coordination, is ethologically grounded, and has been applied across species and disease conditions. NEW METHOD Here we describe the PANDA system (Pulling And Neural Data Analysis), a hardware and software system that integrates a continuous string loop connected to a rotary encoder, feeder, microcontroller, high-speed camera, and analysis software for the assessment and training of reaching, grasping, and pulling behaviors and synchronization with neural data. RESULTS We demonstrate this system in rats implanted with electrodes in motor cortex and hippocampus and show how it can be used to assess relationships between reaching, pulling, and grasping movements and single-unit and local-field activity. Furthermore, we found that automating the shaping procedure significantly improved performance over manual training, with rats pulling > 100 m during a 15-minute session. COMPARISON WITH EXISTING METHODS String-pulling is typically shaped by tying food reward to the string and visually scoring behavior. The system described here automates training, streamlines video assessment with deep learning, and automatically segments reaching movements into distinct reach/pull phases. No system, to our knowledge, exists for the automated shaping and assessment of this behavior. CONCLUSIONS This system will be of general use to researchers investigating motor control, motivation, sensorimotor integration, and motor disorders such as Parkinson's disease and stroke.
Collapse
Affiliation(s)
- Gianna A Jordan
- Biomedical Engineering, University of Arizona, Tucson, AZ, USA
| | | | | | | | - Andrew K Tapia
- Biomedical Engineering, University of Arizona, Tucson, AZ, USA
| | | | | | | | - Torsten Falk
- Neurology, University of Arizona, Tucson, AZ, USA; Pharmacology, University of Arizona, Tucson, AZ, USA
| | | |
Collapse
|
4
|
Jordan GA, Vishwanath A, Holguin G, Bartlett MJ, Tapia AK, Winter GM, Sexauer MR, Stopera CJ, Falk T, Cowen SL. Automated system for training and assessing string-pulling behaviors in rodents. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.02.547431. [PMID: 37461637 PMCID: PMC10349952 DOI: 10.1101/2023.07.02.547431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/25/2023]
Abstract
String-pulling tasks have been used for centuries to study coordinated bimanual motor behavior and problem solving. String pulling is rapidly learned, ethologically grounded, and has been applied to many species and disease conditions. Typically, training of string-pulling behaviors is achieved through manual shaping and baiting. Furthermore, behavioral assessment of reaching, grasping, and pulling is often performed through labor intensive manual video scoring. No system, to our knowledge, currently exists for the automated shaping and assessment of string-pulling behaviors. Here we describe the PANDA system (Pulling And Neural Data Analysis), an inexpensive hardware and software system that utilizes a continuous string loop connected to a rotary encoder, feeder, microcontroller, high-speed camera, and analysis software for assessment and training of string-pulling behaviors and synchronization with neural recording data. We demonstrate this system in unimplanted rats and rats implanted with electrodes in motor cortex and hippocampus and show how the PANDA system can be used to assess relationships between paw movements and single-unit and local-field activity. We also found that automating the shaping procedure significantly improved overall performance, with rats regularly pulling >100 meters during a 15-minute session. In conclusion, the PANDA system will be of general use to researchers investigating motor control, motivation, and motor disorders such as Parkinson's disease, Huntington's disease, and stroke. It will also support the investigation of neural mechanisms involved in sensorimotor integration.
Collapse
Affiliation(s)
| | | | | | | | - Andrew K. Tapia
- Biomedical Engineering, University of Arizona, Tucson Arizona
| | | | | | | | - Torsten Falk
- Neurology, University of Arizona, Tucson Arizona
- Pharmacology, University of Arizona, Tucson Arizona
| | | |
Collapse
|
5
|
Chiappalone M, Cota VR, Carè M, Di Florio M, Beaubois R, Buccelli S, Barban F, Brofiga M, Averna A, Bonacini F, Guggenmos DJ, Bornat Y, Massobrio P, Bonifazi P, Levi T. Neuromorphic-Based Neuroprostheses for Brain Rewiring: State-of-the-Art and Perspectives in Neuroengineering. Brain Sci 2022; 12:1578. [PMID: 36421904 PMCID: PMC9688667 DOI: 10.3390/brainsci12111578] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/09/2022] [Accepted: 11/17/2022] [Indexed: 08/27/2023] Open
Abstract
Neuroprostheses are neuroengineering devices that have an interface with the nervous system and supplement or substitute functionality in people with disabilities. In the collective imagination, neuroprostheses are mostly used to restore sensory or motor capabilities, but in recent years, new devices directly acting at the brain level have been proposed. In order to design the next-generation of neuroprosthetic devices for brain repair, we foresee the increasing exploitation of closed-loop systems enabled with neuromorphic elements due to their intrinsic energy efficiency, their capability to perform real-time data processing, and of mimicking neurobiological computation for an improved synergy between the technological and biological counterparts. In this manuscript, after providing definitions of key concepts, we reviewed the first exploitation of a real-time hardware neuromorphic prosthesis to restore the bidirectional communication between two neuronal populations in vitro. Starting from that 'case-study', we provide perspectives on the technological improvements for real-time interfacing and processing of neural signals and their potential usage for novel in vitro and in vivo experimental designs. The development of innovative neuroprosthetics for translational purposes is also presented and discussed. In our understanding, the pursuit of neuromorphic-based closed-loop neuroprostheses may spur the development of novel powerful technologies, such as 'brain-prostheses', capable of rewiring and/or substituting the injured nervous system.
Collapse
Affiliation(s)
- Michela Chiappalone
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Vinicius R. Cota
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Marta Carè
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Mattia Di Florio
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
| | - Romain Beaubois
- IMS Laboratory, CNRS UMR 5218, University of Bordeaux, 33405 Talence, France
| | - Stefano Buccelli
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Federico Barban
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- Rehab Technologies, Istituto Italiano di Tecnologia, 16163 Genova, Italy
| | - Martina Brofiga
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
| | - Alberto Averna
- Department of Neurology, Bern University Hospital, University of Bern, 3012 Bern, Switzerland
| | - Francesco Bonacini
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
| | - David J. Guggenmos
- Department of Rehabilitation Medicine, University of Kansas Medical Center, Kansas City, KS 66103, USA
- Landon Center on Aging, University of Kansas Medical Center, Kansas City, KS 66103, USA
| | - Yannick Bornat
- IMS Laboratory, CNRS UMR 5218, University of Bordeaux, 33405 Talence, France
| | - Paolo Massobrio
- Department of Informatics, Bioengineering, Robotics System Engineering (DIBRIS), University of Genova, 16145 Genova, Italy
- National Institute for Nuclear Physics (INFN), 16146 Genova, Italy
| | - Paolo Bonifazi
- IKERBASQUE, The Basque Fundation, 48009 Bilbao, Spain
- Biocruces Health Research Institute, 48903 Barakaldo, Spain
| | - Timothée Levi
- IMS Laboratory, CNRS UMR 5218, University of Bordeaux, 33405 Talence, France
| |
Collapse
|
6
|
Makin TR, Micera S, Miller LE. Neurocognitive and motor-control challenges for the realization of bionic augmentation. Nat Biomed Eng 2022; 7:344-348. [PMID: 36050524 PMCID: PMC9975114 DOI: 10.1038/s41551-022-00930-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Robotic fingers and arms that augment the motor abilities of non-disabled individuals are increasingly feasible yet face neurocognitive barriers and hurdles in efferent motor control.
Collapse
Affiliation(s)
- Tamar R Makin
- Institute of Cognitive Neuroscience, University College London, London, UK. .,MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK.
| | - Silvestro Micera
- Bertarelli Foundation Chair in Translational Neural Engineering, Center for Neuroprosthetics and Institute of Bioengineering, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland. .,The BioRobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pisa, Italy.
| | - Lee E Miller
- Department of Physiology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. .,Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. .,Department of Biomedical Engineering, McCormick School of Engineering, Northwestern University, Evanston, IL, USA. .,Shirley Ryan AbilityLab, Chicago, IL, USA.
| |
Collapse
|
7
|
Eden J, Bräcklein M, Ibáñez J, Barsakcioglu DY, Di Pino G, Farina D, Burdet E, Mehring C. Principles of human movement augmentation and the challenges in making it a reality. Nat Commun 2022; 13:1345. [PMID: 35292665 PMCID: PMC8924218 DOI: 10.1038/s41467-022-28725-7] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 02/04/2022] [Indexed: 12/23/2022] Open
Abstract
Augmenting the body with artificial limbs controlled concurrently to one's natural limbs has long appeared in science fiction, but recent technological and neuroscientific advances have begun to make this possible. By allowing individuals to achieve otherwise impossible actions, movement augmentation could revolutionize medical and industrial applications and profoundly change the way humans interact with the environment. Here, we construct a movement augmentation taxonomy through what is augmented and how it is achieved. With this framework, we analyze augmentation that extends the number of degrees-of-freedom, discuss critical features of effective augmentation such as physiological control signals, sensory feedback and learning as well as application scenarios, and propose a vision for the field.
Collapse
Affiliation(s)
- Jonathan Eden
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Mario Bräcklein
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Jaime Ibáñez
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK.,BSICoS, IIS Aragón, Universidad de Zaragoza, Zaragoza, Spain.,Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, London, UK
| | | | - Giovanni Di Pino
- NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Dario Farina
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Etienne Burdet
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK.
| | - Carsten Mehring
- Bernstein Center Freiburg, University of Freiburg, Freiburg im Breisgau, 79104, Germany.,Faculty of Biology, University of Freiburg, Freiburg im Breisgau, 79104, Germany
| |
Collapse
|
8
|
Ramot M, Martin A. Closed-loop neuromodulation for studying spontaneous activity and causality. Trends Cogn Sci 2022; 26:290-299. [PMID: 35210175 PMCID: PMC9396631 DOI: 10.1016/j.tics.2022.01.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 01/30/2022] [Accepted: 01/31/2022] [Indexed: 01/01/2023]
Abstract
Having established that spontaneous brain activity follows meaningful coactivation patterns and correlates with behavior, researchers have turned their attention to understanding its function and behavioral significance. We suggest closed-loop neuromodulation as a neural perturbation tool uniquely well suited for this task. Closed-loop neuromodulation has primarily been viewed as an interventionist tool to teach subjects to directly control their own brain activity. We examine an alternative operant conditioning model of closed-loop neuromodulation which, through implicit feedback, can manipulate spontaneous activity at the network level, without violating the spontaneous or endogenous nature of the signal, thereby providing a direct test of network causality.
Collapse
|
9
|
Taschereau-Dumouchel V, Cushing C, Lau H. Real-Time Functional MRI in the Treatment of Mental Health Disorders. Annu Rev Clin Psychol 2022; 18:125-154. [DOI: 10.1146/annurev-clinpsy-072220-014550] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Multiple mental disorders have been associated with dysregulation of precise brain processes. However, few therapeutic approaches can correct such specific patterns of brain activity. Since the late 1960s and early 1970s, many researchers have hoped that this feat could be achieved by closed-loop brain imaging approaches, such as neurofeedback, that aim to modulate brain activity directly. However, neurofeedback never gained mainstream acceptance in mental health, in part due to methodological considerations. In this review, we argue that, when contemporary methodological guidelines are followed, neurofeedback is one of the few intervention methods in psychology that can be assessed in double-blind placebo-controlled trials. Furthermore, using new advances in machine learning and statistics, it is now possible to target very precise patterns of brain activity for therapeutic purposes. We review the recent literature in functional magnetic resonance imaging neurofeedback and discuss current and future applications to mental health. Expected final online publication date for the Annual Review of Clinical Psychology, Volume 18 is May 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Vincent Taschereau-Dumouchel
- Department of Psychiatry and Addictology, Université de Montréal, Montréal, Québec, Canada
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal, Montréal, Québec, Canada
| | - Cody Cushing
- Department of Psychology, University of California, Los Angeles, California, USA
| | - Hakwan Lau
- RIKEN Center for Brain Science, Wakoshi, Saitama, Japan
| |
Collapse
|
10
|
Stuttaford SA, Dupan SSG, Nazarpour K, Dyson M. Long-Term Myoelectric Training with Delayed Feedback in the Home Environment. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6437-6440. [PMID: 34892585 DOI: 10.1109/embc46164.2021.9629609] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Myoelectric prosthesis users typically do not receive immediate feedback from their device. They must be able to consistently produce distinct muscle activations in the absence of augmented feedback. In previous experiments, abstract decoding has provided real-time visual feedback for closed loop control. It is unclear if the performance in those experiments was due to short-term adaptation or motor learning. To test if similar performance could be reached without short-term adaptation, we trained participants with a delayed feedback paradigm. Feedback was delayed until after the ~1.5 s trial was completed. Three participants trained for five days in their home environments, completing a cumulative total of 4920 trials. Participants became highly accurate while receiving no real-time feedback of their control input. They were also able to retain performance gains across days. This strongly suggests that abstract decoding with delayed feedback facilitates motor learning, enabling four class control without immediate feedback.
Collapse
|
11
|
Lemon RN. The Cortical "Upper Motoneuron" in Health and Disease. Brain Sci 2021; 11:619. [PMID: 34066053 PMCID: PMC8151778 DOI: 10.3390/brainsci11050619] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 05/03/2021] [Accepted: 05/10/2021] [Indexed: 12/11/2022] Open
Abstract
Upper motoneurons (UMNs) in motor areas of the cerebral cortex influence spinal and cranial motor mechanisms through the corticospinal tract (CST) and through projections to brainstem motor pathways. The primate corticospinal system has a diverse cortical origin and a wide spectrum of fibre diameters, including large diameter fibres which are unique to humans and other large primates. Direct cortico-motoneuronal (CM) projections from the motor cortex to arm and hand motoneurons are a late evolutionary feature only present in dexterous primates and best developed in humans. CM projections are derived from a more restricted cortical territory ('new' M1, area 3a) and arise not only from corticospinal neurons with large, fast axons but also from those with relatively slow-conducting axons. During movement, corticospinal neurons are organised and recruited quite differently from 'lower' motoneurons. Accumulating evidence strongly implicates the corticospinal system in the early stages of ALS, with particular involvement of CM projections to distal limb muscles, but also to other muscle groups influenced by the CM system. There are important species differences in the organisation and function of the corticospinal system, and appropriate animal models are needed to understand disorders involving the human corticospinal system.
Collapse
Affiliation(s)
- Roger N Lemon
- Department of Clinical and Movement Sciences, Queen Square Institute of Neurology, UCL, London WC1N 3BG, UK
| |
Collapse
|
12
|
Chauvière L, Singer W. Neurofeedback Training of Gamma Oscillations in Monkey Primary Visual Cortex. Cereb Cortex 2020; 29:4785-4802. [PMID: 30796824 DOI: 10.1093/cercor/bhz013] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2018] [Revised: 01/13/2019] [Accepted: 01/24/2019] [Indexed: 12/11/2022] Open
Abstract
In humans, neurofeedback (NFB) training has been used extensively and successfully to manipulate brain activity. Feedback signals were derived from EEG, fMRI, MEG, and intracranial recordings and modifications were obtained of the BOLD signal, of the power of oscillatory activity in distinct frequency bands and of single unit activity. The purpose of the present study was to examine whether neuronal activity could also be controlled by NFB in early sensory cortices whose activity is thought to be influenced mainly by sensory input rather than volitional control. We trained 2 macaque monkeys to enhance narrow band gamma oscillations in the primary visual cortex by providing them with an acoustic signal that reflected the power of gamma oscillations in a preselected band and rewarding increases of the feedback signal. Oscillations were assessed from local field potentials recorded with chronically implanted microelectrodes. Both monkeys succeeded to raise gamma activity in the absence of visual stimulation in the selected frequency band and at the site from which the NFB signal was derived. This suggests that top-down signals are not confined to just modulate stimulus induced responses but can actually drive or facilitate the gamma generating microcircuits even in a primary sensory area.
Collapse
Affiliation(s)
- L Chauvière
- Ernst Struengmann Institute for Neuroscience in Cooperation with Max Planck Society, Deutschordenstrasse 46, 60528 Frankfurt, Germany
| | - W Singer
- Ernst Struengmann Institute for Neuroscience in Cooperation with Max Planck Society, Deutschordenstrasse 46, 60528 Frankfurt, Germany
| |
Collapse
|
13
|
Wolpaw JR, Millán JDR, Ramsey NF. Brain-computer interfaces: Definitions and principles. HANDBOOK OF CLINICAL NEUROLOGY 2020; 168:15-23. [PMID: 32164849 DOI: 10.1016/b978-0-444-63934-9.00002-0] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
Throughout life, the central nervous system (CNS) interacts with the world and with the body by activating muscles and excreting hormones. In contrast, brain-computer interfaces (BCIs) quantify CNS activity and translate it into new artificial outputs that replace, restore, enhance, supplement, or improve the natural CNS outputs. BCIs thereby modify the interactions between the CNS and the environment. Unlike the natural CNS outputs that come from spinal and brainstem motoneurons, BCI outputs come from brain signals that represent activity in other CNS areas, such as the sensorimotor cortex. If BCIs are to be useful for important communication and control tasks in real life, the CNS must control these brain signals nearly as reliably and accurately as it controls spinal motoneurons. To do this, they might, for example, need to incorporate software that mimics the function of the subcortical and spinal mechanisms that participate in normal movement control. The realization of high reliability and accuracy is perhaps the most difficult and critical challenge now facing BCI research and development. The ongoing adaptive modifications that maintain effective natural CNS outputs take place primarily in the CNS. The adaptive modifications that maintain effective BCI outputs can also take place in the BCI. This means that the BCI operation depends on the effective collaboration of two adaptive controllers, the CNS and the BCI. Realization of this second adaptive controller, the BCI, and management of its interactions with concurrent adaptations in the CNS comprise another complex and critical challenge for BCI development. BCIs can use different kinds of brain signals recorded in different ways from different brain areas. Decisions about which signals recorded in which ways from which brain areas should be selected for which applications are empirical questions that can only be properly answered by experiments. BCIs, like other communication and control technologies, often face artifacts that contaminate or imitate their chosen signals. Noninvasive BCIs (e.g., EEG- or fNIRS-based) need to take special care to avoid interpreting nonbrain signals (e.g., cranial EMG) as brain signals. This typically requires comprehensive topographical and spectral evaluations. In theory, the outputs of BCIs can select a goal or control a process. In the future, the most effective BCIs will probably be those that combine goal selection and process control so as to distribute control between the BCI and the application in a fashion suited to the current action. Through such distribution, BCIs may most effectively imitate natural CNS operation. The primary measure of BCI development is the extent to which BCI systems benefit people with neuromuscular disorders. Thus, BCI clinical evaluation, validation, and dissemination is a key step. It is at the same time a complex and difficult process that depends on multidisciplinary collaboration and management of the demanding requirements of clinical studies. Twenty-five years ago, BCI research was an esoteric endeavor pursued in only a few isolated laboratories. It is now a steadily growing field that engages many hundreds of scientists, engineers, and clinicians throughout the world in an increasingly interconnected community that is addressing the key issues and pursuing the high potential of BCI technology.
Collapse
Affiliation(s)
- Jonathan R Wolpaw
- National Center for Adaptive Neurotechnologies and Stratton VA Medical Center, Wadsworth Center, Albany, NY, United States
| | - José Del R Millán
- Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, United States; Department of Neurology, The University of Texas at Austin, Austin, TX, United States
| | - Nick F Ramsey
- Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
14
|
Pisarchik AN, Maksimenko VA, Hramov AE. From Novel Technology to Novel Applications: Comment on "An Integrated Brain-Machine Interface Platform With Thousands of Channels" by Elon Musk and Neuralink. J Med Internet Res 2019; 21:e16356. [PMID: 31674923 PMCID: PMC6914250 DOI: 10.2196/16356] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2019] [Revised: 10/16/2019] [Accepted: 10/20/2019] [Indexed: 01/20/2023] Open
Affiliation(s)
- Alexander N Pisarchik
- Center for Biomedical Technology, Technical University of Madrid, Pozuelo de Alarcón, Madrid, Spain.,Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Innopolis, Russian Federation
| | - Vladimir A Maksimenko
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Innopolis, Russian Federation
| | - Alexander E Hramov
- Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Innopolis, Russian Federation
| |
Collapse
|
15
|
Lemon R, Kraskov A. Starting and stopping movement by the primate brain. Brain Neurosci Adv 2019; 3:2398212819837149. [PMID: 32166180 PMCID: PMC7058194 DOI: 10.1177/2398212819837149] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2018] [Indexed: 01/13/2023] Open
Abstract
We review the current knowledge about the part that motor cortex plays in the preparation and generation of movement, and we discuss the idea that corticospinal neurons, and particularly those with cortico-motoneuronal connections, act as ‘command’ neurons for skilled reach-to-grasp movements in the primate. We also review the increasing evidence that it is active during processes such as action observation and motor imagery. This leads to a discussion about how movement is inhibited and stopped, and the role in these for disfacilitation of the corticospinal output. We highlight the importance of the non-human primate as a model for the human motor system. Finally, we discuss the insights that recent research into the monkey motor system has provided for translational approaches to neurological diseases such as stroke, spinal injury and motor neuron disease.
Collapse
Affiliation(s)
- Roger Lemon
- Sobell Department of Motor Neuroscience and Movement Disorders, Institute of Neurology, University College London (UCL), London, UK
| | - Alexander Kraskov
- Sobell Department of Motor Neuroscience and Movement Disorders, Institute of Neurology, University College London (UCL), London, UK
| |
Collapse
|
16
|
Intrinsic Variable Learning for Brain-Machine Interface Control by Human Anterior Intraparietal Cortex. Neuron 2019; 102:694-705.e3. [PMID: 30853300 DOI: 10.1016/j.neuron.2019.02.012] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2018] [Revised: 11/05/2018] [Accepted: 02/06/2019] [Indexed: 11/22/2022]
Abstract
Although animal studies provided significant insights in understanding the neural basis of learning and adaptation, they often cannot dissociate between different learning mechanisms due to the lack of verbal communication. To overcome this limitation, we examined the mechanisms of learning and its limits in a human intracortical brain-machine interface (BMI) paradigm. A tetraplegic participant controlled a 2D computer cursor by modulating single-neuron activity in the anterior intraparietal area (AIP). By perturbing the neuron-to-movement mapping, the participant learned to modulate the activity of the recorded neurons to solve the perturbations by adopting a target re-aiming strategy. However, when no cognitive strategies were adequate to produce correct responses, AIP failed to adapt to perturbations. These findings suggest that learning is constrained by the pre-existing neuronal structure, although it is possible that AIP needs more training time to learn to generate novel activity patterns when cognitive re-adaptation fails to solve the perturbations.
Collapse
|
17
|
Bashford L, Wu J, Sarma D, Collins K, Rao RPN, Ojemann JG, Mehring C. Concurrent control of a brain-computer interface and natural overt movements. J Neural Eng 2018; 15:066021. [PMID: 30303130 DOI: 10.1088/1741-2552/aadf3d] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
OBJECTIVE A primary control signal in brain-computer interfaces (BCIs) have been cortical signals related to movement. However, in cases where natural motor function remains, BCI control signals may interfere with other possibly simultaneous activity for useful ongoing movement. We sought to determine if the brain could learn to control both a BCI and concurrent overt movement execution in such cases. APPROACH We designed experiments where BCI and overt movements must be used concurrently and in coordination to achieve a 2D centre out control. Power in the 70-90 Hz band of human electrocorticography (ECoG) signals, was used to generate BCI control commands for vertical movement of the cursor. These signals were deliberately recorded from the same human cortical site that produced the strongest movement related activity associated with the concurrent overt finger movements required for the horizontal movement of the cursor. MAIN RESULTS We demonstrate that three subjects were able to perform the concurrent BCI task, controlling BCI and natural movements simultaneously and to a large extent independently. We conclude that the brain is capable of dissociating the original control signal dependency on movement, producing specific BCI control signals in the presence of motor related responses from the ongoing overt behaviour with which the BCI signal was initially correlated. SIGNIFICANCE We demonstrate a novel human brain-computer interface (BCI) which can be used to control movement concurrently and in coordination with movements of the natural limbs. This demonstrates the dissociation of cortical activity from the behaviour with which it was originally associated despite the ongoing behaviour and shows the feasibility of achieving simultaneous BCI control of devices with natural movements.
Collapse
Affiliation(s)
- L Bashford
- Department of Bioengineering, Imperial College London, London, United Kingdom. Bernstein Center and Brain-Links Brain-Tools, University of Freiburg, Freiburg, Germany
| | | | | | | | | | | | | |
Collapse
|
18
|
Buccino AP, Lepperød ME, Dragly SA, Häfliger P, Fyhn M, Hafting T. Open source modules for tracking animal behavior and closed-loop stimulation based on Open Ephys and Bonsai. J Neural Eng 2018; 15:055002. [DOI: 10.1088/1741-2552/aacf45] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
19
|
Panuccio G, Semprini M, Natale L, Buccelli S, Colombi I, Chiappalone M. Progress in Neuroengineering for brain repair: New challenges and open issues. Brain Neurosci Adv 2018; 2:2398212818776475. [PMID: 32166141 PMCID: PMC7058228 DOI: 10.1177/2398212818776475] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2018] [Accepted: 04/19/2018] [Indexed: 01/01/2023] Open
Abstract
Background In recent years, biomedical devices have proven to be able to target also different neurological disorders. Given the rapid ageing of the population and the increase of invalidating diseases affecting the central nervous system, there is a growing demand for biomedical devices of immediate clinical use. However, to reach useful therapeutic results, these tools need a multidisciplinary approach and a continuous dialogue between neuroscience and engineering, a field that is named neuroengineering. This is because it is fundamental to understand how to read and perturb the neural code in order to produce a significant clinical outcome. Results In this review, we first highlight the importance of developing novel neurotechnological devices for brain repair and the major challenges expected in the next years. We describe the different types of brain repair strategies being developed in basic and clinical research and provide a brief overview of recent advances in artificial intelligence that have the potential to improve the devices themselves. We conclude by providing our perspective on their implementation to humans and the ethical issues that can arise. Conclusions Neuroengineering approaches promise to be at the core of future developments for clinical applications in brain repair, where the boundary between biology and artificial intelligence will become increasingly less pronounced.
Collapse
Affiliation(s)
- Gabriella Panuccio
- Department of Neuroscience and Brain Technologies (NBT), Istituto Italiano di Tecnologia (IIT), Genova, Italy
| | | | - Lorenzo Natale
- iCub Facility, Istituto Italiano di Tecnologia, Genova, Italy
| | - Stefano Buccelli
- Department of Neuroscience and Brain Technologies (NBT), Istituto Italiano di Tecnologia (IIT), Genova, Italy.,Rehab Technologies, Istituto Italiano di Tecnologia, Genova, Italy.,Dipartimento di Neuroscienze, riabilitazione, oftalmologia, genetica e scienze materno-infantili (DINOGMI), University of Genova, Genova, Italy
| | - Ilaria Colombi
- Department of Neuroscience and Brain Technologies (NBT), Istituto Italiano di Tecnologia (IIT), Genova, Italy.,Rehab Technologies, Istituto Italiano di Tecnologia, Genova, Italy.,Dipartimento di Neuroscienze, riabilitazione, oftalmologia, genetica e scienze materno-infantili (DINOGMI), University of Genova, Genova, Italy
| | | |
Collapse
|
20
|
Orsborn AL, Pesaran B. Parsing learning in networks using brain-machine interfaces. Curr Opin Neurobiol 2017; 46:76-83. [PMID: 28843838 DOI: 10.1016/j.conb.2017.08.002] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2017] [Revised: 07/31/2017] [Accepted: 08/03/2017] [Indexed: 12/30/2022]
Abstract
Brain-machine interfaces (BMIs) define new ways to interact with our environment and hold great promise for clinical therapies. Motor BMIs, for instance, re-route neural activity to control movements of a new effector and could restore movement to people with paralysis. Increasing experience shows that interfacing with the brain inevitably changes the brain. BMIs engage and depend on a wide array of innate learning mechanisms to produce meaningful behavior. BMIs precisely define the information streams into and out of the brain, but engage wide-spread learning. We take a network perspective and review existing observations of learning in motor BMIs to show that BMIs engage multiple learning mechanisms distributed across neural networks. Recent studies demonstrate the advantages of BMI for parsing this learning and its underlying neural mechanisms. BMIs therefore provide a powerful tool for studying the neural mechanisms of learning that highlights the critical role of learning in engineered neural therapies.
Collapse
Affiliation(s)
- Amy L Orsborn
- Center for Neural Science, New York University, New York, NY 10003, USA.
| | - Bijan Pesaran
- Center for Neural Science, New York University, New York, NY 10003, USA
| |
Collapse
|
21
|
Hernández-González S, Andreu-Sánchez C, Martín-Pascual MÁ, Gruart A, Delgado-García JM. A Cognition-Related Neural Oscillation Pattern, Generated in the Prelimbic Cortex, Can Control Operant Learning in Rats. J Neurosci 2017; 37:5923-5935. [PMID: 28536269 PMCID: PMC6596507 DOI: 10.1523/jneurosci.3651-16.2017] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2016] [Revised: 03/25/2017] [Accepted: 04/02/2017] [Indexed: 11/21/2022] Open
Abstract
The prelimbic (PrL) cortex constitutes one of the highest levels of cortical hierarchy dedicated to the execution of adaptive behaviors. We have identified a specific local field potential (LFP) pattern generated in the PrL cortex and associated with cognition-related behaviors. We used this pattern to trigger the activation of a visual display on a touch screen as part of an operant conditioning task. Rats learned to increase the presentation rate of the selected θ to β-γ (θ/β-γ) transition pattern across training sessions. The selected LFP pattern appeared to coincide with a significant decrease in the firing of PrL pyramidal neurons and did not seem to propagate to other cortical or subcortical areas. An indication of the PrL cortex's cognitive nature is that the experimental disruption of this θ/β-γ transition pattern prevented the proper performance of the acquired task without affecting the generation of other motor responses. The use of this LFP pattern to trigger an operant task evoked only minor changes in its electrophysiological properties. Thus, the PrL cortex has the capability of generating an oscillatory pattern for dealing with environmental constraints. In addition, the selected θ/β-γ transition pattern could be a useful tool to activate the presentation of external cues or to modify the current circumstances.SIGNIFICANCE STATEMENT Brain-machine interfaces represent a solution for physically impaired people to communicate with external devices. We have identified a specific local field potential pattern generated in the prelimbic cortex and associated with goal-directed behaviors. We used the pattern to trigger the activation of a visual display on a touch screen as part of an operant conditioning task. Rats learned to increase the presentation rate of the selected field potential pattern across training. The selected pattern was not modified when used to activate the touch screen. Electrical stimulation of the recording site prevented the proper performance of the task. Our findings show that the prelimbic cortex can generate oscillatory patterns that rats can use to control their environment for achieving specific goals.
Collapse
Affiliation(s)
| | - Celia Andreu-Sánchez
- Audiovisual Communication and Advertising Department, Universitat Autònoma de Barcelona, 08193 Bellaterra, Spain
| | - Miguel Ángel Martín-Pascual
- Audiovisual Communication and Advertising Department, Universitat Autònoma de Barcelona, 08193 Bellaterra, Spain
| | - Agnès Gruart
- Division of Neurosciences, Pablo de Olavide University, 41013 Seville, Spain, and
| | | |
Collapse
|
22
|
Rouse AG, Williams JJ, Wheeler JJ, Moran DW. Spatial co-adaptation of cortical control columns in a micro-ECoG brain-computer interface. J Neural Eng 2016; 13:056018. [PMID: 27651034 DOI: 10.1088/1741-2560/13/5/056018] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Electrocorticography (ECoG) has been used for a range of applications including electrophysiological mapping, epilepsy monitoring, and more recently as a recording modality for brain-computer interfaces (BCIs). Studies that examine ECoG electrodes designed and implanted chronically solely for BCI applications remain limited. The present study explored how two key factors influence chronic, closed-loop ECoG BCI: (i) the effect of inter-electrode distance on BCI performance and (ii) the differences in neural adaptation and performance when fixed versus adaptive BCI decoding weights are used. APPROACH The amplitudes of epidural micro-ECoG signals between 75 and 105 Hz with 300 μm diameter electrodes were used for one-dimensional and two-dimensional BCI tasks. The effect of inter-electrode distance on BCI control was tested between 3 and 15 mm. Additionally, the performance and cortical modulation differences between constant, fixed decoding using a small subset of channels versus adaptive decoding weights using the entire array were explored. MAIN RESULTS Successful BCI control was possible with two electrodes separated by 9 and 15 mm. Performance decreased and the signals became more correlated when the electrodes were only 3 mm apart. BCI performance in a 2D BCI task improved significantly when using adaptive decoding weights (80%-90%) compared to using constant, fixed weights (50%-60%). Additionally, modulation increased for channels previously unavailable for BCI control under the fixed decoding scheme upon switching to the adaptive, all-channel scheme. SIGNIFICANCE Our results clearly show that neural activity under a BCI recording electrode (which we define as a 'cortical control column') readily adapts to generate an appropriate control signal. These results show that the practical minimal spatial resolution of these control columns with micro-ECoG BCI is likely on the order of 3 mm. Additionally, they show that the combination and interaction between neural adaptation and machine learning are critical to optimizing ECoG BCI performance.
Collapse
|
23
|
Phillips CG. Hughlings Jackson Lecture. Cortical Localization and “sensori Motor Processes” at the “middle Level” in Primates. Proc R Soc Med 2016. [DOI: 10.1177/003591577306601015] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- C G Phillips
- University Laboratory of Physiology, Oxford, OX] 3PT, and Trinity College, Oxford
| |
Collapse
|
24
|
Schroeder KE, Chestek CA. Intracortical Brain-Machine Interfaces Advance Sensorimotor Neuroscience. Front Neurosci 2016; 10:291. [PMID: 27445663 PMCID: PMC4923184 DOI: 10.3389/fnins.2016.00291] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2016] [Accepted: 06/10/2016] [Indexed: 01/06/2023] Open
Abstract
Brain-machine interfaces (BMIs) decode brain activity to control external devices. Over the past two decades, the BMI community has grown tremendously and reached some impressive milestones, including the first human clinical trials using chronically implanted intracortical electrodes. It has also contributed experimental paradigms and important findings to basic neuroscience. In this review, we discuss neuroscience achievements stemming from BMI research, specifically that based upon upper limb prosthetic control with intracortical microelectrodes. We will focus on three main areas: first, we discuss progress in neural coding of reaches in motor cortex, describing recent results linking high dimensional representations of cortical activity to muscle activation. Next, we describe recent findings on learning and plasticity in motor cortex on various time scales. Finally, we discuss how bidirectional BMIs have led to better understanding of somatosensation in and related to motor cortex.
Collapse
Affiliation(s)
- Karen E Schroeder
- Department of Biomedical Engineering, University of Michigan Ann Arbor, MI, USA
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of MichiganAnn Arbor, MI, USA; Neuroscience Graduate Program, University of Michigan Medical SchoolAnn Arbor, MI, USA; Center for Consciousness Science, University of Michigan Medical SchoolAnn Arbor, MI, USA; Department of Electrical Engineering and Computer Science, University of MichiganAnn Arbor, MI, USA; Robotics Graduate Program, University of MichiganAnn Arbor, MI, USA
| |
Collapse
|
25
|
Sepulveda P, Sitaram R, Rana M, Montalba C, Tejos C, Ruiz S. How feedback, motor imagery, and reward influence brain self-regulation using real-time fMRI. Hum Brain Mapp 2016; 37:3153-71. [PMID: 27272616 DOI: 10.1002/hbm.23228] [Citation(s) in RCA: 49] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2016] [Revised: 04/15/2016] [Accepted: 04/18/2016] [Indexed: 02/05/2023] Open
Abstract
The learning process involved in achieving brain self-regulation is presumed to be related to several factors, such as type of feedback, reward, mental imagery, duration of training, among others. Explicitly instructing participants to use mental imagery and monetary reward are common practices in real-time fMRI (rtfMRI) neurofeedback (NF), under the assumption that they will enhance and accelerate the learning process. However, it is still not clear what the optimal strategy is for improving volitional control. We investigated the differential effect of feedback, explicit instructions and monetary reward while training healthy individuals to up-regulate the blood-oxygen-level dependent (BOLD) signal in the supplementary motor area (SMA). Four groups were trained in a two-day rtfMRI-NF protocol: GF with NF only, GF,I with NF + explicit instructions (motor imagery), GF,R with NF + monetary reward, and GF,I,R with NF + explicit instructions (motor imagery) + monetary reward. Our results showed that GF increased significantly their BOLD self-regulation from day-1 to day-2 and GF,R showed the highest BOLD signal amplitude in SMA during the training. The two groups who were instructed to use motor imagery did not show a significant learning effect over the 2 days. The additional factors, namely motor imagery and reward, tended to increase the intersubject variability in the SMA during the course of training. Whole brain univariate and functional connectivity analyses showed common as well as distinct patterns in the four groups, representing the varied influences of feedback, reward, and instructions on the brain. Hum Brain Mapp 37:3153-3171, 2016. © 2016 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- Pradyumna Sepulveda
- Biomedical Imaging Center, Pontificia Universidad Católica De Chile, Santiago, Chile.,Department of Electrical Engineering, Pontificia Universidad Católica De Chile, Santiago, Chile.,Laboratory of Brain-Machine Interfaces and Neuromodulation, Pontificia Universidad Católica De Chile, Santiago, Chile
| | - Ranganatha Sitaram
- Laboratory of Brain-Machine Interfaces and Neuromodulation, Pontificia Universidad Católica De Chile, Santiago, Chile.,Institute for Biological and Medical Engineering, Pontificia Universidad Católica De Chile, Santiago, Chile.,Department of Psychiatry, Faculty of Medicine, Interdisciplinary Center for Neuroscience, Pontificia Universidad Católica De Chile, Santiago, Chile.,Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Mohit Rana
- Laboratory of Brain-Machine Interfaces and Neuromodulation, Pontificia Universidad Católica De Chile, Santiago, Chile.,Department of Psychiatry, Faculty of Medicine, Interdisciplinary Center for Neuroscience, Pontificia Universidad Católica De Chile, Santiago, Chile
| | - Cristian Montalba
- Biomedical Imaging Center, Pontificia Universidad Católica De Chile, Santiago, Chile
| | - Cristian Tejos
- Biomedical Imaging Center, Pontificia Universidad Católica De Chile, Santiago, Chile.,Department of Electrical Engineering, Pontificia Universidad Católica De Chile, Santiago, Chile
| | - Sergio Ruiz
- Laboratory of Brain-Machine Interfaces and Neuromodulation, Pontificia Universidad Católica De Chile, Santiago, Chile.,Department of Psychiatry, Faculty of Medicine, Interdisciplinary Center for Neuroscience, Pontificia Universidad Católica De Chile, Santiago, Chile.,Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| |
Collapse
|
26
|
Perruchoud D, Pisotta I, Carda S, Murray MM, Ionta S. Biomimetic rehabilitation engineering: the importance of somatosensory feedback for brain-machine interfaces. J Neural Eng 2016; 13:041001. [PMID: 27221469 DOI: 10.1088/1741-2560/13/4/041001] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
OBJECTIVE Brain-machine interfaces (BMIs) re-establish communication channels between the nervous system and an external device. The use of BMI technology has generated significant developments in rehabilitative medicine, promising new ways to restore lost sensory-motor functions. However and despite high-caliber basic research, only a few prototypes have successfully left the laboratory and are currently home-deployed. APPROACH The failure of this laboratory-to-user transfer likely relates to the absence of BMI solutions for providing naturalistic feedback about the consequences of the BMI's actions. To overcome this limitation, nowadays cutting-edge BMI advances are guided by the principle of biomimicry; i.e. the artificial reproduction of normal neural mechanisms. MAIN RESULTS Here, we focus on the importance of somatosensory feedback in BMIs devoted to reproducing movements with the goal of serving as a reference framework for future research on innovative rehabilitation procedures. First, we address the correspondence between users' needs and BMI solutions. Then, we describe the main features of invasive and non-invasive BMIs, including their degree of biomimicry and respective advantages and drawbacks. Furthermore, we explore the prevalent approaches for providing quasi-natural sensory feedback in BMI settings. Finally, we cover special situations that can promote biomimicry and we present the future directions in basic research and clinical applications. SIGNIFICANCE The continued incorporation of biomimetic features into the design of BMIs will surely serve to further ameliorate the realism of BMIs, as well as tremendously improve their actuation, acceptance, and use.
Collapse
Affiliation(s)
- David Perruchoud
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology and Department of Clinical Neurosciences, University Hospital Center and University of Lausanne, Lausanne, Switzerland
| | | | | | | | | |
Collapse
|
27
|
Moritz CT, Ruther P, Goering S, Stett A, Ball T, Burgard W, Chudler EH, Rao RPN. New Perspectives on Neuroengineering and Neurotechnologies: NSF-DFG Workshop Report. IEEE Trans Biomed Eng 2016; 63:1354-67. [PMID: 27008657 DOI: 10.1109/tbme.2016.2543662] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
GOAL To identify and overcome barriers to creating new neurotechnologies capable of restoring both motor and sensory function in individuals with neurological conditions. METHODS This report builds upon the outcomes of a joint workshop between the US National Science Foundation and the German Research Foundation on New Perspectives in Neuroengineering and Neurotechnology convened in Arlington, VA, USA, November 13-14, 2014. RESULTS The participants identified key technological challenges for recording and manipulating neural activity, decoding, and interpreting brain data in the presence of plasticity, and early considerations of ethical and social issues pertinent to the adoption of neurotechnologies. CONCLUSIONS The envisaged progress in neuroengineering requires tightly integrated hardware and signal processing efforts, advances in understanding of physiological adaptations to closed-loop interactions with neural devices, and an open dialog with stakeholders and potential end-users of neurotechnology. SIGNIFICANCE The development of new neurotechnologies (e.g., bidirectional brain-computer interfaces) could significantly improve the quality of life of people living with the effects of brain or spinal cord injury, or other neurodegenerative diseases. Focused efforts aimed at overcoming the remaining barriers at the electrode tissue interface, developing implantable hardware with on-board computation, and refining stimulation methods to precisely activate neural tissue will advance both our understanding of brain function and our ability to treat currently intractable disorders of the nervous system.
Collapse
|
28
|
Brain control and information transfer. Exp Brain Res 2015; 233:3335-47. [DOI: 10.1007/s00221-015-4423-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2015] [Accepted: 08/17/2015] [Indexed: 11/27/2022]
|
29
|
Zhang Y, Chase SM. Recasting brain-machine interface design from a physical control system perspective. J Comput Neurosci 2015; 39:107-18. [PMID: 26142906 PMCID: PMC4568020 DOI: 10.1007/s10827-015-0566-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2015] [Revised: 06/17/2015] [Accepted: 06/18/2015] [Indexed: 12/18/2022]
Abstract
With the goal of improving the quality of life for people suffering from various motor control disorders, brain-machine interfaces provide direct neural control of prosthetic devices by translating neural signals into control signals. These systems act by reading motor intent signals directly from the brain and using them to control, for example, the movement of a cursor on a computer screen. Over the past two decades, much attention has been devoted to the decoding problem: how should recorded neural activity be translated into the movement of the cursor? Most approaches have focused on this problem from an estimation standpoint, i.e., decoders are designed to return the best estimate of motor intent possible, under various sets of assumptions about how the recorded neural signals represent motor intent. Here we recast the decoder design problem from a physical control system perspective, and investigate how various classes of decoders lead to different types of physical systems for the subject to control. This framework leads to new interpretations of why certain types of decoders have been shown to perform better than others. These results have implications for understanding how motor neurons are recruited to perform various tasks, and may lend insight into the brain's ability to conceptualize artificial systems.
Collapse
Affiliation(s)
- Yin Zhang
- Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA.
| | - Steven M Chase
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, USA. .,Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
30
|
Neuroplasticity subserving the operation of brain-machine interfaces. Neurobiol Dis 2015; 83:161-71. [PMID: 25968934 DOI: 10.1016/j.nbd.2015.05.001] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2014] [Revised: 04/27/2015] [Accepted: 05/01/2015] [Indexed: 01/16/2023] Open
Abstract
Neuroplasticity is key to the operation of brain machine interfaces (BMIs)-a direct communication pathway between the brain and a man-made computing device. Whereas exogenous BMIs that associate volitional control of brain activity with neurofeedback have been shown to induce long lasting plasticity, endogenous BMIs that use prolonged activity-dependent stimulation--and thus may curtail the time scale that governs natural sensorimotor integration loops--have been shown to induce short lasting plasticity. Here we summarize recent findings from studies using both categories of BMIs, and discuss the fundamental principles that may underlie their operation and the longevity of the plasticity they induce. We draw comparison to plasticity mechanisms known to mediate natural sensorimotor skill learning and discuss principles of homeostatic regulation that may constrain endogenous BMI effects in the adult mammalian brain. We propose that BMIs could be designed to facilitate structural and functional plasticity for the purpose of re-organization of target brain regions and directed augmentation of sensorimotor maps, and suggest possible avenues for future work to maximize their efficacy and viability in clinical applications.
Collapse
|
31
|
Pisotta I, Perruchoud D, Ionta S. Hand-in-hand advances in biomedical engineering and sensorimotor restoration. J Neurosci Methods 2015; 246:22-9. [PMID: 25769276 DOI: 10.1016/j.jneumeth.2015.03.003] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2014] [Revised: 02/26/2015] [Accepted: 03/03/2015] [Indexed: 01/30/2023]
Abstract
BACKGROUND Living in a multisensory world entails the continuous sensory processing of environmental information in order to enact appropriate motor routines. The interaction between our body and our brain is the crucial factor for achieving such sensorimotor integration ability. Several clinical conditions dramatically affect the constant body-brain exchange, but the latest developments in biomedical engineering provide promising solutions for overcoming this communication breakdown. NEW METHOD The ultimate technological developments succeeded in transforming neuronal electrical activity into computational input for robotic devices, giving birth to the era of the so-called brain-machine interfaces. Combining rehabilitation robotics and experimental neuroscience the rise of brain-machine interfaces into clinical protocols provided the technological solution for bypassing the neural disconnection and restore sensorimotor function. RESULTS Based on these advances, the recovery of sensorimotor functionality is progressively becoming a concrete reality. However, despite the success of several recent techniques, some open issues still need to be addressed. COMPARISON WITH EXISTING METHOD(S) Typical interventions for sensorimotor deficits include pharmaceutical treatments and manual/robotic assistance in passive movements. These procedures achieve symptoms relief but their applicability to more severe disconnection pathologies is limited (e.g. spinal cord injury or amputation). CONCLUSIONS Here we review how state-of-the-art solutions in biomedical engineering are continuously increasing expectances in sensorimotor rehabilitation, as well as the current challenges especially with regards to the translation of the signals from brain-machine interfaces into sensory feedback and the incorporation of brain-machine interfaces into daily activities.
Collapse
Affiliation(s)
- Iolanda Pisotta
- Neurological and Spinal Cord Injury Rehabilitation Department A and CaRMA Lab, IRCCS Fondazione S. Lucia, Rome, Italy
| | - David Perruchoud
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology and Department of Clinical Neurosciences, University Hospital Center and University of Lausanne, Lausanne, Switzerland
| | - Silvio Ionta
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology and Department of Clinical Neurosciences, University Hospital Center and University of Lausanne, Lausanne, Switzerland.
| |
Collapse
|
32
|
Explicit memory creation during sleep demonstrates a causal role of place cells in navigation. Nat Neurosci 2015; 18:493-5. [PMID: 25751533 DOI: 10.1038/nn.3970] [Citation(s) in RCA: 155] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2013] [Accepted: 02/09/2015] [Indexed: 02/08/2023]
Abstract
Hippocampal place cells assemblies are believed to support the cognitive map, and their reactivations during sleep are thought to be involved in spatial memory consolidation. By triggering intracranial rewarding stimulations by place cell spikes during sleep, we induced an explicit memory trace, leading to a goal-directed behavior toward the place field. This demonstrates that place cells' activity during sleep still conveys relevant spatial information and that this activity is functionally significant for navigation.
Collapse
|
33
|
Anderson NR, DeVries EM. Brain Computer Interface (BCI) Tools Developed in a Clinical Environment. ACTA ACUST UNITED AC 2015. [DOI: 10.1080/1086508x.2010.11079773] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
34
|
Abstract
With the growing interdependence between medicine and technology, the prospect of connecting machines to the human brain is rapidly being realized. The field of neuroprosthetics is transitioning from the proof of concept stage to the development of advanced clinical treatments. In one area of brain-machine interfaces (BMIs) related to the motor system, also termed ‘motor neuroprosthetics’, research successes with implanted microelectrodes in animals have demonstrated immense potential for restoring motor deficits. Early human trials have also begun, with some success but also highlighting several technical challenges. Here we review the concepts and anatomy underlying motor BMI designs, review their early use in clinical applications, and offer a framework to evaluate these technologies in order to predict their eventual clinical utility. Ultimately, we hope to help neuroscience clinicians understand and participate in this burgeoning field.
Collapse
|
35
|
Zhuang KZ, Lebedev MA, Nicolelis MAL. Joint cross-correlation analysis reveals complex, time-dependent functional relationship between cortical neurons and arm electromyograms. J Neurophysiol 2014; 112:2865-87. [PMID: 25210153 DOI: 10.1152/jn.00031.2013] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Correlation between cortical activity and electromyographic (EMG) activity of limb muscles has long been a subject of neurophysiological studies, especially in terms of corticospinal connectivity. Interest in this issue has recently increased due to the development of brain-machine interfaces with output signals that mimic muscle force. For this study, three monkeys were implanted with multielectrode arrays in multiple cortical areas. One monkey performed self-timed touch pad presses, whereas the other two executed arm reaching movements. We analyzed the dynamic relationship between cortical neuronal activity and arm EMGs using a joint cross-correlation (JCC) analysis that evaluated trial-by-trial correlation as a function of time intervals within a trial. JCCs revealed transient correlations between the EMGs of multiple muscles and neural activity in motor, premotor and somatosensory cortical areas. Matching results were obtained using spike-triggered averages corrected by subtracting trial-shuffled data. Compared with spike-triggered averages, JCCs more readily revealed dynamic changes in cortico-EMG correlations. JCCs showed that correlation peaks often sharpened around movement times and broadened during delay intervals. Furthermore, JCC patterns were directionally selective for the arm-reaching task. We propose that such highly dynamic, task-dependent and distributed relationships between cortical activity and EMGs should be taken into consideration for future brain-machine interfaces that generate EMG-like signals.
Collapse
Affiliation(s)
- Katie Z Zhuang
- Department of Biomedical Engineering, Duke University, Durham, North Carolina
| | - Mikhail A Lebedev
- Department of Biomedical Engineering, Duke University, Durham, North Carolina; Department of Neurobiology, Duke University, Durham, North Carolina
| | - Miguel A L Nicolelis
- Department of Biomedical Engineering, Duke University, Durham, North Carolina; Department of Neurobiology, Duke University, Durham, North Carolina; Department of Psychology and Neuroscience, Duke University, Durham, North Carolina; Center for Neuroengineering, Duke University, Durham, North Carolina; and Edmond and Lily Safra International Institute for Neuroscience of Natal (ELS-IINN), Natal, Brazil
| |
Collapse
|
36
|
Arduin PJ, Frégnac Y, Shulz DE, Ego-Stengel V. Bidirectional control of a one-dimensional robotic actuator by operant conditioning of a single unit in rat motor cortex. Front Neurosci 2014; 8:206. [PMID: 25120417 PMCID: PMC4110947 DOI: 10.3389/fnins.2014.00206] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2013] [Accepted: 06/30/2014] [Indexed: 01/10/2023] Open
Abstract
The design of efficient neuroprosthetic devices has become a major challenge for the long-term goal of restoring autonomy to motor-impaired patients. One approach for brain control of actuators consists in decoding the activity pattern obtained by simultaneously recording large neuronal ensembles in order to predict in real-time the subject's intention, and move the prosthesis accordingly. An alternative way is to assign the output of one or a few neurons by operant conditioning to control the prosthesis with rules defined by the experimenter, and rely on the functional adaptation of these neurons during learning to reach the desired behavioral outcome. Here, several motor cortex neurons were recorded simultaneously in head-fixed awake rats and were conditioned, one at a time, to modulate their firing rate up and down in order to control the speed and direction of a one-dimensional actuator carrying a water bottle. The goal was to maintain the bottle in front of the rat's mouth, allowing it to drink. After learning, all conditioned neurons modulated their firing rate, effectively controlling the bottle position so that the drinking time was increased relative to chance. The mean firing rate averaged over all bottle trajectories depended non-linearly on position, so that the mouth position operated as an attractor. Some modifications of mean firing rate were observed in the surrounding neurons, but to a lesser extent. Notably, the conditioned neuron reacted faster and led to a better control than surrounding neurons, as calculated by using the activity of those neurons to generate simulated bottle trajectories. Our study demonstrates the feasibility, even in the rodent, of using a motor cortex neuron to control a prosthesis in real-time bidirectionally. The learning process includes modifications of the activity of neighboring cortical neurons, while the conditioned neuron selectively leads the activity patterns associated with the prosthesis control.
Collapse
Affiliation(s)
- Pierre-Jean Arduin
- Unité de Neuroscience, Information et Complexité, Centre National de la Recherche Scientifique Gif-sur-Yvette, France
| | - Yves Frégnac
- Unité de Neuroscience, Information et Complexité, Centre National de la Recherche Scientifique Gif-sur-Yvette, France
| | - Daniel E Shulz
- Unité de Neuroscience, Information et Complexité, Centre National de la Recherche Scientifique Gif-sur-Yvette, France
| | - Valérie Ego-Stengel
- Unité de Neuroscience, Information et Complexité, Centre National de la Recherche Scientifique Gif-sur-Yvette, France
| |
Collapse
|
37
|
Bensmaia SJ, Miller LE. Restoring sensorimotor function through intracortical interfaces: progress and looming challenges. Nat Rev Neurosci 2014; 15:313-25. [PMID: 24739786 DOI: 10.1038/nrn3724] [Citation(s) in RCA: 260] [Impact Index Per Article: 26.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
The loss of a limb or paralysis resulting from spinal cord injury has devastating consequences on quality of life. One approach to restoring lost sensory and motor abilities in amputees and patients with tetraplegia is to supply them with implants that provide a direct interface with the CNS. Such brain-machine interfaces might enable a patient to exert voluntary control over a prosthetic or robotic limb or over the electrically induced contractions of paralysed muscles. A parallel interface could convey sensory information about the consequences of these movements back to the patient. Recent developments in the algorithms that decode motor intention from neuronal activity and in approaches to convey sensory feedback by electrically stimulating neurons, using biomimetic and adaptation-based approaches, have shown the promise of invasive interfaces with sensorimotor cortices, although substantial challenges remain.
Collapse
Affiliation(s)
- Sliman J Bensmaia
- Department of Organismal Biology and Anatomy, and Committee on Computational Neuroscience, University of Chicago, Chicago, Illinois 60637, USA
| | - Lee E Miller
- 1] Department of Physical Medicine and Rehabilitation, and Department of Physiology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois 60611, USA. [2] Department of Biomedical Engineering, Northwestern University, Evanston, Illinois 60208, USA
| |
Collapse
|
38
|
Baranauskas G. What limits the performance of current invasive brain machine interfaces? Front Syst Neurosci 2014; 8:68. [PMID: 24808833 PMCID: PMC4010778 DOI: 10.3389/fnsys.2014.00068] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2014] [Accepted: 04/09/2014] [Indexed: 01/08/2023] Open
Abstract
The concept of a brain-machine interface (BMI) or a computer-brain interface is simple: BMI creates a communication pathway for a direct control by brain of an external device. In reality BMIs are very complex devices and only recently the increase in computing power of microprocessors enabled a boom in BMI research that continues almost unabated to this date, the high point being the insertion of electrode arrays into the brains of 5 human patients in a clinical trial run by Cyberkinetics with few other clinical tests still in progress. Meanwhile several EEG-based BMI devices (non-invasive BMIs) were launched commercially. Modern electronics and dry electrode technology made possible to drive the cost of some of these devices below few hundred dollars. However, the initial excitement of the direct control by brain waves of a computer or other equipment is dampened by large efforts required for learning, high error rates and slow response speed. All these problems are directly related to low information transfer rates typical for such EEG-based BMIs. In invasive BMIs employing multiple electrodes inserted into the brain one may expect much higher information transfer rates than in EEG-based BMIs because, in theory, each electrode provides an independent information channel. However, although invasive BMIs require more expensive equipment and have ethical problems related to the need to insert electrodes in the live brain, such financial and ethical costs are often not offset by a dramatic improvement in the information transfer rate. Thus the main topic of this review is why in invasive BMIs an apparently much larger information content obtained with multiple extracellular electrodes does not translate into much higher rates of information transfer? This paper explores possible answers to this question by concluding that more research on what movement parameters are encoded by neurons in motor cortex is needed before we can enjoy the next generation BMIs.
Collapse
Affiliation(s)
- Gytis Baranauskas
- Neurophysiology Laboratory, Neuroscience Institute, Lithuanian University of Health Sciences Kaunas, Lithuania
| |
Collapse
|
39
|
Vato A, Szymanski FD, Semprini M, Mussa-Ivaldi FA, Panzeri S. A bidirectional brain-machine interface algorithm that approximates arbitrary force-fields. PLoS One 2014; 9:e91677. [PMID: 24626393 PMCID: PMC3953591 DOI: 10.1371/journal.pone.0091677] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2013] [Accepted: 02/14/2014] [Indexed: 11/19/2022] Open
Abstract
We examine bidirectional brain-machine interfaces that control external devices in a closed loop by decoding motor cortical activity to command the device and by encoding the state of the device by delivering electrical stimuli to sensory areas. Although it is possible to design this artificial sensory-motor interaction while maintaining two independent channels of communication, here we propose a rule that closes the loop between flows of sensory and motor information in a way that approximates a desired dynamical policy expressed as a field of forces acting upon the controlled external device. We previously developed a first implementation of this approach based on linear decoding of neural activity recorded from the motor cortex into a set of forces (a force field) applied to a point mass, and on encoding of position of the point mass into patterns of electrical stimuli delivered to somatosensory areas. However, this previous algorithm had the limitation that it only worked in situations when the position-to-force map to be implemented is invertible. Here we overcome this limitation by developing a new non-linear form of the bidirectional interface that can approximate a virtually unlimited family of continuous fields. The new algorithm bases both the encoding of position information and the decoding of motor cortical activity on an explicit map between spike trains and the state space of the device computed with Multi-Dimensional-Scaling. We present a detailed computational analysis of the performance of the interface and a validation of its robustness by using synthetic neural responses in a simulated sensory-motor loop.
Collapse
Affiliation(s)
- Alessandro Vato
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Francois D. Szymanski
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Marianna Semprini
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Ferdinando A. Mussa-Ivaldi
- Department of Physiology, Northwestern University, Chicago, Illinois, United States of America
- Department of Biomedical Engineering, Northwestern University, Evanston, Illinois, United States of America
- Sensory Motor Performance Program, Rehabilitation Institute of Chicago, Chicago, Illinois, United States of America
| | - Stefano Panzeri
- Center for Neuroscience and Cognitive Systems @UniTn, Istituto Italiano di Tecnologia, Rovereto, Italy
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| |
Collapse
|
40
|
Sakurai Y, Song K, Tachibana S, Takahashi S. Volitional enhancement of firing synchrony and oscillation by neuronal operant conditioning: interaction with neurorehabilitation and brain-machine interface. Front Syst Neurosci 2014; 8:11. [PMID: 24567704 PMCID: PMC3915778 DOI: 10.3389/fnsys.2014.00011] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2013] [Accepted: 01/16/2014] [Indexed: 11/27/2022] Open
Abstract
In this review, we focus on neuronal operant conditioning in which increments in neuronal activities are directly rewarded without behaviors. We discuss the potential of this approach to elucidate neuronal plasticity for enhancing specific brain functions and its interaction with the progress in neurorehabilitation and brain-machine interfaces. The key to-be-conditioned activities that this paper emphasizes are synchronous and oscillatory firings of multiple neurons that reflect activities of cell assemblies. First, we introduce certain well-known studies on neuronal operant conditioning in which conditioned enhancements of neuronal firing were reported in animals and humans. These studies demonstrated the feasibility of volitional control over neuronal activity. Second, we refer to the recent studies on operant conditioning of synchrony and oscillation of neuronal activities. In particular, we introduce a recent study showing volitional enhancement of oscillatory activity in monkey motor cortex and our study showing selective enhancement of firing synchrony of neighboring neurons in rat hippocampus. Third, we discuss the reasons for emphasizing firing synchrony and oscillation in neuronal operant conditioning, the main reason being that they reflect the activities of cell assemblies, which have been suggested to be basic neuronal codes representing information in the brain. Finally, we discuss the interaction of neuronal operant conditioning with neurorehabilitation and brain-machine interface (BMI). We argue that synchrony and oscillation of neuronal firing are the key activities required for developing both reliable neurorehabilitation and high-performance BMI. Further, we conclude that research of neuronal operant conditioning, neurorehabilitation, BMI, and system neuroscience will produce findings applicable to these interrelated fields, and neuronal synchrony and oscillation can be a common important bridge among all of them.
Collapse
Affiliation(s)
- Yoshio Sakurai
- Department of Psychology, Graduate School of Letters, Kyoto University Kyoto, Japan
| | - Kichan Song
- Department of Psychology, Graduate School of Letters, Kyoto University Kyoto, Japan
| | - Shota Tachibana
- Department of Psychology, Graduate School of Letters, Kyoto University Kyoto, Japan
| | - Susumu Takahashi
- Laboratory of Neural Circuitry, Graduate School of Brain Science, Doshisha University Kizugawa, Japan
| |
Collapse
|
41
|
Orsborn AL, Carmena JM. Creating new functional circuits for action via brain-machine interfaces. Front Comput Neurosci 2013; 7:157. [PMID: 24204342 PMCID: PMC3817362 DOI: 10.3389/fncom.2013.00157] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2013] [Accepted: 10/20/2013] [Indexed: 11/29/2022] Open
Abstract
Brain-machine interfaces (BMIs) are an emerging technology with great promise for developing restorative therapies for those with disabilities. BMIs also create novel, well-defined functional circuits for action that are distinct from the natural sensorimotor apparatus. Closed-loop control of BMI systems can also actively engage learning and adaptation. These properties make BMIs uniquely suited to study learning of motor and non-physical, abstract skills. Recent work used motor BMIs to shed light on the neural representations of skill formation and motor adaptation. Emerging work in sensory BMIs, and other novel interface systems, also highlight the promise of using BMI systems to study fundamental questions in learning and sensorimotor control. This paper outlines the interpretation of BMIs as novel closed-loop systems and the benefits of these systems for studying learning. We review BMI learning studies, their relation to motor control, and propose future directions for this nascent field. Understanding learning in BMIs may both elucidate mechanisms of natural motor and abstract skill learning, and aid in developing the next generation of neuroprostheses.
Collapse
Affiliation(s)
- Amy L Orsborn
- 1UC Berkeley - UCSF Joint Graduate Program in Bioengineering, University of California Berkeley Berkeley, CA, USA
| | | |
Collapse
|
42
|
Abstract
Brain machine interfaces (BMI) have become important in systems neuroscience with the goal to restore motor function in paralyzed patients. We assess the current ability of BMI devices to move objects. The topics discussed include: (1) the bits of information generated by a BMI signal, (2) the limitations of including more neurons for generating a BMI signal, (3) the superiority of a BMI signal using single cells versus electroencephalography, (4) plasticity and BMI, (5) the selection of a neural code for generating BMI, (6) the suppression of body movements during BMI, and (7) the role of vision in BMI. We conclude that further research on understanding how the brain generates movement is necessary before BMI can become a reasonable option for paralyzed patients.
Collapse
|
43
|
"Master" neurons induced by operant conditioning in rat motor cortex during a brain-machine interface task. J Neurosci 2013; 33:8308-20. [PMID: 23658171 DOI: 10.1523/jneurosci.2744-12.2013] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Operant control of a prosthesis by neuronal cortical activity is one of the successful strategies for implementing brain-machine interfaces (BMI), by which the subject learns to exert a volitional control of goal-directed movements. However, it remains unknown if the induced brain circuit reorganization affects preferentially the conditioned neurons whose activity controlled the BMI actuator during training. Here, multiple extracellular single-units were recorded simultaneously in the motor cortex of head-fixed behaving rats. The firing rate of a single neuron was used to control the position of a one-dimensional actuator. Each time the firing rate crossed a predefined threshold, a water bottle moved toward the rat, until the cumulative displacement of the bottle allowed the animal to drink. After a learning period, most (88%) conditioned neurons raised their activity during the trials, such that the time to reward decreased across sessions: the conditioned neuron fired strongly, reliably and swiftly after trial onset, although no explicit instruction in the learning rule imposed a fast neuronal response. Moreover, the conditioned neuron fired significantly earlier and more strongly than nonconditioned neighboring neurons. During the first training sessions, an increase in firing rate variability was seen only for the highly conditionable neurons. This variability then decreased while the conditioning effect increased. These findings suggest that modifications during training target preferentially the neuron chosen to control the BMI, which acts then as a "master" neuron, leading in time the reconfiguration of activity in the local cortical network.
Collapse
|
44
|
Casadio M, Ranganathan R, Mussa-Ivaldi FA. The body-machine interface: a new perspective on an old theme. J Mot Behav 2013; 44:419-33. [PMID: 23237465 DOI: 10.1080/00222895.2012.700968] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Body-machine interfaces establish a way to interact with a variety of devices, allowing their users to extend the limits of their performance. Recent advances in this field, ranging from computer interfaces to bionic limbs, have had important consequences for people with movement disorders. The authors provide an overview of the basic concepts underlying the body-machine interface with special emphasis on their use for rehabilitation and for operating assistive devices. They outline the steps involved in building such an interface and highlight the critical role of body-machine interfaces in addressing theoretical issues in motor control as well as their utility in movement rehabilitation.
Collapse
Affiliation(s)
- Maura Casadio
- Sensory Motor Performance Program, Rehabilitation Institute of Chicago, Illinois 60611, USA
| | | | | |
Collapse
|
45
|
Rowland NC, Breshears J, Chang EF. Neurosurgery and the dawning age of Brain-Machine Interfaces. Surg Neurol Int 2013; 4:S11-4. [PMID: 23653884 PMCID: PMC3642748 DOI: 10.4103/2152-7806.109182] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2012] [Accepted: 12/11/2012] [Indexed: 01/01/2023] Open
Abstract
Brain–machine interfaces (BMIs) are on the horizon for clinical neurosurgery. Electrocorticography-based platforms are less invasive than implanted microelectrodes, however, the latter are unmatched in their ability to achieve fine motor control of a robotic prosthesis capable of natural human behaviors. These technologies will be crucial to restoring neural function to a large population of patients with severe neurologic impairment – including those with spinal cord injury, stroke, limb amputation, and disabling neuromuscular disorders such as amyotrophic lateral sclerosis. On the opposite end of the spectrum are neural enhancement technologies for specialized applications such as combat. An ongoing ethical dialogue is imminent as we prepare for BMI platforms to enter the neurosurgical realm of clinical management.
Collapse
Affiliation(s)
- Nathan C Rowland
- Department of Neurosurgery, 505 Parnassus Avenue, Rm M779, University of California, San Francisco, CA, USA
| | | | | |
Collapse
|
46
|
Cognitive Neuroscience: Targeting Neuroplasticity with Neural Decoding and Biofeedback. Curr Biol 2013; 23:R210-2. [DOI: 10.1016/j.cub.2013.01.015] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
47
|
Vigneswaran G, Philipp R, Lemon R, Kraskov A. M1 corticospinal mirror neurons and their role in movement suppression during action observation. Curr Biol 2013; 23:236-43. [PMID: 23290556 PMCID: PMC3566480 DOI: 10.1016/j.cub.2012.12.006] [Citation(s) in RCA: 148] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2012] [Revised: 11/12/2012] [Accepted: 12/06/2012] [Indexed: 11/17/2022]
Abstract
Evidence is accumulating that neurons in primary motor cortex (M1) respond during action observation, a property first shown for mirror neurons in monkey premotor cortex. We now show for the first time that the discharge of a major class of M1 output neuron, the pyramidal tract neuron (PTN), is modulated during observation of precision grip by a human experimenter. We recorded 132 PTNs in the hand area of two adult macaques, of which 65 (49%) showed mirror-like activity. Many (38 of 65) increased their discharge during observation (facilitation-type mirror neuron), but a substantial number (27 of 65) exhibited reduced discharge or stopped firing (suppression-type). Simultaneous recordings from arm, hand, and digit muscles confirmed the complete absence of detectable muscle activity during observation. We compared the discharge of the same population of neurons during active grasp by the monkeys. We found that facilitation neurons were only half as active for action observation as for action execution, and that suppression neurons reversed their activity pattern and were actually facilitated during execution. Thus, although many M1 output neurons are active during action observation, M1 direct input to spinal circuitry is either reduced or abolished and may not be sufficient to produce overt muscle activity.
Collapse
Affiliation(s)
- Ganesh Vigneswaran
- Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, Queen Square, London WC1N 3BG, UK
| | - Roland Philipp
- Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, Queen Square, London WC1N 3BG, UK
| | - Roger N. Lemon
- Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, Queen Square, London WC1N 3BG, UK
| | - Alexander Kraskov
- Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, Queen Square, London WC1N 3BG, UK
- Corresponding author
| |
Collapse
|
48
|
Manohar A, Flint RD, Knudsen E, Moxon KA. Decoding hindlimb movement for a brain machine interface after a complete spinal transection. PLoS One 2012; 7:e52173. [PMID: 23300606 PMCID: PMC3531410 DOI: 10.1371/journal.pone.0052173] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2012] [Accepted: 11/15/2012] [Indexed: 11/30/2022] Open
Abstract
Stereotypical locomotor movements can be made without input from the brain after a complete spinal transection. However, the restoration of functional gait requires descending modulation of spinal circuits to independently control the movement of each limb. To evaluate whether a brain-machine interface (BMI) could be used to regain conscious control over the hindlimb, rats were trained to press a pedal and the encoding of hindlimb movement was assessed using a BMI paradigm. Off-line, information encoded by neurons in the hindlimb sensorimotor cortex was assessed. Next neural population functions, or weighted representations of the neuronal activity, were used to replace the hindlimb movement as a trigger for reward in real-time (on-line decoding) in three conditions: while the animal could still press the pedal, after the pedal was removed and after a complete spinal transection. A novel representation of the motor program was learned when the animals used neural control to achieve water reward (e.g. more information was conveyed faster). After complete spinal transection, the ability of these neurons to convey information was reduced by more than 40%. However, this BMI representation was relearned over time despite a persistent reduction in the neuronal firing rate during the task. Therefore, neural control is a general feature of the motor cortex, not restricted to forelimb movements, and can be regained after spinal injury.
Collapse
Affiliation(s)
- Anitha Manohar
- School of Biomedical Engineering Science and Health Systems, Drexel University, Philadelphia, Pennsylvania, United States of America
| | - Robert D. Flint
- School of Biomedical Engineering Science and Health Systems, Drexel University, Philadelphia, Pennsylvania, United States of America
| | - Eric Knudsen
- School of Biomedical Engineering Science and Health Systems, Drexel University, Philadelphia, Pennsylvania, United States of America
| | - Karen A. Moxon
- School of Biomedical Engineering Science and Health Systems, Drexel University, Philadelphia, Pennsylvania, United States of America
- Department of Neurobiology and Anatomy, Drexel University College of Medicine, Philadelphia, Pennsylvania, United States of America
- * E-mail:
| |
Collapse
|
49
|
|
50
|
Shaikhouni A, Elder JB. Computers and neurosurgery. World Neurosurg 2012; 78:392-8. [PMID: 22985531 DOI: 10.1016/j.wneu.2012.08.020] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2012] [Accepted: 08/22/2012] [Indexed: 11/19/2022]
Abstract
At the turn of the twentieth century, the only computational device used in neurosurgical procedures was the brain of the surgeon. Today, most neurosurgical procedures rely at least in part on the use of a computer to help perform surgeries accurately and safely. The techniques that revolutionized neurosurgery were mostly developed after the 1950s. Just before that era, the transistor was invented in the late 1940s, and the integrated circuit was invented in the late 1950s. During this time, the first automated, programmable computational machines were introduced. The rapid progress in the field of neurosurgery not only occurred hand in hand with the development of modern computers, but one also can state that modern neurosurgery would not exist without computers. The focus of this article is the impact modern computers have had on the practice of neurosurgery. Neuroimaging, neuronavigation, and neuromodulation are examples of tools in the armamentarium of the modern neurosurgeon that owe each step in their evolution to progress made in computer technology. Advances in computer technology central to innovations in these fields are highlighted, with particular attention to neuroimaging. Developments over the last 10 years in areas of sensors and robotics that promise to transform the practice of neurosurgery further are discussed. Potential impacts of advances in computers related to neurosurgery in developing countries and underserved regions are also discussed. As this article illustrates, the computer, with its underlying and related technologies, is central to advances in neurosurgery over the last half century.
Collapse
Affiliation(s)
- Ammar Shaikhouni
- Department of Neurological Surgery, Wexner Medical Center, Ohio State University, Columbus, OH, USA
| | | |
Collapse
|