1
|
Awuah WA, Ahluwalia A, Darko K, Sanker V, Tan JK, Tenkorang PO, Ben-Jaafar A, Ranganathan S, Aderinto N, Mehta A, Shah MH, Lee Boon Chun K, Abdul-Rahman T, Atallah O. Bridging Minds and Machines: The Recent Advances of Brain-Computer Interfaces in Neurological and Neurosurgical Applications. World Neurosurg 2024; 189:138-153. [PMID: 38789029 DOI: 10.1016/j.wneu.2024.05.104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Revised: 05/16/2024] [Accepted: 05/17/2024] [Indexed: 05/26/2024]
Abstract
Brain-computer interfaces (BCIs), a remarkable technological advancement in neurology and neurosurgery, mark a significant leap since the inception of electroencephalography in 1924. These interfaces effectively convert central nervous system signals into commands for external devices, offering revolutionary benefits to patients with severe communication and motor impairments due to a myriad of neurological conditions like stroke, spinal cord injuries, and neurodegenerative disorders. BCIs enable these individuals to communicate and interact with their environment, using their brain signals to operate interfaces for communication and environmental control. This technology is especially crucial for those completely locked in, providing a communication lifeline where other methods fall short. The advantages of BCIs are profound, offering autonomy and an improved quality of life for patients with severe disabilities. They allow for direct interaction with various devices and prostheses, bypassing damaged or nonfunctional neural pathways. However, challenges persist, including the complexity of accurately interpreting brain signals, the need for individual calibration, and ensuring reliable, long-term use. Additionally, ethical considerations arise regarding autonomy, consent, and the potential for dependence on technology. Despite these challenges, BCIs represent a transformative development in neurotechnology, promising enhanced patient outcomes and a deeper understanding of brain-machine interfaces.
Collapse
Affiliation(s)
| | - Arjun Ahluwalia
- School of Medicine, Queen's University Belfast, Belfast, United Kingdom
| | - Kwadwo Darko
- Department of Neurosurgery, Korle Bu Teaching Hospital, Accra, Ghana
| | - Vivek Sanker
- Department of Neurosurgery, Trivandrum Medical College, India
| | - Joecelyn Kirani Tan
- Faculty of Medicine, University of St Andrews, St. Andrews, Scotland, United Kingdom.
| | | | - Adam Ben-Jaafar
- University College Dublin, School of Medicine, Belfield, Dublin, Ireland
| | - Sruthi Ranganathan
- Department of Medicine, University of Cambridge, Cambridge, United Kingdom
| | - Nicholas Aderinto
- Internal Medicine Department, LAUTECH Teaching Hospital, Ogbomoso, Nigeria
| | - Aashna Mehta
- University of Debrecen-Faculty of Medicine, Debrecen, Hungary
| | | | | | | | - Oday Atallah
- Department of Neurosurgery, Hannover Medical School, Hannover, Germany
| |
Collapse
|
2
|
Canny E, Vansteensel MJ, van der Salm SMA, Müller-Putz GR, Berezutskaya J. Boosting brain-computer interfaces with functional electrical stimulation: potential applications in people with locked-in syndrome. J Neuroeng Rehabil 2023; 20:157. [PMID: 37980536 PMCID: PMC10656959 DOI: 10.1186/s12984-023-01272-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 10/23/2023] [Indexed: 11/20/2023] Open
Abstract
Individuals with a locked-in state live with severe whole-body paralysis that limits their ability to communicate with family and loved ones. Recent advances in brain-computer interface (BCI) technology have presented a potential alternative for these people to communicate by detecting neural activity associated with attempted hand or speech movements and translating the decoded intended movements to a control signal for a computer. A technique that could potentially enrich the communication capacity of BCIs is functional electrical stimulation (FES) of paralyzed limbs and face to restore body and facial movements of paralyzed individuals, allowing to add body language and facial expression to communication BCI utterances. Here, we review the current state of the art of existing BCI and FES work in people with paralysis of body and face and propose that a combined BCI-FES approach, which has already proved successful in several applications in stroke and spinal cord injury, can provide a novel promising mode of communication for locked-in individuals.
Collapse
Affiliation(s)
- Evan Canny
- Department of Neurology and Neurosurgery, Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Mariska J Vansteensel
- Department of Neurology and Neurosurgery, Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Sandra M A van der Salm
- Department of Neurology and Neurosurgery, Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Gernot R Müller-Putz
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
| | - Julia Berezutskaya
- Department of Neurology and Neurosurgery, Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands.
| |
Collapse
|
3
|
Branco MP, Geukes SH, Aarnoutse EJ, Ramsey NF, Vansteensel MJ. Nine decades of electrocorticography: A comparison between epidural and subdural recordings. Eur J Neurosci 2023; 57:1260-1288. [PMID: 36843389 DOI: 10.1111/ejn.15941] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 02/10/2023] [Accepted: 02/18/2023] [Indexed: 02/28/2023]
Abstract
In recent years, electrocorticography (ECoG) has arisen as a neural signal recording tool in the development of clinically viable neural interfaces. ECoG electrodes are generally placed below the dura mater (subdural) but can also be placed on top of the dura (epidural). In deciding which of these modalities best suits long-term implants, complications and signal quality are important considerations. Conceptually, epidural placement may present a lower risk of complications as the dura is left intact but also a lower signal quality due to the dura acting as a signal attenuator. The extent to which complications and signal quality are affected by the dura, however, has been a matter of debate. To improve our understanding of the effects of the dura on complications and signal quality, we conducted a literature review. We inventorized the effect of the dura on signal quality, decodability and longevity of acute and chronic ECoG recordings in humans and non-human primates. Also, we compared the incidence and nature of serious complications in studies that employed epidural and subdural ECoG. Overall, we found that, even though epidural recordings exhibit attenuated signal amplitude over subdural recordings, particularly for high-density grids, the decodability of epidural recorded signals does not seem to be markedly affected. Additionally, we found that the nature of serious complications was comparable between epidural and subdural recordings. These results indicate that both epidural and subdural ECoG may be suited for long-term neural signal recordings, at least for current generations of clinical and high-density ECoG grids.
Collapse
Affiliation(s)
- Mariana P Branco
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Simon H Geukes
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Erik J Aarnoutse
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Nick F Ramsey
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| | - Mariska J Vansteensel
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
4
|
Carino-Escobar RI, Rodríguez-García ME, Carrillo-Mora P, Valdés-Cristerna R, Cantillo-Negrete J. Continuous versus discrete robotic feedback for brain-computer interfaces aimed for neurorehabilitation. Front Neurorobot 2023; 17:1015464. [PMID: 36925628 PMCID: PMC10011154 DOI: 10.3389/fnbot.2023.1015464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Accepted: 02/01/2023] [Indexed: 03/08/2023] Open
Abstract
Introduction Brain-Computer Interfaces (BCI) can allow control of external devices using motor imagery (MI) decoded from electroencephalography (EEG). Although BCI have a wide range of applications including neurorehabilitation, the low spatial resolution of EEG, coupled to the variability of cortical activations during MI, make control of BCI based on EEG a challenging task. Methods An assessment of BCI control with different feedback timing strategies was performed. Two different feedback timing strategies were compared, comprised by passive hand movement provided by a robotic hand orthosis. One of the timing strategies, the continuous, involved the partial movement of the robot immediately after the recognition of each time segment in which hand MI was performed. The other feedback, the discrete, was comprised by the entire movement of the robot after the processing of the complete MI period. Eighteen healthy participants performed two sessions of BCI training and testing, one with each feedback. Results Significantly higher BCI performance (65.4 ± 17.9% with the continuous and 62.1 ± 18.6% with the discrete feedback) and pronounced bilateral alpha and ipsilateral beta cortical activations were observed with the continuous feedback. Discussion It was hypothesized that these effects, although heterogenous across participants, were caused by the enhancement of attentional and closed-loop somatosensory processes. This is important, since a continuous feedback timing could increase the number of BCI users that can control a MI-based system or enhance cortical activations associated with neuroplasticity, important for neurorehabilitation applications.
Collapse
Affiliation(s)
- Ruben I Carino-Escobar
- Division of Research in Medical Engineering, Instituto Nacional de Rehabilitación Luis Guillermo Ibarra Ibarra, Mexico City, Mexico
| | - Martín E Rodríguez-García
- Electrical Engineering Department, Universidad Autónoma Metropolitana Unidad Iztapalapa, Mexico City, Mexico
| | - Paul Carrillo-Mora
- Division of Neuroscience, Instituto Nacional de Rehabilitación Luis Guillermo Ibarra Ibarra, Mexico City, Mexico
| | - Raquel Valdés-Cristerna
- Electrical Engineering Department, Universidad Autónoma Metropolitana Unidad Iztapalapa, Mexico City, Mexico
| | - Jessica Cantillo-Negrete
- Division of Research in Medical Engineering, Instituto Nacional de Rehabilitación Luis Guillermo Ibarra Ibarra, Mexico City, Mexico
| |
Collapse
|
5
|
Somatosensory ECoG-based brain-machine interface with electrical stimulation on medial forebrain bundle. Biomed Eng Lett 2022; 13:85-95. [PMID: 36711163 PMCID: PMC9873859 DOI: 10.1007/s13534-022-00256-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 11/21/2022] [Accepted: 12/02/2022] [Indexed: 12/24/2022] Open
Abstract
Brain-machine interface (BMI) provides an alternative route for controlling an external device with one's intention. For individuals with motor-related disability, the BMI technologies can be used to replace or restore motor functions. Therefore, BMIs for movement restoration generally decode the neural activity from the motor-related brain regions. In this study, however, we designed a BMI system that uses sensory-related neural signals for BMI combined with electrical stimulation for reward. Four-channel electrocorticographic (ECoG) signals were recorded from the whisker-related somatosensory cortex of rats and converted to extract the BMI signals to control the one-dimensional movement of a dot on the screen. At the same time, we used operant conditioning with electrical stimulation on medial forebrain bundle (MFB), which provides a virtual reward to motivate the rat to move the dot towards the desired center region. The BMI task training was performed for 7 days with ECoG recording and MFB stimulation. Animals successfully learned to move the dot location to the desired position using S1BF neural activity. This study successfully demonstrated that it is feasible to utilize the neural signals from the whisker somatosensory cortex for BMI system. In addition, the MFB electrical stimulation is effective for rats to learn the behavioral task for BMI.
Collapse
|
6
|
Li Y, Jiang Y, Lan L, Ge X, Cheng R, Zhan Y, Chen G, Shi L, Wang R, Zheng N, Yang C, Cheng JX. Optically-generated focused ultrasound for noninvasive brain stimulation with ultrahigh precision. LIGHT, SCIENCE & APPLICATIONS 2022; 11:321. [PMID: 36323662 PMCID: PMC9630534 DOI: 10.1038/s41377-022-01004-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 09/29/2022] [Accepted: 10/07/2022] [Indexed: 06/01/2023]
Abstract
High precision neuromodulation is a powerful tool to decipher neurocircuits and treat neurological diseases. Current non-invasive neuromodulation methods offer limited precision at the millimeter level. Here, we report optically-generated focused ultrasound (OFUS) for non-invasive brain stimulation with ultrahigh precision. OFUS is generated by a soft optoacoustic pad (SOAP) fabricated through embedding candle soot nanoparticles in a curved polydimethylsiloxane film. SOAP generates a transcranial ultrasound focus at 15 MHz with an ultrahigh lateral resolution of 83 µm, which is two orders of magnitude smaller than that of conventional transcranial-focused ultrasound (tFUS). Here, we show effective OFUS neurostimulation in vitro with a single ultrasound cycle. We demonstrate submillimeter transcranial stimulation of the mouse motor cortex in vivo. An acoustic energy of 0.6 mJ/cm2, four orders of magnitude less than that of tFUS, is sufficient for successful OFUS neurostimulation. OFUS offers new capabilities for neuroscience studies and disease treatments by delivering a focus with ultrahigh precision non-invasively.
Collapse
Affiliation(s)
- Yueming Li
- Department of Mechanical Engineering, Boston University, Boston, MA, 02215, USA
| | - Ying Jiang
- Graduate Program for Neuroscience, Boston University, Boston, MA, 02215, USA
- Department of Biological Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02142, USA
| | - Lu Lan
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| | - Xiaowei Ge
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| | - Ran Cheng
- Department of Chemistry, Boston University, Boston, MA, 02215, USA
| | - Yuewei Zhan
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA
| | - Guo Chen
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| | - Linli Shi
- Department of Chemistry, Boston University, Boston, MA, 02215, USA
| | - Runyu Wang
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| | - Nan Zheng
- Division of Materials Science and Engineering, Boston University, Boston, MA, 02215, USA
| | - Chen Yang
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA.
- Department of Chemistry, Boston University, Boston, MA, 02215, USA.
| | - Ji-Xin Cheng
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA.
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA.
| |
Collapse
|
7
|
Witham NS, Reiche CF, Odell T, Barth K, Chiang CH, Wang C, Dubey A, Wingel K, Devore S, Friedman D, Pesaran B, Viventi J, Solzbacher F. Flexural bending to approximate cortical forces exerted by electrocorticography (ECoG) arrays. J Neural Eng 2022; 19:10.1088/1741-2552/ac8452. [PMID: 35882223 PMCID: PMC10002477 DOI: 10.1088/1741-2552/ac8452] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 07/26/2022] [Indexed: 11/11/2022]
Abstract
Objective.The force that an electrocorticography (ECoG) array exerts on the brain manifests when it bends to match the curvature of the skull and cerebral cortex. This force can negatively impact both short-term and long-term patient outcomes. Here we provide a mechanical characterization of a novel liquid crystal polymer (LCP) ECoG array prototype to demonstrate that its thinner geometry reduces the force potentially applied to the cortex of the brain.Approach.We built a low-force flexural testing machine to measure ECoG array bending forces, calculate their effective flexural moduli, and approximate the maximum force they could exerted on the human brain.Main results.The LCP ECoG prototype was found to have a maximal force less than 20% that of any commercially available ECoG arrays that were tested. However, as a material, LCP was measured to be as much as 24× more rigid than silicone, which is traditionally used in ECoG arrays. This suggests that the lower maximal force resulted from the prototype's thinner profile (2.9×-3.25×).Significance.While decreasing material stiffness can lower the force an ECoG array exhibits, our LCP ECoG array prototype demonstrated that flexible circuit manufacturing techniques can also lower these forces by decreasing ECoG array thickness. Flexural tests of ECoG arrays are necessary to accurately assess these forces, as material properties for polymers and laminates are often scale dependent. As the polymers used are anisotropic, elastic modulus cannot be used to predict ECoG flexural behavior. Accounting for these factors, we used our four-point flexure testing procedure to quantify the forces exerted on the brain by ECoG array bending. With this experimental method, ECoG arrays can be designed to minimize force exerted on the brain, potentially improving both acute and chronic clinical utility.
Collapse
Affiliation(s)
- Nicholas S Witham
- The University of Utah, Salt Lake City, UT, United States of America
| | | | - Thomas Odell
- The University of Utah, Salt Lake City, UT, United States of America
| | - Katrina Barth
- Duke University, Durham, NC, United States of America
| | | | - Charles Wang
- Duke University, Durham, NC, United States of America
| | - Agrita Dubey
- New York University Grossman School of Medicine, New York City, NY, United States of America
| | - Katie Wingel
- New York University Grossman School of Medicine, New York City, NY, United States of America
| | - Sasha Devore
- New York University Grossman School of Medicine, New York City, NY, United States of America
| | - Daniel Friedman
- New York University Grossman School of Medicine, New York City, NY, United States of America
| | - Bijan Pesaran
- New York University, New York City, NY, United States of America
| | | | | |
Collapse
|
8
|
Mascolini A, Niazi IK, Mesin L. Non-linear optimized spatial filter for single-trial identification of movement related cortical potential. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.02.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
9
|
Ramot M, Martin A. Closed-loop neuromodulation for studying spontaneous activity and causality. Trends Cogn Sci 2022; 26:290-299. [PMID: 35210175 PMCID: PMC9396631 DOI: 10.1016/j.tics.2022.01.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 01/30/2022] [Accepted: 01/31/2022] [Indexed: 01/01/2023]
Abstract
Having established that spontaneous brain activity follows meaningful coactivation patterns and correlates with behavior, researchers have turned their attention to understanding its function and behavioral significance. We suggest closed-loop neuromodulation as a neural perturbation tool uniquely well suited for this task. Closed-loop neuromodulation has primarily been viewed as an interventionist tool to teach subjects to directly control their own brain activity. We examine an alternative operant conditioning model of closed-loop neuromodulation which, through implicit feedback, can manipulate spontaneous activity at the network level, without violating the spontaneous or endogenous nature of the signal, thereby providing a direct test of network causality.
Collapse
|
10
|
The Influence of Frequency Bands and Brain Region on ECoG-Based BMI Learning Performance. SENSORS 2021; 21:s21206729. [PMID: 34695942 PMCID: PMC8541475 DOI: 10.3390/s21206729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 09/30/2021] [Accepted: 10/06/2021] [Indexed: 11/18/2022]
Abstract
Numerous brain–machine interface (BMI) studies have shown that various frequency bands (alpha, beta, and gamma bands) can be utilized in BMI experiments and modulated as neural information for machine control after several BMI learning trial sessions. In addition to frequency range as a neural feature, various areas of the brain, such as the motor cortex or parietal cortex, have been selected as BMI target brain regions. However, although the selection of target frequency and brain region appears to be crucial in obtaining optimal BMI performance, the direct comparison of BMI learning performance as it relates to various brain regions and frequency bands has not been examined in detail. In this study, ECoG-based BMI learning performances were compared using alpha, beta, and gamma bands, respectively, in a single rodent model. Brain area dependence of learning performance was also evaluated in the frontal cortex, the motor cortex, and the parietal cortex. The findings indicated that BMI learning performance was best in the case of the gamma frequency band and worst in the alpha band (one-way ANOVA, F = 4.41, p < 0.05). In brain area dependence experiments, better BMI learning performance appears to be shown in the primary motor cortex (one-way ANOVA, F = 4.36, p < 0.05). In the frontal cortex, two out of four animals failed to learn the feeding tube control even after a maximum of 10 sessions. In conclusion, the findings reported in this study suggest that the selection of target frequency and brain region should be carefully considered when planning BMI protocols and for performing optimized BMI.
Collapse
|
11
|
Chiang CH, Wang C, Barth K, Rahimpour S, Trumpis M, Duraivel S, Rachinskiy I, Dubey A, Wingel KE, Wong M, Witham NS, Odell T, Woods V, Bent B, Doyle W, Friedman D, Bihler E, Reiche CF, Southwell DG, Haglund MM, Friedman AH, Lad SP, Devore S, Devinsky O, Solzbacher F, Pesaran B, Cogan G, Viventi J. Flexible, high-resolution thin-film electrodes for human and animal neural research. J Neural Eng 2021; 18:10.1088/1741-2552/ac02dc. [PMID: 34010815 PMCID: PMC8496685 DOI: 10.1088/1741-2552/ac02dc] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 05/19/2021] [Indexed: 11/11/2022]
Abstract
Objective.Brain functions such as perception, motor control, learning, and memory arise from the coordinated activity of neuronal assemblies distributed across multiple brain regions. While major progress has been made in understanding the function of individual neurons, circuit interactions remain poorly understood. A fundamental obstacle to deciphering circuit interactions is the limited availability of research tools to observe and manipulate the activity of large, distributed neuronal populations in humans. Here we describe the development, validation, and dissemination of flexible, high-resolution, thin-film (TF) electrodes for recording neural activity in animals and humans.Approach.We leveraged standard flexible printed-circuit manufacturing processes to build high-resolution TF electrode arrays. We used biocompatible materials to form the substrate (liquid crystal polymer; LCP), metals (Au, PtIr, and Pd), molding (medical-grade silicone), and 3D-printed housing (nylon). We designed a custom, miniaturized, digitizing headstage to reduce the number of cables required to connect to the acquisition system and reduce the distance between the electrodes and the amplifiers. A custom mechanical system enabled the electrodes and headstages to be pre-assembled prior to sterilization, minimizing the setup time required in the operating room. PtIr electrode coatings lowered impedance and enabled stimulation. High-volume, commercial manufacturing enables cost-effective production of LCP-TF electrodes in large quantities.Main Results. Our LCP-TF arrays achieve 25× higher electrode density, 20× higher channel count, and 11× reduced stiffness than conventional clinical electrodes. We validated our LCP-TF electrodes in multiple human intraoperative recording sessions and have disseminated this technology to >10 research groups. Using these arrays, we have observed high-frequency neural activity with sub-millimeter resolution.Significance.Our LCP-TF electrodes will advance human neuroscience research and improve clinical care by enabling broad access to transformative, high-resolution electrode arrays.
Collapse
Affiliation(s)
- Chia-Han Chiang
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- These authors contributed equally to this work
| | - Charles Wang
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- These authors contributed equally to this work
| | - Katrina Barth
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Shervin Rahimpour
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Michael Trumpis
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | | | - Iakov Rachinskiy
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Agrita Dubey
- Center for Neural Science, New York University, NY, NY, United States of America
| | - Katie E Wingel
- Center for Neural Science, New York University, NY, NY, United States of America
| | - Megan Wong
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Nicholas S Witham
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Thomas Odell
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Virginia Woods
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Brinnae Bent
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | - Werner Doyle
- Department of Neurosurgery, NYU Langone Medical Center, New York City, NY, United States of America
| | - Daniel Friedman
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | | | - Christopher F Reiche
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Derek G Southwell
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Michael M Haglund
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Allan H Friedman
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Shivanand P Lad
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
| | - Sasha Devore
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | - Orrin Devinsky
- Department of Neurosurgery, NYU Langone Medical Center, New York City, NY, United States of America
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
- Comprehensive Epilepsy Center, NYU Langone Health, NY, NY, United States of America
| | - Florian Solzbacher
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States of America
- Department of Materials Science & Engineering, University of Utah, Salt Lake City, UT, United States of America
| | - Bijan Pesaran
- Center for Neural Science, New York University, NY, NY, United States of America
- Department of Neurology, NYU Grossman School of Medicine, NY, NY, United States of America
| | - Gregory Cogan
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
- Department of Psychology and Neuroscience, Duke University, Durham, NC, United States of America
- Center for Cognitive Neuroscience, Duke University, Durham, NC, United States of America
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, United States of America
| | - Jonathan Viventi
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
- Department of Neurosurgery, Duke School of Medicine, Durham, NC, United States of America
- Department of Neurobiology, Duke School of Medicine, Durham, NC, United States of America
- Duke Comprehensive Epilepsy Center, Duke School of Medicine, Durham, NC, United States of America
| |
Collapse
|
12
|
Abstract
Recent advances in brain-computer interface technology to restore and rehabilitate neurologic function aim to enable persons with disabling neurologic conditions to communicate, interact with the environment, and achieve other key activities of daily living and personal goals. Here we evaluate the principles, benefits, challenges, and future directions of brain-computer interfaces in the context of neurorehabilitation. We then explore the clinical translation of these technologies and propose an approach to facilitate implementation of brain-computer interfaces for persons with neurologic disease.
Collapse
Affiliation(s)
- Michael J Young
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - David J Lin
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- School of Engineering and Carney Institute for Brain Science, Brown University, Providence, Rhode Island
- Department of Veterans Affairs Medical Center, VA RR&D Center for Neurorestoration and Neurotechnology, Providence, Rhode Island
| | - Leigh R Hochberg
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
- School of Engineering and Carney Institute for Brain Science, Brown University, Providence, Rhode Island
- Department of Veterans Affairs Medical Center, VA RR&D Center for Neurorestoration and Neurotechnology, Providence, Rhode Island
| |
Collapse
|
13
|
Abstract
This study describes a method for classifying electrocorticograms (ECoGs) based on motor imagery (MI) on the brain–computer interface (BCI) system. This method is different from the traditional feature extraction and classification method. In this paper, the proposed method employs the deep learning algorithm for extracting features and the traditional algorithm for classification. Specifically, we mainly use the convolution neural network (CNN) to extract the features from the training data and then classify those features by combing with the gradient boosting (GB) algorithm. The comprehensive study with CNN and GB algorithms will profoundly help us to obtain more feature information from brain activities, enabling us to obtain the classification results from human body actions. The performance of the proposed framework has been evaluated on the dataset I of BCI Competition III. Furthermore, the combination of deep learning and traditional algorithms provides some ideas for future research with the BCI systems.
Collapse
|
14
|
Yang J, Sawan M. From Seizure Detection to Smart and Fully Embedded Seizure Prediction Engine: A Review. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2020; 14:1008-1023. [PMID: 32822304 DOI: 10.1109/tbcas.2020.3018465] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Recent review papers have investigated seizure prediction, creating the possibility of preempting epileptic seizures. Correct seizure prediction can significantly improve the standard of living for the majority of epileptic patients, as the unpredictability of seizures is a major concern for them. Today, the development of algorithms, particularly in the field of machine learning, enables reliable and accurate seizure prediction using desktop computers. However, despite extensive research effort being devoted to developing seizure detection integrated circuits (ICs), dedicated seizure prediction ICs have not been developed yet. We believe that interdisciplinary study of system architecture, analog and digital ICs, and machine learning algorithms can promote the translation of scientific theory to a more realistic intelligent, integrated, and low-power system that can truly improve the standard of living for epileptic patients. This review explores topics ranging from signal acquisition analog circuits to classification algorithms and dedicated digital signal processing circuits for detection and prediction purposes, to provide a comprehensive and useful guideline for the construction, implementation and optimization of wearable and integrated smart seizure prediction systems.
Collapse
|
15
|
Gunduz A, Opri E, Gilron R, Kremen V, Worrell G, Starr P, Leyde K, Denison T. Adding wisdom to 'smart' bioelectronic systems: a design framework for physiologic control including practical examples. ACTA ACUST UNITED AC 2019; 2:29-41. [PMID: 33868718 PMCID: PMC7610621 DOI: 10.2217/bem-2019-0008] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
This perspective provides an overview of how risk can be effectively considered in physiological control loops that strive for semi-to-fully automated operation. The perspective first introduces the motivation, user needs and framework for the design of a physiological closed-loop controller. Then, we discuss specific risk areas and use examples from historical medical devices to illustrate the key concepts. Finally, we provide a design overview of an adaptive bidirectional brain–machine interface, currently undergoing human clinical studies, to synthesize the design principles in an exemplar application.
Collapse
Affiliation(s)
- Aysegul Gunduz
- Department of Biomedical Engineering, University of Florida Gainesville, Gainesville, FL 32611, USA
| | - Enrico Opri
- Department of Biomedical Engineering, University of Florida Gainesville, Gainesville, FL 32611, USA
| | - Ro'ee Gilron
- School of Medicine, University of California San Francisco, San Francisco CA 94143, USA
| | - Vaclav Kremen
- Department of Neurology, Mayo Clinic, Rochester, MN 55905, USA
| | - Gregory Worrell
- Department of Neurology, Mayo Clinic, Rochester, MN 55905, USA
| | - Phil Starr
- School of Medicine, University of California San Francisco, San Francisco CA 94143, USA
| | - Kent Leyde
- Cadence Neuroscience Inc, Sammamish, WA 98074, USA
| | - Timothy Denison
- Department of Engineering Science, University of Oxford, Oxford, OX3 7DQ, UK
| |
Collapse
|
16
|
Unraveling the Brain With High-Density CMOS Neural Probes: Tackling the Challenges of Neural Interfacing. ACTA ACUST UNITED AC 2019. [DOI: 10.1109/mssc.2019.2939338] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
17
|
Woods V, Trumpis M, Bent B, Palopoli-Trojani K, Chiang CH, Wang C, Yu C, Insanally MN, Froemke RC, Viventi J. Long-term recording reliability of liquid crystal polymer µECoG arrays. J Neural Eng 2018; 15:066024. [PMID: 30246690 PMCID: PMC6342453 DOI: 10.1088/1741-2552/aae39d] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE The clinical use of microsignals recorded over broad cortical regions is largely limited by the chronic reliability of the implanted interfaces. APPROACH We evaluated the chronic reliability of novel 61-channel micro-electrocorticographic (µECoG) arrays in rats chronically implanted for over one year and using accelerated aging. Devices were encapsulated with polyimide (PI) or liquid crystal polymer (LCP), and fabricated using commercial manufacturing processes. In vitro failure modes and predicted lifetimes were determined from accelerated soak testing. Successful designs were implanted epidurally over the rodent auditory cortex. Trends in baseline signal level, evoked responses and decoding performance were reported for over one year of implantation. MAIN RESULTS Devices fabricated with LCP consistently had longer in vitro lifetimes than PI encapsulation. Our accelerated aging results predicted device integrity beyond 3.4 years. Five implanted arrays showed stable performance over the entire implantation period (247-435 d). Our regression analysis showed that impedance predicted signal quality and information content only in the first 31 d of recordings and had little predictive value in the chronic phase (>31 d). In the chronic phase, site impedances slightly decreased yet decoding performance became statistically uncorrelated with impedance. We also employed an improved statistical model of spatial variation to measure sensitivity to locally varying fields, which is typically concealed in standard signal power calculations. SIGNIFICANCE These findings show that µECoG arrays can reliably perform in chronic applications in vivo for over one year, which facilitates the development of a high-density, clinically viable interface.
Collapse
Affiliation(s)
- Virginia Woods
- Department of Biomedical Engineering, Duke University, Durham, NC, United States of America
| | | | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Gui DY, Yu T, Hu Z, Yan J, Li X. Dissociable functional activities of cortical theta and beta oscillations in the lateral prefrontal cortex during intertemporal choice. Sci Rep 2018; 8:11233. [PMID: 30046152 PMCID: PMC6060123 DOI: 10.1038/s41598-018-21150-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2017] [Accepted: 12/07/2017] [Indexed: 11/23/2022] Open
Abstract
The lateral prefrontal cortex (LPFC) plays an important role in the neural networks involved in intertemporal choice. However, little is known about how the neural oscillation of LPFC functions during intertemporal choice, owing to the technical limitations of functional magnetic resonance imaging and event-related brain potential recordings. Electrocorticography (ECoG) is a novel neuroimaging technique that has high spatial and temporal resolution. In this study, we used ECoG and projected the ECoG data onto individual brain spaces to investigate human intracranial cortex activity and how neural oscillations of the LPFC impact intertemporal choice. We found that neural activity of theta oscillation was significantly higher during impulsive decisions, while beta oscillation activity was significantly higher during non-impulsive ones. Our findings suggest a functional dissociation between cortical theta and beta oscillations during decision-making processes involved in intertemporal choice, and that decision outcomes may be determined by LPFC modulation, which involves neural oscillations at different frequencies.
Collapse
Affiliation(s)
- Dan-Yang Gui
- Department of Marketing, College of Management, Shenzhen University, Shenzhen, China.,State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Tao Yu
- Beijing Institute of Functional Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing, China
| | - Zhenhong Hu
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL, 32611-6131, USA
| | - Jiaqing Yan
- College of Electrical and Control Engineering, North China University of Technology, Beijing, China
| | - Xiaoli Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China.
| |
Collapse
|
19
|
De Feo V, Boi F, Safaai H, Onken A, Panzeri S, Vato A. State-Dependent Decoding Algorithms Improve the Performance of a Bidirectional BMI in Anesthetized Rats. Front Neurosci 2017; 11:269. [PMID: 28620273 PMCID: PMC5449465 DOI: 10.3389/fnins.2017.00269] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2017] [Accepted: 04/26/2017] [Indexed: 11/24/2022] Open
Abstract
Brain-machine interfaces (BMIs) promise to improve the quality of life of patients suffering from sensory and motor disabilities by creating a direct communication channel between the brain and the external world. Yet, their performance is currently limited by the relatively small amount of information that can be decoded from neural activity recorded form the brain. We have recently proposed that such decoding performance may be improved when using state-dependent decoding algorithms that predict and discount the large component of the trial-to-trial variability of neural activity which is due to the dependence of neural responses on the network's current internal state. Here we tested this idea by using a bidirectional BMI to investigate the gain in performance arising from using a state-dependent decoding algorithm. This BMI, implemented in anesthetized rats, controlled the movement of a dynamical system using neural activity decoded from motor cortex and fed back to the brain the dynamical system's position by electrically microstimulating somatosensory cortex. We found that using state-dependent algorithms that tracked the dynamics of ongoing activity led to an increase in the amount of information extracted form neural activity by 22%, with a consequently increase in all of the indices measuring the BMI's performance in controlling the dynamical system. This suggests that state-dependent decoding algorithms may be used to enhance BMIs at moderate computational cost.
Collapse
Affiliation(s)
- Vito De Feo
- Neural Computation Laboratory, Istituto Italiano di TecnologiaRovereto, Italy
| | - Fabio Boi
- Neural Computation Laboratory, Istituto Italiano di TecnologiaRovereto, Italy.,Nets3 Laboratory, Department of Neuroscience and Brain Technologies, Istituto Italiano di TecnologiaGenova, Italy
| | - Houman Safaai
- Neural Computation Laboratory, Istituto Italiano di TecnologiaRovereto, Italy.,Department of Neurobiology, Harvard Medical SchoolBoston, MA, United States
| | - Arno Onken
- Neural Computation Laboratory, Istituto Italiano di TecnologiaRovereto, Italy
| | - Stefano Panzeri
- Neural Computation Laboratory, Istituto Italiano di TecnologiaRovereto, Italy
| | - Alessandro Vato
- Neural Computation Laboratory, Istituto Italiano di TecnologiaRovereto, Italy
| |
Collapse
|
20
|
Murphy MD, Guggenmos DJ, Bundy DT, Nudo RJ. Current Challenges Facing the Translation of Brain Computer Interfaces from Preclinical Trials to Use in Human Patients. Front Cell Neurosci 2016; 9:497. [PMID: 26778962 PMCID: PMC4702293 DOI: 10.3389/fncel.2015.00497] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2015] [Accepted: 12/10/2015] [Indexed: 12/13/2022] Open
Abstract
Current research in brain computer interface (BCI) technology is advancing beyond preclinical studies, with trials beginning in human patients. To date, these trials have been carried out with several different types of recording interfaces. The success of these devices has varied widely, but different factors such as the level of invasiveness, timescale of recorded information, and ability to maintain stable functionality of the device over a long period of time all must be considered in addition to accuracy in decoding intent when assessing the most practical type of device moving forward. Here, we discuss various approaches to BCIs, distinguishing between devices focusing on control of operations extrinsic to the subject (e.g., prosthetic limbs, computer cursors) and those focusing on control of operations intrinsic to the brain (e.g., using stimulation or external feedback), including closed-loop or adaptive devices. In this discussion, we consider the current challenges facing the translation of various types of BCI technology to eventual human application.
Collapse
Affiliation(s)
- Maxwell D Murphy
- Bioengineering Graduate Program, University of KansasLawrence, KS, USA; Department of Rehabilitation Medicine, University of Kansas Medical CenterKansas City, KS, USA
| | - David J Guggenmos
- Department of Rehabilitation Medicine, University of Kansas Medical Center Kansas City, KS, USA
| | - David T Bundy
- Department of Rehabilitation Medicine, University of Kansas Medical Center Kansas City, KS, USA
| | - Randolph J Nudo
- Department of Rehabilitation Medicine, University of Kansas Medical CenterKansas City, KS, USA; Landon Center on Aging, University of Kansas Medical CenterKansas City, KS, USA
| |
Collapse
|
21
|
Aas S, Wasserman D. Brain-computer interfaces and disability: extending embodiment, reducing stigma? JOURNAL OF MEDICAL ETHICS 2016; 42:37-40. [PMID: 26336895 DOI: 10.1136/medethics-2015-102807] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2015] [Accepted: 08/12/2015] [Indexed: 06/05/2023]
Abstract
Brain-Computer Interfaces (BCIs) now enable an individual without limb function to "move" a detached mechanical arm to perform simple actions, such as feeding herself. This technology may eventually offer almost everyone a way to move objects at a distance, by exercising cognitive control of a mechanical device. At that point, BCIs may be seen less as an assistive technology for disabled people, and more as a tool, like the internet, which can benefit all users. We will argue that BCIs will have a significant but uncertain impact on attitudes toward disabilities and on norms of bodily form and function. It may be liberating, oppressive, or both. Its impact, we argue, will depend - though not in any simple way - on whether BCIs come to be seen as parts of the body itself or as external tools.
Collapse
Affiliation(s)
- Sean Aas
- Department of Clinical Bioethics, National Institutes of Health, Bethesda, Maryland, USA
| | - David Wasserman
- Department of Clinical Bioethics, National Institutes of Health, Bethesda, Maryland, USA
| |
Collapse
|
22
|
Adewole DO, Serruya MD, Harris JP, Burrell JC, Petrov D, Chen HI, Wolf JA, Cullen DK. The Evolution of Neuroprosthetic Interfaces. Crit Rev Biomed Eng 2016; 44:123-52. [PMID: 27652455 PMCID: PMC5541680 DOI: 10.1615/critrevbiomedeng.2016017198] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
The ideal neuroprosthetic interface permits high-quality neural recording and stimulation of the nervous system while reliably providing clinical benefits over chronic periods. Although current technologies have made notable strides in this direction, significant improvements must be made to better achieve these design goals and satisfy clinical needs. This article provides an overview of the state of neuroprosthetic interfaces, starting with the design and placement of these interfaces before exploring the stimulation and recording platforms yielded from contemporary research. Finally, we outline emerging research trends in an effort to explore the potential next generation of neuroprosthetic interfaces.
Collapse
Affiliation(s)
- Dayo O. Adewole
- Center for Brain Injury and Repair, Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA, USA
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA, USA
- Penn Center for Neuroengineering and Therapeutics, University of Pennsylvania, Philadelphia, PA, USA
| | - Mijail D. Serruya
- Department of Neurology, Jefferson University, Philadelphia, PA, USA
| | - James P. Harris
- Center for Brain Injury and Repair, Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA, USA
| | - Justin C. Burrell
- Center for Brain Injury and Repair, Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA, USA
| | - Dmitriy Petrov
- Center for Brain Injury and Repair, Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA, USA
| | - H. Isaac Chen
- Center for Brain Injury and Repair, Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA, USA
- Penn Center for Neuroengineering and Therapeutics, University of Pennsylvania, Philadelphia, PA, USA
| | - John A. Wolf
- Center for Brain Injury and Repair, Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA, USA
| | - D. Kacy Cullen
- Center for Brain Injury and Repair, Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz Veterans Affairs Medical Center, Philadelphia, PA, USA
- Penn Center for Neuroengineering and Therapeutics, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
23
|
Pahwa M, Kusner M, Hacker CD, Bundy DT, Weinberger KQ, Leuthardt EC. Optimizing the Detection of Wakeful and Sleep-Like States for Future Electrocorticographic Brain Computer Interface Applications. PLoS One 2015; 10:e0142947. [PMID: 26562013 PMCID: PMC4643046 DOI: 10.1371/journal.pone.0142947] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2015] [Accepted: 10/28/2015] [Indexed: 11/18/2022] Open
Abstract
Previous studies suggest stable and robust control of a brain-computer interface (BCI) can be achieved using electrocorticography (ECoG). Translation of this technology from the laboratory to the real world requires additional methods that allow users operate their ECoG-based BCI autonomously. In such an environment, users must be able to perform all tasks currently performed by the experimenter, including manually switching the BCI system on/off. Although a simple task, it can be challenging for target users (e.g., individuals with tetraplegia) due to severe motor disability. In this study, we present an automated and practical strategy to switch a BCI system on or off based on the cognitive state of the user. Using a logistic regression, we built probabilistic models that utilized sub-dural ECoG signals from humans to estimate in pseudo real-time whether a person is awake or in a sleep-like state, and subsequently, whether to turn a BCI system on or off. Furthermore, we constrained these models to identify the optimal anatomical and spectral parameters for delineating states. Other methods exist to differentiate wake and sleep states using ECoG, but none account for practical requirements of BCI application, such as minimizing the size of an ECoG implant and predicting states in real time. Our results demonstrate that, across 4 individuals, wakeful and sleep-like states can be classified with over 80% accuracy (up to 92%) in pseudo real-time using high gamma (70-110 Hz) band limited power from only 5 electrodes (platinum discs with a diameter of 2.3 mm) located above the precentral and posterior superior temporal gyrus.
Collapse
Affiliation(s)
- Mrinal Pahwa
- Department of Biomedical Engineering, Washington University, St. Louis, Missouri, United States of America
- * E-mail:
| | - Matthew Kusner
- Department of Computer Science and Engineering, Washington University, St. Louis, Missouri, United States of America
| | - Carl D. Hacker
- Department of Biomedical Engineering, Washington University, St. Louis, Missouri, United States of America
- School of Medicine, Washington University, St. Louis, Missouri, United States of America
| | - David T. Bundy
- Department of Biomedical Engineering, Washington University, St. Louis, Missouri, United States of America
| | - Kilian Q. Weinberger
- Department of Computer Science and Engineering, Washington University, St. Louis, Missouri, United States of America
| | - Eric C. Leuthardt
- Department of Biomedical Engineering, Washington University, St. Louis, Missouri, United States of America
- School of Medicine, Washington University, St. Louis, Missouri, United States of America
- Department of Neurological Surgery, Washington University, St. Louis, Missouri, United States of America
- Center for Innovation in Neuroscience and Technology, Washington University, St. Louis, Missouri, United States of America
| |
Collapse
|
24
|
Faulkner HG, Myrden A, Li M, Mamun K, Chau T. Sequential hypothesis testing for automatic detection of task-related changes in cerebral perfusion in a brain–computer interface. Neurosci Res 2015; 100:29-38. [DOI: 10.1016/j.neures.2015.06.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2015] [Revised: 05/19/2015] [Accepted: 06/10/2015] [Indexed: 10/23/2022]
|
25
|
Ang KK, Chua KSG, Phua KS, Wang C, Chin ZY, Kuah CWK, Low W, Guan C. A Randomized Controlled Trial of EEG-Based Motor Imagery Brain-Computer Interface Robotic Rehabilitation for Stroke. Clin EEG Neurosci 2015; 46:310-20. [PMID: 24756025 DOI: 10.1177/1550059414522229] [Citation(s) in RCA: 223] [Impact Index Per Article: 24.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/21/2011] [Accepted: 01/03/2014] [Indexed: 11/16/2022]
Abstract
Electroencephalography (EEG)-based motor imagery (MI) brain-computer interface (BCI) technology has the potential to restore motor function by inducing activity-dependent brain plasticity. The purpose of this study was to investigate the efficacy of an EEG-based MI BCI system coupled with MIT-Manus shoulder-elbow robotic feedback (BCI-Manus) for subjects with chronic stroke with upper-limb hemiparesis. In this single-blind, randomized trial, 26 hemiplegic subjects (Fugl-Meyer Assessment of Motor Recovery After Stroke [FMMA] score, 4-40; 16 men; mean age, 51.4 years; mean stroke duration, 297.4 days), prescreened with the ability to use the MI BCI, were randomly allocated to BCI-Manus or Manus therapy, lasting 18 hours over 4 weeks. Efficacy was measured using upper-extremity FMMA scores at weeks 0, 2, 4 and 12. ElEG data from subjects allocated to BCI-Manus were quantified using the revised brain symmetry index (rBSI) and analyzed for correlation with the improvements in FMMA score. Eleven and 15 subjects underwent BCI-Manus and Manus therapy, respectively. One subject in the Manus group dropped out. Mean total FMMA scores at weeks 0, 2, 4, and 12 weeks improved for both groups: 26.3±10.3, 27.4±12.0, 30.8±13.8, and 31.5±13.5 for BCI-Manus and 26.6±18.9, 29.9±20.6, 32.9±21.4, and 33.9±20.2 for Manus, with no intergroup differences (P=.51). More subjects attained further gains in FMMA scores at week 12 from BCI-Manus (7 of 11 [63.6%]) than Manus (5 of 14 [35.7%]). A negative correlation was found between the rBSI and FMMA score improvement (P=.044). BCI-Manus therapy was well tolerated and not associated with adverse events. In conclusion, BCI-Manus therapy is effective and safe for arm rehabilitation after severe poststroke hemiparesis. Motor gains were comparable to those attained with intensive robotic therapy (1,040 repetitions/session) despite reduced arm exercise repetitions using EEG-based MI-triggered robotic feedback (136 repetitions/session). The correlation of rBSI with motor improvements suggests that the rBSI can be used as a prognostic measure for BCI-based stroke rehabilitation.
Collapse
Affiliation(s)
- Kai Keng Ang
- Institute for Infocomm and Research, Agency of Science, Technology and Research, Singapore
| | - Karen Sui Geok Chua
- Department of Rehabilitation Medicine, Tan Tock Seng Hospital Rehabilitation Centre, Singapore
| | - Kok Soon Phua
- Institute for Infocomm and Research, Agency of Science, Technology and Research, Singapore
| | - Chuanchu Wang
- Institute for Infocomm and Research, Agency of Science, Technology and Research, Singapore
| | - Zheng Yang Chin
- Institute for Infocomm and Research, Agency of Science, Technology and Research, Singapore
| | | | - Wilson Low
- Clinical Research Unit, Tan Tock Seng Hospital, Singapore
| | - Cuntai Guan
- Institute for Infocomm and Research, Agency of Science, Technology and Research, Singapore
| |
Collapse
|
26
|
Cano-de-la-Cuerda R, Molero-Sánchez A, Carratalá-Tejada M, Alguacil-Diego I, Molina-Rueda F, Miangolarra-Page J, Torricelli D. Theories and control models and motor learning: Clinical applications in neurorehabilitation. NEUROLOGÍA (ENGLISH EDITION) 2015. [DOI: 10.1016/j.nrleng.2011.12.012] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
|
27
|
|
28
|
Gharabaghi A, Naros G, Khademi F, Jesser J, Spüler M, Walter A, Bogdan M, Rosenstiel W, Birbaumer N. Learned self-regulation of the lesioned brain with epidural electrocorticography. Front Behav Neurosci 2014; 8:429. [PMID: 25538591 PMCID: PMC4260503 DOI: 10.3389/fnbeh.2014.00429] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2014] [Accepted: 11/24/2014] [Indexed: 11/29/2022] Open
Abstract
Introduction: Different techniques for neurofeedback of voluntary brain activations are currently being explored for clinical application in brain disorders. One of the most frequently used approaches is the self-regulation of oscillatory signals recorded with electroencephalography (EEG). Many patients are, however, unable to achieve sufficient voluntary control of brain activity. This could be due to the specific anatomical and physiological changes of the patient’s brain after the lesion, as well as to methodological issues related to the technique chosen for recording brain signals. Methods: A patient with an extended ischemic lesion of the cortex did not gain volitional control of sensorimotor oscillations when using a standard EEG-based approach. We provided him with neurofeedback of his brain activity from the epidural space by electrocorticography (ECoG). Results: Ipsilesional epidural recordings of field potentials facilitated self-regulation of brain oscillations in an online closed-loop paradigm and allowed reliable neurofeedback training for a period of 4 weeks. Conclusion: Epidural implants may decode and train brain activity even when the cortical physiology is distorted following severe brain injury. Such practice would allow for reinforcement learning of preserved neural networks and may well provide restorative tools for those patients who are severely afflicted.
Collapse
Affiliation(s)
- Alireza Gharabaghi
- Division of Functional and Restorative Neurosurgery and Division of Translational Neurosurgery, Department of Neurosurgery, Eberhard Karls University Tuebingen Tuebingen, Germany ; Neuroprosthetics Research Group, Werner Reichardt Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen Tuebingen, Germany
| | - Georgios Naros
- Division of Functional and Restorative Neurosurgery and Division of Translational Neurosurgery, Department of Neurosurgery, Eberhard Karls University Tuebingen Tuebingen, Germany ; Neuroprosthetics Research Group, Werner Reichardt Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen Tuebingen, Germany
| | - Fatemeh Khademi
- Division of Functional and Restorative Neurosurgery and Division of Translational Neurosurgery, Department of Neurosurgery, Eberhard Karls University Tuebingen Tuebingen, Germany ; Neuroprosthetics Research Group, Werner Reichardt Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen Tuebingen, Germany
| | - Jessica Jesser
- Division of Functional and Restorative Neurosurgery and Division of Translational Neurosurgery, Department of Neurosurgery, Eberhard Karls University Tuebingen Tuebingen, Germany ; Neuroprosthetics Research Group, Werner Reichardt Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen Tuebingen, Germany
| | - Martin Spüler
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University Tuebingen Tuebingen, Germany
| | - Armin Walter
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University Tuebingen Tuebingen, Germany
| | - Martin Bogdan
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University Tuebingen Tuebingen, Germany ; Department of Computer Engineering, University of Leipzig Leipzig, Germany
| | - Wolfgang Rosenstiel
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University Tuebingen Tuebingen, Germany
| | - Niels Birbaumer
- Institute for Medical Psychology and Behavioural Neurobiology, Eberhard Karls University Tuebingen Tuebingen, Germany ; Ospedale San Camillo, IRCCS Venice, Italy ; DZD, Eberhard Karls University Tuebingen Tuebingen, Germany
| |
Collapse
|
29
|
Abstract
With the growing interdependence between medicine and technology, the prospect of connecting machines to the human brain is rapidly being realized. The field of neuroprosthetics is transitioning from the proof of concept stage to the development of advanced clinical treatments. In one area of brain-machine interfaces (BMIs) related to the motor system, also termed ‘motor neuroprosthetics’, research successes with implanted microelectrodes in animals have demonstrated immense potential for restoring motor deficits. Early human trials have also begun, with some success but also highlighting several technical challenges. Here we review the concepts and anatomy underlying motor BMI designs, review their early use in clinical applications, and offer a framework to evaluate these technologies in order to predict their eventual clinical utility. Ultimately, we hope to help neuroscience clinicians understand and participate in this burgeoning field.
Collapse
|
30
|
Frey SH, Hansen M, Marchal N. Grasping with the Press of a Button: Grasp-selective Responses in the Human Anterior Intraparietal Sulcus Depend on Nonarbitrary Causal Relationships between Hand Movements and End-effector Actions. J Cogn Neurosci 2014; 27:1146-60. [PMID: 25436672 DOI: 10.1162/jocn_a_00766] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
Evidence implicates ventral parieto-premotor cortices in representing the goal of grasping independent of the movements or effectors involved [Umilta, M. A., Escola, L., Intskirveli, I., Grammont, F., Rochat, M., Caruana, F., et al. When pliers become fingers in the monkey motor system. Proceedings of the National Academy of Sciences, U.S.A., 105, 2209-2213, 2008; Tunik, E., Frey, S. H., & Grafton, S. T. Virtual lesions of the anterior intraparietal area disrupt goal-dependent on-line adjustments of grasp. Nature Neuroscience, 8, 505-511, 2005]. Modern technologies that enable arbitrary causal relationships between hand movements and tool actions provide a strong test of this hypothesis. We capitalized on this unique opportunity by recording activity with fMRI during tasks in which healthy adults performed goal-directed reach and grasp actions manually or by depressing buttons to initiate these same behaviors in a remotely located robotic arm (arbitrary causal relationship). As shown previously [Binkofski, F., Dohle, C., Posse, S., Stephan, K. M., Hefter, H., Seitz, R. J., et al. Human anterior intraparietal area subserves prehension: A combined lesion and functional MRI activation study. Neurology, 50, 1253-1259, 1998], we detected greater activity in the vicinity of the anterior intraparietal sulcus (aIPS) during manual grasp versus reach. In contrast to prior studies involving tools controlled by nonarbitrarily related hand movements [Gallivan, J. P., McLean, D. A., Valyear, K. F., & Culham, J. C. Decoding the neural mechanisms of human tool use. Elife, 2, e00425, 2013; Jacobs, S., Danielmeier, C., & Frey, S. H. Human anterior intraparietal and ventral premotor cortices support representations of grasping with the hand or a novel tool. Journal of Cognitive Neuroscience, 22, 2594-2608, 2010], however, responses within the aIPS and premotor cortex exhibited no evidence of selectivity for grasp when participants employed the robot. Instead, these regions showed comparable increases in activity during both the reach and grasp conditions. Despite equivalent sensorimotor demands, the right cerebellar hemisphere displayed greater activity when participants initiated the robot's actions versus when they pressed a button known to be nonfunctional and watched the very same actions undertaken autonomously. This supports the hypothesis that the cerebellum predicts the forthcoming sensory consequences of volitional actions [Blakemore, S. J., Frith, C. D., & Wolpert, D. M. The cerebellum is involved in predicting the sensory consequences of action. NeuroReport, 12, 1879-1884, 2001]. We conclude that grasp-selective responses in the human aIPS and premotor cortex depend on the existence of nonarbitrary causal relationships between hand movements and end-effector actions.
Collapse
|
31
|
Abstract
A number of studies in tetraplegic humans and healthy nonhuman primates (NHPs) have shown that neuronal activity from reach-related cortical areas can be used to predict reach intentions using brain-machine interfaces (BMIs) and therefore assist tetraplegic patients by controlling external devices (e.g., robotic limbs and computer cursors). However, to our knowledge, there have been no studies that have applied BMIs to eye movement areas to decode intended eye movements. In this study, we recorded the activity from populations of neurons from the lateral intraparietal area (LIP), a cortical node in the NHP saccade system. Eye movement plans were predicted in real time using Bayesian inference from small ensembles of LIP neurons without the animal making an eye movement. Learning, defined as an increase in the prediction accuracy, occurred at the level of neuronal ensembles, particularly for difficult predictions. Population learning had two components: an update of the parameters of the BMI based on its history and a change in the responses of individual neurons. These results provide strong evidence that the responses of neuronal ensembles can be shaped with respect to a cost function, here the prediction accuracy of the BMI. Furthermore, eye movement plans could be decoded without the animals emitting any actual eye movements and could be used to control the position of a cursor on a computer screen. These findings show that BMIs for eye movements are promising aids for assisting paralyzed patients.
Collapse
|
32
|
Gharabaghi A, Naros G, Walter A, Roth A, Bogdan M, Rosenstiel W, Mehring C, Birbaumer N. Epidural electrocorticography of phantom hand movement following long-term upper-limb amputation. Front Hum Neurosci 2014; 8:285. [PMID: 24834047 PMCID: PMC4018546 DOI: 10.3389/fnhum.2014.00285] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2013] [Accepted: 04/17/2014] [Indexed: 11/13/2022] Open
Abstract
INTRODUCTION Prostheses for upper-limb amputees are currently controlled by either myoelectric or peripheral neural signals. Performance and dexterity of these devices is still limited, particularly when it comes to controlling hand function. Movement-related brain activity might serve as a complementary bio-signal for motor control of hand prosthesis. METHODS We introduced a methodology to implant a cortical interface without direct exposure of the brain surface in an upper-limb amputee. This bi-directional interface enabled us to explore the cortical physiology following long-term transhumeral amputation. In addition, we investigated neurofeedback of electrocorticographic brain activity related to the patient's motor imagery to open his missing hand, i.e., phantom hand movement, for real-time control of a virtual hand prosthesis. RESULTS Both event-related brain activity and cortical stimulation revealed mutually overlapping cortical representations of the phantom hand. Phantom hand movements could be robustly classified and the patient required only three training sessions to gain reliable control of the virtual hand prosthesis in an online closed-loop paradigm that discriminated between hand opening and rest. CONCLUSION Epidural implants may constitute a powerful and safe alternative communication pathway between the brain and external devices for upper-limb amputees, thereby facilitating the integrated use of different signal sources for more intuitive and specific control of multi-functional devices in clinical use.
Collapse
Affiliation(s)
- Alireza Gharabaghi
- Division of Functional and Restorative Neurosurgery and Division of Translational Neurosurgery, Department of Neurosurgery, Eberhard Karls University of Tübingen Tübingen, Germany ; Neuroprosthetics Research Group, Werner Reichardt Centre for Integrative Neuroscience, Eberhard Karls University of Tübingen Tübingen, Germany
| | - Georgios Naros
- Division of Functional and Restorative Neurosurgery and Division of Translational Neurosurgery, Department of Neurosurgery, Eberhard Karls University of Tübingen Tübingen, Germany ; Neuroprosthetics Research Group, Werner Reichardt Centre for Integrative Neuroscience, Eberhard Karls University of Tübingen Tübingen, Germany
| | - Armin Walter
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University of Tübingen Tübingen, Germany
| | - Alexander Roth
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University of Tübingen Tübingen, Germany
| | - Martin Bogdan
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University of Tübingen Tübingen, Germany ; Department of Computer Engineering, University of Leipzig Leipzig, Germany
| | - Wolfgang Rosenstiel
- Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University of Tübingen Tübingen, Germany
| | - Carsten Mehring
- Institute for Biology III, Albert-Ludwigs-University Freiburg im Breisgau, Germany
| | - Niels Birbaumer
- Institute of Medical Psychology and Behavioural Neurobiology, Eberhard Karls University of Tübingen Tübingen, Germany
| |
Collapse
|
33
|
Bensch M, Martens S, Halder S, Hill J, Nijboer F, Ramos A, Birbaumer N, Bogdan M, Kotchoubey B, Rosenstiel W, Schölkopf B, Gharabaghi A. Assessing attention and cognitive function in completely locked-in state with event-related brain potentials and epidural electrocorticography. J Neural Eng 2014; 11:026006. [PMID: 24556584 DOI: 10.1088/1741-2560/11/2/026006] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Patients in the completely locked-in state (CLIS), due to, for example, amyotrophic lateral sclerosis (ALS), no longer possess voluntary muscle control. Assessing attention and cognitive function in these patients during the course of the disease is a challenging but essential task for both nursing staff and physicians. APPROACH An electrophysiological cognition test battery, including auditory and semantic stimuli, was applied in a late-stage ALS patient at four different time points during a six-month epidural electrocorticography (ECoG) recording period. Event-related cortical potentials (ERP), together with changes in the ECoG signal spectrum, were recorded via 128 channels that partially covered the left frontal, temporal and parietal cortex. MAIN RESULTS Auditory but not semantic stimuli induced significant and reproducible ERP projecting to specific temporal and parietal cortical areas. N1/P2 responses could be detected throughout the whole study period. The highest P3 ERP was measured immediately after the patient's last communication through voluntary muscle control, which was paralleled by low theta and high gamma spectral power. Three months after the patient's last communication, i.e., in the CLIS, P3 responses could no longer be detected. At the same time, increased activity in low-frequency bands and a sharp drop of gamma spectral power were recorded. SIGNIFICANCE Cortical electrophysiological measures indicate at least partially intact attention and cognitive function during sparse volitional motor control for communication. Although the P3 ERP and frequency-specific changes in the ECoG spectrum may serve as indicators for CLIS, a close-meshed monitoring will be required to define the exact time point of the transition.
Collapse
Affiliation(s)
- Michael Bensch
- Division of Functional and Restorative Neurosurgery & Division of Translational Neurosurgery, Department of Neurosurgery, Eberhard Karls University Tuebingen, Germany. Department of Computer Engineering, Wilhelm-Schickard Institute for Computer Science, Eberhard Karls University Tuebingen, Germany
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
34
|
Bundy DT, Zellmer E, Gaona CM, Sharma M, Szrama N, Hacker C, Freudenburg ZV, Daitch A, Moran DW, Leuthardt EC. Characterization of the effects of the human dura on macro- and micro-electrocorticographic recordings. J Neural Eng 2014; 11:016006. [DOI: 10.1088/1741-2560/11/1/016006] [Citation(s) in RCA: 46] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
35
|
Rudà R, Bello L, Duffau H, Soffietti R. Seizures in low-grade gliomas: natural history, pathogenesis, and outcome after treatments. Neuro Oncol 2013; 14 Suppl 4:iv55-64. [PMID: 23095831 DOI: 10.1093/neuonc/nos199] [Citation(s) in RCA: 161] [Impact Index Per Article: 14.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
Seizures represent a common symptom in low-grade gliomas; when uncontrolled, they significantly contribute to patient morbidity and negatively impact quality of life. Tumor location and histology influence the risk for epilepsy. The pathogenesis of tumor-related epilepsy is multifactorial and may differ among tumor histologies (glioneuronal tumors vs diffuse grade II gliomas). Gross total resection is the strongest predictor of seizure freedom in addition to clinical factors, such as preoperative seizure duration, type, and control with antiepileptic drugs (AEDs). Epilepsy surgery may improve seizure control. Radiotherapy and chemotherapy with alkylating agents (procarbazine + CCNU+ vincristine, temozolomide) are effective in reducing the frequency of seizures in patients with pharmacoresistant epilepsy. Newer AEDs (levetiracetam, topiramate, lacosamide) seem to be better tolerated than the old AEDs (phenobarbital, phenytoin, carbamazepine), but there is lack of evidence regarding their superiority in terms of efficacy.
Collapse
Affiliation(s)
- Roberta Rudà
- Department of Neuro-Oncology, University of Turin and San Giovanni Battista Hospital, Turin, Italy.
| | | | | | | |
Collapse
|
36
|
Rowland NC, Breshears J, Chang EF. Neurosurgery and the dawning age of Brain-Machine Interfaces. Surg Neurol Int 2013; 4:S11-4. [PMID: 23653884 PMCID: PMC3642748 DOI: 10.4103/2152-7806.109182] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2012] [Accepted: 12/11/2012] [Indexed: 01/01/2023] Open
Abstract
Brain–machine interfaces (BMIs) are on the horizon for clinical neurosurgery. Electrocorticography-based platforms are less invasive than implanted microelectrodes, however, the latter are unmatched in their ability to achieve fine motor control of a robotic prosthesis capable of natural human behaviors. These technologies will be crucial to restoring neural function to a large population of patients with severe neurologic impairment – including those with spinal cord injury, stroke, limb amputation, and disabling neuromuscular disorders such as amyotrophic lateral sclerosis. On the opposite end of the spectrum are neural enhancement technologies for specialized applications such as combat. An ongoing ethical dialogue is imminent as we prepare for BMI platforms to enter the neurosurgical realm of clinical management.
Collapse
Affiliation(s)
- Nathan C Rowland
- Department of Neurosurgery, 505 Parnassus Avenue, Rm M779, University of California, San Francisco, CA, USA
| | | | | |
Collapse
|
37
|
Marmarelis VZ, Shin DC, Hampson RE, Deadwyler SA, Song D, Berger TW. Design of optimal stimulation patterns for neuronal ensembles based on Volterra-type hierarchical modeling. J Neural Eng 2012; 9:066003. [PMID: 23075519 DOI: 10.1088/1741-2560/9/6/066003] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
This paper presents a general methodology for the optimal design of stimulation patterns applied to neuronal ensembles in order to elicit a desired effect. The methodology follows a variant of the hierarchical Volterra modeling approach that utilizes input-output data to construct predictive models that describe the effects of interactions among multiple input events in an ascending order of interaction complexity. The illustrative example presented in this paper concerns the multi-unit activity of CA1 neurons in the hippocampus of a rodent performing a learned delayed-nonmatch-to-sample (DNMS) task. The multi-unit activity of the hippocampal CA1 neurons is recorded via chronically implanted multi-electrode arrays during this task. The obtained model quantifies the likelihood of having correct performance of the specific task for a given multi-unit (spatiotemporal) activity pattern of a CA1 neuronal ensemble during the 'sample presentation' phase of the DNMS task. The model can be used to determine computationally (off-line) the 'optimal' multi-unit stimulation pattern that maximizes the likelihood of inducing the correct performance of the DNMS task. Our working hypothesis is that application of this optimal stimulation pattern will enhance performance of the DNMS task due to enhancement of memory formation and storage during the 'sample presentation' phase of the task.
Collapse
Affiliation(s)
- V Z Marmarelis
- Department of Biomedical Engineering and the Biomedical Simulations Resource, University of Southern California, Los Angeles, CA 90089, USA.
| | | | | | | | | | | |
Collapse
|
38
|
Andersson P, Pluim JPW, Viergever MA, Ramsey NF. Navigation of a telepresence robot via covert visuospatial attention and real-time fMRI. Brain Topogr 2012; 26:177-85. [PMID: 22965825 PMCID: PMC3536975 DOI: 10.1007/s10548-012-0252-z] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2012] [Accepted: 08/17/2012] [Indexed: 11/27/2022]
Abstract
Brain-computer interfaces (BCIs) allow people with severe neurological impairment and without ability to control their muscles to regain some control over their environment. The BCI user performs a mental task to regulate brain activity, which is measured and translated into commands controlling some external device. We here show that healthy participants are capable of navigating a robot by covertly shifting their visuospatial attention. Covert Visuospatial Attention (COVISA) constitutes a very intuitive brain function for spatial navigation and does not depend on presented stimuli or on eye movements. Our robot is equipped with motors and a camera that sends visual feedback to the user who can navigate it from a remote location. We used an ultrahigh field MRI scanner (7 Tesla) to obtain fMRI signals that were decoded in real time using a support vector machine. Four healthy subjects with virtually no training succeeded in navigating the robot to at least three of four target locations. Our results thus show that with COVISA BCI, realtime robot navigation can be achieved. Since the magnitude of the fMRI signal has been shown to correlate well with the magnitude of spectral power changes in the gamma frequency band in signals measured by intracranial electrodes, the COVISA concept may in future translate to intracranial application in severely paralyzed people.
Collapse
Affiliation(s)
- Patrik Andersson
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands.
| | | | | | | |
Collapse
|
39
|
Cipresso P, Carelli L, Solca F, Meazzi D, Meriggi P, Poletti B, Lulé D, Ludolph AC, Silani V, Riva G. The use of P300-based BCIs in amyotrophic lateral sclerosis: from augmentative and alternative communication to cognitive assessment. Brain Behav 2012; 2:479-98. [PMID: 22950051 PMCID: PMC3432970 DOI: 10.1002/brb3.57] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2011] [Revised: 03/06/2012] [Accepted: 03/13/2012] [Indexed: 12/11/2022] Open
Abstract
The use of augmentative and alternative communication (AAC) tools in patients with amyotrophic lateral sclerosis (ALS), as effective means to compensate for the progressive loss of verbal and gestural communication, has been deeply investigated in the recent literature. The development of advanced AAC systems, such as eye-tracking (ET) and brain-computer interface (BCI) devices, allowed to bypass the important motor difficulties present in ALS patients. In particular, BCIs could be used in moderate to severe stages of the disease, since they do not require preserved ocular-motor ability, which is necessary for ET applications. Furthermore, some studies have proved the reliability of BCIs, regardless of the severity of the disease and the level of physical decline. However, the use of BCI in ALS patients still shows some limitations, related to both technical and neuropsychological issues. In particular, a range of cognitive deficits in most ALS patients have been observed. At the moment, no effective verbal-motor free measures are available for the evaluation of ALS patients' cognitive integrity; BCIs could offer a new possibility to administer cognitive tasks without the need of verbal or motor responses, as highlighted by preliminary studies in this field. In this review, we outline the essential features of BCIs systems, considering advantages and challenges of these tools with regard to ALS patients and the main applications developed in this field. We then outline the main findings with regard to cognitive deficits observed in ALS and some preliminary attempts to evaluate them by means of BCIs. The definition of specific cognitive profiles could help to draw flexible approaches tailored on patients' needs. It could improve BCIs efficacy and reduce patients' efforts. Finally, we handle the open question, represented by the use of BCIs with totally locked in patients, who seem unable to reliably learn to use such tool.
Collapse
Affiliation(s)
- Pietro Cipresso
- Applied Technology for Neuro‐Psychology Lab, IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Laura Carelli
- Department of Neurology and Laboratory of Neuroscience ‐ “Dino Ferrari” Center ‐ Università degli Studi di Milano ‐ IRCCS Istituto Auxologico Italiano, Milano, Italy
| | - Federica Solca
- Department of Neurology and Laboratory of Neuroscience ‐ “Dino Ferrari” Center ‐ Università degli Studi di Milano ‐ IRCCS Istituto Auxologico Italiano, Milano, Italy
| | - Daniela Meazzi
- Applied Technology for Neuro‐Psychology Lab, IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Paolo Meriggi
- Polo Tecnologico–Biomedical Technology Department, Fondazione Don Carlo Gnocchi Onlus, Milano, Italy
| | - Barbara Poletti
- Department of Neurology and Laboratory of Neuroscience ‐ “Dino Ferrari” Center ‐ Università degli Studi di Milano ‐ IRCCS Istituto Auxologico Italiano, Milano, Italy
| | - Dorothée Lulé
- Department of Neurology ‐ University of Ulm, Ulm, Germany
| | | | - Vincenzo Silani
- Department of Neurology and Laboratory of Neuroscience ‐ “Dino Ferrari” Center ‐ Università degli Studi di Milano ‐ IRCCS Istituto Auxologico Italiano, Milano, Italy
| | - Giuseppe Riva
- Applied Technology for Neuro‐Psychology Lab, IRCCS Istituto Auxologico Italiano, Milan, Italy
| |
Collapse
|
40
|
Gwin JT, Ferris DP. An EEG-based study of discrete isometric and isotonic human lower limb muscle contractions. J Neuroeng Rehabil 2012; 9:35. [PMID: 22682644 PMCID: PMC3476535 DOI: 10.1186/1743-0003-9-35] [Citation(s) in RCA: 56] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2011] [Accepted: 06/09/2012] [Indexed: 11/28/2022] Open
Abstract
Background Electroencephalography (EEG) combined with independent component analysis enables functional neuroimaging in dynamic environments including during human locomotion. This type of functional neuroimaging could be a powerful tool for neurological rehabilitation. It could enable clinicians to monitor changes in motor control related cortical dynamics associated with a therapeutic intervention, and it could facilitate noninvasive electrocortical control of devices for assisting limb movement to stimulate activity dependent plasticity. Understanding the relationship between electrocortical dynamics and muscle activity will be helpful for incorporating EEG-based functional neuroimaging into clinical practice. The goal of this study was to use independent component analysis of high-density EEG to test whether we could relate electrocortical dynamics to lower limb muscle activation in a constrained motor task. A secondary goal was to assess the trial-by-trial consistency of the electrocortical dynamics by decoding the type of muscle action. Methods We recorded 264-channel EEG while 8 neurologically intact subjects performed isometric and isotonic, knee and ankle exercises at two different effort levels. Adaptive mixture independent component analysis (AMICA) parsed EEG into models of underlying source signals. We generated spectrograms for all electrocortical source signals and used a naïve Bayesian classifier to decode exercise type from trial-by-trial time-frequency data. Results AMICA captured different electrocortical source distributions for ankle and knee tasks. The fit of single-trial EEG to these models distinguished knee from ankle tasks with 80% accuracy. Electrocortical spectral modulations in the supplementary motor area were significantly different for isometric and isotonic tasks (p < 0.05). Isometric contractions elicited an event related desynchronization (ERD) in the α-band (8–12 Hz) and β-band (12–30 Hz) at joint torque onset and offset. Isotonic contractions elicited a sustained α- and β-band ERD throughout the trial. Classifiers based on supplementary motor area sources achieved a 4-way classification accuracy of 69% while classifiers based on electrocortical sources in multiple brain regions achieved a 4-way classification accuracy of 87%. Conclusions Independent component analysis of EEG reveals unique spatial and spectro-temporal electrocortical properties for different lower limb motor tasks. Using a broad distribution of electrocortical signals may improve classification of human lower limb movements from single-trial EEG.
Collapse
Affiliation(s)
- Joseph T Gwin
- Human Neuromechanics Laboratory, School of Kinesiology, University of Michigan, Ann Arbor, MI, USA.
| | | |
Collapse
|
41
|
van Gerven MAJ, Chao ZC, Heskes T. On the decoding of intracranial data using sparse orthonormalized partial least squares. J Neural Eng 2012; 9:026017. [PMID: 22414639 DOI: 10.1088/1741-2560/9/2/026017] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
It has recently been shown that robust decoding of motor output from electrocorticogram signals in monkeys over prolonged periods of time has become feasible (Chao et al 2010 Front. Neuroeng. 3 1-10). In order to achieve these results, multivariate partial least-squares (PLS) regression was used. PLS uses a set of latent variables, referred to as components, to model the relationship between the input and the output data and is known to handle high-dimensional and possibly strongly correlated inputs and outputs well. We developed a new decoding method called sparse orthonormalized partial least squares (SOPLS) which was tested on a subset of the data used in Chao et al (2010) (freely obtainable from neurotycho.org (Nagasaka et al 2011 PLoS ONE 6 e22561)). We show that SOPLS reaches the same decoding performance as PLS using just two sparse components which can each be interpreted as encoding particular combinations of motor parameters. Furthermore, the sparse solution afforded by the SOPLS model allowed us to show the functional involvement of beta and gamma band responses in premotor and motor cortex for predicting the first component. Based on the literature, we conjecture that this first component is involved in the encoding of movement direction. Hence, the sparse and compact representation afforded by the SOPLS model facilitates interpretation of which spectral, spatial and temporal components are involved in successful decoding. These advantages make the proposed decoding method an important new tool in neuroprosthetics.
Collapse
Affiliation(s)
- Marcel A J van Gerven
- Radboud University Nijmegen, Donders Institute for Brain, Cognition and Behaviour, Donders Centre for Cognition, Montessorilaan 3, 6500 HE Nijmegen, The Netherlands.
| | | | | |
Collapse
|
42
|
Shih JJ, Krusienski DJ, Wolpaw JR. Brain-computer interfaces in medicine. Mayo Clin Proc 2012; 87:268-79. [PMID: 22325364 PMCID: PMC3497935 DOI: 10.1016/j.mayocp.2011.12.008] [Citation(s) in RCA: 218] [Impact Index Per Article: 18.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/12/2011] [Revised: 11/19/2011] [Accepted: 12/05/2011] [Indexed: 11/20/2022]
Abstract
Brain-computer interfaces (BCIs) acquire brain signals, analyze them, and translate them into commands that are relayed to output devices that carry out desired actions. BCIs do not use normal neuromuscular output pathways. The main goal of BCI is to replace or restore useful function to people disabled by neuromuscular disorders such as amyotrophic lateral sclerosis, cerebral palsy, stroke, or spinal cord injury. From initial demonstrations of electroencephalography-based spelling and single-neuron-based device control, researchers have gone on to use electroencephalographic, intracortical, electrocorticographic, and other brain signals for increasingly complex control of cursors, robotic arms, prostheses, wheelchairs, and other devices. Brain-computer interfaces may also prove useful for rehabilitation after stroke and for other disorders. In the future, they might augment the performance of surgeons or other medical professionals. Brain-computer interface technology is the focus of a rapidly growing research and development enterprise that is greatly exciting scientists, engineers, clinicians, and the public in general. Its future achievements will depend on advances in 3 crucial areas. Brain-computer interfaces need signal-acquisition hardware that is convenient, portable, safe, and able to function in all environments. Brain-computer interface systems need to be validated in long-term studies of real-world use by people with severe disabilities, and effective and viable models for their widespread dissemination must be implemented. Finally, the day-to-day and moment-to-moment reliability of BCI performance must be improved so that it approaches the reliability of natural muscle-based function.
Collapse
Affiliation(s)
- Jerry J Shih
- Department of Neurology, Mayo Clinic, 4500 San Pablo Rd., Jacksonville, FL 32224, USA.
| | | | | |
Collapse
|
43
|
Theories and control models and motor learning: clinical applications in neuro-rehabilitation. Neurologia 2012; 30:32-41. [PMID: 22341985 DOI: 10.1016/j.nrl.2011.12.010] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2011] [Revised: 11/09/2011] [Accepted: 12/20/2011] [Indexed: 11/21/2022] Open
Abstract
INTRODUCTION In recent decades there has been a special interest in theories that could explain the regulation of motor control, and their applications. These theories are often based on models of brain function, philosophically reflecting different criteria on how movement is controlled by the brain, each being emphasised in different neural components of the movement. The concept of motor learning, regarded as the set of internal processes associated with practice and experience that produce relatively permanent changes in the ability to produce motor activities through a specific skill, is also relevant in the context of neuroscience. Thus, both motor control and learning are seen as key fields of study for health professionals in the field of neuro-rehabilitation. DEVELOPMENT The major theories of motor control are described, which include, motor programming theory, systems theory, the theory of dynamic action, and the theory of parallel distributed processing, as well as the factors that influence motor learning and its applications in neuro-rehabilitation. CONCLUSIONS At present there is no consensus on which theory or model defines the regulations to explain motor control. Theories of motor learning should be the basis for motor rehabilitation. The new research should apply the knowledge generated in the fields of control and motor learning in neuro-rehabilitation.
Collapse
|
44
|
Abstract
The primary motor cortex is a critical node in the network of brain regions responsible for voluntary motor behavior. It has been less appreciated, however, that the motor cortex exhibits sensory responses in a variety of modalities including vision and somatosensation. We review current work that emphasizes the heterogeneity in sensorimotor responses in the motor cortex and focus on its implications for cortical control of movement as well as for brain-machine interface development.
Collapse
|
45
|
Breshears JD, Gaona CM, Roland JL, Sharma M, Anderson NR, Bundy DT, Freudenburg ZV, Smyth MD, Zempel J, Limbrick DD, Smart WD, Leuthardt EC. Decoding motor signals from the pediatric cortex: implications for brain-computer interfaces in children. Pediatrics 2011; 128:e160-8. [PMID: 21690116 DOI: 10.1542/peds.2010-1519] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVE To demonstrate the decodable nature of pediatric brain signals for the purpose of neuroprosthetic control. We hypothesized that children would achieve levels of brain-derived computer control comparable to performance previously reported for adults. PATIENTS AND METHODS Six pediatric patients with intractable epilepsy who were invasively monitored underwent screening for electrocortical control signals associated with specific motor or phoneme articulation tasks. Subsequently, patients received visual feedback as they used these associated electrocortical signals to direct one dimensional cursor movement to a target on a screen. RESULTS All patients achieved accuracies between 70% and 99% within 9 minutes of training using the same screened motor and articulation tasks. Two subjects went on to achieve maximum accuracies of 73% and 100% using imagined actions alone. Average mean and maximum performance for the 6 pediatric patients was comparable to that of 5 adults. The mean accuracy of the pediatric group was 81% (95% confidence interval [CI]: 71.5-90.5) over a mean training time of 11.6 minutes, whereas the adult group had a mean accuracy of 72% (95% CI: 61.2-84.3) over a mean training time of 12.5 minutes. Maximum performance was also similar between the pediatric and adult groups (89.6% [95% CI: 83-96.3] and 88.5% [95% CI: 77.1-99.8], respectively). CONCLUSIONS Similarly to adult brain signals, pediatric brain signals can be decoded and used for BCI operation. Therefore, BCI systems developed for adults likely hold similar promise for children with motor disabilities.
Collapse
Affiliation(s)
- Jonathan D Breshears
- Washington University, School of Medicine, Campus Box 8057, 660 S Euclid Ave, St Louis, MO 63130, USA
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
46
|
Berger TW, Hampson RE, Song D, Goonawardena A, Marmarelis VZ, Deadwyler SA. A cortical neural prosthesis for restoring and enhancing memory. J Neural Eng 2011; 8:046017. [PMID: 21677369 DOI: 10.1088/1741-2560/8/4/046017] [Citation(s) in RCA: 126] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
A primary objective in developing a neural prosthesis is to replace neural circuitry in the brain that no longer functions appropriately. Such a goal requires artificial reconstruction of neuron-to-neuron connections in a way that can be recognized by the remaining normal circuitry, and that promotes appropriate interaction. In this study, the application of a specially designed neural prosthesis using a multi-input/multi-output (MIMO) nonlinear model is demonstrated by using trains of electrical stimulation pulses to substitute for MIMO model derived ensemble firing patterns. Ensembles of CA3 and CA1 hippocampal neurons, recorded from rats performing a delayed-nonmatch-to-sample (DNMS) memory task, exhibited successful encoding of trial-specific sample lever information in the form of different spatiotemporal firing patterns. MIMO patterns, identified online and in real-time, were employed within a closed-loop behavioral paradigm. Results showed that the model was able to predict successful performance on the same trial. Also, MIMO model-derived patterns, delivered as electrical stimulation to the same electrodes, improved performance under normal testing conditions and, more importantly, were capable of recovering performance when delivered to animals with ensemble hippocampal activity compromised by pharmacologic blockade of synaptic transmission. These integrated experimental-modeling studies show for the first time that, with sufficient information about the neural coding of memories, a neural prosthesis capable of real-time diagnosis and manipulation of the encoding process can restore and even enhance cognitive, mnemonic processes.
Collapse
Affiliation(s)
- Theodore W Berger
- Depatment of Biomedical Engineering, University of Southern California, Los Angeles, CA, USA
| | | | | | | | | | | |
Collapse
|
47
|
Bobrov P, Frolov A, Cantor C, Fedulova I, Bakhnyan M, Zhavoronkov A. Brain-computer interface based on generation of visual images. PLoS One 2011; 6:e20674. [PMID: 21695206 PMCID: PMC3112189 DOI: 10.1371/journal.pone.0020674] [Citation(s) in RCA: 49] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2010] [Accepted: 05/10/2011] [Indexed: 11/01/2022] Open
Abstract
This paper examines the task of recognizing EEG patterns that correspond to performing three mental tasks: relaxation and imagining of two types of pictures: faces and houses. The experiments were performed using two EEG headsets: BrainProducts ActiCap and Emotiv EPOC. The Emotiv headset becomes widely used in consumer BCI application allowing for conducting large-scale EEG experiments in the future. Since classification accuracy significantly exceeded the level of random classification during the first three days of the experiment with EPOC headset, a control experiment was performed on the fourth day using ActiCap. The control experiment has shown that utilization of high-quality research equipment can enhance classification accuracy (up to 68% in some subjects) and that the accuracy is independent of the presence of EEG artifacts related to blinking and eye movement. This study also shows that computationally-inexpensive bayesian classifier based on covariance matrix analysis yields similar classification accuracy in this problem as a more sophisticated Multi-class Common Spatial Patterns (MCSP) classifier.
Collapse
Affiliation(s)
- Pavel Bobrov
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Sciences, Moscow, Russia
- Technical University of Ostrava, Ostrava Poruba, Czech Republic
| | - Alexander Frolov
- Institute of Higher Nervous Activity and Neurophysiology of Russian Academy of Sciences, Moscow, Russia
| | - Charles Cantor
- Department of Biomedical Engineering, Boston University, Boston, Massachusetts, United States of America
- Department of Physiology and Biophysics, University of California Irvine, Irvine, California, United States of America
| | - Irina Fedulova
- Moscow State University, Department of Computational Mathematics and Cybernetics, Moscow, Russia
| | | | | |
Collapse
|
48
|
Pohlmeyer EA, Wang J, Jangraw DC, Lou B, Chang SF, Sajda P. Closing the loop in cortically-coupled computer vision: a brain-computer interface for searching image databases. J Neural Eng 2011; 8:036025. [PMID: 21562364 DOI: 10.1088/1741-2560/8/3/036025] [Citation(s) in RCA: 47] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
We describe a closed-loop brain-computer interface that re-ranks an image database by iterating between user generated 'interest' scores and computer vision generated visual similarity measures. The interest scores are based on decoding the electroencephalographic (EEG) correlates of target detection, attentional shifts and self-monitoring processes, which result from the user paying attention to target images interspersed in rapid serial visual presentation (RSVP) sequences. The highest scored images are passed to a semi-supervised computer vision system that reorganizes the image database accordingly, using a graph-based representation that captures visual similarity between images. The system can either query the user for more information, by adaptively resampling the database to create additional RSVP sequences, or it can converge to a 'done' state. The done state includes a final ranking of the image database and also a 'guess' of the user's chosen category of interest. We find that the closed-loop system's re-rankings can substantially expedite database searches for target image categories chosen by the subjects. Furthermore, better reorganizations are achieved than by relying on EEG interest rankings alone, or if the system were simply run in an open loop format without adaptive resampling.
Collapse
Affiliation(s)
- Eric A Pohlmeyer
- Department of Biomedical Engineering, Columbia University, New York, NY 10027, USA
| | | | | | | | | | | |
Collapse
|
49
|
Leuthardt EC, Gaona C, Sharma M, Szrama N, Roland J, Freudenberg Z, Solis J, Breshears J, Schalk G. Using the electrocorticographic speech network to control a brain-computer interface in humans. J Neural Eng 2011; 8:036004. [PMID: 21471638 DOI: 10.1088/1741-2560/8/3/036004] [Citation(s) in RCA: 118] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Electrocorticography (ECoG) has emerged as a new signal platform for brain-computer interface (BCI) systems. Classically, the cortical physiology that has been commonly investigated and utilized for device control in humans has been brain signals from the sensorimotor cortex. Hence, it was unknown whether other neurophysiological substrates, such as the speech network, could be used to further improve on or complement existing motor-based control paradigms. We demonstrate here for the first time that ECoG signals associated with different overt and imagined phoneme articulation can enable invasively monitored human patients to control a one-dimensional computer cursor rapidly and accurately. This phonetic content was distinguishable within higher gamma frequency oscillations and enabled users to achieve final target accuracies between 68% and 91% within 15 min. Additionally, one of the patients achieved robust control using recordings from a microarray consisting of 1 mm spaced microwires. These findings suggest that the cortical network associated with speech could provide an additional cognitive and physiologic substrate for BCI operation and that these signals can be acquired from a cortical array that is small and minimally invasive.
Collapse
Affiliation(s)
- Eric C Leuthardt
- Department of Biomedical Engineering, Washington University in St. Louis, Campus Box 8057, 660 South Euclid, St Louis, MO 63130, USA.
| | | | | | | | | | | | | | | | | |
Collapse
|
50
|
Gilja V, Chestek CA, Diester I, Henderson JM, Deisseroth K, Shenoy KV. Challenges and opportunities for next-generation intracortically based neural prostheses. IEEE Trans Biomed Eng 2011; 58:1891-9. [PMID: 21257365 DOI: 10.1109/tbme.2011.2107553] [Citation(s) in RCA: 120] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Neural prosthetic systems aim to help disabled patients by translating neural signals from the brain into control signals for guiding computer cursors, prosthetic arms, and other assistive devices. Intracortical electrode arrays measure action potentials and local field potentials from individual neurons, or small populations of neurons, in the motor cortices and can provide considerable information for controlling prostheses. Despite several compelling proof-of-concept laboratory animal experiments and an initial human clinical trial, at least three key challenges remain which, if left unaddressed, may hamper the translation of these systems into widespread clinical use. We review these challenges: achieving able-bodied levels of performance across tasks and across environments, achieving robustness across multiple decades, and restoring able-bodied quality proprioception and somatosensation. We also describe some emerging opportunities for meeting these challenges. If these challenges can be largely or fully met, intracortically based neural prostheses may achieve true clinical viability and help increasing numbers of disabled patients.
Collapse
Affiliation(s)
- Vikash Gilja
- Department of Computer Science and SINTN, Stanford University, Stanford, CA 94305, USA.
| | | | | | | | | | | |
Collapse
|