1
|
Birbaumer N. "Your Thoughts are (were) Free!": Brain-Computer-Interfaces, Neurofeedback, Detection of Deception, and the Future of Mind-Reading. Appl Psychophysiol Biofeedback 2024:10.1007/s10484-024-09648-z. [PMID: 38874845 DOI: 10.1007/s10484-024-09648-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/20/2024] [Indexed: 06/15/2024]
Abstract
This review describes the historical developement and rationale of clinically relevant research on neurophysiological "mind reading" paradims: Brain- Computer-Interfaces, detection of deception, brain stimulation and neurofeedback and the clinical applications in drug resistant epilepsy, chronic stroke, and communication with paralyzed locked-in persons. The emphasis lies on completely locked-in patients with amyotrophic lateral sclerosis using non-invasive and invasive brain computer interfaces and neurofeedback to restore verbal communication with the social environment. In the second part of the article we argue that success and failure of neurophysiological "mind reading" paradigms may be explained with a motor theory of thinking and emotion in combination with learning theory. The ethical implications of brain computer interface and neurofeedback approaches, particularly for severe chronic paralysis and loss of communication diseases and decisions on hastened death and euthanasia are discussed.
Collapse
Affiliation(s)
- Niels Birbaumer
- Department of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Silcherstrasse 5, 74072, Tübingen, Germany.
| |
Collapse
|
2
|
Ganjali M, Mehridehnavi A, Rakhshani S, Khorasani A. Unsupervised Neural Manifold Alignment for Stable Decoding of Movement from Cortical Signals. Int J Neural Syst 2024; 34:2450006. [PMID: 38063378 DOI: 10.1142/s0129065724500060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Abstract
The stable decoding of movement parameters using neural activity is crucial for the success of brain-machine interfaces (BMIs). However, neural activity can be unstable over time, leading to changes in the parameters used for decoding movement, which can hinder accurate movement decoding. To tackle this issue, one approach is to transfer neural activity to a stable, low-dimensional manifold using dimensionality reduction techniques and align manifolds across sessions by maximizing correlations of the manifolds. However, the practical use of manifold stabilization techniques requires knowledge of the true subject intentions such as target direction or behavioral state. To overcome this limitation, an automatic unsupervised algorithm is proposed that determines movement target intention before manifold alignment in the presence of manifold rotation and scaling across sessions. This unsupervised algorithm is combined with a dimensionality reduction and alignment method to overcome decoder instabilities. The effectiveness of the BMI stabilizer method is represented by decoding the two-dimensional (2D) hand velocity of two rhesus macaque monkeys during a center-out-reaching movement task. The performance of the proposed method is evaluated using correlation coefficient and R-squared measures, demonstrating higher decoding performance compared to a state-of-the-art unsupervised BMI stabilizer. The results offer benefits for the automatic determination of movement intents in long-term BMI decoding. Overall, the proposed method offers a promising automatic solution for achieving stable and accurate movement decoding in BMI applications.
Collapse
Affiliation(s)
- Mohammadali Ganjali
- Department of Biomedical Engineering, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Alireza Mehridehnavi
- Department of Biomedical Engineering, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Sajed Rakhshani
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Abed Khorasani
- Department of Neurology, Northwestern University, Chicago, IL, 60611, USA
- Neuroscience Research Center, Institute of Neuropharmacology, Kerman University of Medical Sciences, Kerman, Iran
| |
Collapse
|
3
|
Wang HL, Kuo YT, Lo YC, Kuo CH, Chen BW, Wang CF, Wu ZY, Lee CE, Yang SH, Lin SH, Chen PC, Chen YY. Enhancing Prediction of Forelimb Movement Trajectory through a Calibrating-Feedback Paradigm Incorporating RAT Primary Motor and Agranular Cortical Ensemble Activity in the Goal-Directed Reaching Task. Int J Neural Syst 2023; 33:2350051. [PMID: 37632142 DOI: 10.1142/s012906572350051x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/27/2023]
Abstract
Complete reaching movements involve target sensing, motor planning, and arm movement execution, and this process requires the integration and communication of various brain regions. Previously, reaching movements have been decoded successfully from the motor cortex (M1) and applied to prosthetic control. However, most studies attempted to decode neural activities from a single brain region, resulting in reduced decoding accuracy during visually guided reaching motions. To enhance the decoding accuracy of visually guided forelimb reaching movements, we propose a parallel computing neural network using both M1 and medial agranular cortex (AGm) neural activities of rats to predict forelimb-reaching movements. The proposed network decodes M1 neural activities into the primary components of the forelimb movement and decodes AGm neural activities into internal feedforward information to calibrate the forelimb movement in a goal-reaching movement. We demonstrate that using AGm neural activity to calibrate M1 predicted forelimb movement can improve decoding performance significantly compared to neural decoders without calibration. We also show that the M1 and AGm neural activities contribute to controlling forelimb movement during goal-reaching movements, and we report an increase in the power of the local field potential (LFP) in beta and gamma bands over AGm in response to a change in the target distance, which may involve sensorimotor transformation and communication between the visual cortex and AGm when preparing for an upcoming reaching movement. The proposed parallel computing neural network with the internal feedback model improves prediction accuracy for goal-reaching movements.
Collapse
Affiliation(s)
- Han-Lin Wang
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
| | - Yun-Ting Kuo
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
| | - Yu-Chun Lo
- The Ph.D. Program in Medical Neuroscience, College of Medical Science and Technology, Taipei Medical University, 12F., Education & Research Building, Shuang-Ho Campus, No. 301, Yuantong Rd., New Taipei City 235235, Taiwan
| | - Chao-Hung Kuo
- Department of Neurosurgery, Neurological Institute Taipei Veterans General Hospital, No. 201, Sec. 2 Shipai Rd., Taipei 11217, Taiwan
| | - Bo-Wei Chen
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
| | - Ching-Fu Wang
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
- Biomedical Engineering Research and Development Center, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
| | - Zu-Yu Wu
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
| | - Chi-En Lee
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
| | - Shih-Hung Yang
- Department of Mechanical Engineering, National Cheng Kung University, No. 1, University Rd., Tainan 70101, Taiwan
| | - Sheng-Huang Lin
- Department of Neurology, Hualien Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, No. 707, Sec. 3 Zhongyang Rd., Hualien 97002, Taiwan
- Department of Neurology, School of Medicine, Tzu Chi University, No. 701, Sec. 3, Zhongyang Rd., Hualien 97004, Taiwan
| | - Po-Chuan Chen
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - You-Yin Chen
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, No. 155, Sec. 2 Linong St., Taipei 112304, Taiwan
- The Ph.D. Program in Medical Neuroscience, College of Medical Science and Technology, Taipei Medical University, 12F., Education & Research Building, Shuang-Ho Campus, No. 301, Yuantong Rd., New Taipei City 235235, Taiwan
| |
Collapse
|
4
|
Zilio F, Gomez-Pilar J, Chaudhary U, Fogel S, Fomina T, Synofzik M, Schöls L, Cao S, Zhang J, Huang Z, Birbaumer N, Northoff G. Altered brain dynamics index levels of arousal in complete locked-in syndrome. Commun Biol 2023; 6:757. [PMID: 37474587 PMCID: PMC10359418 DOI: 10.1038/s42003-023-05109-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 07/06/2023] [Indexed: 07/22/2023] Open
Abstract
Complete locked-in syndrome (CLIS) resulting from late-stage amyotrophic lateral sclerosis (ALS) is characterised by loss of motor function and eye movements. The absence of behavioural indicators of consciousness makes the search for neuronal correlates as possible biomarkers clinically and ethically urgent. EEG-based measures of brain dynamics such as power-law exponent (PLE) and Lempel-Ziv complexity (LZC) have been shown to have explanatory power for consciousness and may provide such neuronal indices for patients with CLIS. Here, we validated PLE and LZC (calculated in a dynamic way) as benchmarks of a wide range of arousal states across different reference states of consciousness (e.g., awake, sleep stages, ketamine, sevoflurane). We show a tendency toward high PLE and low LZC, with high intra-subject fluctuations and inter-subject variability in a cohort of CLIS patients with values graded along different arousal states as in our reference data sets. In conclusion, changes in brain dynamics indicate altered arousal in CLIS. Specifically, PLE and LZC are potentially relevant biomarkers to identify or diagnose the arousal level in CLIS and to determine the optimal time point for treatment, including communication attempts.
Collapse
Affiliation(s)
- Federico Zilio
- Department of Philosophy, Sociology, Education and Applied Psychology, University of Padova, Padua, Italy.
| | - Javier Gomez-Pilar
- Biomedical Engineering Group, University of Valladolid, Valladolid, Spain
- Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Valladolid, Spain
| | - Ujwal Chaudhary
- BrainPortal Technologies GmbH, Mannheim, Germany
- ALS Voice gGmbH, Mössingen, Germany
| | - Stuart Fogel
- School of Psychology, University of Ottawa, Ottawa, Canada
- Institute of Mental Health Research, University of Ottawa, Ottawa, Canada
| | - Tatiana Fomina
- Department for Empirical Inference, Max Planck Institute for Intelligent Systems, Tübingen, Germany
| | - Matthis Synofzik
- Department of Neurodegenerative Diseases and Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
- German Center for Neurodegenerative Diseases (DZNE), Tübingen, Germany
| | - Ludger Schöls
- Department of Neurodegenerative Diseases and Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
- German Center for Neurodegenerative Diseases (DZNE), Tübingen, Germany
| | - Shumei Cao
- Department of Anesthesiology, Fudan University Shanghai Cancer Center, Shanghai, China
| | - Jun Zhang
- Department of Anesthesiology, Fudan University Shanghai Cancer Center, Shanghai, China
| | - Zirui Huang
- Center for Consciousness Science, Department of Anesthesiology, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Niels Birbaumer
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Georg Northoff
- Institute of Mental Health Research, University of Ottawa, Ottawa, Canada
| |
Collapse
|
5
|
Xie YL, Yang YX, Jiang H, Duan XY, Gu LJ, Qing W, Zhang B, Wang YX. Brain-machine interface-based training for improving upper extremity function after stroke: A meta-analysis of randomized controlled trials. Front Neurosci 2022; 16:949575. [PMID: 35992923 PMCID: PMC9381818 DOI: 10.3389/fnins.2022.949575] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2022] [Accepted: 07/08/2022] [Indexed: 11/13/2022] Open
Abstract
Background Upper extremity dysfunction after stroke is an urgent clinical problem that greatly affects patients' daily life and reduces their quality of life. As an emerging rehabilitation method, brain-machine interface (BMI)-based training can extract brain signals and provide feedback to form a closed-loop rehabilitation, which is currently being studied for functional restoration after stroke. However, there is no reliable medical evidence to support the effect of BMI-based training on upper extremity function after stroke. This review aimed to evaluate the efficacy and safety of BMI-based training for improving upper extremity function after stroke, as well as potential differences in efficacy of different external devices. Methods English-language literature published before April 1, 2022, was searched in five electronic databases using search terms including “brain-computer/machine interface”, “stroke” and “upper extremity.” The identified articles were screened, data were extracted, and the methodological quality of the included trials was assessed. Meta-analysis was performed using RevMan 5.4.1 software. The GRADE method was used to assess the quality of the evidence. Results A total of 17 studies with 410 post-stroke patients were included. Meta-analysis showed that BMI-based training significantly improved upper extremity motor function [standardized mean difference (SMD) = 0.62; 95% confidence interval (CI) (0.34, 0.90); I2 = 38%; p < 0.0001; n = 385; random-effects model; moderate-quality evidence]. Subgroup meta-analysis indicated that BMI-based training significantly improves upper extremity motor function in both chronic [SMD = 0.68; 95% CI (0.32, 1.03), I2 = 46%; p = 0.0002, random-effects model] and subacute [SMD = 1.11; 95%CI (0.22, 1.99); I2 = 76%; p = 0.01; random-effects model] stroke patients compared with control interventions, and using functional electrical stimulation (FES) [SMD = 1.11; 95% CI (0.67, 1.54); I2 = 11%; p < 0.00001; random-effects model]or visual feedback [SMD = 0.66; 95% CI (0.2, 1.12); I2 = 4%; p = 0.005; random-effects model;] as the feedback devices in BMI training was more effective than using robot. In addition, BMI-based training was more effective in improving patients' activities of daily living (ADL) than control interventions [SMD = 1.12; 95% CI (0.65, 1.60); I2 = 0%; p < 0.00001; n = 80; random-effects model]. There was no statistical difference in the dropout rate and adverse effects between the BMI-based training group and the control group. Conclusion BMI-based training improved upper limb motor function and ADL in post-stroke patients. BMI combined with FES or visual feedback may be a better combination for functional recovery than robot. BMI-based trainings are well-tolerated and associated with mild adverse effects.
Collapse
Affiliation(s)
- Yu-lei Xie
- Department of Rehabilitation Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
- Department of Rehabilitation Medicine, Capital Medical University, Beijing, China
| | - Yu-xuan Yang
- Department of Rehabilitation Medicine, The Second Clinical Hospital of North Sichuan Medical College, Nanchong Central Hospital, Nanchong, China
| | - Hong Jiang
- Department of Rehabilitation Medicine, Xichong County People's Hospital, Nanchong Central Hospital, Nanchong, China
| | - Xing-Yu Duan
- Department of Rehabilitation Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Li-jing Gu
- Department of Rehabilitation Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Wu Qing
- Department of Rehabilitation Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Bo Zhang
- Department of Rehabilitation Medicine, The Second Clinical Hospital of North Sichuan Medical College, Nanchong Central Hospital, Nanchong, China
- Bo Zhang
| | - Yin-xu Wang
- Department of Rehabilitation Medicine, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
- *Correspondence: Yin-xu Wang
| |
Collapse
|
6
|
A novel command generation method for SSVEP-based BCI by introducing SSVEP blocking response. Comput Biol Med 2022; 146:105521. [DOI: 10.1016/j.compbiomed.2022.105521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Revised: 04/08/2022] [Accepted: 04/11/2022] [Indexed: 11/18/2022]
|
7
|
Chaudhary U, Vlachos I, Zimmermann JB, Espinosa A, Tonin A, Jaramillo-Gonzalez A, Khalili-Ardali M, Topka H, Lehmberg J, Friehs GM, Woodtli A, Donoghue JP, Birbaumer N. Spelling interface using intracortical signals in a completely locked-in patient enabled via auditory neurofeedback training. Nat Commun 2022; 13:1236. [PMID: 35318316 PMCID: PMC8941070 DOI: 10.1038/s41467-022-28859-8] [Citation(s) in RCA: 38] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Accepted: 02/11/2022] [Indexed: 12/14/2022] Open
Abstract
Patients with amyotrophic lateral sclerosis (ALS) can lose all muscle-based routes of communication as motor neuron degeneration progresses, and ultimately, they may be left without any means of communication. While others have evaluated communication in people with remaining muscle control, to the best of our knowledge, it is not known whether neural-based communication remains possible in a completely locked-in state. Here, we implanted two 64 microelectrode arrays in the supplementary and primary motor cortex of a patient in a completely locked-in state with ALS. The patient modulated neural firing rates based on auditory feedback and he used this strategy to select letters one at a time to form words and phrases to communicate his needs and experiences. This case study provides evidence that brain-based volitional communication is possible even in a completely locked-in state.
Collapse
Affiliation(s)
| | - Ioannis Vlachos
- Wyss Center for Bio and Neuroengineering, Geneva, Switzerland
| | | | - Arnau Espinosa
- Wyss Center for Bio and Neuroengineering, Geneva, Switzerland
| | - Alessandro Tonin
- Wyss Center for Bio and Neuroengineering, Geneva, Switzerland.,Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Andres Jaramillo-Gonzalez
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Majid Khalili-Ardali
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Helge Topka
- Department of Neurology, Clinical Neurophysiology, Cognitive Neurology and Stroke Unit, München Klinik Bogenhausen, Munich, Germany
| | - Jens Lehmberg
- Department of Neurosurgery, München Klinik Bogenhausen, Munich, Germany
| | | | - Alain Woodtli
- Wyss Center for Bio and Neuroengineering, Geneva, Switzerland
| | - John P Donoghue
- Carney Brain Institute, Brown University, Providence, RI, USA
| | - Niels Birbaumer
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany.
| |
Collapse
|