1
|
Borgheai SB, Zisk AH, McLinden J, Mcintyre J, Sadjadi R, Shahriari Y. Multimodal pre-screening can predict BCI performance variability: A novel subject-specific experimental scheme. Comput Biol Med 2024; 168:107658. [PMID: 37984201 DOI: 10.1016/j.compbiomed.2023.107658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 10/20/2023] [Accepted: 10/31/2023] [Indexed: 11/22/2023]
Abstract
BACKGROUND Brain-computer interface (BCI) systems currently lack the required robustness for long-term daily use due to inter- and intra-subject performance variability. In this study, we propose a novel personalized scheme for a multimodal BCI system, primarily using functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), to identify, predict, and compensate for factors affecting competence-related and interfering factors associated with performance. METHOD 11 (out of 13 recruited) participants, including five participants with motor deficits, completed four sessions on average. During the training sessions, the subjects performed a short pre-screening phase, followed by three variations of a novel visou-mental (VM) protocol. Features extracted from the pre-screening phase were used to construct predictive platforms using stepwise multivariate linear regression (MLR) models. In the test sessions, we employed a task-correction phase where our predictive models were used to predict the ideal task variation to maximize performance, followed by an interference-correction phase. We then investigated the associations between predicted and actual performances and evaluated the outcome of correction strategies. RESULT The predictive models resulted in respective adjusted R-squared values of 0.942, 0.724, and 0.939 for the first, second, and third variation of the task, respectively. The statistical analyses showed significant associations between the performances predicted by predictive models and the actual performances for the first two task variations, with rhos of 0.7289 (p-value = 0.011) and 0.6970 (p-value = 0.017), respectively. For 81.82 % of the subjects, the task/workload correction stage correctly determined which task variation provided the highest accuracy, with an average performance gain of 5.18 % when applying the correction strategies. CONCLUSION Our proposed method can lead to an integrated multimodal predictive framework to compensate for BCI performance variability, particularly, for people with severe motor deficits.
Collapse
Affiliation(s)
- Seyyed Bahram Borgheai
- Department of Electrical, Computer, and Biomedical Engineering, University of Rhode Island, Kingston, RI, United States; Neurology Department, Emory University, Atlanta, GA, United States
| | - Alyssa Hillary Zisk
- Interdisciplinary Neuroscience Program, University of Rhode Island, Kingston, RI, United States
| | - John McLinden
- Department of Electrical, Computer, and Biomedical Engineering, University of Rhode Island, Kingston, RI, United States
| | - James Mcintyre
- Department of Electrical, Computer, and Biomedical Engineering, University of Rhode Island, Kingston, RI, United States
| | - Reza Sadjadi
- Neurology Department, Massachusetts General Hospital, Boston, MA, United States
| | - Yalda Shahriari
- Department of Electrical, Computer, and Biomedical Engineering, University of Rhode Island, Kingston, RI, United States; Interdisciplinary Neuroscience Program, University of Rhode Island, Kingston, RI, United States.
| |
Collapse
|
2
|
Yadav H, Maini S. Electroencephalogram based brain-computer interface: Applications, challenges, and opportunities. MULTIMEDIA TOOLS AND APPLICATIONS 2023:1-45. [PMID: 37362726 PMCID: PMC10157593 DOI: 10.1007/s11042-023-15653-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 07/17/2022] [Accepted: 04/22/2023] [Indexed: 06/28/2023]
Abstract
Brain-Computer Interfaces (BCI) is an exciting and emerging research area for researchers and scientists. It is a suitable combination of software and hardware to operate any device mentally. This review emphasizes the significant stages in the BCI domain, current problems, and state-of-the-art findings. This article also covers how current results can contribute to new knowledge about BCI, an overview of BCI from its early developments to recent advancements, BCI applications, challenges, and future directions. The authors pointed to unresolved issues and expressed how BCI is valuable for analyzing the human brain. Humans' dependence on machines has led humankind into a new future where BCI can play an essential role in improving this modern world.
Collapse
Affiliation(s)
- Hitesh Yadav
- Department of Electrical and Instrumentation Engineering, Sant Longowal Institute of Engineering & Technology, Longowal, Punjab India
| | - Surita Maini
- Department of Electrical and Instrumentation Engineering, Sant Longowal Institute of Engineering & Technology, Longowal, Punjab India
| |
Collapse
|
3
|
Borkin D, Nemethova A, Nemeth M, Tanuska P. Control of a Production Manipulator with the Use of BCI in Conjunction with an Industrial PLC. SENSORS (BASEL, SWITZERLAND) 2023; 23:3546. [PMID: 37050605 PMCID: PMC10098813 DOI: 10.3390/s23073546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 03/15/2023] [Accepted: 03/22/2023] [Indexed: 06/19/2023]
Abstract
Research in the field of gathering and analyzing biological signals is growing. The sensors are becoming more available and more non-invasive for examining such signals, which in the past required the inconvenient acquisition of data. This was achieved mainly by the fact that biological sensors were able to be built into wearable and portable devices. The representation and analysis of EEGs (electroencephalograms) is nowadays commonly used in various application areas. The application of the use of the EEG signals to the field of automation is still an unexplored area and therefore provides opportunities for interesting research. In our research, we focused on the area of processing automation; especially the use of the EEG signals to bridge the communication between control of individual processes and a human. In this study, the real-time communication between a PLC (programmable logic controller) and BCI (brain computer interface) was investigated and described. In the future, this approach can help people with physical disabilities to control certain machines or devices and therefore it could find applicability in overcoming physical disabilities. The main contribution of the article is, that we have demonstrated the possibility of interaction between a person and a manipulator controlled by a PLC with the help of a BCI. Potentially, with the expansion of functionality, such solutions will allow a person with physical disabilities to participate in the production process.
Collapse
|
4
|
Magnon V, Vallet GT, Benson A, Mermillod M, Chausse P, Lacroix A, Bouillon-Minois JB, Dutheil F. Does heart rate variability predict better executive functioning? A systematic review and meta-analysis. Cortex 2022; 155:218-236. [DOI: 10.1016/j.cortex.2022.07.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Revised: 06/09/2022] [Accepted: 07/19/2022] [Indexed: 12/20/2022]
|
5
|
Osińska A, Rynkiewicz A, Binder M, Komendziński T, Borowicz A, Leszczyński A. Non-invasive Vagus Nerve Stimulation in Treatment of Disorders of Consciousness – Longitudinal Case Study. Front Neurosci 2022; 16:834507. [PMID: 35600632 PMCID: PMC9120963 DOI: 10.3389/fnins.2022.834507] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 03/29/2022] [Indexed: 11/16/2022] Open
Abstract
Neuromodulatory electroceuticals such as vagus nerve stimulation have been recently gaining traction as potential rehabilitation tools for disorders of consciousness (DoC). We present a longitudinal case study of non-invasive auricular vagus nerve stimulation (taVNS) in a patient diagnosed with chronic unresponsive wakefulness syndrome (previously known as vegetative state). Over a period of 6 months we applied taVNS daily and regularly evaluated the patient’s behavioral outcomes using Coma Recovery Scale – Revised. We also took electrophysiological measures: resting state electroencephalography (EEG), heart rate (HR) and heart rate variability (HRV). All these methods revealed signs of improvement in the patient’s condition. The total CRS-R scores fluctuated but rose from 4 and 6 at initial stages to the heights of 12 and 13 in the 3rd and 5th month, which would warrant a change in diagnosis to a Minimally Conscious State. Scores obtained in a 2 months follow-up period, though, suggest this may not have been a lasting improvement. Behavioral signs of recovery are triangulated by EEG frequency spectrum profiles with re-emergence of a second oscillatory peak in the alpha range, which has been shown to characterize aware people. However, sustained spontaneous theta oscillations did not predictably diminish, which most likely reflects structural brain damage. ECG measures revealed a steady decrease in pre-stimulation HR combined with an increase in HRV-HR. This suggests a gradual withdrawal of sympathetic and an increase in parasympathetic control of the heart, which the previous literature has also linked with DoC improvements. Together, this study suggests that taVNS stimulation holds promise as a DoC treatment.
Collapse
Affiliation(s)
- Albertyna Osińska
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
- *Correspondence: Albertyna Osińska,
| | - Andrzej Rynkiewicz
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
- Andrzej Rynkiewicz,
| | - Marek Binder
- Institute of Psychology, Jagiellonian University, Kraków, Poland
| | - Tomasz Komendziński
- Department of Cognitive Science, Faculty of Humanities, Nicolaus Copernicus University in Toruń, Toruń, Poland
| | - Anna Borowicz
- Department of Cognitive Science, Faculty of Humanities, Nicolaus Copernicus University in Toruń, Toruń, Poland
| | - Antoni Leszczyński
- Department of Cognitive Science, Faculty of Humanities, Nicolaus Copernicus University in Toruń, Toruń, Poland
| |
Collapse
|
6
|
Nann M, Haslacher D, Colucci A, Eskofier B, von Tscharner V, Soekadar SR. Heart rate variability predicts decline in sensorimotor rhythm control. J Neural Eng 2021; 18. [PMID: 34229308 DOI: 10.1088/1741-2552/ac1177] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 07/06/2021] [Indexed: 11/11/2022]
Abstract
Objective.Voluntary control of sensorimotor rhythms (SMRs, 8-12 Hz) can be used for brain-computer interface (BCI)-based operation of an assistive hand exoskeleton, e.g. in finger paralysis after stroke. To gain SMR control, stroke survivors are usually instructed to engage in motor imagery (MI) or to attempt moving the paralyzed fingers resulting in task- or event-related desynchronization (ERD) of SMR (SMR-ERD). However, as these tasks are cognitively demanding, especially for stroke survivors suffering from cognitive impairments, BCI control performance can deteriorate considerably over time. Therefore, it would be important to identify biomarkers that predict decline in BCI control performance within an ongoing session in order to optimize the man-machine interaction scheme.Approach.Here we determine the link between BCI control performance over time and heart rate variability (HRV). Specifically, we investigated whether HRV can be used as a biomarker to predict decline of SMR-ERD control across 17 healthy participants using Granger causality. SMR-ERD was visually displayed on a screen. Participants were instructed to engage in MI-based SMR-ERD control over two consecutive runs of 8.5 min each. During the 2nd run, task difficulty was gradually increased.Main results.While control performance (p= .18) and HRV (p= .16) remained unchanged across participants during the 1st run, during the 2nd run, both measures declined over time at high correlation (performance: -0.61%/10 s,p= 0; HRV: -0.007 ms/10 s,p< .001). We found that HRV exhibited predictive characteristics with regard to within-session BCI control performance on an individual participant level (p< .001).Significance.These results suggest that HRV can predict decline in BCI performance paving the way for adaptive BCI control paradigms, e.g. to individualize and optimize assistive BCI systems in stroke.
Collapse
Affiliation(s)
- Marius Nann
- Applied Neurotechnology Lab, Department of Psychiatry and Psychotherapy, University Hospital of Tübingen, Tübingen, Germany.,Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| | - David Haslacher
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| | - Annalisa Colucci
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| | - Bjoern Eskofier
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-Nürnberg (FAU), Erlangen, Germany
| | | | - Surjo R Soekadar
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| |
Collapse
|
7
|
Saha S, Mamun KA, Ahmed K, Mostafa R, Naik GR, Darvishi S, Khandoker AH, Baumert M. Progress in Brain Computer Interface: Challenges and Opportunities. Front Syst Neurosci 2021; 15:578875. [PMID: 33716680 PMCID: PMC7947348 DOI: 10.3389/fnsys.2021.578875] [Citation(s) in RCA: 86] [Impact Index Per Article: 28.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 01/06/2021] [Indexed: 12/13/2022] Open
Abstract
Brain computer interfaces (BCI) provide a direct communication link between the brain and a computer or other external devices. They offer an extended degree of freedom either by strengthening or by substituting human peripheral working capacity and have potential applications in various fields such as rehabilitation, affective computing, robotics, gaming, and neuroscience. Significant research efforts on a global scale have delivered common platforms for technology standardization and help tackle highly complex and non-linear brain dynamics and related feature extraction and classification challenges. Time-variant psycho-neurophysiological fluctuations and their impact on brain signals impose another challenge for BCI researchers to transform the technology from laboratory experiments to plug-and-play daily life. This review summarizes state-of-the-art progress in the BCI field over the last decades and highlights critical challenges.
Collapse
Affiliation(s)
- Simanto Saha
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Khondaker A. Mamun
- Advanced Intelligent Multidisciplinary Systems (AIMS) Lab, Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh
| | - Khawza Ahmed
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Raqibul Mostafa
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Ganesh R. Naik
- Adelaide Institute for Sleep Health, College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| | - Sam Darvishi
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| | - Ahsan H. Khandoker
- Healthcare Engineering Innovation Center, Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Mathias Baumert
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
8
|
Gatzke-Kopp LM, Benson L, Ryan PJ, Ram N. Cortical and affective regulation of autonomic coordination. Psychophysiology 2020; 57:e13544. [PMID: 32039482 DOI: 10.1111/psyp.13544] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2019] [Revised: 12/16/2019] [Accepted: 01/16/2020] [Indexed: 12/13/2022]
Abstract
Although anatomical research clearly demonstrates the ability of the sympathetic and parasympathetic branches of the autonomic nervous system to independently influence cardiac function, little research has examined whether coordinated activation is typical or whether the extent of autonomic coordination is situationally dependent. This study examines the extent of coordination between sympathetic (cardiac pre-ejection period: PEP) and parasympathetic (respiratory sinus arrhythmia: RSA) influences on the cardiac function to determine whether coordination is a trait-like between-person characteristic or a state-varying within-person phenomenon, and if so, whether variability in autonomic coordination is modulated by cognitive (P3b amplitude) or affective state. Kindergarten-aged children (n = 257) completed a go/no-go task administered in blocks designed to induce affective states through the delivery of reward (Blocks 1 and 3) and frustration (Block 2). Results from multilevel models that allowed for the simultaneous examination of between-person and within-person associations in the repeated measures data suggested that (a) children with higher overall RSA also tended to have higher overall PEP; (b) at within-person level, RSA and PEP tended to be reciprocally coordinated; but that (c) when frustration invokes cognitive disengagement, coordination between parasympathetic and sympathetic systems demonstrate compensatory coordination. These findings highlight the extent to which the coordination of autonomic systems is a dynamic state-like phenomenon rather than a trait-like individual differences characteristic.
Collapse
Affiliation(s)
- Lisa M Gatzke-Kopp
- Human Development and Family Studies, The Pennsylvania State University, University Park, PA, USA
| | - Lizbeth Benson
- Human Development and Family Studies, The Pennsylvania State University, University Park, PA, USA
| | - Patrick J Ryan
- Human Development and Family Studies, The Pennsylvania State University, University Park, PA, USA
| | - Nilam Ram
- Human Development and Family Studies, The Pennsylvania State University, University Park, PA, USA
| |
Collapse
|
9
|
Badesa FJ, Diez JA, Catalan JM, Trigili E, Cordella F, Nann M, Crea S, Soekadar SR, Zollo L, Vitiello N, Garcia-Aracil N. Physiological Responses During Hybrid BNCI Control of an Upper-Limb Exoskeleton. SENSORS (BASEL, SWITZERLAND) 2019; 19:E4931. [PMID: 31726745 PMCID: PMC6891352 DOI: 10.3390/s19224931] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2019] [Revised: 10/30/2019] [Accepted: 11/05/2019] [Indexed: 11/20/2022]
Abstract
When combined with assistive robotic devices, such as wearable robotics, brain/neural-computer interfaces (BNCI) have the potential to restore the capabilities of handicapped people to carry out activities of daily living. To improve applicability of such systems, workload and stress should be reduced to a minimal level. Here, we investigated the user's physiological reactions during the exhaustive use of the interfaces of a hybrid control interface. Eleven BNCI-naive healthy volunteers participated in the experiments. All participants sat in a comfortable chair in front of a desk and wore a whole-arm exoskeleton as well as wearable devices for monitoring physiological, electroencephalographic (EEG) and electrooculographic (EoG) signals. The experimental protocol consisted of three phases: (i) Set-up, calibration and BNCI training; (ii) Familiarization phase; and (iii) Experimental phase during which each subject had to perform EEG and EoG tasks. After completing each task, the NASA-TLX questionnaire and self-assessment manikin (SAM) were completed by the user. We found significant differences (p-value < 0.05) in heart rate variability (HRV) and skin conductance level (SCL) between participants during the use of the two different biosignal modalities (EEG, EoG) of the BNCI. This indicates that EEG control is associated with a higher level of stress (associated with a decrease in HRV) and mental work load (associated with a higher level of SCL) when compared to EoG control. In addition, HRV and SCL modulations correlated with the subject's workload perception and emotional responses assessed through NASA-TLX questionnaires and SAM.
Collapse
Affiliation(s)
- Francisco J. Badesa
- Miguel Hernández University of Elche, Av. Universidad w/n, Ed. Innova, 03202 Alicante, Spain; (J.M.C.); (N.G.-A.)
- Universidad de Cádiz, Av. de la Universidad n10, 11519 Puerto Real, Spain
- New technologies for Neurorehabilitation Lab., Av. de la Hospitalidad, s/n, 28054 Madrid, Spain
| | - Jorge A. Diez
- Miguel Hernández University of Elche, Av. Universidad w/n, Ed. Innova, 03202 Alicante, Spain; (J.M.C.); (N.G.-A.)
- New technologies for Neurorehabilitation Lab., Av. de la Hospitalidad, s/n, 28054 Madrid, Spain
| | - Jose Maria Catalan
- Miguel Hernández University of Elche, Av. Universidad w/n, Ed. Innova, 03202 Alicante, Spain; (J.M.C.); (N.G.-A.)
- New technologies for Neurorehabilitation Lab., Av. de la Hospitalidad, s/n, 28054 Madrid, Spain
| | - Emilio Trigili
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Viale Rinaldo Piaggio 34, 56025 Pontedera, Pisa, Italy; (E.T.); (S.C.); (N.V.)
| | - Francesca Cordella
- Unit of Advanced Robotics and Human-centred Technologies, Campus Bio-Medico University of Rome, 00128 Rome, Italy; (F.C.); (L.Z.)
| | - Marius Nann
- Applied Neurotechnology Laboratory, Department of Psychiatry and Psychotherapy, University Hopsital of Tübingen, Calwerstr. 14, 72076 Tübingen, Germany;
| | - Simona Crea
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Viale Rinaldo Piaggio 34, 56025 Pontedera, Pisa, Italy; (E.T.); (S.C.); (N.V.)
- IRCCS Fondazione Don Carlo Gnocchi, Via Alfonso Capecelatro 66, 20148 Milan, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pontedera, Pisa, Italy
| | - Surjo R. Soekadar
- Clinical Neurotechnology Laboratory, Department of Psychiatry and Psychotherapy (CCM), Charité-Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany;
| | - Loredana Zollo
- Unit of Advanced Robotics and Human-centred Technologies, Campus Bio-Medico University of Rome, 00128 Rome, Italy; (F.C.); (L.Z.)
| | - Nicola Vitiello
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Viale Rinaldo Piaggio 34, 56025 Pontedera, Pisa, Italy; (E.T.); (S.C.); (N.V.)
- IRCCS Fondazione Don Carlo Gnocchi, Via Alfonso Capecelatro 66, 20148 Milan, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pontedera, Pisa, Italy
| | - Nicolas Garcia-Aracil
- Miguel Hernández University of Elche, Av. Universidad w/n, Ed. Innova, 03202 Alicante, Spain; (J.M.C.); (N.G.-A.)
- New technologies for Neurorehabilitation Lab., Av. de la Hospitalidad, s/n, 28054 Madrid, Spain
| |
Collapse
|
10
|
Won K, Kwon M, Jang S, Ahn M, Jun SC. P300 Speller Performance Predictor Based on RSVP Multi-feature. Front Hum Neurosci 2019; 13:261. [PMID: 31417382 PMCID: PMC6682684 DOI: 10.3389/fnhum.2019.00261] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2019] [Accepted: 07/11/2019] [Indexed: 12/14/2022] Open
Abstract
Brain-computer interface (BCI) systems were developed so that people can control computers or machines through their brain activity without moving their limbs. The P300 speller is one of the BCI applications used most commonly, as is very simple and reliable and can achieve satisfactory performance. However, like other BCIs, the P300 speller still has room for improvements in terms of its practical use, for example, selecting the best compromise between spelling accuracy and information transfer rate (ITR; speed) so that the P300 speller can maintain high accuracy while increasing spelling speed. Therefore, seeking correlates of, and predicting, the P300 speller's performance is necessary to understand and improve the technique. In this work, we investigated the correlations between rapid serial visual presentation (RSVP) task features and the P300 speller's performance. Fifty-five subjects participated in the RSVP and conventional matrix P300 speller tasks and RSVP behavioral and electroencephalography (EEG) features were compared in the P300's speller performance. We found that several of the RSVP's event-related potential (ERP) and behavioral features were correlated with the P300 speller's offline binary classification accuracy. Using these features, we propose a simple multi-feature performance predictor (r = 0.53, p = 0.0001) that outperforms any single feature performance predictor, including that of the conventional RSVP T1% predictor (r = 0.28, p = 0.06). This result demonstrates that selective multi-features can predict BCI performance better than a single feature alone.
Collapse
Affiliation(s)
- Kyungho Won
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Moonyoung Kwon
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Sehyeon Jang
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Minkyu Ahn
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Sung Chan Jun
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| |
Collapse
|
11
|
Spangler DP, Gamble KR, McGinley JJ, Thayer JF, Brooks JR. Intra-Individual Variability in Vagal Control Is Associated With Response Inhibition Under Stress. Front Hum Neurosci 2018; 12:475. [PMID: 30542274 PMCID: PMC6277930 DOI: 10.3389/fnhum.2018.00475] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2018] [Accepted: 11/12/2018] [Indexed: 11/13/2022] Open
Abstract
Dynamic intra-individual variability (IIV) in cardiac vagal control across multiple situations is believed to contribute to adaptive cognition under stress; however, a dearth of research has empirically tested this notion. To this end, we examined 25 U.S. Army Soldiers (all male, mean age = 30.73, standard deviation (SD) = 7.71) whose high-frequency heart rate variability (HF-HRV) was measured during a resting baseline and during three conditions of a shooting task (training, low stress, high stress). Response inhibition was measured as the correct rejection (CR) of friendly targets during the low and high stress conditions. We tested the association between the SD of HF-HRV across all four task conditions (IIV in vagal control) and changes in response inhibition between low and high stress. Greater differences in vagal control between conditions (larger IIV) were associated with higher tonic vagal control during rest, and stronger stress-related decreases in response inhibition. These results suggest that flexibility in vagal control is supported by tonic vagal control, but this flexibility also uniquely relates to adaptive cognition under stress. Findings are consistent with neurobehavioral and dynamical systems theories of vagal function.
Collapse
Affiliation(s)
- Derek P Spangler
- Human Research & Engineering Directorate, U.S. Army Research Laboratory, Aberdeen, MD, United States
| | - Katherine R Gamble
- Human Research & Engineering Directorate, U.S. Army Research Laboratory, Aberdeen, MD, United States
| | - Jared J McGinley
- Department of Psychology, Towson University, Towson, MD, United States
| | - Julian F Thayer
- Department of Psychology, The Ohio State University, Columbus, OH, United States
| | - Justin R Brooks
- Human Research & Engineering Directorate, U.S. Army Research Laboratory, Aberdeen, MD, United States
| |
Collapse
|
12
|
Hammer EM, Halder S, Kleih SC, Kübler A. Psychological Predictors of Visual and Auditory P300 Brain-Computer Interface Performance. Front Neurosci 2018; 12:307. [PMID: 29867319 PMCID: PMC5960704 DOI: 10.3389/fnins.2018.00307] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2017] [Accepted: 04/20/2018] [Indexed: 12/13/2022] Open
Abstract
Brain-Computer Interfaces (BCIs) provide communication channels independent from muscular control. In the current study we used two versions of the P300-BCI: one based on visual the other on auditory stimulation. Up to now, data on the impact of psychological variables on P300-BCI control are scarce. Hence, our goal was to identify new predictors with a comprehensive psychological test-battery. A total of N = 40 healthy BCI novices took part in a visual and an auditory BCI session. Psychological variables were measured with an electronic test-battery including clinical, personality, and performance tests. The personality factor "emotional stability" was negatively correlated (Spearman's rho = -0.416; p < 0.01) and an output variable of the non-verbal learning test (NVLT), which can be interpreted as ability to learn, correlated positively (Spearman's rho = 0.412; p < 0.01) with visual P300-BCI performance. In a linear regression analysis both independent variables explained 24% of the variance. "Emotional stability" was also negatively related to auditory P300-BCI performance (Spearman's rho = -0.377; p < 0.05), but failed significance in the regression analysis. Psychological parameters seem to play a moderate role in visual P300-BCI performance. "Emotional stability" was identified as a new predictor, indicating that BCI users who characterize themselves as calm and rational showed worse BCI performance. The positive relation of the ability to learn and BCI performance corroborates the notion that also for P300 based BCIs learning may constitute an important factor. Further studies are needed to consolidate or reject the presented predictors.
Collapse
Affiliation(s)
| | | | | | - Andrea Kübler
- Institute of Psychology, University of Würzburg, Würzburg, Germany
| |
Collapse
|
13
|
Scheuren R, Sütterlin S, Anton F. Vagally Mediated Heart Rate Variability Promotes the Perception of Paradoxical Pain. J PSYCHOPHYSIOL 2017. [DOI: 10.1027/0269-8803/a000175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Abstract. Self-regulation mechanisms are governed by prefrontal inhibitory processes and play a crucial role in the modulation of pain. In the present study the thermal grill paradigm was used to investigate the association of vagally mediated resting heart rate variability, a psychophysiological marker of trait self-regulatory capacity, with paradoxical pain sensations induced by non-noxious stimulation. This thermal grill illusion is only perceived by part of the tested individuals. The mechanisms underlying the observed interindividual differences in paradoxical pain sensitivity are largely unknown. During the experimental task, a temperature combination of 15 °C and 41 °C was set at the glass tubes of the thermal grill. The 52 healthy participants placed their dominant hand on the grill for a duration of one min. The magnitude of sensory and affective pain sensations perceived during stimulation was assessed with numerical rating scales. Before stimulation, a short-term electrocardiogram was recorded to compute vagally mediated heart rate variability at rest. Logistic regression analyses revealed that participants with higher vagal tone were significantly more likely to perceive the thermal grill illusion than subjects displaying lower resting heart rate variability. Paradoxical pain sensations were primarily predicted by normalized respiratory sinus arrhythmia. Our results confirm that the magnitude of vagally mediated resting heart rate variability is associated with the individual disposition to illusive pain perceptions. Since the latter is considered to be a marker of trait self-regulation ability, the present findings may corroborate and complement previous evidence for an impact of psychological characteristics on paradoxical pain sensitivity.
Collapse
Affiliation(s)
- Raymonde Scheuren
- Institute for Health and Behavior, Integrative Research Unit on Social and Individual Development (INSIDE), University of Luxembourg, Esch-Alzette, Luxembourg
| | - Stefan Sütterlin
- Section of Psychology, Lillehammer University College, Norway
- Department of Psychosomatic Medicine, Division of Surgery and Clinical Neuroscience, Oslo University Hospital – Rikshospitalet, Oslo, Norway
| | - Fernand Anton
- Institute for Health and Behavior, Integrative Research Unit on Social and Individual Development (INSIDE), University of Luxembourg, Esch-Alzette, Luxembourg
| |
Collapse
|
14
|
Chavarriaga R, Fried-Oken M, Kleih S, Lotte F, Scherer R. Heading for new shores! Overcoming pitfalls in BCI design. BRAIN-COMPUTER INTERFACES 2016; 4:60-73. [PMID: 29629393 DOI: 10.1080/2326263x.2016.1263916] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Research in brain-computer interfaces has achieved impressive progress towards implementing assistive technologies for restoration or substitution of lost motor capabilities, as well as supporting technologies for able-bodied subjects. Notwithstanding this progress, effective translation of these interfaces from proof-of concept prototypes into reliable applications remains elusive. As a matter of fact, most of the current BCI systems cannot be used independently for long periods of time by their intended end-users. Multiple factors that impair achieving this goal have already been identified. However, it is not clear how do they affect the overall BCI performance or how they should be tackled. This is worsened by the publication bias where only positive results are disseminated, preventing the research community from learning from its errors. This paper is the result of a workshop held at the 6th International BCI meeting in Asilomar. We summarize here the discussion on concrete research avenues and guidelines that may help overcoming common pitfalls and make BCIs become a useful alternative communication device.
Collapse
Affiliation(s)
- Ricardo Chavarriaga
- Defitech Chair in Brain-Machine Interface (CNBI), Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Switzerland
| | - Melanie Fried-Oken
- Oregon Health & Science University, Institute on Development and Disability, Portland, Oregon USA
| | - Sonja Kleih
- Institute of Psychology, University of Würzburg, Marcusstraße 9-11, Würzburg, 97070, Germany
| | - Fabien Lotte
- Inria Bordeaux Sud-Ouest/LaBRI, 200 avenue de la vieille tour, 33405, Talence cedex, France
| | - Reinhold Scherer
- Institute of Neural Engineering, BCI-Lab, Graz University of Technology, Stremayrgasse 16/IV, 8010 Graz, Austria
| |
Collapse
|
15
|
Beffara B, Bret AG, Vermeulen N, Mermillod M. Resting high frequency heart rate variability selectively predicts cooperative behavior. Physiol Behav 2016; 164:417-28. [PMID: 27343804 DOI: 10.1016/j.physbeh.2016.06.011] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2016] [Revised: 06/02/2016] [Accepted: 06/11/2016] [Indexed: 01/07/2023]
Abstract
This study explores whether the vagal connection between the heart and the brain is involved in prosocial behaviors. The Polyvagal Theory postulates that vagal activity underlies prosocial tendencies. Even if several results suggest that vagal activity is associated with prosocial behaviors, none of them used behavioral measures of prosociality to establish this relationship. We recorded the resting state vagal activity (reflected by High Frequency Heart Rate Variability, HF-HRV) of 48 (42 suitale for analysis) healthy human adults and measured their level of cooperation during a hawk-dove game. We also manipulated the consequence of mutual defection in the hawk-dove game (severe vs. moderate). Results show that HF-HRV is positively and linearly related to cooperation level, but only when the consequence of mutual defection is severe (compared to moderate). This supports that i) prosocial behaviors are likely to be underpinned by vagal functioning ii) physiological disposition to cooperate interacts with environmental context. We discuss these results within the theoretical framework of the Polyvagal Theory.
Collapse
Affiliation(s)
- Brice Beffara
- Univ. Grenoble Alpes, LPNC, F-38040, Grenoble, France; CNRS, LPNC UMR 5105, F-38040, Grenoble, France; IPSY, Université Catholique de Louvain, Louvain-la-Neuve, Belgium.
| | - Amélie G Bret
- Univ. Grenoble Alpes, LPNC, F-38040, Grenoble, France; CNRS, LPNC UMR 5105, F-38040, Grenoble, France; IPSY, Université Catholique de Louvain, Louvain-la-Neuve, Belgium
| | - Nicolas Vermeulen
- IPSY, Université Catholique de Louvain, Louvain-la-Neuve, Belgium; Fund for Scientific Research (FRS-FNRS), Brussels, Belgium
| | - Martial Mermillod
- Univ. Grenoble Alpes, LPNC, F-38040, Grenoble, France; CNRS, LPNC UMR 5105, F-38040, Grenoble, France; Institut Universitaire de France, Paris, France
| |
Collapse
|
16
|
Meessen J, Mainz V, Gauggel S, Volz-Sidiropoulou E, Sütterlin S, Forkmann T. The Relationship Between Interoception and Metacognition. J PSYCHOPHYSIOL 2016. [DOI: 10.1027/0269-8803/a000157] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Abstract. Recently, Garfinkel and Critchley (2013) proposed to distinguish between three facets of interoception: interoceptive sensibility, interoceptive accuracy, and interoceptive awareness. This pilot study investigated how these facets interrelate to each other and whether interoceptive awareness is related to the metacognitive awareness of memory performance. A sample of 24 healthy students completed a heartbeat perception task (HPT) and a memory task. Judgments of confidence were requested for each task. Participants filled in questionnaires assessing interoceptive sensibility, depression, anxiety, and socio-demographic characteristics. The three facets of interoception were found to be uncorrelated and interoceptive awareness was not related to metacognitive awareness of memory performance. Whereas memory performance was significantly related to metamemory awareness, interoceptive accuracy (HPT) and interoceptive awareness were not correlated. Results suggest that future research on interoception should assess all facets of interoception in order to capture the multifaceted quality of the construct.
Collapse
Affiliation(s)
- Judith Meessen
- Institute of Medical Psychology and Medical Sociology, University Hospital of RWTH Aachen University, Germany
| | - Verena Mainz
- Institute of Medical Psychology and Medical Sociology, University Hospital of RWTH Aachen University, Germany
| | - Siegfried Gauggel
- Institute of Medical Psychology and Medical Sociology, University Hospital of RWTH Aachen University, Germany
| | - Eftychia Volz-Sidiropoulou
- Institute of Medical Psychology and Medical Sociology, University Hospital of RWTH Aachen University, Germany
| | - Stefan Sütterlin
- Section of Psychology, Lillehammer University College, Norway
- Department of Psychosomatic Medicine, Division of Surgery and Clinical Neuroscience, Oslo University Hospital – Rikshospitalet, Norway
| | - Thomas Forkmann
- Institute of Medical Psychology and Medical Sociology, University Hospital of RWTH Aachen University, Germany
| |
Collapse
|
17
|
Zahn D, Adams J, Krohn J, Wenzel M, Mann CG, Gomille LK, Jacobi-Scherbening V, Kubiak T. Heart rate variability and self-control--A meta-analysis. Biol Psychol 2015; 115:9-26. [PMID: 26747415 DOI: 10.1016/j.biopsycho.2015.12.007] [Citation(s) in RCA: 94] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2015] [Revised: 12/11/2015] [Accepted: 12/21/2015] [Indexed: 10/22/2022]
Abstract
Heart rate variability (HRV) has been suggested as a biological correlate of self-control. Whereas many studies found a relationship between HRV at rest and self-control, effect sizes vary substantially across studies in magnitude and direction. This meta-analysis evaluated the association between HRV at rest and self-control in laboratory tasks, with a particular focus on the identification of moderating factors (task characteristics, methodological aspects of HRV assessment, demographics). Overall, 24 articles with 26 studies and 132 effects (n=2317, mean age=22.44, range 18.4-57.8) were integrated (random effects model with robust variance estimation). We found a positive average effect of r=0.15, 95% CI [0.088; 0.221], p<0.001 with a moderate heterogeneity (I(2)=56.10%), but observed evidence of publication bias. Meta-regressions did not reveal significant moderators. Due to the presence of potential publication bias, our results have to be interpreted cautiously.
Collapse
Affiliation(s)
- Daniela Zahn
- Johannes Gutenberg-University Mainz, Health Psychology, Binger Str. 14-16, D-55122 Mainz, Germany.
| | - Johanna Adams
- Johannes Gutenberg-University Mainz, Health Psychology, Binger Str. 14-16, D-55122 Mainz, Germany; University Medicine, Johannes Gutenberg-University Mainz, Institute for Teachers' Health, University Medical Center of the Johannes Gutenberg-University Mainz, Kupferbergterrasse 17-19, D-55116 Mainz, Germany
| | - Jeanette Krohn
- Johannes Gutenberg-University Mainz, Personality Psychology and Psychological Assessment, Johannes Gutenberg-University Mainz, Binger Str. 14-16, D-55122 Mainz, Germany
| | - Mario Wenzel
- Johannes Gutenberg-University Mainz, Health Psychology, Binger Str. 14-16, D-55122 Mainz, Germany
| | - Caroline G Mann
- Johannes Gutenberg-University Mainz, Health Psychology, Binger Str. 14-16, D-55122 Mainz, Germany
| | - Lara K Gomille
- Johannes Gutenberg-University Mainz, Health Psychology, Binger Str. 14-16, D-55122 Mainz, Germany
| | - Vera Jacobi-Scherbening
- Johannes Gutenberg-University Mainz, Health Psychology, Binger Str. 14-16, D-55122 Mainz, Germany
| | - Thomas Kubiak
- Johannes Gutenberg-University Mainz, Health Psychology, Binger Str. 14-16, D-55122 Mainz, Germany
| |
Collapse
|
18
|
Ron-Angevin R, Varona-Moya S, Silva-Sauer LD. Initial test of a T9-like P300-based speller by an ALS patient. J Neural Eng 2015; 12:046023. [DOI: 10.1088/1741-2560/12/4/046023] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
19
|
Ahn M, Jun SC. Performance variation in motor imagery brain–computer interface: A brief review. J Neurosci Methods 2015; 243:103-10. [PMID: 25668430 DOI: 10.1016/j.jneumeth.2015.01.033] [Citation(s) in RCA: 145] [Impact Index Per Article: 16.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2014] [Revised: 01/09/2015] [Accepted: 01/30/2015] [Indexed: 11/29/2022]
Affiliation(s)
- Minkyu Ahn
- Department of Neuroscience, Brown University, Providence, RI 02912, United States
| | - Sung Chan Jun
- School of Information and Communications, Gwangju Institute of Science and Technology, Gwangju 500-712, South Korea.
| |
Collapse
|
20
|
Bamdad M, Zarshenas H, Auais MA. Application of BCI systems in neurorehabilitation: a scoping review. Disabil Rehabil Assist Technol 2015; 10:355-64. [PMID: 25560222 DOI: 10.3109/17483107.2014.961569] [Citation(s) in RCA: 42] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
PURPOSE To review various types of electroencephalographic activities of the brain and present an overview of brain-computer interface (BCI) systems' history and their applications in rehabilitation. METHODS A scoping review of published English literature on BCI application in the field of rehabilitation was undertaken. IEEE Xplore, ScienceDirect, Google Scholar and Scopus databases were searched since inception up to August 2012. All experimental studies published in English and discussed complete cycle of the BCI process was included in the review. RESULTS AND DISCUSSION In total, 90 articles met the inclusion criteria and were reviewed. Various approaches that improve the accuracy and performance of BCI systems were discussed. Based on BCI's clinical application, reviewed articles were categorized into three groups: motion rehabilitation, speech rehabilitation and virtual reality control (VRC). Almost half of the reviewed papers (48%) concentrated on VRC. Speech rehabilitation and motion rehabilitation made up 33% and 19% of the reviewed papers, respectively. Among different types of electroencephalography signals, P300, steady state visual evoked potentials and motor imagery signals were the most common. CONCLUSIONS This review discussed various applications of BCI in rehabilitation and showed how BCI can be used to improve the quality of life for people with neurological disabilities. It will develop and promote new models of communication and finally, will create an accurate, reliable, online communication between human brain and computer and reduces the negative effects of external stimuli on BCI performance. Implications for Rehabilitation The field of brain-computer interfaces (BCI) is rapidly advancing and it is expected to fulfill a critical role in rehabilitation of neurological disorders and in movement restoration in the forthcoming years. In the near future, BCI has notable potential to become a major tool used by people with disabilities to control locomotion and communicate with surrounding environment and, consequently, improve the quality of life for many affected persons. Electrical field recording at the scalp (i.e. electroencephalography) is the most likely method to be of practical value for clinical use as it is simple and non-invasive. However, some aspects need future improvements, such as the ability to separate close imagery signal (motion of extremities and phalanges that are close together).
Collapse
Affiliation(s)
- Mahdi Bamdad
- Mechanical Engineering Department, Biomechatronic Research Lab, Shahrood University of Technology , Shahrood , Iran and
| | | | | |
Collapse
|
21
|
Pappens M, Schroijen M, Sütterlin S, Smets E, Van den Bergh O, Thayer JF, Van Diest I. Resting heart rate variability predicts safety learning and fear extinction in an interoceptive fear conditioning paradigm. PLoS One 2014; 9:e105054. [PMID: 25181542 PMCID: PMC4152223 DOI: 10.1371/journal.pone.0105054] [Citation(s) in RCA: 61] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2014] [Accepted: 07/18/2014] [Indexed: 01/21/2023] Open
Abstract
This study aimed to investigate whether interindividual differences in autonomic inhibitory control predict safety learning and fear extinction in an interoceptive fear conditioning paradigm. Data from a previously reported study (N = 40) were extended (N = 17) and re-analyzed to test whether healthy participants' resting heart rate variability (HRV) - a proxy of cardiac vagal tone - predicts learning performance. The conditioned stimulus (CS) was a slight sensation of breathlessness induced by a flow resistor, the unconditioned stimulus (US) was an aversive short-lasting suffocation experience induced by a complete occlusion of the breathing circuitry. During acquisition, the paired group received 6 paired CS-US presentations; the control group received 6 explicitly unpaired CS-US presentations. In the extinction phase, both groups were exposed to 6 CS-only presentations. Measures included startle blink EMG, skin conductance responses (SCR) and US-expectancy ratings. Resting HRV significantly predicted the startle blink EMG learning curves both during acquisition and extinction. In the unpaired group, higher levels of HRV at rest predicted safety learning to the CS during acquisition. In the paired group, higher levels of HRV were associated with better extinction. Our findings suggest that the strength or integrity of prefrontal inhibitory mechanisms involved in safety- and extinction learning can be indexed by HRV at rest.
Collapse
Affiliation(s)
- Meike Pappens
- Research Group on Health Psychology, KU Leuven, Leuven, Belgium
| | | | - Stefan Sütterlin
- Research Group on Health Psychology, KU Leuven, Leuven, Belgium
- Section of Psychology, Lillehammer University College, Lillehammer, Norway
- Department of Psychosomatic Medicine, Division of Surgery and Clinical Neuroscience, Oslo University Hospital - Rikshospitalet, Oslo, Norway
| | - Elyn Smets
- Research Group on Health Psychology, KU Leuven, Leuven, Belgium
| | | | - Julian F. Thayer
- Dept. of Psychology, Ohio State University, Columbia, Ohio, United States of America
| | - Ilse Van Diest
- Research Group on Health Psychology, KU Leuven, Leuven, Belgium
- * E-mail:
| |
Collapse
|
22
|
Friedrich EVC, Suttie N, Sivanathan A, Lim T, Louchart S, Pineda JA. Brain-computer interface game applications for combined neurofeedback and biofeedback treatment for children on the autism spectrum. FRONTIERS IN NEUROENGINEERING 2014; 7:21. [PMID: 25071545 PMCID: PMC4080880 DOI: 10.3389/fneng.2014.00021] [Citation(s) in RCA: 56] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/03/2014] [Accepted: 06/13/2014] [Indexed: 11/23/2022]
Abstract
Individuals with autism spectrum disorder (ASD) show deficits in social and communicative skills, including imitation, empathy, and shared attention, as well as restricted interests and repetitive patterns of behaviors. Evidence for and against the idea that dysfunctions in the mirror neuron system are involved in imitation and could be one underlying cause for ASD is discussed in this review. Neurofeedback interventions have reduced symptoms in children with ASD by self-regulation of brain rhythms. However, cortical deficiencies are not the only cause of these symptoms. Peripheral physiological activity, such as the heart rate and its variability, is closely linked to neurophysiological signals and associated with social engagement. Therefore, a combined approach targeting the interplay between brain, body, and behavior could be more effective. Brain–computer interface applications for combined neurofeedback and biofeedback treatment for children with ASD are currently nonexistent. To facilitate their use, we have designed an innovative game that includes social interactions and provides neural- and body-based feedback that corresponds directly to the underlying significance of the trained signals as well as to the behavior that is reinforced.
Collapse
Affiliation(s)
| | - Neil Suttie
- School of Mathematical and Computer Sciences, Heriot-Watt University Edinburgh, UK
| | | | - Theodore Lim
- School of Engineering and Physical Science, Heriot-Watt University Edinburgh, UK
| | - Sandy Louchart
- School of Mathematical and Computer Sciences, Heriot-Watt University Edinburgh, UK
| | - Jaime A Pineda
- Department of Cognitive Science, University of California, San Diego La Jolla, CA, USA
| |
Collapse
|
23
|
Akcakaya M, Peters B, Moghadamfalahi M, Mooney AR, Orhan U, Oken B, Erdogmus D, Fried-Oken M. Noninvasive brain-computer interfaces for augmentative and alternative communication. IEEE Rev Biomed Eng 2014; 7:31-49. [PMID: 24802700 PMCID: PMC6525622 DOI: 10.1109/rbme.2013.2295097] [Citation(s) in RCA: 66] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Brain-computer interfaces (BCIs) promise to provide a novel access channel for assistive technologies, including augmentative and alternative communication (AAC) systems, to people with severe speech and physical impairments (SSPI). Research on the subject has been accelerating significantly in the last decade and the research community took great strides toward making BCI-AAC a practical reality to individuals with SSPI. Nevertheless, the end goal has still not been reached and there is much work to be done to produce real-world-worthy systems that can be comfortably, conveniently, and reliably used by individuals with SSPI with help from their families and care givers who will need to maintain, setup, and debug the systems at home. This paper reviews reports in the BCI field that aim at AAC as the application domain with a consideration on both technical and clinical aspects.
Collapse
|
24
|
Riccio A, Simione L, Schettini F, Pizzimenti A, Inghilleri M, Belardinelli MO, Mattia D, Cincotti F. Attention and P300-based BCI performance in people with amyotrophic lateral sclerosis. Front Hum Neurosci 2013; 7:732. [PMID: 24282396 PMCID: PMC3825256 DOI: 10.3389/fnhum.2013.00732] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2013] [Accepted: 10/13/2013] [Indexed: 11/13/2022] Open
Abstract
The purpose of this study was to investigate the support of attentional and memory processes in controlling a P300-based brain-computer interface (BCI) in people with amyotrophic lateral sclerosis (ALS). Eight people with ALS performed two behavioral tasks: (i) a rapid serial visual presentation (RSVP) task, screening the temporal filtering capacity and the speed of the update of the attentive filter, and (ii) a change detection task, screening the memory capacity and the spatial filtering capacity. The participants were also asked to perform a P300-based BCI spelling task. By using correlation and regression analyses, we found that only the temporal filtering capacity in the RSVP task was a predictor of both the P300-based BCI accuracy and of the amplitude of the P300 elicited performing the BCI task. We concluded that the ability to keep the attentional filter active during the selection of a target influences performance in BCI control.
Collapse
Affiliation(s)
- Angela Riccio
- 1Neuroelectrical Imaging and BCI Laboratory, Fondazione Santa Lucia Rome, Italy ; 2Department of Psychology, Sapienza University of Rome Rome, Italy
| | | | | | | | | | | | | | | |
Collapse
|
25
|
Halder S, Ruf CA, Furdea A, Pasqualotto E, De Massari D, van der Heiden L, Bogdan M, Rosenstiel W, Birbaumer N, Kübler A, Matuz T. Prediction of P300 BCI aptitude in severe motor impairment. PLoS One 2013; 8:e76148. [PMID: 24204597 PMCID: PMC3799852 DOI: 10.1371/journal.pone.0076148] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2013] [Accepted: 08/20/2013] [Indexed: 12/14/2022] Open
Abstract
Brain-computer interfaces (BCIs) provide a non-muscular communication channel for persons with severe motor impairments. Previous studies have shown that the aptitude with which a BCI can be controlled varies from person to person. A reliable predictor of performance could facilitate selection of a suitable BCI paradigm. Eleven severely motor impaired participants performed three sessions of a P300 BCI web browsing task. Before each session auditory oddball data were collected to predict the BCI aptitude of the participants exhibited in the current session. We found a strong relationship of early positive and negative potentials around 200 ms (elicited with the auditory oddball task) with performance. The amplitude of the P2 (r = −0.77) and of the N2 (r = −0.86) had the strongest correlations. Aptitude prediction using an auditory oddball was successful. The finding that the N2 amplitude is a stronger predictor of performance than P3 amplitude was reproduced after initially showing this effect with a healthy sample of BCI users. This will reduce strain on the end-users by minimizing the time needed to find suitable paradigms and inspire new approaches to improve performance.
Collapse
Affiliation(s)
- Sebastian Halder
- Institute of Psychology, University of Würzburg, Würzburg, Germany
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
- Department of Computer Engineering, University of Tübingen, Tübingen, Germany
- * E-mail:
| | - Carolin Anne Ruf
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Adrian Furdea
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Emanuele Pasqualotto
- Psychological Sciences Research Institute, Université catholique de Louvain, Louvain-la-neuve, Belgium
| | - Daniele De Massari
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
- Ospedale San Camillo, Istituto Di Ricovero e Cura a Carattere Scientifico Fondazione, Venezia-Lido, Italy
- Graduate Training Centre of Neuroscience, International Max Planck Research School, Tübingen, Germany
| | - Linda van der Heiden
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
- Department of Cognitive Psychology, University of Finance and Management, Warsaw, Poland
| | - Martin Bogdan
- Department of Computer Engineering, University of Tübingen, Tübingen, Germany
- Computer Engineering, University of Leipzig, Leipzig, Germany
| | - Wolfgang Rosenstiel
- Department of Computer Engineering, University of Tübingen, Tübingen, Germany
| | - Niels Birbaumer
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
- Ospedale San Camillo, Istituto Di Ricovero e Cura a Carattere Scientifico Fondazione, Venezia-Lido, Italy
| | - Andrea Kübler
- Institute of Psychology, University of Würzburg, Würzburg, Germany
| | - Tamara Matuz
- Institute of Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| |
Collapse
|
26
|
Kaufmann T, Holz EM, Kübler A. Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state. Front Neurosci 2013; 7:129. [PMID: 23898236 PMCID: PMC3721006 DOI: 10.3389/fnins.2013.00129] [Citation(s) in RCA: 99] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2013] [Accepted: 07/05/2013] [Indexed: 12/03/2022] Open
Abstract
This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials (ERP) elicited in different modalities for use in brain-computer interface (BCI) systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g., partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study.
Collapse
Affiliation(s)
- Tobias Kaufmann
- Department for Psychology I, Institute for Psychology, University of Würzburg Würzburg, Germany
| | | | | |
Collapse
|
27
|
Halder S, Varkuti B, Bogdan M, Kübler A, Rosenstiel W, Sitaram R, Birbaumer N. Prediction of brain-computer interface aptitude from individual brain structure. Front Hum Neurosci 2013; 7:105. [PMID: 23565083 PMCID: PMC3613602 DOI: 10.3389/fnhum.2013.00105] [Citation(s) in RCA: 66] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2013] [Accepted: 03/13/2013] [Indexed: 12/14/2022] Open
Abstract
OBJECTIVE Brain-computer interface (BCI) provide a non-muscular communication channel for patients with impairments of the motor system. A significant number of BCI users is unable to obtain voluntary control of a BCI-system in proper time. This makes methods that can be used to determine the aptitude of a user necessary. METHODS We hypothesized that integrity and connectivity of involved white matter connections may serve as a predictor of individual BCI-performance. Therefore, we analyzed structural data from anatomical scans and DTI of motor imagery BCI-users differentiated into high and low BCI-aptitude groups based on their overall performance. RESULTS Using a machine learning classification method we identified discriminating structural brain trait features and correlated the best features with a continuous measure of individual BCI-performance. Prediction of the aptitude group of each participant was possible with near perfect accuracy (one error). CONCLUSIONS Tissue volumetric analysis yielded only poor classification results. In contrast, the structural integrity and myelination quality of deep white matter structures such as the Corpus Callosum, Cingulum, and Superior Fronto-Occipital Fascicle were positively correlated with individual BCI-performance. SIGNIFICANCE This confirms that structural brain traits contribute to individual performance in BCI use.
Collapse
Affiliation(s)
- S. Halder
- Department of Psychology I, University of WürzburgWürzburg, Germany
- Institute of Medical Psychology and Behavioral Neurobiology, University of TübingenTübingen, Germany
- Wilhelm-Schickard Institute for Computer Science, University of TübingenTübingen, Germany
| | - B. Varkuti
- Department of Psychology I, University of WürzburgWürzburg, Germany
| | - M. Bogdan
- Wilhelm-Schickard Institute for Computer Science, University of TübingenTübingen, Germany
- Department of Computer Engineering, University of LeipzigLeipzig, Germany
| | - A. Kübler
- Department of Psychology I, University of WürzburgWürzburg, Germany
| | - W. Rosenstiel
- Wilhelm-Schickard Institute for Computer Science, University of TübingenTübingen, Germany
| | - R. Sitaram
- Department of Biomedical Engineering, University of FloridaGainesville, FL, USA
| | - N. Birbaumer
- Institute of Medical Psychology and Behavioral Neurobiology, University of TübingenTübingen, Germany
- Ospedale San Camillo, Laboratorio di Neuroscience Comportamentale, Istituto di Ricovero e Cura a Carattere ScientificoVenezia, Italy
| |
Collapse
|
28
|
Fernandez-Vargas J, Pfaff HU, Rodríguez FB, Varona P. Assisted closed-loop optimization of SSVEP-BCI efficiency. Front Neural Circuits 2013; 7:27. [PMID: 23443214 PMCID: PMC3580891 DOI: 10.3389/fncir.2013.00027] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2012] [Accepted: 02/06/2013] [Indexed: 11/23/2022] Open
Abstract
We designed a novel assisted closed-loop optimization protocol to improve the efficiency of brain-computer interfaces (BCI) based on steady state visually evoked potentials (SSVEP). In traditional paradigms, the control over the BCI-performance completely depends on the subjects' ability to learn from the given feedback cues. By contrast, in the proposed protocol both the subject and the machine share information and control over the BCI goal. Generally, the innovative assistance consists in the delivery of online information together with the online adaptation of BCI stimuli properties. In our case, this adaptive optimization process is realized by (1) a closed-loop search for the best set of SSVEP flicker frequencies and (2) feedback of actual SSVEP magnitudes to both the subject and the machine. These closed-loop interactions between subject and machine are evaluated in real-time by continuous measurement of their efficiencies, which are used as online criteria to adapt the BCI control parameters. The proposed protocol aims to compensate for variability in possibly unknown subjects' state and trait dimensions. In a study with N = 18 subjects, we found significant evidence that our protocol outperformed classic SSVEP-BCI control paradigms. Evidence is presented that it takes indeed into account interindividual variabilities: e.g., under the new protocol, baseline resting state EEG measures predict subjects' BCI performances. This paper illustrates the promising potential of assisted closed-loop protocols in BCI systems. Probably their applicability might be expanded to innovative uses, e.g., as possible new diagnostic/therapeutic tools for clinical contexts and as new paradigms for basic research.
Collapse
Affiliation(s)
- Jacobo Fernandez-Vargas
- Grupo de Neurocomputación Biológica, Departamento de Ingeniería Informática, Escuela Politécnica Superior, Universidad Autónoma de Madrid Madrid, Spain
| | | | | | | |
Collapse
|
29
|
Halder S, Hammer EM, Kleih SC, Bogdan M, Rosenstiel W, Birbaumer N, Kübler A. Prediction of auditory and visual p300 brain-computer interface aptitude. PLoS One 2013; 8:e53513. [PMID: 23457444 PMCID: PMC3573031 DOI: 10.1371/journal.pone.0053513] [Citation(s) in RCA: 56] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2012] [Accepted: 11/30/2012] [Indexed: 11/18/2022] Open
Abstract
OBJECTIVE Brain-computer interfaces (BCIs) provide a non-muscular communication channel for patients with late-stage motoneuron disease (e.g., amyotrophic lateral sclerosis (ALS)) or otherwise motor impaired people and are also used for motor rehabilitation in chronic stroke. Differences in the ability to use a BCI vary from person to person and from session to session. A reliable predictor of aptitude would allow for the selection of suitable BCI paradigms. For this reason, we investigated whether P300 BCI aptitude could be predicted from a short experiment with a standard auditory oddball. METHODS Forty healthy participants performed an electroencephalography (EEG) based visual and auditory P300-BCI spelling task in a single session. In addition, prior to each session an auditory oddball was presented. Features extracted from the auditory oddball were analyzed with respect to predictive power for BCI aptitude. RESULTS Correlation between auditory oddball response and P300 BCI accuracy revealed a strong relationship between accuracy and N2 amplitude and the amplitude of a late ERP component between 400 and 600 ms. Interestingly, the P3 amplitude of the auditory oddball response was not correlated with accuracy. CONCLUSIONS Event-related potentials recorded during a standard auditory oddball session moderately predict aptitude in an audiory and highly in a visual P300 BCI. The predictor will allow for faster paradigm selection. SIGNIFICANCE Our method will reduce strain on patients because unsuccessful training may be avoided, provided the results can be generalized to the patient population.
Collapse
Affiliation(s)
- Sebastian Halder
- Institute of Psychology, University of Würzburg, Würzburg, Germany.
| | | | | | | | | | | | | |
Collapse
|
30
|
Meule A, Lutz A, Vögele C, Kübler A. Self-reported dieting success is associated with cardiac autonomic regulation in current dieters. Appetite 2012; 59:494-8. [PMID: 22750850 DOI: 10.1016/j.appet.2012.06.013] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2012] [Revised: 06/19/2012] [Accepted: 06/20/2012] [Indexed: 11/25/2022]
Abstract
Restrained eating, eating disorders and obesity have been associated with cardiac autonomic dysregulation. The current study investigated cardiac autonomic regulation in current dieters. Female students (N=50) indicated if they were currently trying to control their weight and completed the Perceived Self-Regulatory Success in Dieting Scale (PSRS). Heart beat intervals were recorded during two 10 min relaxation periods from which parameters of vagal-cardiac control (high frequency power in normalized units, HF n.u.) and sympathovagal balance (ratio of low and high frequency power, LF/HF) were calculated. In current dieters, self-reported dieting success was positively associated with HF and negatively associated with LF/HF. These associations were independent of current body-mass and food deprivation (i.e. hours since the last meal). We conclude that vagal-cardiac control reflects self-regulatory strength, rather than nutritional status, in current dieters.
Collapse
Affiliation(s)
- Adrian Meule
- Department of Psychology I, University of Würzburg, Marcusstr. 9-11, 97070 Würzburg, Germany.
| | | | | | | |
Collapse
|