1
|
|
2
|
Zhang L. EEG Signals Classification Using Machine Learning for The Identification and Diagnosis of Schizophrenia. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:4521-4524. [PMID: 31946870 DOI: 10.1109/embc.2019.8857946] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
This paper presents the design of a machine learning-based classifier for the differentiation between Schizophrenia patients and healthy controls using features extracted from electroencephalograph(EEG) signals based on event related potential(ERP). A number of features are extracted from an online EEG dataset with 81 subjects, including 32 healthy controls and 49 Schizophrenia patients. The EEG signals are preprocessed and since the dataset is relatively small, the random forest machine learning algorithm is chosen to be applied on different combinations of feature sets for classification. It is found that the classification accuracy can be improved by adding certain features extracted from EEG signals.
Collapse
|
3
|
Hou Y, Zhou L, Jia S, Lun X. A novel approach of decoding EEG four-class motor imagery tasks via scout ESI and CNN. J Neural Eng 2020; 17:016048. [PMID: 31585454 DOI: 10.1088/1741-2552/ab4af6] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
OBJECTIVE To develop and implement a novel approach which combines the technique of scout EEG source imaging (ESI) with convolutional neural network (CNN) for the classification of motor imagery (MI) tasks. APPROACH The technique of ESI uses a boundary element method (BEM) and weighted minimum norm estimation (WMNE) to solve the EEG forward and inverse problems, respectively. Ten scouts are then created within the motor cortex to select the region of interest (ROI). We extract features from the time series of scouts using a Morlet wavelet approach. Lastly, CNN is employed for classifying MI tasks. MAIN RESULTS The overall mean accuracy on the Physionet database reaches 94.5% and the individual accuracy of each task reaches 95.3%, 93.3%, 93.6%, 96% for the left fist, right fist, both fists and both feet, correspondingly, validated using ten-fold cross validation. We report an increase of up to 14.4% for overall classification compared with the competitive results from the state-of-the-art MI classification methods. Then, we add four new subjects to verify the validity of the method and the overall mean accuracy is 92.5%. Furthermore, the global classifier was adapted to single subjects improving the overall mean accuracy to 94.54%. SIGNIFICANCE The combination of scout ESI and CNN enhances BCI performance of decoding EEG four-class MI tasks.
Collapse
Affiliation(s)
- Yimin Hou
- School of Automation Engineering, Northeast Electric Power University, Jilin, People's Republic of China
| | | | | | | |
Collapse
|
4
|
Zhang X, Guo Y, Gao B, Long J. Enhancing Mu-based BCI Performance with Rhythmic Electrical Stimulation at Alpha Frequency. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:5540-5543. [PMID: 31947109 DOI: 10.1109/embc.2019.8857321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The accuracy of brain-computer interfaces (BCIs) is important for effective communication and control. The mu-based BCI is one of the widely used systems, of which the related methods to improve users' accuracy is still poorly studied. Here, we examined the way to enhance the mu-based BCI performance by rhythmic electrical stimulation on the ulnar nerve at the contralateral wrist at the alpha frequency (10 Hz) during the left-and right-hand motor imagery. Time-frequency analysis, spectral analysis, and discriminant analysis were performed on the electroencephalograph (EEG) data before and after the intervention of electrical stimulation in 9 healthy subjects. We found that the ERD/S on the somatosensory and motor cortex during left-or right-hand imagination was more obvious at the mu rhythm after intervention. Furthermore, average classification accuracy between left-and right-hand imagery significantly increased from 78.43% to 88.17% after intervention, suggesting that the electrical stimulation at alpha frequency effectively regulates the brain's mu rhythm and enhances the discriminability of the left-hand and right-hand imagination tasks. These results provide evidence that the electrical stimulation at the alpha frequency is an effective way to improve the mu-based BCI performance.
Collapse
|
5
|
Saha S, Hossain MS, Ahmed K, Mostafa R, Hadjileontiadis L, Khandoker A, Baumert M. Wavelet Entropy-Based Inter-subject Associative Cortical Source Localization for Sensorimotor BCI. Front Neuroinform 2019; 13:47. [PMID: 31396068 PMCID: PMC6664070 DOI: 10.3389/fninf.2019.00047] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2018] [Accepted: 06/11/2019] [Indexed: 11/13/2022] Open
Abstract
We propose event-related cortical sources estimation from subject-independent electroencephalography (EEG) recordings for motor imagery brain computer interface (BCI). By using wavelet-based maximum entropy on the mean (wMEM), task-specific EEG channels are selected to predict right hand and right foot sensorimotor tasks, employing common spatial pattern (CSP) and regularized common spatial pattern (RCSP). EEG from five healthy individuals (Dataset IVa, BCI Competition III) were evaluated by a cross-subject paradigm. Prediction performance was evaluated via a two-layer feed-forward neural network, where the classifier was trained and tested by data from two subjects independently. On average, the overall mean prediction accuracies obtained using all 118 channels are (55.98±6.53) and (71.20±5.32) in cases of CSP and RCSP, respectively, which are slightly lower than the accuracies obtained using only the selected channels, i.e., (58.95±6.90) and (71.41±6.65), respectively. The highest mean prediction accuracy achieved for a specific subject pair by using selected EEG channels was on average (90.36±5.59) and outperformed that achieved by using all available channels (86.07 ± 10.71). Spatially projected cortical sources approximated using wMEM may be useful for capturing inter-subject associative sensorimotor brain dynamics and pave the way toward an enhanced subject-independent BCI.
Collapse
Affiliation(s)
- Simanto Saha
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Md. Shakhawat Hossain
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Khawza Ahmed
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Raqibul Mostafa
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Leontios Hadjileontiadis
- Department of Electrical and Computer Engineering, Khalifa University of Science and Technology, Technology and Research, Abu Dhabi, United Arab Emirates
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Ahsan Khandoker
- Healthcare Engineering Innovation Center (HEIC), Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Electrical and Electronic Engineering Department, University of Melbourne, Parkville, VIC, Australia
| | - Mathias Baumert
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
6
|
Li MA, Wang YF, Jia SM, Sun YJ, Yang JF. Decoding of motor imagery EEG based on brain source estimation. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2019.02.006] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
7
|
Aggarwal S, Chugh N. Signal processing techniques for motor imagery brain computer interface: A review. ARRAY 2019. [DOI: 10.1016/j.array.2019.100003] [Citation(s) in RCA: 71] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
|
8
|
Seeland A, Krell MM, Straube S, Kirchner EA. Empirical Comparison of Distributed Source Localization Methods for Single-Trial Detection of Movement Preparation. Front Hum Neurosci 2018; 12:340. [PMID: 30233341 PMCID: PMC6129768 DOI: 10.3389/fnhum.2018.00340] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2018] [Accepted: 08/09/2018] [Indexed: 11/17/2022] Open
Abstract
The development of technologies for the treatment of movement disorders, like stroke, is still of particular interest in brain-computer interface (BCI) research. In this context, source localization methods (SLMs), that reconstruct the cerebral origin of brain activity measured outside the head, e.g., via electroencephalography (EEG), can add a valuable insight into the current state and progress of the treatment. However, in BCIs SLMs were often solely considered as advanced signal processing methods that are compared against other methods based on the classification performance alone. Though, this approach does not guarantee physiological meaningful results. We present an empirical comparison of three established distributed SLMs with the aim to use one for single-trial movement prediction. The SLMs wMNE, sLORETA, and dSPM were applied on data acquired from eight subjects performing voluntary arm movements. Besides the classification performance as quality measure, a distance metric was used to asses the physiological plausibility of the methods. For the distance metric, which is usually measured to the source position of maximum activity, we further propose a variant based on clusters that is better suited for the single-trial case in which several sources are likely and the actual maximum is unknown. The two metrics showed different results. The classification performance revealed no significant differences across subjects, indicating that all three methods are equally well-suited for single-trial movement prediction. On the other hand, we obtained significant differences in the distance measure, favoring wMNE even after correcting the distance with the number of reconstructed clusters. Further, distance results were inconsistent with the traditional method using the maximum, indicating that for wMNE the point of maximum source activity often did not coincide with the nearest activation cluster. In summary, the presented comparison might help users to select an appropriate SLM and to understand the implications of the selection. The proposed methodology pays attention to the particular properties of distributed SLMs and can serve as a framework for further comparisons.
Collapse
Affiliation(s)
- Anett Seeland
- Robotics Innovation Center, German Research Center for Artificial Intelligence (DFKI GmbH), Bremen, Germany
| | - Mario M Krell
- Robotics Group, Faculty of Mathematics and Computer Science, University of Bremen, Bremen, Germany.,International Computer Science Institute, University of California, Berkeley, Berkeley, CA, United States.,University of California, Berkeley, Berkeley, CA, United States
| | - Sirko Straube
- Robotics Innovation Center, German Research Center for Artificial Intelligence (DFKI GmbH), Bremen, Germany
| | - Elsa A Kirchner
- Robotics Innovation Center, German Research Center for Artificial Intelligence (DFKI GmbH), Bremen, Germany.,Robotics Group, Faculty of Mathematics and Computer Science, University of Bremen, Bremen, Germany
| |
Collapse
|
9
|
Xygonakis I, Athanasiou A, Pandria N, Kugiumtzis D, Bamidis PD. Decoding Motor Imagery through Common Spatial Pattern Filters at the EEG Source Space. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2018; 2018:7957408. [PMID: 30154834 PMCID: PMC6092991 DOI: 10.1155/2018/7957408] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/09/2018] [Revised: 05/30/2018] [Accepted: 06/10/2018] [Indexed: 11/18/2022]
Abstract
Brain-Computer Interface (BCI) is a rapidly developing technology that aims to support individuals suffering from various disabilities and, ultimately, improve everyday quality of life. Sensorimotor rhythm-based BCIs have demonstrated remarkable results in controlling virtual or physical external devices but they still face a number of challenges and limitations. Main challenges include multiple degrees-of-freedom control, accuracy, and robustness. In this work, we develop a multiclass BCI decoding algorithm that uses electroencephalography (EEG) source imaging, a technique that maps scalp potentials to cortical activations, to compensate for low spatial resolution of EEG. Spatial features were extracted using Common Spatial Pattern (CSP) filters in the cortical source space from a number of selected Regions of Interest (ROIs). Classification was performed through an ensemble model, based on individual ROI classification models. The evaluation was performed on the BCI Competition IV dataset 2a, which features 4 motor imagery classes from 9 participants. Our results revealed a mean accuracy increase of 5.6% with respect to the conventional application method of CSP on sensors. Neuroanatomical constraints and prior neurophysiological knowledge play an important role in developing source space-based BCI algorithms. Feature selection and classifier characteristics of our implementation will be explored to raise performance to current state-of-the-art.
Collapse
Affiliation(s)
- Ioannis Xygonakis
- Biomedical Electronics Robotics and Devices (BERD) Group, Lab of Medical Physics, School of Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki (AUTH), 54124 Thessaloniki, Greece
- Department of Electrical and Computer Engineering, Faculty of Engineering, Aristotle University of Thessaloniki (AUTH), 54124 Thessaloniki, Greece
| | - Alkinoos Athanasiou
- Biomedical Electronics Robotics and Devices (BERD) Group, Lab of Medical Physics, School of Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki (AUTH), 54124 Thessaloniki, Greece
| | - Niki Pandria
- Biomedical Electronics Robotics and Devices (BERD) Group, Lab of Medical Physics, School of Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki (AUTH), 54124 Thessaloniki, Greece
| | - Dimitris Kugiumtzis
- Department of Electrical and Computer Engineering, Faculty of Engineering, Aristotle University of Thessaloniki (AUTH), 54124 Thessaloniki, Greece
| | - Panagiotis D. Bamidis
- Biomedical Electronics Robotics and Devices (BERD) Group, Lab of Medical Physics, School of Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki (AUTH), 54124 Thessaloniki, Greece
| |
Collapse
|
10
|
Functional Brain Connectivity during Multiple Motor Imagery Tasks in Spinal Cord Injury. Neural Plast 2018; 2018:9354207. [PMID: 29853852 PMCID: PMC5954936 DOI: 10.1155/2018/9354207] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2017] [Revised: 03/06/2018] [Accepted: 03/21/2018] [Indexed: 12/18/2022] Open
Abstract
Reciprocal communication of the central and peripheral nervous systems is compromised during spinal cord injury due to neurotrauma of ascending and descending pathways. Changes in brain organization after spinal cord injury have been associated with differences in prognosis. Changes in functional connectivity may also serve as injury biomarkers. Most studies on functional connectivity have focused on chronic complete injury or resting-state condition. In our study, ten right-handed patients with incomplete spinal cord injury and ten age- and gender-matched healthy controls performed multiple visual motor imagery tasks of upper extremities and walking under high-resolution electroencephalography recording. Directed transfer function was used to study connectivity at the cortical source space between sensorimotor nodes. Chronic disruption of reciprocal communication in incomplete injury could result in permanent significant decrease of connectivity in a subset of the sensorimotor network, regardless of positive or negative neurological outcome. Cingulate motor areas consistently contributed the larger outflow (right) and received the higher inflow (left) among all nodes, across all motor imagery categories, in both groups. Injured subjects had higher outflow from left cingulate than healthy subjects and higher inflow in right cingulate than healthy subjects. Alpha networks were less dense, showing less integration and more segregation than beta networks. Spinal cord injury patients showed signs of increased local processing as adaptive mechanism. This trial is registered with NCT02443558.
Collapse
|
11
|
Investigating the Role of Alpha and Beta Rhythms in Functional Motor Networks. Neuroscience 2018; 378:54-70. [DOI: 10.1016/j.neuroscience.2016.05.044] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2015] [Revised: 05/19/2016] [Accepted: 05/20/2016] [Indexed: 11/20/2022]
|
12
|
Baxter BS, Edelman BJ, Sohrabpour A, He B. Anodal Transcranial Direct Current Stimulation Increases Bilateral Directed Brain Connectivity during Motor-Imagery Based Brain-Computer Interface Control. Front Neurosci 2017; 11:691. [PMID: 29270110 PMCID: PMC5725434 DOI: 10.3389/fnins.2017.00691] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2017] [Accepted: 11/23/2017] [Indexed: 01/29/2023] Open
Abstract
Transcranial direct current stimulation (tDCS) has been shown to affect motor and cognitive task performance and learning when applied to brain areas involved in the task. Targeted stimulation has also been found to alter connectivity within the stimulated hemisphere during rest. However, the connectivity effect of the interaction of endogenous task specific activity and targeted stimulation is unclear. This study examined the aftereffects of concurrent anodal high-definition tDCS over the left sensorimotor cortex with motor network connectivity during a one-dimensional EEG based sensorimotor rhythm brain-computer interface (SMR-BCI) task. Directed connectivity following anodal tDCS illustrates altered connections bilaterally between frontal and parietal regions, and these alterations occur in a task specific manner; connections between similar cortical regions are altered differentially during left and right imagination trials. During right-hand imagination following anodal tDCS, there was an increase in outflow from the left premotor cortex (PMC) to multiple regions bilaterally in the motor network and increased inflow to the stimulated sensorimotor cortex from the ipsilateral PMC and contralateral sensorimotor cortex. During left-hand imagination following anodal tDCS, there was increased outflow from the stimulated sensorimotor cortex to regions across the motor network. Significant correlations between connectivity and the behavioral measures of total correct trials and time-to-hit (TTH) correct trials were also found, specifically that the input to the left PMC correlated with decreased right hand imagination performance and that flow from the ipsilateral posterior parietal cortex (PPC) to midline sensorimotor cortex correlated with improved performance for both right and left hand imagination. These results indicate that tDCS interacts with task-specific endogenous activity to alter directed connectivity during SMR-BCI. In order to predict and maximize the targeted effect of tDCS, the interaction of stimulation with the dynamics of endogenous activity needs to be examined comprehensively and understood.
Collapse
Affiliation(s)
- Bryan S. Baxter
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, United States
| | - Bradley J. Edelman
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, United States
| | - Abbas Sohrabpour
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, United States
| | - Bin He
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN, United States
- Institute for Engineering in Medicine, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
13
|
Shin J, von Luhmann A, Blankertz B, Kim DW, Jeong J, Hwang HJ, Muller KR. Open Access Dataset for EEG+NIRS Single-Trial Classification. IEEE Trans Neural Syst Rehabil Eng 2017; 25:1735-1745. [PMID: 27849545 DOI: 10.1109/tnsre.2016.2628057] [Citation(s) in RCA: 85] [Impact Index Per Article: 12.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We provide an open access dataset for hybrid brain-computer interfaces (BCIs) using electroencephalography (EEG) and near-infrared spectroscopy (NIRS). For this, we con-ducted two BCI experiments (left vs. right hand motor imagery; mental arithmetic vs. resting state). The dataset was validated using baseline signal analysis methods, with which classification performance was evaluated for each modality and a combination of both modalities. As already shown in previous literature, the capability of discriminating different mental states can be en-hanced by using a hybrid approach, when comparing to single modality analyses. This makes the provided data highly suitable for hybrid BCI investigations. Since our open access dataset also comprises motion artifacts and physiological data, we expect that it can be used in a wide range of future validation approaches in multimodal BCI research.
Collapse
|
14
|
Shim M, Hwang HJ, Kim DW, Lee SH, Im CH. Machine-learning-based diagnosis of schizophrenia using combined sensor-level and source-level EEG features. Schizophr Res 2016; 176:314-319. [PMID: 27427557 DOI: 10.1016/j.schres.2016.05.007] [Citation(s) in RCA: 74] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/30/2016] [Revised: 04/25/2016] [Accepted: 05/05/2016] [Indexed: 11/30/2022]
Abstract
Recently, an increasing number of researchers have endeavored to develop practical tools for diagnosing patients with schizophrenia using machine learning techniques applied to EEG biomarkers. Although a number of studies showed that source-level EEG features can potentially be applied to the differential diagnosis of schizophrenia, most studies have used only sensor-level EEG features such as ERP peak amplitude and power spectrum for machine learning-based diagnosis of schizophrenia. In this study, we used both sensor-level and source-level features extracted from EEG signals recorded during an auditory oddball task for the classification of patients with schizophrenia and healthy controls. EEG signals were recorded from 34 patients with schizophrenia and 34 healthy controls while each subject was asked to attend to oddball tones. Our results demonstrated higher classification accuracy when source-level features were used together with sensor-level features, compared to when only sensor-level features were used. In addition, the selected sensor-level features were mostly found in the frontal area, and the selected source-level features were mostly extracted from the temporal area, which coincide well with the well-known pathological region of cognitive processing in patients with schizophrenia. Our results suggest that our approach would be a promising tool for the computer-aided diagnosis of schizophrenia.
Collapse
Affiliation(s)
- Miseon Shim
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| | - Han-Jeong Hwang
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, South Korea
| | - Do-Won Kim
- Berlin Institute of Technology, Machine Learning Group, Marchstrasse 23, Berlin 10587, Germany
| | - Seung-Hwan Lee
- Psychiatry Department, Ilsan Paik Hospital, Inje University, Goyang, South Korea
| | - Chang-Hwan Im
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea.
| |
Collapse
|
15
|
Wronkiewicz M, Larson E, Lee AKC. Incorporating modern neuroscience findings to improve brain–computer interfaces: tracking auditory attention. J Neural Eng 2016; 13:056017. [DOI: 10.1088/1741-2560/13/5/056017] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
16
|
Edelman B, Baxter B, He B. Discriminating hand gesture motor imagery tasks using cortical current density estimation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2014:1314-7. [PMID: 25570208 DOI: 10.1109/embc.2014.6943840] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Current EEG based brain computer interface (BCI) systems have achieved successful control in up to 3 dimensions; however the current paradigm may be unnatural for many rehabilitative and recreational applications. Therefore there is a great need to find motor imagination (MI) tasks that are realistic for output device control. In this paper we present our results on classifying hand gesture MI tasks, including right hand flexion, extension, supination and pronation using a novel EEG inverse imaging approach. By using both temporal and spatial specificity in the source domain we were able to separate MI tasks with up to 95% accuracy for binary classification of any two tasks compared to a maximum of only 79% in the sensor domain.
Collapse
|
17
|
Edelman BJ, Baxter B, He B. EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks. IEEE Trans Biomed Eng 2016; 63:4-14. [PMID: 26276986 PMCID: PMC4716869 DOI: 10.1109/tbme.2015.2467312] [Citation(s) in RCA: 165] [Impact Index Per Article: 20.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
GOAL Sensorimotor-based brain-computer interfaces (BCIs) have achieved successful control of real and virtual devices in up to three dimensions; however, the traditional sensor-based paradigm limits the intuitive use of these systems. Many control signals for state-of-the-art BCIs involve imagining the movement of body parts that have little to do with the output command, revealing a cognitive disconnection between the user's intent and the action of the end effector. Therefore, there is a need to develop techniques that can identify with high spatial resolution the self-modulated neural activity reflective of the actions of a helpful output device. METHODS We extend previous EEG source imaging (ESI) work to decoding natural hand/wrist manipulations by applying a novel technique to classifying four complex motor imaginations of the right hand: flexion, extension, supination, and pronation. RESULTS We report an increase of up to 18.6% for individual task classification and 12.7% for overall classification using the proposed ESI approach over the traditional sensor-based method. CONCLUSION ESI is able to enhance BCI performance of decoding complex right-hand motor imagery tasks. SIGNIFICANCE This study may lead to the development of BCI systems with naturalistic and intuitive motor imaginations, thus facilitating broad use of noninvasive BCIs.
Collapse
Affiliation(s)
- Bradley J. Edelman
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA ()
| | - Bryan Baxter
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA ()
| | - Bin He
- Department of Biomedical Engineering and Institute for Engineering in Medicine, University of Minnesota, Minneapolis, MN 55455, USA ()
| |
Collapse
|
18
|
Yuan H, He B. Brain-computer interfaces using sensorimotor rhythms: current state and future perspectives. IEEE Trans Biomed Eng 2015; 61:1425-35. [PMID: 24759276 DOI: 10.1109/tbme.2014.2312397] [Citation(s) in RCA: 224] [Impact Index Per Article: 24.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Many studies over the past two decades have shown that people can use brain signals to convey their intent to a computer using brain-computer interfaces (BCIs). BCI systems extract specific features of brain activity and translate them into control signals that drive an output. Recently, a category of BCIs that are built on the rhythmic activity recorded over the sensorimotor cortex, i.e., the sensorimotor rhythm (SMR), has attracted considerable attention among the BCIs that use noninvasive neural recordings, e.g., electroencephalography (EEG), and have demonstrated the capability of multidimensional prosthesis control. This paper reviews the current state and future perspectives of SMR-based BCI and its clinical applications, in particular focusing on the EEG SMR. The characteristic features of SMR from the human brain are described and their underlying neural sources are discussed. The functional components of SMR-based BCI, together with its current clinical applications, are reviewed. Finally, limitations of SMR-BCIs and future outlooks are also discussed.
Collapse
|
19
|
Executed Movement Using EEG Signals through a Naive Bayes Classifier. MICROMACHINES 2014. [DOI: 10.3390/mi5041082] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
20
|
Choi K, Torres EB. Intentional signal in prefrontal cortex generalizes across different sensory modalities. J Neurophysiol 2014; 112:61-80. [PMID: 24259543 DOI: 10.1152/jn.00505.2013] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Biofeedback-EEG training to learn the mental control of an external device (e.g., a cursor on the screen) has been an important paradigm to attempt to understand the involvements of various areas of the brain in the volitional control and the modulation of intentional thought processes. Often the areas to adapt and to monitor progress are selected a priori. Less explored, however, has been the notion of automatically emerging activation in a particular area or subregions within that area recruited above and beyond the rest of the brain. Likewise, the notion of evoking such a signal as an amodal, abstract one remaining robust across different sensory modalities could afford some exploration. Here we develop a simple binary control task in the context of brain-computer interface (BCI) and use a Bayesian sparse probit classification algorithm to automatically uncover brain regional activity that maximizes task performance. We trained and tested 19 participants using the visual modality for instructions and feedback. Across training blocks we quantified coupling of the frontoparietal nodes and selective involvement of visual and auditory regions as a function of the real-time sensory feedback. The testing phase under both forms of sensory feedback revealed automatic recruitment of the prefrontal cortex with a parcellation of higher strength levels in Brodmann's areas 9, 10, and 11 significantly above those in other brain areas. We propose that the prefrontal signal may be a neural correlate of externally driven intended direction and discuss our results in the context of various aspects involved in the cognitive control of our thoughts.
Collapse
Affiliation(s)
- Kyuwan Choi
- Psychology Department, Rutgers University, Piscataway, New Jersey; Center for Computational Biomedicine Imaging and Modeling, Computer Science Department, Rutgers University, Piscataway, New Jersey; and Rutgers Center for Cognitive Science, Rutgers University, Piscataway, New Jersey
| | - Elizabeth B Torres
- Psychology Department, Rutgers University, Piscataway, New Jersey; Center for Computational Biomedicine Imaging and Modeling, Computer Science Department, Rutgers University, Piscataway, New Jersey; and
| |
Collapse
|
21
|
Shan H, Yuan H, Zhu S, He B. EEG-based motor imagery classification accuracy improves with gradually increased channel number. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2012:1695-8. [PMID: 23366235 DOI: 10.1109/embc.2012.6346274] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The question of how many channels should be sed for classification remains a key issue in the study of Brain-Computer Interface. Several studies have shown that a reduced number of channels can achieve the optimal classification accuracy in the offline analysis of motor imagery paradigm, which does not have real-time feedback as in the online control. However, for the cursor movement control paradigm, it remains unclear as to how many channels should be selected in order to achieve the optimal classification. In the present study, we gradually increased the number of channels, and adopted the time-frequency-spatial synthesized method for left and right motor imagery classification. We compared the effect of increasing channel number in two datasets, an imagery-based cursor movement control dataset and a motor imagery tasks dataset. Our results indicated that for the former dataset, the more channels we used, the higher the accuracy rate was achieved, which is in contrast to the finding in the latter dataset that optimal performance was obtained at a subset number of channels. When gradually increasing the number of channels from 2 to all in the analysis of cursor movement control dataset, the average training and testing accuracies from three subjects improved from 68.7% to 90.4% and 63.7% to 87.7%, respectively.
Collapse
Affiliation(s)
- Haijun Shan
- Department of Biomedical Engineering, University of Minnesota, MN, USA
| | | | | | | |
Collapse
|
22
|
Gao L, Wang J, Chen L. Event-related desynchronization and synchronization quantification in motor-related EEG by Kolmogorov entropy. J Neural Eng 2013; 10:036023. [PMID: 23676901 DOI: 10.1088/1741-2560/10/3/036023] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Various approaches have been applied for the quantification of event-related desynchronization/synchronization (ERD/ERS) in EEG/MEG data analysis, but most of them are based on band power analysis. In this paper, we sought a novel method using a nonlinear measurement to quantify the ERD/ERS time course of motor-related EEG. APPROACH We applied Kolmogorov entropy to quantify the ERD/ERS time course of motor-related EEG in relation to hand movement imagination and execution for the first time. To further test the validity of the Kolmogorov entropy measure, we tested it on five human subjects for feature extraction to classify the left and right hand motor tasks. MAIN RESULTS The results show that the relative increase and decrease of Kolmogorov entropy indicates the ERD and ERS respectively. An average classification accuracy of 87.3% was obtained for five subjects. SIGNIFICANCE The results prove that Kolmogorov entropy can effectively quantify the dynamic process of event-related EEG, and it also provides a novel method of classifying motor imagery tasks from scalp EEG by Kolmogorov entropy measurement with promising classification accuracy.
Collapse
Affiliation(s)
- Lin Gao
- Institute of Biomedical Engineering, Key Laboratory of Biomedical Information Engineering of Education Ministry, Xi'an Jiaotong University, Xi'an 710049, Shaanxi, People's Republic of China
| | | | | |
Collapse
|
23
|
Continuous three-dimensional control of a virtual helicopter using a motor imagery based brain-computer interface. PLoS One 2011; 6:e26322. [PMID: 22046274 PMCID: PMC3202533 DOI: 10.1371/journal.pone.0026322] [Citation(s) in RCA: 124] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2011] [Accepted: 09/23/2011] [Indexed: 11/19/2022] Open
Abstract
Brain-computer interfaces (BCIs) allow a user to interact with a computer system using thought. However, only recently have devices capable of providing sophisticated multi-dimensional control been achieved non-invasively. A major goal for non-invasive BCI systems has been to provide continuous, intuitive, and accurate control, while retaining a high level of user autonomy. By employing electroencephalography (EEG) to record and decode sensorimotor rhythms (SMRs) induced from motor imaginations, a consistent, user-specific control signal may be characterized. Utilizing a novel method of interactive and continuous control, we trained three normal subjects to modulate their SMRs to achieve three-dimensional movement of a virtual helicopter that is fast, accurate, and continuous. In this system, the virtual helicopter's forward-backward translation and elevation controls were actuated through the modulation of sensorimotor rhythms that were converted to forces applied to the virtual helicopter at every simulation time step, and the helicopter's angle of left or right rotation was linearly mapped, with higher resolution, from sensorimotor rhythms associated with other motor imaginations. These different resolutions of control allow for interplay between general intent actuation and fine control as is seen in the gross and fine movements of the arm and hand. Subjects controlled the helicopter with the goal of flying through rings (targets) randomly positioned and oriented in a three-dimensional space. The subjects flew through rings continuously, acquiring as many as 11 consecutive rings within a five-minute period. In total, the study group successfully acquired over 85% of presented targets. These results affirm the effective, three-dimensional control of our motor imagery based BCI system, and suggest its potential applications in biological navigation, neuroprosthetics, and other applications.
Collapse
|
24
|
Differential electrophysiological coupling for positive and negative BOLD responses during unilateral hand movements. J Neurosci 2011; 31:9585-93. [PMID: 21715623 DOI: 10.1523/jneurosci.5312-10.2011] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
The coupling between neural cellular activity and blood oxygen level-dependent (BOLD) signal is of critical importance to the interpretation of fMRI. Largely unknown, however, is the degree to which different neuronal events (i.e., excitation and inhibition) maintain or disrupt the neural-hemodynamic relationship, especially in humans. In the present study, we compared local electroencephalographic (EEG) oscillations and the positive/negative BOLD responses of simultaneously recorded data from healthy human volunteers performing unilateral finger tapping at graded rates. By quantifying the single-trial modulations of EEG using source imaging, we tested for their correlation with positive BOLD response (PBR) and negative BOLD response (NBR) after coregistering their spatial locations. PBR was found to be overlapped with and correlated to the decrease of alpha (8-13 Hz) and beta (13-30 Hz) band EEG in the contralateral sensorimotor cortex. Regional EEG modulations at the sensorimotor cortex further predicted a spatially distributed and interconnected network of motor-related cortical areas. Alternatively, no significant correlation was found at the ipsilateral sensorimotor cortex between the NBR and EEG despite their spatial overlapping. This differential electrophysiological coupling of the positive and negative BOLD responses suggests that the underlying neuronal events may not only influence the direction of the signal change but also the neural-hemodynamic relationship.
Collapse
|
25
|
Hwang HJ, Kim KH, Jung YJ, Kim DW, Lee YH, Im CH. An EEG-based real-time cortical functional connectivity imaging system. Med Biol Eng Comput 2011; 49:985-95. [DOI: 10.1007/s11517-011-0791-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2010] [Accepted: 06/13/2011] [Indexed: 11/29/2022]
|
26
|
Royer AS, Rose ML, He B. Goal selection versus process control while learning to use a brain-computer interface. J Neural Eng 2011; 8:036012. [PMID: 21508492 DOI: 10.1088/1741-2560/8/3/036012] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
A brain-computer interface (BCI) can be used to accomplish a task without requiring motor output. Two major control strategies used by BCIs during task completion are process control and goal selection. In process control, the user exerts continuous control and independently executes the given task. In goal selection, the user communicates their goal to the BCI and then receives assistance executing the task. A previous study has shown that goal selection is more accurate and faster in use. An unanswered question is, which control strategy is easier to learn? This study directly compares goal selection and process control while learning to use a sensorimotor rhythm-based BCI. Twenty young healthy human subjects were randomly assigned either to a goal selection or a process control-based paradigm for eight sessions. At the end of the study, the best user from each paradigm completed two additional sessions using all paradigms randomly mixed. The results of this study were that goal selection required a shorter training period for increased speed, accuracy, and information transfer over process control. These results held for the best subjects as well as in the general subject population. The demonstrated characteristics of goal selection make it a promising option to increase the utility of BCIs intended for both disabled and able-bodied users.
Collapse
Affiliation(s)
- Audrey S Royer
- Graduate Program in Neuroscience, University of Minnesota, Minneapolis, MN 55455, USA
| | | | | |
Collapse
|
27
|
Im CH, Hwang HJ. EEG-based real-time dynamic neuroimaging. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2009:5385-8. [PMID: 19963902 DOI: 10.1109/iembs.2009.5332806] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
In the present paper, an electroencephalography (EEG)-based real-time dynamic neuroimaging system, which was recently developed by the authors, is introduced and its potential applications are presented. The real-time system could monitor spatiotemporal changes of cortical rhythmic activity on a subject's cortical surface, not on the subject's scalp surface, with a high temporal resolution. The developed system can be potentially applied to various practical applications such as neurofeedback based motor imagery training, real-time diagnosis of psychiatric brain diseases, online monitoring of EEG experiments, and neurorehabilitation, of which some examples are presented herein.
Collapse
Affiliation(s)
- Chang-Hwan Im
- Department of Biomedical Engineering, Yonsei University, 234 Maeji, Heungeop, Wonju, 220-710, Korea.
| | | |
Collapse
|
28
|
Yuan H, Perdoni C, He B. Relationship between speed and EEG activity during imagined and executed hand movements. J Neural Eng 2010; 7:26001. [PMID: 20168002 DOI: 10.1088/1741-2560/7/2/026001] [Citation(s) in RCA: 96] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
The relationship between primary motor cortex and movement kinematics has been shown in nonhuman primate studies of hand reaching or drawing tasks. Studies have demonstrated that the neural activities accompanying or immediately preceding the movement encode the direction, speed and other information. Here we investigated the relationship between the kinematics of imagined and actual hand movement, i.e. the clenching speed, and the EEG activity in ten human subjects. Study participants were asked to perform and imagine clenching of the left hand and right hand at various speeds. The EEG activity in the alpha (8-12 Hz) and beta (18-28 Hz) frequency bands were found to be linearly correlated with the speed of imagery clenching. Similar parametric modulation was also found during the execution of hand movements. A single equation relating the EEG activity to the speed and the hand (left versus right) was developed. This equation, which contained a linear independent combination of the two parameters, described the time-varying neural activity during the tasks. Based on the model, a regression approach was developed to decode the two parameters from the multiple-channel EEG signals. We demonstrated the continuous decoding of dynamic hand and speed information of the imagined clenching. In particular, the time-varying clenching speed was reconstructed in a bell-shaped profile. Our findings suggest an application to providing continuous and complex control of noninvasive brain-computer interface for movement-impaired paralytics.
Collapse
Affiliation(s)
- Han Yuan
- Department of Biomedical Engineering, University of Minnesota, MN, USA
| | | | | |
Collapse
|
29
|
Yuan H, Liu T, Szarkowski R, Rios C, Ashe J, He B. Negative covariation between task-related responses in alpha/beta-band activity and BOLD in human sensorimotor cortex: an EEG and fMRI study of motor imagery and movements. Neuroimage 2009; 49:2596-606. [PMID: 19850134 DOI: 10.1016/j.neuroimage.2009.10.028] [Citation(s) in RCA: 171] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2009] [Revised: 10/11/2009] [Accepted: 10/12/2009] [Indexed: 11/29/2022] Open
Abstract
Similar to the occipital alpha rhythm, electroencephalographic (EEG) signals in the alpha- and beta-frequency bands can be suppressed by movement or motor imagery and have thus been thought to represent the "idling state" of the sensorimotor cortex. A negative correlation between spontaneous alpha EEG and blood-oxygen-level-dependent (BOLD) signals has been reported in combined EEG and fMRI (functional Magnetic Resonance Imaging) experiments when subjects stayed at the resting state or alternated between the resting state and a task. However, the precise nature of the task-induced alpha modulation remains elusive. It was not clear whether alpha/beta rhythm suppressions may co-vary with BOLD when conducting tasks involving varying activations of the cortex. Here, we quantified the task-evoked responses of BOLD and alpha/beta-band power of EEG directly in the cortical source domain, by using source imaging technology, and examined their covariation across task conditions in a mixed block and event-related design. In this study, 13 subjects performed tasks of right-hand, right-foot or left-hand movement and motor imagery when EEG and fMRI data were separately collected. Task-induced increase of BOLD signal and decrease of EEG amplitudes in alpha and beta bands were shown to be co-localized at the somatotopic sensorimotor cortex. At the corresponding regions, the reciprocal changes of the two signals co-varied in the magnitudes across imagination and movement conditions. The spatial correspondence and negative covariation between the two measurements were further shown to exist at somatotopic brain regions associated with different body parts. These results suggest an inverse functional coupling relationship between task-induced changes of BOLD and low-frequency EEG signals.
Collapse
Affiliation(s)
- Han Yuan
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | | | | | | | | | | |
Collapse
|
30
|
Deffeyes JE, Harbourne RT, DeJong SL, Kyvelidou A, Stuberg WA, Stergiou N. Use of information entropy measures of sitting postural sway to quantify developmental delay in infants. J Neuroeng Rehabil 2009; 6:34. [PMID: 19671183 PMCID: PMC2734840 DOI: 10.1186/1743-0003-6-34] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2008] [Accepted: 08/11/2009] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND By quantifying the information entropy of postural sway data, the complexity of the postural movement of different populations can be assessed, giving insight into pathologic motor control functioning. METHODS In this study, developmental delay of motor control function in infants was assessed by analysis of sitting postural sway data acquired from force plate center of pressure measurements. Two types of entropy measures were used: symbolic entropy, including a new asymmetric symbolic entropy measure, and approximate entropy, a more widely used entropy measure. For each method of analysis, parameters were adjusted to optimize the separation of the results from the infants with delayed development from infants with typical development. RESULTS The method that gave the widest separation between the populations was the asymmetric symbolic entropy method, which we developed by modification of the symbolic entropy algorithm. The approximate entropy algorithm also performed well, using parameters optimized for the infant sitting data. The infants with delayed development were found to have less complex patterns of postural sway in the medial-lateral direction, and were found to have different left-right symmetry in their postural sway, as compared to typically developing infants. CONCLUSION The results of this study indicate that optimization of the entropy algorithm for infant sitting postural sway data can greatly improve the ability to separate the infants with developmental delay from typically developing infants.
Collapse
Affiliation(s)
- Joan E Deffeyes
- Nebraska Biomechanics Core Facility, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Regina T Harbourne
- Munroe-Meyer Institute, University of Nebraska Medical Center, Omaha, NE 68198, USA
| | - Stacey L DeJong
- Munroe-Meyer Institute, University of Nebraska Medical Center, Omaha, NE 68198, USA
| | - Anastasia Kyvelidou
- Nebraska Biomechanics Core Facility, University of Nebraska at Omaha, Omaha, NE, 68182, USA
| | - Wayne A Stuberg
- Munroe-Meyer Institute, University of Nebraska Medical Center, Omaha, NE 68198, USA
| | - Nicholas Stergiou
- Nebraska Biomechanics Core Facility, University of Nebraska at Omaha, Omaha, NE, 68182, USA
- Department of Environmental, Agricultural and Occupational Health Sciences, College of Public Health, University of Nebraska Medical Center, Omaha, NE 68198, USA
| |
Collapse
|
31
|
Neurofeedback-based motor imagery training for brain–computer interface (BCI). J Neurosci Methods 2009; 179:150-6. [PMID: 19428521 DOI: 10.1016/j.jneumeth.2009.01.015] [Citation(s) in RCA: 99] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2008] [Revised: 01/17/2009] [Accepted: 01/19/2009] [Indexed: 11/20/2022]
|
32
|
Yuan H, Doud A, Gururajan A, He B. Cortical imaging of event-related (de)synchronization during online control of brain-computer interface using minimum-norm estimates in frequency domain. IEEE Trans Neural Syst Rehabil Eng 2009; 16:425-31. [PMID: 18990646 DOI: 10.1109/tnsre.2008.2003384] [Citation(s) in RCA: 74] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
It is of wide interest to study the brain activity that correlates to the control of brain-computer interface (BCI). In the present study, we have developed an approach to image the cortical rhythmic modulation associated with motor imagery using minimum-norm estimates in the frequency domain (MNEFD). The distribution of cortical sources of mu activity during online control of BCI was obtained with the MNEFD. Contralateral decrease (event-related desynchronization) and ipsilateral increase (event-related synchronization) are localized in the sensorimotor cortex during online control of BCI in a group of human subjects. Statistical source analysis revealed that maximum correlation with movement imagination is localized in sensorimotor cortex.
Collapse
Affiliation(s)
- Han Yuan
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA
| | | | | | | |
Collapse
|
33
|
Royer AS, He B. Goal selection versus process control in a brain-computer interface based on sensorimotor rhythms. J Neural Eng 2009; 6:016005. [PMID: 19155552 DOI: 10.1088/1741-2560/6/1/016005] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
In a brain-computer interface (BCI) utilizing a process control strategy, the signal from the cortex is used to control the fine motor details normally handled by other parts of the brain. In a BCI utilizing a goal selection strategy, the signal from the cortex is used to determine the overall end goal of the user, and the BCI controls the fine motor details. A BCI based on goal selection may be an easier and more natural system than one based on process control. Although goal selection in theory may surpass process control, the two have never been directly compared, as we are reporting here. Eight young healthy human subjects participated in the present study, three trained and five naïve in BCI usage. Scalp-recorded electroencephalograms (EEG) were used to control a computer cursor during five different paradigms. The paradigms were similar in their underlying signal processing and used the same control signal. However, three were based on goal selection, and two on process control. For both the trained and naïve populations, goal selection had more hits per run, was faster, more accurate (for seven out of eight subjects) and had a higher information transfer rate than process control. Goal selection outperformed process control in every measure studied in the present investigation.
Collapse
Affiliation(s)
- Audrey S Royer
- Graduate Program in Neuroscience, Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA.
| | | |
Collapse
|
34
|
Yuan H, He B. Cortical imaging of sensorimotor rhythms for BCI applications. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2009; 2009:4539-4542. [PMID: 19964646 DOI: 10.1109/iembs.2009.5334130] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
Rhythmic electroencephalographic (EEG) activities associated with movement imaginations are widely used in developing noninvasive Brain-Computer Interface (BCI) towards replacing or restoring the lost motor function in the paralytics. And it is of great importance to develop imaging techniques to enhance the spatial resolution and specificity of the EEG modality. In our work, we developed an innovative approach of imaging the distributed rhythmic brain activity in the spectral domain. In the present study, we evaluated the proposed technique in experimental data of offline and online imaginations in naive and well-trained BCI subjects. Our results identified the cortical origins of sensorimotor rhythms. We also applied the source imaging approach to classifying mental states for BCI applications and demonstrated its feasibility and superior performance.
Collapse
Affiliation(s)
- Han Yuan
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, MN 55455, USA.
| | | |
Collapse
|
35
|
Im CH, Hwang HJ, Che H, Lee S. An EEG-based real-time cortical rhythmic activity monitoring system. Physiol Meas 2007; 28:1101-13. [PMID: 17827657 DOI: 10.1088/0967-3334/28/9/011] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
In the present study, we introduce an electroencephalography (EEG)-based, real-time, cortical rhythmic activity monitoring system which can monitor spatiotemporal changes of cortical rhythmic activity on a subject's cortical surface, not on the subject's scalp surface, with a high temporal resolution. In the monitoring system, a frequency domain inverse operator is preliminarily constructed, considering the subject's anatomical information and sensor configurations, and then the spectral current power at each cortical vertex is calculated for the Fourier transforms of successive sections of continuous data, when a particular frequency band is given. A preliminary offline simulation study using four sets of artifact-free, eye-closed, resting EEG data acquired from two dementia patients and two normal subjects demonstrates that spatiotemporal changes of cortical rhythmic activity can be monitored at the cortical level with a maximal delay time of about 200 ms, when 18 channel EEG data are analyzed under a Pentium4 3.4 GHz environment. The first pilot system is applied to two human experiments-(1) cortical alpha rhythm changes induced by opening and closing eyes and (2) cortical mu rhythm changes originated from the arm movements-and demonstrated the feasibility of the developed system.
Collapse
Affiliation(s)
- Chang-Hwan Im
- Department of Biomedical Engineering, Yonsei University, Wonju, 220-710 Korea.
| | | | | | | |
Collapse
|
36
|
Hwang HJ, Che H, Im CH. An EEG-based real-time cortical rhythmic activity monitoring system: a pilot study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2007; 2007:4394-4397. [PMID: 18002978 DOI: 10.1109/iembs.2007.4353312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
This paper introduces an electroencephalography (EEG)-based, real-time, cortical rhythmic activity monitoring system which can monitor spatiotemporal changes of cortical rhythmic activity on a subject's cortical surface, with a high temporal resolution. In the monitoring system, a frequency domain inverse operator is preliminarily constructed, based on the subject's anatomical information and sensor arrangement, and then spectral current power at each cortical vertex is calculated for the Fourier transforms of successive sections of continuous data, when a particular frequency band is given. The first pilot system was applied to two human experiments: (1)cortical alpha rhythm changes induced by opening and closing eyes and (2) cortical mu rhythm changes originated from arm movements, demonstrating the feasibility of the system.
Collapse
Affiliation(s)
- Han-Jeong Hwang
- Department of Biomedical Engineering, Yonsei University, 234 Maeji-ri, Heungeop-myun, Wonju, Kwangwon-do 220-710 Korea
| | | | | |
Collapse
|