A feasibility study of a complete low-cost consumer-grade brain-computer interface system

EEG-based motor imagery channel selection and classification using hybrid optimization and two-tier deep learning

Brain-computer interface (BCI) technology holds promise for individuals with profound motor impairments, offering the potential for communication and control. Motor imagery (MI)-based BCI systems are particularly relevant in this context. Despite their potential, achieving accurate and robust classification of MI tasks using electroencephalography (EEG) data remains a significant challenge. In this paper, we employed the Minimum Redundancy Maximum Relevance (MRMR) algorithm to optimize channel selection. Furthermore, we introduced a hybrid optimization approach that combines the War Strategy Optimization (WSO) and Chimp Optimization Algorithm (ChOA). This hybridization significantly enhances the classification model's overall performance and adaptability. A two-tier deep learning architecture is proposed for classification, consisting of a Convolutional Neural Network (CNN) and a modified Deep Neural Network (M-DNN). The CNN focuses on capturing temporal correlations within EEG data, while the M-DNN is designed to extract high-level spatial characteristics from selected EEG channels. Integrating optimal channel selection, hybrid optimization, and the two-tier deep learning methodology in our BCI framework presents an enhanced approach for precise and effective BCI control. Our model got 95.06% accuracy with high precision. This advancement has the potential to significantly impact neurorehabilitation and assistive technology applications, facilitating improved communication and control for individuals with motor impairments.

A Randomized Trial Utilizing EEG Brain Computer Interface to Improve Facial Emotion Recognition in Autistic Adults

PURPOSE

Many individuals with autism spectrum disorder (ASD) experience challenges with facial emotion recognition (FER), which may exacerbate social difficulties in ASD. Few studies have examined whether FER can be experimentally manipulated and improved for autistic people. This study utilized a randomized controlled trial design to examine acceptability and preliminary clinical impact of a novel mixed reality-based neurofeedback program, FER Assistant, using EEG brain computer interface (BCI)-assisted technology to improve FER for autistic adolescents and adults.

METHODS

Twenty-seven autistic male participants (M age: 21.12 years; M IQ: 105.78; 85% white) were randomized to the active condition to receive FER Assistant (n = 17) or waitlist control (n = 10). FER Assistant participants received ten sessions utilizing BCI-assisted neurofeedback training in FER. All participants, regardless of randomization, completed a computerized FER task at baseline and endpoint.

RESULTS

Results partially indicated that FER Assistant was acceptable to participants. Regression analyses demonstrated that participation in FER Assistant led to group differences in FER at endpoint, compared to a waitlist control. However, analyses examining reliable change in FER indicated no reliable improvement or decline for FER Assistant participants, whereas two waitlist participants demonstrated reliable decline.

CONCLUSION

Given the preliminary nature of this work, results collectively suggest that FER Assistant may be an acceptable intervention. Results also suggest that FER may be a potential mechanism that is amenable to intervention for autistic individuals, although additional trials using larger sample sizes are warranted.

Exploiting Information in Event-Related Brain Potentials from Average Temporal Waveform, Time-Frequency Representation, and Phase Dynamics

Characterizing the brain's dynamic pattern of response to an input in electroencephalography (EEG) is not a trivial task due to the entanglement of the complex spontaneous brain activity. In this context, the brain's response can be defined as (1) the additional neural activity components generated after the input or (2) the changes in the ongoing spontaneous activities induced by the input. Moreover, the response can be manifested in multiple features. Three commonly studied examples of features are (1) transient temporal waveform, (2) time-frequency representation, and (3) phase dynamics. The most extensively used method of average event-related potentials (ERPs) captures the first one, while the latter two and other more complex features are attracting increasing attention. However, there has not been much work providing a systematic illustration and guidance for how to effectively exploit multifaceted features in neural cognitive research. Based on a visual oddball ERPs dataset with 200 participants, this work demonstrates how the information from the above-mentioned features are complementary to each other and how they can be integrated based on stereotypical neural-network-based machine learning approaches to better exploit neural dynamic information in basic and applied cognitive research.

Remote collection of electrophysiological data with brain wearables: opportunities and challenges

Collection of electroencephalographic (EEG) data provides an opportunity to non-invasively study human brain plasticity, learning and the evolution of various neuropsychiatric disorders. Traditionally, due to sophisticated hardware, EEG studies have been largely limited to research centers which restrict both testing contexts and repeated longitudinal measures. The emergence of low-cost "wearable" EEG devices now provides the prospect of frequent and remote monitoring of the human brain for a variety of physiological and pathological brain states. In this manuscript, we survey evidence that EEG wearables provide high-quality data and review various software used for remote data collection. We then discuss the growing body of evidence supporting the feasibility of remote and longitudinal EEG data collection using wearables including a discussion of potential biomedical applications of these protocols. Lastly, we discuss some additional challenges needed for EEG wearable research to gain further widespread adoption.

A Novel OpenBCI Framework for EEG-Based Neurophysiological Experiments

An Open Brain-Computer Interface (OpenBCI) provides unparalleled freedom and flexibility through open-source hardware and firmware at a low-cost implementation. It exploits robust hardware platforms and powerful software development kits to create customized drivers with advanced capabilities. Still, several restrictions may significantly reduce the performance of OpenBCI. These limitations include the need for more effective communication between computers and peripheral devices and more flexibility for fast settings under specific protocols for neurophysiological data. This paper describes a flexible and scalable OpenBCI framework for electroencephalographic (EEG) data experiments using the Cyton acquisition board with updated drivers to maximize the hardware benefits of ADS1299 platforms. The framework handles distributed computing tasks and supports multiple sampling rates, communication protocols, free electrode placement, and single marker synchronization. As a result, the OpenBCI system delivers real-time feedback and controlled execution of EEG-based clinical protocols for implementing the steps of neural recording, decoding, stimulation, and real-time analysis. In addition, the system incorporates automatic background configuration and user-friendly widgets for stimuli delivery. Motor imagery tests the closed-loop BCI designed to enable real-time streaming within the required latency and jitter ranges. Therefore, the presented framework offers a promising solution for tailored neurophysiological data processing.

EEG-Based BCIs on Motor Imagery Paradigm Using Wearable Technologies: A Systematic Review

In recent decades, the automatic recognition and interpretation of brain waves acquired by electroencephalographic (EEG) technologies have undergone remarkable growth, leading to a consequent rapid development of brain-computer interfaces (BCIs). EEG-based BCIs are non-invasive systems that allow communication between a human being and an external device interpreting brain activity directly. Thanks to the advances in neurotechnologies, and especially in the field of wearable devices, BCIs are now also employed outside medical and clinical applications. Within this context, this paper proposes a systematic review of EEG-based BCIs, focusing on one of the most promising paradigms based on motor imagery (MI) and limiting the analysis to applications that adopt wearable devices. This review aims to evaluate the maturity levels of these systems, both from the technological and computational points of view. The selection of papers has been performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), leading to 84 publications considered in the last ten years (from 2012 to 2022). Besides technological and computational aspects, this review also aims to systematically list experimental paradigms and available datasets in order to identify benchmarks and guidelines for the development of new applications and computational models.

Stimulus-induced narrow-band gamma oscillations in humans can be recorded using open-hardware low-cost EEG amplifier

Stimulus-induced narrow-band gamma oscillations (30-70 Hz) in human electro-encephalograph (EEG) have been linked to attentional and memory mechanisms and are abnormal in mental health conditions such as autism, schizophrenia and Alzheimer's Disease. However, since the absolute power in EEG decreases rapidly with increasing frequency following a "1/f" power law, and the gamma band includes line noise frequency, these oscillations are highly susceptible to instrument noise. Previous studies that recorded stimulus-induced gamma oscillations used expensive research-grade EEG amplifiers to address this issue. While low-cost EEG amplifiers have become popular in Brain Computer Interface applications that mainly rely on low-frequency oscillations (< 30 Hz) or steady-state-visually-evoked-potentials, whether they can also be used to measure stimulus-induced gamma oscillations is unknown. We recorded EEG signals using a low-cost, open-source amplifier (OpenBCI) and a traditional, research-grade amplifier (Brain Products GmbH), both connected to the OpenBCI cap, in male (N = 6) and female (N = 5) subjects (22-29 years) while they viewed full-screen static gratings that are known to induce two distinct gamma oscillations: slow and fast gamma, in a subset of subjects. While the EEG signals from OpenBCI were considerably noisier, we found that out of the seven subjects who showed a gamma response in Brain Products recordings, six showed a gamma response in OpenBCI as well. In spite of the noise in the OpenBCI setup, the spectral and temporal profiles of these responses in alpha (8-13 Hz) and gamma bands were highly correlated between OpenBCI and Brain Products recordings. These results suggest that low-cost amplifiers can potentially be used in stimulus-induced gamma response detection.

EEG-based spatial elements optimisation design method

In the field of digital design, a recent hot topic is the study of the interaction between spatial environment design and human factors. Electroencephalogram (EEG) and eye tracking can be used as quantitative analysis methods for architectural space evaluation; however, conclusions from existing studies on improving the quality of spatial environments based on human factors tend to remain qualitative. In order to realise the quantitative optimisation design of spatial elements from human physiological data, this research used the digital space optimisation method and perceptual evaluation research. In this way, it established an optimisation method for built space elements in real-time using human psychological indicators. Firstly, this method used the specific indicators of the Meditation value and Attention value in the human EEG signal, taking the ThinkGear AM (TGAM) module as the optimisation objective, the architectural space colour and the window size as the optimisation object, and the multi-objective genetic algorithm as the optimisation tool. Secondly, this research combined virtual reality scenarios and parametric linkage models to realise this optimisation method to establish a tool platform and workflow. Thirdly, this study took the optimisation of a typical living space as an example and recruited 50 volunteers to participate in an optimisation experiment. The results indicated that with the iterative optimisation of the multi-objective genetic algorithm, the specific EEG index decreases significantly and the standard deviation of the in-dex fluctuates and decreases during the iterative process, which further indicates that the optimisation method established in this study with the specific EEG index as the optimisation objective is effective and feasible. In addition, this study laid the foundation for more EEG indicators and more complex spatial element opti-misation research in the future.

FPGA-Based Hardware Accelerator on Portable Equipment for EEG Signal Patterns Recognition

Electroencephalogram (EEG) is a recording of comprehensive reflection of physiological brain activities. Because of many reasons, however, including noises of heartbeat artifacts and muscular movements, there are complex challenges for efficient EEG signal classification. The Convolutional Neural Networks (CNN) is considered a promising tool for extracting data features. A deep neural network can detect the deeper-level features with a multilayer through nonlinear mapping. However, there are few viable deep learning algorithms applied to BCI systems. This study proposes a more effective acquisition and processing HW-SW method for EEG biosignal. First, we use a consumer-grade EEG acquisition device to record EEG signals. Short-time Fourier transform (STFT) and Continuous Wavelet Transform (CWT) methods will be used for data preprocessing. Compared with other algorithms, the CWT-CNN algorithm shows a better classification accuracy. The research result shows that the best classification accuracy of the CWT-CNN algorithm is 91.65%. On the other side, CNN inference requires many convolution operations. We further propose a lightweight CNN inference hardware accelerator framework to speed up inference calculation, and we verify and evaluate its performance. The proposed framework performs network tasks quickly and precisely while using less logical resources on the PYNQ-Z2 FPGA development board.

A motor imagery vs. rest dataset with low-cost consumer grade EEG hardware

The data consist of electroencephalography (EEG) signals acquired by means of low-cost consumer-grade devices from 10 participants (four females, right-handed, mean age ± SD = 26.1 ± 4.0 years) without any previous experience in Brain-Computer Interfaces (BCIs) usage. The BCI protocol consisted of two conditions, namely the kinesthetic imagination of grasping movement (motor imagery, MI) of the dominant hand and a rest/idle condition. Five protocol runs were required to be performed by each participant in a single-day session, of about 1.5 h. The first run, called RUN0, involved 5 trials of real grasping movement together with the same number of trials in a rest condition. This first run was done to both better explain the protocol and to encourage the participant to focus on the sensation of executing the movement. The rest of the runs (RUN1-RUN4) were identical, consisting of 20 trials for each condition presented in a random order. The electrical brain activity was registered from 15 electrodes covering the sensorimotor area, at a sampling frequency of 125 Hz. Muscle activity of the dominant hand was controlled via the electromyography (EMG) activity by two electrodes placed at two antagonist muscles involved in the flexion/extension of the wrist. The recordings were performed in a non-shielded office, by means of low-cost consumer grade devices and free multi-platform open source software. The EMG corruption level was analyzed and EEG trials for which the EMG activity was higher than a prescribed threshold value, were discarded. During acquisition, EEG data was digitally band-pass filtered between 0.5 and 45 Hz. These data provide a motor imagery vs. rest EEG dataset, relevant for BCI for motor rehabilitation applications. Since the recordings were performed by means of low-cost consumer grade devices in a non-controlled environment, this dataset provides an excellent source for exploring robust brain decoding techniques for future in-home BCI usage.

Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review

Affective computing, a subcategory of artificial intelligence, detects, processes, interprets, and mimics human emotions. Thanks to the continued advancement of portable non-invasive human sensor technologies, like brain–computer interfaces (BCI), emotion recognition has piqued the interest of academics from a variety of domains. Facial expressions, speech, behavior (gesture/posture), and physiological signals can all be used to identify human emotions. However, the first three may be ineffectual because people may hide their true emotions consciously or unconsciously (so-called social masking). Physiological signals can provide more accurate and objective emotion recognition. Electroencephalogram (EEG) signals respond in real time and are more sensitive to changes in affective states than peripheral neurophysiological signals. Thus, EEG signals can reveal important features of emotional states. Recently, several EEG-based BCI emotion recognition techniques have been developed. In addition, rapid advances in machine and deep learning have enabled machines or computers to understand, recognize, and analyze emotions. This study reviews emotion recognition methods that rely on multi-channel EEG signal-based BCIs and provides an overview of what has been accomplished in this area. It also provides an overview of the datasets and methods used to elicit emotional states. According to the usual emotional recognition pathway, we review various EEG feature extraction, feature selection/reduction, machine learning methods (e.g., k-nearest neighbor), support vector machine, decision tree, artificial neural network, random forest, and naive Bayes) and deep learning methods (e.g., convolutional and recurrent neural networks with long short term memory). In addition, EEG rhythms that are strongly linked to emotions as well as the relationship between distinct brain areas and emotions are discussed. We also discuss several human emotion recognition studies, published between 2015 and 2021, that use EEG data and compare different machine and deep learning algorithms. Finally, this review suggests several challenges and future research directions in the recognition and classification of human emotional states using EEG.

Validation of Continuous Monitoring System for Epileptic Users in Outpatient Settings

Epilepsy is a chronic disease with a significant social impact, given that the patients and their families often live conditioned by the possibility of an epileptic seizure and its possible consequences, such as accidents, injuries, or even sudden unexplained death. In this context, ambulatory monitoring allows the collection of biomedical data about the patients’ health, thus gaining more knowledge about the physiological state and daily activities of each patient in a more personalized manner. For this reason, this article proposes a novel monitoring system composed of different sensors capable of synchronously recording electrocardiogram (ECG), photoplethysmogram (PPG), and ear electroencephalogram (EEG) signals and storing them for further processing and analysis in a microSD card. This system can be used in a static and/or ambulatory way, providing information about the health state through features extracted from the ear EEG signal and the calculation of the heart rate variability (HRV) and pulse travel time (PTT). The different applied processing techniques to improve the quality of these signals are described in this work. A novel algorithm used to compute HRV and PTT robustly and accurately in ambulatory settings is also described. The developed device has also been validated and compared with other commercial systems obtaining similar results. In this way, based on the quality of the obtained signals and the low variability of the computed parameters, even in ambulatory conditions, the developed device can potentially serve as a support tool for clinical decision-taking stages.

Thinking out loud, an open-access EEG-based BCI dataset for inner speech recognition

Surface electroencephalography is a standard and noninvasive way to measure electrical brain activity. Recent advances in artificial intelligence led to significant improvements in the automatic detection of brain patterns, allowing increasingly faster, more reliable and accessible Brain-Computer Interfaces. Different paradigms have been used to enable the human-machine interaction and the last few years have broad a mark increase in the interest for interpreting and characterizing the “inner voice” phenomenon. This paradigm, called inner speech, raises the possibility of executing an order just by thinking about it, allowing a “natural” way of controlling external devices. Unfortunately, the lack of publicly available electroencephalography datasets, restricts the development of new techniques for inner speech recognition. A ten-participant dataset acquired under this and two others related paradigms, recorded with an acquisition system of 136 channels, is presented. The main purpose of this work is to provide the scientific community with an open-access multiclass electroencephalography database of inner speech commands that could be used for better understanding of the related brain mechanisms.

Measurement(s)	brain activity • inner speech command
Technology Type(s)	electroencephalography
Sample Characteristic - Organism	Homo sapiens

Machine-accessible metadata file describing the reported data: 10.6084/m9.figshare.16783987

Low-cost brain computer interface for everyday use

With the growth in electroencephalography (EEG) based applications the demand for affordable consumer solutions is increasing. Here we describe a compact, low-cost EEG device suitable for daily use. The data are transferred from the device to a personal server using the TCP-IP protocol, allowing for wireless operation and a decent range of motion for the user. The device is compact, having a circular shape with a radius of only 25 mm, which would allow for comfortable daily use during both daytime and nighttime. Our solution is also very cost effective, approximately $350 for 24 electrodes. The built-in noise suppression capability improves the accuracy of recordings with a peak input noise below 0.35 μV. Here, we provide the results of the tests for the developed device. On our GitHub page, we provide detailed specification of the steps involved in building this EEG device which should be helpful to readers designing similar devices for their needs  https://github.com/Ildaron/ironbci .

Motor-Imagery EEG-Based BCIs in Wheelchair Movement and Control: A Systematic Literature Review

The pandemic emergency of the coronavirus disease 2019 (COVID-19) shed light on the need for innovative aids, devices, and assistive technologies to enable people with severe disabilities to live their daily lives. EEG-based Brain-Computer Interfaces (BCIs) can lead individuals with significant health challenges to improve their independence, facilitate participation in activities, thus enhancing overall well-being and preventing impairments. This systematic review provides state-of-the-art applications of EEG-based BCIs, particularly those using motor-imagery (MI) data, to wheelchair control and movement. It presents a thorough examination of the different studies conducted since 2010, focusing on the algorithm analysis, features extraction, features selection, and classification techniques used as well as on wheelchair components and performance evaluation. The results provided in this paper could highlight the limitations of current biomedical instrumentations applied to people with severe disabilities and bring focus to innovative research topics.

Noninvasive Electroencephalography Equipment for Assistive, Adaptive, and Rehabilitative Brain-Computer Interfaces: A Systematic Literature Review

Humans interact with computers through various devices. Such interactions may not require any physical movement, thus aiding people with severe motor disabilities in communicating with external devices. The brain-computer interface (BCI) has turned into a field involving new elements for assistive and rehabilitative technologies. This systematic literature review (SLR) aims to help BCI investigator and investors to decide which devices to select or which studies to support based on the current market examination. This examination of noninvasive EEG devices is based on published BCI studies in different research areas. In this SLR, the research area of noninvasive BCIs using electroencephalography (EEG) was analyzed by examining the types of equipment used for assistive, adaptive, and rehabilitative BCIs. For this SLR, candidate studies were selected from the IEEE digital library, PubMed, Scopus, and ScienceDirect. The inclusion criteria (IC) were limited to studies focusing on applications and devices of the BCI technology. The data used herein were selected using IC and exclusion criteria to ensure quality assessment. The selected articles were divided into four main research areas: education, engineering, entertainment, and medicine. Overall, 238 papers were selected based on IC. Moreover, 28 companies were identified that developed wired and wireless equipment as means of BCI assistive technology. The findings of this review indicate that the implications of using BCIs for assistive, adaptive, and rehabilitative technologies are encouraging for people with severe motor disabilities and healthy people. With an increasing number of healthy people using BCIs, other research areas, such as the motivation of players when participating in games or the security of soldiers when observing certain areas, can be studied and collaborated using the BCI technology. However, such BCI systems must be simple (wearable), convenient (sensor fabrics and self-adjusting abilities), and inexpensive.

Crowdsourcing in Cognitive and Systems Neuroscience

Behavioral research in cognitive and human systems neuroscience has been largely carried out in-person in laboratory settings. Underpowering and lack of reproducibility due to small sample sizes have weakened conclusions of these investigations. In other disciplines, such as neuroeconomics and social sciences, crowdsourcing has been extensively utilized as a data collection tool, and a means to increase sample sizes. Recent methodological advances allow scientists, for the first time, to test online more complex cognitive, perceptual, and motor tasks. Here we review the nascent literature on the use of online crowdsourcing in cognitive and human systems neuroscience. These investigations take advantage of the ability to reliably track the activity of a participant's computer keyboard, mouse, and eye gaze in the context of large-scale studies online that involve diverse research participant pools. Crowdsourcing allows for testing the generalizability of behavioral hypotheses in real-life environments that are less accessible to lab-designed investigations. Crowdsourcing is further useful when in-laboratory studies are limited, for example during the current COVID-19 pandemic. We also discuss current limitations of crowdsourcing research, and suggest pathways to address them. We conclude that online crowdsourcing is likely to widen the scope and strengthen conclusions of cognitive and human systems neuroscience investigations.

Induction of Neural Plasticity Using a Low-Cost Open Source Brain-Computer Interface and a 3D-Printed Wrist Exoskeleton

Brain-computer interfaces (BCIs) have been proven to be useful for stroke rehabilitation, but there are a number of factors that impede the use of this technology in rehabilitation clinics and in home-use, the major factors including the usability and costs of the BCI system. The aims of this study were to develop a cheap 3D-printed wrist exoskeleton that can be controlled by a cheap open source BCI (OpenViBE), and to determine if training with such a setup could induce neural plasticity. Eleven healthy volunteers imagined wrist extensions, which were detected from single-trial electroencephalography (EEG), and in response to this, the wrist exoskeleton replicated the intended movement. Motor-evoked potentials (MEPs) elicited using transcranial magnetic stimulation were measured before, immediately after, and 30 min after BCI training with the exoskeleton. The BCI system had a true positive rate of 86 ± 12% with 1.20 ± 0.57 false detections per minute. Compared to the measurement before the BCI training, the MEPs increased by 35 ± 60% immediately after and 67 ± 60% 30 min after the BCI training. There was no association between the BCI performance and the induction of plasticity. In conclusion, it is possible to detect imaginary movements using an open-source BCI setup and control a cheap 3D-printed exoskeleton that when combined with the BCI can induce neural plasticity. These findings may promote the availability of BCI technology for rehabilitation clinics and home-use. However, the usability must be improved, and further tests are needed with stroke patients.

EEG-Based BCI Emotion Recognition: A Survey

Affecting computing is an artificial intelligence area of study that recognizes, interprets, processes, and simulates human affects. The user's emotional states can be sensed through electroencephalography (EEG)-based Brain Computer Interfaces (BCI) devices. Research in emotion recognition using these tools is a rapidly growing field with multiple inter-disciplinary applications. This article performs a survey of the pertinent scientific literature from 2015 to 2020. It presents trends and a comparative analysis of algorithm applications in new implementations from a computer science perspective. Our survey gives an overview of datasets, emotion elicitation methods, feature extraction and selection, classification algorithms, and performance evaluation. Lastly, we provide insights for future developments.