A P300-based brain-computer interface for people with amyotrophic lateral sclerosis

Feasibility of source-level motor imagery classification for people with multiple sclerosis

Objective.There is limited work investigating brain-computer interface (BCI) technology in people with multiple sclerosis (pwMS), a neurodegenerative disorder of the central nervous system. Present work is limited to recordings at the scalp, which may be significantly altered by changes within the cortex due to volume conduction. The recordings obtained from the sensors, therefore, combine disease-related alterations and task-relevant neural signals, as well as signals from other regions of the brain that are not relevant. The current study aims to unmix signals affected by multiple sclerosis (MS) progression and BCI task-relevant signals using estimated source activity to improve classification accuracy.Approach.Data was collected from eight participants with a range of MS severity and ten neurotypical participants. This dataset was used to report the classification accuracy of imagined movements of the hands and feet at the sensor-level and the source-level in the current study.K-means clustering of equivalent current dipoles was conducted to unmix temporally independent signals. The location of these dipoles was compared between MS and control groups and used for classification of imagined movement. Linear discriminant analysis classification was performed at each time-frequency point to highlight differences in frequency band delay.Main Results.Source-level signal acquisition significantly improved decoding accuracy of imagined movement vs rest and movement vs movement classification in pwMS and controls. There was no significant difference found in alpha (7-13 Hz) and beta (13-30 Hz) band classification delay between the neurotypical control and MS group, including imagery of limbs with weakness or paralysis.Significance.This study is the first to demonstrate the advantages of source-level analysis for BCI applications in pwMS. The results highlight the potential for enhanced clinical outcomes and emphasize the need for longitudinal studies to assess the impact of MS progression on BCI performance, which is crucial for effective clinical translation of BCI technology.

Towards developing brain-computer interfaces for people with Multiple Sclerosis

BACKGROUND

Multiple Sclerosis (MS) can be a severely disabling condition that leads to various neurological symptoms. A Brain-Computer Interface (BCI) may substitute some lost function; however, there is a lack of BCI research in people with MS. Present BCI designs have also overlooked the unique pathological changes associated with MS and have not considered needs of users within their home environments. To progress this research area effectively and efficiently, we aimed to evaluate user needs and assess the feasibility and user-centric requirements of a BCI for people with MS. We hypothesised that (i) people with MS would be interested in adopting BCI technology and (ii) those with reduced independence would prefer a higher-performing invasive BCI.

METHODS

We conducted an online survey of people with MS to describe user preferences and establish the initial steps of user-centred design. The survey aimed to understand their interest in BCI applications, bionic applications, device preferences, and development considerations and related these to symptoms and assistance needs.

RESULTS

We demonstrated widespread interest for BCI applications in all stages of MS, with a preference for a non-invasive (n = 12) or minimally invasive (n = 15) BCI over carer assistance (n = 6). Descriptive analysis indicated that level of independence did not influence preference towards the higher performing but highly invasive BCI.

CONCLUSIONS

The needs of end users reported in this study are crucial for efficient development of BCI systems that can be effectively translated into the home environment. Considering the potential to enhance independence and quality of life for people living with MS, the results emphasise the importance of user-centred design for future advancement of BCIs that account for the unique pathological changes associated with MS.

A protocol for trustworthy EEG decoding with neural networks

Deep learning solutions have rapidly emerged for EEG decoding, achieving state-of-the-art performance on a variety of decoding tasks. Despite their high performance, existing solutions do not fully address the challenge posed by the introduction of many hyperparameters, defining data pre-processing, network architecture, network training, and data augmentation. Automatic hyperparameter search is rarely performed and limited to network-related hyperparameters. Moreover, pipelines are highly sensitive to performance fluctuations due to random initialization, hindering their reliability. Here, we design a comprehensive protocol for EEG decoding that explores the hyperparameters characterizing the entire pipeline and that includes multi-seed initialization for providing robust performance estimates. Our protocol is validated on 9 datasets about motor imagery, P300, SSVEP, including 204 participants and 26 recording sessions, and on different deep learning models. We accompany our protocol with extensive experiments on the main aspects influencing it, such as the number of participants used for hyperparameter search, the split into sequential simpler searches (multi-step search), the use of informed vs. non-informed search algorithms, and the number of random seeds for obtaining stable performance. The best protocol included 2-step hyperparameter search via an informed search algorithm, with the final training and evaluation performed using 10 random initializations. The optimal trade-off between performance and computational time was achieved by using a subset of 3-5 participants for hyperparameter search. Our protocol consistently outperformed baseline state-of-the-art pipelines, widely across datasets and models, and could represent a standard approach for neuroscientists for decoding EEG in a trustworthy and reliable way.

Non-Invasive Brain-Computer Interfaces: State of the Art and Trends

Brain-computer interface (BCI) is a rapidly evolving technology that has the potential to widely influence research, clinical and recreational use. Non-invasive BCI approaches are particularly common as they can impact a large number of participants safely and at a relatively low cost. Where traditional non-invasive BCIs were used for simple computer cursor tasks, it is now increasingly common for these systems to control robotic devices for complex tasks that may be useful in daily life. In this review, we provide an overview of the general BCI framework as well as the various methods that can be used to record neural activity, extract signals of interest, and decode brain states. In this context, we summarize the current state-of-the-art of non-invasive BCI research, focusing on trends in both the application of BCIs for controlling external devices and algorithm development to optimize their use. We also discuss various open-source BCI toolboxes and software, and describe their impact on the field at large.

Decoding imagined movement in people with multiple sclerosis for brain-computer interface translation

Objective.Multiple sclerosis (MS) is a heterogeneous autoimmune-mediated disorder affecting the central nervous system, commonly manifesting as fatigue and progressive limb impairment. This can significantly impact quality of life due to weakness or paralysis in the upper and lower limbs. A brain-computer interface (BCI) aims to restore quality of life through control of an external device, such as a wheelchair. However, the limited BCI research in people with MS has been confined to exploring the P300 response and brain signals associated with attempted movement. The current study aims to expand the MS-BCI literature by highlighting the feasibility of decoding MS imagined movement.Approach.We collected electroencephalography data from eight participants with various symptoms of MS and ten neurotypical control participants. Participants made imagined movements of the hands and feet as directed by a go no-go protocol. Binary regularised linear discriminant analysis was used to classify imagined movement vs. rest and vs. movement at individual time-frequency points. The frequency bands which provided the maximal accuracy, and the associated latency, were compared.Main Results.In all MS participants, the classification algorithm achieved above 70% accuracy in at least one imagined movement vs. rest classification and most movement vs. movement classifications. There was no significant difference between classification of limbs with weakness or paralysis to neurotypical controls. Both the MS and control groups possessed decodable information within the alpha (7-13 Hz) and beta (16-30 Hz) bands at similar latency.Significance.This study is the first to demonstrate the feasibility of decoding imagined movements in people with MS. As an alternative to the P300 response, motor imagery-based control of a BCI may also be combined with existing motor imagery therapy to supplement MS rehabilitation. These promising results merit further long term BCI studies to investigate the effect of MS progression on classification performance.

EEG Signals Classification Related to Visual Objects Using Long Short-Term Memory Network and Nonlinear Interval Type-2 Fuzzy Regression

By gaining insights into how brain activity is encoded and decoded, we enhance our understanding of brain function. This study introduces a method for classifying EEG signals related to visual objects, employing a combination of an LSTM network and nonlinear interval type-2 fuzzy regression (NIT2FR). Here, ResNet is utilized for feature extraction from images, the LSTM network for feature extraction from EEG signals, and NIT2FR for mapping image features to EEG signal features. The application of type-2 fuzzy logic addresses uncertainties arising from EEG signal nonlinearity, noise, limited data sample size, and diverse mental states among participants. The Stanford database was used for implementation, evaluating effectiveness through metrics like classification accuracy, precision, recall, and F1 score. According to the findings, the LSTM network achieved an accuracy of 55.83% in categorizing images using raw EEG data. When compared to other methods like linear type-2, linear/nonlinear type-1 fuzzy, neural network, and polynomial regression, NIT2FR coupled with an SVM classifier outperformed with a 68.05% accuracy. Thus, NIT2FR demonstrates superiority in handling high uncertainty environments. Moreover, the 6.03% improvement in accuracy over the best previous study using the same dataset underscores its effectiveness. Precision, recall, and F1 score results for NIT2FR were 68.93%, 68.08%, and 68.49% respectively, surpassing outcomes from linear type-2, linear/nonlinear type-1 fuzzy regression methods.

A click-based electrocorticographic brain-computer interface enables long-term high-performance switch scan spelling

BACKGROUND

Brain-computer interfaces (BCIs) can restore communication for movement- and/or speech-impaired individuals by enabling neural control of computer typing applications. Single command click detectors provide a basic yet highly functional capability.

METHODS

We sought to test the performance and long-term stability of click decoding using a chronically implanted high density electrocorticographic (ECoG) BCI with coverage of the sensorimotor cortex in a human clinical trial participant (ClinicalTrials.gov, NCT03567213) with amyotrophic lateral sclerosis. We trained the participant's click detector using a small amount of training data (<44 min across 4 days) collected up to 21 days prior to BCI use, and then tested it over a period of 90 days without any retraining or updating.

RESULTS

Using a click detector to navigate a switch scanning speller interface, the study participant can maintain a median spelling rate of 10.2 characters per min. Though a transient reduction in signal power modulation can interrupt usage of a fixed model, a new click detector can achieve comparable performance despite being trained with even less data (<15 min, within 1 day).

CONCLUSIONS

These results demonstrate that a click detector can be trained with a small ECoG dataset while retaining robust performance for extended periods, providing functional text-based communication to BCI users.

Using the Cocktail Party Effect to Add the Coding Dimension of Auditory Event Related Potential Brain-Computer Interface

OBJECTIVE

The auditory event-related potential based brain-computer interface (aERP-BCI) is a classical paradigm of brain-computer communication. To improve the coding efficiency of aERP-BCI, this study proposes a method using two parallel voice channels to add the coding dimension based on the cocktail party effect.

METHODS

The novel paradigm used male and female voices to establish two parallel oddball sound stimulus sequences. In comparison, the baseline paradigm only presented male or female stimulus sequences. Both the double voice condition (DVC) and the single voice condition (SVC) paradigms carried out offline experiments and the DVC also carried out online experiment. Subsequently, the EEG signal and BCI operation results were compared and analyzed.

CONCLUSION

The cocktail party effect caused a significant difference in the EEG responses of non-target stimulus between the focused vocal channel and the ignored vocal channel under the DVC paradigm, and the focused and ignored channels achieved a recognition accuracy of 97.2%. The target recognition rate of DVC was 82.3%, with no significant difference compared with 85% of SVC while the information transfer rate (ITR) of DVC reaching 15.3 bits/min was significantly higher than that of SVC.

SIGNIFICANCE

The cocktail party effect improves the coding efficiency by adding parallel channels without reducing the target/non-target stimulus recognition in the focused vocal channel. This provides a novel direction for the performance improvement of aERP-BCI.

Short-length SSVEP data extension by a novel generative adversarial networks based framework

Steady-state visual evoked potentials (SSVEPs) based brain-computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency identification methods heavily hinges on the amount of user calibration data and data length, which hinders the deployment in real-world applications. Recently, generative adversarial networks (GANs)-based data generation methods have been widely adopted to create synthetic electroencephalography data, holds promise to address these issues. In this paper, we proposed a GAN-based end-to-end signal transformation network for Time-window length Extension, termed as TEGAN. TEGAN transforms short-length SSVEP signals into long-length artificial SSVEP signals. Additionally, we introduced a two-stage training strategy and the LeCam-divergence regularization term to regularize the training process of GAN during the network implementation. The proposed TEGAN was evaluated on two public SSVEP datasets (a 4-class and 12-class dataset). With the assistance of TEGAN, the performance of traditional frequency recognition methods and deep learning-based methods have been significantly improved under limited calibration data. And the classification performance gap of various frequency recognition methods has been narrowed. This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system. The proposed GAN-based methods have the great potential of shortening the calibration time and cutting down the budget for various real-world BCI-based applications.

Boosting brain-computer interfaces with functional electrical stimulation: potential applications in people with locked-in syndrome

Individuals with a locked-in state live with severe whole-body paralysis that limits their ability to communicate with family and loved ones. Recent advances in brain-computer interface (BCI) technology have presented a potential alternative for these people to communicate by detecting neural activity associated with attempted hand or speech movements and translating the decoded intended movements to a control signal for a computer. A technique that could potentially enrich the communication capacity of BCIs is functional electrical stimulation (FES) of paralyzed limbs and face to restore body and facial movements of paralyzed individuals, allowing to add body language and facial expression to communication BCI utterances. Here, we review the current state of the art of existing BCI and FES work in people with paralysis of body and face and propose that a combined BCI-FES approach, which has already proved successful in several applications in stroke and spinal cord injury, can provide a novel promising mode of communication for locked-in individuals.

Detecting passive and active response in patients with behaviourally diagnosed unresponsive wakefulness syndrome

The diagnosis of unresponsive wakefulness syndrome depends mostly on the motor response following verbal commands. However, there is a potential for misdiagnosis in patients who understand verbal commands (passive response) but cannot perform voluntary movements (active response). To evaluate passive and active responses in such patients, this study used an approach combining functional magnetic resonance imaging and passive listening tasks to evaluate the level of speech comprehension, with portable brain-computer interface modalities that were applied to elicit an active response to attentional modulation tasks at the bedside. We included ten patients who were clinically diagnosed as unresponsive wakefulness syndrome. Two of ten patients showed no significant activation, while limited activation in the auditory cortex was found in six patients. The remaining two patients showed significant activation in language areas, and were able to control the brain-computer interface with reliable accuracy. Using a combined passive/active approach, we identified unresponsive wakefulness syndrome patients who showed both active and passive neural responses. This suggests that some patients with unresponsive wakefulness syndrome diagnosed behaviourally are both wakeful and responsive, and the combined approach is useful for distinguishing a minimally conscious state from unresponsive wakefulness syndrome physiologically.

Design and verification of a wearable wireless 64-channel high-resolution EEG acquisition system with wi-fi transmission

Brain-computer interfaces (BCIs) allow communication between the brain and the external world. This type of technology has been extensively studied. However, BCI instruments with high signal quality are typically heavy and large. Thus, recording electroencephalography (EEG) signals is an inconvenient task. In recent years, system-on-chip (SoC) approaches have been integrated into BCI research, and sensors for wireless portable devices have been developed; however, there is still considerable work to be done. As neuroscience research has advanced, EEG signal analyses have come to require more accurate data. Due to the limited bandwidth of Bluetooth wireless transmission technology, EEG measurement systems with more than 16 channels must be used to reduce the sampling rate and prevent data loss. Therefore, the goal of this study was to develop a multichannel, high-resolution (24-bit), high-sampling-rate EEG BCI device that transmits signals via Wi-Fi. We believe that this system can be used in neuroscience research. The EEG acquisition system proposed in this work is based on a Cortex-M4 microcontroller with a Wi-Fi subsystem, providing a multichannel design and improved signal quality. This system is compatible with wet sensors, Ag/AgCl electrodes, and dry sensors. A LabVIEW-based user interface receives EEG data via Wi-Fi transmission and saves the raw data for offline analysis. In previous cognitive experiments, event tags have been communicated using Recommended Standard 232 (RS-232). The developed system was validated through event-related potential (ERP) and steady-state visually evoked potential (SSVEP) experiments. Our experimental results demonstrate that this system is suitable for recording EEG measurements and has potential in practical applications. The advantages of the developed system include its high sampling rate and high amplification. Additionally, in the future, Internet of Things (IoT) technology can be integrated into the system for remote real-time analysis or edge computing.

Promoting Simple and Engaging Brain-Computer Interface Designs for Children by Evaluating Contrasting Motion Techniques

PURPOSE

There is an increasing focus on using motion in augmentative and alternative communication (AAC) systems. In considering brain-computer interface access to AAC (BCI-AAC), motion may provide a simpler or more intuitive avenue for BCI-AAC control. Different motion techniques may be utilized in supporting competency with AAC devices including simple (e.g., zoom) and complex (behaviorally relevant animation) methods. However, how different pictorial symbol animation techniques impact BCI-AAC is unclear.

METHOD

Sixteen healthy children completed two experimental conditions. These conditions included highlighting of pictorial symbols via both functional (complex) and zoom (simple) animation to evaluate the effects of motion techniques on P300-based BCI-AAC signals and offline (predicted) BCI-AAC performance.

RESULTS

Functional (complex) animation significantly increased attentional-related P200/P300 event-related potential (ERP) amplitudes in the parieto-occipital area. Zoom (simple) animation significantly decreased N400 latency. N400 ERP amplitude was significantly greater, and occurred significantly earlier, on the right versus left side for the functional animation condition within the parieto-occipital bin. N200 ERP latency was significantly reduced over the left hemisphere for the zoom condition in the central bin. As hypothesized, elicitation of all targeted ERP components supported offline (predicted) BCI-AAC performance being similar between conditions.

CONCLUSION

Study findings provide continued support for the use of animation in BCI-AAC systems for children and highlight differences in neural and attentional processing between complex and simple animation techniques.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.24085623.

A high-frequency SSVEP-BCI system based on a 360 Hz refresh rate

Objective. Steady-state visual evoked potential (SSVEP) based brain-computer interfaces (BCIs) often struggle to balance user experience and system performance. To address this challenge, this study employed stimuli in the 55-62.8 Hz frequency range to implement a 40-target BCI speller that offered both high-performance and user-friendliness.Approach. This study proposed a method that presents stable multi-target stimuli on a monitor with a 360 Hz refresh rate. Real-time generation of stimulus matrix and stimulus rendering was used to ensure stable presentation while reducing the computational load. The 40 targets were encoded using the joint frequency and phase modulation method, offline and online BCI experiments were conducted on 16 subjects using the task discriminant component analysis algorithm for feature extraction and classification.Main results. The online BCI system achieved an average accuracy of 88.87% ± 3.05% and an information transfer rate of 51.83 ± 2.77 bits min-1under the low flickering perception condition.Significance. These findings suggest the feasibility and significant practical value of the proposed high-frequency SSVEP BCI system in advancing the visual BCI technology.

Talking with hands and feet: Selective somatosensory attention and fMRI enable robust and convenient brain-based communication

In brain-based communication, voluntarily modulated brain signals (instead of motor output) are utilized to interact with the outside world. The possibility to circumvent the motor system constitutes an important alternative option for severely paralyzed. Most communication brain-computer interface (BCI) paradigms require intact visual capabilities and impose a high cognitive load, but for some patients, these requirements are not given. In these situations, a better-suited, less cognitively demanding information-encoding approach may exploit auditorily-cued selective somatosensory attention to vibrotactile stimulation. Here, we propose, validate and optimize a novel communication-BCI paradigm using differential fMRI activation patterns evoked by selective somatosensory attention to tactile stimulation of the right hand or left foot. Using cytoarchitectonic probability maps and multi-voxel pattern analysis (MVPA), we show that the locus of selective somatosensory attention can be decoded from fMRI-signal patterns in (especially primary) somatosensory cortex with high accuracy and reliability, with the highest classification accuracy (85.93%) achieved when using Brodmann area 2 (SI-BA2) at a probability level of 0.2. Based on this outcome, we developed and validated a novel somatosensory attention-based yes/no communication procedure and demonstrated its high effectiveness even when using only a limited amount of (MVPA) training data. For the BCI user, the paradigm is straightforward, eye-independent, and requires only limited cognitive functioning. In addition, it is BCI-operator friendly given its objective and expertise-independent procedure. For these reasons, our novel communication paradigm has high potential for clinical applications.

Altered Inhibitory Control Mechanism of Internet Addiction: An Electroencephalogram Study of Brain Oscillations and Connectivity

The development of the Internet has changed people's lives and has resulted in a new type of addictive behavior. In the past decade, Internet game addiction has been identified as a mental illness. Considering internet game addiction as the only cause of mental illness is limited in its view, as internet games, social platforms and other internet multimedia are also widely used. Thus, other internet-related behaviors, that maybe addictive, should also be included. Previous neuroimaging studies have reported a role of alteration in brain's inhibitory control mechanism in addiction. However, the results are still diverse with inconsistent findings. In this study, we used an Internet-related stop signal task with EEG signals recorded to study the relationship between internet addiction through brain oscillations and functional connectivity. We also compared the differences in the brain connectivity between addicted and non-addicted participants using phase lag index. We found that the brain connectivity in participants addicted to the internet is significantly greater than that of nonaddicted users.Clinical Relevance- In this study, we assessed brain functional networks of participants with Internet Gaming Disorder and internet addiction.

Applications of brain-computer interfaces in neurodegenerative diseases

Brain-computer interfaces (BCIs) provide the central nervous system with channels of direct communication to the outside world, without having to go through the peripheral nervous system. Neurodegenerative diseases (NDs) are notoriously incurable and burdensome medical conditions that will result in progressive deterioration of the nervous system. The applications of BCIs in NDs have been studied for decades now through different approaches, resulting in a considerable amount of literature in all related areas. In this study, we begin by introducing BCIs and proceed by explaining the principles of BCI-based neurorehabilitation. Then, we go through four specific types of NDs, including amyotrophic lateral sclerosis, Parkinson's disease, Alzheimer's disease, and spinal muscular atrophy, and review some of the applications of BCIs in the neural rehabilitation of these diseases. We conclude with a discussion of the characteristics, challenges, and future possibilities of research in the field. Going through the uses of BCIs in NDs, we can see that approaches and strategies employed to tackle the wide range of limitations caused by NDs are numerous and diverse. Furthermore, NDs can fall under different categories based on the target area of neurodegeneration and thus require different methods of BCI-based rehabilitation. In recent years, neurotechnology companies have substantially invested in research on BCIs, focusing on commercializing BCIs and bringing BCI-based technologies from bench to bedside. This can mean the beginning of a new era for BCI-based neurorehabilitation, with an anticipated spike in interest among researchers, practitioners, engineers, and entrepreneurs alike.

Teleintervention for users of augmentative and alternative communication devices: A systematic review

AIM

To synthesize existing evidence on the effectiveness of speech-language teleinterventions delivered via videoconferencing to users of augmentative and alternative communication (AAC) devices.

METHOD

A systematic literature search was conducted in 10 electronic databases, from inception until August 2021. Included were speech-language teleinterventions delivered by researchers and/or clinicians via videoconferencing to users of AAC devices, without restrictions on chronological age and clinical diagnosis. The quality of the studies included in the review was appraised using the Downs and Black checklist and the Single-Case Experimental Design Scale; risk of bias was assessed using the Risk Of Bias In Non-Randomized Studies - of Interventions and the single-case design risk of bias tools.

RESULTS

Six teleinterventions including 25 participants with a variety of conditions, such as Down syndrome, autism, Rett syndrome, and amyotrophic lateral sclerosis met the inclusion criteria. Five studies used a single-case experimental design and one was a cohort study. Teleinterventions included active consultation (n = 2), functional communication training (n = 2), brain-computer interface (n = 1), and both teleintervention and in-person intervention (n = 1). All teleinterventions reported an increase in participants' independent use of AAC devices during the training sessions compared to baseline, as well as an overall high satisfaction and treatment acceptability.

INTERPRETATION

Speech-language teleinterventions for users of AAC devices show great potential for a successful method of service delivery. Future telehealth studies with larger sample sizes and more robust methodology are strongly encouraged to allow the generalization of results across different populations.

WHAT THIS PAPER ADDS

Individuals can learn to use augmentative and alternative communication (AAC) devices independently during tele-AAC interventions. Service providers and recipients reported an overall high satisfaction and acceptability for AAC services delivered via teleinterventions. Speech-language teleinterventions may be an effective method of providing AAC intervention services.

Global Functional Connectivity at Rest Is Associated with Attention: An Arterial Spin Labeling Study

Neural markers of attention, including those frequently linked to the event-related potential P3 (P300) or P3b component, vary widely within and across participants. Understanding the neural mechanisms of attention that contribute to the P3 is crucial for better understanding attention-related brain disorders. All ten participants were scanned twice with a resting-state PCASL perfusion MRI and an ERP with a visual oddball task to measure brain resting-state functional connectivity (rsFC) and P3 parameters (P3 amplitudes and P3 latencies). Global rsFC (average rsFC across the entire brain) was associated with both P3 amplitudes (r = 0.57, p = 0.011) and P3 onset latencies (r = -0.56, p = 0.012). The observed P3 parameters were correlated with predicted P3 amplitude from the global rsFC (amplitude: r = +0.48, p = 0.037; latency: r = +0.40, p = 0.088) but not correlated with the rsFC over the most significant individual edge. P3 onset latency was primarily related to long-range connections between the prefrontal and parietal/limbic regions, while P3 amplitudes were related to connections between prefrontal and parietal/occipital, between sensorimotor and subcortical, and between limbic/subcortical and parietal/occipital regions. These results demonstrated the power of resting-state PCASL and P3 correlation with brain global functional connectivity.

Neuropsychological and Neurophysiological Mechanisms behind Flickering Light Stimulus Processing

The aim of this review is to summarise current knowledge about flickering light and the underlying processes that occur during its processing in the brain. Despite the growing interest in the topic of flickering light, its clinical applications are still not well understood. Studies using EEG indicate an appearing synchronisation of brain wave frequencies with the frequency of flickering light, and hopefully, it could be used in memory therapy, among other applications. Some researchers have focused on using the flicker test as an indicator of arousal, which may be useful in clinical studies if the background for such a relationship is described. Since flicker testing has a risk of inducing epileptic seizures, however, every effort must be made to avoid high-risk combinations, which include, for example, red-blue light flashing at 15 Hz. Future research should focus on the usage of neuroimaging methods to describe the specific neuropsychological and neurophysiological processes occurring in the brain during the processing of flickering light so that its clinical utility can be preliminarily determined and randomised clinical trials can be initiated to test existing reports.

A separable convolutional neural network-based fast recognition method for AR-P300

Augmented reality-based brain–computer interface (AR–BCI) has a low signal-to-noise ratio (SNR) and high real-time requirements. Classical machine learning algorithms that improve the recognition accuracy through multiple averaging significantly affect the information transfer rate (ITR) of the AR–SSVEP system. In this study, a fast recognition method based on a separable convolutional neural network (SepCNN) was developed for an AR-based P300 component (AR–P300). SepCNN achieved single extraction of AR–P300 features and improved the recognition speed. A nine-target AR–P300 single-stimulus paradigm was designed to be administered with AR holographic glasses to verify the effectiveness of SepCNN. Compared with four classical algorithms, SepCNN significantly improved the average target recognition accuracy (81.1%) and information transmission rate (57.90 bits/min) of AR–P300 single extraction. SepCNN with single extraction also attained better results than classical algorithms with multiple averaging.

Overview of the EEG-Based Classification of Motor Imagery Activities Using Machine Learning Methods and Inference Acceleration with FPGA-Based Cards

In this article, we provide a brief overview of the EEG-based classification of motor imagery activities using machine learning methods. We examined the effect of data segmentation and different neural network structures. By applying proper window size and using a purely convolutional neural network, we achieved 97.7% recognition accuracy on data from twenty subjects in three classes. The proposed architecture outperforms several networks used in previous research and makes the motor imagery-based BCI more efficient in some applications. In addition, we examined the performance of the neural network on a FPGA-based card and compared it with the inference speed and accuracy provided by a general-purpose processor.

Reducing the Calibration Time in Somatosensory BCI by Using Tactile ERD

OBJECTIVE

We propose a tactile-induced-oscillation approach to reduce the calibration time in somatosensory brain-computer interfaces (BCI).

METHODS

Based on the similarity between tactile induced event-related desynchronization (ERD) and imagined sensation induced ERD activation, we extensively evaluated BCI performance when using a conventional and a novel calibration strategy. In the conventional calibration, the tactile imagined data was used, while in the sensory calibration model sensory stimulation data was used. Subjects were required to sense the tactile stimulus when real tactile was applied to the left or right wrist and were required to perform imagined sensation tasks in the somatosensory BCI paradigm.

RESULTS

The sensory calibration led to a significantly better performance than the conventional calibration when tested on the same imagined sensation dataset ( [Formula: see text]=10.89, P=0.0038), with an average 5.1% improvement in accuracy. Moreover, the sensory calibration was 39.3% faster in reaching a performance level of above 70% accuracy.

CONCLUSION

The proposed approach of using tactile ERD from the sensory cortex provides an effective way of reducing the calibration time in a somatosensory BCI system.

SIGNIFICANCE

The tactile stimulation would be specifically useful before BCI usage, avoiding excessive fatigue when the mental task is difficult to perform. The tactile ERD approach may find BCI applications for patients or users with preserved afferent pathways.

Usability of a Hybrid System Combining P300-Based Brain-Computer Interface and Commercial Assistive Technologies to Enhance Communication in People With Multiple Sclerosis

Brain-computer interface (BCI) can provide people with motor disabilities with an alternative channel to access assistive technology (AT) software for communication and environmental interaction. Multiple sclerosis (MS) is a chronic disease of the central nervous system that mostly starts in young adulthood and often leads to a long-term disability, possibly exacerbated by the presence of fatigue. Patients with MS have been rarely considered as potential BCI end-users. In this pilot study, we evaluated the usability of a hybrid BCI (h-BCI) system that enables both a P300-based BCI and conventional input devices (i.e., muscular dependent) to access mainstream applications through the widely used AT software for communication “Grid 3.” The evaluation was performed according to the principles of the user-centered design (UCD) with the aim of providing patients with MS with an alternative control channel (i.e., BCI), potentially less sensitive to fatigue. A total of 13 patients with MS were enrolled. In session I, participants were presented with a widely validated P300-based BCI (P3-speller); in session II, they had to operate Grid 3 to access three mainstream applications with (1) an AT conventional input device and (2) the h-BCI. Eight patients completed the protocol. Five out of eight patients with MS were successfully able to access the Grid 3 via the BCI, with a mean online accuracy of 83.3% (± 14.6). Effectiveness (online accuracy), satisfaction, and workload were comparable between the conventional AT inputs and the BCI channel in controlling the Grid 3. As expected, the efficiency (time for correct selection) resulted to be significantly lower for the BCI with respect to the AT conventional channels (Z = 0.2, p < 0.05). Although cautious due to the limited sample size, these preliminary findings indicated that the BCI control channel did not have a detrimental effect with respect to conventional AT channels on the ability to operate an AT software (Grid 3). Therefore, we inferred that the usability of the two access modalities was comparable. The integration of BCI with commercial AT input devices to access a widely used AT software represents an important step toward the introduction of BCIs into the AT centers’ daily practice.

The science and engineering behind sensitized brain-controlled bionic hands

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

Improving the performance of a gaze independent P300-BCI by using the expectancy wave

OBJECTIVE

A P300-BCI conveys a subject's intention through recognition of their ERPs. However, in the case of visual stimuli, its performance depends strongly on eye gaze. When eye movement is impaired, it becomes difficult to focus attention on a target stimulus, and the quality of the ERP declines greatly, thereby affecting recognition efficiency.

APPROACH

In this paper, the expectancy wave (E-wave) is proposed to improve signal quality and thereby improve identification of visual targets under the covert attention. The stimuli of the P300-BCI described here are presented in a fixed sequence, so the subjects can predict the next target stimulus and establish a stable expectancy effect of the target stimulus through training. Features from the E-wave that occurred 0~300ms before a stimulus were added to the post-stimulus ERP components for intention recognition.

MAIN RESULTS

Comparisons of 10 healthy subjects before and after training demonstrated that the expectancy wave generated before target stimulus could be used with the P300 component to improve character recognition accuracy (CRA) from 85% to 92.4%. In addition, CRA using only the expectancy component can reach 68.2%, which is significantly greater than random probability (16.7%). The results of this study indicate that the expectancy wave can be used to improve recognition efficiency for a gaze-independent P300-BCI, and that training contributes to induction and recognition of the potential.

SIGNIFICANCE

This study proposes an effective approach to an efficient gaze-independent P300-BCI system.

Spelling interface using intracortical signals in a completely locked-in patient enabled via auditory neurofeedback training

Patients with amyotrophic lateral sclerosis (ALS) can lose all muscle-based routes of communication as motor neuron degeneration progresses, and ultimately, they may be left without any means of communication. While others have evaluated communication in people with remaining muscle control, to the best of our knowledge, it is not known whether neural-based communication remains possible in a completely locked-in state. Here, we implanted two 64 microelectrode arrays in the supplementary and primary motor cortex of a patient in a completely locked-in state with ALS. The patient modulated neural firing rates based on auditory feedback and he used this strategy to select letters one at a time to form words and phrases to communicate his needs and experiences. This case study provides evidence that brain-based volitional communication is possible even in a completely locked-in state.

Emerging technologies for management of patients with amyotrophic lateral sclerosis: from telehealth to assistive robotics and neural interfaces

Amyotrophic lateral sclerosis (ALS), also known as motor neuron disease, is characterized by the degeneration of both upper and lower motor neurons, which leads to muscle weakness and subsequently paralysis. It begins subtly with focal weakness but spreads relentlessly to involve most muscles, thus proving to be effectively incurable. Typically, death due to respiratory paralysis occurs in 3–5 years. To date, it has been shown that the management of ALS patients is best achieved with a multidisciplinary approach, and with the help of emerging technologies ranging from multidisciplinary teleconsults (for monitoring the dysphagia, respiratory function, and nutritional status) to brain-computer interfaces and eye tracking for alternative augmentative communication, until robotics, it may increase effectiveness. The COVID-19 pandemic created a spasmodic need to accelerate the development and implementation of such technologies in clinical practice, to improve the daily lives of both ALS patients and caregivers. However, despite the remarkable strides that have been made in the field, there are still issues to be addressed. This review will be discussed on the eureka moment of emerging technologies for ALS, used as a blueprint not only for neurodegenerative diseases, examining the current technologies already in place or being evaluated, highlighting the pros and cons for future clinical applications.

EEG-Based Multiword Imagined Speech Classification for Persian Words

This study focuses on providing a simple, extensible, and multiclass classifier for imagined words using EEG signals. Six Persian words, along with the silence (or idle state), were selected as input classes. The words can be used to control a mouse/robot movement or fill a simple computer form. The data set of this study was 10 recordings of five participants collected in five sessions. Each record had 20 repetitions of all words and the silence. Feature sets consist of normalized, 1 Hz resolution frequency spectrum of 19 EEG channels in 1 to 32 Hz bands. Majority rule on a bank of binary SVM classifiers was used to determine the corresponding class of a feature set. Mean accuracy and confusion matrix of the classifiers were estimated by Monte-Carlo cross-validation. According to recording the time difference of inter- and intraclass samples, three classification modes were defined. In the long-time mode, where all instances of a word in the whole database are involved, average accuracies were about 58% for Word-Silence, 60% for Word-Word, 40% for Word-Word-Silence, and 32% for the seven-class classification (6 Words+Silence). For the short-time mode, when only instances of the same record are used, the accuracies were 96, 75, 79, and 55%, respectively. Finally, in the mixed-time classification, where samples of every class are taken from a different record, the highest performance achieved with average accuracies was about 97, 97, 92, and 62%. These results, even in the worst case of the long-time mode, are meaningfully better than random and are comparable with the best reported results of previously conducted studies in this area.

An FPGA-Embedded Brain-Computer Interface System to Support Individual Autonomy in Locked-In Individuals

Brain-computer interfaces (BCI) can detect specific EEG patterns and translate them into control signals for external devices by providing people suffering from severe motor disabilities with an alternative/additional channel to communicate and interact with the outer world. Many EEG-based BCIs rely on the P300 event-related potentials, mainly because they require training times for the user relatively short and provide higher selection speed. This paper proposes a P300-based portable embedded BCI system realized through an embedded hardware platform based on FPGA (field-programmable gate array), ensuring flexibility, reliability, and high-performance features. The system acquires EEG data during user visual stimulation and processes them in a real-time way to correctly detect and recognize the EEG features. The BCI system is designed to allow to user to perform communication and domotic controls.

Integrating Cognitive Developmental Neuroscience in Society: Lessons Learned From a Multidisciplinary Research Project on Education and Social Safety of Youth

Integrating fundamental science in society, with the goal to translate research findings to daily practice, comes with certain challenges. Successfully integrating research projects into society requires (1) good collaboration between scientists and societal stakeholders, (2) collaboration partners with common expectations and goals, and (3) investment in clear communication. Here we describe an integrative research project conducted by a large Dutch consortium that consisted of neuroscientists, psychologists, sociologists, ethicists, teachers, health care professionals and policy makers, focusing on applying cognitive developmental neuroscience for the benefit of youth in education and social safety. We argue that to effectively integrate cognitive developmental neuroscience in society, (1) it is necessary to invest in a well-functioning, diverse and multidisciplinary team involving societal stakeholders and youth themselves from the start of the project. This aids to build a so-called productive interactive network that increases the chances to realize societal impact in the long-term. Additionally, we propose that to integrate knowledge, (2) a different than standard research approach should be taken. When focusing on integration, the ultimate goal of research is not solely to understand the world better, but also to intervene with real-life situations, such as education or (forensic) youth care. To accomplish this goal, we propose an approach in which integration is not only started after the research has been conducted, but taken into account throughout the entire project. This approach helps to create common expectations and goals between different stakeholders. Finally, we argue that (3) dedicating sufficient resources to effective communication, both within the consortium and between scientists and society, greatly benefits the integration of cognitive developmental neuroscience in society.

A Multivariate Randomized Controlled Experiment about the Effects of Mindfulness Priming on EEG Neurofeedback Self-Regulation Serious Games

Neurofeedback training (NFT) is a technique often proposed to train brain activity SR with promising results. However, some criticism has been raised due to the lack of evaluation, reliability, and validation of its learning effects. The current work evaluates the hypothesis that SR learning may be improved by priming the subject before NFT with guided mindfulness meditation (MM). The proposed framework was tested in a two-way parallel-group randomized controlled intervention with a single session alpha NFT, in a simplistic serious game design. Sixty-two healthy naïve subjects, aged between 18 and 43 years, were divided into MM priming and no-priming groups. Although both the EG and CG successfully attained the up-regulation of alpha rhythms (F(1,59) = 20.67, p < 0.001, ηp2 = 0.26), the EG showed a significantly enhanced ability (t(29) = 4.38, p < 0.001) to control brain activity, compared to the CG (t(29) = 1.18, p > 0.1). Furthermore, EG superior performance on NFT seems to be explained by the subject’s lack of awareness at pre-intervention, less vigour at post-intervention, increased task engagement, and a relaxed non-judgemental attitude towards the NFT tasks. This study is a preliminary validation of the proposed assisted priming framework, advancing some implicit and explicit metrics about its efficacy on NFT performance, and a promising tool for improving naïve “users” self-regulation ability.

An Open Source-Based BCI Application for Virtual World Tour and Its Usability Evaluation

Brain-computer interfaces can provide a new communication channel and control functions to people with restricted movements. Recent studies have indicated the effectiveness of brain-computer interface (BCI) applications. Various types of applications have been introduced so far in this field, but the number of those available to the public is still insufficient. Thus, there is a need to expand the usability and accessibility of BCI applications. In this study, we introduce a BCI application for users to experience a virtual world tour. This software was built on three open-source environments and is publicly available through the GitHub repository. For a usability test, 10 healthy subjects participated in an electroencephalography (EEG) experiment and evaluated the system through a questionnaire. As a result, all the participants successfully played the BCI application with 96.6% accuracy with 20 blinks from two sessions and gave opinions on its usability (e.g., controllability, completeness, comfort, and enjoyment) through the questionnaire. We believe that this open-source BCI world tour system can be used in both research and entertainment settings and hopefully contribute to open science in the BCI field.

Brain-Computer Interfaces for Children With Complex Communication Needs and Limited Mobility: A Systematic Review

Brain-computer interfaces (BCIs) represent a new frontier in the effort to maximize the ability of individuals with profound motor impairments to interact and communicate. While much literature points to BCIs' promise as an alternative access pathway, there have historically been few applications involving children and young adults with severe physical disabilities. As research is emerging in this sphere, this article aims to evaluate the current state of translating BCIs to the pediatric population. A systematic review was conducted using the Scopus, PubMed, and Ovid Medline databases. Studies of children and adolescents that reported BCI performance published in English in peer-reviewed journals between 2008 and May 2020 were included. Twelve publications were identified, providing strong evidence for continued research in pediatric BCIs. Research evidence was generally at multiple case study or exploratory study level, with modest sample sizes. Seven studies focused on BCIs for communication and five on mobility. Articles were categorized and grouped based on type of measurement (i.e., non-invasive and invasive), and the type of brain signal (i.e., sensory evoked potentials or movement-related potentials). Strengths and limitations of studies were identified and used to provide requirements for clinical translation of pediatric BCIs. This systematic review presents the state-of-the-art of pediatric BCIs focused on developing advanced technology to support children and youth with communication disabilities or limited manual ability. Despite a few research studies addressing the application of BCIs for communication and mobility in children, results are encouraging and future works should focus on customizable pediatric access technologies based on brain activity.

Brain-Computer Interface (BCI) Control of a Virtual Assistant in a Smartphone to Manage Messaging Applications

Brain-computer interfaces (BCI) are a type of assistive technology that uses the brain signals of users to establish a communication and control channel between them and an external device. BCI systems may be a suitable tool to restore communication skills in severely motor-disabled patients, as BCI do not rely on muscular control. The loss of communication is one of the most negative consequences reported by such patients. This paper presents a BCI system focused on the control of four mainstream messaging applications running in a smartphone: WhatsApp, Telegram, e-mail and short message service (SMS). The control of the BCI is achieved through the well-known visual P300 row-column paradigm (RCP), allowing the user to select control commands as well as spelling characters. For the control of the smartphone, the system sends synthesized voice commands that are interpreted by a virtual assistant running in the smartphone. Four tasks related to the four mentioned messaging services were tested with 15 healthy volunteers, most of whom were able to accomplish the tasks, which included sending free text e-mails to an address proposed by the subjects themselves. The online performance results obtained, as well as the results of subjective questionnaires, support the viability of the proposed system.

Development of a Tactile Actuator with Non-Contact and Trans-Object Characteristics Using a Time-Varying Magnetic Field

A non-contact tactile stimulation system using a time-varying magnetic field was developed. The system comprises a control unit, power unit, output unit, and actuator. The control unit adjusts stimulation parameters, particularly the signal intensity and frequency. The power unit produces high voltages for generating the magnetic field, whereas the output unit transmits the energy generated according to the signal from the control unit to the actuator. A spiral coil actuator generates the magnetic field. To validate the effectiveness of the system, preliminary experiments on 10 male adults without neurological disorders (23.2 ± 3.05 years) were conducted. Magnetic field stimuli were presented to the right palm of the subjects at three different frequencies (10, 30, and 50 Hz), and corresponding electroencephalogram (EEG) signals were measured simultaneously. Event-related potential (ERP) analysis showed that N100 and P300 components were identified in somatosensory areas. Subjective evaluations revealed that feelings such as “tingling,” “trembling,” “tapping,” and “percussing” were induced. Moreover, as the stimulus frequency changes, differences may occur in induced feeling. The system uses a time-varying magnetic field, which not only induces tactile stimulation without contact but also has trans-object characteristics that can present tactile sensations, even when there is an obstacle between an actuator and skin.

High-performance brain-to-text communication via handwriting

Brain-computer interfaces (BCIs) can restore communication to people who have lost the ability to move or speak. So far, a major focus of BCI research has been on restoring gross motor skills, such as reaching and grasping^1-5 or point-and-click typing with a computer cursor^6,7. However, rapid sequences of highly dexterous behaviours, such as handwriting or touch typing, might enable faster rates of communication. Here we developed an intracortical BCI that decodes attempted handwriting movements from neural activity in the motor cortex and translates it to text in real time, using a recurrent neural network decoding approach. With this BCI, our study participant, whose hand was paralysed from spinal cord injury, achieved typing speeds of 90 characters per minute with 94.1% raw accuracy online, and greater than 99% accuracy offline with a general-purpose autocorrect. To our knowledge, these typing speeds exceed those reported for any other BCI, and are comparable to typical smartphone typing speeds of individuals in the age group of our participant (115 characters per minute)⁸. Finally, theoretical considerations explain why temporally complex movements, such as handwriting, may be fundamentally easier to decode than point-to-point movements. Our results open a new approach for BCIs and demonstrate the feasibility of accurately decoding rapid, dexterous movements years after paralysis.

The influence of motivation and emotion on sensorimotor rhythm-based brain-computer interface performance

While decades of research have investigated and technically improved brain-computer interface (BCI)-controlled applications, relatively little is known about the psychological aspects of brain-computer interfacing. In 35 healthy students, we investigated whether extrinsic motivation manipulated via monetary reward and emotional state manipulated via video and music would influence behavioral and psychophysiological measures of performance with a sensorimotor rhythm (SMR)-based BCI. We found increased task-related brain activity in extrinsically motivated (rewarded) as compared with nonmotivated participants but no clear effect of emotional state manipulation. Our experiment investigated the short-term effect of motivation and emotion manipulation in a group of young healthy subjects, and thus, the significance for patients in the locked-in state, who may be in need of a BCI, remains to be investigated.

Expert-Level Intracranial Electroencephalogram Ictal Pattern Detection by a Deep Learning Neural Network

Background: Decision-making in epilepsy surgery is strongly connected to the interpretation of the intracranial EEG (iEEG). Although deep learning approaches have demonstrated efficiency in processing extracranial EEG, few studies have addressed iEEG seizure detection, in part due to the small number of seizures per patient typically available from intracranial investigations. This study aims to evaluate the efficiency of deep learning methodology in detecting iEEG seizures using a large dataset of ictal patterns collected from epilepsy patients implanted with a responsive neurostimulation system (RNS). Methods: Five thousand two hundred and twenty-six ictal events were collected from 22 patients implanted with RNS. A convolutional neural network (CNN) architecture was created to provide personalized seizure annotations for each patient. Accuracy of seizure identification was tested in two scenarios: patients with seizures occurring following a period of chronic recording (scenario 1) and patients with seizures occurring immediately following implantation (scenario 2). The accuracy of the CNN in identifying RNS-recorded iEEG ictal patterns was evaluated against human neurophysiology expertise. Statistical performance was assessed via the area-under-precision-recall curve (AUPRC). Results: In scenario 1, the CNN achieved a maximum mean binary classification AUPRC of 0.84 ± 0.19 (95%CI, 0.72-0.93) and mean regression accuracy of 6.3 ± 1.0 s (95%CI, 4.3-8.5 s) at 30 seed samples. In scenario 2, maximum mean AUPRC was 0.80 ± 0.19 (95%CI, 0.68-0.91) and mean regression accuracy was 6.3 ± 0.9 s (95%CI, 4.8-8.3 s) at 20 seed samples. We obtained near-maximum accuracies at seed size of 10 in both scenarios. CNN classification failures can be explained by ictal electro-decrements, brief seizures, single-channel ictal patterns, highly concentrated interictal activity, changes in the sleep-wake cycle, and progressive modulation of electrographic ictal features. Conclusions: We developed a deep learning neural network that performs personalized detection of RNS-derived ictal patterns with expert-level accuracy. These results suggest the potential for automated techniques to significantly improve the management of closed-loop brain stimulation, including during the initial period of recording when the device is otherwise naïve to a given patient's seizures.

Habituation of P300 in the Use of P300-based Brain-Computer Interface Spellers: Individuals With Amyotrophic Lateral Sclerosis Versus Age-Matched Controls

The P300-based brain-computer interface speller can provide motor independent communication to individuals with amyotrophic lateral sclerosis (ALS), a progressive neurodegenerative disorder that affects the motor system. P300 amplitude stability is critical for operation of the P300 speller. The P300 has good long-term stability, but to our knowledge, short-term habituation in the P300 speller has not been studied. In the current study, 15 participants: 8 ALS patients and 7 age-matched healthy volunteers (HVs), used 2 versions of P300 spellers, Face speller and Flash speller, each for 30 minutes. The ALS group performed as well as the HVs in both spellers and HVs did better with the Face speller than Flash speller while the ALS group performed equally well in both spellers. Neither intra-run P300 habituation nor inter-run P300 habituation was found. The P300 speller could be a reliable communication device for individuals with ALS.

Critical Dynamics in Spontaneous Resting-State Oscillations Are Associated With the Attention-Related P300 ERP in a Go/Nogo Task

Sustained attention is the ability to continually concentrate on task-relevant information, even in the presence of distraction. Understanding the neural mechanisms underlying this ability is critical for comprehending attentional processes as well as neuropsychiatric disorders characterized by attentional deficits, such as attention deficit hyperactivity disorder (ADHD). In this study, we aimed to investigate how trait-like critical oscillations during rest relate to the P300 evoked potential-a biomarker commonly used to assess attentional deficits. We measured long-range temporal correlations (LRTC) in resting-state EEG oscillations as index for criticality of the signal. In addition, the attentional performance of the subjects was assessed as reaction time variability (RTV) in a continuous performance task following an oddball paradigm. P300 amplitude and latencies were obtained from EEG recordings during this task. We found that, after controlling for individual variability in task performance, LRTC were positively associated with P300 amplitudes but not latencies. In line with previous findings, good performance in the sustained attention task was related to higher P300 amplitudes and earlier peak latencies. Unexpectedly, we observed a positive relationship between LRTC in ongoing oscillations during rest and RTV, indicating that greater criticality in brain oscillations during rest relates to worse task performance. In summary, our results show that resting-state neuronal activity, which operates near a critical state, relates to the generation of higher P300 amplitudes. Brain dynamics close to criticality potentially foster a computationally advantageous state which promotes the ability to generate higher event-related potential (ERP) amplitudes.

Performance Improvement of Near-Infrared Spectroscopy-Based Brain-Computer Interfaces Using Transcranial Near-Infrared Photobiomodulation With the Same Device

Transcranial near-infrared photobiomodulation (tNIR-PBM) can modulate physiological characteristics of the human brain, such as the cerebral blood flow and oxidative metabolism. Here, we investigated whether the performance of near-infrared spectroscopy (NIRS)-based brain-computer interfaces (BCIs) can be improved by tNIR-PBM applied to the prefrontal cortex with the same NIRS device. A total of 14 healthy individuals participated in the NIRS-based BCI study where the aim was to distinguish the mental arithmetic task from the idle state (IS) task either after tNIR-PBM or after sham stimulation, with the two experiments being conducted at least two days apart. The tNIR-PBM was applied by simply turning on the NIRS recording equipment for 20 min. To evaluate the degree of performance improvement obtained after tNIR-PBM, the average BCI classification accuracy obtained under the tNIR-PBM condition was compared with that obtained under the sham stimulation condition. The classification accuracy of NIRS-based BCI was significantly improved upon conduction of tNIR-PBM (82.74%) as compared to that in the sham stimulation condition (76.07%, p < 0.005). Thus, our results suggest that simply turning on the NIRS recording equipment before the BCI experiment can improve the performance of the NIRS-based BCI system.

Physiological and Medico-Social Research Trends of the Wave P300 and More Late Components of Visual Event-Related Potentials

To extend the application of the late waves of the event-related potentials (ERPs) to multiple modalities, devices and software the underlying physiological mechanisms and responses of the brain for a particular sensory system and mental function must be carefully examined. The objective of this study was aimed to study the sensory processes of the “human-computer interaction” model when classifying visual images with an incomplete set of signs based on the analysis of early, middle, late and slow ERPs components. 26 healthy subjects (men) aged 20–26 years were investigated. ERPs in 19 monopolar sites according to the 10/20 system were recorded. Discriminant and factor analyzes (BMDP Statistical Software) were applied. The component N₄₅₀ is the most specialized indicator of the perception of unrecognizable (oddball) visual images. The amplitude of the ultra-late components N₇₅₀ and N₉₀₀ is also higher under conditions of presentation of the oddball image, regardless of the location of the registration points. In brain pathology along with the pronounced asymmetry of the wave distribution, reduction of the N₁₅₀ wave and lengthening of its peak latency, a line of regularities were noted. These include–a pronounced reduction in peak latency P₂₅₀ and N₃₅₀, an increased amplitude of N₃₅₀ in the frontal and central points of registration, a decrease in the amplitude of N₄₅₀ in the left frontal cortex and its increase in the occipital registration points, activation of the occipital cortex at a time interval of 400–500 ms, as well as fusion later waves. We called such phenomena of the development of cognitive ERP in brain pathology “the incongruence of ERP components”. The results of the research are discussed in the light of the paradigm of the P₃₀₀ wave application in brain-computer interface systems, as well as with the peculiarities in brain pathology.

A Review of Hyperscanning and Its Use in Virtual Environments

Hyperscanning is a technique which simultaneously records the neural activity of two or more people. This is done using one of several neuroimaging methods, such as electroencephalography (EEG), functional magnetic resonance imaging (fMRI), and functional near-infrared spectroscopy (fNIRS). The use of hyperscanning has seen a dramatic rise in recent years to monitor social interactions between two or more people. Similarly, there has been an increase in the use of virtual reality (VR) for collaboration, and an increase in the frequency of social interactions being carried out in virtual environments (VE). In light of this, it is important to understand how interactions function within VEs, and how they can be enhanced to improve their quality in a VE. In this paper, we present some of the work that has been undertaken in the field of social neuroscience, with a special emphasis on hyperscanning. We also cover the literature detailing the work that has been carried out in the human–computer interaction domain that addresses remote collaboration. Finally, we present a way forward where these two research domains can be combined to explore how monitoring the neural activity of a group of participants in VE could enhance collaboration among them.

New technologies and Amyotrophic Lateral Sclerosis - Which step forward rushed by the COVID-19 pandemic?

Amyotrophic Lateral Sclerosis (ALS) is a fast-progressive neurodegenerative disease leading to progressive physical immobility with usually normal or mild cognitive and/or behavioural involvement. Many patients are relatively young, instructed, sensitive to new technologies, and professionally active when developing the first symptoms. Older patients usually require more time, encouragement, reinforcement and a closer support but, nevertheless, selecting user-friendly devices, provided earlier in the course of the disease, and engaging motivated carers may overcome many technological barriers. ALS may be considered a model for neurodegenerative diseases to further develop and test new technologies. From multidisciplinary teleconsults to telemonitoring of the respiratory function, telemedicine has the potentiality to embrace other fields, including nutrition, physical mobility, and the interaction with the environment. Brain-computer interfaces and eye tracking expanded the field of augmentative and alternative communication in ALS but their potentialities go beyond communication, to cognition and robotics. Virtual reality and different forms of artificial intelligence present further interesting possibilities that deserve to be investigated. COVID-19 pandemic is an unprecedented opportunity to speed up the development and implementation of new technologies in clinical practice, improving the daily living of both ALS patients and carers. The present work reviews the current technologies for ALS patients already in place or being under evaluation with published publications, prompted by the COVID-19 pandemic.

P300-Based Brain-Computer Interface Speller: Usability Evaluation of Three Speller Sizes by Severely Motor-Disabled Patients

Brain-computer interface (BCI) spellers allow severe motor-disabled patients to communicate using their brain activity without muscular mobility. Different visual configurations of the widely studied P300-based BCI speller had been assessed with healthy and motor-disabled users. However, the speller size (in terms of cm) had only been assessed for healthy subjects. We think that the speller size might be limiting for some severely motor-disabled patients with restricted head and eye movements. The usability of three speller sizes was assessed for seven patients diagnosed with amyotrophic lateral sclerosis (ALS) and a participant diagnosed with Duchenne muscular dystrophy (DMD). This is the first usability evaluation of speller size with severely motor-disabled participants. Effectiveness (in the online results) and efficiency (in the workload test) of the medium speller was remarkably better. Satisfaction was significantly the highest with the medium size speller and the lowest with the small size. These results correlate with previously described findings in healthy subjects. In conclusion, the speller size should be considered when designing a speller paradigm, especially for motor-disabled individuals, since it might affect their performance and user experience while controlling a BCI speller.