Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG

Impact of Affective Multimedia Content on the Electroencephalogram and Facial Expressions

Most of the research in the field of affective computing has focused on detecting and classifying human emotions through electroencephalogram (EEG) or facial expressions. Designing multimedia content to evoke certain emotions has been largely motivated by manual rating provided by users. Here we present insights from the correlation of affective features between three modalities namely, affective multimedia content, EEG, and facial expressions. Interestingly, low-level Audio-visual features such as contrast and homogeneity of the video and tone of the audio in the movie clips are most correlated with changes in facial expressions and EEG. We also detect the regions associated with the human face and the brain (in addition to the EEG frequency bands) that are most representative of affective responses. The computational modeling between the three modalities showed a high correlation between features from these regions and user-reported affective labels. Finally, the correlation between different layers of convolutional neural networks with EEG and Face images as input provides insights into human affection. Together, these findings will assist in (1) designing more effective multimedia contents to engage or influence the viewers, (2) understanding the brain/body bio-markers of affection, and (3) developing newer brain-computer interfaces as well as facial-expression-based algorithms to read emotional responses of the viewers.

More Reliable EEG Electrode Digitizing Methods Can Reduce Source Estimation Uncertainty, but Current Methods Already Accurately Identify Brodmann Areas

Electroencephalography (EEG) and source estimation can be used to identify brain areas activated during a task, which could offer greater insight on cortical dynamics. Source estimation requires knowledge of the locations of the EEG electrodes. This could be provided with a template or obtained by digitizing the EEG electrode locations. Operator skill and inherent uncertainties of a digitizing system likely produce a range of digitization reliabilities, which could affect source estimation and the interpretation of the estimated source locations. Here, we compared the reliabilities of five digitizing methods (ultrasound, structured-light 3D scan, infrared 3D scan, motion capture probe, and motion capture) and determined the relationship between digitization reliability and source estimation uncertainty, assuming other contributors to source estimation uncertainty were constant. We digitized a mannequin head using each method five times and quantified the reliability and validity of each method. We created five hundred sets of electrode locations based on our reliability results and applied a dipole fitting algorithm (DIPFIT) to perform source estimation. The motion capture method, which recorded the locations of markers placed directly on the electrodes had the best reliability with an average electrode variability of 0.001 cm. Then, in order of decreasing reliability were the method using a digitizing probe in the motion capture system, an infrared 3D scanner, a structured-light 3D scanner, and an ultrasound digitization system. Unsurprisingly, uncertainty of the estimated source locations increased with greater variability of EEG electrode locations and less reliable digitizing systems. If EEG electrode location variability was ∽1 cm, a single source could shift by as much as 2 cm. To help translate these distances into practical terms, we quantified Brodmann area accuracy for each digitizing method and found that the average Brodmann area accuracy for all digitizing methods was >80%. Using a template of electrode locations reduced the Brodmann area accuracy to ∽50%. Overall, more reliable digitizing methods can reduce source estimation uncertainty, but the significance of the source estimation uncertainty depends on the desired spatial resolution. For accurate Brodmann area identification, any of the digitizing methods tested can be used confidently.

Evaluating Mental Load During Realistic Driving Simulations by Means of Round the Ear Electrodes

Film based round the ear electrodes (cEEGrids) provide both, the accessibility of unobtrusive mobile EEG as well as a rapid EEG application in stationary settings when extended measurements are not possible. In a large-scale evaluation of driving abilities of older adults (N > 350) in a realistic driving simulation, we evaluated to what extent mental demands can be measured using cEEGrids in a completely unrestricted environment. For a first frequency-based analysis, the driving scenario was subdivided into different street segments with respect to their task loads (low, medium, high) that was a priori rated by an expert. Theta activity increased with task load but no change in Alpha power was found. Effects gained clarity after removing pink noise effects, that were potentially high in this data set due to motion artifacts. Theta fraction increased with task load and Alpha fraction decreased. We mapped this effect to specific street segments by applying a track-frequency analysis. Whilst participants drove with constant speed and without high steering wheel activity, Alpha was high and theta low. The reverse was the case in sections that required either high activity or increased attentional allocation to the driving context. When calculating mental demands for different street segments based on EEG, this measure is highly significant correlated with the experts' rating of task load. Deviances can be explained by specific features within the segments. Thus, modulations in spectral power of the EEG were validly reflected in the cEEGrids data. All findings were in line with the prominent literature in the field. The results clearly demonstrate the usability of this low-density EEG method for application in real-world settings where an increase in ecological validity might outweigh the loss of certain aspects of internal validity.

Effects of Transpulmonary Administration of Caffeine on Brain Activity in Healthy Men

The present study aimed to examine the effect of transpulmonary administration of caffeine on working memory and related brain functions by electroencephalography measurement. The participants performed working memory tasks before and after vaporizer-assisted aspiration with inhalation of caffeinated- and non-caffeinated liquids in the caffeine and sham conditions, respectively. Transpulmonary administration of caffeine tended to increase the rate of correct answers. Moreover, our findings suggest that transpulmonary administration of caffeine increases the theta-band activity in the right prefrontal, central, and temporal areas during the task assigned post-aspiration. Our results may indicate an efficient and fast means of eliciting the stimulatory effects of transpulmonary administration of caffeine.

EEG Sensorimotor Correlates of Speed During Forearm Passive Movements

Although passive movement therapy has been widely adopted to recover lost motor functions of impaired body parts, the underlying neural mechanisms are still unclear. In this context, fully understanding how the proprioceptive input modulates the brain activity may provide valuable insights. Specifically, it has not been investigated how the speed of motions, passively guided by a haptic device, affects the sensorimotor rhythms (SMR). On the grounds that faster passive motions elicit larger quantity of afferent input, we hypothesize a proportional relationship between localized SMR features and passive movement speed. To address this hypothesis, we conducted an experiment where healthy subjects received passive forearm oscillations at different speed levels while their electroencephalogram was recorded. The mu and beta event related desynchronization (ERD) and beta rebound of both left and right sensorimotor areas are analyzed by linear mixed-effects models. Results indicate that passive movement speed is correlated with the contralateral beta rebound and ipsilateral mu ERD. The former has been previously linked with the processing of proprioceptive afferent input quantity, while the latter with speed-dependent inhibitory processes. This suggests the existence of functionally-distinct frequency-specific neuronal populations associated with passive movements. In future, our findings may guide the design of novel rehabilitation paradigms.

Brief mindfulness training enhances cognitive control in socioemotional contexts: Behavioral and neural evidence

In social contexts, the dynamic nature of others' emotions places unique demands on attention and emotion regulation. Mindfulness, characterized by heightened and receptive moment-to-moment attending, may be well-suited to meet these demands. In particular, mindfulness may support more effective cognitive control in social situations via efficient deployment of top-down attention. To test this, a randomized controlled study examined effects of mindfulness training (MT) on behavioral and neural (event-related potentials [ERPs]) responses during an emotional go/no-go task that tested cognitive control in the context of emotional facial expressions that tend to elicit approach or avoidance behavior. Participants (N = 66) were randomly assigned to four brief (20 min) MT sessions or to structurally equivalent book learning control sessions. Relative to the control group, MT led to improved discrimination of facial expressions, as indexed by d-prime, as well as more efficient cognitive control, as indexed by response time and accuracy, and particularly for those evidencing poorer discrimination and cognitive control at baseline. MT also produced better conflict monitoring of behavioral goal-prepotent response tendencies, as indexed by larger No-Go N200 ERP amplitudes, and particularly so for those with smaller No-Go amplitude at baseline. Overall, findings are consistent with MT's potential to enhance deployment of early top-down attention to better meet the unique cognitive and emotional demands of socioemotional contexts, particularly for those with greater opportunity for change. Findings also suggest that early top-down attention deployment could be a cognitive mechanism correspondent to the present-oriented attention commonly used to explain regulatory benefits of mindfulness more broadly.

Facial Recognition Task for the Classification of Mild Cognitive Impairment with Ensemble Sparse Classifier

Conventional methods for detecting mild cognitive impairment (MCI) require cognitive exams and follow-up neuroimaging, which can be time-consuming and expensive. A great need exists for objective and cost-effective biomarkers for the early detection of MCI. This study uses a sequential imaging oddball paradigm to determine if familiar, unfamiliar, or inverted faces are effective visual stimuli for the early detection of MCI. Unlike the traditional approach where the amplitude and latency of certain deflection points of event-related potentials (ERPs) are selected as electrophysiological biomarkers (or features) of MCI, we used the entire ERPs as potential biomarkers and relied on an advanced machine-learning technique, i.e. an ensemble of sparse classifier (ESC), to choose the set of features to best discriminate MCI from healthy controls. Five MCI subjects and eight age-matched controls were given the MoCA exam before EEG recordings in a sensory-deprived room. Traditional time-domain comparisons of averaged ERPs between the two groups did not yield any statistical significance. However, ESC was able to discriminate MCI from controls with 95% classification accuracy based on the averaged ERPs elicited by familiar faces. By adopting advanced machine-learning techniques such as ESC, it may be possible to accurately diagnose MCI based on the ERPs that are specifically elicited by familiar faces.

Neural Activations Associated With Friction Stimulation on Touch-Screen Devices

Tactile sensation largely influences human perception, for instance when using a mobile device or a touch screen. Active touch, which involves tactile and proprioceptive sensing under the control of movement, is the dominant tactile exploration mechanism compared to passive touch (being touched). This paper investigates the role of friction stimulation objectively and quantitatively in active touch tasks, in a real human-computer interaction on a touch-screen device. In this study, 24 participants completed an active touch task involved stroking the virtual strings of a guitar on a touch-screen device while recording the electroencephalography (EEG) signal. Statistically significant differences in beta and gamma oscillations in the middle frontal and parietal areas at the late period of the active touch task are found. Furthermore, stronger beta event-related desynchronization (ERD) and rebound in the presence of friction stimulation in the contralateral parietal area are observed. However, in the ipsilateral parietal area, there is a difference in beta oscillation only at the late period of the motor task. As for implicit emotion communication, a significant increase in emotional responses for valence, arousal, dominance, and satisfaction is observed when the friction stimulation is applied. It is argued that the friction stimulation felt by the participants' fingertip in a touch-screen device further induces cognitive processing compared to the case when no friction stimulation is applied. This study provides objective and quantitative evidence that friction stimulation is able to affect the bottom-up sensation and cognitive processing.

Group-level cortical and muscular connectivity during perturbations to walking and standing balance

Maintaining balance is a complex process requiring multisensory processing and coordinated muscle activation. Previous studies have indicated that the cortex is directly involved in balance control, but less information is known about cortical flow of signals for balance. We studied source-localized electrocortical effective connectivity dynamics of healthy young subjects (29 subjects: 14 male and 15 female) walking and standing with both visual and physical perturbations to their balance. The goal of this study was to quantify differences in group-level corticomuscular connectivity responses to sensorimotor perturbations during walking and standing. We hypothesized that perturbed visual input during balance would transiently decrease connectivity between occipital and parietal areas due to disruptive visual input during sensory processing. We also hypothesized that physical pull perturbations would increase cortical connections to central sensorimotor areas because of higher sensorimotor integration demands. Our findings show decreased occipito-parietal connectivity during visual rotations and widespread increases in connectivity during pull perturbations focused on central areas, as expected. We also found evidence for communication from cortex to muscles during perturbed balance. These results show that sensorimotor perturbations to balance alter cortical networks and can be quantified using effective connectivity estimation.

ICLabel: An automated electroencephalographic independent component classifier, dataset, and website

The electroencephalogram (EEG) provides a non-invasive, minimally restrictive, and relatively low-cost measure of mesoscale brain dynamics with high temporal resolution. Although signals recorded in parallel by multiple, near-adjacent EEG scalp electrode channels are highly-correlated and combine signals from many different sources, biological and non-biological, independent component analysis (ICA) has been shown to isolate the various source generator processes underlying those recordings. Independent components (IC) found by ICA decomposition can be manually inspected, selected, and interpreted, but doing so requires both time and practice as ICs have no order or intrinsic interpretations and therefore require further study of their properties. Alternatively, sufficiently-accurate automated IC classifiers can be used to classify ICs into broad source categories, speeding the analysis of EEG studies with many subjects and enabling the use of ICA decomposition in near-real-time applications. While many such classifiers have been proposed recently, this work presents the ICLabel project comprised of (1) the ICLabel dataset containing spatiotemporal measures for over 200,000 ICs from more than 6000 EEG recordings and matching component labels for over 6000 of those ICs, all using common average reference, (2) the ICLabel website for collecting crowdsourced IC labels and educating EEG researchers and practitioners about IC interpretation, and (3) the automated ICLabel classifier, freely available for MATLAB. The ICLabel classifier improves upon existing methods in two ways: by improving the accuracy of the computed label estimates and by enhancing its computational efficiency. The classifier outperforms or performs comparably to the previous best publicly available automated IC component classification method for all measured IC categories while computing those labels ten times faster than that classifier as shown by a systematic comparison against other publicly available EEG IC classifiers.

Assaying neural activity of children during video game play in public spaces: a deep learning approach

OBJECTIVE

Understanding neural activity patterns in the developing brain remains one of the grand challenges in neuroscience. Developing neural networks are likely to be endowed with functionally important variability associated with the environmental context, age, gender, and other variables. Therefore, we conducted experiments with typically developing children in a stimulating museum setting and tested the feasibility of using deep learning techniques to help identify patterns of brain activity associated with different conditions.

APPROACH

A four-channel dry EEG-based Mobile brain-body imaging data of children at rest and during videogame play (VGP) was acquired at the Children's Museum of Houston. A data-driven approach based on convolutional neural networks (CNN) was used to describe underlying feature representations in the EEG and their ability to discern task and gender. The variability of the spectral features of EEG during the rest condition as a function of age was also analyzed.

MAIN RESULTS

Alpha power (7-13 Hz) was higher during rest whereas theta power (4-7 Hz) was higher during VGP. Beta (13-18 Hz) power was the most significant feature, higher in females, when differentiating between males and females. Using data from both temporoparietal channels to classify between VGP and rest condition, leave-one-subject-out cross-validation accuracy of 67% was obtained. Age-related changes in EEG spectral content during rest were consistent with previous developmental studies conducted in laboratory settings showing an inverse relationship between age and EEG power.

SIGNIFICANCE

These findings are the first to acquire, quantify and explain brain patterns observed during VGP and rest in freely behaving children in a museum setting using a deep learning framework. The study shows how deep learning can be used as a data driven approach to identify patterns in the data and explores the issues and the potential of conducting experiments involving children in a natural and engaging environment.

Android Feedback-Based Training Modulates Sensorimotor Rhythms During Motor Imagery

EEG-based brain computer interface (BCI) systems have demonstrated potential to assist patients with devastating motor paralysis conditions. However, there is great interest in shifting the BCI trend toward applications aimed at healthy users. Although BCI operation depends on technological factors (i.e., EEG pattern classification algorithm) and human factors (i.e., how well the person can generate good quality EEG patterns), it is the latter that is least investigated. In order to control a motor imagery-based BCI, users need to learn to modulate their sensorimotor brain rhythms by practicing motor imagery using a classical training protocol with an abstract visual feedback. In this paper, we investigate a different BCI training protocol using a human-like android robot (Geminoid HI-2) to provide realistic visual feedback. The proposed training protocol addresses deficiencies of the classical approach and takes the advantage of body-abled user capabilities. Experimental results suggest that android feedback-based BCI training improves the modulation of sensorimotor rhythms during motor imagery task. Moreover, we discuss how the influence of body ownership transfer illusion toward the android might have an effect on the modulation of event-related desynchronization/synchronization activity.

Monitoring Pilot's Mental Workload Using ERPs and Spectral Power with a Six-Dry-Electrode EEG System in Real Flight Conditions

Recent technological progress has allowed the development of low-cost and highly portable brain sensors such as pre-amplified dry-electrodes to measure cognitive activity out of the laboratory. This technology opens promising perspectives to monitor the "brain at work" in complex real-life situations such as while operating aircraft. However, there is a need to benchmark these sensors in real operational conditions. We therefore designed a scenario in which twenty-two pilots equipped with a six-dry-electrode EEG system had to perform one low load and one high load traffic pattern along with a passive auditory oddball. In the low load condition, the participants were monitoring the flight handled by a flight instructor, whereas they were flying the aircraft in the high load condition. At the group level, statistical analyses disclosed higher P300 amplitude for the auditory target (Pz, P4 and Oz electrodes) along with higher alpha band power (Pz electrode), and higher theta band power (Oz electrode) in the low load condition as compared to the high load one. Single trial classification accuracy using both event-related potentials and event-related frequency features at the same time did not exceed chance level to discriminate the two load conditions. However, when considering only the frequency features computed over the continuous signal, classification accuracy reached around 70% on average. This study demonstrates the potential of dry-EEG to monitor cognition in a highly ecological and noisy environment, but also reveals that hardware improvement is still needed before it can be used for everyday flight operations.

Double-blind, randomized pilot clinical trial targeting alpha oscillations with transcranial alternating current stimulation (tACS) for the treatment of major depressive disorder (MDD)

Major depressive disorder (MDD) is one of the most common psychiatric disorders, but pharmacological treatments are ineffective in a substantial fraction of patients and are accompanied by unwanted side effects. Here we evaluated the feasibility and efficacy of transcranial alternating current stimulation (tACS) at 10 Hz, which we hypothesized would improve clinical symptoms by renormalizing alpha oscillations in the left dorsolateral prefrontal cortex (dlPFC). To this end, 32 participants with MDD were randomized to 1 of 3 arms and received daily 40 min sessions of either 10 Hz-tACS, 40 Hz-tACS, or active sham stimulation for 5 consecutive days. Symptom improvement was assessed using the Montgomery-Åsberg Depression Rating Scale (MADRS) as the primary outcome. High-density electroencephalograms (hdEEGs) were recorded to measure changes in alpha oscillations as the secondary outcome. For the primary outcome, we did not observe a significant interaction between treatment condition (10 Hz-tACS, 40 Hz-tACS, sham) and session (baseline to 4 weeks after completion of treatment); however, exploratory analyses show that 2 weeks after completion of the intervention, the 10 Hz-tACS group had more responders (MADRS and HDRS) compared with 40 Hz-tACS and sham groups (n = 30, p = 0.026). Concurrently, we found a significant reduction in alpha power over the left frontal regions in EEG after completion of the intervention for the group that received per-protocol 10 Hz-tACS (n = 26, p < 0.05). Our data suggest that targeting oscillations with tACS has potential as a therapeutic intervention for treatment of MDD.

Identifying and Engaging Neuronal Oscillations by Transcranial Alternating Current Stimulation in Patients With Chronic Low Back Pain: A Randomized, Crossover, Double-Blind, Sham-Controlled Pilot Study

Chronic pain is associated with maladaptive reorganization of the central nervous system. Recent studies have suggested that disorganization of large-scale electrical brain activity patterns, such as neuronal network oscillations in the thalamocortical system, plays a key role in the pathophysiology of chronic pain. Yet, little is known about whether and how such network pathologies can be targeted with noninvasive brain stimulation as a nonpharmacological treatment option. We hypothesized that alpha oscillations, a prominent thalamocortical activity pattern in the human brain, are impaired in chronic pain and can be modulated with transcranial alternating current stimulation (tACS). We performed a randomized, crossover, double-blind, sham-controlled study in patients with chronic low back pain (CLBP) to investigate how alpha oscillations relate to pain symptoms for target identification and whether tACS can engage this target and thereby induce pain relief. We used high-density electroencephalography to measure alpha oscillations and found that the oscillation strength in the somatosensory region at baseline before stimulation was negatively correlated with pain symptoms. Stimulation with alpha-tACS compared to sham (placebo) stimulation significantly enhanced alpha oscillations in the somatosensory region. The stimulation-induced increase of alpha oscillations in the somatosensory region was correlated with pain relief. Given these findings of successful target identification and engagement, we propose that modulating alpha oscillations with tACS may represent a target-specific, nonpharmacological treatment approach for CLBP. This trial has been registered in ClinicalTrials.gov (NCT03243084). PERSPECTIVE: This study suggests that a rational design of transcranial alternating current stimulation, which is target identification, engagement, and validation, could be a nonpharmacological treatment approach for patients with CLBP.

Stronger responses in the visual cortex of sighted compared to blind individuals during auditory space representation

It has been previously shown that the interaction between vision and audition involves early sensory cortices. However, the functional role of these interactions and their modulation due to sensory impairment is not yet understood. To shed light on the impact of vision on auditory spatial processing, we recorded ERPs and collected psychophysical responses during space and time bisection tasks in sighted and blind participants. They listened to three consecutive sounds and judged whether the second sound was either spatially or temporally further from the first or the third sound. We demonstrate that spatial metric representation of sounds elicits an early response of the visual cortex (P70) which is different between sighted and visually deprived individuals. Indeed, only in sighted and not in blind people P70 is strongly selective for the spatial position of sounds, mimicking many aspects of the visual-evoked C1. These results suggest that early auditory processing associated with the construction of spatial maps is mediated by visual experience. The lack of vision might impair the projection of multi-sensory maps on the retinotopic maps used by the visual cortex.

Modulating neural oscillations by transcranial static magnetic field stimulation of the dorsolateral prefrontal cortex: A crossover, double-blind, sham-controlled pilot study

Transcranial static magnetic field stimulation (tSMS) is a novel non-invasive brain stimulation technique that has been shown to locally increase alpha power in the parietal and occipital cortex. We investigated if tSMS locally increased alpha power in the left or right prefrontal cortex, as the balance of left/right prefrontal alpha power (frontal alpha asymmetry) has been linked to emotional processing and mood disorders. Therefore, altering frontal alpha asymmetry with tSMS may serve as a novel treatment to psychiatric diseases. We performed a crossover, double-blind, sham-controlled pilot study to assess the effects of prefrontal tSMS on neural oscillations. Twenty-four right-handed healthy participants were recruited and received left dorsolateral prefrontal cortex (DLPFC) tSMS, right DLPFC tSMS, and sham tSMS in a randomized order. Electroencephalography data were collected before (2 min eyes-closed, 2 min eyes-open), during (10 min eyes-open), and after (2 min eyes-open) stimulation. In contrast with our hypothesis, neither left nor right tSMS locally increased frontal alpha power. However, alpha power increased in occipital cortex during left DLPFC tSMS. Right DLPFC tSMS increased post-stimulation fronto-parietal theta power, indicating possible relevance to memory and cognition. Left and right DLPFC tSMS increased post-stimulation left hemisphere beta power, indicating possible changes to motor behavior. Left DLPFC tSMS also increased post-stimulation right frontal beta power, demonstrating complex network effects that may be relevant to aggressive behavior. We concluded that DLPFC tSMS modulated the network oscillations in regions distant from the location of stimulation and that tSMS has region specific effects on neural oscillations.

Targeting reduced neural oscillations in patients with schizophrenia by transcranial alternating current stimulation

Transcranial alternating current stimulation (tACS) modulates endogenous neural oscillations in healthy human participants by the application of a low-amplitude electrical current with a periodic stimulation waveform. Yet, it is unclear if tACS can modulate and restore neural oscillations that are reduced in patients with psychiatric illnesses such as schizophrenia. Here, we asked if tACS modulates network oscillations in schizophrenia. We performed a randomized, double-blind, sham-controlled clinical trial to contrast tACS with transcranial direct current stimulation (tDCS) and sham stimulation in 22 schizophrenia patients with auditory hallucinations. We used high-density electroencephalography to investigate if a five-day, twice-daily 10Hz-tACS protocol enhances alpha oscillations and modulates network dynamics that are reduced in schizophrenia. We found that 10Hz-tACS enhanced alpha oscillations and modulated functional connectivity in the alpha frequency band. In addition, 10Hz-tACS enhanced the 40Hz auditory steady-state response (ASSR), which is reduced in patients with schizophrenia. Importantly, clinical improvement of auditory hallucinations correlated with enhancement of alpha oscillations and the 40Hz-ASSR. Together, our findings suggest that tACS has potential as a network-level approach to modulate reduced neural oscillations related to clinical symptoms in patients with schizophrenia.

EEG Microstates Change in Response to Increase in Dopaminergic Stimulation in Typical Parkinson's Disease Patients

Objectives: Characterizing pharmacological response in Parkinson's Disease (PD) patients may be a challenge in early stages but gives valuable clues for diagnosis. Neurotropic drugs may modulate Electroencephalography (EEG) microstates (MS). We investigated EEG-MS default-mode network changes in response to dopaminergic stimulation in PD. Methods: Fourteen PD subjects in HY stage III or less were included, and twenty-one healthy controls. All patients were receiving dopaminergic stimulation with levodopa or dopaminergic agonists. Resting EEG activity was recorded before the first daily PD medication dose and 1 h after drug intake resting EEG activity was again recorded. Time and frequency variables for each MS were calculated. Results: Parkinson's disease subjects MS A duration decreases after levodopa intake, MS B appears more often than before levodopa intake. MS E was not present, but MS G was. There were no significant differences between control subjects and patients after medication intake. Conclusion: Clinical response to dopaminergic drugs in PD is characterized by clear changes in MS profile. Significance: This work demonstrates that there are clear EEG MS markers of PD dopaminergic stimulation state. The characterization of the disease and its response to dopaminergic medication may be of help for early therapeutic diagnosis.

Effects of an Integrated Neurofeedback System with Dry Electrodes: EEG Acquisition and Cognition Assessment

Electroencephalogram (EEG) neurofeedback improves cognitive capacity and behaviors by regulating brain activity, which can lead to cognitive enhancement in healthy people and better rehabilitation in patients. The increased use of EEG neurofeedback highlights the urgent need to reduce the discomfort and preparation time and increase the stability and simplicity of the system’s operation. Based on brain-computer interface technology and a multithreading design, we describe a neurofeedback system with an integrated design that incorporates wearable, multichannel, dry electrode EEG acquisition equipment and cognitive function assessment. Then, we evaluated the effectiveness of the system in a single-blind control experiment in healthy people, who increased the alpha frequency band power in a neurofeedback protocol. We found that upregulation of the alpha power density improved working memory following short-term training (only five training sessions in a week), while the attention network regulation may be related to other frequency band activities, such as theta and beta. Our integrated system will be an effective neurofeedback training and cognitive function assessment system for personal and clinical use.

Transient visual perturbations boost short-term balance learning in virtual reality by modulating electrocortical activity

Immersive virtual reality can expose humans to novel training and sensory environments, but motor training with virtual reality has not been able to improve motor performance as much as motor training in real-world conditions. An advantage of immersive virtual reality that has not been fully leveraged is that it can introduce transient visual perturbations on top of the visual environment being displayed. The goal of this study was to determine whether transient visual perturbations introduced in immersive virtual reality modify electrocortical activity and behavioral outcomes in human subjects practicing a novel balancing task during walking. We studied three groups of healthy young adults (5 male and 5 female for each) while they learned a balance beam walking task for 30 min under different conditions. Two groups trained while wearing a virtual reality headset, and one of those groups also had half-second visual rotation perturbations lasting ~10% of the training time. The third group trained without virtual reality. We recorded high-density electroencephalography (EEG) and movement kinematics. We hypothesized that virtual reality training with perturbations would increase electrocortical activity and improve balance performance compared with virtual reality training without perturbations. Our results confirmed the hypothesis. Brief visual perturbations induced increased theta spectral power and decreased alpha spectral power in parietal and occipital regions and improved balance performance in posttesting. Our findings indicate that transient visual perturbations during immersive virtual reality training can boost short-term motor learning by inducing a cognitive change, minimizing the negative effects of virtual reality on motor training. NEW & NOTEWORTHY We found that transient visual perturbations in virtual reality during balance training can boost short-term motor learning by inducing a cognitive change, overcoming the negative effects of immersive virtual reality. As a result, subjects training in immersive virtual reality with visual perturbations have equivalent performance improvement as training in real-world conditions. Visual perturbations elicited cortical responses in occipital and parietal regions and may have improved the brain's ability to adapt to variations in sensory input.

Infant-directed speech facilitates seven-month-old infants' cortical tracking of speech

This study assessed cortical tracking of temporal information in incoming natural speech in seven-month-old infants. Cortical tracking refers to the process by which neural activity follows the dynamic patterns of the speech input. In adults, it has been shown to involve attentional mechanisms and to facilitate effective speech encoding. However, in infants, cortical tracking or its effects on speech processing have not been investigated. This study measured cortical tracking of speech in infants and, given the involvement of attentional mechanisms in this process, cortical tracking of both infant-directed speech (IDS), which is highly attractive to infants, and the less captivating adult-directed speech (ADS), were compared. IDS is the speech register parents use when addressing young infants. In comparison to ADS, it is characterised by several acoustic qualities that capture infants' attention to linguistic input and assist language learning. Seven-month-old infants' cortical responses were recorded via electroencephalography as they listened to IDS or ADS recordings. Results showed stronger low-frequency cortical tracking of the speech envelope in IDS than in ADS. This suggests that IDS has a privileged status in facilitating successful cortical tracking of incoming speech which may, in turn, augment infants' early speech processing and even later language development.

Electrophysiological correlates of the interplay between low-level visual features and emotional content during word reading

Processing affectively charged visual stimuli typically results in increased amplitude of specific event-related potential (ERP) components. Low-level features similarly modulate electrophysiological responses, with amplitude changes proportional to variations in stimulus size and contrast. However, it remains unclear whether emotion-related amplifications during visual word processing are necessarily intertwined with changes in specific low-level features or, instead, may act independently. In this pre-registered electrophysiological study, we varied font size and contrast of neutral and negative words while participants were monitoring their semantic content. We examined ERP responses associated with early sensory and attentional processes as well as later stages of stimulus processing. Results showed amplitude modulations by low-level visual features early on following stimulus onset - i.e., P1 and N1 components -, while the LPP was independently modulated by these visual features. Independent effects of size and emotion were observed only at the level of the EPN. Here, larger EPN amplitudes for negative were observed only for small high contrast and large low contrast words. These results suggest that early increase in sensory processing at the EPN level for negative words is not automatic, but bound to specific combinations of low-level features, occurring presumably via attentional control processes.

Differentiation in Theta and Beta Electrocortical Activity between Visual and Physical Perturbations to Walking and Standing Balance

Human balance is a complex process in healthy adults, requiring precisely timed coordination among sensory information, cognitive processing, and motor control. It has been difficult to quantify brain dynamics during human balance control due to limitations in brain-imaging modalities. The goal of this study was to determine whether by using high-density electroencephalography (EEG) and independent component analysis, we can identify common cortical responses to visual and physical balance perturbations during walking and standing. We studied the responses of 30 healthy young adults to sensorimotor perturbations that challenged their balance. Subjects performed four 10 min trials of beam walking and tandem stance while either being mediolaterally pulled at the waist or viewing brief 20° field-of-view rotations in virtual reality. We recorded high-density EEG, motion capture, lower leg electromyography (EMG), and neck EMG. We hypothesized that both physical pull and visual rotation perturbations would elicit time-frequency fluctuations in theta (4-8 Hz) and beta (13-30 Hz) bands, with increased occipito-parietal activity during visual rotations compared with pull perturbations. Our results confirmed this hypothesis. For both perturbations, we found early theta synchronization and late alpha-beta (8-30 Hz) desynchronization following perturbation onset. This pattern was strongest in occipito-parietal areas during visual perturbations and strongest in sensorimotor areas during pull perturbations. These results suggest a similar time-frequency electrocortical pattern when humans respond to sensorimotor conflict, but with substantive differences in the brain areas involved for visual versus physical perturbations. Our findings may have important implications for assessing and training balance in individuals with and without motor disabilities.

Full body mobile brain-body imaging data during unconstrained locomotion on stairs, ramps, and level ground

Human locomotion is a complex process that requires the integration of central and peripheral nervous signalling. Understanding the brain's involvement in locomotion is challenging and is traditionally investigated during locomotor imagination or observation. However, stationary imaging methods lack the ability to infer information about the peripheral and central signalling during actual task execution. In this report, we present a dataset containing simultaneously recorded electroencephalography (EEG), lower-limb electromyography (EMG), and full body motion capture recorded from ten able-bodied individuals. The subjects completed an average of twenty trials on an experimental gait course containing level-ground, ramps, and stairs. We recorded 60-channel EEG from the scalp and 4-channel EOG from the face and temples. Surface EMG was recorded from six muscle sites bilaterally on the thigh and shank. The motion capture system consisted of seventeen wireless IMUs, allowing for unconstrained ambulation in the experimental space. In this report, we present the rationale for collecting these data, a detailed explanation of the experimental setup, and a brief validation of the data quality.

Review of EEG-based pattern classification frameworks for dyslexia

Dyslexia is a disability that causes difficulties in reading and writing despite average intelligence. This hidden disability often goes undetected since dyslexics are normal and healthy in every other way. Electroencephalography (EEG) is one of the upcoming methods being researched for identifying unique brain activation patterns in dyslexics. The aims of this paper are to examine pros and cons of existing EEG-based pattern classification frameworks for dyslexia and recommend optimisations through the findings to assist future research. A critical analysis of the literature is conducted focusing on each framework’s (1) data collection, (2) pre-processing, (3) analysis and (4) classification methods. A wide range of inputs as well as classification approaches has been experimented for the improvement in EEG-based pattern classification frameworks. It was uncovered that incorporating reading- and writing-related tasks to experiments used in data collection may help improve these frameworks instead of using only simple tasks, and those unwanted artefacts caused by body movements in the EEG signals during reading and writing activities could be minimised using artefact subspace reconstruction. Further, support vector machine is identified as a promising classifier to be used in EEG-based pattern classification frameworks for dyslexia.

Effects of speed and direction of perturbation on electroencephalographic and balance responses

The modulation of perturbation-evoked potential (PEP) N1 as a function of different biomechanical characteristics of perturbation has been investigated before. However, it remains unknown whether the PEP N1 modulation contributes to the shaping of the functional postural response. To improve this understanding, we examined the modulation of functional postural response in relation to the PEP N1 response in ten healthy young subjects during unpredictable perturbations to their upright stance-translations of the support surface in a forward or backward direction at two different amplitudes of constant speed. Using independent components from the fronto-central region, obtained from subject-specific head models created from the MRI, our results show that the latency of onset of the functional postural response after the PEP N1 response was faster for forward than backward perturbations at a constant speed but was not affected by the speed of perturbation. Further, our results reinforce some of the previous findings that suggested that the N1 peak amplitude and peak latency are both modulated by the speed of perturbation but not by the direction of the perturbation. Our results improve the understanding of the relation between characteristics of perturbation and the neurophysiology of reactive balance control and may have implications for the design of brain-machine interfaces for populations with a higher risk of falls.

The Harvard Automated Processing Pipeline for Electroencephalography (HAPPE): Standardized Processing Software for Developmental and High-Artifact Data

Electroenchephalography (EEG) recordings collected with developmental populations present particular challenges from a data processing perspective. These EEGs have a high degree of artifact contamination and often short recording lengths. As both sample sizes and EEG channel densities increase, traditional processing approaches like manual data rejection are becoming unsustainable. Moreover, such subjective approaches preclude standardized metrics of data quality, despite the heightened importance of such measures for EEGs with high rates of initial artifact contamination. There is presently a paucity of automated resources for processing these EEG data and no consistent reporting of data quality measures. To address these challenges, we propose the Harvard Automated Processing Pipeline for EEG (HAPPE) as a standardized, automated pipeline compatible with EEG recordings of variable lengths and artifact contamination levels, including high-artifact and short EEG recordings from young children or those with neurodevelopmental disorders. HAPPE processes event-related and resting-state EEG data from raw files through a series of filtering, artifact rejection, and re-referencing steps to processed EEG suitable for time-frequency-domain analyses. HAPPE also includes a post-processing report of data quality metrics to facilitate the evaluation and reporting of data quality in a standardized manner. Here, we describe each processing step in HAPPE, perform an example analysis with EEG files we have made freely available, and show that HAPPE outperforms seven alternative, widely-used processing approaches. HAPPE removes more artifact than all alternative approaches while simultaneously preserving greater or equivalent amounts of EEG signal in almost all instances. We also provide distributions of HAPPE's data quality metrics in an 867 file dataset as a reference distribution and in support of HAPPE's performance across EEG data with variable artifact contamination and recording lengths. HAPPE software is freely available under the terms of the GNU General Public License at https://github.com/lcnhappe/happe.

Brain-computer interface control in a virtual reality environment and applications for the internet of things

Brain-computer interfaces (BCIs) have enabled individuals to control devices such as spellers, robotic arms, drones, and wheelchairs, but often these BCI applications are restricted to research laboratories. With the advent of virtual reality (VR) systems and the internet of things (IoT) we can couple these technologies to offer real-time control of a user's virtual and physical environment. Likewise, BCI applications are often single-use with user's having no control outside of the restrictions placed upon the applications at the time of creation. Therefore, there is a need to create a tool that allows users the flexibility to create and modularize aspects of BCI applications for control of IoT devices and VR environments. Using a popular video game engine, Unity, and coupling it with BCI2000, we can create diverse applications that give the end-user additional autonomy during the task at hand. We demonstrate the validity of controlling a Unity-based VR environment and several commercial IoT devices via direct neural interfacing processed through BCI2000.

Disruption in neural phase synchrony is related to identification of inattentional deafness in real-world setting

Individuals often have reduced ability to hear alarms in real world situations (e.g., anesthesia monitoring, flying airplanes) when attention is focused on another task, sometimes with devastating consequences. This phenomenon is called inattentional deafness and usually occurs under critical high workload conditions. It is difficult to simulate the critical nature of these tasks in the laboratory. In this study, dry electroencephalography is used to investigate inattentional deafness in real flight while piloting an airplane. The pilots participating in the experiment responded to audio alarms while experiencing critical high workload situations. It was found that missed relative to detected alarms were marked by reduced stimulus evoked phase synchrony in theta and alpha frequencies (6-14 Hz) from 120 to 230 ms poststimulus onset. Correlation of alarm detection performance with intertrial coherence measures of neural phase synchrony showed different frequency and time ranges for detected and missed alarms. These results are consistent with selective attentional processes actively disrupting oscillatory coherence in sensory networks not involved with the primary task (piloting in this case) under critical high load conditions. This hypothesis is corroborated by analyses of flight parameters showing greater maneuvering associated with difficult phases of flight occurring during missed alarms. Our results suggest modulation of neural oscillation is a general mechanism of attention utilizing enhancement of phase synchrony to sharpen alarm perception during successful divided attention, and disruption of phase synchrony in brain networks when attentional demands of the primary task are great, such as in the case of inattentional deafness.

Signal Quality Evaluation of Emerging EEG Devices

Electroencephalogram (EEG) registration as a direct measure of brain activity has unique potentials. It is one of the most reliable and predicative indicators when studying human cognition, evaluating a subject's health condition, or monitoring their mental state. Unfortunately, standard signal acquisition procedures limit the usability of EEG devices and narrow their application outside the lab. Emerging sensor technology allows gel-free EEG registration and wireless signal transmission. Thus, it enables quick and easy application of EEG devices by users themselves. Although a main requirement for the interpretation of an EEG is good signal quality, there is a lack of research on this topic in relation to new devices. In our work, we compared the signal quality of six very different EEG devices. On six consecutive days, 24 subjects wore each device for 60 min and completed tasks and games on the computer. The registered signals were evaluated in the time and frequency domains. In the time domain, we examined the percentage of artifact-contaminated EEG segments and the signal-to-noise ratios. In the frequency domain, we focused on the band power variation in relation to task demands. The results indicated that the signal quality of a mobile, gel-based EEG system could not be surpassed by that of a gel-free system. However, some of the mobile dry-electrode devices offered signals that were almost comparable and were very promising. This study provided a differentiated view of the signal quality of emerging mobile and gel-free EEG recording technology and allowed an assessment of the functionality of the new devices. Hence, it provided a crucial prerequisite for their general application, while simultaneously supporting their further development.

Real-Time EEG Signal Enhancement Using Canonical Correlation Analysis and Gaussian Mixture Clustering

Electroencephalogram (EEG) signals are usually contaminated with various artifacts, such as signal associated with muscle activity, eye movement, and body motion, which have a noncerebral origin. The amplitude of such artifacts is larger than that of the electrical activity of the brain, so they mask the cortical signals of interest, resulting in biased analysis and interpretation. Several blind source separation methods have been developed to remove artifacts from the EEG recordings. However, the iterative process for measuring separation within multichannel recordings is computationally intractable. Moreover, manually excluding the artifact components requires a time-consuming offline process. This work proposes a real-time artifact removal algorithm that is based on canonical correlation analysis (CCA), feature extraction, and the Gaussian mixture model (GMM) to improve the quality of EEG signals. The CCA was used to decompose EEG signals into components followed by feature extraction to extract representative features and GMM to cluster these features into groups to recognize and remove artifacts. The feasibility of the proposed algorithm was demonstrated by effectively removing artifacts caused by blinks, head/body movement, and chewing from EEG recordings while preserving the temporal and spectral characteristics of the signals that are important to cognitive research.

High-density EEG characterization of brain responses to auditory rhythmic stimuli during wakefulness and NREM sleep

Auditory rhythmic sensory stimulation modulates brain oscillations by increasing phase-locking to the temporal structure of the stimuli and by increasing the power of specific frequency bands, resulting in Auditory Steady State Responses (ASSR). The ASSR is altered in different diseases of the central nervous system such as schizophrenia. However, in order to use the ASSR as biological markers for disease states, it needs to be understood how different vigilance states and underlying brain activity affect the ASSR. Here, we compared the effects of auditory rhythmic stimuli on EEG brain activity during wake and NREM sleep, investigated the influence of the presence of dominant sleep rhythms on the ASSR, and delineated the topographical distribution of these modulations. Participants (14 healthy males, 20-33 years) completed on the same day a 60 min nap session and two 30 min wakefulness sessions (before and after the nap). During these sessions, amplitude modulated (AM) white noise auditory stimuli at different frequencies were applied. High-density EEG was continuously recorded and time-frequency analyses were performed to assess ASSR during wakefulness and NREM periods. Our analysis revealed that depending on the electrode location, stimulation frequency applied and window/frequencies analysed the ASSR was significantly modulated by sleep pressure (before and after sleep), vigilance state (wake vs. NREM sleep), and the presence of slow wave activity and sleep spindles. Furthermore, AM stimuli increased spindle activity during NREM sleep but not during wakefulness. Thus, (1) electrode location, sleep history, vigilance state and ongoing brain activity needs to be carefully considered when investigating ASSR and (2) auditory rhythmic stimuli during sleep might represent a powerful tool to boost sleep spindles.

Adaptive Spatial Filter Based on Similarity Indices to Preserve the Neural Information on EEG Signals during On-Line Processing

This work presents a new on-line adaptive filter, which is based on a similarity analysis between standard electrode locations, in order to reduce artifacts and common interferences throughout electroencephalography (EEG) signals, but preserving the useful information. Standard deviation and Concordance Correlation Coefficient (CCC) between target electrodes and its correspondent neighbor electrodes are analyzed on sliding windows to select those neighbors that are highly correlated. Afterwards, a model based on CCC is applied to provide higher values of weight to those correlated electrodes with lower similarity to the target electrode. The approach was applied to brain computer-interfaces (BCIs) based on Canonical Correlation Analysis (CCA) to recognize 40 targets of steady-state visual evoked potential (SSVEP), providing an accuracy (ACC) of 86.44 ± 2.81%. In addition, also using this approach, features of low frequency were selected in the pre-processing stage of another BCI to recognize gait planning. In this case, the recognition was significantly (p<0.01) improved for most of the subjects (ACC≥74.79%), when compared with other BCIs based on Common Spatial Pattern, Filter Bank-Common Spatial Pattern, and Riemannian Geometry.

Deployment of Mobile EEG Technology in an Art Museum Setting: Evaluation of Signal Quality and Usability

Electroencephalography (EEG) has emerged as a powerful tool for quantitatively studying the brain that enables natural and mobile experiments. Recent advances in EEG have allowed for the use of dry electrodes that do not require a conductive medium between the recording electrode and the scalp. The overall goal of this research was to gain an understanding of the overall usability and signal quality of dry EEG headsets compared to traditional gel-based systems in an unconstrained environment. EEG was used to collect Mobile Brain-body Imaging (MoBI) data from 432 people as they experienced an art exhibit in a public museum. The subjects were instrumented with either one of four dry electrode EEG systems or a conventional gel electrode EEG system. Each of the systems was evaluated based on the signal quality and usability in a real-world setting. First, we describe the various artifacts that were characteristic of each of the systems. Second, we report on each system's usability and their limitations in a mobile setting. Third, to evaluate signal quality for task discrimination and characterization, we employed a data driven clustering approach on the data from 134 of the 432 subjects (those with reliable location tracking information and usable EEG data) to evaluate the power spectral density (PSD) content of the EEG recordings. The experiment consisted of a baseline condition in which the subjects sat quietly facing a white wall for 1 min. Subsequently, the participants were encouraged to explore the exhibit for as long as they wished (piece-viewing). No constraints were placed upon the individual in relation to action, time, or navigation of the exhibit. In this freely-behaving approach, the EEG systems varied in their capacity to record characteristic modulations in the EEG data, with the gel-based system more clearly capturing stereotypical alpha and beta-band modulations.

Quantifying and Characterizing Tonic Thermal Pain Across Subjects From EEG Data Using Random Forest Models

OBJECTIVE

Effective pain assessment and management strategies are needed to better manage pain. In addition to self-report, an objective pain assessment system can provide a more complete picture of the neurophysiological basis for pain. In this study, a robust and accurate machine learning approach is developed to quantify tonic thermal pain across healthy subjects into a maximum of ten distinct classes.

METHODS

A random forest model was trained to predict pain scores using time-frequency wavelet representations of independent components obtained from electroencephalography (EEG) data, and the relative importance of each frequency band to pain quantification is assessed.

RESULTS

The mean classification accuracy for predicting pain on an independent test subject for a range of 1-10 is 89.45%, highest among existing state of the art quantification algorithms for EEG. The gamma band is the most important to both intersubject and intrasubject classification accuracy.

CONCLUSION

The robustness and generalizability of the classifier are demonstrated.

SIGNIFICANCE

Our results demonstrate the potential of this tool to be used clinically to help us to improve chronic pain treatment and establish spectral biomarkers for future pain-related studies using EEG.

Mirror-normal difference in the late phase of mental rotation: An ERP study

Mirror-normal letter discriminations are thought to require mental rotation in order to transform the rotated alphanumeric character into its canonical orientation. Moreover, out-of-plane rotation is likely to occur after in-plane rotation to fully normalize the mirror version before the final mirror-normal judgment. The so-called rotation-related negativity, which varies with orientation, is found in both ERPonset (averaged with respect to stimulus onset) and ERPRT (averaged with respect to response time), representing the involvement of mental rotation in both time windows. Additionally, the mean amplitude of ERPRT correlates with individual performance. We performed a comprehensive analysis of the mirror-normal differences in the early and late phases of mental rotation and deduced that out-of-plane rotation is more likely to occur in the late phase and interacts with both in-plane rotation and the decision-making process, as indicated by both behavioral and electrophysiological findings.

Spatial localization of sound elicits early responses from occipital visual cortex in humans

Much evidence points to an interaction between vision and audition at early cortical sites. However, the functional role of these interactions is not yet understood. Here we show an early response of the occipital cortex to sound that it is strongly linked to the spatial localization task performed by the observer. The early occipital response to a sound, usually absent, increased by more than 10-fold when presented during a space localization task, but not during a time localization task. The response amplification was not only specific to the task, but surprisingly also to the position of the stimulus in the two hemifields. We suggest that early occipital processing of sound is linked to the construction of an audio spatial map that may utilize the visual map of the occipital cortex.

Real-time EEG-based brain-computer interface to a virtual avatar enhances cortical involvement in human treadmill walking

Recent advances in non-invasive brain-computer interface (BCI) technologies have shown the feasibility of neural decoding for both users' gait intent and continuous kinematics. However, the dynamics of cortical involvement in human upright walking with a closed-loop BCI has not been investigated. This study aims to investigate the changes of cortical involvement in human treadmill walking with and without BCI control of a walking avatar. Source localization revealed significant differences in cortical network activity between walking with and without closed-loop BCI control. Our results showed sustained α/µ suppression in the Posterior Parietal Cortex and Inferior Parietal Lobe, indicating increases of cortical involvement during walking with BCI control. We also observed significant increased activity of the Anterior Cingulate Cortex (ACC) in the low frequency band suggesting the presence of a cortical network involved in error monitoring and motor learning. Additionally, the presence of low γ modulations in the ACC and Superior Temporal Gyrus may associate with increases of voluntary control of human gait. This work is a further step toward the development of a novel training paradigm for improving the efficacy of rehabilitation in a top-down approach.

Detecting voluntary gait intention of chronic stroke patients towards top-down gait rehabilitation using EEG

One of the recent trends in gait rehabilitation is to incorporate bio-signals, such as electromyography (EMG) or electroencephalography (EEG), for facilitating neuroplasticity, i.e. top-down approach. In this study, we investigated decoding stroke patients' gait intention through a wireless EEG system. To overcome patient-specific EEG patterns due to impaired cerebral cortices, common spatial patterns (CSP) was employed. We demonstrated that CSP filter can be used to maximize the EEG signal variance-ratio of gait and standing conditions. Finally, linear discriminant analysis (LDA) classification was conducted, whereby the average accuracy of 73.2% and the average delay of 0.13 s were achieved for 3 chronic stroke patients. Additionally, we also found out that the inverse CSP matrix topography of stroke patients' EEG showed good agreement with the patients' paretic side.

Detecting Glaucoma With a Portable Brain-Computer Interface for Objective Assessment of Visual Function Loss

Importance

The current assessment of visual field loss in diseases such as glaucoma is affected by the subjectivity of patient responses and the lack of portability of standard perimeters.

Objective

To describe the development and initial validation of a portable brain-computer interface (BCI) for objectively assessing visual function loss.

Design, Setting, and Participants

This case-control study involved 62 eyes of 33 patients with glaucoma and 30 eyes of 17 healthy participants. Glaucoma was diagnosed based on a masked grading of optic disc stereophotographs. All participants underwent testing with a BCI device and standard automated perimetry (SAP) within 3 months. The BCI device integrates wearable, wireless, dry electroencephalogram and electrooculogram systems and a cellphone-based head-mounted display to enable the detection of multifocal steady state visual-evoked potentials associated with visual field stimulation. The performances of global and sectoral multifocal steady state visual-evoked potentials metrics to discriminate glaucomatous from healthy eyes were compared with global and sectoral SAP parameters. The repeatability of the BCI device measurements was assessed by collecting results of repeated testing in 20 eyes of 10 participants with glaucoma for 3 sessions of measurements separated by weekly intervals.

Main Outcomes and Measures

Receiver operating characteristic curves summarizing diagnostic accuracy. Intraclass correlation coefficients and coefficients of variation for assessing repeatability.

Results

Among the 33 participants with glaucoma, 19 (58%) were white, 12 (36%) were black, and 2 (6%) were Asian, while among the 17 participants with healthy eyes, 9 (53%) were white, 8 (47%) were black, and none were Asian. The receiver operating characteristic curve area for the global BCI multifocal steady state visual-evoked potentials parameter was 0.92 (95% CI, 0.86-0.96), which was larger than for SAP mean deviation (area under the curve, 0.81; 95% CI, 0.72-0.90), SAP mean sensitivity (area under the curve, 0.80; 95% CI, 0.69-0.88; P = .03), and SAP pattern standard deviation (area under the curve, 0.77; 95% CI, 0.66-0.87; P = .01). No statistically significant differences were seen for the sectoral measurements between the BCI and SAP. Intraclass coefficients for global and sectoral parameters ranged from 0.74 to 0.92, and mean coefficients of variation ranged from 3.03% to 7.45%.

Conclusions and Relevance

The BCI device may be useful for assessing the electrical brain responses associated with visual field stimulation. The device discriminated eyes with glaucomatous neuropathy from healthy eyes in a clinically based setting. Further studies should investigate the feasibility of the BCI device for home-based testing as well as for detecting visual function loss over time.

Monitoring alert and drowsy states by modeling EEG source nonstationarity

OBJECTIVE

As a human brain performs various cognitive functions within ever-changing environments, states of the brain characterized by recorded brain activities such as electroencephalogram (EEG) are inevitably nonstationary. The challenges of analyzing the nonstationary EEG signals include finding neurocognitive sources that underlie different brain states and using EEG data to quantitatively assess the state changes.

APPROACH

This study hypothesizes that brain activities under different states, e.g. levels of alertness, can be modeled as distinct compositions of statistically independent sources using independent component analysis (ICA). This study presents a framework to quantitatively assess the EEG source nonstationarity and estimate levels of alertness. The framework was tested against EEG data collected from 10 subjects performing a sustained-attention task in a driving simulator.

MAIN RESULTS

Empirical results illustrate that EEG signals under alert versus drowsy states, indexed by reaction speeds to driving challenges, can be characterized by distinct ICA models. By quantifying the goodness-of-fit of each ICA model to the EEG data using the model deviation index (MDI), we found that MDIs were significantly correlated with the reaction speeds (r  =  -0.390 with alertness models and r  =  0.449 with drowsiness models) and the opposite correlations indicated that the two models accounted for sources in the alert and drowsy states, respectively. Based on the observed source nonstationarity, this study also proposes an online framework using a subject-specific ICA model trained with an initial (alert) state to track the level of alertness. For classification of alert against drowsy states, the proposed online framework achieved an averaged area-under-curve of 0.745 and compared favorably with a classic power-based approach.

SIGNIFICANCE

This ICA-based framework provides a new way to study changes of brain states and can be applied to monitoring cognitive or mental states of human operators in attention-critical settings or in passive brain-computer interfaces.

Noninvasive EEG correlates of overground and stair walking

Automated walking intention detection remains a challenge in lower-limb neuroprosthetic systems. Here, we assess the feasibility of extracting motor intent from scalp electroencephalography (EEG). First, we evaluated the corticomuscular coherence between central EEG electrodes (C1, Cz, C2) and muscles of the shank and thigh during walking on level ground and stairs. Second, we trained decoders to predict the linear envelope of the surface electromyogram (EMG). We observed significant EEG-led corticomuscular coupling between electrodes and sEMG (tibialis anterior) in the high delta (3-4 Hz) and low theta (4-5 Hz) frequency bands during level walking, indicating efferent signaling from the cortex to peripheral motor neurons. The coherence was increased between EEG and vastus lateralis and tibialis anterior in the delta band (<; 2 Hz) during stair ascent, indicating a task specific modulation in corticomuscular coupling. However, EMG was the leading signal for biceps femoris and gastrocnemius coherence during stair ascent, possibly representing afferent feedback loops from periphery to the motor cortex. Decoder validation showed that EEG signals contained information about the sEMG patterns during over ground walking, however, the accuracy of the predicted sEMG patterns decreased during the stair condition. Overall, these initial findings support the feasibility of integrating sEMG and EEG into a hybrid decoder for volitional control of lower limb neuroprostheses.

Multiple Kernel Based Region Importance Learning for Neural Classification of Gait States from EEG Signals

With the development of Brain Machine Interface (BMI) systems, people with motor disabilities are able to control external devices to help them restore movement abilities. Longitudinal validation of these systems is critical not only to assess long-term performance reliability but also to investigate adaptations in electrocortical patterns due to learning to use the BMI system. In this paper, we decode the patterns of user's intended gait states (e.g., stop, walk, turn left, and turn right) from scalp electroencephalography (EEG) signals and simultaneously learn the relative importance of different brain areas by using the multiple kernel learning (MKL) algorithm. The region of importance (ROI) is identified during training the MKL for classification. The efficacy of the proposed method is validated by classifying different movement intentions from two subjects—an able-bodied and a spinal cord injury (SCI) subject. The preliminary results demonstrate that frontal and fronto-central regions are the most important regions for the tested subjects performing gait movements, which is consistent with the brain regions hypothesized to be involved in the control of lower-limb movements. However, we observed some regional changes comparing the able-bodied and the SCI subject. Moreover, in the longitudinal experiments, our findings exhibit the cortical plasticity triggered by the BMI use, as the classification accuracy and the weights for important regions—in sensor space—generally increased, as the user learned to control the exoskeleton for movement over multiple sessions.

An Automated Quiet Sleep Detection Approach in Preterm Infants as a Gateway to Assess Brain Maturation

Sleep state development in preterm neonates can provide crucial information regarding functional brain maturation and give insight into neurological well being. However, visual labeling of sleep stages from EEG requires expertise and is very time consuming, prompting the need for an automated procedure. We present a robust method for automated detection of preterm sleep from EEG, over a wide postmenstrual age (PMA = gestational age + postnatal age) range, focusing first on Quiet Sleep (QS) as an initial marker for sleep assessment. Our algorithm, CLuster-based Adaptive Sleep Staging (CLASS), detects QS if it remains relatively more discontinuous than non-QS over PMA. CLASS was optimized on a training set of 34 recordings aged 27–42 weeks PMA, and performance then assessed on a distinct test set of 55 recordings of the same age range. Results were compared to visual QS labeling from two independent raters (with inter-rater agreement Kappa = 0. 93), using Sensitivity, Specificity, Detection Factor (DF = proportion of visual QS periods correctly detected by CLASS) and Misclassification Factor (MF = proportion of CLASS-detected QS periods that are misclassified). CLASS performance proved optimal across recordings at 31–38 weeks (median DF = 1.0, median MF 0–0.25, median Sensitivity 0.93–1.0, and median Specificity 0.80–0.91 across this age range), with minimal misclassifications at 35–36 weeks (median MF = 0). To illustrate the potential of CLASS in facilitating clinical research, normal maturational trends over PMA were derived from CLASS-estimated QS periods, visual QS estimates, and nonstate specific periods (containing QS and non-QS) in the EEG recording. CLASS QS trends agreed with those from visual QS, with both showing stronger correlations than nonstate specific trends. This highlights the benefit of automated QS detection for exploring brain maturation.