rtMEG: a real-time software interface for magnetoencephalography

Doubting the double-blind: Introducing a questionnaire for awareness of experimental purposes in neurofeedback studies

Double-blinding subjects to the experiment's purpose is an important standard in neurofeedback studies. However, it is difficult to provide evidence that humans are entirely unaware of certain information. This study used insights from consciousness studies and neurophenomenology to develop a contingency awareness questionnaire for neurofeedback. We assessed whether participants had an awareness of experimental purposes to manipulate their attention and multisensory perception. A subset of subjects (5 out of 20) gained a degree of awareness of experimental purposes as evidenced by their correct guess about the purposes of the experiment to affect their attention and multisensory perceptions specific to their double-blinded group assignment. The results warrant replication before they are applied to clinical neurofeedback studies, given the considerable time taken to perform the questionnaire (∼25 min). We discuss the strengths and limitations of our contingency awareness questionnaire and the growing appeal of the double-blinded standard in clinical neurofeedback studies.

Research on the MEG of Depression Patients Based on Multivariate Transfer Entropy

The pathogenesis of depression is complex, and the current means of medical diagnosis is single. Patients with severe depression may even have great physical pain and suicidal tendencies. Magnetoencephalography (MEG) has the characteristics of ultrahigh spatiotemporal resolution and safety. It is a good medical means for the diagnosis of depression. In this paper, multivariate transfer entropy algorithm is used to study MEG of depression. In this paper, the subjects are divided into the same brain region and the multichannel combination between different brain regions, and the multivariate transfer entropy of patients with depression and healthy controls under different EEG signal frequency bands is calculated. Finally, the significant difference between the two groups of experimental samples is verified by the results of independent sample t-test. The experimental results show that for the same combination of brain channels, the multivariate transfer entropy in the depression group is generally lower than that in the healthy control group, and the difference is the best in γ frequency band and the largest in the frontal region.

Can neurofeedback provide evidence of direct brain-behavior causality?

Neurofeedback is a procedure that measures brain activity in real-time and presents it as feedback to an individual, thus allowing them to self-regulate brain activity with effects on cognitive processes inferred from behavior. One common argument is that neurofeedback studies can reveal how the measured brain activity causes a particular cognitive process. The causal claim is often made regarding the measured brain activity being manipulated as an independent variable, similar to brain stimulation studies. However, this causal inference is vulnerable to the argument that other upstream brain activities change concurrently and cause changes in the brain activity from which feedback is derived. In this paper, we outline the inference that neurofeedback may causally affect cognition by indirect means. We further argue that researchers should remain open to the idea that the trained brain activity could be part of a "causal network" that collectively affects cognition rather than being necessarily causally primary. This particular inference may provide a better translation of evidence from neurofeedback studies to the rest of neuroscience. We argue that the recent advent of multivariate pattern analysis, when combined with implicit neurofeedback, currently comprises the strongest case for causality. Our perspective is that although the burden of inferring direct causality is difficult, it may be triangulated using a collection of various methods in neuroscience. Finally, we argue that the neurofeedback methodology provides unique advantages compared to other methods for revealing changes in the brain and cognitive processes but that researchers should remain mindful of indirect causal effects.

The effect of visual and proprioceptive feedback on sensorimotor rhythms during BCI training

Brain–computer interfaces (BCI) can be designed with several feedback modalities. To promote appropriate brain plasticity in therapeutic applications, the feedback should guide the user to elicit the desired brain activity and preferably be similar to the imagined action. In this study, we employed magnetoencephalography (MEG) to measure neurophysiological changes in healthy subjects performing motor imagery (MI) -based BCI training with two different feedback modalities. The MI-BCI task used in this study lasted 40–60 min and involved imagery of right- or left-hand movements. 8 subjects performed the task with visual and 14 subjects with proprioceptive feedback. We analysed power changes across the session at multiple frequencies in the range of 4–40 Hz with a generalized linear model to find those frequencies at which the power increased significantly during training. In addition, the power increase was analysed for each gradiometer, separately for alpha (8–13 Hz), beta (14–30 Hz) and gamma (30–40 Hz) bands, to find channels showing significant linear power increase over the session. These analyses were applied during three different conditions: rest, preparation, and MI. Visual feedback enhanced the amplitude of mainly high beta and gamma bands (24–40 Hz) in all conditions in occipital and left temporal channels. During proprioceptive feedback, in contrast, power increased mainly in alpha and beta bands. The alpha-band enhancement was found in multiple parietal, occipital, and temporal channels in all conditions, whereas the beta-band increase occurred during rest and preparation mainly in the parieto-occipital region and during MI in the parietal channels above hand motor regions. Our results show that BCI training with proprioceptive feedback increases the power of sensorimotor rhythms in the motor cortex, whereas visual feedback causes mainly a gamma-band increase in the visual cortex. MI-BCIs should involve proprioceptive feedback to facilitate plasticity in the motor cortex.

Neurofeedback Modulation of the Sound-induced Flash Illusion Using Parietal Cortex Alpha Oscillations Reveals Dependency on Prior Multisensory Congruency

Spontaneous neural oscillations are key predictors of perceptual decisions to bind multisensory signals into a unified percept. Research links decreased alpha power in the posterior cortices to attention and audiovisual binding in the sound-induced flash illusion (SIFI) paradigm. This suggests that controlling alpha oscillations would be a way of controlling audiovisual binding. In the present feasibility study we used MEG-neurofeedback to train one group of subjects to increase left/right and another to increase right/left alpha power ratios in the parietal cortex. We tested for changes in audiovisual binding in a SIFI paradigm where flashes appeared in both hemifields. Results showed that the neurofeedback induced a significant asymmetry in alpha power for the left/right group, not seen for the right/left group. Corresponding asymmetry changes in audiovisual binding in illusion trials (with 2, 3, and 4 beeps paired with 1 flash) were not apparent. Exploratory analyses showed that neurofeedback training effects were present for illusion trials with the lowest numeric disparity (i.e., 2 beeps and 1 flash trials) only if the previous trial had high congruency (2 beeps and 2 flashes). Our data suggest that the relation between parietal alpha power (an index of attention) and its effect on audiovisual binding is dependent on the learned causal structure in the previous stimulus. The present results suggests that low alpha power biases observers towards audiovisual binding when they have learned that audiovisual signals originate from a common origin, consistent with a Bayesian causal inference account of multisensory perception.

Extended Signal-Space Separation Method for Improved Interference Suppression in MEG

Objective:

Magnetoencephalography (MEG) signals typically reflect a mixture of neuromagnetic fields, subject-related artifacts, external interference and sensor noise. Even inside a magnetically shielded room, external interference can be significantly stronger than brain signals. Methods such as signal-space projection (SSP) and signal-space separation (SSS) have been developed to suppress this residual interference, but their performance might not be sufficient in cases of strong interference or when the sources of interference change over time.

Methods:

Here we suggest a new method, extended signal-space separation (eSSS), which combines a physical model of the magnetic fields (as in SSS) with a statistical description of the interference (as in SSP). We demonstrate the performance of this method via simulations and experimental MEG data.

Results:

The eSSS method clearly outperforms SSS and SSP in interference suppression regardless of the extent of a priori information available on the interference sources. We also show that the method does not cause location or amplitude bias in dipole modeling.

Conclusion:

Our eSSS method provides better data quality than SSP or SSS and can be readily combined with other SSS-based methods, such as spatiotemporal SSS or head movement compensation. Thus, eSSS extends and complements the interference suppression techniques currently available for MEG.

Significance:

Due to its ability to suppress external interference to the level of sensor noise, eSSS can facilitate single-trial data analysis, exemplified in automated analysis of epileptic data. Such an enhanced suppression is especially important in environments with large interference fields.

A computational paradigm for real-time MEG neurofeedback for dynamic allocation of spatial attention

Background

Neurofeedback aids volitional control of one’s own brain activity using non-invasive recordings of brain activity. The applications of neurofeedback include improvement of cognitive performance and treatment of various psychiatric and neurological disorders. During real-time magnetoencephalography (rt-MEG), sensor-level or source-localized brain activity is measured and transformed into a visual feedback cue to the subject. Recent real-time fMRI (rt-fMRI) neurofeedback studies have used pattern recognition techniques to decode and train a brain state to link brain activities and cognitive behaviors. Here, we utilize the real-time decoding technique similar to ones employed in rt-fMRI to analyze time-varying rt-MEG signals.

Results

We developed a novel rt-MEG method, state-based neurofeedback (sb-NFB), to decode a time-varying brain state, a state signal, from which timings are extracted for neurofeedback training. The approach is entirely data-driven: it uses sensor-level oscillatory activity to find relevant features that best separate the targeted brain states. In a psychophysical task of spatial attention switching, we trained five young, healthy subjects using the sb-NFB method to decrease the time necessary for switch spatial attention from one visual hemifield to the other (referred to as switch time). Training resulted in a decrease in switch time with training. We saw that the activity targeted by the training involved proportional changes in alpha and beta-band oscillations, in sensors at the occipital and parietal regions. We also found that the state signal that encodes whether subjects attend to the left or right visual field effectively switches consistently with the task.

Conclusion

We demonstrated the use of the sb-NFB method when the subject learns to increase the speed of shifting covert spatial attention from one visual field to the other. The sb-NFB method can target timing features that would otherwise also include extraneous features such as visual detection and motor response in a simple reaction time task.

Neural Decoding of Multi-Modal Imagery Behavior Focusing on Temporal Complexity

Mental imagery behaviors of various modalities include visual, auditory, and motor behaviors. Their alterations are pathologically involved in various psychiatric disorders. Results of earlier studies suggest that imagery behaviors are correlated with the modulated activities of the respective modality-specific regions and the additional activities of supramodal imagery-related regions. Additionally, despite the availability of complexity analysis in the neuroimaging field, it has not been used for neural decoding approaches. Therefore, we sought to characterize neural oscillation related to multimodal imagery through complexity-based neural decoding. For this study, we modified existing complexity measures to characterize the time evolution of temporal complexity. We took magnetoencephalography (MEG) data of eight healthy subjects as they performed multimodal imagery and non-imagery tasks. The MEG data were decomposed into amplitude and phase of sub-band frequencies by Hilbert-Huang transform. Subsequently, we calculated the complexity values of each reconstructed time series, along with raw data and band power for comparison, and applied these results as inputs to decode visual perception (VP), visual imagery (VI), motor execution (ME), and motor imagery (MI) functions. Consequently, intra-subject decoding with the complexity yielded a characteristic sensitivity map for each task with high decoding accuracy. The map is inverted in the occipital regions between VP and VI and in the central regions between ME and MI. Additionally, replacement of the labels into two classes as imagery and non-imagery also yielded better classification performance and characteristic sensitivity with the complexity. It is particularly interesting that some subjects showed characteristic sensitivities not only in modality-specific regions, but also in supramodal regions. These analyses indicate that two-class and four-class classifications each provided better performance when using complexity than when using raw data or band power as input. When inter-subject decoding was used with the same model, characteristic sensitivity maps were also obtained, although their decoding performance was lower. Results of this study underscore the availability of complexity measures in neural decoding approaches and suggest the possibility of a modality-independent imagery-related mechanism. The use of time evolution of temporal complexity in neural decoding might extend our knowledge of the neural bases of hierarchical functions in the human brain.

Endogenously generated gamma-band oscillations in early visual cortex: A neurofeedback study

Human subjects were trained with neurofeedback (NFB) to enhance the power of narrow-band gamma oscillations in circumscribed regions of early visual cortex. To select the region and the oscillation frequency for NFB training, gamma oscillations were induced with locally presented drifting gratings. The source and frequency of these induced oscillations were determined using beamforming methods. During NFB training the power of narrow band gamma oscillations was continuously extracted from this source with online beamforming and converted into the pitch of a tone signal. We found that seven out of ten subjects were able to selectively increase the amplitude of gamma oscillations in the absence of visual stimulation. One subject however failed completely and two subjects succeeded to manipulate the feedback signal by contraction of muscles. In all subjects the attempts to enhance visual gamma oscillations were associated with an increase of beta oscillations over precentral/frontal regions. Only successful subjects exhibited an additional marked increase of theta oscillations over precentral/prefrontal and temporal regions whereas unsuccessful subjects showed an increase of alpha band oscillations over occipital regions. We argue that spatially confined networks in early visual cortex can be entrained to engage in narrow band gamma oscillations not only by visual stimuli but also by top down signals. We interpret the concomitant increase in beta oscillations as indication for an engagement of the fronto-parietal attention network and the increase of theta oscillations as a correlate of imagery. Our finding support the application of NFB in disease conditions associated with impaired gamma synchronization.

Across-subject offline decoding of motor imagery from MEG and EEG

Long calibration time hinders the feasibility of brain-computer interfaces (BCI). If other subjects’ data were used for training the classifier, BCI-based neurofeedback practice could start without the initial calibration. Here, we compare methods for inter-subject decoding of left- vs. right-hand motor imagery (MI) from MEG and EEG. Six methods were tested on data involving MEG and EEG measurements of healthy participants. Inter-subject decoders were trained on subjects showing good within-subject accuracy, and tested on all subjects, including poor performers. Three methods were based on Common Spatial Patterns (CSP), and three others on logistic regression with l₁ - or l_2,1 -norm regularization. The decoding accuracy was evaluated using (1) MI and (2) passive movements (PM) for training, separately for MEG and EEG. With MI training, the best accuracies across subjects (mean 70.6% for MEG, 67.7% for EEG) were obtained using multi-task learning (MTL) with logistic regression and l_2,1-norm regularization. MEG yielded slightly better average accuracies than EEG. With PM training, none of the inter-subject methods yielded above chance level (58.7%) accuracy. In conclusion, MTL and training with other subject’s MI is efficient for inter-subject decoding of MI. Passive movements of other subjects are likely suboptimal for training the MI classifiers.

Across-subject offline decoding of motor imagery from MEG and EEG

Long calibration time hinders the feasibility of brain-computer interfaces (BCI). If other subjects' data were used for training the classifier, BCI-based neurofeedback practice could start without the initial calibration. Here, we compare methods for inter-subject decoding of left- vs. right-hand motor imagery (MI) from MEG and EEG. Six methods were tested on data involving MEG and EEG measurements of healthy participants. Inter-subject decoders were trained on subjects showing good within-subject accuracy, and tested on all subjects, including poor performers. Three methods were based on Common Spatial Patterns (CSP), and three others on logistic regression with l₁ - or l_2,1 -norm regularization. The decoding accuracy was evaluated using (1) MI and (2) passive movements (PM) for training, separately for MEG and EEG. With MI training, the best accuracies across subjects (mean 70.6% for MEG, 67.7% for EEG) were obtained using multi-task learning (MTL) with logistic regression and l_2,1-norm regularization. MEG yielded slightly better average accuracies than EEG. With PM training, none of the inter-subject methods yielded above chance level (58.7%) accuracy. In conclusion, MTL and training with other subject's MI is efficient for inter-subject decoding of MI. Passive movements of other subjects are likely suboptimal for training the MI classifiers.

Evidence for a general performance-monitoring system in the human brain

Adaptive behavior relies on the ability of the brain to form predictions and monitor action outcomes. In the human brain, the same system is thought to monitor action outcomes regardless of whether the information originates from internal (e.g., proprioceptive) and external (e.g., visual) sensory channels. Neural signatures of processing motor errors and action outcomes communicated by external feedback have been studied extensively; however, the existence of such a general action‐monitoring system has not been tested directly. Here, we use concurrent EEG‐MEG measurements and a probabilistic learning task to demonstrate that event‐related responses measured by electroencephalography and magnetoencephalography display spatiotemporal patterns that allow an effective transfer of a multivariate statistical model discriminating the outcomes across the following conditions: (a) erroneous versus correct motor output, (b) negative versus positive feedback, (c) high‐ versus low‐surprise negative feedback, and (d) erroneous versus correct brain–computer‐interface output. We further show that these patterns originate from highly‐overlapping neural sources in the medial frontal and the medial parietal cortices. We conclude that information about action outcomes arriving from internal or external sensory channels converges to the same neural system in the human brain, that matches this information to the internal predictions.

Real-Time Clustered Multiple Signal Classification (RTC-MUSIC)

Magnetoencephalography (MEG) and electroencephalography provide a high temporal resolution, which allows estimation of the detailed time courses of neuronal activity. However, in real-time analysis of these data two major challenges must be handled: the low signal-to-noise ratio (SNR) and the limited time available for computations. In this work, we present real-time clustered multiple signal classification (RTC-MUSIC) a real-time source localization algorithm, which can handle low SNRs and can reduce the computational effort. It provides correlation information together with sparse source estimation results, which can, e.g., be used to identify evoked responses with high sensitivity. RTC-MUSIC clusters the forward solution based on an anatomical brain atlas and optimizes the scanning process inherent to MUSIC approaches. We evaluated RTC-MUSIC by analyzing MEG auditory and somatosensory data. The results demonstrate that the proposed method localizes sources reliably. For the auditory experiment the most dominant correlated source pair was located bilaterally in the superior temporal gyri. The highest activation in the somatosensory experiment was found in the contra-lateral primary somatosensory cortex.

Defining the Neural Substrate of the Adult Outcome of Childhood ADHD: A Multimodal Neuroimaging Study of Response Inhibition

OBJECTIVE

Understanding the neural processes tied to the adult outcome of childhood attention deficit hyperactivity disorder (ADHD) could guide novel interventions to improve its clinical course. It has been argued that normalization of prefrontal cortical activity drives remission from ADHD, while anomalies in subcortical processes are "fixed," present even in remission. Using multimodal neuroimaging of inhibitory processes, the authors tested these hypotheses in adults followed since childhood, contrasting remitted against persistent ADHD.

METHOD

Adult participants (persistent ADHD, N=35; remit-ted ADHD, N=47; never affected, N=99) were scanned with functional MRI (fMRI) (N=85), magnetoencephalography (N=33), or both (N=63) during a response inhibition task.

RESULTS

In fMRI analyses, during inhibition, right caudate anomalies reflected a childhood ADHD history and were present even among those who remitted. By contrast, differences related to adult outcome emerged in cortical (right inferior frontal and inferior parietal/precuneus) and cerebellar regions. The persistent ADHD group showed under-activation, whereas the remitted ADHD group did not differ significantly from the never-affected group. Magnetoencephalography showed that the association between adult symptom severity and prefrontal neuronal activity was confined to the time window covering the act of inhibition (300 ms-350 ms). Group differences in cerebellar and parietal neuronal activity occurred during the time window of performance monitoring processes (500 ms-600 ms).

CONCLUSIONS

By combining fMRI and magnetoencephalography, the location and time window of neuronal activity that underpins the adult outcome of ADHD was pinpointed. Thus, the cortico-cerebellar processes tied to the clinical course of ADHD are separated from the subcortical processes that are not.

Unimodal Versus Bimodal EEG-fMRI Neurofeedback of a Motor Imagery Task

Neurofeedback is a promising tool for brain rehabilitation and peak performance training. Neurofeedback approaches usually rely on a single brain imaging modality such as EEG or fMRI. Combining these modalities for neurofeedback training could allow to provide richer information to the subject and could thus enable him/her to achieve faster and more specific self-regulation. Yet unimodal and multimodal neurofeedback have never been compared before. In the present work, we introduce a simultaneous EEG-fMRI experimental protocol in which participants performed a motor-imagery task in unimodal and bimodal NF conditions. With this protocol we were able to compare for the first time the effects of unimodal EEG-neurofeedback and fMRI-neurofeedback versus bimodal EEG-fMRI-neurofeedback by looking both at EEG and fMRI activations. We also propose a new feedback metaphor for bimodal EEG-fMRI-neurofeedback that integrates both EEG and fMRI signal in a single bi-dimensional feedback (a ball moving in 2D). Such a feedback is intended to relieve the cognitive load of the subject by presenting the bimodal neurofeedback task as a single regulation task instead of two. Additionally, this integrated feedback metaphor gives flexibility on defining a bimodal neurofeedback target. Participants were able to regulate activity in their motor regions in all NF conditions. Moreover, motor activations as revealed by offline fMRI analysis were stronger during EEG-fMRI-neurofeedback than during EEG-neurofeedback. This result suggests that EEG-fMRI-neurofeedback could be more specific or more engaging than EEG-neurofeedback. Our results also suggest that during EEG-fMRI-neurofeedback, participants tended to regulate more the modality that was harder to control. Taken together our results shed first light on the specific mechanisms of bimodal EEG-fMRI-neurofeedback and on its added-value as compared to unimodal EEG-neurofeedback and fMRI-neurofeedback.

Comparing Features for Classification of MEG Responses to Motor Imagery

BACKGROUND

Motor imagery (MI) with real-time neurofeedback could be a viable approach, e.g., in rehabilitation of cerebral stroke. Magnetoencephalography (MEG) noninvasively measures electric brain activity at high temporal resolution and is well-suited for recording oscillatory brain signals. MI is known to modulate 10- and 20-Hz oscillations in the somatomotor system. In order to provide accurate feedback to the subject, the most relevant MI-related features should be extracted from MEG data. In this study, we evaluated several MEG signal features for discriminating between left- and right-hand MI and between MI and rest.

METHODS

MEG was measured from nine healthy participants imagining either left- or right-hand finger tapping according to visual cues. Data preprocessing, feature extraction and classification were performed offline. The evaluated MI-related features were power spectral density (PSD), Morlet wavelets, short-time Fourier transform (STFT), common spatial patterns (CSP), filter-bank common spatial patterns (FBCSP), spatio-spectral decomposition (SSD), and combined SSD+CSP, CSP+PSD, CSP+Morlet, and CSP+STFT. We also compared four classifiers applied to single trials using 5-fold cross-validation for evaluating the classification accuracy and its possible dependence on the classification algorithm. In addition, we estimated the inter-session left-vs-right accuracy for each subject.

RESULTS

The SSD+CSP combination yielded the best accuracy in both left-vs-right (mean 73.7%) and MI-vs-rest (mean 81.3%) classification. CSP+Morlet yielded the best mean accuracy in inter-session left-vs-right classification (mean 69.1%). There were large inter-subject differences in classification accuracy, and the level of the 20-Hz suppression correlated significantly with the subjective MI-vs-rest accuracy. Selection of the classification algorithm had only a minor effect on the results.

CONCLUSIONS

We obtained good accuracy in sensor-level decoding of MI from single-trial MEG data. Feature extraction methods utilizing both the spatial and spectral profile of MI-related signals provided the best classification results, suggesting good performance of these methods in an online MEG neurofeedback system.

MEG-based neurofeedback for hand rehabilitation

BACKGROUND

Providing neurofeedback (NF) of motor-related brain activity in a biologically-relevant and intuitive way could maximize the utility of a brain-computer interface (BCI) for promoting therapeutic plasticity. We present a BCI capable of providing intuitive and direct control of a video-based grasp.

METHODS

Utilizing magnetoencephalography's (MEG) high temporal and spatial resolution, we recorded sensorimotor rhythms (SMR) that were modulated by grasp or rest intentions. SMR modulation controlled the grasp aperture of a stop motion video of a human hand. The displayed hand grasp position was driven incrementally towards a closed or opened state and subjects were required to hold the targeted position for a time that was adjusted to change the task difficulty.

RESULTS

We demonstrated that three individuals with complete hand paralysis due to spinal cord injury (SCI) were able to maintain brain-control of closing and opening a virtual hand with an average of 63 % success which was significantly above the average chance rate of 19 %. This level of performance was achieved without pre-training and less than 4 min of calibration. In addition, successful grasp targets were reached in 1.96 ± 0.15 s. Subjects performed 200 brain-controlled trials in approximately 30 min excluding breaks. Two of the three participants showed a significant improvement in SMR indicating that they had learned to change their brain activity within a single session of NF.

CONCLUSIONS

This study demonstrated the utility of a MEG-based BCI system to provide realistic, efficient, and focused NF to individuals with paralysis with the goal of using NF to induce neuroplasticity.

Brain computer interface learning for systems based on electrocorticography and intracortical microelectrode arrays

A brain-computer interface (BCI) system transforms neural activity into control signals for external devices in real time. A BCI user needs to learn to generate specific cortical activity patterns to control external devices effectively. We call this process BCI learning, and it often requires significant effort and time. Therefore, it is important to study this process and develop novel and efficient approaches to accelerate BCI learning. This article reviews major approaches that have been used for BCI learning, including computer-assisted learning, co-adaptive learning, operant conditioning, and sensory feedback. We focus on BCIs based on electrocorticography and intracortical microelectrode arrays for restoring motor function. This article also explores the possibility of brain modulation techniques in promoting BCI learning, such as electrical cortical stimulation, transcranial magnetic stimulation, and optogenetics. Furthermore, as proposed by recent BCI studies, we suggest that BCI learning is in many ways analogous to motor and cognitive skill learning, and therefore skill learning should be a useful metaphor to model BCI learning.

Noninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms

Brain-computer interfaces (BCIs) have been explored in the field of neuroengineering to investigate how the brain can use these systems to control external devices. We review the principles and approaches we have taken to develop a sensorimotor rhythm EEG based brain-computer interface (BCI). The methods include developing BCI systems incorporating the control of physical devices to increase user engagement, improving BCI systems by inversely mapping scalp-recorded EEG signals to the cortical source domain, integrating BCI with noninvasive neuromodulation strategies to improve learning, and incorporating mind-body awareness training to enhance BCI learning and performance. The challenges and merits of these strategies are discussed, together with recent findings. Our work indicates that the sensorimotor-rhythm-based noninvasive BCI has the potential to provide communication and control capabilities as an alternative to physiological motor pathways.

Real-Time MEG Source Localization Using Regional Clustering

With its millisecond temporal resolution, Magnetoencephalography (MEG) is well suited for real-time monitoring of brain activity. Real-time feedback allows the adaption of the experiment to the subject's reaction and increases time efficiency by shortening acquisition and off-line analysis. Two formidable challenges exist in real-time analysis: the low signal-to-noise ratio (SNR) and the limited time available for computations. Since the low SNR reduces the number of distinguishable sources, we propose an approach which downsizes the source space based on a cortical atlas and allows to discern the sources in the presence of noise. Each cortical region is represented by a small set of dipoles, which is obtained by a clustering algorithm. Using this approach, we adapted dynamic statistical parametric mapping for real-time source localization. In terms of point spread and crosstalk between regions the proposed clustering technique performs better than selecting spatially evenly distributed dipoles. We conducted real-time source localization on MEG data from an auditory experiment. The results demonstrate that the proposed real-time method localizes sources reliably in the superior temporal gyrus. We conclude that real-time source estimation based on MEG is a feasible, useful addition to the standard on-line processing methods, and enables feedback based on neural activity during the measurements.

Self-regulation of frontal-midline theta facilitates memory updating and mental set shifting

Frontal-midline (fm) theta oscillations as measured via the electroencephalogram (EEG) have been suggested as neural "working language" of executive functioning. Their power has been shown to increase when cognitive processing or task performance is enhanced. Thus, the question arises whether learning to increase fm-theta amplitudes would functionally impact the behavioral performance in tasks probing executive functions (EFs). Here, the effects of neurofeedback (NF), a learning method to self-up-regulate fm-theta over fm electrodes, on the four most representative EFs, memory updating, set shifting, conflict monitoring, and motor inhibition are presented. Before beginning and after completing an individualized, eight-session gap-spaced NF intervention, the three-back, letter/number task-switching, Stroop, and stop-signal tasks were tested while measuring the EEG. Self-determined up-regulation of fm-theta and its putative role for executive functioning were compared to an active control group, the so-called pseudo-neurofeedback group. Task-related fm-theta activity after training differed significantly between groups. More importantly, though, after NF significantly enhanced behavioral performance was observed. The training group showed higher accuracy scores in the three-back task and reduced mixing and shifting costs in letter/number task-switching. However, this specific protocol type did not affect performance in tasks probing conflict monitoring and motor inhibition. Thus, our results suggest a modulation of proactive but not reactive mechanisms of cognitive control. Furthermore, task-related EEG changes show a distinct pattern for fm-theta after training between the NF and the pseudo-neurofeedback group, which indicates that NF training indeed tackles EFs-networks. In sum, the modulation of fm-theta via NF may serve as potent treatment approach for executive dysfunctions.

Head movement compensation in real-time magnetoencephalographic recordings

Neurofeedback- and brain-computer interface (BCI)-based interventions can be implemented using real-time analysis of magnetoencephalographic (MEG) recordings. Head movement during MEG recordings, however, can lead to inaccurate estimates of brain activity, reducing the efficacy of the intervention. Most real-time applications in MEG have utilized analyses that do not correct for head movement. Effective means of correcting for head movement are needed to optimize the use of MEG in such applications. Here we provide preliminary validation of a novel analysis technique, real-time source estimation (rtSE), that measures head movement and generates corrected current source time course estimates in real-time. rtSE was applied while recording a calibrated phantom to determine phantom position localization accuracy and source amplitude estimation accuracy under stationary and moving conditions. Results were compared to off-line analysis methods to assess validity of the rtSE technique. The rtSE method allowed for accurate estimation of current source activity at the source-level in real-time, and accounted for movement of the source due to changes in phantom position. The rtSE technique requires modifications and specialized analysis of the following MEG work flow steps.•Data acquisition•Head position estimation•Source localization•Real-time source estimation This work explains the technical details and validates each of these steps.

A constrained ICA approach for real-time cardiac artifact rejection in magnetoencephalography

Recently, magnetoencephalography (MEG)-based real-time brain computing interfaces (BCI) have been developed to enable novel and promising methods of neuroscience research and therapy. Artifact rejection prior to source localization largely enhances the localization accuracy. However, many BCI approaches neglect real-time artifact removal due to its time consuming processing. With cardiac artifact rejection for real-time analysis (CARTA), we introduce a novel algorithm capable of real-time cardiac artifact (CA) rejection. The method is based on constrained independent component analysis (ICA), where a priori information of the underlying source signal is used to optimize and accelerate signal decomposition. In CARTA, this is performed by estimating the subject's individual density distribution of the cardiac activity, which leads to a subject-specific signal decomposition algorithm. We show that the new method is capable of effectively reducing CAs within one iteration and a time delay of 1 ms. In contrast, Infomax and Extended Infomax ICA converged not until seven iterations, while FastICA needs at least ten iterations. CARTA was tested and applied to data from three different but most common MEG systems (4-D-Neuroimaging, VSM MedTech Inc., and Elekta Neuromag). Therefore, the new method contributes to reliable signal analysis utilizing BCI approaches.

Ocular and cardiac artifact rejection for real-time analysis in MEG

BACKGROUND

Recently, magnetoencephalography (MEG) based real-time brain computing interfaces (BCI) have been developed to enable novel and promising methods for neuroscience research. It is well known that artifact rejection prior to source localization largely enhances the localization accuracy. However, many BCI approaches neglect real-time artifact removal due to its time consuming process.

NEW METHOD

The method (referred to as ocular and cardiac artifact rejection for real-time analysis, OCARTA) is based on constrained independent component analysis (cICA), where a priori information of the underlying source signals is used to optimize and accelerate signal decomposition. Thereby, prior information is incorporated by using the subject's individual cardiac and ocular activity. The algorithm automatically uses different separation strategies depending on the underlying source activity.

RESULTS

OCARTA was tested and applied to data from three different but most commonly used MEG systems (4D-Neuroimaging, VSM MedTech Inc. and Elekta Neuromag). Ocular and cardiac artifacts were effectively reduced within one iteration at a time delay of 1ms performed on a standard PC (Intel Core i5-2410M).

COMPARISON WITH EXISTING METHODS

The artifact rejection results achieved with OCARTA are in line with the results reported for offline ICA-based artifact rejection methods.

CONCLUSION

Due to the fast and subject-specific signal decomposition the new approach introduced here is capable of real-time ocular and cardiac artifact rejection.

Brain-computer interface (BCI) evaluation in people with amyotrophic lateral sclerosis

Brain-computer interfaces (BCIs) might restore communication to people severely disabled by amyotrophic lateral sclerosis (ALS) or other disorders. We sought to: 1) define a protocol for determining whether a person with ALS can use a visual P300-based BCI; 2) determine what proportion of this population can use the BCI; and 3) identify factors affecting BCI performance. Twenty-five individuals with ALS completed an evaluation protocol using a standard 6 × 6 matrix and parameters selected by stepwise linear discrimination. With an 8-channel EEG montage, the subjects fell into two groups in BCI accuracy (chance accuracy 3%). Seventeen averaged 92 (± 3)% (range 71-100%), which is adequate for communication (G70 group). Eight averaged 12 (± 6)% (range 0-36%), inadequate for communication (L40 subject group). Performance did not correlate with disability: 11/17 (65%) of G70 subjects were severely disabled (i.e. ALSFRS-R < 5). All L40 subjects had visual impairments (e.g. nystagmus, diplopia, ptosis). P300 was larger and more anterior in G70 subjects. A 16-channel montage did not significantly improve accuracy. In conclusion, most people severely disabled by ALS could use a visual P300-based BCI for communication. In those who could not, visual impairment was the principal obstacle. For these individuals, auditory P300-based BCIs might be effective.

Gamma band activity associated with BCI performance: simultaneous MEG/EEG study

While brain computer interface (BCI) can be employed with patients and healthy subjects, there are problems that must be resolved before BCI can be useful to the public. In the most popular motor imagery (MI) BCI system, a significant number of target users (called “BCI-Illiterates”) cannot modulate their neuronal signals sufficiently to use the BCI system. This causes performance variability among subjects and even among sessions within a subject. The mechanism of such BCI-Illiteracy and possible solutions still remain to be determined. Gamma oscillation is known to be involved in various fundamental brain functions, and may play a role in MI. In this study, we investigated the association of gamma activity with MI performance among subjects. Ten simultaneous MEG/EEG experiments were conducted; MI performance for each was estimated by EEG data, and the gamma activity associated with BCI performance was investigated with MEG data. Our results showed that gamma activity had a high positive correlation with MI performance in the prefrontal area. This trend was also found across sessions within one subject. In conclusion, gamma rhythms generated in the prefrontal area appear to play a critical role in BCI performance.

Implementation of a beam forming technique in real-time magnetoencephalography

Real-time magnetoencephalography (rtMEG) is an emerging neurofeedback technology that could potentially benefit multiple areas of basic and clinical neuroscience. In the present study, we implemented voxel-based real-time coherence measurements in a rtMEG system in which we employed a beamformer to localize signal sources in the anatomical space prior to computing imaginary coherence. Our rtMEG experiment showed that a healthy subject could increase coherence between the parietal cortex and visual cortex when attending to a flickering visual stimulus. This finding suggests that our system is suitable for neurofeedback training and can be useful for practical brain-machine interface applications or neurofeedback rehabilitation.

Stability of MEG for real-time neurofeedback

Movement-related field potentials can be extracted and processed in real-time with magnetoencephalography (MEG) and used for brain machine interfacing (BMI). However, due to its immense sensitivity to magnetic fields, MEG is prone to a low signal to noise ratio. It is therefore important to collect enough initial data to appropriately characterize motor-related activity and to ensure that decoders can be built to adequately translate brain activity into BMI-device commands. This is of particular importance for therapeutic BMI applications where less time spent collecting initial open-loop data means more time for performing neurofeedback training which could potentially promote cortical plasticity and rehabilitation. This study evaluated the amount of hand-grasp movement and rest data needed to characterize sensorimotor modulation depth and build classifier functions to decode brain states in real-time. It was determined that with only five minutes of initial open-loop MEG data, decoders can be built to classify brain activity as grasp or rest in real-time with an accuracy of 84 ± 6%.