Decoding Steady-State Visual Evoked Potentials From Electrocorticography

Multisensory flicker modulates widespread brain networks and reduces interictal epileptiform discharges

Modulating brain oscillations has strong therapeutic potential. Interventions that both non-invasively modulate deep brain structures and are practical for chronic daily home use are desirable for a variety of therapeutic applications. Repetitive audio-visual stimulation, or sensory flicker, is an accessible approach that modulates hippocampus in mice, but its effects in humans are poorly defined. We therefore quantified the neurophysiological effects of flicker with high spatiotemporal resolution in patients with focal epilepsy who underwent intracranial seizure monitoring. In this interventional trial (NCT04188834) with a cross-over design, subjects underwent different frequencies of flicker stimulation in the same recording session with the effect of sensory flicker exposure on local field potential (LFP) power and interictal epileptiform discharges (IEDs) as primary and secondary outcomes, respectively. Flicker focally modulated local field potentials in expected canonical sensory cortices but also in the medial temporal lobe and prefrontal cortex, likely via resonance of stimulated long-range circuits. Moreover, flicker decreased interictal epileptiform discharges, a pathological biomarker of epilepsy and degenerative diseases, most strongly in regions where potentials were flicker-modulated, especially the visual cortex and medial temporal lobe. This trial met the scientific goal and is now closed. Our findings reveal how multi-sensory stimulation may modulate cortical structures to mitigate pathological activity in humans.

Cortical activation and BCI performance during brief tactile imagery: A comparative study with motor imagery

Brain-computer interfaces (BCIs) rely heavily on motor imagery (MI) for operation, yet tactile imagery (TI) presents a novel approach that may be advantageous in situations where visual feedback is impractical. The current study aimed to compare the cortical activity and digit classification performance induced by TI and MI to assess the viability of TI for use in BCIs. Twelve right-handed participants engaged in trials of TI and MI, focusing on their left and right index digits. Event-related desynchronization (ERD) in the mu and beta bands was analyzed, and classification accuracy was determined through an artificial neural network (ANN). Comparable ERD patterns were observed in both TI and MI, with significant decreases in ERD during imagery tasks. The ANN demonstrated high classification accuracy, with TI achieving a mean±SD of 79.30 ± 3.91 % and MI achieving 81.10 ± 2.96 %, with no significant difference between the two (p = 0.11). The study found that TI induces substantial ERD comparable to MI and maintains high classification accuracy, supporting its potential as an effective mental strategy for BCIs. This suggests that TI could be a valuable alternative in BCI applications, particularly for individuals unable to rely on visual cues.

Brain-computer interface paradigms and neural coding

Brain signal patterns generated in the central nervous system of brain-computer interface (BCI) users are closely related to BCI paradigms and neural coding. In BCI systems, BCI paradigms and neural coding are critical elements for BCI research. However, so far there have been few references that clearly and systematically elaborated on the definition and design principles of the BCI paradigm as well as the definition and modeling principles of BCI neural coding. Therefore, these contents are expounded and the existing main BCI paradigms and neural coding are introduced in the review. Finally, the challenges and future research directions of BCI paradigm and neural coding were discussed, including user-centered design and evaluation for BCI paradigms and neural coding, revolutionizing the traditional BCI paradigms, breaking through the existing techniques for collecting brain signals and combining BCI technology with advanced AI technology to improve brain signal decoding performance. It is expected that the review will inspire innovative research and development of the BCI paradigm and neural coding.

A Real-Time Non-Implantation Bi-Directional Brain-Computer Interface Solution Without Stimulation Artifacts

The non-implantation bi-directional brain-computer interface (BCI) is a neural interface technology that enables direct two-way communication between the brain and the external world by both "reading" neural signals and "writing" stimulation patterns to the brain. This technology has vast potential applications, such as improving the quality of life for individuals with neurological and mental illnesses and even expanding the boundaries of human capabilities. Nonetheless, non-implantation bi-directional BCIs face challenges in generating real-time feedback and achieving compatibility between stimulation and recording. These issues arise due to the considerable overlap between electrical stimulation frequencies and electrophysiological recording frequencies, as well as the impediment caused by the skull to the interaction of external and internal currents. To address those challenges, this work proposes a novel solution that combines the temporal interference stimulation paradigm and minimally invasive skull modification. A longitudinal animal experiment has preliminarily validated the feasibility of the proposed method. In signal recording experiments, the average impedance of our scheme decreased by 4.59 kΩ , about 67%, compared to the conventional technique at 18 points. The peak-to-peak value of the Somatosensory Evoked Potential increased by 8%. Meanwhile, the signal-to-noise ratio of Steady-State Visual Evoked Potential increased by 5.13 dB, and its classification accuracy increased by 44%. The maximum bandwidth of the resting state rose by 63%. In electrical stimulation experiments, the signal-to-noise ratio of the low-frequency response evoked by our scheme rose by 8.04 dB, and no stimulation artifacts were generated. The experimental results show that signal quality in acquisition has significantly improved, and frequency-band isolation eliminates stimulation artifacts at the source. The acquisition and stimulation pathways are real-time compatible in this non-implantation bi-directional BCI solution, which can provide technical support and theoretical guidance for creating closed-loop adaptive systems coupled with particular application scenarios in the future.

A Methodology for Enhancing SSVEP Features Using Adaptive Filtering Based on the Spatial Distribution of EEG Signals

In this paper, we propose a classification algorithm of EEG signal based on canonical correlation analysis (CCA) and integrated with adaptive filtering. It can enhance the detection of steady-state visual evoked potentials (SSVEPs) in a brain-computer interface (BCI) speller. An adaptive filter is employed in front of the CCA algorithm to improve the signal-to-noise ratio (SNR) of SSVEP signals by removing background electroencephalographic (EEG) activities. The ensemble method is developed to integrate recursive least squares (RLS) adaptive filter corresponding to multiple stimulation frequencies. The method is tested by the SSVEP signal recorded from six targets by actual experiment and the EEG in a public SSVEP dataset of 40 targets from Tsinghua University. The accuracy rates of the CCA method and the CCA-based integrated RLS filter algorithm (RLS-CCA method) are compared. Experiment results show that the proposed RLS-CCA-based method significantly improves the classification accuracy compared with the pure CCA method. Especially when the number of EEG leads is low (three occipital electrodes and five non occipital electrodes), its advantage is more significant, and accuracy reaches 91.23%, which is more suitable for wearable environments where high-density EEG is not easy to collect.

Multisensory Flicker Modulates Widespread Brain Networks and Reduces Interictal Epileptiform Discharges in Humans

Modulating brain oscillations has strong therapeutic potential. However, commonly used non-invasive interventions such as transcranial magnetic or direct current stimulation have limited effects on deeper cortical structures like the medial temporal lobe. Repetitive audio-visual stimulation, or sensory flicker, modulates such structures in mice but little is known about its effects in humans. Using high spatiotemporal resolution, we mapped and quantified the neurophysiological effects of sensory flicker in human subjects undergoing presurgical intracranial seizure monitoring. We found that flicker modulates both local field potential and single neurons in higher cognitive regions, including the medial temporal lobe and prefrontal cortex, and that local field potential modulation is likely mediated via resonance of involved circuits. We then assessed how flicker affects pathological neural activity, specifically interictal epileptiform discharges, a biomarker of epilepsy also implicated in Alzheimer's and other diseases. In our patient population with focal seizure onsets, sensory flicker decreased the rate interictal epileptiform discharges. Our findings support the use of sensory flicker to modulate deeper cortical structures and mitigate pathological activity in humans.

Minimally Invasive Local-Skull Electrophysiological Modification With Piezoelectric Drill

The research on non-invasive BCI is nowadays hitting the bottleneck due to the humble quality of scalp EEG signals. Whereas invasive solutions that offer higher signal quality in contrast are suffocated in their spreading because of the potential surgical complication and health risks caused by electrode implantation. Therefore, it puts forward a necessity to explore a scheme that could both collect high-quality EEG signals and guarantee high-level operation safety.This study proposed a Minimally Invasive Local-skull Electrophysiological Modification method to improve scalp EEG signals qualities at specific brain regions. Six eight-month-old SD rats were used for in vivo verification experiment. A hole with a diameter of about 500 micrometers was drilled in the skull above the visual cortex of rats. Significant changes in rsEEG and SSVEP signals before and after modification were observed. After modification, the skull impedance of rats decreases by about 84 %, the average maximum bandwidth of rsEEG increase by 57 %, and the broadband SNR of SSVEP is increased by 5.13 dB. The time of piezoelectric drilling operation is strictly controlled under 30 seconds for each rat to prevent possible brain damage from overheating. Compared with traditional invasive procedures such as ECoG, Minimally Invasive Local-skull Electrophysiological Modification operation time is shorter and no electrode implantation is needed while it remarkably boosts the scalp EEG signal quality. This technical solution has the potential to replace the use of ECoG in certain application scenarios and further invigorate studies in the field of scalp EEG in the future.

Phase-spatial beamforming renders a visual brain computer interface capable of exploiting EEG electrode phase shifts in motion-onset target responses

Brain-computer interfaces (BCIs) provide communication facilities that do not rely on the brains usual pathways. Visual BCIs are based on changes in EEG activity in response to attended flashing or flickering targets. A less taxing way to encode such targets is with briefly moving stimuli, the onset of which elicits a lateralized EEG potential over the parieto-occipital scalp area called the motion-onset visual evoked potential (mVEP). We recruited 21 healthy subjects for an experiment in which motion-onset stimulations translating leftwards (LT) or rightwards (RT) were encoding 9 displayed targets. We propose a novel algorithm that exploits the phase-shift between EEG electrodes to improve target decoding performance. We hereto extend the spatiotemporal beamformer (stBF) with a phase extracting procedure, leading to the phase-spatial beamformer (psBF). We show that psBF performs significantly better than the stBF (p<0.001 for 1 and 2 stimulus repetitions and p<0.01 for 3 to 5 stimulus repetitions), as well as the previously validated linear support-vector machines (p<0.001 for 5 stimulus repetitions and p<0.01 for 1,2 and 6 stimulus repetitions) and stepwise linear discriminant analysis decoders (p<0.001 for all repetitions) when simultaneously addressing timing and translation direction.

Practical real-time MEG-based neural interfacing with optically pumped magnetometers

BACKGROUND

Brain-computer interfaces decode intentions directly from the human brain with the aim to restore lost functionality, control external devices or augment daily experiences. To combine optimal performance with wide applicability, high-quality brain signals should be captured non-invasively. Magnetoencephalography (MEG) is a potent candidate but currently requires costly and confining recording hardware. The recently developed optically pumped magnetometers (OPMs) promise to overcome this limitation, but are currently untested in the context of neural interfacing.

RESULTS

In this work, we show that OPM-MEG allows robust single-trial analysis which we exploited in a real-time 'mind-spelling' application yielding an average accuracy of 97.7%.

CONCLUSIONS

This shows that OPM-MEG can be used to exploit neuro-magnetic brain responses in a practical and flexible manner, and opens up new avenues for a wide range of new neural interface applications in the future.

An Open Dataset for Wearable SSVEP-Based Brain-Computer Interfaces

Brain-computer interfaces (BCIs) provide humans a new communication channel by encoding and decoding brain activities. Steady-state visual evoked potential (SSVEP)-based BCI stands out among many BCI paradigms because of its non-invasiveness, little user training, and high information transfer rate (ITR). However, the use of conductive gel and bulky hardware in the traditional Electroencephalogram (EEG) method hinder the application of SSVEP-based BCIs. Besides, continuous visual stimulation in long time use will lead to visual fatigue and pose a new challenge to the practical application. This study provides an open dataset, which is collected based on a wearable SSVEP-based BCI system, and comprehensively compares the SSVEP data obtained by wet and dry electrodes. The dataset consists of 8-channel EEG data from 102 healthy subjects performing a 12-target SSVEP-based BCI task. For each subject, 10 consecutive blocks were recorded using wet and dry electrodes, respectively. The dataset can be used to investigate the performance of wet and dry electrodes in SSVEP-based BCIs. Besides, the dataset provides sufficient data for developing new target identification algorithms to improve the performance of wearable SSVEP-based BCIs.

High-gamma oscillations precede visual steady-state responses: A human electrocorticography study

The robust steady-state cortical activation elicited by flickering visual stimulation has been exploited by a wide range of scientific studies. As the fundamental neural response inherits the spectral properties of the gazed flickering, the paradigm has been used to chart cortical characteristics and their relation to pathologies. However, despite its widespread adoption, the underlying neural mechanisms are not well understood. Here, we show that the fundamental response is preceded by high-gamma (55-125 Hz) oscillations which are also synchronised to the gazed frequency. Using a subdural recording of the primary and associative visual cortices of one human subject, we demonstrate that the latencies of the high-gamma and fundamental components are highly correlated on a single-trial basis albeit that the latter is consistently delayed by approximately 55 ms. These results corroborate previous reports that top-down feedback projections are involved in the generation of the fundamental response, but, in addition, we show that trial-to-trial variability in fundamental latency is paralleled by a highly similar variability in high-gamma latency. Pathology- or paradigm-induced alterations in steady-state responses could thus originate either from deviating visual gamma responses or from aberrations in the neural feedback mechanism. Experiments designed to tease apart the two processes are expected to provide deeper insights into the studied paradigm.

Fast periodic visual stimulation to highlight the relationship between human intracerebral recordings and scalp electroencephalography

Despite being of primary importance for fundamental research and clinical studies, the relationship between local neural population activity and scalp electroencephalography (EEG) in humans remains largely unknown. Here we report simultaneous scalp and intracerebral EEG responses to face stimuli in a unique epileptic patient implanted with 27 intracerebral recording contacts in the right occipitotemporal cortex. The patient was shown images of faces appearing at a frequency of 6 Hz, which elicits neural responses at this exact frequency. Response quantification at this frequency allowed to objectively relate the neural activity measured inside and outside the brain. The patient exhibited typical 6 Hz responses on the scalp at the right occipitotemporal sites. Moreover, there was a clear spatial correspondence between these scalp responses and intracerebral signals in the right lateral inferior occipital gyrus, both in amplitude and in phase. Nevertheless, the signal measured on the scalp and inside the brain at nearby locations showed a 10-fold difference in amplitude due to electrical insulation from the head. To further quantify the relationship between the scalp and intracerebral recordings, we used an approach correlating time-varying signals at the stimulation frequency across scalp and intracerebral channels. This analysis revealed a focused and right-lateralized correspondence between the scalp and intracerebral recordings that were specific to the face stimulation is more broadly distributed in various control situations. These results demonstrate the interest of a frequency tagging approach in characterizing the electrical propagation from brain sources to scalp EEG sensors and in identifying the cortical sources of brain functions from these recordings.