High-performance brain-to-text communication via handwriting

Brain control of bimanual movement enabled by recurrent neural networks

Brain-computer interfaces have so far focused largely on enabling the control of a single effector, for example a single computer cursor or robotic arm. Restoring multi-effector motion could unlock greater functionality for people with paralysis (e.g., bimanual movement). However, it may prove challenging to decode the simultaneous motion of multiple effectors, as we recently found that a compositional neural code links movements across all limbs and that neural tuning changes nonlinearly during dual-effector motion. Here, we demonstrate the feasibility of high-quality bimanual control of two cursors via neural network (NN) decoders. Through simulations, we show that NNs leverage a neural 'laterality' dimension to distinguish between left and right-hand movements as neural tuning to both hands become increasingly correlated. In training recurrent neural networks (RNNs) for two-cursor control, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously. Our results suggest that neural network decoders may be advantageous for multi-effector decoding, provided they are designed to transfer to the online setting.

Beta bursts question the ruling power for brain-computer interfaces

Objective: Current efforts to build reliable brain-computer interfaces (BCI) span multiple axes from hardware, to software, to more sophisticated experimental protocols, and personalized approaches. However, despite these abundant efforts, there is still room for significant improvement. We argue that a rather overlooked direction lies in linking BCI protocols with recent advances in fundamental neuroscience.Approach: In light of these advances, and particularly the characterization of the burst-like nature of beta frequency band activity and the diversity of beta bursts, we revisit the role of beta activity in 'left vs. right hand' motor imagery (MI) tasks. Current decoding approaches for such tasks take advantage of the fact that MI generates time-locked changes in induced power in the sensorimotor cortex and rely on band-passed power changes in single or multiple channels. Although little is known about the dynamics of beta burst activity during MI, we hypothesized that beta bursts should be modulated in a way analogous to their activity during performance of real upper limb movements.Main results and Significance: We show that classification features based on patterns of beta burst modulations yield decoding results that are equivalent to or better than typically used beta power across multiple open electroencephalography datasets, thus providing insights into the specificity of these bio-markers.

Brain-computer interface paradigms and neural coding

Brain signal patterns generated in the central nervous system of brain-computer interface (BCI) users are closely related to BCI paradigms and neural coding. In BCI systems, BCI paradigms and neural coding are critical elements for BCI research. However, so far there have been few references that clearly and systematically elaborated on the definition and design principles of the BCI paradigm as well as the definition and modeling principles of BCI neural coding. Therefore, these contents are expounded and the existing main BCI paradigms and neural coding are introduced in the review. Finally, the challenges and future research directions of BCI paradigm and neural coding were discussed, including user-centered design and evaluation for BCI paradigms and neural coding, revolutionizing the traditional BCI paradigms, breaking through the existing techniques for collecting brain signals and combining BCI technology with advanced AI technology to improve brain signal decoding performance. It is expected that the review will inspire innovative research and development of the BCI paradigm and neural coding.

Decoding motor plans using a closed-loop ultrasonic brain-machine interface

Brain-machine interfaces (BMIs) enable people living with chronic paralysis to control computers, robots and more with nothing but thought. Existing BMIs have trade-offs across invasiveness, performance, spatial coverage and spatiotemporal resolution. Functional ultrasound (fUS) neuroimaging is an emerging technology that balances these attributes and may complement existing BMI recording technologies. In this study, we use fUS to demonstrate a successful implementation of a closed-loop ultrasonic BMI. We streamed fUS data from the posterior parietal cortex of two rhesus macaque monkeys while they performed eye and hand movements. After training, the monkeys controlled up to eight movement directions using the BMI. We also developed a method for pretraining the BMI using data from previous sessions. This enabled immediate control on subsequent days, even those that occurred months apart, without requiring extensive recalibration. These findings establish the feasibility of ultrasonic BMIs, paving the way for a new class of less-invasive (epidural) interfaces that generalize across extended time periods and promise to restore function to people with neurological impairments.

Dynamical flexible inference of nonlinear latent factors and structures in neural population activity

Modelling the spatiotemporal dynamics in the activity of neural populations while also enabling their flexible inference is hindered by the complexity and noisiness of neural observations. Here we show that the lower-dimensional nonlinear latent factors and latent structures can be computationally modelled in a manner that allows for flexible inference causally, non-causally and in the presence of missing neural observations. To enable flexible inference, we developed a neural network that separates the model into jointly trained manifold and dynamic latent factors such that nonlinearity is captured through the manifold factors and the dynamics can be modelled in tractable linear form on this nonlinear manifold. We show that the model, which we named 'DFINE' (for 'dynamical flexible inference for nonlinear embeddings') achieves flexible inference in simulations of nonlinear dynamics and across neural datasets representing a diversity of brain regions and behaviours. Compared with earlier neural-network models, DFINE enables flexible inference, better predicts neural activity and behaviour, and better captures the latent neural manifold structure. DFINE may advance the development of neurotechnology and investigations in neuroscience.

Electrode Development for Epilepsy Diagnosis and Treatment

Recording neural activity has been a critical aspect in the diagnosis and treatment of patients with epilepsy. For those with intractable epilepsy, intracranial neural monitoring has been of substantial importance. Clinically, however, methods for recording neural information have remained essentially unchanged for decades. Over the last decade or so, rapid advances in electrode technology have begun to change this landscape. New systems allow for the observation of neural activity with high spatial resolution and, in some cases, at the level of the activity of individual neurons. These new tools have contributed greatly to our understanding of brain function and dysfunction. Here, the authors review the primary technologies currently in use in humans. The authors discuss other possible systems, some of the challenges which come along with these devices, and how they will become incorporated into the clinical workflow. Ultimately, the expectation is that these new, high-density, high-spatial-resolution recording systems will become a valuable part of the clinical arsenal used in the diagnosis and surgical management of epilepsy.

Progress in neurorehabilitation research and the support by the National Natural Science Foundation of China from 2010 to 2022

The National Natural Science Foundation of China is one of the major funding agencies for neurorehabilitation research in China. This study reviews the frontier directions and achievements in the field of neurorehabilitation in China and worldwide. We used data from the Web of Science Core Collection (WoSCC) database to analyze the publications and data provided by the National Natural Science Foundation of China to analyze funding information. In addition, the prospects for neurorehabilitation research in China are discussed. From 2010 to 2022, a total of 74,220 publications in neurorehabilitation were identified, with there being an overall upward tendency. During this period, the National Natural Science Foundation of China has funded 476 research projects with a total funding of 192.38 million RMB to support neurorehabilitation research in China. With the support of the National Natural Science Foundation of China, China has made some achievements in neurorehabilitation research. Research related to neurorehabilitation is believed to be making steady and significant progress in China.

Advanced Electrode Technologies for Noninvasive Brain-Computer Interfaces

Brain-computer interfaces (BCIs) have garnered significant attention in recent years due to their potential applications in medical, assistive, and communication technologies. Building on this, noninvasive BCIs stand out as they provide a safe and user-friendly method for interacting with the human brain. In this work, we provide a comprehensive overview of the latest developments and advancements in material, design, and application of noninvasive BCIs electrode technology. We also explore the challenges and limitations currently faced by noninvasive BCI electrode technology and sketch out the technological roadmap from three dimensions: Materials and Design; Performances; Mode and Function. We aim to unite research efforts within the field of noninvasive BCI electrode technology, focusing on the consolidation of shared goals and fostering integrated development strategies among a diverse array of multidisciplinary researchers.

Recent Progress in Wearable Brain-Computer Interface (BCI) Devices Based on Electroencephalogram (EEG) for Medical Applications: A Review

Importance: Brain-computer interface (BCI) decodes and converts brain signals into machine instructions to interoperate with the external world. However, limited by the implantation risks of invasive BCIs and the operational complexity of conventional noninvasive BCIs, applications of BCIs are mainly used in laboratory or clinical environments, which are not conducive to the daily use of BCI devices. With the increasing demand for intelligent medical care, the development of wearable BCI systems is necessary. Highlights: Based on the scalp-electroencephalogram (EEG), forehead-EEG, and ear-EEG, the state-of-the-art wearable BCI devices for disease management and patient assistance are reviewed. This paper focuses on the EEG acquisition equipment of the novel wearable BCI devices and summarizes the development direction of wearable EEG-based BCI devices. Conclusions: BCI devices play an essential role in the medical field. This review briefly summarizes novel wearable EEG-based BCIs applied in the medical field and the latest progress in related technologies, emphasizing its potential to help doctors, patients, and caregivers better understand and utilize BCI devices.

Biohybrid neural interfaces: improving the biological integration of neural implants

Implantable neural interfaces (NIs) have emerged in the clinic as outstanding tools for the management of a variety of neurological conditions caused by trauma or disease. However, the foreign body reaction triggered upon implantation remains one of the major challenges hindering the safety and longevity of NIs. The integration of tools and principles from biomaterial design and tissue engineering has been investigated as a promising strategy to develop NIs with enhanced functionality and performance. In this Feature Article, we highlight the main bioengineering approaches for the development of biohybrid NIs with an emphasis on relevant device design criteria. Technical and scientific challenges associated with the fabrication and functional assessment of technologies composed of both artificial and biological components are discussed. Lastly, we provide future perspectives related to engineering, regulatory, and neuroethical challenges to be addressed towards the realisation of the promise of biohybrid neurotechnology.

Group-level brain decoding with deep learning

Decoding brain imaging data are gaining popularity, with applications in brain-computer interfaces and the study of neural representations. Decoding is typically subject-specific and does not generalise well over subjects, due to high amounts of between subject variability. Techniques that overcome this will not only provide richer neuroscientific insights but also make it possible for group-level models to outperform subject-specific models. Here, we propose a method that uses subject embedding, analogous to word embedding in natural language processing, to learn and exploit the structure in between-subject variability as part of a decoding model, our adaptation of the WaveNet architecture for classification. We apply this to magnetoencephalography data, where 15 subjects viewed 118 different images, with 30 examples per image; to classify images using the entire 1 s window following image presentation. We show that the combination of deep learning and subject embedding is crucial to closing the performance gap between subject- and group-level decoding models. Importantly, group models outperform subject models on low-accuracy subjects (although slightly impair high-accuracy subjects) and can be helpful for initialising subject models. While we have not generally found group-level models to perform better than subject-level models, the performance of group modelling is expected to be even higher with bigger datasets. In order to provide physiological interpretation at the group level, we make use of permutation feature importance. This provides insights into the spatiotemporal and spectral information encoded in the models. All code is available on GitHub (https://github.com/ricsinaruto/MEG-group-decode).

Plug-and-Play Stability for Intracortical Brain-Computer Interfaces: A One-Year Demonstration of Seamless Brain-to-Text Communication

Intracortical brain-computer interfaces (iBCIs) have shown promise for restoring rapid communication to people with neurological disorders such as amyotrophic lateral sclerosis (ALS). However, to maintain high performance over time, iBCIs typically need frequent recalibration to combat changes in the neural recordings that accrue over days. This requires iBCI users to stop using the iBCI and engage in supervised data collection, making the iBCI system hard to use. In this paper, we propose a method that enables self-recalibration of communication iBCIs without interrupting the user. Our method leverages large language models (LMs) to automatically correct errors in iBCI outputs. The self-recalibration process uses these corrected outputs ("pseudo-labels") to continually update the iBCI decoder online. Over a period of more than one year (403 days), we evaluated our Continual Online Recalibration with Pseudo-labels (CORP) framework with one clinical trial participant. CORP achieved a stable decoding accuracy of 93.84% in an online handwriting iBCI task, significantly outperforming other baseline methods. Notably, this is the longest-running iBCI stability demonstration involving a human participant. Our results provide the first evidence for long-term stabilization of a plug-and-play, high-performance communication iBCI, addressing a major barrier for the clinical translation of iBCIs.

Stable Decoding from a Speech BCI Enables Control for an Individual with ALS without Recalibration for 3 Months

Brain-computer interfaces (BCIs) can be used to control assistive devices by patients with neurological disorders like amyotrophic lateral sclerosis (ALS) that limit speech and movement. For assistive control, it is desirable for BCI systems to be accurate and reliable, preferably with minimal setup time. In this study, a participant with severe dysarthria due to ALS operates computer applications with six intuitive speech commands via a chronic electrocorticographic (ECoG) implant over the ventral sensorimotor cortex. Speech commands are accurately detected and decoded (median accuracy: 90.59%) throughout a 3-month study period without model retraining or recalibration. Use of the BCI does not require exogenous timing cues, enabling the participant to issue self-paced commands at will. These results demonstrate that a chronically implanted ECoG-based speech BCI can reliably control assistive devices over long time periods with only initial model training and calibration, supporting the feasibility of unassisted home use.

The effect of a Mn(III)tetrakis(4-benzoic acid)porphyrin (MnTBAP) coating on the chronic recording performance of planar silicon intracortical microelectrode arrays

Intracortical microelectrode arrays (MEAs) are used to record neural activity. However, their implantation initiates a neuroinflammatory cascade, involving the accumulation of reactive oxygen species, leading to interface failure. Here, we coated commercially-available MEAs with Mn(III)tetrakis(4-benzoic acid)porphyrin (MnTBAP), to mitigate oxidative stress. First, we assessed the in vitro cytotoxicity of modified sample substrates. Then, we implanted 36 rats with uncoated, MnTBAP-coated ("Coated"), or (3-Aminopropyl)triethoxysilane (APTES)-coated devices - an intermediate step in the coating process. We assessed electrode performance during the acute (1-5 weeks), sub-chronic (6-11 weeks), and chronic (12-16 weeks) phases after implantation. Three subsets of animals were euthanized at different time points to assess the acute, sub-chronic and chronic immunohistological responses. Results showed that MnTBAP coatings were not cytotoxic in vitro, and their implantation in vivo improved the proportion of electrodes during the sub-chronic and chronic phases; APTES coatings resulted in failure of the neural interface during the chronic phase. In addition, MnTBAP coatings improved the quality of the signal throughout the study and reduced the neuroinflammatory response around the implant as early as two weeks, an effect that remained consistent for months post-implantation. Together, these results suggest that MnTBAP coatings are a potentially useful modification to improve MEA reliability.

The role of distinct ECoG frequency features in decoding finger movement

Objective.To identify the electrocorticography (ECoG) frequency features that encode distinct finger movement states during repeated finger flexions.Approach.We used the publicly available Stanford ECoG dataset of cue-based, repeated single finger flexions. Using linear regression, we identified the spectral features that contributed most to the encoding of movement dynamics and discriminating movement events from rest, and combined them to predict finger movement trajectories. Furthermore, we also looked into the effect of the used frequency range and the spatial distribution of the identified features.Main results.Two frequency features generate superior performance, each one for a different movement aspect: high gamma band activity distinguishes movement events from rest, whereas the local motor potential (LMP) codes for movement dynamics. Combining these two features in a finger movement decoder outperformed comparable prior work where the entire spectrum was used as the average correlation coefficient with the true trajectories increased from 0.45 to 0.5, both applied to the Stanford dataset, and erroneous predictions during rest were demoted. In addition, for the first time, our results show the influence of the upper cut-off frequency used to extract LMP, yielding a higher performance when this range is adjusted to the finger movement rate.Significance.This study shows the benefit of a detailed feature analysis prior to designing the finger movement decoder.

Boosting brain-computer interfaces with functional electrical stimulation: potential applications in people with locked-in syndrome

Individuals with a locked-in state live with severe whole-body paralysis that limits their ability to communicate with family and loved ones. Recent advances in brain-computer interface (BCI) technology have presented a potential alternative for these people to communicate by detecting neural activity associated with attempted hand or speech movements and translating the decoded intended movements to a control signal for a computer. A technique that could potentially enrich the communication capacity of BCIs is functional electrical stimulation (FES) of paralyzed limbs and face to restore body and facial movements of paralyzed individuals, allowing to add body language and facial expression to communication BCI utterances. Here, we review the current state of the art of existing BCI and FES work in people with paralysis of body and face and propose that a combined BCI-FES approach, which has already proved successful in several applications in stroke and spinal cord injury, can provide a novel promising mode of communication for locked-in individuals.

Low-invasive neural recording in mouse models with diabetes via an ultrasmall needle-electrode

Diabetes is known to cause a variety of complications, having a high correlation with Alzheimer's disease. Electrophysiological recording using a microscale needle electrode is a promising technology for the study, however, diabetic brain tissue is more difficult to record neuronal activities than normal tissue due to these complications including the development of cerebrovascular disease. Here we show an electrophysiological methodology for diabetic db/db mice (+Leprdb/+Leprdb) using a 4-μm-tip diameter needle-electrode device. The needle electrode minimized the tissue injury when compared to a typical larger metal electrode, as confirmed by bleeding during penetration. The proposed electrode device showed both acute and chronic in vivo recording capabilities for diabetic mice while reducing the glial cells' responses. Because of these device characteristics, the 4-μm-tip diameter needle-electrode will allow electrophysiological studies on diabetes models of not only mice, as proven in this study, but also other animals.

Decoding the Spike-Band Subthreshold Motor Cortical Activity

Intracortical Brain-Computer Interfaces (iBCI) use single-unit activity (SUA), multiunit activity (MUA) and local field potentials (LFP) to control neuroprosthetic devices. SUA and MUA are usually extracted from the bandpassed recording through amplitude thresholding, while subthreshold data are ignored. Here, we show that subthreshold data can actually be decoded to determine behavioral variables with test set accuracy of up to 100%. Although the utility of SUA, MUA and LFP for decoding behavioral variables has been explored previously, this study investigates the utility of spike-band subthreshold activity exclusively. We provide evidence suggesting that this activity can be used to keep decoding performance at acceptable levels even when SUA quality is reduced over time. To the best of our knowledge, the signals that we derive from the subthreshold activity may be the weakest neural signals that have ever been extracted from extracellular neural recordings, while still being decodable with test set accuracy of up to 100%. These results are relevant for the development of fully data-driven and automated methods for amplitude thresholding spike-band extracellular neural recordings in iBCIs containing thousands of electrodes.

The neural basis of mental navigation in rats

A brain-machine interface demonstrates volitional control of hippocampal activity.

Volitional activation of remote place representations with a hippocampal brain-machine interface

The hippocampus is critical for recollecting and imagining experiences. This is believed to involve voluntarily drawing from hippocampal memory representations of people, events, and places, including maplike representations of familiar environments. However, whether representations in such "cognitive maps" can be volitionally accessed is unknown. We developed a brain-machine interface to test whether rats can do so by controlling their hippocampal activity in a flexible, goal-directed, and model-based manner. We found that rats can efficiently navigate or direct objects to arbitrary goal locations within a virtual reality arena solely by activating and sustaining appropriate hippocampal representations of remote places. This provides insight into the mechanisms underlying episodic memory recall, mental simulation and planning, and imagination and opens up possibilities for high-level neural prosthetics that use hippocampal representations.

From monkeys to humans: observation-basedEMGbrain-computer interface decoders for humans with paralysis

Objective. Intracortical brain-computer interfaces (iBCIs) aim to enable individuals with paralysis to control the movement of virtual limbs and robotic arms. Because patients' paralysis prevents training a direct neural activity to limb movement decoder, most iBCIs rely on 'observation-based' decoding in which the patient watches a moving cursor while mentally envisioning making the movement. However, this reliance on observed target motion for decoder development precludes its application to the prediction of unobservable motor output like muscle activity. Here, we ask whether recordings of muscle activity from a surrogate individual performing the same movement as the iBCI patient can be used as target for an iBCI decoder.Approach. We test two possible approaches, each using data from a human iBCI user and a monkey, both performing similar motor actions. In one approach, we trained a decoder to predict the electromyographic (EMG) activity of a monkey from neural signals recorded from a human. We then contrast this to a second approach, based on the hypothesis that the low-dimensional 'latent' neural representations of motor behavior, known to be preserved across time for a given behavior, might also be preserved across individuals. We 'transferred' an EMG decoder trained solely on monkey data to the human iBCI user after using Canonical Correlation Analysis to align the human latent signals to those of the monkey.Main results. We found that both direct and transfer decoding approaches allowed accurate EMG predictions between two monkeys and from a monkey to a human.Significance. Our findings suggest that these latent representations of behavior are consistent across animals and even primate species. These methods are an important initial step in the development of iBCI decoders that generate EMG predictions that could serve as signals for a biomimetic decoder controlling motion and impedance of a prosthetic arm, or even muscle force directly through functional electrical stimulation.

An Ultraflexible Electrode Array for Large-Scale Chronic Recording in the Nonhuman Primate Brain

Single-unit (SU) recording in nonhuman primates (NHPs) is indispensible in the quest of how the brain works, yet electrodes currently used for the NHP brain are limited in signal longevity, stability, and spatial coverage. Using new structural materials, microfabrication, and penetration techniques, we develop a mechanically robust ultraflexible, 1 µm thin electrode array (MERF) that enables pial penetration and high-density, large-scale, and chronic recording of neurons along both vertical and horizontal cortical axes in the nonhuman primate brain. Recording from three monkeys yields 2,913 SUs from 1,065 functional recording channels (up to 240 days), with some SUs tracked for up to 2 months. Recording from the primary visual cortex (V1) reveals that neurons with similar orientation preferences for visual stimuli exhibited higher spike correlation. Furthermore, simultaneously recorded neurons in different cortical layers of the primary motor cortex (M1) show preferential firing for hand movements of different directions. Finally, it is shown that a linear decoder trained with neuronal spiking activity across M1 layers during monkey's hand movements can be used to achieve on-line control of cursor movement. Thus, the MERF electrode array offers a new tool for basic neuroscience studies and brain-machine interface (BMI) applications in the primate brain.

Flexible Electrodes for Brain-Computer Interface System

Brain-computer interface (BCI) has been the subject of extensive research recently. Governments and companies have substantially invested in relevant research and applications. The restoration of communication and motor function, the treatment of psychological disorders, gaming, and other daily and therapeutic applications all benefit from BCI. The electrodes hold the key to the essential, fundamental BCI precondition of electrical brain activity detection and delivery. However, the traditional rigid electrodes are limited due to their mismatch in Young's modulus, potential damages to the human body, and a decline in signal quality with time. These factors make the development of flexible electrodes vital and urgent. Flexible electrodes made of soft materials have grown in popularity in recent years as an alternative to conventional rigid electrodes because they offer greater conformance, the potential for higher signal-to-noise ratio (SNR) signals, and a wider range of applications. Therefore, the latest classifications and future developmental directions of fabricating these flexible electrodes are explored in this paper to further encourage the speedy advent of flexible electrodes for BCI. In summary, the perspectives and future outlook for this developing discipline are provided.

Advancing the interfacing performances of chronically implantable neural probes in the era of CMOS neuroelectronics

Tissue penetrating microelectrode neural probes can record electrophysiological brain signals at resolutions down to single neurons, making them invaluable tools for neuroscience research and Brain-Computer-Interfaces (BCIs). The known gradual decrease of their electrical interfacing performances in chronic settings, however, remains a major challenge. A key factor leading to such decay is Foreign Body Reaction (FBR), which is the cascade of biological responses that occurs in the brain in the presence of a tissue damaging artificial device. Interestingly, the recent adoption of Complementary Metal Oxide Semiconductor (CMOS) technology to realize implantable neural probes capable of monitoring hundreds to thousands of neurons simultaneously, may open new opportunities to face the FBR challenge. Indeed, this shift from passive Micro Electro-Mechanical Systems (MEMS) to active CMOS neural probe technologies creates important, yet unexplored, opportunities to tune probe features such as the mechanical properties of the probe, its layout, size, and surface physicochemical properties, to minimize tissue damage and consequently FBR. Here, we will first review relevant literature on FBR to provide a better understanding of the processes and sources underlying this tissue response. Methods to assess FBR will be described, including conventional approaches based on the imaging of biomarkers, and more recent transcriptomics technologies. Then, we will consider emerging opportunities offered by the features of CMOS probes. Finally, we will describe a prototypical neural probe that may meet the needs for advancing clinical BCIs, and we propose axial insertion force as a potential metric to assess the influence of probe features on acute tissue damage and to control the implantation procedure to minimize iatrogenic injury and subsequent FBR.

Recommendations for promoting user agency in the design of speech neuroprostheses

Brain-computer interfaces (BCI) that directly decode speech from brain activity aim to restore communication in people with paralysis who cannot speak. Despite recent advances, neural inference of speech remains imperfect, limiting the ability for speech BCIs to enable experiences such as fluent conversation that promote agency - that is, the ability for users to author and transmit messages enacting their intentions. Here, we make recommendations for promoting agency based on existing and emerging strategies in neural engineering. The focus is on achieving fast, accurate, and reliable performance while ensuring volitional control over when a decoder is engaged, what exactly is decoded, and how messages are expressed. Additionally, alongside neuroscientific progress within controlled experimental settings, we argue that a parallel line of research must consider how to translate experimental successes into real-world environments. While such research will ultimately require input from prospective users, here we identify and describe design choices inspired by human-factors work conducted in existing fields of assistive technology, which address practical issues likely to emerge in future real-world speech BCI applications.

Audio-induced medial prefrontal cortical dynamics enhances coadaptive learning in brain-machine interfaces

Objectives. Coadaptive brain-machine interfaces (BMIs) allow subjects and external devices to adapt to each other during the closed-loop control, which provides a promising solution for paralyzed individuals. Previous studies have focused on either improving sensory feedback to facilitate subject learning or developing adaptive algorithms to maintain stable decoder performance. In this work, we aim to design an efficient coadaptive BMI framework which not only facilitates the learning of subjects on new tasks with designed sensory feedback, but also improves decoders' learning ability by extracting sensory feedback-induced evaluation information.Approach. We designed dynamic audio feedback during the trial according to the subjects' performance when they were trained to learn a new behavioral task. We compared the learning performance of two groups of Sprague Dawley rats, one with and the other without the designed audio feedback to show whether this audio feedback could facilitate the subjects' learning. Compared with the traditional closed-loop in BMI systems, an additional closed-loop involving medial prefrontal cortex (mPFC) activity was introduced into the coadaptive framework. The neural dynamics of audio-induced mPFC activity was analyzed to investigate whether a significant neural response could be triggered. This audio-induced response was then translated into reward expectation information to guide the learning of decoders on a new task. The multiday decoding performance of the decoders with and without audio-induced reward expectation was compared to investigate whether the extracted information could accelerate decoders to learn a new task.Main results. The behavior performance comparison showed that the average days for rats to achieve 80% well-trained behavioral performance was improved by 26.4% after introducing the designed audio feedback sequence. The analysis of neural dynamics showed that a significant neural response of mPFC activity could be elicited by the audio feedback and the visualization of audio-induced neural patterns was emerged and accompanied by the behavioral improvement of subjects. The multiday decoding performance comparison showed that the decoder taking the reward expectation information could achieve faster task learning by 33.8% on average across subjects.Significance. This study demonstrates that the designed audio feedback could improve the learning of subjects and the mPFC activity induced by audio feedback can be utilized to improve the decoder's learning efficiency on new tasks. The coadaptive framework involving mPFC dynamics in the closed-loop interaction can advance the BMIs into a more adaptive and efficient system with learning ability on new tasks.

Aligning Semantic in Brain and Language: A Curriculum Contrastive Method for Electroencephalography-to-Text Generation

Electroencephalography-to-Text generation (EEG-to-Text), which aims to directly generate natural text from EEG signals has drawn increasing attention in recent years due to the enormous potential for Brain-computer interfaces. However, the remarkable discrepancy between the subject-dependent EEG representation and the semantic-dependent text representation poses a great challenge to this task. To mitigate this, we devise a Curriculum Semantic-aware Contrastive Learning strategy (C- SCL), which effectively recalibrates the subject-dependent EEG representation to the semantic-dependent EEG representation, thereby reducing the discrepancy. Specifically, our C- SCL pulls semantically similar EEG representations together while pushing apart dissimilar ones. Besides, in order to introduce more meaningful contrastive pairs, we carefully employ curriculum learning to not only craft meaningful contrastive pairs but also make the learning progressively. We conduct extensive experiments on the ZuCo benchmark and our method combined with diverse models and architectures shows stable improvements across three types of metrics while achieving the new state-of-the-art. Further investigation proves not only its superiority in both the single-subject and low-resource settings but also its robust generalizability in the zero-shot setting. Our codes are available at: https://github.com/xcfcode/contrastive_eeg2text.

Multifunctional fibers enable modulation of cortical and deep brain activity during cognitive behavior in macaques

Recording and modulating neural activity in vivo enables investigations of the neurophysiology underlying behavior and disease. However, there is a dearth of translational tools for simultaneous recording and localized receptor-specific modulation. We address this limitation by translating multifunctional fiber neurotechnology previously only available for rodent studies to enable cortical and subcortical neural recording and modulation in macaques. We record single-neuron and broader oscillatory activity during intracranial GABA infusions in the premotor cortex and putamen. By applying state-space models to characterize changes in electrophysiology, we uncover that neural activity evoked by a working memory task is reshaped by even a modest local inhibition. The recordings provide detailed insight into the electrophysiological effect of neurotransmitter receptor modulation in both cortical and subcortical structures in an awake macaque. Our results demonstrate a first-time application of multifunctional fibers for causal studies of neuronal activity in behaving nonhuman primates and pave the way for clinical translation of fiber-based neurotechnology.

Differential expression of genes involved in the chronic response to intracortical microelectrodes

Brain-Machine Interface systems (BMIs) are clinically valuable devices that can provide functional restoration for patients with spinal cord injury or improved integration for patients requiring prostheses. Intracortical microelectrodes can record neuronal action potentials at a resolution necessary for precisely controlling BMIs. However, intracortical microelectrodes have a demonstrated history of progressive decline in the recording performance with time, inhibiting their usefulness. One major contributor to decreased performance is the neuroinflammatory response to the implanted microelectrodes. The neuroinflammatory response can lead to neurodegeneration and the formation of a glial scar at the implant site. Historically, histological imaging of relatively few known cellular and protein markers has characterized the neuroinflammatory response to implanted microelectrode arrays. However, neuroinflammation requires many molecular players to coordinate the response - meaning traditional methods could result in an incomplete understanding. Taking advantage of recent advancements in tools to characterize the relative or absolute DNA/RNA expression levels, a few groups have begun to explore gene expression at the microelectrode-tissue interface. We have utilized a custom panel of ∼813 neuroinflammatory-specific genes developed with NanoString for bulk tissue analysis at the microelectrode-tissue interface. Our previous studies characterized the acute innate immune response to intracortical microelectrodes. Here we investigated the gene expression at the microelectrode-tissue interface in wild-type (WT) mice chronically implanted with nonfunctioning probes. We found 28 differentially expressed genes at chronic time points (4WK, 8WK, and 16WK), many in the complement and extracellular matrix system. Further, the expression levels were relatively stable over time. Genes identified here represent chronic molecular players at the microelectrode implant sites and potential therapeutic targets for the long-term integration of microelectrodes. STATEMENT OF SIGNIFICANCE: Intracortical microelectrodes can record neuronal action potentials at a resolution necessary for the precise control of Brain-Machine Interface systems (BMIs). However, intracortical microelectrodes have a demonstrated history of progressive declines in the recording performance with time, inhibiting their usefulness. One major contributor to the decline in these devices is the neuroinflammatory response against the implanted microelectrodes. Historically, neuroinflammation to implanted microelectrode arrays has been characterized by histological imaging of relatively few known cellular and protein markers. Few studies have begun to develop a more in-depth understanding of the molecular pathways facilitating device-mediated neuroinflammation. Here, we are among the first to identify genetic pathways that could represent targets to improve the host response to intracortical microelectrodes, and ultimately device performance.

Advocating for neurodata privacy and neurotechnology regulation

The ability to record and alter brain activity by using implantable and nonimplantable neural devices, while poised to have significant scientific and clinical benefits, also raises complex ethical concerns. In this Perspective, we raise awareness of the ability of artificial intelligence algorithms and data-aggregation tools to decode and analyze data containing highly sensitive information, jeopardizing personal neuroprivacy. Voids in existing regulatory frameworks, in fact, allow unrestricted decoding and commerce of neurodata. We advocate for the implementation of proposed ethical and human rights guidelines, alongside technical options such as data encryption, differential privacy and federated learning to ensure the protection of neurodata privacy. We further encourage regulatory bodies to consider taking a position of responsibility by categorizing all brain-derived data as sensitive health data and apply existing medical regulations to all data gathered via pre-registered neural devices. Lastly, we propose that a technocratic oath may instill a deontology for neurotechnology practitioners akin to what the Hippocratic oath represents in medicine. A conscientious societal position that thoroughly rejects the misuse of neurodata would provide the moral compass for the future development of the neurotechnology field.

Toward metacognition: subject-aware contrastive deep fusion representation learning for EEG analysis

We propose a subject-aware contrastive learning deep fusion neural network framework for effectively classifying subjects' confidence levels in the perception of visual stimuli. The framework, called WaveFusion, is composed of lightweight convolutional neural networks for per-lead time-frequency analysis and an attention network for integrating the lightweight modalities for final prediction. To facilitate the training of WaveFusion, we incorporate a subject-aware contrastive learning approach by taking advantage of the heterogeneity within a multi-subject electroencephalogram dataset to boost representation learning and classification accuracy. The WaveFusion framework demonstrates high accuracy in classifying confidence levels by achieving a classification accuracy of 95.7% while also identifying influential brain regions.

A click-based electrocorticographic brain-computer interface enables long-term high-performance switch-scan spelling

Background

Brain-computer interfaces (BCIs) can restore communication in movement- and/or speech-impaired individuals by enabling neural control of computer typing applications. Single command "click" decoders provide a basic yet highly functional capability.

Methods

We sought to test the performance and long-term stability of click-decoding using a chronically implanted high density electrocorticographic (ECoG) BCI with coverage of the sensorimotor cortex in a human clinical trial participant (ClinicalTrials.gov, NCT03567213) with amyotrophic lateral sclerosis (ALS). We trained the participant's click decoder using a small amount of training data (< 44 minutes across four days) collected up to 21 days prior to BCI use, and then tested it over a period of 90 days without any retraining or updating.

Results

Using this click decoder to navigate a switch-scanning spelling interface, the study participant was able to maintain a median spelling rate of 10.2 characters per min. Though a transient reduction in signal power modulation interrupted testing with this fixed model, a new click decoder achieved comparable performance despite being trained with even less data (< 15 min, within one day).

Conclusion

These results demonstrate that a click decoder can be trained with a small ECoG dataset while retaining robust performance for extended periods, providing functional text-based communication to BCI users.

Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking Activity

The neural population spiking activity recorded by intracortical brain-computer interfaces (iBCIs) contain rich structure. Current models of such spiking activity are largely prepared for individual experimental contexts, restricting data volume to that collectable within a single session and limiting the effectiveness of deep neural networks (DNNs). The purported challenge in aggregating neural spiking data is the pervasiveness of context-dependent shifts in the neural data distributions. However, large scale unsupervised pretraining by nature spans heterogeneous data, and has proven to be a fundamental recipe for successful representation learning across deep learning. We thus develop Neural Data Transformer 2 (NDT2), a spatiotemporal Transformer for neural spiking activity, and demonstrate that pretraining can leverage motor BCI datasets that span sessions, subjects, and experimental tasks. NDT2 enables rapid adaptation to novel contexts in downstream decoding tasks and opens the path to deployment of pretrained DNNs for iBCI control. Code: https://github.com/joel99/context_general_bci.

Wireless agents for brain recording and stimulation modalities

New sensors and modulators that interact wirelessly with medical modalities unlock uncharted avenues for in situ brain recording and stimulation. Ongoing miniaturization, material refinement, and sensitization to specific neurophysiological and neurochemical processes are spurring new capabilities that begin to transcend the constraints of traditional bulky and invasive wired probes. Here we survey current state-of-the-art agents across diverse realms of operation and evaluate possibilities depending on size, delivery, specificity and spatiotemporal resolution. We begin by describing implantable and injectable micro- and nano-scale electronic devices operating at or below the radio frequency (RF) regime with simple near field transmission, and continue with more sophisticated devices, nanoparticles and biochemical molecular conjugates acting as dynamic contrast agents in magnetic resonance imaging (MRI), ultrasound (US) transduction and other functional tomographic modalities. We assess the ability of some of these technologies to deliver stimulation and neuromodulation with emerging probes and materials that provide minimally invasive magnetic, electrical, thermal and optogenetic stimulation. These methodologies are transforming the repertoire of readily available technologies paired with compatible imaging systems and hold promise toward broadening the expanse of neurological and neuroscientific diagnostics and therapeutics.

Direct speech reconstruction from sensorimotor brain activity with optimized deep learning models

Objective.Development of brain-computer interface (BCI) technology is key for enabling communication in individuals who have lost the faculty of speech due to severe motor paralysis. A BCI control strategy that is gaining attention employs speech decoding from neural data. Recent studies have shown that a combination of direct neural recordings and advanced computational models can provide promising results. Understanding which decoding strategies deliver best and directly applicable results is crucial for advancing the field.Approach.In this paper, we optimized and validated a decoding approach based on speech reconstruction directly from high-density electrocorticography recordings from sensorimotor cortex during a speech production task.Main results.We show that (1) dedicated machine learning optimization of reconstruction models is key for achieving the best reconstruction performance; (2) individual word decoding in reconstructed speech achieves 92%-100% accuracy (chance level is 8%); (3) direct reconstruction from sensorimotor brain activity produces intelligible speech.Significance.These results underline the need for model optimization in achieving best speech decoding results and highlight the potential that reconstruction-based speech decoding from sensorimotor cortex can offer for development of next-generation BCI technology for communication.

Invasive neurophysiology and whole brain connectomics for neural decoding in patients with brain implants

Brain computer interfaces (BCI) provide unprecedented spatiotemporal precision that will enable significant expansion in how numerous brain disorders are treated. Decoding dynamic patient states from brain signals with machine learning is required to leverage this precision, but a standardized framework for identifying and advancing novel clinical BCI approaches does not exist. Here, we developed a platform that integrates brain signal decoding with connectomics and demonstrate its utility across 123 hours of invasively recorded brain data from 73 neurosurgical patients treated for movement disorders, depression and epilepsy. First, we introduce connectomics-informed movement decoders that generalize across cohorts with Parkinson's disease and epilepsy from the US, Europe and China. Next, we reveal network targets for emotion decoding in left prefrontal and cingulate circuits in DBS patients with major depression. Finally, we showcase opportunities to improve seizure detection in responsive neurostimulation for epilepsy. Our platform provides rapid, high-accuracy decoding for precision medicine approaches that can dynamically adapt neuromodulation therapies in response to the individual needs of patients.

Decoding Depression Severity From Intracranial Neural Activity

BACKGROUND

Disorders of mood and cognition are prevalent, disabling, and notoriously difficult to treat. Fueling this challenge in treatment is a significant gap in our understanding of their neurophysiological basis.

METHODS

We recorded high-density neural activity from intracranial electrodes implanted in depression-relevant prefrontal cortical regions in 3 human subjects with severe depression. Neural recordings were labeled with depression severity scores across a wide dynamic range using an adaptive assessment that allowed sampling with a temporal frequency greater than that possible with typical rating scales. We modeled these data using regularized regression techniques with region selection to decode depression severity from the prefrontal recordings.

RESULTS

Across prefrontal regions, we found that reduced depression severity is associated with decreased low-frequency neural activity and increased high-frequency activity. When constraining our model to decode using a single region, spectral changes in the anterior cingulate cortex best predicted depression severity in all 3 subjects. Relaxing this constraint revealed unique, individual-specific sets of spatiospectral features predictive of symptom severity, reflecting the heterogeneous nature of depression.

CONCLUSIONS

The ability to decode depression severity from neural activity increases our fundamental understanding of how depression manifests in the human brain and provides a target neural signature for personalized neuromodulation therapies.

Recent progress and challenges in the treatment of spinal cord injury

Spinal cord injury (SCI) disrupts the structural and functional connectivity between the higher center and the spinal cord, resulting in severe motor, sensory, and autonomic dysfunction with a variety of complications. The pathophysiology of SCI is complicated and multifaceted, and thus individual treatments acting on a specific aspect or process are inadequate to elicit neuronal regeneration and functional recovery after SCI. Combinatory strategies targeting multiple aspects of SCI pathology have achieved greater beneficial effects than individual therapy alone. Although many problems and challenges remain, the encouraging outcomes that have been achieved in preclinical models offer a promising foothold for the development of novel clinical strategies to treat SCI. In this review, we characterize the mechanisms underlying axon regeneration of adult neurons and summarize recent advances in facilitating functional recovery following SCI at both the acute and chronic stages. In addition, we analyze the current status, remaining problems, and realistic challenges towards clinical translation. Finally, we consider the future of SCI treatment and provide insights into how to narrow the translational gap that currently exists between preclinical studies and clinical practice. Going forward, clinical trials should emphasize multidisciplinary conversation and cooperation to identify optimal combinatorial approaches to maximize therapeutic benefit in humans with SCI.

Expressive dynamics models with nonlinear injective readouts enable reliable recovery of latent features from neural activity

The advent of large-scale neural recordings has enabled new approaches that aim to discover the computational mechanisms of neural circuits by understanding the rules that govern how their state evolves over time. While these neural dynamics cannot be directly measured, they can typically be approximated by low-dimensional models in a latent space. How these models represent the mapping from latent space to neural space can affect the interpretability of the latent representation. We show that typical choices for this mapping (e.g., linear or MLP) often lack the property of injectivity, meaning that changes in latent state are not obligated to affect activity in the neural space. During training, non-injective readouts incentivize the invention of dynamics that misrepresent the underlying system and the computation it performs. Combining our injective Flow readout with prior work on interpretable latent dynamics models, we created the Ordinary Differential equations autoencoder with Injective Nonlinear readout (ODIN), which learns to capture latent dynamical systems that are nonlinearly embedded into observed neural activity via an approximately injective nonlinear mapping. We show that ODIN can recover nonlinearly embedded systems from simulated neural activity, even when the nature of the system and embedding are unknown. Additionally, we show that ODIN enables the unsupervised recovery of underlying dynamical features (e.g., fixed points) and embedding geometry. When applied to biological neural recordings, ODIN can reconstruct neural activity with comparable accuracy to previous state-of-the-art methods while using substantially fewer latent dimensions. Overall, ODIN's accuracy in recovering ground-truth latent features and ability to accurately reconstruct neural activity with low dimensionality make it a promising method for distilling interpretable dynamics that can help explain neural computation.

A Real-Time Non-Implantation Bi-Directional Brain-Computer Interface Solution Without Stimulation Artifacts

The non-implantation bi-directional brain-computer interface (BCI) is a neural interface technology that enables direct two-way communication between the brain and the external world by both "reading" neural signals and "writing" stimulation patterns to the brain. This technology has vast potential applications, such as improving the quality of life for individuals with neurological and mental illnesses and even expanding the boundaries of human capabilities. Nonetheless, non-implantation bi-directional BCIs face challenges in generating real-time feedback and achieving compatibility between stimulation and recording. These issues arise due to the considerable overlap between electrical stimulation frequencies and electrophysiological recording frequencies, as well as the impediment caused by the skull to the interaction of external and internal currents. To address those challenges, this work proposes a novel solution that combines the temporal interference stimulation paradigm and minimally invasive skull modification. A longitudinal animal experiment has preliminarily validated the feasibility of the proposed method. In signal recording experiments, the average impedance of our scheme decreased by 4.59 kΩ , about 67%, compared to the conventional technique at 18 points. The peak-to-peak value of the Somatosensory Evoked Potential increased by 8%. Meanwhile, the signal-to-noise ratio of Steady-State Visual Evoked Potential increased by 5.13 dB, and its classification accuracy increased by 44%. The maximum bandwidth of the resting state rose by 63%. In electrical stimulation experiments, the signal-to-noise ratio of the low-frequency response evoked by our scheme rose by 8.04 dB, and no stimulation artifacts were generated. The experimental results show that signal quality in acquisition has significantly improved, and frequency-band isolation eliminates stimulation artifacts at the source. The acquisition and stimulation pathways are real-time compatible in this non-implantation bi-directional BCI solution, which can provide technical support and theoretical guidance for creating closed-loop adaptive systems coupled with particular application scenarios in the future.

Transcranial Focused Ultrasound to V5 Enhances Human Visual Motion Brain-Computer Interface by Modulating Feature-Based Attention

Paralysis affects roughly 1 in 50 Americans. While there is no cure for the condition, brain-computer interfaces (BCI) can allow users to control a device with their mind, bypassing the paralyzed region. Non-invasive BCIs still have high error rates, which is hypothesized to be reduced with concurrent targeted neuromodulation. This study examines whether transcranial focused ultrasound (tFUS) modulation can improve BCI outcomes, and what the underlying mechanism of action might be through high-density electroencephalography (EEG)-based source imaging (ESI) analyses. V5-targeted tFUS significantly reduced the error for the BCI speller task. ESI analyses showed significantly increased theta activity in the tFUS condition at both V5 and downstream the dorsal visual processing pathway. Correlation analysis indicates that the dorsal processing pathway connection was preserved during tFUS stimulation, whereas extraneous connections were severed. These results suggest that V5-targeted tFUS' mechanism of action is to raise the brain's feature-based attention to visual motion.

A Calibration-Free Hybrid BCI Speller System Based on High-Frequency SSVEP and sEMG

Hybrid brain-computer interface (hBCI) systems that combine steady-state visual evoked potential (SSVEP) and surface electromyography (sEMG) signals have attracted attention of researchers due to the advantage of exhibiting significantly improved system performance. However, almost all existing studies adopt low-frequency SSVEP to build hBCI. It produces much more visual fatigue than high-frequency SSVEP. Therefore, the current study attempts to build a hBCI based on high-frequency SSVEP and sEMG. With these two signals, this study designed and realized a 32-target hBCI speller system. Thirty-two targets were separated from the middle into two groups. Each side contained 16 sets of targets with different high-frequency visual stimuli (i.e., 31-34.75 Hz with an interval of 0.25 Hz). sEMG was utilized to choose the group and SSVEP was adopted to identify intra-group targets. The filter bank canonical correlation analysis (FBCCA) and the root mean square value (RMS) methods were used to identify signals. Therefore, the proposed system allowed users to operate it without system calibration. A total of 12 healthy subjects participated in online experiment, with an average accuracy of 93.52 ± 1.66% and the average information transfer rate (ITR) reached 93.50 ± 3.10 bits/min. Furthermore, 12 participants perfectly completed the free-spelling tasks. These results of the experiments indicated feasibility and practicality of the proposed hybrid BCI speller system.

Using adversarial networks to extend brain computer interface decoding accuracy over time

Existing intracortical brain computer interfaces (iBCIs) transform neural activity into control signals capable of restoring movement to persons with paralysis. However, the accuracy of the 'decoder' at the heart of the iBCI typically degrades over time due to turnover of recorded neurons. To compensate, decoders can be recalibrated, but this requires the user to spend extra time and effort to provide the necessary data, then learn the new dynamics. As the recorded neurons change, one can think of the underlying movement intent signal being expressed in changing coordinates. If a mapping can be computed between the different coordinate systems, it may be possible to stabilize the original decoder's mapping from brain to behavior without recalibration. We previously proposed a method based on Generalized Adversarial Networks (GANs), called 'Adversarial Domain Adaptation Network' (ADAN), which aligns the distributions of latent signals within underlying low-dimensional neural manifolds. However, we tested ADAN on only a very limited dataset. Here we propose a method based on Cycle-Consistent Adversarial Networks (Cycle-GAN), which aligns the distributions of the full-dimensional neural recordings. We tested both Cycle-GAN and ADAN on data from multiple monkeys and behaviors and compared them to a third, quite different method based on Procrustes alignment of axes provided by Factor Analysis. All three methods are unsupervised and require little data, making them practical in real life. Overall, Cycle-GAN had the best performance and was easier to train and more robust than ADAN, making it ideal for stabilizing iBCI systems over time.

Decision Aids in the ICU: a scoping review

OBJECTIVE

The purpose of this scoping review was to synthesise the effectiveness and acceptability of decision aids for critically ill patients and family members in the intensive care unit (ICU).

METHODS

A systematic search of four electronic databases and grey literature was undertaken to identify relevant studies on the application of decision aids in the ICU, without publication date restriction, through March 2023. The methodological framework proposed by Arksey and O'Malley was used to guide the scoping review.

RESULTS

Fourteen papers were ultimately included in this review. However, only nine decision aids were available, and it is noteworthy that many of these studies focused on the iterative development and testing of individual decision aids. Among the included studies, 92% (n=13) were developed in North America, with a primary focus on goals of care and life-sustaining treatments. The summary of the effect of decision aid application revealed that the most common indicators were the level of knowledge and code status, and some promising signals disappeared in randomised trials.

CONCLUSIONS

The complexity of treatment decisions in the ICU exceeds the current capabilities of existing decision aids. There is a clear gap in decision aids that are tailored to different cultural contexts, highlighting the need to expand the scope of their application. In addition, rigorous quality control is very important for randomised controlled trial, and indicators for assessing the effectiveness of decision aids need to be further clarified.

A magnetoencephalography dataset during three-dimensional reaching movements for brain-computer interfaces

Studying the motor-control mechanisms of the brain is critical in academia and also has practical implications because techniques such as brain-computer interfaces (BCIs) can be developed based on brain mechanisms. Magnetoencephalography (MEG) signals have the highest spatial resolution (~3 mm) and temporal resolution (~1 ms) among the non-invasive methods. Therefore, the MEG is an excellent modality for investigating brain mechanisms. However, publicly available MEG data remains scarce due to expensive MEG equipment, requiring a magnetically shielded room, and high maintenance costs for the helium gas supply. In this study, we share the 306-channel MEG and 3-axis accelerometer signals acquired during three-dimensional reaching movements. Additionally, we provide analysis results and MATLAB codes for time-frequency analysis, F-value time-frequency analysis, and topography analysis. These shared MEG datasets offer valuable resources for investigating brain activities or evaluating the accuracy of prediction algorithms. To the best of our knowledge, this data is the only publicly available MEG data measured during reaching movements.

The Emergence of Functional Ultrasound for Noninvasive Brain-Computer Interface

A noninvasive brain-computer interface is a central task in the comprehensive analysis and understanding of the brain and is an important challenge in international brain-science research. Current implanted brain-computer interfaces are cranial and invasive, which considerably limits their applications. The development of new noninvasive reading and writing technologies will advance substantial innovations and breakthroughs in the field of brain-computer interfaces. Here, we review the theory and development of the ultrasound brain functional imaging and its applications. Furthermore, we introduce latest advancements in ultrasound brain modulation and its applications in rodents, primates, and human; its mechanism and closed-loop ultrasound neuromodulation based on electroencephalograph are also presented. Finally, high-frequency acoustic noninvasive brain-computer interface is prospected based on ultrasound super-resolution imaging and acoustic tweezers.

Flexible regulation of representations on a drifting manifold enables long-term stable complex neuroprosthetic control

The nervous system needs to balance the stability of neural representations with plasticity. It is unclear what is the representational stability of simple actions, particularly those that are well-rehearsed in humans, and how it changes in new contexts. Using an electrocorticography brain-computer interface (BCI), we found that the mesoscale manifold and relative representational distances for a repertoire of simple imagined movements were remarkably stable. Interestingly, however, the manifold's absolute location demonstrated day-to-day drift. Strikingly, representational statistics, especially variance, could be flexibly regulated to increase discernability during BCI control without somatotopic changes. Discernability strengthened with practice and was specific to the BCI, demonstrating remarkable contextual specificity. Accounting for drift, and leveraging the flexibility of representations, allowed neuroprosthetic control of a robotic arm and hand for over 7 months without recalibration. Our study offers insight into how electrocorticography can both track representational statistics across long periods and allow long-term complex neuroprosthetic control.

BRAND: A platform for closed-loop experiments with deep network models

Artificial neural networks (ANNs) are state-of-the-art tools for modeling and decoding neural activity, but deploying them in closed-loop experiments with tight timing constraints is challenging due to their limited support in existing real-time frameworks. Researchers need a platform that fully supports high-level languages for running ANNs (e.g., Python and Julia) while maintaining support for languages that are critical for low-latency data acquisition and processing (e.g., C and C++). To address these needs, we introduce the Backend for Realtime Asynchronous Neural Decoding (BRAND). BRAND comprises Linux processes, termed nodes , which communicate with each other in a graph via streams of data. Its asynchronous design allows for acquisition, control, and analysis to be executed in parallel on streams of data that may operate at different timescales. BRAND uses Redis to send data between nodes, which enables fast inter-process communication and supports 54 different programming languages. Thus, developers can easily deploy existing ANN models in BRAND with minimal implementation changes. In our tests, BRAND achieved <600 microsecond latency between processes when sending large quantities of data (1024 channels of 30 kHz neural data in 1-millisecond chunks). BRAND runs a brain-computer interface with a recurrent neural network (RNN) decoder with less than 8 milliseconds of latency from neural data input to decoder prediction. In a real-world demonstration of the system, participant T11 in the BrainGate2 clinical trial performed a standard cursor control task, in which 30 kHz signal processing, RNN decoding, task control, and graphics were all executed in BRAND. This system also supports real-time inference with complex latent variable models like Latent Factor Analysis via Dynamical Systems. By providing a framework that is fast, modular, and language-agnostic, BRAND lowers the barriers to integrating the latest tools in neuroscience and machine learning into closed-loop experiments.

Brain-computer interface: trend, challenges, and threats

Brain-computer interface (BCI), an emerging technology that facilitates communication between brain and computer, has attracted a great deal of research in recent years. Researchers provide experimental results demonstrating that BCI can restore the capabilities of physically challenged people, hence improving the quality of their lives. BCI has revolutionized and positively impacted several industries, including entertainment and gaming, automation and control, education, neuromarketing, and neuroergonomics. Notwithstanding its broad range of applications, the global trend of BCI remains lightly discussed in the literature. Understanding the trend may inform researchers and practitioners on the direction of the field, and on where they should invest their efforts more. Noting this significance, we have analyzed 25,336 metadata of BCI publications from Scopus to determine advancement of the field. The analysis shows an exponential growth of BCI publications in China from 2019 onwards, exceeding those from the United States that started to decline during the same period. Implications and reasons for this trend are discussed. Furthermore, we have extensively discussed challenges and threats limiting exploitation of BCI capabilities. A typical BCI architecture is hypothesized to address two prominent BCI threats, privacy and security, as an attempt to make the technology commercially viable to the society.