Cortical control of a prosthetic arm for self-feeding

Recent advances in neurotechnology-based biohybrid robots

Biohybrid robots retain the innate biological characteristics and behavioral traits of animals, making them valuable in applications such as disaster relief, exploration of unknown terrains, and medical care. This review aims to comprehensively discuss the evolution of biohybrid robots, their key technologies and applications, and the challenges they face. By analyzing studies conducted on terrestrial, aquatic, and aerial biohybrid robots, we gain a deeper understanding of how these technologies have made significant progress in simulating natural organisms, improving mechanical performance, and intelligent control. Additionally, we address challenges associated with the application of electrical stimulation technology, the precision of neural signal monitoring, and the ethical considerations for biohybrid robots. We highlight the importance of future research focusing on developing more sophisticated and biocompatible control methods while prioritizing animal welfare. We believe that exploring multimodal monitoring and stimulation technologies holds the potential to enhance the performance of biohybrid robots. These efforts are expected to pave the way for biohybrid robotics technology to introduce greater innovation and well-being to human society in the future.

Quantifying physical degradation alongside recording and stimulation performance of 980 intracortical microelectrodes chronically implanted in three humans for 956-2246 days

Motivation

The clinical success of brain-machine interfaces depends on overcoming both biological and material challenges to ensure a long-term stable connection for neural recording and stimulation. Therefore, there is a need to quantify any damage that microelectrodes sustain when they are chronically implanted in the human cortex.

Methods

Using scanning electron microscopy (SEM), we imaged 980 microelectrodes from Neuroport arrays chronically implanted in the cortex of three people with tetraplegia for 956-2246 days. We analyzed eleven multi-electrode arrays in total: eight arrays with platinum (Pt) electrode tips and three with sputtered iridium oxide tips (SIROF); one Pt array was left in sterile packaging, serving as a control. The arrays were implanted/explanted across three different clinical sites surgeries (Caltech/UCLA, Caltech/USC and APL/Johns Hopkins) in the anterior intraparietal area, Brodmann's area 5, motor cortex, and somatosensory cortex.Human experts rated the electron micrographs of electrodes with respect to five damage metrics: the loss of metal at the electrode tip, the amount of separation between the silicon shank and tip metal, tissue adherence or bio-material to the electrode, damage to the shank insulation and silicone shaft. These metrics were compared to functional outcomes (recording quality, noise, impedance and stimulation ability).

Results

Despite higher levels of physical degradation, SIROF electrodes were twice as likely to record neural activity than Pt electrodes (measured by SNR), at the time of explant. Additionally, 1 kHz impedance (measured in vivo prior to explant) significantly correlated with all physical damage metrics, recording, and stimulation performance for SIROF electrodes (but not Pt), suggesting a reliable measurement of in vivo degradation.We observed a new degradation type, primarily occurring on stimulated electrodes ("pockmarked" vs "cracked") electrodes; however, tip metalization damage was not significantly higher due to stimulation or amount of charge. Physical damage was centralized to specific regions of an array often with differences between outer and inner electrodes. This is consistent with degradation due to contact with the biologic milieu, influenced by variations in initial manufactured state. From our data, we hypothesize that erosion of the silicon shank often precedes damage to the tip metal, accelerating damage to the electrode / tissue interface.

Conclusions

These findings link quantitative measurements, such as impedance, to the physical condition of the microelectrodes and their capacity to record and stimulate. These data could lead to improved manufacturing or novel electrode designs to improve long-term performance of BMIs making them are vitally important as multi-year clinical trials of BMIs are becoming more common.

Brain-Computer Interface for Patients with Spinal Cord Injury: A Bibliometric Study

BACKGROUND

Spinal cord injury (SCI) is a debilitating condition with profound implications on patients' quality of life. Recent advancements in brain-computer interface (BCI) technology have provided novel opportunities for individuals with paralysis due to SCI. Consequently, research on the application of BCI for treating SCI has received increasing attention from scholars worldwide. However, there is a lack of rigorous bibliometric studies on the evolution and trends in this field. Hence, the present study aimed to use bibliometric methods to investigate the current status and emerging trends in the field of applying BCI for treating SCI and thus identify novel therapeutic options for SCI.

METHODS

We conducted a comprehensive review of the relevant literature on BCI applications for treating SCI published between 2005 and 2024 by using the Web of Science Core Collection database. To facilitate visualization and quantitative analysis of the published literature, we used VOSviewer and CiteSpace software tools. These tools enabled the assessment of co-authorships, co-occurrences, citations, and co-citations in the selected literature, thereby providing an overview of the current trends and predictive insights into the field.

RESULTS

The literature search yielded 714 publications from the Web of Science Core Collection database. The findings indicated a significant upward trend in the number of publications, yielding a total of 24,804 citations, with an average citation rate of 34.74 per publication and an H-index of 75. Research contributions were identified from 54 countries/regions, and the United States, China, and Germany emerged as the predominant contributors. A total of 1114 research institutions contributed to the retrieved literature, with Harvard Medical School, Brown University, and Northwestern University producing the highest number of publications. The published literature was predominantly distributed across 258 academic journals, and the Journal of Neural Engineering was the most frequently utilized publication source. Hochberg, Leigh, Henderson, Jaimie, and Collinger were the prominent authors in this field.

CONCLUSIONS

In recent years, there has been a steep increase in research on the use of BCI for treating SCI. Existing research focuses on the application of BCI for improving rehabilitation and quality of life of patients with SCI. Interdisciplinary collaboration is the current trend in this field.

Multimodal Technologies for Closed-Loop Neural Modulation and Sensing

Existing methods for studying neural circuits and treating neurological disorders are typically based on physical and chemical cues to manipulate and record neural activities. These approaches often involve predefined, rigid, and unchangeable signal patterns, which cannot be adjusted in real time according to the patient's condition or neural activities. With the continuous development of neural interfaces, conducting in vivo research on adaptive and modifiable treatments for neurological diseases and neural circuits is now possible. In this review, current and potential integration of various modalities to achieve precise, closed-loop modulation, and sensing in neural systems are summarized. Advanced materials, devices, or systems that generate or detect electrical, magnetic, optical, acoustic, or chemical signals are highlighted and utilized to interact with neural cells, tissues, and networks for closed-loop interrogation. Further, the significance of developing closed-loop techniques for diagnostics and treatment of neurological disorders such as epilepsy, depression, rehabilitation of spinal cord injury patients, and exploration of brain neural circuit functionality is elaborated.

Motor somatotopy impacts imagery strategy success in human intracortical brain-computer interfaces

The notion of a somatotopically organized motor cortex, with movements of different body parts being controlled by spatially distinct areas of cortex, is well known. However, recent studies have challenged this notion and suggested a more distributed representation of movement control. This shift in perspective has significant implications, particularly when considering the implantation location of electrode arrays for intracortical brain-computer interfaces (iBCIs). We sought to evaluate whether the location of neural recordings from the precentral gyrus, and thus the underlying somatotopy, has any impact on the imagery strategies that can enable successful iBCI control. Three individuals with a spinal cord injury were enrolled in an ongoing clinical trial of an iBCI. Participants had two intracortical microelectrode arrays implanted in the arm and/or hand areas of the precentral gyrus based on presurgical functional imaging. Neural data were recorded while participants attempted to perform movements of the hand, wrist, elbow, and shoulder. We found that electrode arrays that were located more medially recorded significantly more activity during attempted proximal arm movements (elbow, shoulder) than did lateral arrays, which captured more activity related to attempted distal arm movements (hand, wrist). We also evaluated the relative contribution from the two arrays implanted in each participant to decoding accuracy during calibration of an iBCI decoder for translation and grasping tasks. For both task types, imagery strategy (e.g., reaching vs. wrist movements) had a significant impact on the relative contributions of each array to decoding. Overall, we found some evidence of broad tuning to arm and hand movements; however, there was a clear bias in the amount of information accessible about each movement type in spatially distinct areas of cortex. These results demonstrate that classical concepts of somatotopy can have real consequences for iBCI use, and highlight the importance of considering somatotopy when planning iBCI implantation.

Planar amorphous silicon carbide microelectrode arrays for chronic recording in rat motor cortex

Chronic implantation of intracortical microelectrode arrays (MEAs) capable of recording from individual neurons can be used for the development of brain-machine interfaces. However, these devices show reduced recording capabilities under chronic conditions due, at least in part, to the brain's foreign body response (FBR). This creates a need for MEAs that can minimize the FBR to possibly enable long-term recording. A potential approach to reduce the FBR is the use of MEAs with reduced cross-sectional geometries. Here, we fabricated 4-shank amorphous silicon carbide (a-SiC) MEAs and implanted them into the motor cortex of seven female Sprague-Dawley rats. Each a-SiC MEA shank was 8 μm thick by 20 μm wide and had sixteen sputtered iridium oxide film (SIROF) electrodes (4 per shank). A-SiC was chosen as the fabrication base for its high chemical stability, good electrical insulation properties, and amenability to thin film fabrication. Electrochemical analysis and neural recordings were performed weekly for 4 months. MEAs were characterized pre-implantation in buffered saline and in vivo using electrochemical impedance spectroscopy and cyclic voltammetry at 50 mV/s and 50,000 mV/s. Neural recordings were analyzed for single unit activity. At the end of the study, animals were sacrificed for immunohistochemical analysis. We observed statistically significant, but small, increases in 1 and 30 kHz impedance values and 50,000 mV/s charge storage capacity over the 16-week implantation period. Slow sweep 50 mV/s CV and 1 Hz impedance did not significantly change over time. Impedance values increased from 11.6 MΩ to 13.5 MΩ at 1 Hz, 1.2 MΩ-2.9 MΩ at 1 kHz, and 0.11 MΩ-0.13 MΩ at 30 kHz over 16 weeks. The median charge storage capacity of the implanted electrodes at 50 mV/s was 58.1 mC/cm2 on week 1 and 55.9 mC/cm2 on week 16, and at 50,000 mV/s, 4.27 mC/cm2 on week 1 and 5.93 mC/cm2 on week 16. Devices were able to record neural activity from 92% of all active channels at the beginning of the study, At the study endpoint, a-SiC devices were still recording single-unit activity on 51% of electrochemically active electrode channels. In addition, we observed that the signal-to-noise ratio experienced a small decline of -0.19 per week. We also classified observed units as fast and slow repolarizing based on the trough-to-peak time. Although the overall presence of single units declined, fast and slow repolarizing units declined at a similar rate. At recording electrode depth, immunohistochemistry showed minimal tissue response to the a-SiC devices, as indicated by statistically insignificant differences in activated glial cell response between implanted brains slices and contralateral sham slices at 150 μm away from the implant location, as evidenced by GFAP staining. NeuN staining revealed the presence of neuronal cell bodies close to the implantation site, again statistically not different from a contralateral sham slice. These results warrant further investigation of a-SiC MEAs for future long-term implantation neural recording studies.

Advances in conductive hydrogels for neural recording and stimulation

The brain-computer interface (BCI) allows the human or animal brain to directly interact with the external environment through the neural interfaces, thus playing the role of monitoring, protecting, improving/restoring, enhancing, and replacing. Recording electrophysiological information such as brain neural signals is of great importance in health monitoring and disease diagnosis. According to the electrode position, it can be divided into non-implantable, semi-implantable, and implantable. Among them, implantable neural electrodes can obtain the highest-quality electrophysiological information, so they have the most promising application. However, due to the chemo-mechanical mismatch between devices and tissues, the adverse foreign body response and performance loss over time seriously restrict the development and application of implantable neural electrodes. Given the challenges, conductive hydrogel-based neural electrodes have recently attracted much attention, owing to many advantages such as good mechanical match with the native tissues, negligible foreign body response, and minimal signal attenuation. This review mainly focuses on the current development of conductive hydrogels as a biocompatible framework for neural tissue and conductivity-supporting substrates for the transmission of electrical signals of neural tissue to speed up electrical regeneration and their applications in neural sensing and recording as well as stimulation.

Decoding Subject-Driven Cognitive States from EEG Signals for Cognitive Brain-Computer Interface

In this study, we investigated the feasibility of using electroencephalogram (EEG) signals to differentiate between four distinct subject-driven cognitive states: resting state, narrative memory, music, and subtraction tasks. EEG data were collected from seven healthy male participants while performing these cognitive tasks, and the raw EEG signals were transformed into time-frequency maps using continuous wavelet transform. Based on these time-frequency maps, we developed a convolutional neural network model (TF-CNN-CFA) with a channel and frequency attention mechanism to automatically distinguish between these cognitive states. The experimental results demonstrated that the model achieved an average classification accuracy of 76.14% in identifying these four cognitive states, significantly outperforming traditional EEG signal processing methods and other classical image classification algorithms. Furthermore, we investigated the impact of varying lengths of EEG signals on classification performance and found that TF-CNN-CFA demonstrates consistent performance across different window lengths, indicating its strong generalization capability. This study validates the ability of EEG to differentiate higher cognitive states, which could potentially offer a novel BCI paradigm.

Machine learning decoding of single neurons in the thalamus for speech brain-machine interfaces

Objective. Our goal is to decode firing patterns of single neurons in the left ventralis intermediate nucleus (Vim) of the thalamus, related to speech production, perception, and imagery. For realistic speech brain-machine interfaces (BMIs), we aim to characterize the amount of thalamic neurons necessary for high accuracy decoding.Approach. We intraoperatively recorded single neuron activity in the left Vim of eight neurosurgical patients undergoing implantation of deep brain stimulator or RF lesioning during production, perception and imagery of the five monophthongal vowel sounds. We utilized the Spade decoder, a machine learning algorithm that dynamically learns specific features of firing patterns and is based on sparse decomposition of the high dimensional feature space.Main results. Spade outperformed all algorithms compared with, for all three aspects of speech: production, perception and imagery, and obtained accuracies of 100%, 96%, and 92%, respectively (chance level: 20%) based on pooling together neurons across all patients. The accuracy was logarithmic in the amount of neurons for all three aspects of speech. Regardless of the amount of units employed, production gained highest accuracies, whereas perception and imagery equated with each other.Significance. Our research renders single neuron activity in the left Vim a promising source of inputs to BMIs for restoration of speech faculties for locked-in patients or patients with anarthria or dysarthria to allow them to communicate again. Our characterization of how many neurons are necessary to achieve a certain decoding accuracy is of utmost importance for planning BMI implantation.

A theory of brain-computer interface learning via low-dimensional control

A remarkable demonstration of the flexibility of mammalian motor systems is primates' ability to learn to control brain-computer interfaces (BCIs). This constitutes a completely novel motor behavior, yet primates are capable of learning to control BCIs under a wide range of conditions. BCIs with carefully calibrated decoders, for example, can be learned with only minutes to hours of practice. With a few weeks of practice, even BCIs with randomly constructed decoders can be learned. What are the biological substrates of this learning process? Here, we develop a theory based on a re-aiming strategy, whereby learning operates within a low-dimensional subspace of task-relevant inputs driving the local population of recorded neurons. Through comprehensive numerical and formal analysis, we demonstrate that this theory can provide a unifying explanation for disparate phenomena previously reported in three different BCI learning tasks, and we derive a novel experimental prediction that we verify with previously published data. By explicitly modeling the underlying neural circuitry, the theory reveals an interpretation of these phenomena in terms of biological constraints on neural activity.

Brain control of bimanual movement enabled by recurrent neural networks

Brain-computer interfaces have so far focused largely on enabling the control of a single effector, for example a single computer cursor or robotic arm. Restoring multi-effector motion could unlock greater functionality for people with paralysis (e.g., bimanual movement). However, it may prove challenging to decode the simultaneous motion of multiple effectors, as we recently found that a compositional neural code links movements across all limbs and that neural tuning changes nonlinearly during dual-effector motion. Here, we demonstrate the feasibility of high-quality bimanual control of two cursors via neural network (NN) decoders. Through simulations, we show that NNs leverage a neural 'laterality' dimension to distinguish between left and right-hand movements as neural tuning to both hands become increasingly correlated. In training recurrent neural networks (RNNs) for two-cursor control, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously. Our results suggest that neural network decoders may be advantageous for multi-effector decoding, provided they are designed to transfer to the online setting.

Rhesus monkeys learn to control a directional-key inspired brain machine interface via bio-feedback

Brain machine interfaces (BMI) connect brains directly to the outside world, bypassing natural neural systems and actuators. Neuronal-activity-to-motion transformation algorithms allow applications such as control of prosthetics or computer cursors. These algorithms lie within a spectrum between bio-mimetic control and bio-feedback control. The bio-mimetic approach relies on increasingly complex algorithms to decode neural activity by mimicking the natural neural system and actuator relationship while focusing on machine learning: the supervised fitting of decoder parameters. On the other hand, the bio-feedback approach uses simple algorithms and relies primarily on user learning, which may take some time, but can facilitate control of novel, non-biological appendages. An increasing amount of work has focused on the arguably more successful bio-mimetic approach. However, as chronic recordings have become more accessible and utilization of novel appendages such as computer cursors have become more universal, users can more easily spend time learning in a bio-feedback control paradigm. We believe a simple approach which leverages user learning and few assumptions will provide users with good control ability. To test the feasibility of this idea, we implemented a simple firing-rate-to-motion correspondence rule, assigned groups of neurons to virtual "directional keys" for control of a 2D cursor. Though not strictly required, to facilitate initial control, we selected neurons with similar preferred directions for each group. The groups of neurons were kept the same across multiple recording sessions to allow learning. Two Rhesus monkeys used this BMI to perform a center-out cursor movement task. After about a week of training, monkeys performed the task better and neuronal signal patterns changed on a group basis, indicating learning. While our experiments did not compare this bio-feedback BMI to bio-mimetic BMIs, the results demonstrate the feasibility of our control paradigm and paves the way for further research in multi-dimensional bio-feedback BMIs.

Boosting brain-computer interfaces with functional electrical stimulation: potential applications in people with locked-in syndrome

Individuals with a locked-in state live with severe whole-body paralysis that limits their ability to communicate with family and loved ones. Recent advances in brain-computer interface (BCI) technology have presented a potential alternative for these people to communicate by detecting neural activity associated with attempted hand or speech movements and translating the decoded intended movements to a control signal for a computer. A technique that could potentially enrich the communication capacity of BCIs is functional electrical stimulation (FES) of paralyzed limbs and face to restore body and facial movements of paralyzed individuals, allowing to add body language and facial expression to communication BCI utterances. Here, we review the current state of the art of existing BCI and FES work in people with paralysis of body and face and propose that a combined BCI-FES approach, which has already proved successful in several applications in stroke and spinal cord injury, can provide a novel promising mode of communication for locked-in individuals.

Decoding the Spike-Band Subthreshold Motor Cortical Activity

Intracortical Brain-Computer Interfaces (iBCI) use single-unit activity (SUA), multiunit activity (MUA) and local field potentials (LFP) to control neuroprosthetic devices. SUA and MUA are usually extracted from the bandpassed recording through amplitude thresholding, while subthreshold data are ignored. Here, we show that subthreshold data can actually be decoded to determine behavioral variables with test set accuracy of up to 100%. Although the utility of SUA, MUA and LFP for decoding behavioral variables has been explored previously, this study investigates the utility of spike-band subthreshold activity exclusively. We provide evidence suggesting that this activity can be used to keep decoding performance at acceptable levels even when SUA quality is reduced over time. To the best of our knowledge, the signals that we derive from the subthreshold activity may be the weakest neural signals that have ever been extracted from extracellular neural recordings, while still being decodable with test set accuracy of up to 100%. These results are relevant for the development of fully data-driven and automated methods for amplitude thresholding spike-band extracellular neural recordings in iBCIs containing thousands of electrodes.

Volitional activation of remote place representations with a hippocampal brain-machine interface

The hippocampus is critical for recollecting and imagining experiences. This is believed to involve voluntarily drawing from hippocampal memory representations of people, events, and places, including maplike representations of familiar environments. However, whether representations in such "cognitive maps" can be volitionally accessed is unknown. We developed a brain-machine interface to test whether rats can do so by controlling their hippocampal activity in a flexible, goal-directed, and model-based manner. We found that rats can efficiently navigate or direct objects to arbitrary goal locations within a virtual reality arena solely by activating and sustaining appropriate hippocampal representations of remote places. This provides insight into the mechanisms underlying episodic memory recall, mental simulation and planning, and imagination and opens up possibilities for high-level neural prosthetics that use hippocampal representations.

An Ultraflexible Electrode Array for Large-Scale Chronic Recording in the Nonhuman Primate Brain

Single-unit (SU) recording in nonhuman primates (NHPs) is indispensible in the quest of how the brain works, yet electrodes currently used for the NHP brain are limited in signal longevity, stability, and spatial coverage. Using new structural materials, microfabrication, and penetration techniques, we develop a mechanically robust ultraflexible, 1 µm thin electrode array (MERF) that enables pial penetration and high-density, large-scale, and chronic recording of neurons along both vertical and horizontal cortical axes in the nonhuman primate brain. Recording from three monkeys yields 2,913 SUs from 1,065 functional recording channels (up to 240 days), with some SUs tracked for up to 2 months. Recording from the primary visual cortex (V1) reveals that neurons with similar orientation preferences for visual stimuli exhibited higher spike correlation. Furthermore, simultaneously recorded neurons in different cortical layers of the primary motor cortex (M1) show preferential firing for hand movements of different directions. Finally, it is shown that a linear decoder trained with neuronal spiking activity across M1 layers during monkey's hand movements can be used to achieve on-line control of cursor movement. Thus, the MERF electrode array offers a new tool for basic neuroscience studies and brain-machine interface (BMI) applications in the primate brain.

Advancing the interfacing performances of chronically implantable neural probes in the era of CMOS neuroelectronics

Tissue penetrating microelectrode neural probes can record electrophysiological brain signals at resolutions down to single neurons, making them invaluable tools for neuroscience research and Brain-Computer-Interfaces (BCIs). The known gradual decrease of their electrical interfacing performances in chronic settings, however, remains a major challenge. A key factor leading to such decay is Foreign Body Reaction (FBR), which is the cascade of biological responses that occurs in the brain in the presence of a tissue damaging artificial device. Interestingly, the recent adoption of Complementary Metal Oxide Semiconductor (CMOS) technology to realize implantable neural probes capable of monitoring hundreds to thousands of neurons simultaneously, may open new opportunities to face the FBR challenge. Indeed, this shift from passive Micro Electro-Mechanical Systems (MEMS) to active CMOS neural probe technologies creates important, yet unexplored, opportunities to tune probe features such as the mechanical properties of the probe, its layout, size, and surface physicochemical properties, to minimize tissue damage and consequently FBR. Here, we will first review relevant literature on FBR to provide a better understanding of the processes and sources underlying this tissue response. Methods to assess FBR will be described, including conventional approaches based on the imaging of biomarkers, and more recent transcriptomics technologies. Then, we will consider emerging opportunities offered by the features of CMOS probes. Finally, we will describe a prototypical neural probe that may meet the needs for advancing clinical BCIs, and we propose axial insertion force as a potential metric to assess the influence of probe features on acute tissue damage and to control the implantation procedure to minimize iatrogenic injury and subsequent FBR.

Enhancing Prediction of Forelimb Movement Trajectory through a Calibrating-Feedback Paradigm Incorporating RAT Primary Motor and Agranular Cortical Ensemble Activity in the Goal-Directed Reaching Task

Complete reaching movements involve target sensing, motor planning, and arm movement execution, and this process requires the integration and communication of various brain regions. Previously, reaching movements have been decoded successfully from the motor cortex (M1) and applied to prosthetic control. However, most studies attempted to decode neural activities from a single brain region, resulting in reduced decoding accuracy during visually guided reaching motions. To enhance the decoding accuracy of visually guided forelimb reaching movements, we propose a parallel computing neural network using both M1 and medial agranular cortex (AGm) neural activities of rats to predict forelimb-reaching movements. The proposed network decodes M1 neural activities into the primary components of the forelimb movement and decodes AGm neural activities into internal feedforward information to calibrate the forelimb movement in a goal-reaching movement. We demonstrate that using AGm neural activity to calibrate M1 predicted forelimb movement can improve decoding performance significantly compared to neural decoders without calibration. We also show that the M1 and AGm neural activities contribute to controlling forelimb movement during goal-reaching movements, and we report an increase in the power of the local field potential (LFP) in beta and gamma bands over AGm in response to a change in the target distance, which may involve sensorimotor transformation and communication between the visual cortex and AGm when preparing for an upcoming reaching movement. The proposed parallel computing neural network with the internal feedback model improves prediction accuracy for goal-reaching movements.

Reconfigurable Soft Pneumatic Actuators Using Extensible Fabric-Based Skins

The development of the field of soft robotics has led to the exploration of novel techniques to manufacture soft actuators, which provide distinct advantages for wearable assistive robotics. One subset of these soft pneumatic actuators is conventionally developed from silicone, fabrics, and thermoplastic polyurethane (TPU). Each of these materials in isolation possesses limitations of low-stress capacity, low-design complexity, and high-input pressure requirements, respectively. Combining these materials can overcome some limitations and maintain their desirable properties. In this article, we explore one such composite design scheme using a combination of silicone polymer-based bladder and reconfigurable fabric skin made from an anisotropic extensible fabric. The silicone polymer bladder acts as the hermetic seal, while this skin acts as the constraint. Bending and torsional actuators were designed utilizing the anisotropy of these fabrics. The torsional actuator designs can achieve over 540° of twist, significantly larger than previously reported in the literature, owing to the lower mechanical impedance of the extensible fabrics. Actuators with 360° of bending were also fabricated using this method. In addition, the lack of TPU-backed or inextensible fabrics reduces the actuator's stiffness, leading to lower actuation pressures. Skin-based designs also confer the advantage of modularity, reconfigurability, and the ability to achieve complex motions by tuning the properties of the bladder and the skin. For applications with high-force requirements, such as wearable exoskeletons, we demonstrate the utility of multilayer design schemes. A multilayer bending actuator generated 190 N of force at 100 kPa and was shown to be a candidate for wearable assistive devices. In addition, torsional designs were shown to have utility in practical scenarios such as screwing on a bottle cap and turning knobs. Thus, we present a novel fabric-skin-based design concept that is highly versatile and customizable for various application requirements.

Shared Three-Dimensional Robotic Arm Control Based on Asynchronous BCI and Computer Vision

OBJECTIVE

A brain-computer interface (BCI) can be used to translate neuronal activity into commands to control external devices. However, using noninvasive BCI to control a robotic arm for movements in three-dimensional (3D) environments and accomplish complicated daily tasks, such as grasping and drinking, remains a challenge.

APPROACH

In this study, a shared robotic arm control system based on hybrid asynchronous BCI and computer vision was presented. The BCI model, which combines steady-state visual evoked potentials (SSVEPs) and blink-related electrooculography (EOG) signals, allows users to freely choose from fifteen commands in an asynchronous mode corresponding to robot actions in a 3D workspace and reach targets with a wide movement range, while computer vision can identify objects and assist a robotic arm in completing more precise tasks, such as grasping a target automatically.

RESULTS

Ten subjects participated in the experiments and achieved an average accuracy of more than 92% and a high trajectory efficiency for robot movement. All subjects were able to perform the reach-grasp-drink tasks successfully using the proposed shared control method, with fewer error commands and shorter completion time than with direct BCI control.

SIGNIFICANCE

Our results demonstrated the feasibility and efficiency of generating practical multidimensional control of an intuitive robotic arm by merging hybrid asynchronous BCI and computer vision-based recognition.

Flexible multichannel electrodes for acute recording in nonhuman primates

Flexible electrodes have demonstrated better biocompatibility than rigid electrodes in relieving tissue encapsulation and long-term recording. Nonhuman primates are closer to humans in their brains' structural and functional properties, thus making them more suitable than rodents as animal models for potential clinical usage. However, the application of flexible electrodes on nonhuman primates has rarely been reported. In the present study, a flexible multichannel electrode array for nonhuman primates was developed and implemented for extracellular recording in behaving monkeys. To minimize the window of durotomy for reducing possible risks, a guide-tube-compatible implantation solution was designed to deliver the flexible electrodes through the dura into the cortex. The proposed structure for inserting flexible electrodes was characterized ex vivo and validated in vivo. Furthermore, acute recording of multichannel flexible electrodes for the primates was performed. The results showed that the flexible electrodes and implantation method used in this study meet the needs of extracellular recording in nonhuman primates. Task-related neuronal activities with a high signal-to-noise ratio of spikes demonstrated that our whole device is currently a minimally invasive and clinically viable approach for extracellular recording.

The influence of non-stationarity of spike signals on decoding performance in intracortical brain-computer interface: a simulation study

Introduction

Intracortical Brain-Computer Interfaces (iBCI) establish a new pathway to restore motor functions in individuals with paralysis by interfacing directly with the brain to translate movement intention into action. However, the development of iBCI applications is hindered by the non-stationarity of neural signals induced by the recording degradation and neuronal property variance. Many iBCI decoders were developed to overcome this non-stationarity, but its effect on decoding performance remains largely unknown, posing a critical challenge for the practical application of iBCI.

Methods

To improve our understanding on the effect of non-stationarity, we conducted a 2D-cursor simulation study to examine the influence of various types of non-stationarities. Concentrating on spike signal changes in chronic intracortical recording, we used the following three metrics to simulate the non-stationarity: mean firing rate (MFR), number of isolated units (NIU), and neural preferred directions (PDs). MFR and NIU were decreased to simulate the recording degradation while PDs were changed to simulate the neuronal property variance. Performance evaluation based on simulation data was then conducted on three decoders and two different training schemes. Optimal Linear Estimation (OLE), Kalman Filter (KF), and Recurrent Neural Network (RNN) were implemented as decoders and trained using static and retrained schemes.

Results

In our evaluation, RNN decoder and retrained scheme showed consistent better performance under small recording degradation. However, the serious signal degradation would cause significant performance to drop eventually. On the other hand, RNN performs significantly better than the other two decoders in decoding simulated non-stationary spike signals, and the retrained scheme maintains the decoders' high performance when changes are limited to PDs.

Discussion

Our simulation work demonstrates the effects of neural signal non-stationarity on decoding performance and serves as a reference for selecting decoders and training schemes in chronic iBCI. Our result suggests that comparing to KF and OLE, RNN has better or equivalent performance using both training schemes. Performance of decoders under static scheme is influenced by recording degradation and neuronal property variation while decoders under retrained scheme are only influenced by the former one.

Translating deep learning to neuroprosthetic control

Advances in deep learning have given rise to neural network models of the relationship between movement and brain activity that appear to far outperform prior approaches. Brain-computer interfaces (BCIs) that enable people with paralysis to control external devices, such as robotic arms or computer cursors, might stand to benefit greatly from these advances. We tested recurrent neural networks (RNNs) on a challenging nonlinear BCI problem: decoding continuous bimanual movement of two computer cursors. Surprisingly, we found that although RNNs appeared to perform well in offline settings, they did so by overfitting to the temporal structure of the training data and failed to generalize to real-time neuroprosthetic control. In response, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously, far outperforming standard linear methods. Our results provide evidence that preventing models from overfitting to temporal structure in training data may, in principle, aid in translating deep learning advances to the BCI setting, unlocking improved performance for challenging applications.

Rapid adaptation of brain-computer interfaces to new neuronal ensembles or participants via generative modelling

For brain-computer interfaces (BCIs), obtaining sufficient training data for algorithms that map neural signals onto actions can be difficult, expensive or even impossible. Here we report the development and use of a generative model-a model that synthesizes a virtually unlimited number of new data distributions from a learned data distribution-that learns mappings between hand kinematics and the associated neural spike trains. The generative spike-train synthesizer is trained on data from one recording session with a monkey performing a reaching task and can be rapidly adapted to new sessions or monkeys by using limited additional neural data. We show that the model can be adapted to synthesize new spike trains, accelerating the training and improving the generalization of BCI decoders. The approach is fully data-driven, and hence, applicable to applications of BCIs beyond motor control.

Modulating Brain Activity with Invasive Brain-Computer Interface: A Narrative Review

Brain-computer interface (BCI) can be used as a real-time bidirectional information gateway between the brain and machines. In particular, rapid progress in invasive BCI, propelled by recent developments in electrode materials, miniature and power-efficient electronics, and neural signal decoding technologies has attracted wide attention. In this review, we first introduce the concepts of neuronal signal decoding and encoding that are fundamental for information exchanges in BCI. Then, we review the history and recent advances in invasive BCI, particularly through studies using neural signals for controlling external devices on one hand, and modulating brain activity on the other hand. Specifically, regarding modulating brain activity, we focus on two types of techniques, applying electrical stimulation to cortical and deep brain tissues, respectively. Finally, we discuss the related ethical issues concerning the clinical application of this emerging technology.

Neuroprosthetics: from sensorimotor to cognitive disorders

Neuroprosthetics is a multidisciplinary field at the interface between neurosciences and biomedical engineering, which aims at replacing or modulating parts of the nervous system that get disrupted in neurological disorders or after injury. Although neuroprostheses have steadily evolved over the past 60 years in the field of sensory and motor disorders, their application to higher-order cognitive functions is still at a relatively preliminary stage. Nevertheless, a recent series of proof-of-concept studies suggest that electrical neuromodulation strategies might also be useful in alleviating some cognitive and memory deficits, in particular in the context of dementia. Here, we review the evolution of neuroprosthetics from sensorimotor to cognitive disorders, highlighting important common principles such as the need for neuroprosthetic systems that enable multisite bidirectional interactions with the nervous system.

Flexible intentions: An Active Inference theory

We present a normative computational theory of how the brain may support visually-guided goal-directed actions in dynamically changing environments. It extends the Active Inference theory of cortical processing according to which the brain maintains beliefs over the environmental state, and motor control signals try to fulfill the corresponding sensory predictions. We propose that the neural circuitry in the Posterior Parietal Cortex (PPC) compute flexible intentions-or motor plans from a belief over targets-to dynamically generate goal-directed actions, and we develop a computational formalization of this process. A proof-of-concept agent embodying visual and proprioceptive sensors and an actuated upper limb was tested on target-reaching tasks. The agent behaved correctly under various conditions, including static and dynamic targets, different sensory feedbacks, sensory precisions, intention gains, and movement policies; limit conditions were individuated, too. Active Inference driven by dynamic and flexible intentions can thus support goal-directed behavior in constantly changing environments, and the PPC might putatively host its core intention mechanism. More broadly, the study provides a normative computational basis for research on goal-directed behavior in end-to-end settings and further advances mechanistic theories of active biological systems.

Clinical neuroscience and neurotechnology: An amazing symbiosis

In the last decades, clinical neuroscience found a novel ally in neurotechnologies, devices able to record and stimulate electrical activity in the nervous system. These technologies improved the ability to diagnose and treat neural disorders. Neurotechnologies are concurrently enabling a deeper understanding of healthy and pathological dynamics of the nervous system through stimulation and recordings during brain implants. On the other hand, clinical neurosciences are not only driving neuroengineering toward the most relevant clinical issues, but are also shaping the neurotechnologies thanks to clinical advancements. For instance, understanding the etiology of a disease informs the location of a therapeutic stimulation, but also the way stimulation patterns should be designed to be more effective/naturalistic. Here, we describe cases of fruitful integration such as Deep Brain Stimulation and cortical interfaces to highlight how this symbiosis between clinical neuroscience and neurotechnology is closer to a novel integrated framework than to a simple interdisciplinary interaction.

Dual sensing signal decoupling based on tellurium anisotropy for VR interaction and neuro-reflex system application

Anisotropy control of the electronic structure in inorganic semiconductors is an important step in developing devices endowed with multi-function. Here, we demonstrate that the intrinsic anisotropy of tellurium nanowires can be used to modulate the electronic structure and piezoelectric polarization and decouple pressure and temperature difference signals, and realize VR interaction and neuro-reflex applications. The architecture design of the device combined with self-locking effect can eliminate dependence on displacement, enabling a single device to determine the hardness and thermal conductivity of materials through a simple touch. We used a bimodal Te-based sensor to develop a wearable glove for endowing real objects to the virtual world, which greatly improves VR somatosensory feedback. In addition, we successfully achieved stimulus recognition and neural-reflex in a rabbit sciatic nerve model by integrating the sensor signals using a deep learning technique. In view of in-/ex-vivo feasibility, the bimodal Te-based sensor would be considered a novel sensing platform for a wide range application of metaverse, AI robot, and electronic medicine.

Beyond the brain-computer interface: Decoding brain activity as a tool to understand neuronal mechanisms subtending cognition and behavior

One of the major challenges in system neurosciences consists in developing techniques for estimating the cognitive information content in brain activity. This has an enormous potential in different domains spanning from clinical applications, cognitive enhancement to a better understanding of the neural bases of cognition. In this context, the inclusion of machine learning techniques to decode different aspects of human cognition and behavior and its use to develop brain-computer interfaces for applications in neuroprosthetics has supported a genuine revolution in the field. However, while these approaches have been shown quite successful for the study of the motor and sensory functions, success is still far from being reached when it comes to covert cognitive functions such as attention, motivation and decision making. While improvement in this field of BCIs is growing fast, a new research focus has emerged from the development of strategies for decoding neural activity. In this review, we aim at exploring how the advanced in decoding of brain activity is becoming a major neuroscience tool moving forward our understanding of brain functions, providing a robust theoretical framework to test predictions on the relationship between brain activity and cognition and behavior.

Instant disembodiment of virtual body parts

Evidence from multisensory body illusions suggests that body representations may be malleable, for instance, by embodying external objects. However, adjusting body representations to current task demands also implies that external objects become disembodied from the body representation if they are no longer required. In the current web-based study, we induced the embodiment of a two-dimensional (2D) virtual hand that could be controlled by active movements of a computer mouse or on a touchpad. Following initial embodiment, we probed for disembodiment by comparing two conditions: Participants either continued moving the virtual hand or they stopped moving and kept the hand still. Based on theoretical accounts that conceptualize body representations as a set of multisensory bindings, we expected gradual disembodiment of the virtual hand if the body representations are no longer updated through correlated visuomotor signals. In contrast to our prediction, the virtual hand was instantly disembodied as soon as participants stopped moving it. This result was replicated in two follow-up experiments. The observed instantaneous disembodiment might suggest that humans are sensitive to the rapid changes that characterize action and body in virtual environments, and hence adjust corresponding body representations particularly swiftly.

Time stability and connectivity analysis with an intracortical 96-channel microelectrode array inserted in human visual cortex

OBJECTIVE

Microstimulation via electrodes that penetrate the visual cortex creates visual perceptions called phosphenes. Besides providing electrical stimulation to induce perceptions, each electrode can be used to record the brain signals from the cortex region under the electrode which contains brain state information. Since the future visual prosthesis interfaces will be implanted chronically in the visual cortex of blind people, it is important to study the long-term stability of the signals acquired from the electrodes. Here, we studied the changes over time and the repercussions of electrical stimulation on the brain signals acquired with an intracortical 96-channel microelectrode array implanted in the visual cortex of a blind volunteer for 6 months.

APPROACH

We used variance, power spectral density, correlation, coherence, and phase coherence to study the brain signals acquired in resting condition before and after the administration of electrical stimulation during a period of 6 months.

MAIN RESULTS

Variance and power spectral density up to 750 Hz do not show any significant trend in the 6 months, but correlation coherence and phase coherence significantly decrease over the implantation time and increase after electrical stimulation.

SIGNIFICANCE

The stability of variance and power spectral density in time is important for long-term clinical applications based on the intracortical signals collected by the electrodes. The decreasing trends of correlation, coherence, and phase coherence might be related to plasticity changes in the visual cortex due to electrical microstimulation.

Cluster Kernel Reinforcement Learning-based Kalman Filter for Three-Lever Discrimination Task in Brain-Machine Interface

Brain-Machine Interface (BMI) translates paralyzed people's neural activity into control commands of the prosthesis so that their lost motor functions could be restored. The neural activities represent brain states that change continuously over time which brings the challenge to the online decoder. Reinforcement Learning (RL) has the advantage to construct the dynamic neural-kinematic mapping during the interaction. However, existing RL decoders output discrete actions as a classification problem and cannot provide continuous estimation. Previous work has combined Kalman Filter (KF) with RL for BMI, which achieves a continuous motor state estimation. However, this method adopts a neural network structure, which might get stuck in local optimum and cannot provide an efficient online update for the neural-kinematic mapping. In this paper, we propose a Cluster Kernel Reinforcement Learning-based Kalman Filter (CKRL-based KF) to avoid the local optimum problem for online neural-kinematic updating. The neural patterns are projected into Reproducing Kernel Hilbert Space (RKHS), which builds a universal approximation to guarantee the global optimum. We compare our proposed algorithm with the existing method on rat data collected during a brain control three-lever discrimination task. Our preliminary results show that the proposed method has a higher trial accuracy with lower variance across data segments, which shows its potential to improve the performance for online BMI control. Clinical Relevance- This paper provides a more stable decoding method for adaptive and continuous neural decoding. It is promising for clinical applications in BMI.

Information sparseness in cortical microelectrode channels while decoding movement direction using an artificial neural network

Implanted microelectrode arrays can directly pick up electrode signals from the primary motor cortex (M1) during movement, and brain-machine interfaces (BMIs) can decode these signals to predict the directions of contemporaneous movements. However, it is not well known how much each individual input is responsible for the overall performance of a BMI decoder. In this paper, we seek to quantify how much each channel contributes to an artificial neural network (ANN)-based decoder, by measuring how much the removal of each individual channel degrades the accuracy of the output. If information on movement direction was equally distributed among channels, then the removal of one would have a minimal effect on decoder accuracy. On the other hand, if that information was distributed sparsely, then the removal of specific information-rich channels would significantly lower decoder accuracy. We found that for most channels, their removal did not significantly affect decoder performance. However, for a subset of channels (16 out of 61), removing them significantly reduced the decoder accuracy. This suggests that information is not uniformly distributed among the recording channels. We propose examining these channels further to optimize BMIs more effectively, as well as understand how M1 functions at the neuronal level.

Restoration of complex movement in the paralyzed upper limb

OBJECTIVE

Functional electrical stimulation (FES) involves artificial activation of skeletal muscles to reinstate motor function in paralyzed individuals. While FES applied to the upper limb has improved the ability of tetraplegics to perform activities of daily living, there are key shortcomings impeding its widespread use. One major limitation is that the range of motor behaviors that can be generated is restricted to a small set of simple, preprogrammed movements. This limitation stems from the substantial difficulty in determining the patterns of stimulation across many muscles required to produce more complex movements. Therefore, the objective of this study was to use machine learning to flexibly identify patterns of muscle stimulation needed to evoke a wide array of multi-joint arm movements.

APPROACH

Arm kinematics and electromyographic activity from 29 muscles were recorded while a 'trainer' monkey made an extensive range of arm movements. Those data were used to train an artificial neural network that predicted patterns of muscle activity associated with a new set of movements. Those patterns were converted into trains of stimulus pulses that were delivered to upper limb muscles in two other temporarily paralyzed monkeys.

RESULTS

Machine-learning based prediction of EMG was good for within-subject predictions but appreciably poorer for across-subject predictions. Evoked responses matched the desired movements with good fidelity only in some cases. Means to mitigate errors associated with FES-evoked movements are discussed.

SIGNIFICANCE

Because the range of movements that can be produced with our approach is virtually unlimited, this system could greatly expand the repertoire of movements available to individuals with high level paralysis.

Intracranial brain-computer interface spelling using localized visual motion response

Intracranial brain-computer interfaces (BCIs) can assist severely disabled persons in text communication and environmental control with high precision and speed. Nevertheless, sustainable BCI implants require minimal invasiveness. One of the implantation strategies is to adopt localized and robust cortical activities to drive BCI communication and to make a precise presurgical planning. The visual motion response is a good candidate for inclusion in this strategy because of its focal activity over the middle temporal visual area (MT). Here, we developed an intracranial BCI for spelling, utilizing only three electrodes over the MT area. The best recording electrodes were decided by preoperative functional magnetic resonance imaging (MRI) localization of the MT, and local neural activities were further enhanced by differential rereferencing of these electrodes. The BCI spelling system was validated both offline and online by five epilepsy patients, achieving the fastest speed of 62 bits/min, i.e., 12 characters/min. Moreover, the response patterns of dual-directional visual motion stimuli provided an additional dimension of BCI target encoding and paved the way for a higher information transfer rate of intracranial BCI spelling.

Conductive Polymer Enabled Biostable Liquid Metal Electrodes for Bioelectronic Applications

Gallium (Ga)-based liquid metal materials have emerged as a promising material platform for soft bioelectronics. Unfortunately, Ga has limited biostability and electrochemical performance under physiological conditions, which can hinder the implementation of its use in bioelectronic devices. Here, an effective conductive polymer deposition strategy on the liquid metal surface to improve the biostability and electrochemical performance of Ga-based liquid metals for use under physiological conditions is demonstrated. The conductive polymer [poly(3,4-ethylene dioxythiophene):tetrafluoroborate]-modified liquid metal surface significantly outperforms the liquid metal.based electrode in mechanical, biological, and electrochemical studies. In vivo action potential recordings in behaving nonhuman primate and invertebrate models demonstrate the feasibility of using liquid metal electrodes for high-performance neural recording applications. This is the first demonstration of single-unit neural recording using Ga-based liquid metal bioelectronic devices to date. The results determine that the electrochemical deposition of conductive polymer over liquid metal can improve the material properties of liquid metal electrodes for use under physiological conditions and open numerous design opportunities for next-generation liquid metal-based bioelectronics.

A Power-Efficient Brain-Machine Interface System With a Sub-mw Feature Extraction and Decoding ASIC Demonstrated in Nonhuman Primates

Intracortical brain-machine interfaces have shown promise for restoring function to people with paralysis, but their translation to portable and implantable devices is hindered by their high power consumption. Recent devices have drastically reduced power consumption compared to standard experimental brain-machine interfaces, but still require wired or wireless connections to computing hardware for feature extraction and inference. Here, we introduce a Neural Recording And Decoding (NeuRAD) application specific integrated circuit (ASIC) in 180 nm CMOS that can extract neural spiking features and predict two-dimensional behaviors in real-time. To reduce amplifier and feature extraction power consumption, the NeuRAD has a hardware accelerator for extracting spiking band power (SBP) from intracortical spiking signals and includes an M0 processor with a fixed-point Matrix Acceleration Unit (MAU) for efficient and flexible decoding. We validated device functionality by recording SBP from a nonhuman primate implanted with a Utah microelectrode array and predicting the one- and two-dimensional finger movements the monkey was attempting to execute in closed-loop using a steady-state Kalman filter (SSKF). Using the NeuRAD's real-time predictions, the monkey achieved 100% success rate and 0.82 s mean target acquisition time to control one-dimensional finger movements using just 581 μW. To predict two-dimensional finger movements, the NeuRAD consumed 588 μW to enable the monkey to achieve a 96% success rate and 2.4 s mean acquisition time. By employing SBP, ASIC brain-machine interfaces can close the gap to enable fully implantable therapies for people with paralysis.

Continuous 2D trajectory decoding from attempted movement: across-session performance in able-bodied and feasibility in a spinal cord injured participant

OBJECTIVE

In people with a cervical spinal cord injury (SCI) or degenerative diseases leading to limited motor function, restoration of upper limb movement has been a goal of the brain-computer interface (BCI) field for decades. Recently, research from our group investigated non-invasive and real-time decoding of continuous movement in able-bodied participants from low-frequency brain signals during a target-tracking task. To advance our setup towards motor-impaired end users, we consequently chose a new paradigm based on attempted movement.

APPROACH

Here, we present the results of two studies. During the first study, data of ten able-bodied participants completing a target-tracking/shape-tracing task on-screen were investigated in terms of improvements in decoding performance due to user training. In a second study, a spinal cord injured participant underwent the same tasks. To investigate the merit of employing attempted movement in end users with SCI, data of the spinal cord injured participant were recorded twice; once within an observation only condition, and once while simultaneously attempting movement.

MAIN RESULTS

We observed mean correlation well above chance level for continuous motor decoding based on attempted movement in able-bodied participants. No global improvement over three sessions, both in sensor and source space, could be observed across all participants and movement parameters. In the participant with SCI, decoding performance well above chance was found.

SIGNIFICANCE

No presence of a learning effect in continuous attempted movement decoding in able-bodied participants could be observed. In contrast, non-significantly varying decoding patterns may promote the use of source space decoding in terms of generalized decoders utilizing transfer learning. Furthermore, above-chance correlations for attempted movement decoding ranging between those of observation only and executed movement were seen in one spinal cord injured participant, suggesting attempted movement decoding as a possible link between feasibility studies in able-bodied and actual applications in motor impaired end users.

Ionic communication for implantable bioelectronics

Implanted bioelectronic devices require data transmission through tissue, but ionic conductivity and inhomogeneity of this medium complicate conventional communication approaches. Here, we introduce ionic communication (IC) that uses ions to effectively propagate megahertz-range signals. We demonstrate that IC operates by generating and sensing electrical potential energy within polarizable media. IC was tuned to transmit across a range of biologically relevant tissue depths. The radius of propagation was controlled to enable multiline parallel communication, and it did not interfere with concurrent use of other bioelectronics. We created a fully implantable IC-based neural interface device that acquired and noninvasively transmitted neurophysiologic data from freely moving rodents over a period of weeks with stability sufficient for isolation of action potentials from individual neurons. IC is a biologically based data communication that establishes long-term, high-fidelity interactions across intact tissue.

The science and engineering behind sensitized brain-controlled bionic hands

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

Far-field electric potentials provide access to the output from the spinal cord from wrist-mounted sensors

OBJECTIVE

Neural interfaces need to become more unobtrusive and socially acceptable to appeal to general consumers outside rehabilitation settings.

APPROACH

We developed a non-invasive neural interface that provides access to spinal motor neuron activities from the wrist, which is the preferred location for a wearable. The interface decodes far-field potentials present at the tendon endings of the forearm muscles using blind source separation. First, we evaluated the reliability of the interface to detect motor neuron firings based on far-field potentials, and thereafter we used the decoded motor neuron activity for the prediction of finger contractions in offline and real-time conditions.

MAIN RESULTS

The results showed that motor neuron activity decoded from the far-field potentials at the wrist accurately predicted individual and combined finger commands and therefore allowed for highly accurate real-time task classification.

SIGNIFICANCE

These findings demonstrate the feasibility of a non-invasive, neural interface at the wrist for precise real-time control based on the output of the spinal cord.

From Parametric Representation to Dynamical System: Shifting Views of the Motor Cortex in Motor Control

In contrast to traditional representational perspectives in which the motor cortex is involved in motor control via neuronal preference for kinetics and kinematics, a dynamical system perspective emerging in the last decade views the motor cortex as a dynamical machine that generates motor commands by autonomous temporal evolution. In this review, we first look back at the history of the representational and dynamical perspectives and discuss their explanatory power and controversy from both empirical and computational points of view. Here, we aim to reconcile the above perspectives, and evaluate their theoretical impact, future direction, and potential applications in brain-machine interfaces.

A behavioral paradigm for cortical control of a robotic actuator by freely moving rats in a one-dimensional two-target reaching task

BACKGROUND

Controlling the trajectory of a neuroprosthesis to reach distant targets is a commonly used brain-machine interface (BMI) task in primates and has not been available for rodents yet.

NEW METHOD

Here, we describe a novel, fine-tuned behavioral paradigm and setup which enables this task for rats in one-dimensional space for reaching two distant targets depending on their limited cognitive and visual capabilities compared to those of primates. An online transform was used to convert the activity of a pair of primary motor cortex (M1) units into two robotic actions. The rats were shaped to adapt to the transform and direct the robotic actuator toward the selected target by modulating the activity of the M1 neurons.

RESULTS

All three rats involved in the study were capable of achieving randomly selected targets with at least 78% accuracy. A total of 9 out of 16 pairs of units examined were eligible for exceeding this success criterion. Two out of three rats were capable of reversal learning, where the mapping between the activity of the M1 units and the robotic actions were reversed.

COMPARISON WITH EXISTING METHODS

The present work is the first demonstration of trajectory-based control of a neuroprosthetic device by rodents to reach two distant targets using visual feedback.

CONCLUSION

The behavioral paradigm and setup introduced here can be used as a cost-effective platform for elucidating the information processing principles in the neural circuits related to neuroprosthetic control and for studying the performance of novel BMI technologies using freely moving rats.

Effective Evaluation of Finger Sensation Evoking by Non-invasive Stimulation for Sensory Function Recovery in Transradial Amputees

Synergetic recovery of both somatosensory and motor functions is highly desired by limb amputees to fully regain their lost limb abilities. The commercially available prostheses can restore the lost motor function in amputees but lack intuitive sensory feedback. The previous studies showed that electrical stimulation on the arm stump would be a promising approach to induce sensory information into the nervous system, enabling the possibility of realizing sensory feedback in limb prostheses. However, there are currently limited studies on the effective evaluation of the sensations evoked by transcutaneous electrical nerve stimulation (TENS). In this paper, a multichannel TENS platform was developed and the different stimulus patterns were designed to evoke stable finger sensations for a transradial amputee. Electroencephalogram (EEG) was recorded simultaneously during TENS on the arm stump, which was utilized to evaluate the evoked sensations. The experimental results revealed that different types of sensations on three phantom fingers could be stably evoked for the amputee by properly selecting TENS patterns. The analysis of the event-related potential (ERP) of EEG recordings further confirmed the evoked sensations, and ERP latencies and curve characteristics for different phantom fingers showed significant differences. This work may provide insight for an in-depth understanding of how somatosensation could be restored in limb amputees and offer technical support for the applications of non-invasive sensory feedback systems.

Towards in vivo neural decoding

Conventional spike sorting and motor intention decoding algorithms are mostly implemented on an external computing device, such as a personal computer. The innovation of high-resolution and high-density electrodes to record the brain's activity at the single neuron level may eliminate the need for spike sorting altogether while potentially enabling in vivo neural decoding. This article explores the feasibility and efficient realization of in vivo decoding, with and without spike sorting. The efficiency of neural network-based models for reliable motor decoding is presented and the performance of candidate neural decoding schemes on sorted single-unit activity and unsorted multi-unit activity are evaluated. A programmable processor with a custom instruction set architecture, for the first time to the best of our knowledge, is designed and implemented for executing neural network operations in a standard 180-nm CMOS process. The processor's layout is estimated to occupy 49 mm 2 of silicon area and to dissipate 12 mW of power from a 1.8 V supply, which is within the tissue-safe operation of the brain.

A 16-Channel Fully Configurable Neural SoC With 1.52 μW/Ch Signal Acquisition, 2.79 μW/Ch Real-Time Spike Classifier, and 1.79 TOPS/W Deep Neural Network Accelerator in 22 nm FDSOI

With the advent of high-density micro-electrodes arrays, developing neural probes satisfying the real-time and stringent power-efficiency requirements becomes more challenging. A smart neural probe is an essential device in future neuroscientific research and medical applications. To realize such devices, we present a 22 nm FDSOI SoC with complex on-chip real-time data processing and training for neural signal analysis. It consists of a digitally-assisted 16-channel analog front-end with 1.52 μW/Ch, dedicated bio-processing accelerators for spike detection and classification with 2.79 μW/Ch, and a 125 MHz RISC-V CPU, utilizing adaptive body biasing at 0.5 V with a supporting 1.79 TOPS/W MAC array. The proposed SoC shows a proof-of-concept of how to realize a high-level integration of various on-chip accelerators to satisfy the neural probe requirements for modern applications.