HermesC: low-power wireless neural recording system for freely moving primates

Technical survey of end-to-end signal processing in BCIs using invasive MEAs

Modern brain-computer interfaces and neural implants allow interaction between the tissue, the user and the environment, where people suffer from neurodegenerative diseases or injuries.This interaction can be achieved by using penetrating/invasive microelectrodes for extracellular recordings and stimulation, such as Utah or Michigan arrays. The application-specific signal processing of the extracellular recording enables the detection of interactions and enables user interaction. For example, it allows to read out movement intentions from recordings of brain signals for controlling a prosthesis or an exoskeleton. To enable this, computationally complex algorithms are used in research that cannot be executed on-chip or on embedded systems. Therefore, an optimization of the end-to-end processing pipeline, from the signal condition on the electrode array over the analog pre-processing to spike-sorting and finally the neural decoding process, is necessary for hardware inference in order to enable a local signal processing in real-time and to enable a compact system for achieving a high comfort level. This paper presents a survey of system architectures and algorithms for end-to-end signal processing pipelines of neural activity on the hardware of such neural devices, including (i) on-chip signal pre-processing, (ii) spike-sorting on-chip or on embedded hardware and (iii) neural decoding on workstations. A particular focus for the hardware implementation is on low-power electronic design and artifact-robust algorithms with low computational effort and very short latency. For this, current challenges and possible solutions with support of novel machine learning techniques are presented in brief. In addition, we describe our future vision for next-generation BCIs.

Toward a neuroscience of natural behavior

One of the most exciting new developments in systems neuroscience is the progress being made toward neurophysiological experiments that move beyond simplified laboratory settings and address the richness of natural behavior. This is enabled by technological advances such as wireless recording in freely moving animals, automated quantification of behavior, and new methods for analyzing large data sets. Beyond new empirical methods and data, however, there is also a need for new theories and concepts to interpret that data. Such theories need to address the particular challenges of natural behavior, which often differ significantly from the scenarios studied in traditional laboratory settings. Here, we discuss some strategies for developing such novel theories and concepts and some example hypotheses being proposed.

Passive Impedance-Matched Neural Recording Systems for Improved Signal Sensitivity

Wireless passive neural recording systems integrate sensory electrophysiological interfaces with a backscattering-based telemetry system. Despite the circuit simplicity and miniaturization with this topology, the high electrode-tissue impedance creates a major barrier to achieving high signal sensitivity and low telemetry power. In this paper, buffered impedance is utilized to address this limitation. The resulting passive telemetry-based wireless neural recording is implemented with thin flexible packages. Thus, the paper reports neural recording implants and integrator systems with three improved features: (1) passive high impedance matching with a simple buffer circuit, (2) a bypass capacitor to route the high frequency and improve mixer performance, and (3) system packaging with an integrated, flexible, biocompatible patch to capture the neural signal. The patch consists of a U-slot dual-band patch antenna that receives the transmitted power from the interrogator and backscatters the modulated carrier power at a different frequency. When the incoming power was 5-10 dBm, the neurosensor could communicate with the interrogator at a maximum distance of 5 cm. A biosignal as low as 80 µV peak was detected at the receiver.

Home-Enclosure-Based Behavioral and Wireless Neural Recording Setup for Unrestrained Rhesus Macaques

Electrophysiological studies with behaving nonhuman primates often require the separation of animals from their social group as well as partial movement restraint to perform well-controlled experiments. When the research goal per se does not mandate constraining the animals' movements, there are often still experimental needs imposed by tethered data acquisition. Recent technological advances meanwhile allow wireless neurophysiological recordings at high band-width in limited-size enclosures. Here, we demonstrate wireless neural recordings at single unit resolution from unrestrained rhesus macaques while they performed self-paced, structured visuomotor tasks on our custom-built, stand-alone touchscreen system [eXperimental Behavioral Instrument (XBI)] in their home environment. We were able to successfully characterize neural tuning to task parameters, such as visuo-spatial selectivity during movement planning and execution, as expected from existing findings obtained via setup-based neurophysiology recordings. We conclude that when movement restraint and/or a highly controlled, insulated environment are not necessary for scientific reasons, cage-based wireless neural recordings are a viable option. We propose an approach that allows the animals to engage in a self-paced manner with our XBI device, both for fully automatized training and cognitive testing, as well as neural data acquisition in their familiar environment, maintaining auditory and sometimes visual contact with their conspecifics.

Group-based, autonomous, individualized training and testing of long-tailed macaques (Macaca fascicularis) in their home enclosure to a visuo-acoustic discrimination task

In recent years, the utility and efficiency of automated procedures for cognitive assessment in psychology and neuroscience have been demonstrated in non-human primates (NHP). This approach mimics conventional shaping principles of breaking down a final desired behavior into smaller components that can be trained in a staircase manner. When combined with home-cage-based approaches, this could lead to a reduction in human workload, enhancement in data quality, and improvement in animal welfare. However, to our knowledge, there are no reported attempts to develop automated training and testing protocols for long-tailed macaques (Macaca fascicularis), a ubiquitous NHP model in neuroscience and pharmaceutical research. In the current work, we present the results from 6 long-tailed macaques that were trained using an automated unsupervised training (AUT) protocol for introducing the animals to the basics of a two-alternative choice (2 AC) task where they had to discriminate a conspecific vocalization from a pure tone relying on images presented on a touchscreen to report their response. We found that animals (1) consistently engaged with the device across several months; (2) interacted in bouts of high engagement; (3) alternated peacefully to interact with the device; and (4) smoothly ascended from step to step in the visually guided section of the procedure, in line with previous results from other NHPs. However, we also found (5) that animals' performance remained at chance level as soon as the acoustically guided steps were reached; and (6) that the engagement level decreased significantly with decreasing performance during the transition from visual to acoustic-guided sections. We conclude that with an autonomous approach, it is possible to train long-tailed macaques in their social group using computer vision techniques and without dietary restriction to solve a visually guided discrimination task but not an acoustically guided task. We provide suggestions on what future attempts could take into consideration to instruct acoustically guided discrimination tasks successfully.

The road towards understanding embodied decisions

Most current decision-making research focuses on classical economic scenarios, where choice offers are prespecified and where action dynamics play no role in the decision. However, our brains evolved to deal with different choice situations: "embodied decisions". As examples of embodied decisions, consider a lion that has to decide which gazelle to chase in the savannah or a person who has to select the next stone to jump on when crossing a river. Embodied decision settings raise novel questions, such as how people select from time-varying choice options and how they track the most relevant choice attributes; but they have long remained challenging to study empirically. Here, we summarize recent progress in the study of embodied decisions in sports analytics and experimental psychology. Furthermore, we introduce a formal methodology to identify the relevant dimensions of embodied choices (present and future affordances) and to map them into the attributes of classical economic decisions (probabilities and utilities), hence aligning them. Studying embodied decisions will greatly expand our understanding of what decision-making is.

Signal Generation, Acquisition, and Processing in Brain Machine Interfaces: A Unified Review

Brain machine interfaces (BMIs), or brain computer interfaces (BCIs), are devices that act as a medium for communications between the brain and the computer. It is an emerging field with numerous applications in domains of prosthetic devices, robotics, communication technology, gaming, education, and security. It is noted in such a multidisciplinary field, many reviews have surveyed on various focused subfields of interest, such as neural signaling, microelectrode fabrication, and signal classification algorithms. A unified review is lacking to cover and link all the relevant areas in this field. Herein, this review intends to connect on the relevant areas that circumscribe BMIs to present a unified script that may help enhance our understanding of BMIs. Specifically, this article discusses signal generation within the cortex, signal acquisition using invasive, non-invasive, or hybrid techniques, and the signal processing domain. The latest development is surveyed in this field, particularly in the last decade, with discussions regarding the challenges and possible solutions to allow swift disruption of BMI products in the commercial market.

A markerless platform for ambulatory systems neuroscience

Motor systems neuroscience seeks to understand how the brain controls movement. To minimize confounding variables, large-animal studies typically constrain body movement from areas not under observation, ensuring consistent, repeatable behaviors. Such studies have fueled decades of research, but they may be artificially limiting the richness of neural data observed, preventing generalization to more natural movements and settings. Neuroscience studies of unconstrained movement would capture a greater range of behavior and a more complete view of neuronal activity, but instrumenting an experimental rig suitable for large animals presents substantial engineering challenges. Here, we present a markerless, full-body motion tracking and synchronized wireless neural electrophysiology platform for large, ambulatory animals. Composed of four depth (RGB-D) cameras that provide a 360° view of a 4.5-square-meters enclosed area, this system is designed to record a diverse range of neuroethologically relevant behaviors. This platform also allows for the simultaneous acquisition of hundreds of wireless neural recording channels in multiple brain regions. As behavioral and neuronal data are generated at rates below 200 megabytes per second, a single desktop can facilitate hours of continuous recording. This setup is designed for systems neuroscience and neuroengineering research, where synchronized kinematic behavior and neural data are the foundation for investigation. By enabling the study of previously unexplored movement tasks, this system can generate insights into the functioning of the mammalian motor system and provide a platform to develop brain-machine interfaces for unconstrained applications.

Neurochip3: An Autonomous Multichannel Bidirectional Brain-Computer Interface for Closed-Loop Activity-Dependent Stimulation

Toward addressing many neuroprosthetic applications, the Neurochip3 (NC3) is a multichannel bidirectional brain-computer interface that operates autonomously and can support closed-loop activity-dependent stimulation. It consists of four circuit boards populated with off-the-shelf components and is sufficiently compact to be carried on the head of a non-human primate (NHP). NC3 has six main components: (1) an analog front-end with an Intan biophysical signal amplifier (16 differential or 32 single-ended channels) and a 3-axis accelerometer, (2) a digital control system comprised of a Cyclone V FPGA and Atmel SAM4 MCU, (3) a micro SD Card for 128 GB or more storage, (4) a 6-channel differential stimulator with ±60 V compliance, (5) a rechargeable battery pack supporting autonomous operation for up to 24 h and, (6) infrared transceiver and serial ports for communication. The NC3 and earlier versions have been successfully deployed in many closed-loop operations to induce synaptic plasticity and bridge lost biological connections, as well as deliver activity-dependent intracranial reinforcement. These paradigms to strengthen or replace impaired connections have many applications in neuroprosthetics and neurorehabilitation.

Home Use of a Percutaneous Wireless Intracortical Brain-Computer Interface by Individuals With Tetraplegia

OBJECTIVE

Individuals with neurological disease or injury such as amyotrophic lateral sclerosis, spinal cord injury or stroke may become tetraplegic, unable to speak or even locked-in. For people with these conditions, current assistive technologies are often ineffective. Brain-computer interfaces are being developed to enhance independence and restore communication in the absence of physical movement. Over the past decade, individuals with tetraplegia have achieved rapid on-screen typing and point-and-click control of tablet apps using intracortical brain-computer interfaces (iBCIs) that decode intended arm and hand movements from neural signals recorded by implanted microelectrode arrays. However, cables used to convey neural signals from the brain tether participants to amplifiers and decoding computers and require expert oversight, severely limiting when and where iBCIs could be available for use. Here, we demonstrate the first human use of a wireless broadband iBCI.

METHODS

Based on a prototype system previously used in pre-clinical research, we replaced the external cables of a 192-electrode iBCI with wireless transmitters and achieved high-resolution recording and decoding of broadband field potentials and spiking activity from people with paralysis. Two participants in an ongoing pilot clinical trial completed on-screen item selection tasks to assess iBCI-enabled cursor control.

RESULTS

Communication bitrates were equivalent between cabled and wireless configurations. Participants also used the wireless iBCI to control a standard commercial tablet computer to browse the web and use several mobile applications. Within-day comparison of cabled and wireless interfaces evaluated bit error rate, packet loss, and the recovery of spike rates and spike waveforms from the recorded neural signals. In a representative use case, the wireless system recorded intracortical signals from two arrays in one participant continuously through a 24-hour period at home.

SIGNIFICANCE

Wireless multi-electrode recording of broadband neural signals over extended periods introduces a valuable tool for human neuroscience research and is an important step toward practical deployment of iBCI technology for independent use by individuals with paralysis. On-demand access to high-performance iBCI technology in the home promises to enhance independence and restore communication and mobility for individuals with severe motor impairment.

Wireless and battery-free platforms for collection of biosignals

Recent progress in biosensors have quantitively expanded current capabilities in exploratory research tools, diagnostics and therapeutics. This rapid pace in sensor development has been accentuated by vast improvements in data analysis methods in the form of machine learning and artificial intelligence that, together, promise fantastic opportunities in chronic sensing of biosignals to enable preventative screening, automated diagnosis, and tools for personalized treatment strategies. At the same time, the importance of widely accessible personal monitoring has become evident by recent events such as the COVID-19 pandemic. Progress in fully integrated and chronic sensing solutions is therefore increasingly important. Chronic operation, however, is not truly possible with tethered approaches or bulky, battery-powered systems that require frequent user interaction. A solution for this integration challenge is offered by wireless and battery-free platforms that enable continuous collection of biosignals. This review summarizes current approaches to realize such device architectures and discusses their building blocks. Specifically, power supplies, wireless communication methods and compatible sensing modalities in the context of most prevalent implementations in target organ systems. Additionally, we highlight examples of current embodiments that quantitively expand sensing capabilities because of their use of wireless and battery-free architectures.

Wireless, miniaturized, semi-implantable electrocorticography microsystem validated in vivo

This paper reports on the design, development, and test of a multi-channel wireless micro-electrocorticography (µECoG) system. The system consists of a semi-implantable, ultra-compact recording unit and an external unit, interfaced through a 2.4 GHz radio frequency data telemetry link with 2 Mbps (partially used) data transfer rate. Encased in a 3D-printed 2.9 cm × 2.9 cm × 2.5 cm cubic package, the semi-implantable recording unit consists of a microelectrode array, a vertically-stacked PCB platform containing off-the-shelf components, and commercially-available small-size 3.7-V, 50 mAh lithium-ion batteries. Two versions of microelectrode array were developed for the recording unit: a rigid 4 × 2 microelectrode array, and a flexible 12 × 6 microelectrode array, 36 of which routed to bonding pads for actual recording. The external unit comprises a transceiver board, a data acquisition board, and a host computer, on which reconstruction of the received signals is performed. After development, assembly, and integration, the system was tested and validated in vivo on anesthetized rats. The system successfully recorded both spontaneous and evoked activities from the brain of the subject.

Wireless recording from unrestrained monkeys reveals motor goal encoding beyond immediate reach in frontoparietal cortex

System neuroscience of motor cognition regarding the space beyond immediate reach mandates free, yet experimentally controlled movements. We present an experimental environment (Reach Cage) and a versatile visuo-haptic interaction system (MaCaQuE) for investigating goal-directed whole-body movements of unrestrained monkeys. Two rhesus monkeys conducted instructed walk-and-reach movements towards targets flexibly positioned in the cage. We tracked 3D multi-joint arm and head movements using markerless motion capture. Movements show small trial-to-trial variability despite being unrestrained. We wirelessly recorded 192 broad-band neural signals from three cortical sensorimotor areas simultaneously. Single unit activity is selective for different reach and walk-and-reach movements. Walk-and-reach targets could be decoded from premotor and parietal but not motor cortical activity during movement planning. The Reach Cage allows systems-level sensorimotor neuroscience studies with full-body movements in a configurable 3D spatial setting with unrestrained monkeys. We conclude that the primate frontoparietal network encodes reach goals beyond immediate reach during movement planning.

Fully Passive Flexible Wireless Neural Recorder for the Acquisition of Neuropotentials from a Rat Model

Wireless implantable neural interfaces can record high-resolution neuropotentials without constraining patient movement. Existing wireless systems often require intracranial wires to connect implanted electrodes to an external head stage or/and deploy an application-specific integrated circuit (ASIC), which is battery-powered or externally power-transferred, raising safety concerns such as infection, electronics failure, or heat-induced tissue damage. This work presents a biocompatible, flexible, implantable neural recorder capable of wireless acquisition of neuropotentials without wires, batteries, energy harvesting units, or active electronics. The recorder, fabricated on a thin polyimide substrate, features a small footprint of 9 mm × 8 mm × 0.3 mm and is composed of passive electronic components. The absence of active electronics on the device leads to near zero power consumption, inherently avoiding the catastrophic failure of active electronics. We performed both in vitro validation in a tissue-simulating phantom and in vivo validation in an epileptic rat. The fully passive wireless recorder was implanted under rat scalp to measure neuropotentials from its contact electrodes. The implanted wireless recorder demonstrated its capability to capture low voltage neuropotentials, including somatosensory evoked potentials (SSEPs), and interictal epileptiform discharges (IEDs). Wirelessly recorded SSEP and IED signals were directly compared to those from wired electrodes to demonstrate the efficacy of the wireless data. In addition, a convoluted neural network-based machine learning algorithm successfully achieved IED signal recognition accuracy as high as 100 and 91% in wired and wireless IED data, respectively. These results strongly support the fully passive wireless neural recorder's capability to measure neuropotentials as low as tens of microvolts. With further improvement, the recorder system presented in this work may find wide applications in future brain machine interface systems.

A Miniature Dual-Biomarker-Based Sensing and Conditioning Device for Closed-Loop DBS

In this paper, a dual-biomarker-based neural sensing and conditioning device is proposed for closing the feedback loop in deep brain stimulation devices. The device explores both local field potentials (LFPs) and action potentials (APs) as measured biomarkers. It includes two channels, each having four main parts: (1) a pre-amplifier with built-in low-pass filter, (2) a ground shifting circuit, (3) an amplifier with low-pass function, and (4) a high-pass filter. The design specifications include miniature-size, light-weight, and 100 dB gain in the LFP and AP channels. This device has been validated through bench and in-vitro tests. The bench tests have been performed using different sinusoidal signals and pre-recorded neural signals. The in-vitro tests have been conducted in the saline solution that mimics the brain environment. The total weight of the device including a 3 V coin battery, and battery holder is 1.2 g. The diameter of the device is 11.2 mm. The device can be used to concurrently sense LFPs and APs for closing the feedback loop in closed-loop deep brain stimulation systems. It provides a tetherless head-mountable platform suitable for pre-clinical trials.

Multisite microLED optrode array for neural interfacing

We present an electrically addressable optrode array capable of delivering light to 181 sites in the brain, each providing sufficient light to optogenetically excite thousands of neurons in vivo, developed with the aim to allow behavioral studies in large mammals. The device is a glass microneedle array directly integrated with a custom fabricated microLED device, which delivers light to 100 needle tips and 81 interstitial surface sites, giving two-level optogenetic excitation of neurons in vivo. Light delivery and thermal properties are evaluated, with the device capable of peak irradiances > 80    mW / mm 2 per needle site. The device consists of an array of 181 80    μ m × 80    μ m 2 microLEDs, fabricated on a 150 - μ m -thick GaN-on-sapphire wafer, coupled to a glass needle array on a 150 - μ m thick backplane. A pinhole layer is patterned on the sapphire side of the microLED array to reduce stray light. Future designs are explored through optical and thermal modeling and benchmarked against the current device.

Accurate Estimation of Neural Population Dynamics without Spike Sorting

A central goal of systems neuroscience is to relate an organism's neural activity to behavior. Neural population analyses often reduce the data dimensionality to focus on relevant activity patterns. A major hurdle to data analysis is spike sorting, and this problem is growing as the number of recorded neurons increases. Here, we investigate whether spike sorting is necessary to estimate neural population dynamics. The theory of random projections suggests that we can accurately estimate the geometry of low-dimensional manifolds from a small number of linear projections of the data. We recorded data using Neuropixels probes in motor cortex of nonhuman primates and reanalyzed data from three previous studies and found that neural dynamics and scientific conclusions are quite similar using multiunit threshold crossings rather than sorted neurons. This finding unlocks existing data for new analyses and informs the design and use of new electrode arrays for laboratory and clinical use.

Decoding of muscle activity from the sensorimotor cortex in freely behaving monkeys

Remarkable advances have recently been made in the development of Brain-Machine Interface (BMI) technologies for restoring or enhancing motor function. However, the application of these technologies may be limited to patients in static conditions, as these developments have been largely based on studies of animals (e.g., non-human primates) in constrained movement conditions. The ultimate goal of BMI technology is to enable individuals to move their bodies naturally or control external devices without physical constraints. Here, we demonstrate accurate decoding of muscle activity from electrocorticogram (ECoG) signals in unrestrained, freely behaving monkeys. We recorded ECoG signals from the sensorimotor cortex as well as electromyogram signals from multiple muscles in the upper arm while monkeys performed two types of movements with no physical restraints, as follows: forced forelimb movement (lever-pull task) and natural whole-body movement (free movement within the cage). As in previous reports using restrained monkeys, we confirmed that muscle activity during forced forelimb movement was accurately predicted from simultaneously recorded ECoG data. More importantly, we demonstrated that accurate prediction of muscle activity from ECoG data was possible in monkeys performing natural whole-body movement. We found that high-gamma activity in the primary motor cortex primarily contributed to the prediction of muscle activity during natural whole-body movement as well as forced forelimb movement. In contrast, the contribution of high-gamma activity in the premotor and primary somatosensory cortices was significantly larger during natural whole-body movement. Thus, activity in a larger area of the sensorimotor cortex was needed to predict muscle activity during natural whole-body movement. Furthermore, decoding models obtained from forced forelimb movement could not be generalized to natural whole-body movement, which suggests that decoders should be built individually and according to different behavior types. These results contribute to the future application of BMI systems in unrestrained individuals.

Advances in Penetrating Multichannel Microelectrodes Based on the Utah Array Platform

The Utah electrode array (UEA) and its many derivatives have become a gold standard for high-channel count bi-directional neural interfaces, in particular in human subject applications. The chapter provides a brief overview of leading electrode concepts and the context in which the UEA has to be understood. It goes on to discuss the key advances and developments of the UEA platform in the past 15 years, as well as novel wireless and system integration technologies that will merge into future generations of fully integrated devices. Aspects covered include novel device architectures that allow scaling of channel count and density of electrode contacts, material improvements to substrate, electrode contacts, and encapsulation. Further subjects are adaptations of the UEA platform to support IR and optogenetic simulation as well as an improved understanding of failure modes and methods to test and accelerate degradation in vitro such as to better predict device failure and lifetime in vivo.

Towards miniaturized closed-loop optogenetic stimulation devices

OBJECTIVE

Electrical brain stimulation provides therapeutic benefits for patients with drug-resistant neurological disorders. It, however, has restricted access to cell-type selectivity which limits its treatment effectiveness. Optogenetics, in contrast, enables precise targeting of a specific cell type which can address the issue with electrical brain stimulation. It, nonetheless, disregards real-time brain responses in delivering optimized stimulation to target cells. Closed-loop optogenetics, on the other hand, senses the difference between normal and abnormal states of the brain, and modulates stimulation parameters to achieve the desired stimulation outcome. Current review articles on closed-loop optogenetics have focused on its theoretical aspects and potential benefits. A review of the recent progress in miniaturized closed-loop optogenetic stimulation devices is thus needed.

APPROACH

This paper presents a comprehensive study on the existing miniaturized closed-loop optogenetic stimulation devices and their internal components.

MAIN RESULTS

Hardware components of closed-loop optogenetic stimulation devices including electrode, light-guiding mechanism, optical source, neural recorder, and optical stimulator are discussed. Next, software modules of closed-loop optogenetic stimulation devices including feature extraction, classification, control, and stimulation parameter modulation are described. Then, the existing devices are categorized into open-loop and closed-loop groups, and the combined operation of their neural recorder, optical stimulator, and control approach is discussed. Finally, the challenges in the design and implementation of closed-loop optogenetic stimulation devices are presented, suggestions on how to tackle these challenges are given, and future directions for closed-loop optogenetics are stated.

SIGNIFICANCE

A generic architecture for closed-loop optogenetic stimulation devices involving both hardware and software perspectives is devised. A comprehensive investigation into the most current miniaturized and tetherless closed-loop optogenetic stimulation devices is given. A detailed comparison of the closed-loop optogenetic stimulation devices is presented.

The brain during free movement - What can we learn from the animal model

Animals, just like humans, can freely move. They do so for various important reasons, such as finding food and escaping predators. Observing these behaviors can inform us about the underlying cognitive processes. In addition, while humans can convey complicated information easily through speaking, animals need to move their bodies to communicate. This has prompted many creative solutions by animal neuroscientists to enable studying the brain during movement. In this review, we first summarize how animal researchers record from the brain while an animal is moving, by describing the most common neural recording techniques in animals and how they were adapted to record during movement. We further discuss the challenge of controlling or monitoring sensory input during free movement. However, not only is free movement a necessity to reflect the outcome of certain internal cognitive processes in animals, it is also a fascinating field of research since certain crucial behavioral patterns can only be observed and studied during free movement. Therefore, in a second part of the review, we focus on some key findings in animal research that specifically address the interaction between free movement and brain activity. First, focusing on walking as a fundamental form of free movement, we discuss how important such intentional movements are for understanding processes as diverse as spatial navigation, active sensing, and complex motor planning. Second, we propose the idea of regarding free movement as the expression of a behavioral state. This view can help to understand the general influence of movement on brain function. Together, the technological advancements towards recording from the brain during movement, and the scientific questions asked about the brain engaged in movement, make animal research highly valuable to research into the human "moving brain".

An engineered home environment for untethered data telemetry from nonhuman primates

BACKGROUND

Wireless neural recording technologies now provide untethered access to large populations of neurons in the nonhuman primate brain. Such technologies enable long-term, continuous interrogation of neural circuits and importantly open the door for chronic neurorehabilitation platforms. For example, by providing continuous consistent closed loop feedback from a brain machine interface, the nervous system can leverage plasticity to integrate more effectively into the system than would be possible in short experimental sessions. However, to fully realize this opportunity necessitates the development of experimental environments that do not hinder wireless data transmission. Traditional nonhuman primate metal cage construction, while durable and standardized around the world, prevents data transmission at the frequencies necessary for high-bandwidth data transfer.

NEW METHOD

To overcome this limitation, we have engineered and constructed a radio-frequency transparent home environment for nonhuman primates using primarily non-conductive materials.

RESULTS

Computational modeling and empirical testing were performed to demonstrate the behavior of transmitted signals passing through the enclosure. In addition, neural data were successfully recorded from a freely behaving nonhuman primate inside the housing system.

COMPARISON WITH EXISTING METHODS

Our design outperforms standard metallic home cages by allowing radiation to transmit beyond its boundaries, without significant interference, while simultaneously maintaining the mechanical and operational integrity of existing commercial home cages.

CONCLUSIONS

Continuous access to neural signals in combination with other bio-potential and kinematic sensors will empower new insights into unrestrained behavior, aid the development of advanced neural prostheses, and enable neurorehabilitation strategies to be employed outside traditional environments.

Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation

Brain-machine interfaces (BMIs) combine methods, approaches, and concepts derived from neurophysiology, computer science, and engineering in an effort to establish real-time bidirectional links between living brains and artificial actuators. Although theoretical propositions and some proof of concept experiments on directly linking the brains with machines date back to the early 1960s, BMI research only took off in earnest at the end of the 1990s, when this approach became intimately linked to new neurophysiological methods for sampling large-scale brain activity. The classic goals of BMIs are 1) to unveil and utilize principles of operation and plastic properties of the distributed and dynamic circuits of the brain and 2) to create new therapies to restore mobility and sensations to severely disabled patients. Over the past decade, a wide range of BMI applications have emerged, which considerably expanded these original goals. BMI studies have shown neural control over the movements of robotic and virtual actuators that enact both upper and lower limb functions. Furthermore, BMIs have also incorporated ways to deliver sensory feedback, generated from external actuators, back to the brain. BMI research has been at the forefront of many neurophysiological discoveries, including the demonstration that, through continuous use, artificial tools can be assimilated by the primate brain's body schema. Work on BMIs has also led to the introduction of novel neurorehabilitation strategies. As a result of these efforts, long-term continuous BMI use has been recently implicated with the induction of partial neurological recovery in spinal cord injury patients.

Implantable neurotechnologies: a review of integrated circuit neural amplifiers

Neural signal recording is critical in modern day neuroscience research and emerging neural prosthesis programs. Neural recording requires the use of precise, low-noise amplifier systems to acquire and condition the weak neural signals that are transduced through electrode interfaces. Neural amplifiers and amplifier-based systems are available commercially or can be designed in-house and fabricated using integrated circuit (IC) technologies, resulting in very large-scale integration or application-specific integrated circuit solutions. IC-based neural amplifiers are now used to acquire untethered/portable neural recordings, as they meet the requirements of a miniaturized form factor, light weight and low power consumption. Furthermore, such miniaturized and low-power IC neural amplifiers are now being used in emerging implantable neural prosthesis technologies. This review focuses on neural amplifier-based devices and is presented in two interrelated parts. First, neural signal recording is reviewed, and practical challenges are highlighted. Current amplifier designs with increased functionality and performance and without penalties in chip size and power are featured. Second, applications of IC-based neural amplifiers in basic science experiments (e.g., cortical studies using animal models), neural prostheses (e.g., brain/nerve machine interfaces) and treatment of neuronal diseases (e.g., DBS for treatment of epilepsy) are highlighted. The review concludes with future outlooks of this technology and important challenges with regard to neural signal amplification.

Enabling Low-Power, Multi-Modal Neural Interfaces Through a Common, Low-Bandwidth Feature Space

Brain-Machine Interfaces (BMIs) have shown great potential for generating prosthetic control signals. Translating BMIs into the clinic requires fully implantable, wireless systems; however, current solutions have high power requirements which limit their usability. Lowering this power consumption typically limits the system to a single neural modality, or signal type, and thus to a relatively small clinical market. Here, we address both of these issues by investigating the use of signal power in a single narrow frequency band as a decoding feature for extracting information from electrocorticographic (ECoG), electromyographic (EMG), and intracortical neural data. We have designed and tested the Multi-modal Implantable Neural Interface (MINI), a wireless recording system which extracts and transmits signal power in a single, configurable frequency band. In prerecorded datasets, we used the MINI to explore low frequency signal features and any resulting tradeoff between power savings and decoding performance losses. When processing intracortical data, the MINI achieved a power consumption 89.7% less than a more typical system designed to extract action potential waveforms. When processing ECoG and EMG data, the MINI achieved similar power reductions of 62.7% and 78.8%. At the same time, using the single signal feature extracted by the MINI, we were able to decode all three modalities with less than a 9% drop in accuracy relative to using high-bandwidth, modality-specific signal features. We believe this system architecture can be used to produce a viable, cost-effective, clinical BMI.

Wireless impedance measurements for monitoring peripheral vascular disease

Wireless microdevices powered by ultrasound energy have been fabricated to measure and telemeter tissue impedance spectrums for applications in peripheral vascular disease monitoring. The system is characterized by simplicity of the implant consisting of only two electrical components. Ex vivo testing shows the potential for constructing tissue impedance spectrum plots over the range from 10 Hz to 10 kHz by a device less than 1 mm in diameter and 1 cm long. The neurostimulator microdevice was powered by continuous waveform 650 kHz ultrasound with a swept-frequency amplitude modulation. The system was operated at safe ultrasound power levels on the order of 10-100 mW/cm(2). The device proved to be sensitive and able to measure tissue impedances over a broad range. Volume conducted signals carrying impedance information from the microdevice were remotely detected by surface biopotential electrodes.

Effect of bias voltage and temperature on lifetime of wireless neural interfaces with Al ₂O₃ and parylene bilayer encapsulation

The lifetime of neural interfaces is a critical challenge for chronic implantations, as therapeutic devices (e.g., neural prosthetics) will require decades of lifetime. We evaluated the lifetime of wireless Utah electrode array (UEA) based neural interfaces with a bilayer encapsulation scheme utilizing a combination of alumina deposited by Atomic Layer Deposition (ALD) and parylene C. Wireless integrated neural interfaces (INIs), equipped with recording version 9 (INI-R9) ASIC chips, were used to monitor the encapsulation performance through radio-frequency (RF) power and telemetry. The wireless devices were encapsulated with 52 nm of ALD Al2O3 and 6 μm of parylene C, and tested by soaking in phosphate buffered solution (PBS) at 57 °C for 4× accelerated lifetime testing. The INIs were also powered continuously through 2.765 MHz inductive power and forward telemetry link at unregulated 5 V. The bilayer encapsulated INIs were fully functional for ∼35 days (140 days at 37 °C equivalent) with consistent power-up frequencies (∼910 MHz), stable RF signal (∼-75 dBm), and 100 % command reception rate. This is ∼10 times of equivalent lifetime of INIs with parylene-only encapsulation (13 days) under same power condition at 37 °C. The bilayer coated INIs without continuous powering lasted over 1860 equivalent days (still working) at 37 °C. Those results suggest that bias stress is a significant factor to accelerate the failure of the encapsulated devices. The INIs failed completely within 5 days of the initial frequency shift of RF signal at 57 °C, which implied that the RF frequency shift is an early indicator of encapsulation/device failure.

A wireless transmission neural interface system for unconstrained non-human primates

OBJECTIVE

Studying the brain in large animal models in a restrained laboratory rig severely limits our capacity to examine brain circuits in experimental and clinical applications.

APPROACH

To overcome these limitations, we developed a high-fidelity 96-channel wireless system to record extracellular spikes and local field potentials from the neocortex. A removable, external case of the wireless device is attached to a titanium pedestal placed in the animal skull. Broadband neural signals are amplified, multiplexed, and continuously transmitted as TCP/IP data at a sustained rate of 24 Mbps. A Xilinx Spartan 6 FPGA assembles the digital signals into serial data frames for transmission at 20 kHz though an 802.11n wireless data link on a frequency-shift key-modulated signal at 5.7-5.8 GHz to a receiver up to 10 m away. The system is powered by two CR123A, 3 V batteries for 2 h of operation.

MAIN RESULTS

We implanted a multi-electrode array in visual area V4 of one anesthetized monkey (Macaca fascicularis) and in the dorsolateral prefrontal cortex (dlPFC) of a freely moving monkey (Macaca mulatta). The implanted recording arrays were electrically stable and delivered broadband neural data over a year of testing. For the first time, we compared dlPFC neuronal responses to the same set of stimuli (food reward) in restrained and freely moving conditions. Although we did not find differences in neuronal responses as a function of reward type in the restrained and unrestrained conditions, there were significant differences in correlated activity. This demonstrates that measuring neural responses in freely moving animals can capture phenomena that are absent in the traditional head-fixed paradigm.

SIGNIFICANCE

We implemented a wireless neural interface for multi-electrode recordings in freely moving non-human primates, which can potentially move systems neuroscience to a new direction by allowing one to record neural signals while animals interact with their environment.

Upper Body-Based Power Wheelchair Control Interface for Individuals With Tetraplegia

Many power wheelchair control interfaces are not sufficient for individuals with severely limited upper limb mobility. The majority of controllers that do not rely on coordinated arm and hand movements provide users a limited vocabulary of commands and often do not take advantage of the user's residual motion. We developed a body-machine interface (BMI) that leverages the flexibility and customizability of redundant control by using high dimensional changes in shoulder kinematics to generate proportional control commands for a power wheelchair. In this study, three individuals with cervical spinal cord injuries were able to control a power wheelchair safely and accurately using only small shoulder movements. With the BMI, participants were able to achieve their desired trajectories and, after five sessions driving, were able to achieve smoothness that was similar to the smoothness with their current joystick. All participants were twice as slow using the BMI however improved with practice. Importantly, users were able to generalize training controlling a computer to driving a power wheelchair, and employed similar strategies when controlling both devices. Overall, this work suggests that the BMI can be an effective wheelchair control interface for individuals with high-level spinal cord injuries who have limited arm and hand control.

Comparison of spike sorting and thresholding of voltage waveforms for intracortical brain-machine interface performance

OBJECTIVE

For intracortical brain-machine interfaces (BMIs), action potential voltage waveforms are often sorted to separate out individual neurons. If these neurons contain independent tuning information, this process could increase BMI performance. However, the sorting of action potentials ('spikes') requires high sampling rates and is computationally expensive. To explicitly define the difference between spike sorting and alternative methods, we quantified BMI decoder performance when using threshold-crossing events versus sorted action potentials.

APPROACH

We used data sets from 58 experimental sessions from two rhesus macaques implanted with Utah arrays. Data were recorded while the animals performed a center-out reaching task with seven different angles. For spike sorting, neural signals were sorted into individual units by using a mixture of Gaussians to cluster the first four principal components of the waveforms. For thresholding events, spikes that simply crossed a set threshold were retained. We decoded the data offline using both a Naïve Bayes classifier for reaching direction and a linear regression to evaluate hand position.

MAIN RESULTS

We found the highest performance for thresholding when placing a threshold between -3 and -4.5 × Vrms. Spike sorted data outperformed thresholded data for one animal but not the other. The mean Naïve Bayes classification accuracy for sorted data was 88.5% and changed by 5% on average when data were thresholded. The mean correlation coefficient for sorted data was 0.92, and changed by 0.015 on average when thresholded.

SIGNIFICANCE

For prosthetics applications, these results imply that when thresholding is used instead of spike sorting, only a small amount of performance may be lost. The utilization of threshold-crossing events may significantly extend the lifetime of a device because these events are often still detectable once single neurons are no longer isolated.

A programmable closed-loop recording and stimulating wireless system for behaving small laboratory animals

A portable 16-channels microcontroller-based wireless system for a bi-directional interaction with the central nervous system is presented in this work. The device is designed to be used with freely behaving small laboratory animals and allows recording of spontaneous and evoked neural activity wirelessly transmitted and stored on a personal computer. Biphasic current stimuli with programmable duration, frequency and amplitude may be triggered in real-time on the basis of the recorded neural activity as well as by the animal behavior within a specifically designed experimental setup. An intuitive graphical user interface was developed to configure and to monitor the whole system. The system was successfully tested through bench tests and in vivo measurements on behaving rats chronically implanted with multi-channels microwire arrays.

Simultaneous real-time monitoring of multiple cortical systems

OBJECTIVE

Real-time monitoring of the brain is potentially valuable for performance monitoring, communication, training or rehabilitation. In natural situations, the brain performs a complex mix of various sensory, motor or cognitive functions. Thus, real-time brain monitoring would be most valuable if (a) it could decode information from multiple brain systems simultaneously, and (b) this decoding of each brain system were robust to variations in the activity of other (unrelated) brain systems. Previous studies showed that it is possible to decode some information from different brain systems in retrospect and/or in isolation. In our study, we set out to determine whether it is possible to simultaneously decode important information about a user from different brain systems in real time, and to evaluate the impact of concurrent activity in different brain systems on decoding performance.

APPROACH

We study these questions using electrocorticographic signals recorded in humans. We first document procedures for generating stable decoding models given little training data, and then report their use for offline and for real-time decoding from 12 subjects (six for offline parameter optimization, six for online experimentation). The subjects engage in tasks that involve movement intention, movement execution and auditory functions, separately, and then simultaneously. Main Results: Our real-time results demonstrate that our system can identify intention and movement periods in single trials with an accuracy of 80.4% and 86.8%, respectively (where 50% would be expected by chance). Simultaneously, the decoding of the power envelope of an auditory stimulus resulted in an average correlation coefficient of 0.37 between the actual and decoded power envelopes. These decoders were trained separately and executed simultaneously in real time.

SIGNIFICANCE

This study yielded the first demonstration that it is possible to decode simultaneously the functional activity of multiple independent brain systems. Our comparison of univariate and multivariate decoding strategies, and our analysis of the influence of their decoding parameters, provides benchmarks and guidelines for future research on this topic.

Implanted miniaturized antenna for brain computer interface applications: analysis and design

Implantable Brain Computer Interfaces (BCIs) are designed to provide real-time control signals for prosthetic devices, study brain function, and/or restore sensory information lost as a result of injury or disease. Using Radio Frequency (RF) to wirelessly power a BCI could widely extend the number of applications and increase chronic in-vivo viability. However, due to the limited size and the electromagnetic loss of human brain tissues, implanted miniaturized antennas suffer low radiation efficiency. This work presents simulations, analysis and designs of implanted antennas for a wireless implantable RF-powered brain computer interface application. The results show that thin (on the order of 100 micrometers thickness) biocompatible insulating layers can significantly impact the antenna performance. The proper selection of the dielectric properties of the biocompatible insulating layers and the implantation position inside human brain tissues can facilitate efficient RF power reception by the implanted antenna. While the results show that the effects of the human head shape on implanted antenna performance is somewhat negligible, the constitutive properties of the brain tissues surrounding the implanted antenna can significantly impact the electrical characteristics (input impedance, and operational frequency) of the implanted antenna. Three miniaturized antenna designs are simulated and demonstrate that maximum RF power of up to 1.8 milli-Watts can be received at 2 GHz when the antenna implanted around the dura, without violating the Specific Absorption Rate (SAR) limits.

A freely-moving monkey treadmill model

OBJECTIVE

Motor neuroscience and brain-machine interface (BMI) design is based on examining how the brain controls voluntary movement, typically by recording neural activity and behavior from animal models. Recording technologies used with these animal models have traditionally limited the range of behaviors that can be studied, and thus the generality of science and engineering research. We aim to design a freely-moving animal model using neural and behavioral recording technologies that do not constrain movement.

APPROACH

We have established a freely-moving rhesus monkey model employing technology that transmits neural activity from an intracortical array using a head-mounted device and records behavior through computer vision using markerless motion capture. We demonstrate the flexibility and utility of this new monkey model, including the first recordings from motor cortex while rhesus monkeys walk quadrupedally on a treadmill.

MAIN RESULTS

Using this monkey model, we show that multi-unit threshold-crossing neural activity encodes the phase of walking and that the average firing rate of the threshold crossings covaries with the speed of individual steps. On a population level, we find that neural state-space trajectories of walking at different speeds have similar rotational dynamics in some dimensions that evolve at the step rate of walking, yet robustly separate by speed in other state-space dimensions.

SIGNIFICANCE

Freely-moving animal models may allow neuroscientists to examine a wider range of behaviors and can provide a flexible experimental paradigm for examining the neural mechanisms that underlie movement generation across behaviors and environments. For BMIs, freely-moving animal models have the potential to aid prosthetic design by examining how neural encoding changes with posture, environment and other real-world context changes. Understanding this new realm of behavior in more naturalistic settings is essential for overall progress of basic motor neuroscience and for the successful translation of BMIs to people with paralysis.

Minimum requirements for accurate and efficient real-time on-chip spike sorting

BACKGROUND

Extracellular recordings are performed by inserting electrodes in the brain, relaying the signals to external power-demanding devices, where spikes are detected and sorted in order to identify the firing activity of different putative neurons. A main caveat of these recordings is the necessity of wires passing through the scalp and skin in order to connect intracortical electrodes to external amplifiers. The aim of this paper is to evaluate the feasibility of an implantable platform (i.e., a chip) with the capability to wirelessly transmit the neural signals and perform real-time on-site spike sorting.

NEW METHOD

We computationally modelled a two-stage implementation for online, robust, and efficient spike sorting. In the first stage, spikes are detected on-chip and streamed to an external computer where mean templates are created and sent back to the chip. In the second stage, spikes are sorted in real-time through template matching.

RESULTS

We evaluated this procedure using realistic simulations of extracellular recordings and describe a set of specifications that optimise performance while keeping to a minimum the signal requirements and the complexity of the calculations.

COMPARISON WITH EXISTING METHODS

A key bottleneck for the development of long-term BMIs is to find an inexpensive method for real-time spike sorting. Here, we simulated a solution to this problem that uses both offline and online processing of the data.

CONCLUSIONS

Hardware implementations of this method therefore enable low-power long-term wireless transmission of multiple site extracellular recordings, with application to wireless BMIs or closed-loop stimulation designs.

Chronic, wireless recordings of large-scale brain activity in freely moving rhesus monkeys

Advances in techniques for recording large-scale brain activity contribute to both the elucidation of neurophysiological principles and the development of brain-machine interfaces (BMIs). Here we describe a neurophysiological paradigm for performing tethered and wireless large-scale recordings based on movable volumetric three-dimensional (3D) multielectrode implants. This approach allowed us to isolate up to 1,800 units per animal and simultaneously record the extracellular activity of close to 500 cortical neurons, distributed across multiple cortical areas, in freely behaving rhesus monkeys. The method is expandable, in principle, to thousands of simultaneously recorded channels. It also allows increased recording longevity (5 consecutive years), and recording of a broad range of behaviors, e.g. social interactions, and BMI paradigms in freely moving primates. We propose that wireless large-scale recordings could have a profound impact on basic primate neurophysiology research, while providing a framework for the development and testing of clinically relevant neuroprostheses.

Long-term reliability of Al2O3 and Parylene C bilayer encapsulated Utah electrode array based neural interfaces for chronic implantation

OBJECTIVE

We focus on improving the long-term stability and functionality of neural interfaces for chronic implantation by using bilayer encapsulation.

APPROACH

We evaluated the long-term reliability of Utah electrode array (UEA) based neural interfaces encapsulated by 52 nm of atomic layer deposited Al2O3 and 6 µm of Parylene C bilayer, and compared these to devices with the baseline Parylene-only encapsulation. Three variants of arrays including wired, wireless, and active UEAs were used to evaluate this bilayer encapsulation scheme, and were immersed in phosphate buffered saline (PBS) at 57 °C for accelerated lifetime testing.

MAIN RESULTS

The median tip impedance of the bilayer encapsulated wired UEAs increased from 60 to 160 kΩ during the 960 days of equivalent soak testing at 37 °C, the opposite trend to that typically observed for Parylene encapsulated devices. The loss of the iridium oxide tip metallization and etching of the silicon tip in PBS solution contributed to the increase of impedance. The lifetime of fully integrated wireless UEAs was also tested using accelerated lifetime measurement techniques. The bilayer coated devices had stable power-up frequencies at ∼910 MHz and constant radio-frequency signal strength of -50 dBm during up to 1044 days (still under testing) of equivalent soaking time at 37 °C. This is a significant improvement over the lifetime of ∼100 days achieved with Parylene-only encapsulation at 37 °C. The preliminary samples of bilayer coated active UEAs with a flip-chip bonded ASIC chip had a steady current draw of ∼3 mA during 228 days of soak testing at 37 °C. An increase in the current draw has been consistently correlated to device failures, so is a sensitive metric for their lifetime.

SIGNIFICANCE

The trends of increasing electrode impedance of wired devices and performance stability of wireless and active devices support the significantly greater encapsulation performance of this bilayer encapsulation compared with Parylene-only encapsulation. The bilayer encapsulation should significantly improve the in vivo lifetime of neural interfaces for chronic implantation.

Rodent scope: a user-configurable digital wireless telemetry system for freely behaving animals

This paper describes the design and implementation of a wireless neural telemetry system that enables new experimental paradigms, such as neural recordings during rodent navigation in large outdoor environments. RoSco, short for Rodent Scope, is a small lightweight user-configurable module suitable for digital wireless recording from freely behaving small animals. Due to the digital transmission technology, RoSco has advantages over most other wireless modules of noise immunity and online user-configurable settings. RoSco digitally transmits entire neural waveforms for 14 of 16 channels at 20 kHz with 8-bit encoding which are streamed to the PC as standard USB audio packets. Up to 31 RoSco wireless modules can coexist in the same environment on non-overlapping independent channels. The design has spatial diversity reception via two antennas, which makes wireless communication resilient to fading and obstacles. In comparison with most existing wireless systems, this system has online user-selectable independent gain control of each channel in 8 factors from 500 to 32,000 times, two selectable ground references from a subset of channels, selectable channel grounding to disable noisy electrodes, and selectable bandwidth suitable for action potentials (300 Hz-3 kHz) and low frequency field potentials (4 Hz-3 kHz). Indoor and outdoor recordings taken from freely behaving rodents are shown to be comparable to a commercial wired system in sorting for neural populations. The module has low input referred noise, battery life of 1.5 hours and transmission losses of 0.1% up to a range of 10 m.

Sensors and decoding for intracortical brain computer interfaces

Intracortical brain computer interfaces (iBCIs) are being developed to enable people to drive an output device, such as a computer cursor, directly from their neural activity. One goal of the technology is to help people with severe paralysis or limb loss. Key elements of an iBCI are the implanted sensor that records the neural signals and the software that decodes the user's intended movement from those signals. Here, we focus on recent advances in these two areas, placing special attention on contributions that are or may soon be adopted by the iBCI research community. We discuss how these innovations increase the technology's capability, accuracy, and longevity, all important steps that are expanding the range of possible future clinical applications.

Multi-coil approach to reduce electromagnetic energy absorption for wirelessly powered implants

Near-field inductive coupling is a commonly used technique for wireless power transfer (WPT) in biomedical implants. Owing to the close proximity of the implant coil(s) with the tissue ( ∼1 mm) and high current ( ∼100-300 mA) in the magnetic coil(s), a significant induced electric field can be generated for the operating frequency (1-20 MHz). In this Letter, a multi-coil-based WPT technique is proposed to selectively control the currents in the external and implant coils to reduce the specific absorption rate (SAR). A three-coil WPT system, that can achieve 26% reduction in peak 1-g SAR and 15% reduction in peak 10-g SAR, as compared to a two-coil WPT system with the same dimensions, is implemented and used to demonstrate the effectiveness of the proposed approach. To achieve the seamless design for the external and implant electronics, the multi-coil system achieves the same voltage gain and bandwidth as the two-coil design with 46% improvement in the power transfer efficiency.

Current challenges to the clinical translation of brain machine interface technology

Development of neural prostheses over the past few decades has produced a number of clinically relevant brain-machine interfaces (BMIs), such as the cochlear prostheses and deep brain stimulators. Current research pursues the restoration of communication or motor function to individuals with neurological disorders. Efforts in the field, such as the BrainGate trials, have already demonstrated that such interfaces can enable humans to effectively control external devices with neural signals. However, a number of significant issues regarding BMI performance, device capabilities, and surgery must be resolved before clinical use of BMI technology can become widespread. This chapter reviews challenges to clinical translation and discusses potential solutions that have been reported in recent literature, with focuses on hardware reliability, state-of-the-art decoding algorithms, and surgical considerations during implantation.

A framework for relating neural activity to freely moving behavior

Two research communities, motor systems neuroscience and motor prosthetics, examine the relationship between neural activity in the motor cortex and movement. The former community aims to understand how the brain controls and generates movement; the latter community focuses on how to decode neural activity as control signals for a prosthetic cursor or limb. Both have made progress toward understanding the relationship between neural activity in the motor cortex and behavior. However, these findings are tested using animal models in an environment that constrains behavior to simple, limited movements. These experiments show that, in constrained settings, simple reaching motions can be decoded from small populations of spiking neurons. It is unclear whether these findings hold for more complex, full-body behaviors in unconstrained settings. Here we present the results of freely-moving behavioral experiments from a monkey with simultaneous intracortical recording. We investigated neural firing rates while the monkey performed various tasks such as walking on a treadmill, reaching for food, and sitting idly. We show that even in such an unconstrained and varied context, neural firing rates are well tuned to behavior, supporting findings of basic neuroscience. Further, we demonstrate that the various behavioral tasks can be reliably classified with over 95% accuracy, illustrating the viability of decoding techniques despite significant variation and environmental distractions associated with unconstrained behavior. Such encouraging results hint at potential utility of the freely-moving experimental paradigm.

Continuous Time Level Crossing Sampling ADC for Bio-Potential Recording Systems

In this paper we present a fixed window level crossing sampling analog to digital convertor for bio-potential recording sensors. This is the first proposed and fully implemented fixed window level crossing ADC without local DACs and clocks. The circuit is designed to reduce data size, power, and silicon area in future wireless neurophysiological sensor systems. We built a testing system to measure bio-potential signals and used it to evaluate the performance of the circuit. The bio-potential amplifier offers a gain of 53 dB within a bandwidth of 200 Hz-20 kHz. The input-referred rms noise is 2.8 µV. In the asynchronous level crossing ADC, the minimum delta resolution is 4 mV. The input signal frequency of the ADC is up to 5 kHz. The system was fabricated using the AMI 0.5 µm CMOS process. The chip size is 1.5 mm by 1.5 mm. The power consumption of the 4-channel system from a 3.3 V supply is 118.8 µW in the static state and 501.6 µW with a 240 kS/s sampling rate. The conversion efficiency is 1.6 nJ/conversion.

Design and validation of a real-time spiking-neural-network decoder for brain-machine interfaces

OBJECTIVE

Cortically-controlled motor prostheses aim to restore functions lost to neurological disease and injury. Several proof of concept demonstrations have shown encouraging results, but barriers to clinical translation still remain. In particular, intracortical prostheses must satisfy stringent power dissipation constraints so as not to damage cortex.

APPROACH

One possible solution is to use ultra-low power neuromorphic chips to decode neural signals for these intracortical implants. The first step is to explore in simulation the feasibility of translating decoding algorithms for brain-machine interface (BMI) applications into spiking neural networks (SNNs).

MAIN RESULTS

Here we demonstrate the validity of the approach by implementing an existing Kalman-filter-based decoder in a simulated SNN using the Neural Engineering Framework (NEF), a general method for mapping control algorithms onto SNNs. To measure this system's robustness and generalization, we tested it online in closed-loop BMI experiments with two rhesus monkeys. Across both monkeys, a Kalman filter implemented using a 2000-neuron SNN has comparable performance to that of a Kalman filter implemented using standard floating point techniques.

SIGNIFICANCE

These results demonstrate the tractability of SNN implementations of statistical signal processing algorithms on different monkeys and for several tasks, suggesting that a SNN decoder, implemented on a neuromorphic chip, may be a feasible computational platform for low-power fully-implanted prostheses. The validation of this closed-loop decoder system and the demonstration of its robustness and generalization hold promise for SNN implementations on an ultra-low power neuromorphic chip using the NEF.

An implantable wireless neural interface for recording cortical circuit dynamics in moving primates

OBJECTIVE

Neural interface technology suitable for clinical translation has the potential to significantly impact the lives of amputees, spinal cord injury victims and those living with severe neuromotor disease. Such systems must be chronically safe, durable and effective.

APPROACH

We have designed and implemented a neural interface microsystem, housed in a compact, subcutaneous and hermetically sealed titanium enclosure. The implanted device interfaces the brain with a 510k-approved, 100-element silicon-based microelectrode array via a custom hermetic feedthrough design. Full spectrum neural signals were amplified (0.1 Hz to 7.8 kHz, 200× gain) and multiplexed by a custom application specific integrated circuit, digitized and then packaged for transmission. The neural data (24 Mbps) were transmitted by a wireless data link carried on a frequency-shift-key-modulated signal at 3.2 and 3.8 GHz to a receiver 1 m away by design as a point-to-point communication link for human clinical use. The system was powered by an embedded medical grade rechargeable Li-ion battery for 7 h continuous operation between recharge via an inductive transcutaneous wireless power link at 2 MHz.

MAIN RESULTS

Device verification and early validation were performed in both swine and non-human primate freely-moving animal models and showed that the wireless implant was electrically stable, effective in capturing and delivering broadband neural data, and safe for over one year of testing. In addition, we have used the multichannel data from these mobile animal models to demonstrate the ability to decode neural population dynamics associated with motor activity.

SIGNIFICANCE

We have developed an implanted wireless broadband neural recording device evaluated in non-human primate and swine. The use of this new implantable neural interface technology can provide insight into how to advance human neuroprostheses beyond the present early clinical trials. Further, such tools enable mobile patient use, have the potential for wider diagnosis of neurological conditions and will advance brain research.

A portable system for recording neural activity in indoor and outdoor environments

We present a self-contained portable USB based device that can amplify and record small bioelectric signals from insects and animals. The system combines a purpose built low noise amplifier with off the shelf components to provide a low cost low power system for recording electrophysiological signals. Using open source software the system is programmed as a simple USB device and can be connected to any USB capable computer for recording data. This simple and universal interface provides the ability to connect to a variety of systems. Open source acquisition software was also written to record signals under the linux operating system. Performance analysis shows that our device is able to record good quality signals both indoors and outdoors and delivers this performance at a very low cost. Compared to larger systems our device provides the additional advantage of portability given that it can fit into a pocket and costs a fraction of large systems used in electrophysiology labs.

On the design of efficient multi-coil telemetry system for biomedical implants

Two-coil based inductive coupling is a commonly used technique for wireless power and data transfer for biomedical implants. Because the source and load resistances are finite, two-coil systems generally achieve a relatively low power transfer efficiency. A novel multi-coil technique (using more than two coils) for wireless power and data transfer is considered to help overcoming this limitation. The proposed multi-coil system is formulated using both network theory and a two-port model. Using three or four coils for the wireless link allows for the source and load resistances to be decoupled from the Q-factor of the coils, resulting in a higher Q -factor and a corresponding improved power transfer efficiency (PTE). Moreover, due to the strong coupling between the driver and the transmitter coil (and/or between the receiver and the load coil), the multi-coil system achieves higher tunable frequency bandwidth as compared to its same sized two-coil equivalent. Because of the wider range of reflected impedance in the multi-coil system case, it is easier to tune the output power to the load and achieve the maximum power transfer condition for given source voltage than in a configuration with two coils. Experimental results showing a three-coil system achieving twice the efficiency and higher gain-bandwidth product compared to its two-coil counterpart are presented. In addition, a figure of merit for telemetry systems is defined to quantify the overall telemetry system performance.

Evaluation of the packaging and encapsulation reliability in fully integrated, fully wireless 100 channel Utah Slant Electrode Array (USEA): Implications for long term functionality

The encapsulation and packaging reliability in fully integrated, fully wireless 100 channel Utah Slant Electrode Array (USEA)/integrated neural interface-recording version 5 (INI-R5) has been evaluated by monitoring the extended long term in-vitro functional stability and recording longevity. The INI encapsulated with 6-μm Parylene-C was immersed in phosphate buffer saline (PBS) at room temperature for a period of over 12 months. The USEA/INI-R5, while being soaked was powered and configured wirelessly through 2.765 MHz inductive link and the transmitted frequency shift keying (FSK) modulated radio-frequency (RF) (900 MHz Industrial, scientific, medical-ISM band) signal was also recorded wirelessly as a function of soak time. In order to test the long term recording ability, in-vitro wireless recording was performed in agarose for few channels. The full functionality and the ability of the electrodes to record artificial neural signals even after 12 months of PBS soak provides a measure of encapsulation reliability, the functional and recording stability in fully integrated wireless neural interface and potential usefulness for future chronic implants.

A Fully Implantable, Programmable and Multimodal Neuroprocessor for Wireless, Cortically Controlled Brain-Machine Interface Applications

Reliability, scalability and clinical viability are of utmost importance in the design of wireless Brain Machine Interface systems (BMIs). This paper reports on the design and implementation of a neuroprocessor for conditioning raw extracellular neural signals recorded through microelectrode arrays chronically implanted in the brain of awake behaving rats. The neuroprocessor design exploits a sparse representation of the neural signals to combat the limited wireless telemetry bandwidth. We demonstrate a multimodal processing capability (monitoring, compression, and spike sorting) inherent in the neuroprocessor to support a wide range of scenarios in real experimental conditions. A wireless transmission link with rate-dependent compression strategy is shown to preserve information fidelity in the neural data. At 32 channels, the neuroprocessor has been fully implemented on a 5mm×5mm nano-FPGA, and the prototyping resulted in 5.19 mW power consumption, bringing its performance within the power-size constraints for clinical use. The optimal design for compression and sorting performance was evaluated for multiple sampling frequencies, wavelet basis choice and power consumption.

Computationally efficient neural feature extraction for spike sorting in implantable high-density recording systems

Modern microelectrode arrays acquire neural signals from hundreds of neurons in parallel that are subsequently processed for spike sorting. It is important to identify, extract, and transmit appropriate features that allow accurate spike sorting while using minimum computational resources. This paper describes a new set of spike sorting features, explicitly framed to be computationally efficient and shown to outperform principal component analysis (PCA)-based spike sorting. A hardware friendly architecture, feasible for implantation, is also presented for detecting neural spikes and extracting features to be transmitted for off chip spike classification. The proposed feature set does not require any off-chip training, and requires about 5% of computations as compared to the PCA-based features for the same classification accuracy, tested for spike trains with a broad range of signal-to-noise ratio. Our simulations show a reduction of required bandwidth to about 2% of original data rate, with an average classification accuracy of greater than 94% at a typical signal to noise ratio of 5 dB.