Compact standalone platform for neural recording with real-time spike sorting and data logging

Reconfigurable Resistive Switching Memory for Telegraph Code Sensing and Recognizing Reservoir Computing Systems

Reservoir computing (RC) system is based upon the reservoir layer, which non-linearly transforms input signals into high-dimensional states, facilitating simple training in the readout layer-a linear neural network. These layers require different types of devices-the former demonstrated as diffusive memristors and the latter prepared as drift memristors. The integration of these components can increase the structural complexity of RC system. Here, a reconfigurable resistive switching memory (RSM) capable of implementing both diffusive and drift dynamics is demonstrated. This reconfigurability is achieved by preparing a medium with a 3D ion transport channel (ITC), enabling precise control of the metal filament that determines memristor operation. The 3D ITC-RSM operates in a volatile threshold switching (TS) mode under a weak electric field and exhibits short-term dynamics that are confirmed to be applicable as reservoir elements in RC systems. Meanwhile, the 3D ITC-RSM operates in a non-volatile bipolar switching (BS) mode under a strong electric field, and the conductance modulation metrics forming the basis of synaptic weight update are validated, which can be utilized as readout elements in the readout layer. Finally, an RC system is designed for the application of reconfigurable 3D ITC-RSM, and performs real-time recognition on Morse code datasets.

An unsupervised real-time spike sorting system based on optimized OSort

Objective. The OSort algorithm, a pivotal unsupervised spike sorting method, has been implemented in dedicated hardware devices for real-time spike sorting. However, due to the inherent complexity of neural recording environments, OSort still grapples with numerous transient cluster occurrences during the practical sorting process. This leads to substantial memory usage, heavy computational load, and complex hardware architectures, especially in noisy recordings and multi-channel systems.Approach. This study introduces an optimized OSort algorithm (opt-OSort) which utilizes correlation coefficient (CC), instead of Euclidean distance as classification criterion. TheCCmethod not only bolsters the robustness of spike classification amidst the diverse and ever-changing conditions of physiological and recording noise environments, but also can finish the entire sorting procedure within a fixed number of cluster slots, thus preventing a large number of transient clusters. Moreover, the opt-OSort incorporates two configurable validation loops to efficiently reject cluster outliers and track recording variations caused by electrode drifting in real-time.Main results. The opt-OSort significantly reduces transient cluster occurrences by two orders of magnitude and decreases memory usage by 2.5-80 times in the number of pre-allocated transient clusters compared with other hardware implementations of OSort. The opt-OSort maintains an accuracy comparable to offline OSort and other commonly-used algorithms, with a sorting time of 0.68µs as measured by the hardware-implemented system in both simulated datasets and experimental data. The opt-OSort's ability to handle variations in neural activity caused by electrode drifting is also demonstrated.Significance. These results present a rapid, precise, and robust spike sorting solution suitable for integration into low-power, portable, closed-loop neural control systems and brain-computer interfaces.

Calibration-Free and Hardware-Efficient Neural Spike Detection for Brain Machine Interfaces

Recent translational efforts in brain-machine interfaces (BMI) are demonstrating the potential to help people with neurological disorders. The current trend in BMI technology is to increase the number of recording channels to the thousands, resulting in the generation of vast amounts of raw data. This in turn places high bandwidth requirements for data transmission, which increases power consumption and thermal dissipation of implanted systems. On-implant compression and/or feature extraction are therefore becoming essential to limiting this increase in bandwidth, but add further power constraints - the power required for data reduction must remain less than the power saved through bandwidth reduction. Spike detection is a common feature extraction technique used for intracortical BMIs. In this article, we develop a novel firing-rate-based spike detection algorithm that requires no external training and is hardware efficient and therefore ideally suited for real-time applications. Key performance and implementation metrics such as detection accuracy, adaptability in chronic deployment, power consumption, area utilization, and channel scalability are benchmarked against existing methods using various datasets. The algorithm is first validated using a reconfigurable hardware (FPGA) platform and then ported to a digital ASIC implementation in both 65 nm and 0.18 μm CMOS technologies. The 128-channel ASIC design implemented in a 65 nm CMOS technology occupies 0.096 mm2 silicon area and consumes 4.86 μW from a 1.2 V power supply. The adaptive algorithm achieves a 96% spike detection accuracy on a commonly used synthetic dataset, without the need for any prior training.

Multi-channel Wireless Implantable Brain-Computer Interface System

The implantable brain-computer interface has been widely used in recent years due to its great application potential and research value. Few neural implants have been designed to gather neural spikes, which require a higher sampling frequency than ECoG and LFPs. These systems are still constrained by low channel counts and their bulky size. Furthermore, wire connection is still used in many neural interfaces for further data analysis, facing challenges such as tissue infection, limited movement, and increased noise interference. To address the aforementioned problems, this paper presents a compact multi-channel wireless implantable brain-computer interface system that meets the requirements of spike signals collection and miniaturization. A WiFi module is utilized to transmit information between the system and terminal equipment to eliminate the tethering effects. A 128-channel signal acquisition module, consisting of two pieces of commercial digital electrophysiology amplifier chips, is designed to realize high channel counts for capturing spike events. The proposed system has successfully recorded the analog spike signals from a digital neural signal simulator.

From End to End: Gaining, Sorting, and Employing High-Density Neural Single Unit Recordings

The meaning behind neural single unit activity has constantly been a challenge, so it will persist in the foreseeable future. As one of the most sourced strategies, detecting neural activity in high-resolution neural sensor recordings and then attributing them to their corresponding source neurons correctly, namely the process of spike sorting, has been prevailing so far. Support from ever-improving recording techniques and sophisticated algorithms for extracting worthwhile information and abundance in clustering procedures turned spike sorting into an indispensable tool in electrophysiological analysis. This review attempts to illustrate that in all stages of spike sorting algorithms, the past 5 years innovations' brought about concepts, results, and questions worth sharing with even the non-expert user community. By thoroughly inspecting latest innovations in the field of neural sensors, recording procedures, and various spike sorting strategies, a skeletonization of relevant knowledge lays here, with an initiative to get one step closer to the original objective: deciphering and building in the sense of neural transcript.

Interleukin-4 receptor signaling modulates neuronal network activity

Evidence is emerging that immune responses not only play a part in the central nervous system (CNS) in diseases but may also be relevant for healthy conditions. We discovered a major role for the interleukin-4 (IL-4)/IL-4 receptor alpha (IL-4Rα) signaling pathway in synaptic processes, as indicated by transcriptome analysis in IL-4Rα–deficient mice and human neurons with/without IL-4 treatment. Moreover, IL-4Rα is expressed presynaptically, and locally available IL-4 regulates synaptic transmission. We found reduced synaptic vesicle pools, altered postsynaptic currents, and a higher excitatory drive in cortical networks of IL-4Rα–deficient neurons. Acute effects of IL-4 treatment on postsynaptic currents in wild-type neurons were mediated via PKCγ signaling release and led to increased inhibitory activity supporting the findings in IL-4Rα–deficient neurons. In fact, the deficiency of IL-4Rα resulted in increased network activity in vivo, accompanied by altered exploration and anxiety-related learning behavior; general learning and memory was unchanged. In conclusion, neuronal IL-4Rα and its presynaptic prevalence appear relevant for maintaining homeostasis of CNS synaptic function.

Closed-loop sacral neuromodulation for bladder function using dorsal root ganglia sensory feedback in an anesthetized feline model

Overactive bladder patients suffer from a frequent, uncontrollable urge to urinate, which can lead to a poor quality of life. We aim to improve open-loop sacral neuromodulation therapy by developing a conditional stimulation paradigm using neural recordings from dorsal root ganglia (DRG) as sensory feedback. Experiments were performed in 5 anesthetized felines. We implemented a Kalman filter-based algorithm to estimate the bladder pressure in real-time using sacral-level DRG neural recordings and initiated sacral root electrical stimulation when the algorithm detected an increase in bladder pressure. Closed-loop neuromodulation was performed during continuous cystometry and compared to bladder fills with continuous and no stimulation. Overall, closed-loop stimulation increased bladder capacity by 13.8% over no stimulation (p < 0.001) and reduced stimulation time versus continuous stimulation by 57.7%. High-confidence bladder single units had a reduced sensitivity during stimulation, with lower linear trendline fits and higher pressure thresholds for firing observed during stimulation trials. This study demonstrates the utility of decoding bladder pressure from neural activity for closed-loop control of sacral neuromodulation. An underlying mechanism for sacral neuromodulation may be a reduction in bladder sensory neuron activity during stimulation. Real-time validation during behavioral studies is necessary prior to clinical translation of closed-loop sacral neuromodulation.

Materials for Implantable Surface Electrode Arrays: Current Status and Future Directions

Surface electrode arrays are mainly fabricated from rigid or elastic materials, and precisely manipulated ductile metal films, which offer limited stretchability. However, the living tissues to which they are applied are nonlinear viscoelastic materials, which can undergo significant mechanical deformation in dynamic biological environments. Further, the same arrays and compositions are often repurposed for vastly different tissues rather than optimizing the materials and mechanical properties of the implant for the target application. By first characterizing the desired biological environment, and then designing a technology for a particular organ, surface electrode arrays may be more conformable, and offer better interfaces to tissues while causing less damage. Here, the various materials used in each component of a surface electrode array are first reviewed, and then electrically active implants in three specific biological systems, the nervous system, the muscular system, and skin, are described. Finally, the fabrication of next-generation surface arrays that overcome current limitations is discussed.

A Neuromorphic Brain Interface based on RRAM Crossbar Arrays for High Throughput Real-time Spike Sorting

Real-time spike sorting and processing are crucial for closed-loop brain-machine interfaces and neural prosthetics. Recent developments in high-density multi-electrode arrays with hundreds of electrodes have enabled simultaneous recordings of spikes from a large number of neurons. However, the high channel count imposes stringent demands on real-time spike sorting hardware regarding data transmission bandwidth and computation complexity. Thus, it is necessary to develop a specialized real-time hardware that can sort neural spikes on the fly with high throughputs while consuming minimal power. Here, we present a real-time, low latency spike sorting processor that utilizes high-density CuO_x resistive crossbars to implement in-memory spike sorting in a massively parallel manner. We developed a fabrication process which is compatible with CMOS BEOL integration. We extensively characterized switching characteristics and statistical variations of the CuO_x memory devices. In order to implement spike sorting with crossbar arrays, we developed a template matching-based spike sorting algorithm that can be directly mapped onto RRAM crossbars. By using synthetic and in vivo recordings of extracellular spikes, we experimentally demonstrated energy efficient spike sorting with high accuracy. Our neuromorphic interface offers substantial improvements in area (~1000× less area), power (~200× less power), and latency (4.8μs latency for sorting 100 channels) for real-time spike sorting compared to other hardware implementations based on FPGAs and microcontrollers.

Algorithm and hardware considerations for real-time neural signal on-implant processing

Objective Various on-workstation neural-spike-based brain machine interface(BMI) systems have reached the point of in-human trials, but on-node and on-implant BMI systems are still under exploration. Such systems are constrained by the area and battery. Researchers should consider the algorithm complexity, available resources, power budgets, CMOS technologies, and the choice of platforms when designing BMI systems. However, the effect of these factors is currently still unclear. Approaches. Here we have proposed a novel real-time 128 channel spike detection algorithm and optimised it on Microcontroller(MCU) and Field Programmable Gate Array(FPGA) platforms towards consuming minimal power and memory/resources. It is presented as a use case to explore the different considerations in system design. Main results. The proposed spike detection algorithm achieved over 97% sensitivity and a smaller than 3% false detection rate. The MCU implementation occupies less than 3KB RAM and consumes 31.5μW/ch. The FPGA platform only occupies 299 logic cells and 3KB RAM for 128 channels and consumes 0.04μW/ch. Significance. On the spike detection algorithm front, we have eliminated the processing bottleneck by reducing the dynamic power consumption to lower than the hardware static power, without sacrificing detection performance. More importantly, we have explored the considerations in algorithm and hardware design with respect to scalability, portability, and costs. These findings can facilitate and guide the future development of real-time on-implant neural signal processing platforms.

Implantable brain machine interfaces: first-in-human studies, technology challenges and trends

Implantable brain machine interfaces (BMIs) are now on a trajectory to go mainstream, wherein what was once considered last resort will progressively become elective at earlier stages in disease treatment. First-in-human successes have demonstrated the ability to decode highly dexterous motor skills such as handwriting, and speech from human cortical activity. These have been used for cursor and prosthesis control, direct-to-text communication and speech synthesis. Along with these breakthrough studies, technology advancements have enabled the observation of more channels of neural activity through new concepts for centralised/distributed implant architectures. This is complemented by research in flexible substrates, packaging, surgical workflows and data processing. New regulatory guidance and funding has galvanised the field. This culmination of resource, efforts and capability is now attracting significant investment for BMI commercialisation. This paper reviews recent developments and describes the paradigm shift in BMI development that is leading to new innovations, insights and BMI translation.

A Closed-Loop Optogenetic Platform

Neuromodulation is an established treatment for numerous neurological conditions, but to expand the therapeutic scope there is a need to improve the spatial, temporal and cell-type specificity of stimulation. Optogenetics is a promising area of current research, enabling optical stimulation of genetically-defined cell types without interfering with concurrent electrical recording for closed-loop control of neural activity. We are developing an open-source system to provide a platform for closed-loop optogenetic neuromodulation, incorporating custom integrated circuitry for recording and stimulation, real-time closed-loop algorithms running on a microcontroller and experimental control via a PC interface. We include commercial components to validate performance, with the ultimate aim of translating this approach to humans. In the meantime our system is flexible and expandable for use in a variety of preclinical neuroscientific applications. The platform consists of a Controlling Abnormal Network Dynamics using Optogenetics (CANDO) Control System (CS) that interfaces with up to four CANDO headstages responsible for electrical recording and optical stimulation through custom CANDO LED optrodes. Control of the hardware, inbuilt algorithms and data acquisition is enabled via the CANDO GUI (Graphical User Interface). Here we describe the design and implementation of this system, and demonstrate how it can be used to modulate neuronal oscillations in vitro and in vivo.

Do not waste your electrodes-principles of optimal electrode geometry for spike sorting

Objective. This study examines how the geometrical arrangement of electrodes influences spike sorting efficiency, and attempts to formalise principles for the design of electrode systems enabling optimal spike sorting performance.Approach. The clustering performance of KlustaKwik, a popular toolbox, was evaluated using semi-artificial multi-channel data, generated from a library of real spike waveforms recorded in the CA1 region of mouse Hippocampusin vivo.Main results. Based on spike sorting results under various channel configurations and signal levels, a simple model was established to describe the efficiency of different electrode geometries. Model parameters can be inferred from existing spike waveform recordings, which allowed quantifying both the cooperative effect between channels and the noise dependence of clustering performance.Significance. Based on the model, analytical and numerical results can be derived for the optimal spacing and arrangement of electrodes for one- and two-dimensional electrode systems, targeting specific brain areas.

Adaptive spike detection and hardware optimization towards autonomous, high-channel-count BMIs

BACKGROUND

The progress in microtechnology has enabled an exponential trend in the number of neurons that can be simultaneously recorded. The data bandwidth requirement is however increasing with channel count. The vast majority of experimental work involving electrophysiology stores the raw data and then processes this offline; to detect the underlying spike events. Emerging applications however require new methods for local, real-time processing.

NEW METHODS

We have developed an adaptive, low complexity spike detection algorithm that combines three novel components for: (1) removing the local field potentials; (2) enhancing the signal-to-noise ratio; and (3) computing an adaptive threshold. The proposed algorithm has been optimised for hardware implementation (i.e. minimising computations, translating to a fixed-point implementation), and demonstrated on low-power embedded targets.

MAIN RESULTS

The algorithm has been validated on both synthetic datasets and real recordings yielding a detection sensitivity of up to 90%. The initial hardware implementation using an off-the-shelf embedded platform demonstrated a memory requirement of less than 0.1 kb ROM and 3 kb program flash, consuming an average power of 130 μW.

COMPARISON WITH EXISTING METHODS

The method presented has the advantages over other approaches, that it allows spike events to be robustly detected in real-time from neural activity in a completely autonomous way, without the need for any calibration, and can be implemented with low hardware resources.

CONCLUSION

The proposed method can detect spikes effectively and adaptively. It alleviates the need for re-calibration, which is critical towards achieving a viable BMI, and more so with future 'high bandwidth' systems' targeting 1000s of channels.

SenseBack - An Implantable System for Bidirectional Neural Interfacing

Chronic in-vivo neurophysiology experiments require highly miniaturized, remotely powered multi-channel neural interfaces which are currently lacking in power or flexibility post implantation. To resolve this problem we present the SenseBack system, a post-implantation reprogrammable wireless 32-channel bidirectional neural interfacing device that can enable chronic peripheral electrophysiology experiments in freely behaving small animals. The large number of channels for a peripheral neural interface, coupled with fully implantable hardware and complete software flexibility enable complex in-vivo studies where the system can adapt to evolving study needs as they arise. In complementary \textit{ex-vivo} and \textit{in-vivo} preparations, we demonstrate that this system can record neural signals and perform high-voltage, bipolar stimulation on any channel. In addition, we demonstrate transcutaneous power delivery and Bluetooth 5 data communication with a PC. The SenseBack system is capable of stimulation on any channel with 20 V of compliance and up to 315 A of current, and highly configurable recording with per-channel adjustable gain and filtering with 8 sets of 10-bit ADCs to sample data at 20 kHz for each channel. To our knowledge this is the first such implantable research platform offering this level of performance and flexibility post-implantation (including complete reprogramming even after encapsulation) for small animal electrophysiology. Here we present initial acute trials, demonstrations and progress towards a system that we expect to enable a wide range of electrophysiology experiments in freely behaving animals.

Spatial Information Based OSort for Real-Time Spike Sorting Using FPGA

OBJECTIVE

Spiking activity of individual neurons can be separated from the acquired multi-unit activity with spike sorting methods. Processing the recorded high-dimensional neural data can take a large amount of time when performed on general-purpose computers.

METHODS

In this paper, an FPGA-based real-time spike sorting system is presented which takes into account the spatial correlation between the electrical signals recorded with closely-packed recording sites to cluster multi-channel neural data. The system uses a spatial window-based version of the Online Sorting algorithm, which uses unsupervised template-matching for clustering.

RESULTS

The test results show that the proposed system can reach an average accuracy of 86% using simulated data (16-32 neurons, 4-10 dB Signal-to-Noise Ratio), while the single-channel clustering version achieves only 74% average accuracy in the same cases on a 128-channel electrode array. The developed system was also tested on in vivo cortical recordings obtained from an anesthetized rat.

CONCLUSION

The proposed FPGA-based spike sorting system can process more than 11000 spikes/second, so it can be used during in vivo experiments providing real-time feedback on the location and electrophysiological properties of well-separable single units.

SIGNIFICANCE

The proposed spike sorting system could be used to reduce the positioning error of the closely-packed recording site during a neural measurement.

Predicting Single-Unit Activity from Local Field Potentials with LSTMs

This paper investigates to what extent Long Short-Term Memory (LSTM) decoders can use Local Field Potentials (LFPs) to predict Single-Unit Activity (SUA) in Macaque Primary Motor cortex. The motivation is to determine to what degree the LFP signal can be used as a proxy for SUA, for both neuroscience and Brain-Computer Interface (BCI) applications. Firstly, the results suggest that the prediction quality varies significantly by implant location or animal. However, within each implant location / animal, the prediction quality seems to be correlated with the amount of power in certain LFP frequency bands (0-10, 10-20 and 40-50Hz, standardised LFPs). Secondly, the results suggest that bipolar LFPs are more informative as to SUA than unipolar LFPs. This suggests common mode rejection aids in the elimination of non-local neural information. Thirdly, the best individual bipolar LFPs generally perform better than when using all available unipolar LFPs. This suggests that LFP channel selection may be a simple but effective means of lossy data compression in Wireless Intracortical LFP-based BCIs. Overall, LFPs were moderately predictive of SUA, and improvements can likely be made.

A 300 Mbps 37 pJ/bit Pulsed Optical Biotelemetry

This article reports an implantable transcutaneous telemetry for a brain machine interface that uses a novel optical communication system to achieve a highly energy-efficient link. Based on an pulse-based coding scheme, the system uses sub-nanosecond laser pulses to achieve data rates up to 300 Mbps with relatively low power levels when compared to other methods of wireless communication. This has been implemented using a combination of discrete components (semiconductor laser and driver, fast-response Si photodiode and interface) integrated at board level together with reconfigurable logic (encoder, decoder and processing circuits implemented using Xilinx KCU105 board with Kintex UltraScale FPGA). Experimental validation has been performed using a tissue sample that achieves representative level of attenuation/scattering (porcine skin) in the optical path. Results reveal that the system can operate at data rates up to 300 Mbps with a bit error rate (BER) of less than 10 ^-10, and an energy efficiency of 37 pJ/bit. This can communicate, for example, 1,024 channels of broadband neural data sampled at 18 kHz, 16-bit with only 11 mW power consumption.

Memristor networks for real-time neural activity analysis

The ability to efficiently analyze the activities of biological neural networks can significantly promote our understanding of neural communications and functionalities. However, conventional neural signal analysis approaches need to transmit and store large amounts of raw recording data, followed by extensive processing offline, posing significant challenges to the hardware and preventing real-time analysis and feedback. Here, we demonstrate a memristor-based reservoir computing (RC) system that can potentially analyze neural signals in real-time. We show that the perovskite halide-based memristor can be directly driven by emulated neural spikes, where the memristor state reflects temporal features in the neural spike train. The RC system is successfully used to recognize neural firing patterns, monitor the transition of the firing patterns, and identify neural synchronization states among different neurons. Advanced neuroelectronic systems with such memristor networks can enable efficient neural signal analysis with high spatiotemporal precision, and possibly closed-loop feedback control.

Designing energy efficient artificial neural networks for real-time analysis remains a challenge. Here, the authors report the development of a perovskite halide (CsPbI3) memristor-based Reservoir Computing system for real-time recognition of neural firing patterns and neural synchronization states.

Studying the visual brain in its natural rhythm

How the brain fluidly orchestrates visual behavior is a central question in cognitive neuroscience. Researchers studying neural responses in humans and nonhuman primates have mapped out visual response profiles and cognitive modulation in a large number of brain areas, most often using pared down stimuli and highly controlled behavioral paradigms. The historical emphasis on reductionism has placed most studies at one pole of an inherent trade-off between strictly controlled experimental variables and open designs that monitor the brain during its natural modes of operation. This bias toward simplified experiments has strongly shaped the field of visual neuroscience, with little guarantee that the principles and concepts established within that framework will apply more generally. In recent years, a growing number of studies have begun to relax strict experimental control with the aim of understanding how the brain responds under more naturalistic conditions. In this article, we survey research that has explicitly embraced the complexity and rhythm of natural vision. We focus on those studies most pertinent to understanding high-level visual specializations in brains of humans and nonhuman primates. We conclude that representationalist concepts borne from conventional visual experiments fall short in their ability to capture the real-life visual operations undertaken by the brain. More naturalistic approaches, though fraught with experimental and analytic challenges, provide fertile ground for neuroscientists seeking new inroads to investigate how the brain supports core aspects of our daily visual experience.

Measurement system with real time data converter for conversion of I 2 S data stream to UDP protocol data

A central goal of systems neuroscience is to simultaneously measure the activities of all achievable neurons in the brain at millisecond resolution in freely moving animals. This paper describes a protocol converter which is part of a measurement acquisition system for multichannel real time recording of brain signals. In practice, in such techniques, a primary consideration of reliability leads to great necessity towards increasing the sampling rate of these signals while simultaneously increasing the resolution of A/D conversion to 24 bits or even to the unprecedented 32 bits per sample. In fact, this was the guiding principle for our team in the present study. By increasing the temporal and amplitude resolution, it is supposed that we get enabled to discover or recognize and identify new signal components which have previously been masked at a "low" temporal and amplitude resolution, and these new signal components, in the future, are likely to contribute to a deeper understanding of the workings of the brain.

On-Chip TaO x -Based Non-volatile Resistive Memory for in vitro Neurointerfaces

The development of highly integrated electrophysiological devices working in direct contact with living neuron tissue opens new exciting prospects in the fields of neurophysiology and medicine, but imposes tight requirements on the power dissipated by electronics. On-chip preprocessing of neuronal signals can substantially decrease the power dissipated by external data interfaces, and the addition of embedded non-volatile memory would significantly improve the performance of a co-processor in real-time processing of the incoming information stream from the neuron tissue. Here, we evaluate the parameters of TaO _x -based resistive switching (RS) memory devices produced by magnetron sputtering technique and integrated with the 180-nm CMOS field-effect transistors as possible candidates for on-chip memory in the hybrid neurointerface under development. The electrical parameters of the optimized one-transistor-one-resistor (1T-1R) devices, such as the switching voltage (approx. ±1 V), uniformity of the R _off/R _on ratio (∼10), read/write speed (<40 ns), and the number of the writing cycles (up to 10¹⁰), are satisfactory. The energy values for writing and reading out a bit ∼30 and ∼0.1 pJ, respectively, are also suitable for the desired in vitro neurointerfaces, but are still far too high once the prospective in vivo applications are considered. Challenges arising in the course of the prospective fabrication of the proposed TaO _x -based RS devices in the back-end-of-line process are identified.

A Real-Time Spike Sorting System Using Parallel OSort Clustering

This article presents an efficient design and implementation of a real-time spike sorting system using unsupervised clustering. We utilize the online sorting (OSort) algorithm and model it first in both floating-point and fixed-point numerical representations to accurately assess the feasibility of our hardware architecture and also reliably analyze the sorting accuracy. For efficient hardware realization of OSort, we propose a modified parallel OSort algorithm. By reducing the number of required memory accesses, the number of computations performed for the management and upkeep of cluster averages and cluster merging is substantially reduced. By limiting the number of supported clusters per channel, the classification/clustering latency is significantly reduced compared to the previously published work, making the designed OSort system applicable for in-vivo spike sorting. The proposed OSort hardware architecture utilizes a novel memory configuration scheme to parallelize the OSort algorithm, which allows us to avoid using relatively large memory queues for storing detected spike waveforms and process them concurrently to the spike cluster management. The characteristics and implementation results of the designed OSort-based spike sorting system on a Xilinx Artix-7 field-programmable gate array (FPGA) are presented. The ASIC implementation of the designed system is estimated to occupy 2.57 mm² in a standard 32-nm CMOS process. Post-layout power estimation shows that the ASIC will dissipate 2.78 mW, while operating at 24 kHz.

Neuropixels Data-Acquisition System: A Scalable Platform for Parallel Recording of 10 000+ Electrophysiological Signals

Although CMOS fabrication has enabled a quick evolution in the design of high-density neural probes and neural-recording chips, the scaling and miniaturization of the complete data-acquisition systems has happened at a slower pace. This is mainly due to the complexity and the many requirements that change depending on the specific experimental settings. In essence, the fundamental challenge of a neural-recording system is getting the signals describing the largest possible set of neurons out of the brain and down to data storage for analysis. This requires a complete system optimization that considers the physical, electrical, thermal and signal-processing requirements, while accounting for available technology, manufacturing constraints and budget. Here we present a scalable and open-standards-based open-source data-acquisition system capable of recording from over 10,000 channels of raw neural data simultaneously. The components and their interfaces have been optimized to ensure robustness and minimum invasiveness in small-rodent electrophysiology.

Sequential Neural Activity in Primary Motor Cortex during Sleep

Sequential firing of neurons during sleep is thought to play a role in the consolidation of learning. However, direct evidence for such sequence replay is limited to only a few brain areas and sleep states mainly in rodents. Using a custom-designed wearable neural data logger and chronically implanted electrodes, we made long-term recordings of neural activity in the primary motor cortex of two female nonhuman primates during free behavior and natural sleep. We used the local field potential (LFP) spectrogram to characterize sleep cycles, and examined firing rates, correlations, and sequential firing of neurons at different frequency bands through the cycle. Slow-wave sleep (SWS) was characterized by low neural firing rates and high synchrony, reflecting slow oscillations between cortical down and up states. However, the order in which neurons entered up states was similar to the sequence of neural activity observed at low frequencies during waking behavior. In addition, we found evidence of brief bursts of theta oscillation, associated with non-SWS states, during which neurons fired in strikingly regular sequential order phase-locked to the LFP. Theta sequences were preserved between waking and sleep, but appeared not to resemble the order of neural activity observed at lower frequencies. The sequential firing of neurons during slow oscillations and theta bursts may contribute to the consolidation of procedural memories during sleep.SIGNIFICANCE STATEMENT Replay of sequential neural activity during sleep is believed to support consolidation of daytime learning. Despite a wealth of studies investigating sequential replay in association with episodic and spatial memory, it is unknown whether similar sequences occur in motor areas during sleep. Within long-term neural recordings from monkey motor cortex, we found two distinct patterns of sequential activity during different phases of the natural sleep cycle. Slow-wave sleep was associated with delta-band sequences that resembled low-frequency activity during movement, while occasional brief bursts of theta oscillation were associated with a different order of sequential firing. Our results are the first report of sequential sleep replay in the motor cortex, which may play an important role in consolidation of procedural learning.

Reliability of motor and sensory neural decoding by threshold crossings for intracortical brain-machine interface

OBJECTIVE

For intracortical neurophysiological studies, spike sorting is an important procedure to isolate single units for analyzing specific functions. However, whether spike sorting is necessary or not for neural decoding applications is controversial. Several studies showed that using threshold crossings (TC) instead of spike sorting could also achieve a similar satisfactory performance. However, such studies were limited in similar behavioral tasks, and the neural signal source mainly focused on the motor-related cortical regions. It is not certain if this conclusion is applicable to other situations. Therefore, we compared the performance of TC and spike sorting in neural decoding with more comprehensive paradigms and parameters.

APPROACH

Two rhesus macaques implanted with Utah or floating microelectrode arrays (FMAs) in motor or sensory-related cortical regions were trained to perform a motor or a sensory task. Data from each monkey were preprocessed with three different schemes: TC, automatic sorting (AS), and manual sorting (MS). A support vector machine was used as the decoder, and the decoding accuracy was used for evaluating the performance of three preprocessing methods. Different neural signal sources, different decoders, and related parameters and decoding stability were further tested to systematically compare three preprocessing methods.

MAIN RESULTS

TC could achieve a similar (-4.5 RMS threshold) or better (-3.0 RMS threshold) decoding performance compared to the other two sorting methods in the motor or sensory tasks even if the neural signal sources or decoder-related parameters were changed. Moreover, TC was much more stable in neural decoding across sessions and robust to changes of threshold.

SIGNIFICANCE

Our results indicated that spike-firing patterns could be stably extracted through TC from multiple cortices in both motor and sensory neural decoding applications. Considering the stability of TC, it might be more suitable for neural decoding compared to sorting methods.