Extracellular spike detection from multiple electrode array using novel intelligent filter and ensemble fuzzy decision making

A deep learning network based on CNN and sliding window LSTM for spike sorting

Spike sorting plays an essential role to obtain electrophysiological activity of single neuron in the fields of neural signal decoding. With the development of electrode array, large numbers of spikes are recorded simultaneously, which rises the need for accurate automatic and generalization algorithms. Hence, this paper proposes a spike sorting model with convolutional neural network (CNN) and a spike classification model with combination of CNN and Long-Short Term Memory (LSTM). The recall rate of our detector could reach 94.40% in low noise level dataset. Although the recall declined with the increasing noise level, our model still presented higher feasibility and better robustness than other models. In addition, the results of our classification model presented an accuracy of greater than 99% in simulated data and an average accuracy of about 95% in experimental data, suggesting our classifier outperforms the current "WMsorting" and other deep learning models. Moreover, the performance of our whole algorithm was evaluated through simulated data and the results shows that the accuracy of spike sorting reached about 97%. It is noteworthy to say that, this proposed algorithm could be used to achieve accurate and robust automated spike detection and spike classification.

Classification of overlapping spikes using convolutional neural networks and long short term memory

Spike sorting is one of the key techniques to understand brain activity. In this paper, we propose a novel deep learning approach based on convolutional neural networks (CNN) and long short term memory (LSTM) to implement overlapping spike sorting. The results of the simulated data demonstrated that the clustering accuracy was greater than 99.9% and 99.0% for non-overlapping spikes and overlapping spikes, respectively. Moreover, the proposed method performed better than our previous deep learning approach named "1D-CNN". In addition, the experimental data recorded from the primary visual cortex of a macaque monkey were used to evaluate the proposed method in a practical application. It was shown that the method could successfully isolate most overlapping spikes of different neurons (ranging from two to five). In summary, the CNN + LSTM method proposed in this paper is of great advantage for overlapping spike sorting with high accuracy. It lays the foundation for application in more challenging works, such as distinguishing the simultaneous recordings of multichannel neuronal activities.

An Accurate and Robust Method for Spike Sorting Based on Convolutional Neural Networks

In the fields of neuroscience and biomedical signal processing, spike sorting is a crucial step to extract the information of single neurons from extracellular recordings. In this paper, we propose a novel deep learning approach based on one-dimensional convolutional neural networks (1D-CNNs) to implement accurate and robust spike sorting. The results of the simulated data demonstrated that the clustering accuracy in most datasets was greater than 99%, despite the multiple levels of noise and various degrees of overlapped spikes. Moreover, the proposed method performed significantly better than the state-of-the-art method named “WMsorting” and a deep-learning-based multilayer perceptron (MLP) model. In addition, the experimental data recorded from the primary visual cortex of a macaque monkey were used to evaluate the proposed method in a practical application. It was shown that the method could successfully isolate most spikes of different neurons (ranging from two to five) by training the 1D-CNN model with a small number of manually labeled spikes. Considering the above, the deep learning method proposed in this paper is of great advantage for spike sorting with high accuracy and strong robustness. It lays the foundation for application in more challenging works, such as distinguishing overlapped spikes and the simultaneous sorting of multichannel recordings.

Neural signal recording and processing in somatic neuroprosthetic applications. A review

Neurointerfaces have acquired major relevance as both rehabilitative and therapeutic tools for patients with spinal cord injury, limb amputations and other neural disorders. Bidirectional neural interfaces are a key component for the functional control of neuroprosthetic devices. The two main neuroprosthetic applications of interfaces with the peripheral nervous system (PNS) are: the refined control of artificial prostheses with sensory neural feedback, and functional electrical stimulation (FES) systems attempting to generate motor or visceral responses in paralyzed organs. The results obtained in experimental and clinical studies with both, extraneural and intraneural electrodes are very promising in terms of the achieved functionality for the neural stimulation mode. However, the results of neural recordings with peripheral nerve interfaces are more limited. In this paper we review the different existing approaches for PNS signals recording, denoising, processing and classification, enabling their use for bidirectional interfaces. PNS recordings can provide three types of signals: i) population activity signals recorded by using extraneural electrodes placed on the outer surface of the nerve, which carry information about cumulative nerve activity; ii) spike activity signals recorded with intraneural electrodes placed inside the nerve, which carry information about the electrical activity of a set of individual nerve fibers; and iii) hybrid signals, which contain both spiking and cumulative signals. Finally, we also point out some of the main limitations, which are hampering clinical translation of neural decoding, and indicate possible solutions for improvement.

Spike detection and spike sorting with a hidden Markov model improves offline decoding of motor cortical recordings

OBJECTIVE

Detection and sorting (classification) of action potentials from extracellular recordings are two important pre-processing steps for brain-computer interfaces (BCIs) and some neuroscientific studies. Traditional approaches perform these two steps serially, but using shapes of action potential waveforms during detection, i.e. combining the two steps, may lead to better performance, especially during high noise. We propose a hidden Markov model (HMM) based method for combined detecting and sorting of spikes, with the aim of improving the final decoding accuracy of BCIs.

APPROACH

The states of the HMM indicate whether there is a spike, what unit a spike belongs to, and the time course within a waveform. The HMM outputs probabilities of spike detection, and from this we can calculate expectations of spike counts in time bins, which can replace integer spike counts as input to BCI decoders. We evaluate the HMM method on simulated spiking data. We then examine the impact of using this method on decoding real neural data recorded from primary motor cortex of two Rhesus monkeys.

MAIN RESULTS

Our comparisons on simulated data to detection-then-sorting approaches and combined detection-and-sorting algorithms indicate that the HMM method performs more accurately at detection and sorting (0.93 versus 0.73 spike count correlation, 0.73 versus 0.49 adjusted mutual information). On real neural data, the HMM method led to higher adjusted mutual information between spike counts and kinematics (monkey K: 0.034 versus 0.027; monkey M: 0.033 versus 0.022) and better neuron encoding model predictions (K: 0.016 dB improvement; M: 0.056 dB improvement). Lastly, the HMM method facilitated higher offline decoding accuracy (Kalman filter, K: 8.5% mean squared error reduction, M: 18.6% reduction).

SIGNIFICANCE

The HMM spike detection and sorting method offers a new approach to spike pre-processing for BCIs and neuroscientific studies.

Spike detection using a multiresolution entropy based method

Correct interpretation of neural mechanisms depends on the accurate detection of neuronal activities, which become visible as spikes in the electrical activity of neurons. In the present work, a novel entropy based method is proposed for spike detection which employs the fact that transient spike events change the entropy level of the neural time series. In this regard, the time-dependent entropy method can be used for detecting spike times, where the entropy of a selected segment of a neural time series, using a sliding window approach, is calculated and the time of the events are highlighted by sharp peaks in the output of the time-dependent entropy method. It is shown that the length of the sliding window determines the resolution of the time series in entropy space, therefore, the calculation is performed with a different window length for obtaining a multiresolution transform. The final decision threshold for detecting spike events is applied to the point-wise product of the time dependent entropy calculations with different resolutions. The proposed detection method has been assessed using several simulated and real neural data sets. The results show that the proposed method detects spikes in their exact times while compared with other traditional methods, relatively lower false alarm rate is obtained.

A Novel and Simple Spike Sorting Implementation

Monitoring the activity of multiple, individual neurons that fire spikes in the vicinity of an electrode, namely perform a Spike Sorting (SS) procedure, comprises one of the most important tools for contemporary neuroscience in order to reverse-engineer the brain. As recording electrodes' technology rabidly evolves by integrating thousands of electrodes in a confined spatial setting, the algorithms that are used to monitor individual neurons from recorded signals have to become even more reliable and computationally efficient. In this work, we propose a novel framework of the SS approach in which a single-step processing of the raw (unfiltered) extracellular signal is sufficient for both the detection and sorting of the activity of individual neurons. Despite its simplicity, the proposed approach exhibits comparable performance with state-of-the-art approaches, especially for spike detection in noisy signals, and paves the way for a new family of SS algorithms with the potential for multi-recording, fast, on-chip implementations.

Amplitude-aware permutation entropy: Illustration in spike detection and signal segmentation

BACKGROUND AND OBJECTIVE

Signal segmentation and spike detection are two important biomedical signal processing applications. Often, non-stationary signals must be segmented into piece-wise stationary epochs or spikes need to be found among a background of noise before being further analyzed. Permutation entropy (PE) has been proposed to evaluate the irregularity of a time series. PE is conceptually simple, structurally robust to artifacts, and computationally fast. It has been extensively used in many applications, but it has two key shortcomings. First, when a signal is symbolized using the Bandt-Pompe procedure, only the order of the amplitude values is considered and information regarding the amplitudes is discarded. Second, in the PE, the effect of equal amplitude values in each embedded vector is not addressed. To address these issues, we propose a new entropy measure based on PE: the amplitude-aware permutation entropy (AAPE).

METHODS

AAPE is sensitive to the changes in the amplitude, in addition to the frequency, of the signals thanks to it being more flexible than the classical PE in the quantification of the signal motifs. To demonstrate how the AAPE method can enhance the quality of the signal segmentation and spike detection, a set of synthetic and realistic synthetic neuronal signals, electroencephalograms and neuronal data are processed. We compare the performance of AAPE in these problems against state-of-the-art approaches and evaluate the significance of the differences with a repeated ANOVA with post hoc Tukey's test.

RESULTS

In signal segmentation, the accuracy of AAPE-based method is higher than conventional segmentation methods. AAPE also leads to more robust results in the presence of noise. The spike detection results show that AAPE can detect spikes well, even when presented with single-sample spikes, unlike PE. For multi-sample spikes, the changes in AAPE are larger than in PE.

CONCLUSION

We introduce a new entropy metric, AAPE, that enables us to consider amplitude information in the formulation of PE. The AAPE algorithm can be used in almost every irregularity-based application in various signal and image processing fields. We also made freely available the Matlab code of the AAPE.

A comparative study of breast cancer diagnosis based on neural network ensemble via improved training algorithms

Breast cancer is one of the most common types of cancer in women all over the world. Early diagnosis of this kind of cancer can significantly increase the chances of long-term survival. Since diagnosis of breast cancer is a complex problem, neural network (NN) approaches have been used as a promising solution. Considering the low speed of the back-propagation (BP) algorithm to train a feed-forward NN, we consider a number of improved NN trainings for the Wisconsin breast cancer dataset: BP with momentum, BP with adaptive learning rate, BP with adaptive learning rate and momentum, Polak-Ribikre conjugate gradient algorithm (CGA), Fletcher-Reeves CGA, Powell-Beale CGA, scaled CGA, resilient BP (RBP), one-step secant and quasi-Newton methods. An NN ensemble, which is a learning paradigm to combine a number of NN outputs, is used to improve the accuracy of the classification task. Results demonstrate that NN ensemble-based classification methods have better performance than NN-based algorithms. The highest overall average accuracy is 97.68% obtained by NN ensemble trained by RBP for 50%-50% training-test evaluation method.

Intracranial neuronal ensemble recordings and analysis in epilepsy

Pathological neuronal firing was demonstrated 50 years ago as the hallmark of epileptically transformed cortex with the use of implanted microelectrodes. Since then, microelectrodes remained only experimental tools in humans to detect unitary neuronal activity to reveal physiological and pathological brain functions. This recording technique has evolved substantially in the past few decades; however, based on recent human data implying their usefulness as diagnostic tools, we expect a substantial increase in the development of microelectrodes in the near future. Here, we review the technological background and history of microelectrode array development for human examinations in epilepsy, including discussions on of wire-based and microelectrode arrays fabricated using micro-electro-mechanical system (MEMS) techniques and novel future techniques to record neuronal ensemble. We give an overview of clinical and surgical considerations, and try to provide a list of probes on the market with their availability for human recording. Then finally, we briefly review the literature on modulation of single neuron for the treatment of epilepsy, and highlight the current topics under examination that can be background for the future development.

Past, present and future of spike sorting techniques

Spike sorting is a crucial step to extract information from extracellular recordings. With new recording opportunities provided by the development of new electrodes that allow monitoring hundreds of neurons simultaneously, the scenario for the new generation of algorithms is both exciting and challenging. However, this will require a new approach to the problem and the development of a common reference framework to quickly assess the performance of new algorithms. In this work, we review the basic concepts of spike sorting, including the requirements for different applications, together with the problems faced by presently available algorithms. We conclude by proposing a roadmap stressing the crucial points to be addressed to support the neuroscientific research of the near future.

A Robustness Comparison of Two Algorithms Used for EEG Spike Detection

Spikes and sharp waves recorded on scalp EEG may play an important role in identifying the epileptogenic network as well as in understanding the central nervous system. Therefore, several automatic and semi-automatic methods have been implemented to detect these two neural transients. A consistent gold standard associated with a high degree of agreement among neuroscientists is required to measure relevant performance of different methods. In fact, scalp EEG data can often be corrupted by a set of artifacts and are not always served as data of gold standard. For this reason, the use of intracerebral EEG data mixed with gaussian noise seems to best resemble the output of scalp EEG brain and serves as a consistent gold standard. In the present framework, we test the robustness of two important methods that have been previously used for the automatic detection of epileptiform transients (spikes and sharp waves). These methods are based respectively on Discrete Wavelet Transform (DWT) and Continuous Wavelet Transform (CWT). Our purpose is to elaborate a comparative study in terms of sensitivity and selectivity changes via the decrease of Signal to Noise Ratio (SNR), which is ranged from 10 dB up to -10 dB. The results demonstrate that, DWT approach turns to be more stable in terms of sensitivity, and it successfully follows the detection of relevant spikes with the decrease of SNR. However, CWT-based approach remains more stable in terms of selectivity, so that, it performs well in terms of rejecting false spikes compared to DWT approach.

Combination of signal segmentation approaches using fuzzy decision making

Segmentation is an important stage in signal analysis, and its performance plays a significant role in the efficiency of the subsequent steps, such as extraction of descriptive features and classification. There are a large number of approaches to segment signals. The performance of each of them remarkably varies when the signal changes. In this present study, two novel algorithms, which use the probability and fuzzy concepts, are proposed to combine several well-known existing signal segmentation approaches. The simulation results confirm the efficiency of the proposed approaches using the synthetic and real electroencephalogram signals.