1
|
Radmanesh M, Rezaei AA, Jalili M, Hashemi A, Goudarzi MM. Online spike sorting via deep contractive autoencoder. Neural Netw 2022; 155:39-49. [DOI: 10.1016/j.neunet.2022.08.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 07/03/2022] [Accepted: 08/01/2022] [Indexed: 11/16/2022]
|
2
|
Bod RB, Rokai J, Meszéna D, Fiáth R, Ulbert I, Márton G. From End to End: Gaining, Sorting, and Employing High-Density Neural Single Unit Recordings. Front Neuroinform 2022; 16:851024. [PMID: 35769832 PMCID: PMC9236662 DOI: 10.3389/fninf.2022.851024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Accepted: 05/06/2022] [Indexed: 11/15/2022] Open
Abstract
The meaning behind neural single unit activity has constantly been a challenge, so it will persist in the foreseeable future. As one of the most sourced strategies, detecting neural activity in high-resolution neural sensor recordings and then attributing them to their corresponding source neurons correctly, namely the process of spike sorting, has been prevailing so far. Support from ever-improving recording techniques and sophisticated algorithms for extracting worthwhile information and abundance in clustering procedures turned spike sorting into an indispensable tool in electrophysiological analysis. This review attempts to illustrate that in all stages of spike sorting algorithms, the past 5 years innovations' brought about concepts, results, and questions worth sharing with even the non-expert user community. By thoroughly inspecting latest innovations in the field of neural sensors, recording procedures, and various spike sorting strategies, a skeletonization of relevant knowledge lays here, with an initiative to get one step closer to the original objective: deciphering and building in the sense of neural transcript.
Collapse
Affiliation(s)
- Réka Barbara Bod
- Laboratory of Experimental Neurophysiology, Department of Physiology, Faculty of Medicine, George Emil Palade University of Medicine, Pharmacy, Science and Technology of Târgu Mureş, Târgu Mureş, Romania
| | - János Rokai
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- School of PhD Studies, Semmelweis University, Budapest, Hungary
| | - Domokos Meszéna
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - Richárd Fiáth
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - István Ulbert
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| | - Gergely Márton
- Integrative Neuroscience Group, Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Information Technology and Bionics, Pázmány Péter Catholic University, Budapest, Hungary
| |
Collapse
|
3
|
Wang PK, Pun SH, Chen CH, McCullagh EA, Klug A, Li A, Vai MI, Mak PU, Lei TC. Low-latency single channel real-time neural spike sorting system based on template matching. PLoS One 2019; 14:e0225138. [PMID: 31756211 PMCID: PMC6874356 DOI: 10.1371/journal.pone.0225138] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2019] [Accepted: 10/29/2019] [Indexed: 11/26/2022] Open
Abstract
Recent technical advancements in neural engineering allow for precise recording and control of neural circuits simultaneously, opening up new opportunities for closed-loop neural control. In this work, a rapid spike sorting system was developed based on template matching to rapidly calculate instantaneous firing rates for each neuron in a multi-unit extracellular recording setting. Cluster templates were first generated by a desktop computer using a non-parameter spike sorting algorithm (Super-paramagnetic clustering) and then transferred to a field-programmable gate array digital circuit for rapid sorting through template matching. Two different matching techniques–Euclidean distance (ED) and correlational matching (CM)–were compared for the accuracy of sorting and the performance of calculating firing rates. The performance of the system was first verified using publicly available artificial data and was further confirmed with pre-recorded neural spikes from an anesthetized Mongolian gerbil. Real-time recording and sorting from an awake mouse were also conducted to confirm the system performance in a typical behavioral neuroscience experimental setting. Experimental results indicated that high sorting accuracies were achieved for both template-matching methods, but CM can better handle spikes with non-Gaussian spike distributions, making it more robust for in vivo recording. The technique was also compared to several other off-line spike sorting algorithms and the results indicated that the sorting accuracy is comparable but sorting time is significantly shorter than these other techniques. A low sorting latency of under 2 ms and a maximum spike sorting rate of 941 spikes/second have been achieved with our hybrid hardware/software system. The low sorting latency and fast sorting rate allow future system developments of neural circuit modulation through analyzing neural activities in real-time.
Collapse
Affiliation(s)
- Pan Ke Wang
- State Key Laboratory of Analog and Mixed-Signal VLSI, Institute of Microelectronics, University of Macau, Macau, China
- Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, China
| | - Sio Hang Pun
- State Key Laboratory of Analog and Mixed-Signal VLSI, Institute of Microelectronics, University of Macau, Macau, China
- * E-mail:
| | - Chang Hao Chen
- State Key Laboratory of Analog and Mixed-Signal VLSI, Institute of Microelectronics, University of Macau, Macau, China
| | - Elizabeth A. McCullagh
- Department of Physiology and Biophysics, University of Colorado Anschutz Medical Campus, Aurora, CO, United States of America
| | - Achim Klug
- Department of Physiology and Biophysics, University of Colorado Anschutz Medical Campus, Aurora, CO, United States of America
| | - Anan Li
- Jiangsu Key Laboratory of Brain Disease and Bioinformation, Research Center for Biochemistry and Molecular Biology, Xuzhou Medical University, Xuzhou, China
| | - Mang I. Vai
- State Key Laboratory of Analog and Mixed-Signal VLSI, Institute of Microelectronics, University of Macau, Macau, China
- Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, China
| | - Peng Un Mak
- Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Macau, China
| | - Tim C. Lei
- State Key Laboratory of Analog and Mixed-Signal VLSI, Institute of Microelectronics, University of Macau, Macau, China
- Department of Electrical Engineering, University of Colorado, Denver, CO, United States of America
| |
Collapse
|
4
|
Mahallati S, Bezdek JC, Popovic MR, Valiante TA. Cluster tendency assessment in neuronal spike data. PLoS One 2019; 14:e0224547. [PMID: 31714913 PMCID: PMC6850537 DOI: 10.1371/journal.pone.0224547] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2019] [Accepted: 10/16/2019] [Indexed: 02/05/2023] Open
Abstract
Sorting spikes from extracellular recording into clusters associated with distinct single units (putative neurons) is a fundamental step in analyzing neuronal populations. Such spike sorting is intrinsically unsupervised, as the number of neurons are not known a priori. Therefor, any spike sorting is an unsupervised learning problem that requires either of the two approaches: specification of a fixed value k for the number of clusters to seek, or generation of candidate partitions for several possible values of c, followed by selection of a best candidate based on various post-clustering validation criteria. In this paper, we investigate the first approach and evaluate the utility of several methods for providing lower dimensional visualization of the cluster structure and on subsequent spike clustering. We also introduce a visualization technique called improved visual assessment of cluster tendency (iVAT) to estimate possible cluster structures in data without the need for dimensionality reduction. Experimental results are conducted on two datasets with ground truth labels. In data with a relatively small number of clusters, iVAT is beneficial in estimating the number of clusters to inform the initialization of clustering algorithms. With larger numbers of clusters, iVAT gives a useful estimate of the coarse cluster structure but sometimes fails to indicate the presumptive number of clusters. We show that noise associated with recording extracellular neuronal potentials can disrupt computational clustering schemes, highlighting the benefit of probabilistic clustering models. Our results show that t-Distributed Stochastic Neighbor Embedding (t-SNE) provides representations of the data that yield more accurate visualization of potential cluster structure to inform the clustering stage. Moreover, The clusters obtained using t-SNE features were more reliable than the clusters obtained using the other methods, which indicates that t-SNE can potentially be used for both visualization and to extract features to be used by any clustering algorithm.
Collapse
Affiliation(s)
- Sara Mahallati
- Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Canada
- KITE Research Institute, University Health Network, Toronto, Canada
- Krembil Research Institute, University Health Network, Toronto, Canada
- CRANIA, University Health Network and University of Toronto, Toronto, Canada
| | - James C. Bezdek
- Computer Science and Information Systems Departments, University of Melbourne, Melbourne, Australia
| | - Milos R. Popovic
- Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Canada
- KITE Research Institute, University Health Network, Toronto, Canada
- CRANIA, University Health Network and University of Toronto, Toronto, Canada
| | - Taufik A. Valiante
- Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Canada
- Krembil Research Institute, University Health Network, Toronto, Canada
- Division of Neurosurgery, University of Toronto, Toronto, Canada
- CRANIA, University Health Network and University of Toronto, Toronto, Canada
| |
Collapse
|
5
|
Continuing progress of spike sorting in the era of big data. Curr Opin Neurobiol 2019; 55:90-96. [PMID: 30856552 DOI: 10.1016/j.conb.2019.02.007] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2018] [Revised: 01/26/2019] [Accepted: 02/07/2019] [Indexed: 11/21/2022]
Abstract
Engineering efforts are currently attempting to build devices capable of collecting neural activity from one million neurons in the brain. Part of this effort focuses on developing dense multiple-electrode arrays, which require post-processing via 'spike sorting' to extract neural spike trains from the raw signal. Gathering information at this scale will facilitate fascinating science, but these dreams are only realizable if the spike sorting procedure and data pipeline are computationally scalable, at or superior to hand processing, and scientifically reproducible. These challenges are all being amplified as the data scale continues to increase. In this review, recent efforts to attack these challenges are discussed, which have primarily focused on increasing accuracy and reliability while being computationally scalable. These goals are addressed by adding additional stages to the data processing pipeline and using divide-and-conquer algorithmic approaches. These recent developments should prove useful to most research groups regardless of data scale, not just for cutting-edge devices.
Collapse
|
6
|
Caro-Martín CR, Delgado-García JM, Gruart A, Sánchez-Campusano R. Spike sorting based on shape, phase, and distribution features, and K-TOPS clustering with validity and error indices. Sci Rep 2018; 8:17796. [PMID: 30542106 PMCID: PMC6290782 DOI: 10.1038/s41598-018-35491-4] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2017] [Accepted: 11/05/2018] [Indexed: 12/13/2022] Open
Abstract
Spike sorting is one of the most important data analysis problems in neurophysiology. The precision in all steps of the spike-sorting procedure critically affects the accuracy of all subsequent analyses. After data preprocessing and spike detection have been carried out properly, both feature extraction and spike clustering are the most critical subsequent steps of the spike-sorting procedure. The proposed spike sorting approach comprised a new feature extraction method based on shape, phase, and distribution features of each spike (hereinafter SS-SPDF method), which reveal significant information of the neural events under study. In addition, we applied an efficient clustering algorithm based on K-means and template optimization in phase space (hereinafter K-TOPS) that included two integrative clustering measures (validity and error indices) to verify the cohesion-dispersion among spike events during classification and the misclassification of clustering, respectively. The proposed method/algorithm was tested on both simulated data and real neural recordings. The results obtained for these datasets suggest that our spike sorting approach provides an efficient way for sorting both single-unit spikes and overlapping waveforms. By analyzing raw extracellular recordings collected from the rostral-medial prefrontal cortex (rmPFC) of behaving rabbits during classical eyeblink conditioning, we have demonstrated that the present method/algorithm performs better at classifying spikes and neurons and at assessing their modulating properties than other methods currently used in neurophysiology.
Collapse
Affiliation(s)
| | | | - Agnès Gruart
- Division of Neurosciences, Pablo de Olavide University, Seville, 41013, Spain
| | - R Sánchez-Campusano
- Division of Neurosciences, Pablo de Olavide University, Seville, 41013, Spain.
| |
Collapse
|
7
|
Diggelmann R, Fiscella M, Hierlemann A, Franke F. Automatic spike sorting for high-density microelectrode arrays. J Neurophysiol 2018; 120:3155-3171. [PMID: 30207864 PMCID: PMC6314465 DOI: 10.1152/jn.00803.2017] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2017] [Revised: 09/07/2018] [Accepted: 09/07/2018] [Indexed: 11/22/2022] Open
Abstract
High-density microelectrode arrays can be used to record extracellular action potentials from hundreds to thousands of neurons simultaneously. Efficient spike sorters must be developed to cope with such large data volumes. Most existing spike sorting methods for single electrodes or small multielectrodes, however, suffer from the "curse of dimensionality" and cannot be directly applied to recordings with hundreds of electrodes. This holds particularly true for the standard reference spike sorting algorithm, principal component analysis-based feature extraction, followed by k-means or expectation maximization clustering, against which most spike sorters are evaluated. We present a spike sorting algorithm that circumvents the dimensionality problem by sorting local groups of electrodes independently with classical spike sorting approaches. It is scalable to any number of recording electrodes and well suited for parallel computing. The combination of data prewhitening before the principal component analysis-based extraction and a parameter-free clustering algorithm obviated the need for parameter adjustments. We evaluated its performance using surrogate data in which we systematically varied spike amplitudes and spike rates and that were generated by inserting template spikes into the voltage traces of real recordings. In a direct comparison, our algorithm could compete with existing state-of-the-art spike sorters in terms of sensitivity and precision, while parameter adjustment or manual cluster curation was not required. NEW & NOTEWORTHY We present an automatic spike sorting algorithm that combines three strategies to scale classical spike sorting techniques for high-density microelectrode arrays: 1) splitting the recording electrodes into small groups and sorting them independently; 2) clustering a subset of spikes and classifying the rest to limit computation time; and 3) prewhitening the spike waveforms to enable the use of parameter-free clustering. Finally, we combined these strategies into an automatic spike sorter that is competitive with state-of-the-art spike sorters.
Collapse
Affiliation(s)
- Roland Diggelmann
- Department of Biosystems Science and Engineering, ETH Zurich, Basel , Switzerland
- Neural Circuit Laboratories, Friedrich Miescher Institute for Biomedical Research , Basel , Switzerland
| | - Michele Fiscella
- Department of Biosystems Science and Engineering, ETH Zurich, Basel , Switzerland
- Neural Circuit Laboratories, Friedrich Miescher Institute for Biomedical Research , Basel , Switzerland
| | - Andreas Hierlemann
- Department of Biosystems Science and Engineering, ETH Zurich, Basel , Switzerland
| | - Felix Franke
- Department of Biosystems Science and Engineering, ETH Zurich, Basel , Switzerland
| |
Collapse
|
8
|
Fournier J, Müller CM, Schneider I, Laurent G. Spatial Information in a Non-retinotopic Visual Cortex. Neuron 2018; 97:164-180.e7. [DOI: 10.1016/j.neuron.2017.11.017] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2017] [Revised: 08/25/2017] [Accepted: 11/10/2017] [Indexed: 02/04/2023]
|
9
|
Shan KQ, Lubenov EV, Siapas AG. Model-based spike sorting with a mixture of drifting t-distributions. J Neurosci Methods 2017; 288:82-98. [PMID: 28652008 PMCID: PMC5563448 DOI: 10.1016/j.jneumeth.2017.06.017] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2017] [Revised: 06/16/2017] [Accepted: 06/20/2017] [Indexed: 10/19/2022]
Abstract
BACKGROUND Chronic extracellular recordings are a powerful tool for systems neuroscience, but spike sorting remains a challenge. A common approach is to fit a generative model, such as a mixture of Gaussians, to the observed spike data. Even if non-parametric methods are used for spike sorting, such generative models provide a quantitative measure of unit isolation quality, which is crucial for subsequent interpretation of the sorted spike trains. NEW METHOD We present a spike sorting strategy that models the data as a mixture of drifting t-distributions. This model captures two important features of chronic extracellular recordings-cluster drift over time and heavy tails in the distribution of spikes-and offers improved robustness to outliers. RESULTS We evaluate this model on several thousand hours of chronic tetrode recordings and show that it fits the empirical data substantially better than a mixture of Gaussians. We also provide a software implementation that can re-fit long datasets in a few seconds, enabling interactive clustering of chronic recordings. COMPARISON WITH EXISTING METHODS We identify three common failure modes of spike sorting methods that assume stationarity and evaluate their impact given the empirically-observed cluster drift in chronic recordings. Using hybrid ground truth datasets, we also demonstrate that our model-based estimate of misclassification error is more accurate than previous unit isolation metrics. CONCLUSIONS The mixture of drifting t-distributions model enables efficient spike sorting of long datasets and provides an accurate measure of unit isolation quality over a wide range of conditions.
Collapse
Affiliation(s)
- Kevin Q Shan
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States; Division of Engineering and Applied Science, California Institute of Technology, Pasadena, United States
| | - Evgueniy V Lubenov
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States; Division of Engineering and Applied Science, California Institute of Technology, Pasadena, United States
| | - Athanassios G Siapas
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States; Division of Engineering and Applied Science, California Institute of Technology, Pasadena, United States.
| |
Collapse
|
10
|
Lefebvre B, Yger P, Marre O. Recent progress in multi-electrode spike sorting methods. JOURNAL OF PHYSIOLOGY, PARIS 2016; 110:327-335. [PMID: 28263793 PMCID: PMC5581741 DOI: 10.1016/j.jphysparis.2017.02.005] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2016] [Revised: 11/09/2016] [Accepted: 02/27/2017] [Indexed: 01/05/2023]
Abstract
In recent years, arrays of extracellular electrodes have been developed and manufactured to record simultaneously from hundreds of electrodes packed with a high density. These recordings should allow neuroscientists to reconstruct the individual activity of the neurons spiking in the vicinity of these electrodes, with the help of signal processing algorithms. Algorithms need to solve a source separation problem, also known as spike sorting. However, these new devices challenge the classical way to do spike sorting. Here we review different methods that have been developed to sort spikes from these large-scale recordings. We describe the common properties of these algorithms, as well as their main differences. Finally, we outline the issues that remain to be solved by future spike sorting algorithms.
Collapse
Affiliation(s)
- Baptiste Lefebvre
- Sorbonne Universités, UPMC Univ Paris 06, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, 75012 Paris, France; Laboratoire de Physique Statistique, UPMC-Sorbonne Universités, CNRS, ENS-PSL Research University, 24 rue Lhomond, 75005 Paris, France.
| | - Pierre Yger
- Sorbonne Universités, UPMC Univ Paris 06, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, 75012 Paris, France
| | - Olivier Marre
- Sorbonne Universités, UPMC Univ Paris 06, INSERM, CNRS, Institut de la Vision, 17 rue Moreau, 75012 Paris, France
| |
Collapse
|