1
|
Kobayashi R, Shinomoto S. Inference of monosynaptic connections from parallel spike trains: A review. Neurosci Res 2024:S0168-0102(24)00097-X. [PMID: 39098768 DOI: 10.1016/j.neures.2024.07.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 07/12/2024] [Accepted: 07/19/2024] [Indexed: 08/06/2024]
Abstract
This article presents a mini-review about the progress in inferring monosynaptic connections from spike trains of multiple neurons over the past twenty years. First, we explain a variety of meanings of "neuronal connectivity" in different research areas of neuroscience, such as structural connectivity, monosynaptic connectivity, and functional connectivity. Among these, we focus on the methods used to infer the monosynaptic connectivity from spike data. We then summarize the inference methods based on two main approaches, i.e., correlation-based and model-based approaches. Finally, we describe available source codes for connectivity inference and future challenges. Although inference will never be perfect, the accuracy of identifying the monosynaptic connections has improved dramatically in recent years due to continuous efforts.
Collapse
Affiliation(s)
- Ryota Kobayashi
- Graduate School of Frontier Sciences, The University of Tokyo, Chiba 277-8561, Japan; Mathematics and Informatics Center, The University of Tokyo, Tokyo 113-8656, Japan.
| | - Shigeru Shinomoto
- Graduate School of Biostudies, Kyoto University, Kyoto 606-8501, Japan; Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka 567-8570, Japan
| |
Collapse
|
2
|
Tsubo Y, Shinomoto S. Nondifferentiable activity in the brain. PNAS NEXUS 2024; 3:pgae261. [PMID: 38994500 PMCID: PMC11238849 DOI: 10.1093/pnasnexus/pgae261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 06/05/2024] [Indexed: 07/13/2024]
Abstract
Spike raster plots of numerous neurons show vertical stripes, indicating that neurons exhibit synchronous activity in the brain. We seek to determine whether these coherent dynamics are caused by smooth brainwave activity or by something else. By analyzing biological data, we find that their cross-correlograms exhibit not only slow undulation but also a cusp at the origin, in addition to possible signs of monosynaptic connectivity. Here we show that undulation emerges if neurons are subject to smooth brainwave oscillations while a cusp results from nondifferentiable fluctuations. While modern analysis methods have achieved good connectivity estimation by adapting the models to slow undulation, they still make false inferences due to the cusp. We devise a new analysis method that may solve both problems. We also demonstrate that oscillations and nondifferentiable fluctuations may emerge in simulations of large-scale neural networks.
Collapse
Affiliation(s)
- Yasuhiro Tsubo
- College of Information Science and Engineering, Ritsumeikan University, Osaka 567-8570, Japan
| | - Shigeru Shinomoto
- Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka 567-8570, Japan
- Graduate School of Biostudies, Kyoto University, Kyoto 606-8501, Japan
| |
Collapse
|
3
|
Liang T, Brinkman BAW. Statistically inferred neuronal connections in subsampled neural networks strongly correlate with spike train covariances. Phys Rev E 2024; 109:044404. [PMID: 38755896 DOI: 10.1103/physreve.109.044404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Accepted: 02/29/2024] [Indexed: 05/18/2024]
Abstract
Statistically inferred neuronal connections from observed spike train data are often skewed from ground truth by factors such as model mismatch, unobserved neurons, and limited data. Spike train covariances, sometimes referred to as "functional connections," are often used as a proxy for the connections between pairs of neurons, but reflect statistical relationships between neurons, not anatomical connections. Moreover, covariances are not causal: spiking activity is correlated in both the past and the future, whereas neurons respond only to synaptic inputs in the past. Connections inferred by maximum likelihood inference, however, can be constrained to be causal. However, we show in this work that the inferred connections in spontaneously active networks modeled by stochastic leaky integrate-and-fire networks strongly correlate with the covariances between neurons, and may reflect noncausal relationships, when many neurons are unobserved or when neurons are weakly coupled. This phenomenon occurs across different network structures, including random networks and balanced excitatory-inhibitory networks. We use a combination of simulations and a mean-field analysis with fluctuation corrections to elucidate the relationships between spike train covariances, inferred synaptic filters, and ground-truth connections in partially observed networks.
Collapse
Affiliation(s)
- Tong Liang
- Department of Physics and Astronomy, Stony Brook University, Stony Brook, New York 11794, USA
- Department of Neurobiology and Behavior, Stony Brook University, Stony Brook, New York 11794, USA
| | - Braden A W Brinkman
- Department of Neurobiology and Behavior, Stony Brook University, Stony Brook, New York 11794, USA
| |
Collapse
|
4
|
Vareberg AD, Bok I, Eizadi J, Ren X, Hai A. Inference of network connectivity from temporally binned spike trains. J Neurosci Methods 2024; 404:110073. [PMID: 38309313 PMCID: PMC10949361 DOI: 10.1016/j.jneumeth.2024.110073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 01/19/2024] [Accepted: 01/30/2024] [Indexed: 02/05/2024]
Abstract
BACKGROUND Processing neural activity to reconstruct network connectivity is a central focus of neuroscience, yet the spatiotemporal requisites of biological nervous systems are challenging for current neuronal sensing modalities. Consequently, methods that leverage limited data to successfully infer synaptic connections, predict activity at single unit resolution, and decipher their effect on whole systems, can uncover critical information about neural processing. Despite the emergence of powerful methods for inferring connectivity, network reconstruction based on temporally subsampled data remains insufficiently unexplored. NEW METHOD We infer synaptic weights by processing firing rates within variable time bins for a heterogeneous feed-forward network of excitatory, inhibitory, and unconnected units. We assess classification and optimize model parameters for postsynaptic spike train reconstruction. We test our method on a physiological network of leaky integrate-and-fire neurons displaying bursting patterns and assess prediction of postsynaptic activity from microelectrode array data. RESULTS Results reveal parameters for improved prediction and performance and suggest that lower resolution data and limited access to neurons can be preferred. COMPARISON WITH EXISTING METHOD(S) Recent computational methods demonstrate highly improved reconstruction of connectivity from networks of parallel spike trains by considering spike lag, time-varying firing rates, and other underlying dynamics. However, these methods insufficiently explore temporal subsampling representative of novel data types. CONCLUSIONS We provide a framework for reverse engineering neural networks from data with limited temporal quality, describing optimal parameters for each bin size, which can be further improved using non-linear methods and applied to more complicated readouts and connectivity distributions in multiple brain circuits.
Collapse
Affiliation(s)
- Adam D Vareberg
- Department of Biomedical Engineering, University of Wisconsin-Madison, United States; Wisconsin Institute for Translational Neuroengineering (WITNe), University of Wisconsin-Madison, United States
| | - Ilhan Bok
- Department of Electrical and Computer Engineering, University of Wisconsin-Madison, United States; Wisconsin Institute for Translational Neuroengineering (WITNe), University of Wisconsin-Madison, United States
| | - Jenna Eizadi
- Department of Biomedical Engineering, University of Wisconsin-Madison, United States; Wisconsin Institute for Translational Neuroengineering (WITNe), University of Wisconsin-Madison, United States
| | - Xiaoxuan Ren
- Department of Electrical and Computer Engineering, University of Wisconsin-Madison, United States
| | - Aviad Hai
- Department of Biomedical Engineering, University of Wisconsin-Madison, United States; Department of Electrical and Computer Engineering, University of Wisconsin-Madison, United States; Wisconsin Institute for Translational Neuroengineering (WITNe), University of Wisconsin-Madison, United States.
| |
Collapse
|
5
|
Reconstruction of sparse recurrent connectivity and inputs from the nonlinear dynamics of neuronal networks. J Comput Neurosci 2023; 51:43-58. [PMID: 35849304 DOI: 10.1007/s10827-022-00831-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2020] [Revised: 06/16/2022] [Accepted: 07/13/2022] [Indexed: 01/18/2023]
Abstract
Reconstructing the recurrent structural connectivity of neuronal networks is a challenge crucial to address in characterizing neuronal computations. While directly measuring the detailed connectivity structure is generally prohibitive for large networks, we develop a novel framework for reverse-engineering large-scale recurrent network connectivity matrices from neuronal dynamics by utilizing the widespread sparsity of neuronal connections. We derive a linear input-output mapping that underlies the irregular dynamics of a model network composed of both excitatory and inhibitory integrate-and-fire neurons with pulse coupling, thereby relating network inputs to evoked neuronal activity. Using this embedded mapping and experimentally feasible measurements of the firing rate as well as voltage dynamics in response to a relatively small ensemble of random input stimuli, we efficiently reconstruct the recurrent network connectivity via compressive sensing techniques. Through analogous analysis, we then recover high dimensional natural stimuli from evoked neuronal network dynamics over a short time horizon. This work provides a generalizable methodology for rapidly recovering sparse neuronal network data and underlines the natural role of sparsity in facilitating the efficient encoding of network data in neuronal dynamics.
Collapse
|
6
|
van Albada SJ, Morales-Gregorio A, Dickscheid T, Goulas A, Bakker R, Bludau S, Palm G, Hilgetag CC, Diesmann M. Bringing Anatomical Information into Neuronal Network Models. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2022; 1359:201-234. [DOI: 10.1007/978-3-030-89439-9_9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
7
|
Endo D, Kobayashi R, Bartolo R, Averbeck BB, Sugase-Miyamoto Y, Hayashi K, Kawano K, Richmond BJ, Shinomoto S. A convolutional neural network for estimating synaptic connectivity from spike trains. Sci Rep 2021; 11:12087. [PMID: 34103546 PMCID: PMC8187444 DOI: 10.1038/s41598-021-91244-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Accepted: 05/21/2021] [Indexed: 02/05/2023] Open
Abstract
The recent increase in reliable, simultaneous high channel count extracellular recordings is exciting for physiologists and theoreticians because it offers the possibility of reconstructing the underlying neuronal circuits. We recently presented a method of inferring this circuit connectivity from neuronal spike trains by applying the generalized linear model to cross-correlograms. Although the algorithm can do a good job of circuit reconstruction, the parameters need to be carefully tuned for each individual dataset. Here we present another method using a Convolutional Neural Network for Estimating synaptic Connectivity from spike trains. After adaptation to huge amounts of simulated data, this method robustly captures the specific feature of monosynaptic impact in a noisy cross-correlogram. There are no user-adjustable parameters. With this new method, we have constructed diagrams of neuronal circuits recorded in several cortical areas of monkeys.
Collapse
Affiliation(s)
- Daisuke Endo
- Graduate School of Informatics, Kyoto University, Kyoto, 606-8501, Japan
| | - Ryota Kobayashi
- Mathematics and Informatics Center, The University of Tokyo, Tokyo, 113-8656, Japan
- Department of Complexity Science and Engineering, The University of Tokyo, Chiba, 277-8561, Japan
- JST, PRESTO, Saitama, 332-0012, Japan
| | - Ramon Bartolo
- Laboratory of Neuropsychology, NIMH/NIH/DHHS, Bethesda, MD, 20814, USA
| | - Bruno B Averbeck
- Laboratory of Neuropsychology, NIMH/NIH/DHHS, Bethesda, MD, 20814, USA
| | - Yasuko Sugase-Miyamoto
- Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, 305-8568, Japan
| | - Kazuko Hayashi
- Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, 305-8568, Japan
- Japan Society for the Promotion of Science, Tokyo, 102-0083, Japan
| | - Kenji Kawano
- Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, 305-8568, Japan
| | - Barry J Richmond
- Laboratory of Neuropsychology, NIMH/NIH/DHHS, Bethesda, MD, 20814, USA
| | - Shigeru Shinomoto
- Graduate School of Informatics, Kyoto University, Kyoto, 606-8501, Japan.
- Brain Information Communication Research Laboratory Group, ATR Institute International, Kyoto, 619-0288, Japan.
| |
Collapse
|
8
|
Liew YJ, Pala A, Whitmire CJ, Stoy WA, Forest CR, Stanley GB. Inferring thalamocortical monosynaptic connectivity in vivo. J Neurophysiol 2021; 125:2408-2431. [PMID: 33978507 PMCID: PMC8285656 DOI: 10.1152/jn.00591.2020] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Revised: 04/12/2021] [Accepted: 04/29/2021] [Indexed: 11/22/2022] Open
Abstract
As the tools to simultaneously record electrophysiological signals from large numbers of neurons within and across brain regions become increasingly available, this opens up for the first time the possibility of establishing the details of causal relationships between monosynaptically connected neurons and the patterns of neural activation that underlie perception and behavior. Although recorded activity across synaptically connected neurons has served as the cornerstone for much of what we know about synaptic transmission and plasticity, this has largely been relegated to ex vivo preparations that enable precise targeting under relatively well-controlled conditions. Analogous studies in vivo, where image-guided targeting is often not yet possible, rely on indirect, data-driven measures, and as a result such studies have been sparse and the dependence upon important experimental parameters has not been well studied. Here, using in vivo extracellular single-unit recordings in the topographically aligned rodent thalamocortical pathway, we sought to establish a general experimental and computational framework for inferring synaptic connectivity. Specifically, attacking this problem within a statistical signal detection framework utilizing experimentally recorded data in the ventral-posterior medial (VPm) region of the thalamus and the homologous region in layer 4 of primary somatosensory cortex (S1) revealed a trade-off between network activity levels needed for the data-driven inference and synchronization of nearby neurons within the population that results in masking of synaptic relationships. Here, we provide a framework for establishing connectivity in multisite, multielectrode recordings based on statistical inference, setting the stage for large-scale assessment of synaptic connectivity within and across brain structures.NEW & NOTEWORTHY Despite the fact that all brain function relies on the long-range transfer of information across different regions, the tools enabling us to measure connectivity across brain structures are lacking. Here, we provide a statistical framework for identifying and assessing potential monosynaptic connectivity across neuronal circuits from population spiking activity that generalizes to large-scale recording technologies that will help us to better understand the signaling within networks that underlies perception and behavior.
Collapse
Affiliation(s)
- Yi Juin Liew
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, Georgia
- Joint PhD Program in Biomedical Engineering, Georgia Institute of Technology-Emory University-Peking University, Atlanta, Georgia
| | - Aurélie Pala
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, Georgia
| | - Clarissa J Whitmire
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, Georgia
| | - William A Stoy
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, Georgia
| | - Craig R Forest
- George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, Georgia
| | - Garrett B Stanley
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, Georgia
| |
Collapse
|
9
|
Shorten DP, Spinney RE, Lizier JT. Estimating Transfer Entropy in Continuous Time Between Neural Spike Trains or Other Event-Based Data. PLoS Comput Biol 2021; 17:e1008054. [PMID: 33872296 PMCID: PMC8084348 DOI: 10.1371/journal.pcbi.1008054] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 04/29/2021] [Accepted: 02/19/2021] [Indexed: 11/24/2022] Open
Abstract
Transfer entropy (TE) is a widely used measure of directed information flows in a number of domains including neuroscience. Many real-world time series for which we are interested in information flows come in the form of (near) instantaneous events occurring over time. Examples include the spiking of biological neurons, trades on stock markets and posts to social media, amongst myriad other systems involving events in continuous time throughout the natural and social sciences. However, there exist severe limitations to the current approach to TE estimation on such event-based data via discretising the time series into time bins: it is not consistent, has high bias, converges slowly and cannot simultaneously capture relationships that occur with very fine time precision as well as those that occur over long time intervals. Building on recent work which derived a theoretical framework for TE in continuous time, we present an estimation framework for TE on event-based data and develop a k-nearest-neighbours estimator within this framework. This estimator is provably consistent, has favourable bias properties and converges orders of magnitude more quickly than the current state-of-the-art in discrete-time estimation on synthetic examples. We demonstrate failures of the traditionally-used source-time-shift method for null surrogate generation. In order to overcome these failures, we develop a local permutation scheme for generating surrogate time series conforming to the appropriate null hypothesis in order to test for the statistical significance of the TE and, as such, test for the conditional independence between the history of one point process and the updates of another. Our approach is shown to be capable of correctly rejecting or accepting the null hypothesis of conditional independence even in the presence of strong pairwise time-directed correlations. This capacity to accurately test for conditional independence is further demonstrated on models of a spiking neural circuit inspired by the pyloric circuit of the crustacean stomatogastric ganglion, succeeding where previous related estimators have failed.
Collapse
Affiliation(s)
- David P. Shorten
- Complex Systems Research Group and Centre for Complex Systems, Faculty of Engineering, The University of Sydney, Sydney, Australia
| | - Richard E. Spinney
- Complex Systems Research Group and Centre for Complex Systems, Faculty of Engineering, The University of Sydney, Sydney, Australia
- School of Physics and EMBL Australia Node Single Molecule Science, School of Medical Sciences, The University of New South Wales, Sydney, Australia
| | - Joseph T. Lizier
- Complex Systems Research Group and Centre for Complex Systems, Faculty of Engineering, The University of Sydney, Sydney, Australia
| |
Collapse
|
10
|
Ren N, Ito S, Hafizi H, Beggs JM, Stevenson IH. Model-based detection of putative synaptic connections from spike recordings with latency and type constraints. J Neurophysiol 2020; 124:1588-1604. [DOI: 10.1152/jn.00066.2020] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Detecting synaptic connections using large-scale extracellular spike recordings is a difficult statistical problem. Here, we develop an extension of a generalized linear model that explicitly separates fast synaptic effects and slow background fluctuations in cross-correlograms between pairs of neurons while incorporating circuit properties learned from the whole network. This model outperforms two previously developed synapse detection methods in the simulated networks and recovers plausible connections from hundreds of neurons in in vitro multielectrode array data.
Collapse
Affiliation(s)
- Naixin Ren
- Department of Psychological Sciences, University of Connecticut, Storrs, Connecticut
| | - Shinya Ito
- Santa Cruz Institute for Particle Physics, University of California, Santa Cruz, California
| | - Hadi Hafizi
- Department of Physics, Indiana University, Bloomington, Indiana
| | - John M. Beggs
- Department of Physics, Indiana University, Bloomington, Indiana
| | - Ian H. Stevenson
- Department of Psychological Sciences, University of Connecticut, Storrs, Connecticut
- Department of Biomedical Engineering, University of Connecticut, Storrs, Connecticut
| |
Collapse
|
11
|
Inference of synaptic connectivity and external variability in neural microcircuits. J Comput Neurosci 2020; 48:123-147. [PMID: 32080777 DOI: 10.1007/s10827-020-00739-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2019] [Revised: 11/15/2019] [Accepted: 01/03/2020] [Indexed: 10/25/2022]
Abstract
A major goal in neuroscience is to estimate neural connectivity from large scale extracellular recordings of neural activity in vivo. This is challenging in part because any such activity is modulated by the unmeasured external synaptic input to the network, known as the common input problem. Many different measures of functional connectivity have been proposed in the literature, but their direct relationship to synaptic connectivity is often assumed or ignored. For in vivo data, measurements of this relationship would require a knowledge of ground truth connectivity, which is nearly always unavailable. Instead, many studies use in silico simulations as benchmarks for investigation, but such approaches necessarily rely upon a variety of simplifying assumptions about the simulated network and can depend on numerous simulation parameters. We combine neuronal network simulations, mathematical analysis, and calcium imaging data to address the question of when and how functional connectivity, synaptic connectivity, and latent external input variability can be untangled. We show numerically and analytically that, even though the precision matrix of recorded spiking activity does not uniquely determine synaptic connectivity, it is in practice often closely related to synaptic connectivity. This relation becomes more pronounced when the spatial structure of neuronal variability is jointly considered.
Collapse
|
12
|
Inferring and validating mechanistic models of neural microcircuits based on spike-train data. Nat Commun 2019; 10:4933. [PMID: 31666513 PMCID: PMC6821748 DOI: 10.1038/s41467-019-12572-0] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2018] [Accepted: 09/18/2019] [Indexed: 01/11/2023] Open
Abstract
The interpretation of neuronal spike train recordings often relies on abstract statistical models that allow for principled parameter estimation and model selection but provide only limited insights into underlying microcircuits. In contrast, mechanistic models are useful to interpret microcircuit dynamics, but are rarely quantitatively matched to experimental data due to methodological challenges. Here we present analytical methods to efficiently fit spiking circuit models to single-trial spike trains. Using derived likelihood functions, we statistically infer the mean and variance of hidden inputs, neuronal adaptation properties and connectivity for coupled integrate-and-fire neurons. Comprehensive evaluations on synthetic data, validations using ground truth in-vitro and in-vivo recordings, and comparisons with existing techniques demonstrate that parameter estimation is very accurate and efficient, even for highly subsampled networks. Our methods bridge statistical, data-driven and theoretical, model-based neurosciences at the level of spiking circuits, for the purpose of a quantitative, mechanistic interpretation of recorded neuronal population activity. It is difficult to fit mechanistic, biophysically constrained circuit models to spike train data from in vivo extracellular recordings. Here the authors present analytical methods that enable efficient parameter estimation for integrate-and-fire circuit models and inference of the underlying connectivity structure in subsampled networks.
Collapse
|
13
|
Kobayashi R, Kurita S, Kurth A, Kitano K, Mizuseki K, Diesmann M, Richmond BJ, Shinomoto S. Reconstructing neuronal circuitry from parallel spike trains. Nat Commun 2019; 10:4468. [PMID: 31578320 PMCID: PMC6775109 DOI: 10.1038/s41467-019-12225-2] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2018] [Accepted: 08/27/2019] [Indexed: 11/23/2022] Open
Abstract
State-of-the-art techniques allow researchers to record large numbers of spike trains in parallel for many hours. With enough such data, we should be able to infer the connectivity among neurons. Here we develop a method for reconstructing neuronal circuitry by applying a generalized linear model (GLM) to spike cross-correlations. Our method estimates connections between neurons in units of postsynaptic potentials and the amount of spike recordings needed to verify connections. The performance of inference is optimized by counting the estimation errors using synthetic data. This method is superior to other established methods in correctly estimating connectivity. By applying our method to rat hippocampal data, we show that the types of estimated connections match the results inferred from other physiological cues. Thus our method provides the means to build a circuit diagram from recorded spike trains, thereby providing a basis for elucidating the differences in information processing in different brain regions. Current techniques have enabled the simultaneous collection of spike train data from large numbers of neurons. Here, the authors report a method to infer the underlying neural circuit connectivity diagram based on a generalized linear model applied to spike cross-correlations between neurons.
Collapse
Affiliation(s)
- Ryota Kobayashi
- National Institute of Informatics, Tokyo, 101-8430, Japan.,Department of Informatics, SOKENDAI (The Graduate University for Advanced Studies), Tokyo, 101-8430, Japan
| | - Shuhei Kurita
- Center for Advanced Intelligence Project, RIKEN, Tokyo, 103-0027, Japan
| | - Anno Kurth
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA-Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, 52425, Jülich, Germany.,Department of Physics, Faculty 1, RWTH Aachen University, Aachen, Germany
| | - Katsunori Kitano
- Department of Information Science and Engineering, Ritsumeikan University, Kusatsu, 525-8577, Japan
| | - Kenji Mizuseki
- Department of Physiology, Osaka City University Graduate School of Medicine, Osaka, 545-8585, Japan
| | - Markus Diesmann
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA-Institute Brain Structure-Function Relationships (INM-10), Jülich Research Centre, 52425, Jülich, Germany.,Department of Physics, Faculty 1, RWTH Aachen University, Aachen, Germany.,Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, Aachen, Germany
| | - Barry J Richmond
- Laboratory of Neuropsychology, NIMH/NIH/DHHS, Bethesda, MD, 20814, USA
| | - Shigeru Shinomoto
- Department of Physics, Kyoto University, Kyoto, 606-8502, Japan. .,Brain Information Communication Research Laboratory Group, ATR Institute International, Kyoto, 619-0288, Japan.
| |
Collapse
|
14
|
High-resolution directed human connectomes and the Consensus Connectome Dynamics. PLoS One 2019; 14:e0215473. [PMID: 30990832 PMCID: PMC6467387 DOI: 10.1371/journal.pone.0215473] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2018] [Accepted: 04/02/2019] [Indexed: 12/13/2022] Open
Abstract
Here we show a method of directing the edges of the connectomes, prepared from HARDI datasets from the human brain. Before the present work, no high-definition directed braingraphs were published, because the tractography methods in use are not capable of assigning directions to the neural tracts discovered. Previous work on the functional connectomes applied low-resolution functional MRI-detected statistical causality for the assignment of directions of connectomes of typically several dozens of vertices. Our method is based on the phenomenon of the “Consensus Connectome Dynamics”, described earlier by our research group. In this contribution, we apply the method to the 423 braingraphs, each with 1015 vertices, computed from the public release of the Human Connectome Project, and we also made the directed connectomes publicly available at the site http://braingraph.org. We also show the robustness of our edge directing method in four independently chosen connectome datasets: we have found that 86% of the edges, which were present in all four datasets, get the same directions in all datasets; therefore the direction method is robust. While our new edge-directing method still needs more empirical validation, we think that our present contribution opens up new possibilities in the analysis of the high-definition human connectome.
Collapse
|
15
|
Pastore VP, Massobrio P, Godjoski A, Martinoia S. Identification of excitatory-inhibitory links and network topology in large-scale neuronal assemblies from multi-electrode recordings. PLoS Comput Biol 2018; 14:e1006381. [PMID: 30148879 PMCID: PMC6128636 DOI: 10.1371/journal.pcbi.1006381] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Revised: 09/07/2018] [Accepted: 07/20/2018] [Indexed: 12/23/2022] Open
Abstract
Functional-effective connectivity and network topology are nowadays key issues for studying brain physiological functions and pathologies. Inferring neuronal connectivity from electrophysiological recordings presents open challenges and unsolved problems. In this work, we present a cross-correlation based method for reliably estimating not only excitatory but also inhibitory links, by analyzing multi-unit spike activity from large-scale neuronal networks. The method is validated by means of realistic simulations of large-scale neuronal populations. New results related to functional connectivity estimation and network topology identification obtained by experimental electrophysiological recordings from high-density and large-scale (i.e., 4096 electrodes) microtransducer arrays coupled to in vitro neural populations are presented. Specifically, we show that: (i) functional inhibitory connections are accurately identified in in vitro cortical networks, providing that a reasonable firing rate and recording length are achieved; (ii) small-world topology, with scale-free and rich-club features are reliably obtained, on condition that a minimum number of active recording sites are available. The method and procedure can be directly extended and applied to in vivo multi-units brain activity recordings. The balance between excitation and inhibition is fundamental for proper brain functions and for this reason is precisely regulated in adult cortices. Impaired excitation/inhibition balance is often associated with several neurological disorders, such as epilepsy, autism and schizophrenia. However, estimating functional inhibitory connections is not an easy task and few methods are available to identify such connections from electrophysiological data. Here we present a cross-correlation based method to identify both excitatory and inhibitory functional connections in large-scale neuronal networks. The method is applicable to both in vitro and in vivo spike data recordings. Once a connectivity map (i.e. a graph) is obtained, we characterized the associated topology by means of classical graph theory metrics to unveil functional architecture. In this work, we analyze in vitro cortical networks probed by means of large-scale microelectrode arrays (i.e., 4096 sensors) and we derive network topologies from spike data. The functional organization found is called “small-world and scale-free” and is the same organization found in cortical in vivo brain regions by means of different experimental methods. We also show that to obtain reliable information about network architecture at least a network with a hundred of nodes-neurons is needed.
Collapse
Affiliation(s)
- Vito Paolo Pastore
- University of Genova, Dept. of Informatics, Bioengineering, Robotics and System Engineering, Genova, Italy
| | - Paolo Massobrio
- University of Genova, Dept. of Informatics, Bioengineering, Robotics and System Engineering, Genova, Italy
| | - Aleksandar Godjoski
- University of Genova, Dept. of Informatics, Bioengineering, Robotics and System Engineering, Genova, Italy
- 3Brain gmbh, Wädenswil, Switzerland
| | - Sergio Martinoia
- University of Genova, Dept. of Informatics, Bioengineering, Robotics and System Engineering, Genova, Italy
- CNR—Institute of Biophysics, Genova, Italy
- * E-mail:
| |
Collapse
|
16
|
Casadiego J, Maoutsa D, Timme M. Inferring Network Connectivity from Event Timing Patterns. PHYSICAL REVIEW LETTERS 2018; 121:054101. [PMID: 30118266 DOI: 10.1103/physrevlett.121.054101] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2017] [Revised: 03/05/2018] [Indexed: 06/08/2023]
Abstract
Reconstructing network connectivity from the collective dynamics of a system typically requires access to its complete continuous-time evolution, although these are often experimentally inaccessible. Here we propose a theory for revealing physical connectivity of networked systems only from the event time series their intrinsic collective dynamics generate. Representing the patterns of event timings in an event space spanned by interevent and cross-event intervals, we reveal which other units directly influence the interevent times of any given unit. For illustration, we linearize an event-space mapping constructed from the spiking patterns in model neural circuits to reveal the presence or absence of synapses between any pair of neurons, as well as whether the coupling acts in an inhibiting or activating (excitatory) manner. The proposed model-independent reconstruction theory is scalable to larger networks and may thus play an important role in the reconstruction of networks from biology to social science and engineering.
Collapse
Affiliation(s)
- Jose Casadiego
- Chair for Network Dynamics, Institute of Theoretical Physics and Center for Advancing Electronics Dresden (cfaed), Technical University of Dresden, 01062 Dresden, Germany
- Network Dynamics, Max Planck Institute for Dynamics and Self-Organization (MPIDS), 37077 Göttingen, Germany
| | - Dimitra Maoutsa
- Network Dynamics, Max Planck Institute for Dynamics and Self-Organization (MPIDS), 37077 Göttingen, Germany
- Artificial Intelligence Group, Department of Software Engineering and Theoretical Computer Science, Technical University of Berlin, 10587 Berlin, Germany
| | - Marc Timme
- Chair for Network Dynamics, Institute of Theoretical Physics and Center for Advancing Electronics Dresden (cfaed), Technical University of Dresden, 01062 Dresden, Germany
- Network Dynamics, Max Planck Institute for Dynamics and Self-Organization (MPIDS), 37077 Göttingen, Germany
- Bernstein Center for Computational Neuroscience (BCCN), 37077 Göttingen, Germany
- Max Planck Institute for the Physics of Complex Systems, 01069 Dresden, Germany
| |
Collapse
|
17
|
Chambers B, Levy M, Dechery JB, MacLean JN. Ensemble stacking mitigates biases in inference of synaptic connectivity. Netw Neurosci 2018; 2:60-85. [PMID: 29911678 PMCID: PMC5989998 DOI: 10.1162/netn_a_00032] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2017] [Accepted: 10/11/2017] [Indexed: 01/26/2023] Open
Abstract
A promising alternative to directly measuring the anatomical connections in a neuronal population is inferring the connections from the activity. We employ simulated spiking neuronal networks to compare and contrast commonly used inference methods that identify likely excitatory synaptic connections using statistical regularities in spike timing. We find that simple adjustments to standard algorithms improve inference accuracy: A signing procedure improves the power of unsigned mutual-information-based approaches and a correction that accounts for differences in mean and variance of background timing relationships, such as those expected to be induced by heterogeneous firing rates, increases the sensitivity of frequency-based methods. We also find that different inference methods reveal distinct subsets of the synaptic network and each method exhibits different biases in the accurate detection of reciprocity and local clustering. To correct for errors and biases specific to single inference algorithms, we combine methods into an ensemble. Ensemble predictions, generated as a linear combination of multiple inference algorithms, are more sensitive than the best individual measures alone, and are more faithful to ground-truth statistics of connectivity, mitigating biases specific to single inference methods. These weightings generalize across simulated datasets, emphasizing the potential for the broad utility of ensemble-based approaches.
Collapse
Affiliation(s)
- Brendan Chambers
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA
| | - Maayan Levy
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA
| | - Joseph B Dechery
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA
| | - Jason N MacLean
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA.,Department of Neurobiology, University of Chicago, Chicago, IL, USA
| |
Collapse
|
18
|
Nowke C, Diaz-Pier S, Weyers B, Hentschel B, Morrison A, Kuhlen TW, Peyser A. Toward Rigorous Parameterization of Underconstrained Neural Network Models Through Interactive Visualization and Steering of Connectivity Generation. Front Neuroinform 2018; 12:32. [PMID: 29937723 PMCID: PMC5992991 DOI: 10.3389/fninf.2018.00032] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2017] [Accepted: 05/11/2018] [Indexed: 11/13/2022] Open
Abstract
Simulation models in many scientific fields can have non-unique solutions or unique solutions which can be difficult to find. Moreover, in evolving systems, unique final state solutions can be reached by multiple different trajectories. Neuroscience is no exception. Often, neural network models are subject to parameter fitting to obtain desirable output comparable to experimental data. Parameter fitting without sufficient constraints and a systematic exploration of the possible solution space can lead to conclusions valid only around local minima or around non-minima. To address this issue, we have developed an interactive tool for visualizing and steering parameters in neural network simulation models. In this work, we focus particularly on connectivity generation, since finding suitable connectivity configurations for neural network models constitutes a complex parameter search scenario. The development of the tool has been guided by several use cases-the tool allows researchers to steer the parameters of the connectivity generation during the simulation, thus quickly growing networks composed of multiple populations with a targeted mean activity. The flexibility of the software allows scientists to explore other connectivity and neuron variables apart from the ones presented as use cases. With this tool, we enable an interactive exploration of parameter spaces and a better understanding of neural network models and grapple with the crucial problem of non-unique network solutions and trajectories. In addition, we observe a reduction in turn around times for the assessment of these models, due to interactive visualization while the simulation is computed.
Collapse
Affiliation(s)
- Christian Nowke
- Visual Computing Institute, RWTH Aachen University, JARA-HPC, Aachen, Germany
| | - Sandra Diaz-Pier
- SimLab Neuroscience, Jülich Supercomputing Centre (JSC), Institute for Advanced Simulation, JARA, Forschungszentrum Jülich GmbH, Jülich, Germany
| | - Benjamin Weyers
- Visual Computing Institute, RWTH Aachen University, JARA-HPC, Aachen, Germany
| | - Bernd Hentschel
- Visual Computing Institute, RWTH Aachen University, JARA-HPC, Aachen, Germany
| | - Abigail Morrison
- SimLab Neuroscience, Jülich Supercomputing Centre (JSC), Institute for Advanced Simulation, JARA, Forschungszentrum Jülich GmbH, Jülich, Germany.,Institute of Neuroscience and Medicine, Institute for Advanced Simulation, JARA Institute Brain Structure-Function Relationships, Forschungszentrum Jülich GmbH, Jülich, Germany.,Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr-University Bochum, Bochum, Germany
| | - Torsten W Kuhlen
- Visual Computing Institute, RWTH Aachen University, JARA-HPC, Aachen, Germany
| | - Alexander Peyser
- SimLab Neuroscience, Jülich Supercomputing Centre (JSC), Institute for Advanced Simulation, JARA, Forschungszentrum Jülich GmbH, Jülich, Germany
| |
Collapse
|
19
|
Karbasi A, Salavati AH, Vetterli M. Learning neural connectivity from firing activity: efficient algorithms with provable guarantees on topology. J Comput Neurosci 2018; 44:253-272. [PMID: 29464489 PMCID: PMC5851696 DOI: 10.1007/s10827-018-0678-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2017] [Revised: 01/06/2018] [Accepted: 01/22/2018] [Indexed: 11/18/2022]
Abstract
The connectivity of a neuronal network has a major effect on its functionality and role. It is generally believed that the complex network structure of the brain provides a physiological basis for information processing. Therefore, identifying the network's topology has received a lot of attentions in neuroscience and has been the center of many research initiatives such as Human Connectome Project. Nevertheless, direct and invasive approaches that slice and observe the neural tissue have proven to be time consuming, complex and costly. As a result, the inverse methods that utilize firing activity of neurons in order to identify the (functional) connections have gained momentum recently, especially in light of rapid advances in recording technologies; It will soon be possible to simultaneously monitor the activities of tens of thousands of neurons in real time. While there are a number of excellent approaches that aim to identify the functional connections from firing activities, the scalability of the proposed techniques plays a major challenge in applying them on large-scale datasets of recorded firing activities. In exceptional cases where scalability has not been an issue, the theoretical performance guarantees are usually limited to a specific family of neurons or the type of firing activities. In this paper, we formulate the neural network reconstruction as an instance of a graph learning problem, where we observe the behavior of nodes/neurons (i.e., firing activities) and aim to find the links/connections. We develop a scalable learning mechanism and derive the conditions under which the estimated graph for a network of Leaky Integrate and Fire (LIf) neurons matches the true underlying synaptic connections. We then validate the performance of the algorithm using artificially generated data (for benchmarking) and real data recorded from multiple hippocampal areas in rats.
Collapse
Affiliation(s)
- Amin Karbasi
- Inference, Information and Decision Systems Group, Yale Institute for Network Science, Yale University, New Haven, CT 06520 USA
| | - Amir Hesam Salavati
- Laboratory of Audiovisual Communications (LCAV), School of Computer and Communication Sciences, Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland
| | - Martin Vetterli
- Laboratory of Audiovisual Communications (LCAV), School of Computer and Communication Sciences, Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland
| |
Collapse
|
20
|
Kass RE, Amari SI, Arai K, Brown EN, Diekman CO, Diesmann M, Doiron B, Eden UT, Fairhall AL, Fiddyment GM, Fukai T, Grün S, Harrison MT, Helias M, Nakahara H, Teramae JN, Thomas PJ, Reimers M, Rodu J, Rotstein HG, Shea-Brown E, Shimazaki H, Shinomoto S, Yu BM, Kramer MA. Computational Neuroscience: Mathematical and Statistical Perspectives. ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION 2018; 5:183-214. [PMID: 30976604 PMCID: PMC6454918 DOI: 10.1146/annurev-statistics-041715-033733] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
Mathematical and statistical models have played important roles in neuroscience, especially by describing the electrical activity of neurons recorded individually, or collectively across large networks. As the field moves forward rapidly, new challenges are emerging. For maximal effectiveness, those working to advance computational neuroscience will need to appreciate and exploit the complementary strengths of mechanistic theory and the statistical paradigm.
Collapse
Affiliation(s)
- Robert E Kass
- Carnegie Mellon University, Pittsburgh, PA, USA, 15213;
| | - Shun-Ichi Amari
- RIKEN Brain Science Institute, Wako, Saitama Prefecture, Japan, 351-0198
| | | | - Emery N Brown
- Massachusetts Institute of Technology, Cambridge, MA, USA, 02139
- Harvard Medical School, Boston, MA, USA, 02115
| | | | - Markus Diesmann
- Jülich Research Centre, Jülich, Germany, 52428
- RWTH Aachen University, Aachen, Germany, 52062
| | - Brent Doiron
- University of Pittsburgh, Pittsburgh, PA, USA, 15260
| | - Uri T Eden
- Boston University, Boston, MA, USA, 02215
| | | | | | - Tomoki Fukai
- RIKEN Brain Science Institute, Wako, Saitama Prefecture, Japan, 351-0198
| | - Sonja Grün
- Jülich Research Centre, Jülich, Germany, 52428
- RWTH Aachen University, Aachen, Germany, 52062
| | | | - Moritz Helias
- Jülich Research Centre, Jülich, Germany, 52428
- RWTH Aachen University, Aachen, Germany, 52062
| | - Hiroyuki Nakahara
- RIKEN Brain Science Institute, Wako, Saitama Prefecture, Japan, 351-0198
| | | | - Peter J Thomas
- Case Western Reserve University, Cleveland, OH, USA, 44106
| | - Mark Reimers
- Michigan State University, East Lansing, MI, USA, 48824
| | - Jordan Rodu
- Carnegie Mellon University, Pittsburgh, PA, USA, 15213;
| | | | | | - Hideaki Shimazaki
- Honda Research Institute Japan, Wako, Saitama Prefecture, Japan, 351-0188
- Kyoto University, Kyoto, Kyoto Prefecture, Japan, 606-8502
| | | | - Byron M Yu
- Carnegie Mellon University, Pittsburgh, PA, USA, 15213;
| | | |
Collapse
|
21
|
Wu J, Skilling QM, Maruyama D, Li C, Ognjanovski N, Aton S, Zochowski M. Functional network stability and average minimal distance - A framework to rapidly assess dynamics of functional network representations. J Neurosci Methods 2017; 296:69-83. [PMID: 29294309 DOI: 10.1016/j.jneumeth.2017.12.021] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2017] [Revised: 12/21/2017] [Accepted: 12/24/2017] [Indexed: 01/31/2023]
Abstract
BACKGROUND Recent advances in neurophysiological recording techniques have increased both the spatial and temporal resolution of data. New methodologies are required that can handle large data sets in an efficient manner as well as to make quantifiable, and realistic, predictions about the global modality of the brain from under-sampled recordings. NEW METHOD To rectify both problems, we first propose an analytical modification to an existing functional connectivity algorithm, Average Minimal Distance (AMD), to rapidly capture functional network connectivity. We then complement this algorithm by introducing Functional Network Stability (FuNS), a metric that can be used to quickly assess the global network dynamic changes over time, without being constrained by the activities of a specific set of neurons. RESULTS We systematically test the performance of AMD and FuNS (1) on artificial spiking data with different statistical characteristics, (2) from spiking data generated using a neural network model, and (3) using in vivo data recorded from mouse hippocampus during fear learning. Our results show that AMD and FuNS are able to monitor the change in network dynamics during memory consolidation. COMPARISON WITH OTHER METHODS AMD outperforms traditional bootstrapping and cross-correlation (CC) methods in both significance and computation time. Simultaneously, FuNS provides a reliable way to establish a link between local structural network changes, global dynamics of network-wide representations activity, and behavior. CONCLUSIONS The AMD-FuNS framework should be universally useful in linking long time-scale, global network dynamics and cognitive behavior.
Collapse
Affiliation(s)
- Jiaxing Wu
- Applied Physics Program, University of Michigan, Ann Arbor, MI, 48109, USA
| | | | - Daniel Maruyama
- Department of Physics, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Chenguang Li
- R.E.U program in Biophysics, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Nicolette Ognjanovski
- Department of Molecular, Cellular, and Developmental Biology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Sara Aton
- Department of Molecular, Cellular, and Developmental Biology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Michal Zochowski
- Applied Physics Program, University of Michigan, Ann Arbor, MI, 48109, USA; Biophysics Program, University of Michigan, Ann Arbor, MI, 48109, USA; Department of Physics, University of Michigan, Ann Arbor, MI, 48109, USA.
| |
Collapse
|
22
|
|
23
|
Gerhard F, Deger M, Truccolo W. On the stability and dynamics of stochastic spiking neuron models: Nonlinear Hawkes process and point process GLMs. PLoS Comput Biol 2017; 13:e1005390. [PMID: 28234899 PMCID: PMC5325182 DOI: 10.1371/journal.pcbi.1005390] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2016] [Accepted: 01/28/2017] [Indexed: 01/12/2023] Open
Abstract
Point process generalized linear models (PP-GLMs) provide an important statistical framework for modeling spiking activity in single-neurons and neuronal networks. Stochastic stability is essential when sampling from these models, as done in computational neuroscience to analyze statistical properties of neuronal dynamics and in neuro-engineering to implement closed-loop applications. Here we show, however, that despite passing common goodness-of-fit tests, PP-GLMs estimated from data are often unstable, leading to divergent firing rates. The inclusion of absolute refractory periods is not a satisfactory solution since the activity then typically settles into unphysiological rates. To address these issues, we derive a framework for determining the existence and stability of fixed points of the expected conditional intensity function (CIF) for general PP-GLMs. Specifically, in nonlinear Hawkes PP-GLMs, the CIF is expressed as a function of the previous spike history and exogenous inputs. We use a mean-field quasi-renewal (QR) approximation that decomposes spike history effects into the contribution of the last spike and an average of the CIF over all spike histories prior to the last spike. Fixed points for stationary rates are derived as self-consistent solutions of integral equations. Bifurcation analysis and the number of fixed points predict that the original models can show stable, divergent, and metastable (fragile) dynamics. For fragile models, fluctuations of the single-neuron dynamics predict expected divergence times after which rates approach unphysiologically high values. This metric can be used to estimate the probability of rates to remain physiological for given time periods, e.g., for simulation purposes. We demonstrate the use of the stability framework using simulated single-neuron examples and neurophysiological recordings. Finally, we show how to adapt PP-GLM estimation procedures to guarantee model stability. Overall, our results provide a stability framework for data-driven PP-GLMs and shed new light on the stochastic dynamics of state-of-the-art statistical models of neuronal spiking activity.
Collapse
Affiliation(s)
- Felipe Gerhard
- Department of Neuroscience, Brown University, Providence, Rhode Island, United States of America
| | - Moritz Deger
- School of Computer and Communication Sciences and School of Life Sciences, Brain Mind Institute, École polytechnique fédérale de Lausanne (EPFL), Lausanne, Switzerland
- Institute for Zoology, Faculty of Mathematics and Natural Sciences, University of Cologne, Cologne, Germany
| | - Wilson Truccolo
- Department of Neuroscience, Brown University, Providence, Rhode Island, United States of America
- Institute for Brain Science, Brown University, Providence, Rhode Island, United States of America
- Center for Neurorestoration & Neurotechnology, U. S. Department of Veterans Affairs, Providence, Rhode Island, United States of America
- * E-mail:
| |
Collapse
|
24
|
Truccolo W. From point process observations to collective neural dynamics: Nonlinear Hawkes process GLMs, low-dimensional dynamics and coarse graining. JOURNAL OF PHYSIOLOGY, PARIS 2016; 110:336-347. [PMID: 28336305 PMCID: PMC5610574 DOI: 10.1016/j.jphysparis.2017.02.004] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/31/2016] [Revised: 02/20/2017] [Accepted: 02/26/2017] [Indexed: 01/15/2023]
Abstract
This review presents a perspective on capturing collective dynamics in recorded neuronal ensembles based on multivariate point process models, inference of low-dimensional dynamics and coarse graining of spatiotemporal measurements. A general probabilistic framework for continuous time point processes reviewed, with an emphasis on multivariate nonlinear Hawkes processes with exogenous inputs. A point process generalized linear model (PP-GLM) framework for the estimation of discrete time multivariate nonlinear Hawkes processes is described. The approach is illustrated with the modeling of collective dynamics in neocortical neuronal ensembles recorded in human and non-human primates, and prediction of single-neuron spiking. A complementary approach to capture collective dynamics based on low-dimensional dynamics ("order parameters") inferred via latent state-space models with point process observations is presented. The approach is illustrated by inferring and decoding low-dimensional dynamics in primate motor cortex during naturalistic reach and grasp movements. Finally, we briefly review hypothesis tests based on conditional inference and spatiotemporal coarse graining for assessing collective dynamics in recorded neuronal ensembles.
Collapse
Affiliation(s)
- Wilson Truccolo
- Department of Neuroscience and Institute for Brain Science, Brown University, Providence, USA; Center for Neurorestoration and Neurotechnology, U.S. Department of Veterans Affairs, Providence, USA.
| |
Collapse
|
25
|
Rings T, Lehnertz K. Distinguishing between direct and indirect directional couplings in large oscillator networks: Partial or non-partial phase analyses? CHAOS (WOODBURY, N.Y.) 2016; 26:093106. [PMID: 27781446 DOI: 10.1063/1.4962295] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We investigate the relative merit of phase-based methods for inferring directional couplings in complex networks of weakly interacting dynamical systems from multivariate time-series data. We compare the evolution map approach and its partialized extension to each other with respect to their ability to correctly infer the network topology in the presence of indirect directional couplings for various simulated experimental situations using coupled model systems. In addition, we investigate whether the partialized approach allows for additional or complementary indications of directional interactions in evolving epileptic brain networks using intracranial electroencephalographic recordings from an epilepsy patient. For such networks, both direct and indirect directional couplings can be expected, given the brain's connection structure and effects that may arise from limitations inherent to the recording technique. Our findings indicate that particularly in larger networks (number of nodes ≫10), the partialized approach does not provide information about directional couplings extending the information gained with the evolution map approach.
Collapse
Affiliation(s)
- Thorsten Rings
- Department of Epileptology, University of Bonn, Sigmund-Freud-Straße 25, 53105 Bonn, Germany
| | - Klaus Lehnertz
- Department of Epileptology, University of Bonn, Sigmund-Freud-Straße 25, 53105 Bonn, Germany
| |
Collapse
|
26
|
Freestone DR, Karoly PJ, Peterson ADH, Kuhlmann L, Lai A, Goodarzy F, Cook MJ. Seizure Prediction: Science Fiction or Soon to Become Reality? Curr Neurol Neurosci Rep 2016; 15:73. [PMID: 26404726 DOI: 10.1007/s11910-015-0596-3] [Citation(s) in RCA: 43] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
This review highlights recent developments in the field of epileptic seizure prediction. We argue that seizure prediction is possible; however, most previous attempts have used data with an insufficient amount of information to solve the problem. The review discusses four methods for gaining more information above standard clinical electrophysiological recordings. We first discuss developments in obtaining long-term data that enables better characterisation of signal features and trends. Then, we discuss the usage of electrical stimulation to probe neural circuits to obtain robust information regarding excitability. Following this, we present a review of developments in high-resolution micro-electrode technologies that enable neuroimaging across spatial scales. Finally, we present recent results from data-driven model-based analyses, which enable imaging of seizure generating mechanisms from clinical electrophysiological measurements. It is foreseeable that the field of seizure prediction will shift focus to a more probabilistic forecasting approach leading to improvements in the quality of life for the millions of people who suffer uncontrolled seizures. However, a missing piece of the puzzle is devices to acquire long-term high-quality data. When this void is filled, seizure prediction will become a reality.
Collapse
Affiliation(s)
- Dean R Freestone
- Department of Medicine, St. Vincent's Hospital Melbourne, The University of Melbourne, Fitzroy, VIC, Australia, 3065. .,Department of Statistics, Columbia University, New York, NY, 10027, USA.
| | - Philippa J Karoly
- Department of Medicine, St. Vincent's Hospital Melbourne, The University of Melbourne, Fitzroy, VIC, Australia, 3065.,Department of Electrical and Electronic Engineering, The University of Melbourne, Parkville, VIC, Australia, 3000
| | - Andre D H Peterson
- Department of Medicine, St. Vincent's Hospital Melbourne, The University of Melbourne, Fitzroy, VIC, Australia, 3065
| | - Levin Kuhlmann
- Department of Electrical and Electronic Engineering, The University of Melbourne, Parkville, VIC, Australia, 3000
| | - Alan Lai
- Department of Electrical and Electronic Engineering, The University of Melbourne, Parkville, VIC, Australia, 3000
| | - Farhad Goodarzy
- Department of Electrical and Electronic Engineering, The University of Melbourne, Parkville, VIC, Australia, 3000
| | - Mark J Cook
- Department of Medicine, St. Vincent's Hospital Melbourne, The University of Melbourne, Fitzroy, VIC, Australia, 3065.
| |
Collapse
|
27
|
Gilson M, Moreno-Bote R, Ponce-Alvarez A, Ritter P, Deco G. Estimation of Directed Effective Connectivity from fMRI Functional Connectivity Hints at Asymmetries of Cortical Connectome. PLoS Comput Biol 2016; 12:e1004762. [PMID: 26982185 PMCID: PMC4794215 DOI: 10.1371/journal.pcbi.1004762] [Citation(s) in RCA: 102] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2015] [Accepted: 01/20/2016] [Indexed: 01/06/2023] Open
Abstract
The brain exhibits complex spatio-temporal patterns of activity. This phenomenon is governed by an interplay between the internal neural dynamics of cortical areas and their connectivity. Uncovering this complex relationship has raised much interest, both for theory and the interpretation of experimental data (e.g., fMRI recordings) using dynamical models. Here we focus on the so-called inverse problem: the inference of network parameters in a cortical model to reproduce empirically observed activity. Although it has received a lot of interest, recovering directed connectivity for large networks has been rather unsuccessful so far. The present study specifically addresses this point for a noise-diffusion network model. We develop a Lyapunov optimization that iteratively tunes the network connectivity in order to reproduce second-order moments of the node activity, or functional connectivity. We show theoretically and numerically that the use of covariances with both zero and non-zero time shifts is the key to infer directed connectivity. The first main theoretical finding is that an accurate estimation of the underlying network connectivity requires that the time shift for covariances is matched with the time constant of the dynamical system. In addition to the network connectivity, we also adjust the intrinsic noise received by each network node. The framework is applied to experimental fMRI data recorded for subjects at rest. Diffusion-weighted MRI data provide an estimate of anatomical connections, which is incorporated to constrain the cortical model. The empirical covariance structure is reproduced faithfully, especially its temporal component (i.e., time-shifted covariances) in addition to the spatial component that is usually the focus of studies. We find that the cortical interactions, referred to as effective connectivity, in the tuned model are not reciprocal. In particular, hubs are either receptors or feeders: they do not exhibit both strong incoming and outgoing connections. Our results sets a quantitative ground to explore the propagation of activity in the cortex. The study of interactions between different cortical regions at rest or during a task has considerably developed in the past decades thanks to progress in non-invasive imaging techniques, such as fMRI, EEG and MEG. These techniques have revealed that distant cortical areas exhibit specific correlated activity during the resting state, also called functional connectivity (FC). Moreover, recent studies have highlighted the possible role of white-matter projections between cortical regions in shaping these activity patterns. This structural connectivity (SC) can be estimated using MRI, which measures the probability for two areas to be connected via the density of neural fibers. However, this does not provide the strengths of dynamical interactions. Many methods have thus been developed to estimate the connectivity between neural populations in the cortex that is hypothesized to shape FC. The strengths of these dynamical interactions are called effective connectivity (EC). We use a cortical model that combines information from Diffusion-weighted MRI (dwMRI) and fMRI in order to estimate EC. We demonstrate theoretically that directed C can be inferred using time-shifted covariances. The key point of our method is the use of temporal information from FC at the scale of the whole network. Applying our model on experimental fMRI data at rest, we estimate the asymmetry of intracortical connectivity. Obtaining an accurate EC estimate is essential to analyze its graph properties, such as hubs. In particular, directed connectivity links to the asymmetry between input and output EC strengths of each node, which characterizes feeder and receiver hubs in the cortical network.
Collapse
Affiliation(s)
- Matthieu Gilson
- Center for Brain Cognition, Dept of Technology and Information, Universitat Pompeu Fabra, Barcelona, Spain
- * E-mail:
| | - Ruben Moreno-Bote
- Research Unit, Parc Sanitari Sant Joan de Déu and Universitat de Barcelona, Esplugues de Llobregat, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Esplugues de Llobregat, Barcelona, Spain
- Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain
- Serra Húnter Fellow Programme, Universitat Pompeu Fabra, Barcelona, Spain
| | - Adrián Ponce-Alvarez
- Center for Brain Cognition, Dept of Technology and Information, Universitat Pompeu Fabra, Barcelona, Spain
| | - Petra Ritter
- Minerva Research Group Brain Modes, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Department of Neurology, Charité - University Medicine, Berlin, Germany
- Bernstein Focus State Dependencies of Learning & Bernstein Center for Computational Neuroscience, Berlin, Germany
- Berlin School of Mind and Brain & Mind and Brain Institute, Humboldt University, Berlin, Germany
| | - Gustavo Deco
- Center for Brain Cognition, Dept of Technology and Information, Universitat Pompeu Fabra, Barcelona, Spain
- Institució Catalana de la Recerca i Estudis Avançats, Universitat Barcelona, Barcelona, Spain
| |
Collapse
|
28
|
Soudry D, Keshri S, Stinson P, Oh MH, Iyengar G, Paninski L. Efficient "Shotgun" Inference of Neural Connectivity from Highly Sub-sampled Activity Data. PLoS Comput Biol 2015; 11:e1004464. [PMID: 26465147 PMCID: PMC4605541 DOI: 10.1371/journal.pcbi.1004464] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2014] [Accepted: 07/09/2015] [Indexed: 11/19/2022] Open
Abstract
Inferring connectivity in neuronal networks remains a key challenge in statistical neuroscience. The “common input” problem presents a major roadblock: it is difficult to reliably distinguish causal connections between pairs of observed neurons versus correlations induced by common input from unobserved neurons. Available techniques allow us to simultaneously record, with sufficient temporal resolution, only a small fraction of the network. Consequently, naive connectivity estimators that neglect these common input effects are highly biased. This work proposes a “shotgun” experimental design, in which we observe multiple sub-networks briefly, in a serial manner. Thus, while the full network cannot be observed simultaneously at any given time, we may be able to observe much larger subsets of the network over the course of the entire experiment, thus ameliorating the common input problem. Using a generalized linear model for a spiking recurrent neural network, we develop a scalable approximate expected loglikelihood-based Bayesian method to perform network inference given this type of data, in which only a small fraction of the network is observed in each time bin. We demonstrate in simulation that the shotgun experimental design can eliminate the biases induced by common input effects. Networks with thousands of neurons, in which only a small fraction of the neurons is observed in each time bin, can be quickly and accurately estimated, achieving orders of magnitude speed up over previous approaches. Optical imaging of the activity in a neuronal network is limited by the scanning speed of the imaging device. Therefore, typically, only a small fixed part of the network is observed during the entire experiment. However, in such an experiment, it can be hard to infer from the observed activity patterns whether (1) a neuron A directly affects neuron B, or (2) another, unobserved neuron C affects both A and B. To deal with this issue, we propose a “shotgun” observation scheme, in which, at each time point, we observe a small changing subset of the neurons from the network. Consequently, many fewer neurons remain completely unobserved during the entire experiment, enabling us to eventually distinguish between cases (1) and (2) given sufficiently long experiments. Since previous inference algorithms cannot efficiently handle so many missing observations, we develop a scalable algorithm for data acquired using the shotgun observation scheme, in which only a small fraction of the neurons are observed in each time bin. Using this kind of simulated data, we show the algorithm is able to quickly infer connectivity in spiking recurrent networks with thousands of neurons.
Collapse
Affiliation(s)
- Daniel Soudry
- Department of Statistics, Department of Neuroscience, the Center for Theoretical Neuroscience, the Grossman Center for the Statistics of Mind, the Kavli Institute for Brain Science, and the NeuroTechnology Center, Columbia University, New York, New York, United States of America
| | - Suraj Keshri
- Department of Industrial Engineering and Operations Research, Columbia University, New York, New York, United States of America
| | - Patrick Stinson
- Department of Statistics, Department of Neuroscience, the Center for Theoretical Neuroscience, the Grossman Center for the Statistics of Mind, the Kavli Institute for Brain Science, and the NeuroTechnology Center, Columbia University, New York, New York, United States of America
| | - Min-Hwan Oh
- Department of Industrial Engineering and Operations Research, Columbia University, New York, New York, United States of America
| | - Garud Iyengar
- Department of Industrial Engineering and Operations Research, Columbia University, New York, New York, United States of America
| | - Liam Paninski
- Department of Statistics, Department of Neuroscience, the Center for Theoretical Neuroscience, the Grossman Center for the Statistics of Mind, the Kavli Institute for Brain Science, and the NeuroTechnology Center, Columbia University, New York, New York, United States of America
| |
Collapse
|