Model-free reconstruction of excitatory neuronal connectivity from calcium imaging signals

Improving on transfer entropy-based network reconstruction using time-delays: Approach and validation

Transfer entropy constitutes a viable model-free tool to infer causal relationships between two dynamical systems from their time-series. In an information-theoretic sense, transfer entropy associates a cause-and-effect relationship with directed information transfer, such that one may improve the prediction of the future of a dynamical system from the history of another system. Recent studies have proposed the use of transfer entropy to reconstruct networks, but the inherent dyadic nature of this metric challenges the development of a robust approach that can discriminate direct from indirect interactions between nodes. In this paper, we seek to fill this methodological gap through the cogent integration of time-delays in the transfer entropy computation. By recognizing that information transfer in the network is bound by a finite speed, we relate the value of the time-delayed transfer entropy between two nodes to the number of walks between them. Upon this premise, we lay out the foundation of an alternative framework for network reconstruction, which we illustrate through closed-form results on three-node networks and numerically validate on larger networks, using examples of Boolean models and chaotic maps.

Small-world networks of neuroblastoma cells cultured in three-dimensional polymeric scaffolds featuring multi-scale roughness

Understanding the mechanisms underlying cell-surface interaction is of fundamental importance for the rational design of scaffolds aiming at tissue engineering, tissue repair and neural regeneration applications. Here, we examined patterns of neuroblastoma cells cultured in three-dimensional polymeric scaffolds obtained by two-photon lithography. Because of the intrinsic resolution of the technique, the micrometric cylinders composing the scaffold have a lateral step size of ~200 nm, a surface roughness of around 20 nm, and large values of fractal dimension approaching 2.7. We found that cells in the scaffold assemble into separate groups with many elements per group. After cell wiring, we found that resulting networks exhibit high clustering, small path lengths, and small-world characteristics. These values of the topological characteristics of the network can potentially enhance the quality, quantity and density of information transported in the network compared to equivalent random graphs of the same size. This is one of the first direct observations of cells developing into 3D small-world networks in an artificial matrix.

High-order couplings in geometric complex networks of neurons

We explore the consequences of introducing higher-order interactions in a geometric complex network of Morris-Lecar neurons. We focus on the regime where traveling synchronization waves are observed from a first-neighbors-based coupling to evaluate the changes induced when higher-order dynamical interactions are included. We observe that the traveling-wave phenomenon gets enhanced by these interactions, allowing the activity to travel further in the system without generating pathological full synchronization states. This scheme could be a step toward a simple phenomenological modelization of neuroglial networks.

Spontaneous Functional Recovery after Focal Damage in Neuronal Cultures

Damage in biological neuronal networks triggers a complex functional reorganization whose mechanisms are still poorly understood. To delineate this reorganization process, here we investigate the functional alterations of in vitro rat cortical circuits following localized laser ablation. The analysis of the functional network configuration before and after ablation allowed us to quantify the extent of functional alterations and the characteristic spatial and temporal scales along recovery. We observed that damage precipitated a fast rerouting of information flow that restored network’s communicability in about 15 min. Functional restoration was led by the immediate neighbors around trauma but was orchestrated by the entire network. Our in vitro setup exposes the ability of neuronal circuits to articulate fast responses to acute damage, and may serve as a proxy to devise recovery strategies in actual brain circuits. Moreover, this biological setup can become a benchmark to empirically test network theories about the spontaneous recovery in dynamical networks.

Stability of spontaneous, correlated activity in mouse auditory cortex

Neural systems can be modeled as complex networks in which neural elements are represented as nodes linked to one another through structural or functional connections. The resulting network can be analyzed using mathematical tools from network science and graph theory to quantify the system’s topological organization and to better understand its function. Here, we used two-photon calcium imaging to record spontaneous activity from the same set of cells in mouse auditory cortex over the course of several weeks. We reconstruct functional networks in which cells are linked to one another by edges weighted according to the correlation of their fluorescence traces. We show that the networks exhibit modular structure across multiple topological scales and that these multi-scale modules unfold as part of a hierarchy. We also show that, on average, network architecture becomes increasingly dissimilar over time, with similarity decaying monotonically with the distance (in time) between sessions. Finally, we show that a small fraction of cells maintain strongly-correlated activity over multiple days, forming a stable temporal core surrounded by a fluctuating and variable periphery. Our work indicates a framework for studying spontaneous activity measured by two-photon calcium imaging using computational methods and graphical models from network science. The methods are flexible and easily extended to additional datasets, opening the possibility of studying cellular level network organization of neural systems and how that organization is modulated by stimuli or altered in models of disease.

Neurons coordinate their activity with one another, forming networks that help support adaptive, flexible behavior. Still, little is known about the organization of these networks at the cellular scale and their stability over time. Here, we reconstruct networks from calcium imaging data recorded in mouse primary auditory cortex. We show that these networks exhibit spatially constrained, hierarchical modular structure, which may facilitate specialized information processing. However, we show that connection weights and modular structure are also variable over time, changing on a timescale of days and adopting novel network configurations. Despite this, a small subset of neurons maintain their connections to one another and preserve their modular organization across time, forming a stable temporal core surrounded by a flexible periphery. These findings represent a conceptual bridge linking network analyses of macroscale and cellular-level neuroimaging data. They also represent a complementary approach to existing circuits- and systems-based interrogation of nervous system function, opening the door for deeper and more targeted analysis in the future.

Reconstructing neuronal circuitry from parallel spike trains

State-of-the-art techniques allow researchers to record large numbers of spike trains in parallel for many hours. With enough such data, we should be able to infer the connectivity among neurons. Here we develop a method for reconstructing neuronal circuitry by applying a generalized linear model (GLM) to spike cross-correlations. Our method estimates connections between neurons in units of postsynaptic potentials and the amount of spike recordings needed to verify connections. The performance of inference is optimized by counting the estimation errors using synthetic data. This method is superior to other established methods in correctly estimating connectivity. By applying our method to rat hippocampal data, we show that the types of estimated connections match the results inferred from other physiological cues. Thus our method provides the means to build a circuit diagram from recorded spike trains, thereby providing a basis for elucidating the differences in information processing in different brain regions.

Current techniques have enabled the simultaneous collection of spike train data from large numbers of neurons. Here, the authors report a method to infer the underlying neural circuit connectivity diagram based on a generalized linear model applied to spike cross-correlations between neurons.

A nanoelectrode array for obtaining intracellular recordings from thousands of connected neurons

Current electrophysiological or optical techniques cannot reliably perform simultaneous intracellular recordings from more than a few tens of neurons. Here we report a nanoelectrode array that can simultaneously obtain intracellular recordings from thousands of connected mammalian neurons in vitro. The array consists of 4,096 platinum-black electrodes with nanoscale roughness fabricated on top of a silicon chip that monolithically integrates 4,096 microscale amplifiers, configurable into pseudocurrent-clamp mode (for concurrent current injection and voltage recording) or into pseudovoltage-clamp mode (for concurrent voltage application and current recording). We used the array in pseudovoltage-clamp mode to measure the effects of drugs on ion-channel currents. In pseudocurrent-clamp mode, the array intracellularly recorded action potentials and postsynaptic potentials from thousands of neurons. In addition, we mapped over 300 excitatory and inhibitory synaptic connections from more than 1,700 neurons that were intracellularly recorded for 19 min. This high-throughput intracellular-recording technology could benefit functional connectome mapping, electrophysiological screening and other functional interrogations of neuronal networks.

Chemically Cross-Linked Carbon Nanotube Films Engineered to Control Neuronal Signaling

In recent years, the use of free-standing carbon nanotube (CNT) films for neural tissue engineering has attracted tremendous attention. CNT films show large surface area and high electrical conductivity that combined with flexibility and biocompatibility may promote neuron growth and differentiation while stimulating neural activity. In addition, adhesion, survival, and growth of neurons can be modulated through chemical modification of CNTs. Axonal and synaptic signaling can also be positively tuned by these materials. Here we describe the ability of free-standing CNT films to influence neuronal activity. We demonstrate that the degree of cross-linking between the CNTs has a strong impact on the electrical conductivity of the substrate, which, in turn, regulates neural circuit outputs.

Impact of targeted attack on the spontaneous activity in spatial and biologically-inspired neuronal networks

We study the structural and dynamical consequences of damage in spatial neuronal networks. Inspired by real in vitro networks, we construct directed networks embedded in a two-dimensional space and follow biological rules for designing the wiring of the system. As a result, synthetic cultures display strong metric correlations similar to those observed in real experiments. In its turn, neuronal dynamics is incorporated through the Izhikevich model adopting the parameters derived from observation in real cultures. We consider two scenarios for damage, targeted attacks on those neurons with the highest out-degree and random failures. By analyzing the evolution of both the giant connected component and the dynamical patterns of the neurons as nodes are removed, we observe that network activity halts for a removal of 50% of the nodes in targeted attacks, much lower than the 70% node removal required in the case of random failures. Notably, the decrease of neuronal activity is not gradual. Both damage scenarios portray "boosts" of activity just before full silencing that are not present in equivalent random (Erdös-Rényi) graphs. These boosts correspond to small, spatially compact subnetworks that are able to maintain high levels of activity. Since these subnetworks are absent in the equivalent random graphs, we hypothesize that metric correlations facilitate the existence of local circuits sufficiently integrated to maintain activity, shaping an intrinsic mechanism for resilience.

Media coverage and firearm acquisition in the aftermath of a mass shooting

With an alarming frequency, the United States is experiencing mass shooting events, which often result in heated public debates on firearm control. Whether such events play any role in recent dramatic increases in firearm prevalence remains an open question. This study adopts an information-theoretic framework to analyse the complex interplay between the occurrence of a mass shooting, media coverage on firearm control policies and firearm acquisition at both national and state levels. Through the analysis of time series from 1999 to 2017, we identify a correlation between the occurrence of a mass shooting and the rate of growth in firearm acquisition. More importantly, a transfer entropy analysis pinpoints media coverage on firearm control policies as a potential causal link in a Wiener-Granger sense that establishes this correlation. Our results demonstrate that media coverage may increase public worry about more stringent firearm control and partially drive increases in firearm prevalence.

High-throughput microscopy exposes a pharmacological window in which dual leucine zipper kinase inhibition preserves neuronal network connectivity

Therapeutic developments for neurodegenerative disorders are redirecting their focus to the mechanisms that contribute to neuronal connectivity and the loss thereof. Using a high-throughput microscopy pipeline that integrates morphological and functional measurements, we found that inhibition of dual leucine zipper kinase (DLK) increased neuronal connectivity in primary cortical cultures. This neuroprotective effect was not only observed in basal conditions but also in cultures depleted from antioxidants and in cultures in which microtubule stability was genetically perturbed. Based on the morphofunctional connectivity signature, we further showed that the effects were limited to a specific dose and time range. Thus, our results illustrate that profiling microscopy images with deep coverage enables sensitive interrogation of neuronal connectivity and allows exposing a pharmacological window for targeted treatments. In doing so, we revealed a broad-spectrum neuroprotective effect of DLK inhibition, which may have relevance to pathological conditions that ar.e associated with compromised neuronal connectivity.

High-resolution directed human connectomes and the Consensus Connectome Dynamics

Here we show a method of directing the edges of the connectomes, prepared from HARDI datasets from the human brain. Before the present work, no high-definition directed braingraphs were published, because the tractography methods in use are not capable of assigning directions to the neural tracts discovered. Previous work on the functional connectomes applied low-resolution functional MRI-detected statistical causality for the assignment of directions of connectomes of typically several dozens of vertices. Our method is based on the phenomenon of the “Consensus Connectome Dynamics”, described earlier by our research group. In this contribution, we apply the method to the 423 braingraphs, each with 1015 vertices, computed from the public release of the Human Connectome Project, and we also made the directed connectomes publicly available at the site http://braingraph.org. We also show the robustness of our edge directing method in four independently chosen connectome datasets: we have found that 86% of the edges, which were present in all four datasets, get the same directions in all datasets; therefore the direction method is robust. While our new edge-directing method still needs more empirical validation, we think that our present contribution opens up new possibilities in the analysis of the high-definition human connectome.

Reconstruction of Functional Connectivity from Multielectrode Recordings and Calcium Imaging

In the last two decades, increasing research efforts in neuroscience have been focused on determining both structural and functional connectivity of brain circuits, with the main goal of relating the wiring diagram of neuronal systems to their emerging properties, from the microscale to the macroscale. While combining multisite parallel recordings with structural circuits' reconstruction in vivo is still very challenging, the reductionist in vitro approach based on neuronal cultures offers lower technical difficulties and is much more stable under control conditions. In this chapter, we present different approaches to infer the connectivity of cultured neuronal networks using multielectrode array or calcium imaging recordings. We first formally introduce the used methods, and then we will describe into details how those methods were applied in case studies. Since multielectrode array and calcium imaging recordings provide distinct and complementary spatiotemporal features of neuronal activity, in this chapter we present the strategies implemented with the two different methodologies in distinct sections.

Impact of modular organization on dynamical richness in cortical networks

As in many naturally formed networks, the brain exhibits an inherent modular architecture that is the basis of its rich operability, robustness, and integration-segregation capacity. However, the mechanisms that allow spatially segregated neuronal assemblies to swiftly change from localized to global activity remain unclear. Here, we integrate microfabrication technology with in vitro cortical networks to investigate the dynamical repertoire and functional traits of four interconnected neuronal modules. We show that the coupling among modules is central. The highest dynamical richness of the network emerges at a critical connectivity at the verge of physical disconnection. Stronger coupling leads to a persistently coherent activity among the modules, while weaker coupling precipitates the activity to be localized solely within the modules. An in silico modeling of the experiments reveals that the advent of coherence is mediated by a trade-off between connectivity and subquorum firing, a mechanism flexible enough to allow for the coexistence of both segregated and integrated activities. Our results unveil a new functional advantage of modular organization in complex networks of nonlinear units.

Modeling driver cells in developing neuronal networks

Spontaneous emergence of synchronized population activity is a characteristic feature of developing brain circuits. Recent experiments in the developing neo-cortex showed the existence of driver cells able to impact the synchronization dynamics when single-handedly stimulated. We have developed a spiking network model capable to reproduce the experimental results, thus identifying two classes of driver cells: functional hubs and low functionally connected (LC) neurons. The functional hubs arranged in a clique orchestrated the synchronization build-up, while the LC drivers were lately or not at all recruited in the synchronization process. Notwithstanding, they were able to alter the network state when stimulated by modifying the temporal activation of the functional clique or even its composition. LC drivers can lead either to higher population synchrony or even to the arrest of population dynamics, upon stimulation. Noticeably, some LC driver can display both effects depending on the received stimulus. We show that in the model the presence of inhibitory neurons together with the assumption that younger cells are more excitable and less connected is crucial for the emergence of LC drivers. These results provide a further understanding of the structural-functional mechanisms underlying synchronized firings in developing circuits possibly related to the coordinated activity of cell assemblies in the adult brain.

Inference of time-varying networks through transfer entropy, the case of a Boolean network model

Inferring network topologies from the time series of individual units is of paramount importance in the study of biological and social networks. Despite considerable progress, our success in network inference is largely limited to static networks and autonomous node dynamics, which are often inadequate to describe complex systems. Here, we explore the possibility of reconstructing time-varying weighted topologies through the information-theoretic notion of transfer entropy. We focus on a Boolean network model in which the weight of the links and the spontaneous activity periodically vary in time. For slowly-varying dynamics, we establish closed-form expressions for the stationary periodic distribution and transfer entropy between each pair of nodes. Our results indicate that the instantaneous weight of each link is mapped into a corresponding transfer entropy value, thereby affording the possibility of pinpointing the dominant weights at each time. However, comparing transfer entropy readings at different times may provide erroneous estimates of the strength of the links in time, due to a counterintuitive modulation of the information flow by the non-autonomous dynamics. In fact, this time variation should be used to scale transfer entropy values toward the correct inference of the time evolution of the network weights. This study constitutes a necessary step toward a mathematically-principled use of transfer entropy to reconstruct time-varying networks.

On the nature and use of models in network neuroscience

Network theory provides an intuitively appealing framework for studying relationships among interconnected brain mechanisms and their relevance to behaviour. As the space of its applications grows, so does the diversity of meanings of the term network model. This diversity can cause confusion, complicate efforts to assess model validity and efficacy, and hamper interdisciplinary collaboration. In this Review, we examine the field of network neuroscience, focusing on organizing principles that can help overcome these challenges. First, we describe the fundamental goals in constructing network models. Second, we review the most common forms of network models, which can be described parsimoniously along the following three primary dimensions: from data representations to first-principles theory; from biophysical realism to functional phenomenology; and from elementary descriptions to coarse-grained approximations. Third, we draw on biology, philosophy and other disciplines to establish validation principles for these models. We close with a discussion of opportunities to bridge model types and point to exciting frontiers for future pursuits.

Statistical inference approach to structural reconstruction of complex networks from binary time series

Complex networks hosting binary-state dynamics arise in a variety of contexts. In spite of previous works, to fully reconstruct the network structure from observed binary data remains challenging. We articulate a statistical inference based approach to this problem. In particular, exploiting the expectation-maximization (EM) algorithm, we develop a method to ascertain the neighbors of any node in the network based solely on binary data, thereby recovering the full topology of the network. A key ingredient of our method is the maximum-likelihood estimation of the probabilities associated with actual or nonexistent links, and we show that the EM algorithm can distinguish the two kinds of probability values without any ambiguity, insofar as the length of the available binary time series is reasonably long. Our method does not require any a priori knowledge of the detailed dynamical processes, is parameter-free, and is capable of accurate reconstruction even in the presence of noise. We demonstrate the method using combinations of distinct types of binary dynamical processes and network topologies, and provide a physical understanding of the underlying reconstruction mechanism. Our statistical inference based reconstruction method contributes an additional piece to the rapidly expanding "toolbox" of data based reverse engineering of complex networked systems.

Ensemble stacking mitigates biases in inference of synaptic connectivity

A promising alternative to directly measuring the anatomical connections in a neuronal population is inferring the connections from the activity. We employ simulated spiking neuronal networks to compare and contrast commonly used inference methods that identify likely excitatory synaptic connections using statistical regularities in spike timing. We find that simple adjustments to standard algorithms improve inference accuracy: A signing procedure improves the power of unsigned mutual-information-based approaches and a correction that accounts for differences in mean and variance of background timing relationships, such as those expected to be induced by heterogeneous firing rates, increases the sensitivity of frequency-based methods. We also find that different inference methods reveal distinct subsets of the synaptic network and each method exhibits different biases in the accurate detection of reciprocity and local clustering. To correct for errors and biases specific to single inference algorithms, we combine methods into an ensemble. Ensemble predictions, generated as a linear combination of multiple inference algorithms, are more sensitive than the best individual measures alone, and are more faithful to ground-truth statistics of connectivity, mitigating biases specific to single inference methods. These weightings generalize across simulated datasets, emphasizing the potential for the broad utility of ensemble-based approaches.

Connectivity inference from neural recording data: Challenges, mathematical bases and research directions

This article presents a review of computational methods for connectivity inference from neural activity data derived from multi-electrode recordings or fluorescence imaging. We first identify biophysical and technical challenges in connectivity inference along the data processing pipeline. We then review connectivity inference methods based on two major mathematical foundations, namely, descriptive model-free approaches and generative model-based approaches. We investigate representative studies in both categories and clarify which challenges have been addressed by which method. We further identify critical open issues and possible research directions.

Neural electrical activity and neural network growth

The development of central and peripheral neural system depends in part on the emergence of the correct functional connectivity in its input and output pathways. Now it is generally accepted that molecular factors guide neurons to establish a primary scaffold that undergoes activity-dependent refinement for building a fully functional circuit. However, a number of experimental results obtained recently shows that the neuronal electrical activity plays an important role in the establishing of initial interneuronal connections. Nevertheless, these processes are rather difficult to study experimentally, due to the absence of theoretical description and quantitative parameters for estimation of the neuronal activity influence on growth in neural networks. In this work we propose a general framework for a theoretical description of the activity-dependent neural network growth. The theoretical description incorporates a closed-loop growth model in which the neural activity can affect neurite outgrowth, which in turn can affect neural activity. We carried out the detailed quantitative analysis of spatiotemporal activity patterns and studied the relationship between individual cells and the network as a whole to explore the relationship between developing connectivity and activity patterns. The model, developed in this work will allow us to develop new experimental techniques for studying and quantifying the influence of the neuronal activity on growth processes in neural networks and may lead to a novel techniques for constructing large-scale neural networks by self-organization.

Collective Sensing of β-Cells Generates the Metabolic Code

Major part of a pancreatic islet is composed of β-cells that secrete insulin, a key hormone regulating influx of nutrients into all cells in a vertebrate organism to support nutrition, housekeeping or energy storage. β-cells constantly communicate with each other using both direct, short-range interactions through gap junctions, and paracrine long-range signaling. However, how these cell interactions shape collective sensing and cell behavior in islets that leads to insulin release is unknown. When stimulated by specific ligands, primarily glucose, β-cells collectively respond with expression of a series of transient Ca²⁺ changes on several temporal scales. Here we reanalyze a set of Ca²⁺ spike trains recorded in acute rodent pancreatic tissue slice under physiological conditions. We found strongly correlated states of co-spiking cells coexisting with mostly weak pairwise correlations widespread across the islet. Furthermore, the collective Ca²⁺ spiking activity in islet shows on-off intermittency with scaling of spiking amplitudes, and stimulus dependent autoassociative memory features. We use a simple spin glass-like model for the functional network of a β-cell collective to describe these findings and argue that Ca²⁺ spike trains produced by collective sensing of β-cells constitute part of the islet metabolic code that regulates insulin release and limits the islet size.

7,8-dihydroxyflavone ameliorates cognitive and motor deficits in a Huntington's disease mouse model through specific activation of the PLCγ1 pathway

Huntington's disease (HD) is a fatal neurodegenerative disease with motor, cognitive and psychiatric impairment. Dysfunctions in HD models have been related to reduced levels of striatal brain-derived neurotrophic factor (BDNF) and imbalance between its receptors TrkB and p75(NTR). Thus, molecules with activity on the BDNF/TrkB/p75 system can have therapeutic potential. 7,8-Dihydroxyflavone (7,8-DHF) was described as a TrkB agonist in several models of neuro-degenerative diseases, however, its TrkB activation profile needs further investigation due to its pleiotropic properties and divergence from BDNF effect. To investigate this, we used in vitro and in vivo models of HD to dissect TrkB activation upon 7,8-DHF treatment. 7,8-DHF treatment in primary cultures showed phosphorylation of TrkBY816 but not TrkBY515 with activation of the PLCγ1 pathway leading to morphological and functional improvements. Chronic administration of 7,8-DHF delayed motor deficits in R6/1 mice and reversed deficits on the Novel Object Recognition Test (NORT) at 17 weeks. Morphological and biochemical analyses revealed improved striatal levels of enkephalin, and prevention of striatal volume loss. We found a TrkBY816 but not TrkBY515 phosphorylation recovery in striatum concordant with in vitro results. Additionally, 7,8-DHF normalized striatal levels of induced and neuronal nitric oxide synthase (iNOS and nNOS, respectively) and ameliorated the imbalance of p75/TrkB. Our results provide new insights into the mechanism of action of 7,8-DHF suggesting that its effect through the TrkB receptor in striatum is via selective phosphorylation of its Y816 residue and activation of PLCγ1 pathway, but pleiotropic effects of the drug also contribute to its therapeutic potential.

Rewiring of neuronal networks during synaptic silencing

Analyzing the connectivity of neuronal networks, based on functional brain imaging data, has yielded new insight into brain circuitry, bringing functional and effective networks into the focus of interest for understanding complex neurological and psychiatric disorders. However, the analysis of network changes, based on the activity of individual neurons, is hindered by the lack of suitable meaningful and reproducible methodologies. Here, we used calcium imaging, statistical spike time analysis and a powerful classification model to reconstruct effective networks of primary rat hippocampal neurons in vitro. This method enables the calculation of network parameters, such as propagation probability, path length, and clustering behavior through the measurement of synaptic activity at the single-cell level, thus providing a fuller understanding of how changes at single synapses translate to an entire population of neurons. We demonstrate that our methodology can detect the known effects of drug-induced neuronal inactivity and can be used to investigate the extensive rewiring processes affecting population-wide connectivity patterns after periods of induced neuronal inactivity.

Inferring structural connectivity using Ising couplings in models of neuronal networks

Functional connectivity metrics have been widely used to infer the underlying structural connectivity in neuronal networks. Maximum entropy based Ising models have been suggested to discount the effect of indirect interactions and give good results in inferring the true anatomical connections. However, no benchmarking is currently available to assess the performance of Ising couplings against other functional connectivity metrics in the microscopic scale of neuronal networks through a wide set of network conditions and network structures. In this paper, we study the performance of the Ising model couplings to infer the synaptic connectivity in in silico networks of neurons and compare its performance against partial and cross-correlations for different correlation levels, firing rates, network sizes, network densities, and topologies. Our results show that the relative performance amongst the three functional connectivity metrics depends primarily on the network correlation levels. Ising couplings detected the most structural links at very weak network correlation levels, and partial correlations outperformed Ising couplings and cross-correlations at strong correlation levels. The result was consistent across varying firing rates, network sizes, and topologies. The findings of this paper serve as a guide in choosing the right functional connectivity tool to reconstruct the structural connectivity.

Differential Covariance: A New Class of Methods to Estimate Sparse Connectivity from Neural Recordings

With our ability to record more neurons simultaneously, making sense of these data is a challenge. Functional connectivity is one popular way to study the relationship of multiple neural signals. Correlation-based methods are a set of currently well-used techniques for functional connectivity estimation. However, due to explaining away and unobserved common inputs (Stevenson, Rebesco, Miller, & Körding, 2008 ), they produce spurious connections. The general linear model (GLM), which models spike trains as Poisson processes (Okatan, Wilson, & Brown, 2005 ; Truccolo, Eden, Fellows, Donoghue, & Brown, 2005 ; Pillow et al., 2008 ), avoids these confounds. We develop here a new class of methods by using differential signals based on simulated intracellular voltage recordings. It is equivalent to a regularized AR(2) model. We also expand the method to simulated local field potential recordings and calcium imaging. In all of our simulated data, the differential covariance-based methods achieved performance better than or similar to the GLM method and required fewer data samples. This new class of methods provides alternative ways to analyze neural signals.

Robustness and versatility of a nonlinear interdependence method for directional coupling detection from spike trains

The detection of directional couplings between dynamics based on measured spike trains is a crucial problem in the understanding of many different systems. In particular, in neuroscience it is important to assess the connectivity between neurons. One of the approaches that can estimate directional coupling from the analysis of point processes is the nonlinear interdependence measure L. Although its efficacy has already been demonstrated, it still needs to be tested under more challenging and realistic conditions prior to an application to real data. Thus, in this paper we use the Hindmarsh-Rose model system to test the method in the presence of noise and for different spiking regimes. We also examine the influence of different parameters and spike train distances. Our results show that the measure L is versatile and robust to various types of noise, and thus suitable for application to experimental data.

Reconstructing complex networks without time series

In the real world there are situations where the network dynamics are transient (e.g., various spreading processes) and the final nodal states represent the available data. Can the network topology be reconstructed based on data that are not time series? Assuming that an ensemble of the final nodal states resulting from statistically independent initial triggers (signals) of the spreading dynamics is available, we develop a maximum likelihood estimation-based framework to accurately infer the interaction topology. For dynamical processes that result in a binary final state, the framework enables network reconstruction based solely on the final nodal states. Additional information, such as the first arrival time of each signal at each node, can improve the reconstruction accuracy. For processes with a uniform final state, the first arrival times can be exploited to reconstruct the network. We derive a mathematical theory for our framework and validate its performance and robustness using various combinations of spreading dynamics and real-world network topologies.

On the Structure of Cortical Microcircuits Inferred from Small Sample Sizes

The structure in cortical microcircuits deviates from what would be expected in a purely random network, which has been seen as evidence of clustering. To address this issue, we sought to reproduce the nonrandom features of cortical circuits by considering several distinct classes of network topology, including clustered networks, networks with distance-dependent connectivity, and those with broad degree distributions. To our surprise, we found that all of these qualitatively distinct topologies could account equally well for all reported nonrandom features despite being easily distinguishable from one another at the network level. This apparent paradox was a consequence of estimating network properties given only small sample sizes. In other words, networks that differ markedly in their global structure can look quite similar locally. This makes inferring network structure from small sample sizes, a necessity given the technical difficulty inherent in simultaneous intracellular recordings, problematic. We found that a network statistic called the sample degree correlation (SDC) overcomes this difficulty. The SDC depends only on parameters that can be estimated reliably given small sample sizes and is an accurate fingerprint of every topological family. We applied the SDC criterion to data from rat visual and somatosensory cortex and discovered that the connectivity was not consistent with any of these main topological classes. However, we were able to fit the experimental data with a more general network class, of which all previous topologies were special cases. The resulting network topology could be interpreted as a combination of physical spatial dependence and nonspatial, hierarchical clustering.SIGNIFICANCE STATEMENT The connectivity of cortical microcircuits exhibits features that are inconsistent with a simple random network. Here, we show that several classes of network models can account for this nonrandom structure despite qualitative differences in their global properties. This apparent paradox is a consequence of the small numbers of simultaneously recorded neurons in experiment: when inferred via small sample sizes, many networks may be indistinguishable despite being globally distinct. We develop a connectivity measure that successfully classifies networks even when estimated locally with a few neurons at a time. We show that data from rat cortex is consistent with a network in which the likelihood of a connection between neurons depends on spatial distance and on nonspatial, asymmetric clustering.

Information theory and robotics meet to study predator-prey interactions

Transfer entropy holds promise to advance our understanding of animal behavior, by affording the identification of causal relationships that underlie animal interactions. A critical step toward the reliable implementation of this powerful information-theoretic concept entails the design of experiments in which causal relationships could be systematically controlled. Here, we put forward a robotics-based experimental approach to test the validity of transfer entropy in the study of predator-prey interactions. We investigate the behavioral response of zebrafish to a fear-evoking robotic stimulus, designed after the morpho-physiology of the red tiger oscar and actuated along preprogrammed trajectories. From the time series of the positions of the zebrafish and the robotic stimulus, we demonstrate that transfer entropy correctly identifies the influence of the stimulus on the focal subject. Building on this evidence, we apply transfer entropy to study the interactions between zebrafish and a live red tiger oscar. The analysis of transfer entropy reveals a change in the direction of the information flow, suggesting a mutual influence between the predator and the prey, where the predator adapts its strategy as a function of the movement of the prey, which, in turn, adjusts its escape as a function of the predator motion. Through the integration of information theory and robotics, this study posits a new approach to study predator-prey interactions in freshwater fish.

Mapping functional connectivity of bursting neuronal networks

Using single-cell laser scanning photostimulation (LSPS) combined with broad-field calcium imaging, we measured the functional connectivity of neuronal cultures before and after the developmental appearance of network bursting. From these data, network properties were determined for these relatively large neuronal networks. Based on these properties, we found that although 'small-world' network behavior existed throughout this time period, only average node degree and global efficiency correlate with the development of network bursting while clustering and local efficiency remained relatively constant.

Flexible information routing by transient synchrony

Perception, cognition and behavior rely on flexible communication between microcircuits in distinct cortical regions. The mechanisms underlying rapid information rerouting between such microcircuits are still unknown. It has been proposed that changing patterns of coherence between local gamma rhythms support flexible information rerouting. The stochastic and transient nature of gamma oscillations in vivo, however, is hard to reconcile with such a function. Here we show that models of cortical circuits near the onset of oscillatory synchrony selectively route input signals despite the short duration of gamma bursts and the irregularity of neuronal firing. In canonical multiarea circuits, we find that gamma bursts spontaneously arise with matched timing and frequency and that they organize information flow by large-scale routing states. Specific self-organized routing states can be induced by minor modulations of background activity.

Weak connections form an infinite number of patterns in the brain

Recently, much attention has been paid to interpreting the mechanisms for memory formation in terms of brain connectivity and dynamics. Within the plethora of collective states a complex network can exhibit, we show that the phenomenon of Collective Almost Synchronisation (CAS), which describes a state with an infinite number of patterns emerging in complex networks for weak coupling strengths, deserves special attention. We show that a simulated neuron network with neurons weakly connected does produce CAS patterns, and additionally produces an output that optimally model experimental electroencephalograph (EEG) signals. This work provides strong evidence that the brain operates locally in a CAS regime, allowing it to have an unlimited number of dynamical patterns, a state that could explain the enormous memory capacity of the brain, and that would give support to the idea that local clusters of neurons are sufficiently decorrelated to independently process information locally.

Transfer entropy in continuous time, with applications to jump and neural spiking processes

Transfer entropy has been used to quantify the directed flow of information between source and target variables in many complex systems. While transfer entropy was originally formulated in discrete time, in this paper we provide a framework for considering transfer entropy in continuous time systems, based on Radon-Nikodym derivatives between measures of complete path realizations. To describe the information dynamics of individual path realizations, we introduce the pathwise transfer entropy, the expectation of which is the transfer entropy accumulated over a finite time interval. We demonstrate that this formalism permits an instantaneous transfer entropy rate. These properties are analogous to the behavior of physical quantities defined along paths such as work and heat. We use this approach to produce an explicit form for the transfer entropy for pure jump processes, and highlight the simplified form in the specific case of point processes (frequently used in neuroscience to model neural spike trains). Finally, we present two synthetic spiking neuron model examples to exhibit the pertinent features of our formalism, namely, that the information flow for point processes consists of discontinuous jump contributions (at spikes in the target) interrupting a continuously varying contribution (relating to waiting times between target spikes). Numerical schemes based on our formalism promise significant benefits over existing strategies based on discrete time formalisms.

A spatially resolved network spike in model neuronal cultures reveals nucleation centers, circular traveling waves and drifting spiral waves

We show that in model neuronal cultures, where the probability of interneuronal connection formation decreases exponentially with increasing distance between the neurons, there exists a small number of spatial nucleation centers of a network spike, from where the synchronous spiking activity starts propagating in the network typically in the form of circular traveling waves. The number of nucleation centers and their spatial locations are unique and unchanged for a given realization of neuronal network but are different for different networks. In contrast, if the probability of interneuronal connection formation is independent of the distance between neurons, then the nucleation centers do not arise and the synchronization of spiking activity during a network spike occurs spatially uniform throughout the network. Therefore one can conclude that spatial proximity of connections between neurons is important for the formation of nucleation centers. It is also shown that fluctuations of the spatial density of neurons at their random homogeneous distribution typical for the experiments in vitro do not determine the locations of the nucleation centers. The simulation results are qualitatively consistent with the experimental observations.

Mesoscale Architecture Shapes Initiation and Richness of Spontaneous Network Activity

Spontaneous activity in the absence of external input, including propagating waves of activity, is a robust feature of neuronal networks in vivo and in vitro The neurophysiological and anatomical requirements for initiation and persistence of such activity, however, are poorly understood, as is their role in the function of neuronal networks. Computational network studies indicate that clustered connectivity may foster the generation, maintenance, and richness of spontaneous activity. Since this mesoscale architecture cannot be systematically modified in intact tissue, testing these predictions is impracticable in vivo Here, we investigate how the mesoscale structure shapes spontaneous activity in generic networks of rat cortical neurons in vitro In these networks, neurons spontaneously arrange into local clusters with high neurite density and form fasciculating long-range axons. We modified this structure by modulation of protein kinase C, an enzyme regulating neurite growth and cell migration. Inhibition of protein kinase C reduced neuronal aggregation and fasciculation of axons, i.e., promoted uniform architecture. Conversely, activation of protein kinase C promoted aggregation of neurons into clusters, local connectivity, and bundling of long-range axons. Supporting predictions from theory, clustered networks were more spontaneously active and generated diverse activity patterns. Neurons within clusters received stronger synaptic inputs and displayed increased membrane potential fluctuations. Intensified clustering promoted the initiation of synchronous bursting events but entailed incomplete network recruitment. Moderately clustered networks appear optimal for initiation and propagation of diverse patterns of activity. Our findings support a crucial role of the mesoscale architectures in the regulation of spontaneous activity dynamics.SIGNIFICANCE STATEMENT Computational studies predict richer and persisting spatiotemporal patterns of spontaneous activity in neuronal networks with neuron clustering. To test this, we created networks of varying architecture in vitro Supporting these predictions, the generation and spatiotemporal patterns of propagation were most variable in networks with intermediate clustering and lowest in uniform networks. Grid-like clustering, on the other hand, facilitated spontaneous activity but led to degenerating patterns of propagation. Neurons outside clusters had weaker synaptic input than neurons within clusters, in which increased membrane potential fluctuations facilitated the initiation of synchronized spike activity. Our results thus show that the intermediate level organization of neuronal networks strongly influences the dynamics of their activity.

Micro-connectomics: probing the organization of neuronal networks at the cellular scale

Defining the organizational principles of neuronal networks at the cellular scale, or micro-connectomics, is a key challenge of modern neuroscience. In this Review, we focus on graph theoretical parameters of micro-connectome topology, often informed by economical principles that conceptually originated with Ramón y Cajal's conservation laws. First, we summarize results from studies in intact small organisms and in samples from larger nervous systems. We then evaluate the evidence for an economical trade-off between biological cost and functional value in the organization of neuronal networks. Various results suggest that many aspects of neuronal network organization are indeed the outcome of competition between these two fundamental selection pressures.

Quantifying Long-Range Interactions and Coherent Structure in Multi-Agent Dynamics

We develop and apply several novel methods quantifying dynamic multi-agent team interactions. These interactions are detected information-theoretically and captured in two ways: via (i) directed networks (interaction diagrams) representing significant coupled dynamics between pairs of agents, and (ii) state-space plots (coherence diagrams) showing coherent structures in Shannon information dynamics. This model-free analysis relates, on the one hand, the information transfer to responsiveness of the agents and the team, and, on the other hand, the information storage within the team to the team's rigidity and lack of tactical flexibility. The resultant interaction and coherence diagrams reveal implicit interactions, across teams, that may be spatially long-range. The analysis was verified with a statistically significant number of experiments (using simulated football games, produced during RoboCup 2D Simulation League matches), identifying the zones of the most intense competition, the extent and types of interactions, and the correlation between the strength of specific interactions and the results of the matches.

Network inference from multimodal data: A review of approaches from infectious disease transmission

Networks inference problems are commonly found in multiple biomedical subfields such as genomics, metagenomics, neuroscience, and epidemiology. Networks are useful for representing a wide range of complex interactions ranging from those between molecular biomarkers, neurons, and microbial communities, to those found in human or animal populations. Recent technological advances have resulted in an increasing amount of healthcare data in multiple modalities, increasing the preponderance of network inference problems. Multi-domain data can now be used to improve the robustness and reliability of recovered networks from unimodal data. For infectious diseases in particular, there is a body of knowledge that has been focused on combining multiple pieces of linked information. Combining or analyzing disparate modalities in concert has demonstrated greater insight into disease transmission than could be obtained from any single modality in isolation. This has been particularly helpful in understanding incidence and transmission at early stages of infections that have pandemic potential. Novel pieces of linked information in the form of spatial, temporal, and other covariates including high-throughput sequence data, clinical visits, social network information, pharmaceutical prescriptions, and clinical symptoms (reported as free-text data) also encourage further investigation of these methods. The purpose of this review is to provide an in-depth analysis of multimodal infectious disease transmission network inference methods with a specific focus on Bayesian inference. We focus on analytical Bayesian inference-based methods as this enables recovering multiple parameters simultaneously, for example, not just the disease transmission network, but also parameters of epidemic dynamics. Our review studies their assumptions, key inference parameters and limitations, and ultimately provides insights about improving future network inference methods in multiple applications.

Detecting causality in policy diffusion processes

A universal question in network science entails learning about the topology of interaction from collective dynamics. Here, we address this question by examining diffusion of laws across US states. We propose two complementary techniques to unravel determinants of this diffusion process: information-theoretic union transfer entropy and event synchronization. In order to systematically investigate their performance on law activity data, we establish a new stochastic model to generate synthetic law activity data based on plausible networks of interactions. Through extensive parametric studies, we demonstrate the ability of these methods to reconstruct networks, varying in size, link density, and degree heterogeneity. Our results suggest that union transfer entropy should be preferred for slowly varying processes, which may be associated with policies attending to specific local problems that occur only rarely or with policies facing high levels of opposition. In contrast, event synchronization is effective for faster enactment rates, which may be related to policies involving Federal mandates or incentives. This study puts forward a data-driven toolbox to explain the determinants of legal activity applicable to political science, across dynamical systems, information theory, and complex networks.

Understanding Policy Diffusion in the U.S.: An Information-Theoretical Approach to Unveil Connectivity Structures in Slowly Evolving Complex Systems

Detecting and explaining the relationships among interacting components has long been a focal point of dynamical systems research. In this paper, we extend these types of data-driven analyses to the realm of public policy, whereby individual legislative entities interact to produce changes in their legal and political environments. We focus on the U.S. public health policy landscape, whose complexity determines our capacity as a society to effectively tackle pressing health issues. It has long been thought that some U.S. states innovate and enact new policies, while others mimic successful or competing states. However, the extent to which states learn from others, and the state characteristics that lead two states to influence one another, are not fully understood. Here, we propose a model-free, information-theoretical method to measure the existence and direction of influence of one state's policy or legal activity on others. Specifically, we tailor a popular notion of causality to handle the slow time-scale of policy adoption dynamics and unravel relationships among states from their recent law enactment histories. The method is validated using surrogate data generated from a new stochastic model of policy activity. Through the analysis of real data in alcohol, driving safety, and impaired driving policy, we provide evidence for the role of geography, political ideology, risk factors, and demographic and economic indicators on a state's tendency to learn from others when shaping its approach to public health regulation. Our method offers a new model-free approach to uncover interactions and establish cause-and-effect in slowly-evolving complex dynamical systems.

Invisible Brain: Knowledge in Research Works and Neuron Activity

If the market has an invisible hand, does knowledge creation and representation have an "invisible brain"? While knowledge is viewed as a product of neuron activity in the brain, can we identify knowledge that is outside the brain but reflects the activity of neurons in the brain? This work suggests that the patterns of neuron activity in the brain can be seen in the representation of knowledge-related activity. Here we show that the neuron activity mechanism seems to represent much of the knowledge learned in the past decades based on published articles, in what can be viewed as an "invisible brain" or collective hidden neural networks. Similar results appear when analyzing knowledge activity in patents. Our work also tries to characterize knowledge increase as neuron network activity growth. The results propose that knowledge-related activity can be seen outside of the neuron activity mechanism. Consequently, knowledge might exist as an independent mechanism.

Empirical Bayesian significance measure of neuronal spike response

Background

Functional connectivity analyses of multiple neurons provide a powerful bottom-up approach to reveal functions of local neuronal circuits by using simultaneous recording of neuronal activity. A statistical methodology, generalized linear modeling (GLM) of the spike response function, is one of the most promising methodologies to reduce false link discoveries arising from pseudo-correlation based on common inputs. Although recent advancement of fluorescent imaging techniques has increased the number of simultaneously recoded neurons up to the hundreds or thousands, the amount of information per pair of neurons has not correspondingly increased, partly because of the instruments’ limitations, and partly because the number of neuron pairs increase in a quadratic manner. Consequently, the estimation of GLM suffers from large statistical uncertainty caused by the shortage in effective information.

Results

In this study, we propose a new combination of GLM and empirical Bayesian testing for the estimation of spike response functions that enables both conservative false discovery control and powerful functional connectivity detection. We compared our proposed method’s performance with those of sparse estimation of GLM and classical Granger causality testing. Our method achieved high detection performance of functional connectivity with conservative estimation of false discovery rate and q values in case of information shortage due to short observation time. We also showed that empirical Bayesian testing on arbitrary statistics in place of likelihood-ratio statistics reduce the computational cost without decreasing the detection performance. When our proposed method was applied to a functional multi-neuron calcium imaging dataset from the rat hippocampal region, we found significant functional connections that are possibly mediated by AMPA and NMDA receptors.

Conclusions

The proposed empirical Bayesian testing framework with GLM is promising especially when the amount of information per a neuron pair is small because of growing size of observed network.

Electronic supplementary material

The online version of this article (doi:10.1186/s12868-016-0255-x) contains supplementary material, which is available to authorized users.

High-Degree Neurons Feed Cortical Computations

Recent work has shown that functional connectivity among cortical neurons is highly varied, with a small percentage of neurons having many more connections than others. Also, recent theoretical developments now make it possible to quantify how neurons modify information from the connections they receive. Therefore, it is now possible to investigate how information modification, or computation, depends on the number of connections a neuron receives (in-degree) or sends out (out-degree). To do this, we recorded the simultaneous spiking activity of hundreds of neurons in cortico-hippocampal slice cultures using a high-density 512-electrode array. This preparation and recording method combination produced large numbers of neurons recorded at temporal and spatial resolutions that are not currently available in any in vivo recording system. We utilized transfer entropy (a well-established method for detecting linear and nonlinear interactions in time series) and the partial information decomposition (a powerful, recently developed tool for dissecting multivariate information processing into distinct parts) to quantify computation between neurons where information flows converged. We found that computations did not occur equally in all neurons throughout the networks. Surprisingly, neurons that computed large amounts of information tended to receive connections from high out-degree neurons. However, the in-degree of a neuron was not related to the amount of information it computed. To gain insight into these findings, we developed a simple feedforward network model. We found that a degree-modified Hebbian wiring rule best reproduced the pattern of computation and degree correlation results seen in the real data. Interestingly, this rule also maximized signal propagation in the presence of network-wide correlations, suggesting a mechanism by which cortex could deal with common random background input. These are the first results to show that the extent to which a neuron modifies incoming information streams depends on its topological location in the surrounding functional network.

We recorded the electrical activity of hundreds of neurons simultaneously in brain tissue from mice and we analyzed these signals using state-of-the-art tools from information theory. These tools allowed us to ascertain which neurons were transmitting information to other neurons and to characterize the computations performed by neurons using the inputs they received from two or more other neurons. We found that computations did not occur equally in all neurons throughout the networks. Surprisingly, neurons that computed large amounts of information tended to be recipients of information from neurons with a large number of outgoing connections. Interestingly, the number of incoming connections to a neuron was not related to the amount of information that neuron computed. To better understand these results, we built a network model to match the data. Unexpectedly, the model also maximized information transfer in the presence of network-wide correlations. This suggested a way that networks of cortical neurons could deal with common random background input. These results are the first to show that the amount of information computed by a neuron depends on where it is located in the surrounding network.

Graphene Oxide Nanosheets Reshape Synaptic Function in Cultured Brain Networks

Graphene offers promising advantages for biomedical applications. However, adoption of graphene technology in biomedicine also poses important challenges in terms of understanding cell responses, cellular uptake, or the intracellular fate of soluble graphene derivatives. In the biological microenvironment, graphene nanosheets might interact with exposed cellular and subcellular structures, resulting in unexpected regulation of sophisticated biological signaling. More broadly, biomedical devices based on the design of these 2D planar nanostructures for interventions in the central nervous system require an accurate understanding of their interactions with the neuronal milieu. Here, we describe the ability of graphene oxide nanosheets to down-regulate neuronal signaling without affecting cell viability.

Modularity Induced Gating and Delays in Neuronal Networks

Neural networks, despite their highly interconnected nature, exhibit distinctly localized and gated activation. Modularity, a distinctive feature of neural networks, has been recently proposed as an important parameter determining the manner by which networks support activity propagation. Here we use an engineered biological model, consisting of engineered rat cortical neurons, to study the role of modular topology in gating the activity between cell populations. We show that pairs of connected modules support conditional propagation (transmitting stronger bursts with higher probability), long delays and propagation asymmetry. Moreover, large modular networks manifest diverse patterns of both local and global activation. Blocking inhibition decreased activity diversity and replaced it with highly consistent transmission patterns. By independently controlling modularity and disinhibition, experimentally and in a model, we pose that modular topology is an important parameter affecting activation localization and is instrumental for population-level gating by disinhibition.

The capacity to transmit information between connected parts of a neuronal network is fundamental to its function. The organization of network connections (the topology of the network) is therefore expected to play an important role in determining network transmission. Since modular topology characterizes many brain circuits on multiple scales, investigating the role of modularity in activity gating is clearly desirable. By engineering such modular networks in vitro, we were able to perform such an investigation. Under these experimental conditions, we can independently control the degree of modularity, as well as inhibition in the network. We show that a combination of these two properties is highly beneficial from a communication perspective. Namely, it equips connected modules and large modular networks with the capacity to gate and temporally coordinate activity between the different parts of the network.

Model-free information-theoretic approach to infer leadership in pairs of zebrafish

Collective behavior affords several advantages to fish in avoiding predators, foraging, mating, and swimming. Although fish schools have been traditionally considered egalitarian superorganisms, a number of empirical observations suggest the emergence of leadership in gregarious groups. Detecting and classifying leader-follower relationships is central to elucidate the behavioral and physiological causes of leadership and understand its consequences. Here, we demonstrate an information-theoretic approach to infer leadership from positional data of fish swimming. In this framework, we measure social interactions between fish pairs through the mathematical construct of transfer entropy, which quantifies the predictive power of a time series to anticipate another, possibly coupled, time series. We focus on the zebrafish model organism, which is rapidly emerging as a species of choice in preclinical research for its genetic similarity to humans and reduced neurobiological complexity with respect to mammals. To overcome experimental confounds and generate test data sets on which we can thoroughly assess our approach, we adapt and calibrate a data-driven stochastic model of zebrafish motion for the simulation of a coupled dynamical system of zebrafish pairs. In this synthetic data set, the extent and direction of the coupling between the fish are systematically varied across a wide parameter range to demonstrate the accuracy and reliability of transfer entropy in inferring leadership. Our approach is expected to aid in the analysis of collective behavior, providing a data-driven perspective to understand social interactions.