Diagrammatic expansion of pulse-coupled network dynamics in terms of subnetworks

Olfactory encoding within the insect antennal lobe: The emergence and role of higher order temporal correlations in the dynamics of antennal lobe spiking activity

In this review, we focus on the antennal lobe (AL) of three insect species - the fruit fly, sphinx moth, and locust. We first review the experimentally elucidated anatomy and physiology of the early olfactory system of each species; empirical studies of AL activity, however, often focus on assessing firing rates (averaged over time scales of about 100 ms), and hence the AL odor code is often analyzed in terms of a temporally evolving vector of firing rates. However, such a perspective necessarily misses the possibility of higher order temporal correlations in spiking activity within a single cell and across multiple cells over shorter time scales (of about 10 ms). Hence, we then review our prior theoretical work, where we constructed biophysically detailed, species-specific AL models within the fly, moth, and locust, finding that in each case higher order temporal correlations in spiking naturally emerge from model dynamics (i.e., without a prioriincorporation of elements designed to produce correlated activity). We therefore use our theoretical work to argue the perspective that temporal correlations in spiking over short time scales, which have received little experimental attention to-date, may provide valuable coding dimensions (complementing the coding dimensions provided by the vector of firing rates) that nature has exploited in the encoding of odors within the AL. We further argue that, if the AL does indeed utilize temporally correlated activity to represent odor information, such an odor code could be naturally and easily deciphered within the Mushroom Body.

Dimensionality in recurrent spiking networks: Global trends in activity and local origins in connectivity

The dimensionality of a network's collective activity is of increasing interest in neuroscience. This is because dimensionality provides a compact measure of how coordinated network-wide activity is, in terms of the number of modes (or degrees of freedom) that it can independently explore. A low number of modes suggests a compressed low dimensional neural code and reveals interpretable dynamics [1], while findings of high dimension may suggest flexible computations [2, 3]. Here, we address the fundamental question of how dimensionality is related to connectivity, in both autonomous and stimulus-driven networks. Working with a simple spiking network model, we derive three main findings. First, the dimensionality of global activity patterns can be strongly, and systematically, regulated by local connectivity structures. Second, the dimensionality is a better indicator than average correlations in determining how constrained neural activity is. Third, stimulus evoked neural activity interacts systematically with neural connectivity patterns, leading to network responses of either greater or lesser dimensionality than the stimulus.

Interplay between Graph Topology and Correlations of Third Order in Spiking Neuronal Networks

The study of processes evolving on networks has recently become a very popular research field, not only because of the rich mathematical theory that underpins it, but also because of its many possible applications, a number of them in the field of biology. Indeed, molecular signaling pathways, gene regulation, predator-prey interactions and the communication between neurons in the brain can be seen as examples of networks with complex dynamics. The properties of such dynamics depend largely on the topology of the underlying network graph. In this work, we want to answer the following question: Knowing network connectivity, what can be said about the level of third-order correlations that will characterize the network dynamics? We consider a linear point process as a model for pulse-coded, or spiking activity in a neuronal network. Using recent results from theory of such processes, we study third-order correlations between spike trains in such a system and explain which features of the network graph (i.e. which topological motifs) are responsible for their emergence. Comparing two different models of network topology—random networks of Erdős-Rényi type and networks with highly interconnected hubs—we find that, in random networks, the average measure of third-order correlations does not depend on the local connectivity properties, but rather on global parameters, such as the connection probability. This, however, ceases to be the case in networks with a geometric out-degree distribution, where topological specificities have a strong impact on average correlations.

Many biological phenomena can be viewed as dynamical processes on a graph. Understanding coordinated activity of nodes in such a network is of some importance, as it helps to characterize the behavior of the complex system. Of course, the topology of a network plays a pivotal role in determining the level of coordination among its different vertices. In particular, correlations between triplets of events (here: action potentials generated by neurons) have recently garnered some interest in the theoretical neuroscience community. In this paper, we present a decomposition of an average measure of third-order coordinated activity of neurons in a spiking neuronal network in terms of the relevant topological motifs present in the underlying graph. We study different network topologies and show, in particular, that the presence of certain tree motifs in the synaptic connectivity graph greatly affects the strength of third-order correlations between spike trains of different neurons.

Functional roles for synaptic-depression within a model of the fly antennal lobe

Several experiments indicate that there exists substantial synaptic-depression at the synapses between olfactory receptor neurons (ORNs) and neurons within the drosophila antenna lobe (AL). This synaptic-depression may be partly caused by vesicle-depletion, and partly caused by presynaptic-inhibition due to the activity of inhibitory local neurons within the AL. While it has been proposed that this synaptic-depression contributes to the nonlinear relationship between ORN and projection neuron (PN) firing-rates, the precise functional role of synaptic-depression at the ORN synapses is not yet fully understood. In this paper we propose two hypotheses linking the information-coding properties of the fly AL with the network mechanisms responsible for ORNAL synaptic-depression. Our first hypothesis is related to variance coding of ORN firing-rate information — once stimulation to the ORNs is sufficiently high to saturate glomerular responses, further stimulation of the ORNs increases the regularity of PN spiking activity while maintaining PN firing-rates. The second hypothesis proposes a tradeoff between spike-time reliability and coding-capacity governed by the relative contribution of vesicle-depletion and presynaptic-inhibition to ORNAL synaptic-depression. Synaptic-depression caused primarily by vesicle-depletion will give rise to a very reliable system, whereas an equivalent amount of synaptic-depression caused primarily by presynaptic-inhibition will give rise to a less reliable system that is more sensitive to small shifts in odor stimulation. These two hypotheses are substantiated by several small analyzable toy models of the fly AL, as well as a more physiologically realistic large-scale computational model of the fly AL involving glomerular channels.

Understanding the intricacies of sensory processing is a major scientific challenge. In this paper we examine the early stages of the olfactory system of the fruit-fly. Many experiments have revealed a great deal regarding the architecture of this system, including the types of neurons within it, as well as the connections those neurons make amongst one another. In this paper we examine the potential dynamics produced by this neuronal network. Specifically, we construct a computational model of this early olfactory system and study the effects of synaptic-depression within this system. We find that the dynamics and coding properties of this system depend strongly on the strength, and sources of, synaptic-depression. This work has ramifications for understanding the coding properties of other insect olfactory systems, and perhaps even other sensory modalities in other animals.

Impact of network structure and cellular response on spike time correlations

Novel experimental techniques reveal the simultaneous activity of larger and larger numbers of neurons. As a result there is increasing interest in the structure of cooperative – or correlated – activity in neural populations, and in the possible impact of such correlations on the neural code. A fundamental theoretical challenge is to understand how the architecture of network connectivity along with the dynamical properties of single cells shape the magnitude and timescale of correlations. We provide a general approach to this problem by extending prior techniques based on linear response theory. We consider networks of general integrate-and-fire cells with arbitrary architecture, and provide explicit expressions for the approximate cross-correlation between constituent cells. These correlations depend strongly on the operating point (input mean and variance) of the neurons, even when connectivity is fixed. Moreover, the approximations admit an expansion in powers of the matrices that describe the network architecture. This expansion can be readily interpreted in terms of paths between different cells. We apply our results to large excitatory-inhibitory networks, and demonstrate first how precise balance – or lack thereof – between the strengths and timescales of excitatory and inhibitory synapses is reflected in the overall correlation structure of the network. We then derive explicit expressions for the average correlation structure in randomly connected networks. These expressions help to identify the important factors that shape coordinated neural activity in such networks.

Is neural activity more than the sum of its individual parts? What is the impact of cooperative, or correlated, spiking among multiple cells? We can start addressing these questions, as rapid advances in experimental techniques allow simultaneous recordings from ever-increasing populations. However, we still lack a general understanding of the origin and consequences of the joint activity that is revealed. The challenge is compounded by the fact that both the intrinsic dynamics of single cells and the correlations among then vary depending on the overall state of the network. Here, we develop a toolbox that addresses this issue. Specifically, we show how linear response theory allows for the expression of correlations explicitly in terms of the underlying network connectivity and known single-cell properties – and that the predictions of this theory accurately match simulations of a touchstone, nonlinear model in computational neuroscience, the general integrate-and-fire cell. Thus, our theory should help unlock the relationship between network architecture, single-cell dynamics, and correlated activity in diverse neural circuits.