Waves, bumps, and patterns in neural field theories

Determination of effective brain connectivity from functional connectivity using propagator-based interferometry and neural field theory with application to the corticothalamic system

It is shown how to compute both direct and total effective connection matrices (deCMs and teCMs), which embody the strengths of neural connections between regions, from correlation-based functional CMs using propagator-based interferometry, a method that stems from geophysics and acoustics, coupled with the recent identification of deCMs and teCMs with bare and dressed propagators, respectively. The approach incorporates excitatory and inhibitory connections, multiple structures and populations, and measurement effects. The propagator is found for a generalized scalar wave equation derived from neural field theory, and expressed in terms of neural activity correlations and covariances, and wave damping rates. It is then related to correlation matrices that are commonly used to express functional and effective connectivities in the brain. The results are illustrated in analytically tractable test cases.

Dynamic mechanisms of neocortical focal seizure onset

Recent experimental and clinical studies have provided diverse insight into the mechanisms of human focal seizure initiation and propagation. Often these findings exist at different scales of observation, and are not reconciled into a common understanding. Here we develop a new, multiscale mathematical model of cortical electric activity with realistic mesoscopic connectivity. Relating the model dynamics to experimental and clinical findings leads us to propose three classes of dynamical mechanisms for the onset of focal seizures in a unified framework. These three classes are: (i) globally induced focal seizures; (ii) globally supported focal seizures; (iii) locally induced focal seizures. Using model simulations we illustrate these onset mechanisms and show how the three classes can be distinguished. Specifically, we find that although all focal seizures typically appear to arise from localised tissue, the mechanisms of onset could be due to either localised processes or processes on a larger spatial scale. We conclude that although focal seizures might have different patient-specific aetiologies and electrographic signatures, our model suggests that dynamically they can still be classified in a clinically useful way. Additionally, this novel classification according to the dynamical mechanisms is able to resolve some of the previously conflicting experimental and clinical findings.

According to the WHO fact sheet, epilepsy is a neurological disorder affecting about 50 million people worldwide. Even today 30% of epilepsy patients do not respond well to drug therapies. Neocortical focal epilepsy is a particular type of epilepsy in which drug treatments fail and surgical success rate is low. Hence, research is essential to improve the treatment of this type of epilepsy. Recent advances in brain recording methods have led to new observations regarding the nature of neocortical focal epilepsy. However, some of the observations appear to be contradictory. Here, we develop a computational modelling framework that can explain the different observations as different aspects of possible mechanisms that can all lead to seizure onset. Specifically, we classify three main conditions under which focal seizure onset can happen. This classification is clinically important, as our model predicts different treatment strategies for each class. We conclude that focal seizures are diverse, not only in their electrographic appearance and aetiology, but also in their onset mechanism. Combined multiscale recordings as well as stimulation studies are required to elucidate the onset mechanism in each patient. Our work provides the first classification of possible onset mechanism.

Large deviations for nonlocal stochastic neural fields

We study the effect of additive noise on integro-differential neural field equations. In particular, we analyze an Amari-type model driven by a Q-Wiener process, and focus on noise-induced transitions and escape. We argue that proving a sharp Kramers' law for neural fields poses substantial difficulties, but that one may transfer techniques from stochastic partial differential equations to establish a large deviation principle (LDP). Then we demonstrate that an efficient finite-dimensional approximation of the stochastic neural field equation can be achieved using a Galerkin method and that the resulting finite-dimensional rate function for the LDP can have a multiscale structure in certain cases. These results form the starting point for an efficient practical computation of the LDP. Our approach also provides the technical basis for further rigorous study of noise-induced transitions in neural fields based on Galerkin approximations.Mathematics Subject Classification (2000): 60F10, 60H15, 65M60, 92C20.

Bifurcation study of a neural field competition model with an application to perceptual switching in motion integration

Perceptual multistability is a phenomenon in which alternate interpretations of a fixed stimulus are perceived intermittently. Although correlates between activity in specific cortical areas and perception have been found, the complex patterns of activity and the underlying mechanisms that gate multistable perception are little understood. Here, we present a neural field competition model in which competing states are represented in a continuous feature space. Bifurcation analysis is used to describe the different types of complex spatio-temporal dynamics produced by the model in terms of several parameters and for different inputs. The dynamics of the model was then compared to human perception investigated psychophysically during long presentations of an ambiguous, multistable motion pattern known as the barberpole illusion. In order to do this, the model is operated in a parameter range where known physiological response properties are reproduced whilst also working close to bifurcation. The model accounts for characteristic behaviour from the psychophysical experiments in terms of the type of switching observed and changes in the rate of switching with respect to contrast. In this way, the modelling study sheds light on the underlying mechanisms that drive perceptual switching in different contrast regimes. The general approach presented is applicable to a broad range of perceptual competition problems in which spatial interactions play a role.

Capture of fixation by rotational flow; a deterministic hypothesis regarding scaling and stochasticity in fixational eye movements

Visual scan paths exhibit complex, stochastic dynamics. Even during visual fixation, the eye is in constant motion. Fixational drift and tremor are thought to reflect fluctuations in the persistent neural activity of neural integrators in the oculomotor brainstem, which integrate sequences of transient saccadic velocity signals into a short term memory of eye position. Despite intensive research and much progress, the precise mechanisms by which oculomotor posture is maintained remain elusive. Drift exhibits a stochastic statistical profile which has been modeled using random walk formalisms. Tremor is widely dismissed as noise. Here we focus on the dynamical profile of fixational tremor, and argue that tremor may be a signal which usefully reflects the workings of oculomotor postural control. We identify signatures reminiscent of a certain flavor of transient neurodynamics; toric traveling waves which rotate around a central phase singularity. Spiral waves play an organizational role in dynamical systems at many scales throughout nature, though their potential functional role in brain activity remains a matter of educated speculation. Spiral waves have a repertoire of functionally interesting dynamical properties, including persistence, which suggest that they could in theory contribute to persistent neural activity in the oculomotor postural control system. Whilst speculative, the singularity hypothesis of oculomotor postural control implies testable predictions, and could provide the beginnings of an integrated dynamical framework for eye movements across scales.

How pattern formation in ring networks of excitatory and inhibitory spiking neurons depends on the input current regime

Pattern formation, i.e., the generation of an inhomogeneous spatial activity distribution in a dynamical system with translation invariant structure, is a well-studied phenomenon in neuronal network dynamics, specifically in neural field models. These are population models to describe the spatio-temporal dynamics of large groups of neurons in terms of macroscopic variables such as population firing rates. Though neural field models are often deduced from and equipped with biophysically meaningful properties, a direct mapping to simulations of individual spiking neuron populations is rarely considered. Neurons have a distinct identity defined by their action on their postsynaptic targets. In its simplest form they act either excitatorily or inhibitorily. When the distribution of neuron identities is assumed to be periodic, pattern formation can be observed, given the coupling strength is supracritical, i.e., larger than a critical weight. We find that this critical weight is strongly dependent on the characteristics of the neuronal input, i.e., depends on whether neurons are mean- or fluctuation driven, and different limits in linearizing the full non-linear system apply in order to assess stability. In particular, if neurons are mean-driven, the linearization has a very simple form and becomes independent of both the fixed point firing rate and the variance of the input current, while in the very strongly fluctuation-driven regime the fixed point rate, as well as the input mean and variance are important parameters in the determination of the critical weight. We demonstrate that interestingly even in "intermediate" regimes, when the system is technically fluctuation-driven, the simple linearization neglecting the variance of the input can yield the better prediction of the critical coupling strength. We moreover analyze the effects of structural randomness by rewiring individual synapses or redistributing weights, as well as coarse-graining on the formation of inhomogeneous activity patterns.

Formation of localized structures in bistable systems through nonlocal spatial coupling. I. General framework

The present work studies the influence of nonlocal spatial coupling on the existence of localized structures in one-dimensional extended systems. We consider systems described by a real field with a nonlocal coupling that has a linear dependence on the field. Leveraging spatial dynamics we provide a general framework to understand the effect of the nonlocality on the shape of the fronts connecting two stable states. In particular we show that nonlocal terms can induce spatial oscillations in the front tails, allowing for the creation of localized structures, that emerge from pinning between two fronts. In parameter space the region where fronts are oscillatory is limited by three transitions: the modulational instability of the homogeneous state, the Belyakov-Devaney transition in which monotonic fronts acquire spatial oscillations with infinite wavelength, and a crossover in which monotonically decaying fronts develop spatial oscillations with a finite wavelength. We show how these transitions are organized by codimension 2 and 3 points and illustrate how by changing the parameters of the nonlocal coupling it is possible to bring the system into the region where localized structures can be formed.

Formation of localized structures in bistable systems through nonlocal spatial coupling. II. The nonlocal Ginzburg-Landau equation

We study the influence of a linear nonlocal spatial coupling on the interaction of fronts connecting two equivalent stable states in the prototypical 1-dimensional real Ginzburg-Landau equation. While for local coupling the fronts are always monotonic and therefore the dynamical behavior leads to coarsening and the annihilation of pairs of fronts, nonlocal terms can induce spatial oscillations in the front, allowing for the creation of localized structures, emerging from pinning between two fronts. We show this for three different nonlocal influence kernels. The first two, mod-exponential and Gaussian, are positive definite and decay exponentially or faster, while the third one, a Mexican-hat kernel, is not positive definite.

Introduction to focus issue: rhythms and dynamic transitions in neurological disease: modeling, computation, and experiment

Rhythmic neuronal oscillations across a broad range of frequencies, as well as spatiotemporal phenomena, such as waves and bumps, have been observed in various areas of the brain and proposed as critical to brain function. While there is a long and distinguished history of studying rhythms in nerve cells and neuronal networks in healthy organisms, the association and analysis of rhythms to diseases are more recent developments. Indeed, it is now thought that certain aspects of diseases of the nervous system, such as epilepsy, schizophrenia, Parkinson's, and sleep disorders, are associated with transitions or disruptions of neurological rhythms. This focus issue brings together articles presenting modeling, computational, analytical, and experimental perspectives about rhythms and dynamic transitions between them that are associated to various diseases.

A dendritic mechanism for decoding traveling waves: principles and applications to motor cortex

Traveling waves of neuronal oscillations have been observed in many cortical regions, including the motor and sensory cortex. Such waves are often modulated in a task-dependent fashion although their precise functional role remains a matter of debate. Here we conjecture that the cortex can utilize the direction and wavelength of traveling waves to encode information. We present a novel neural mechanism by which such information may be decoded by the spatial arrangement of receptors within the dendritic receptor field. In particular, we show how the density distributions of excitatory and inhibitory receptors can combine to act as a spatial filter of wave patterns. The proposed dendritic mechanism ensures that the neuron selectively responds to specific wave patterns, thus constituting a neural basis of pattern decoding. We validate this proposal in the descending motor system, where we model the large receptor fields of the pyramidal tract neurons — the principle outputs of the motor cortex — decoding motor commands encoded in the direction of traveling wave patterns in motor cortex. We use an existing model of field oscillations in motor cortex to investigate how the topology of the pyramidal cell receptor field acts to tune the cells responses to specific oscillatory wave patterns, even when those patterns are highly degraded. The model replicates key findings of the descending motor system during simple motor tasks, including variable interspike intervals and weak corticospinal coherence. By additionally showing how the nature of the wave patterns can be controlled by modulating the topology of local intra-cortical connections, we hence propose a novel integrated neuronal model of encoding and decoding motor commands.

Physiological studies in humans and monkeys have revealed spatially organized waves of neuronal activity that propagate across the cortex during sensory or behavioral tasks. However the functional role of such waves remains elusive. In the present study, we use numerical simulation to investigate whether wave patterns may serve as a basis for neural coding in cortex. Specifically, we propose a theoretical dendritic mechanism which permits neurons to respond selectively to the morphological properties of waves. In this proposal, the arrangement of excitatory and inhibitory receptors within the dendritic receptor field constitutes a spatial filter of the incoming wave patterns. The proposed mechanism allows the neuron to discriminate waves based on wavelength and orientation, thereby providing a basis for neural decoding. We explore this concept in the context of the descending motor system where the pyramidal tract neurons of motor cortex monosynaptically innervate motor neurons in the spinal cord. Pyramidal tract neurons have broad dendritic fields which make them ideal candidates for spatial filters of waves in motor cortex. Our model demonstrates how wave patterns in motor cortex can be transformed into a descending motor drive which replicates some fundamental oscillatory properties of human motor physiology.

Formation and regulation of dynamic patterns in two-dimensional spiking neural circuits with spike-timing-dependent plasticity

Spike-timing-dependent plasticity (STDP) is an important synaptic dynamics that is capable of shaping the complex spatiotemporal activity of neural circuits. In this study, we examine the effects of STDP on the spatiotemporal patterns of a spatially extended, two-dimensional spiking neural circuit. We show that STDP can promote the formation of multiple, localized spiking wave patterns or multiple spike timing sequences in a broad parameter space of the neural circuit. Furthermore, we illustrate that the formation of these dynamic patterns is due to the interaction between the dynamics of ongoing patterns in the neural circuit and STDP. This interaction is analyzed by developing a simple model able to capture its essential dynamics, which give rise to symmetry breaking. This occurs in a fundamentally self-organizing manner, without fine-tuning of the system parameters. Moreover, we find that STDP provides a synaptic mechanism to learn the paths taken by spiking waves and modulate the dynamics of their interactions, enabling them to be regulated. This regulation mechanism has error-correcting properties. Our results therefore highlight the important roles played by STDP in facilitating the formation and regulation of spiking wave patterns that may have crucial functional roles in brain information processing.

Distributed nonlocal feedback delays may destabilize fronts in neural fields, distributed transmission delays do not

The spread of activity in neural populations is a well-known phenomenon. To understand the propagation speed and the stability of stationary fronts in neural populations, the present work considers a neural field model that involves intracortical and cortico-cortical synaptic interactions. This includes distributions of axonal transmission speeds and nonlocal feedback delays as well as general classes of synaptic interactions. The work proves the spectral stability of standing and traveling fronts subject to general transmission speeds for large classes of spatial interactions and derives conditions for the front instabilities subjected to nonlocal feedback delays. Moreover, it turns out that the uniqueness of the stationary traveling fronts guarantees its exponential stability for vanishing feedback delay. Numerical simulations complement the analytical findings.

Generation and annihilation of localized persistent-activity states in a two-population neural-field model

We investigate the generation and annihilation of persistent localized activity states, so-called bumps, in response to transient spatiotemporal external input in a two-population neural-field model of the Wilson-Cowan type. Such persistent cortical states have been implicated as a biological substrate for short-term working memory, that is, the ability to store stimulus-related information for a few seconds and discard it once it is no longer relevant. In previous studies of the same model it has been established that the stability of bump states hinges on the relative inhibitory constant τ, i.e., the ratio of the time constants governing the dynamics of the inhibitory and excitatory populations: persistent bump states are typically only stable for values of τ smaller than a critical value τcr. We find here that τ is also a key parameter determining whether a transient input can generate a persistent bump state (in the regime where τ<τcr) or not. For small values of τ generation of the persistent states is found to depend only on the overall strength of the transient input, i.e., as long as the magnitude and duration of the excitatory transient input are larger and/or long enough, the persistent state will be activated. For higher values of τ we find that only specific combinations of amplitude and duration leads to persistent activation. For the corresponding annihilation process, no such delicate selectivity on the transient input is observed.

Strong nonlocal coupling stabilizes localized structures: an analysis based on front dynamics

We investigate the effect of strong nonlocal coupling in bistable spatially extended systems by using a Lorentzian-like kernel. This effect through front interaction drastically alters the space-time dynamics of bistable systems by stabilizing localized structures in one and two dimensions, and by affecting the kinetics law governing their behavior with respect to weak nonlocal and local coupling. We derive an analytical formula for the front interaction law and show that the kinetics governing the formation of localized structures obeys a law inversely proportional to their size to some power. To illustrate this mechanism, we consider two systems, the Nagumo model describing population dynamics and nonlinear optics model describing a ring cavity filled with a left-handed material. Numerical solutions of the governing equations are in close agreement with analytical predictions.

Stability constraints on large-scale structural brain networks

Stability is an important dynamical property of complex systems and underpins a broad range of coherent self-organized behavior. Based on evidence that some neurological disorders correspond to linear instabilities, we hypothesize that stability constrains the brain's electrical activity and influences its structure and physiology. Using a physiologically-based model of brain electrical activity, we investigated the stability and dispersion solutions of networks of neuronal populations with propagation time delays and dendritic time constants. We find that stability is determined by the spectrum of the network's matrix of connection strengths and is independent of the temporal damping rate of axonal propagation with stability restricting the spectrum to a region in the complex plane. Time delays and dendritic time constants modify the shape of this region but it always contains the unit disk. Instabilities resulting from changes in connection strength initially have frequencies less than a critical frequency. For physiologically plausible parameter values based on the corticothalamic system, this critical frequency is approximately 10 Hz. For excitatory networks and networks with randomly distributed excitatory and inhibitory connections, time delays and non-zero dendritic time constants have no impact on network stability but do effect dispersion frequencies. Random networks with both excitatory and inhibitory connections can have multiple marginally stable modes at low delta frequencies.

Asymmetry in neural fields: a spatiotemporal encoding mechanism

Neural field models have been successfully applied to model diverse brain mechanisms like visual attention, motor control, and memory. Most theoretical and modeling works have focused on the study of the dynamics of such systems under variations in neural connectivity, mainly symmetric connectivity among neurons. However, less attention has been given to the emerging properties of neuron populations when neural connectivity is asymmetric, although asymmetric activity propagation has been observed in cortical tissue. Here we explore the dynamics of neural fields with asymmetric connectivity and show, in the case of front propagation, that it can bias the population to follow a certain trajectory with higher activation. We find that asymmetry relates linearly to the input speed when the input is spatially localized, and this relation holds for different kernels and input shapes. To illustrate the behavior of asymmetric connectivity, we present an application: standard video sequences of human motion were encoded using the asymmetric neural field and compared to computer vision techniques. Overall, our results indicate that asymmetric neural fields are a competitive approach for spatiotemporal encoding with two main advantages: online classification and distributed operation.

Neural 'Bubble' Dynamics Revisited

In this paper, we revisit the work of John G Taylor on neural ‘bubble’ dynamics in two-dimensional neural field models. This builds on original work of Amari in a one-dimensional setting and makes use of the fact that mathematical treatments are much simpler when the firing rate function is chosen to be a Heaviside. In this case, the dynamics of an excited or active region, defining a ‘bubble’, reduce to the dynamics of the boundary. The focus of John’s work was on the properties of radially symmetric ‘bubbles’, including existence and radial stability, with applications to the theory of topographic map formation in self-organising neural networks. As well as reviewing John’s work in this area, we also include some recent results that treat more general classes of perturbations.

Beyond mean field theory: statistical field theory for neural networks

Mean field theories have been a stalwart for studying the dynamics of networks of coupled neurons. They are convenient because they are relatively simple and possible to analyze. However, classical mean field theory neglects the effects of fluctuations and correlations due to single neuron effects. Here, we consider various possible approaches for going beyond mean field theory and incorporating correlation effects. Statistical field theory methods, in particular the Doi-Peliti-Janssen formalism, are particularly useful in this regard.

Modeling the influences of nanoparticles on neural field oscillations in thalamocortical networks

The purpose of this study is twofold. First, we present a simplified multiscale modeling approach integrating activity on the scale of ionic channels into the spatiotemporal scale of neural field potentials: Resting upon a Hodgkin-Huxley based single cell model we introduced a neuronal feedback circuit based on the Llinás-model of thalamocortical activity and binding, where all cell specific intrinsic properties were adopted from patch-clamp measurements. In this paper, we expand this existing model by integrating the output to the spatiotemporal scale of field potentials. Those are supposed to originate from the parallel activity of a variety of synchronized thalamocortical columns at the quasi-microscopic level, where the involved neurons are gathered together in units. Second and more important, we study the possible effects of nanoparticles (NPs) that are supposed to interact with thalamic cells of our network model. In two preliminary studies we demonstrated in vitro and in vivo effects of NPs on the ionic channels of single neurons and thereafter on neuronal feedback circuits. By means of our new model we assumed now NPs induced changes on the ionic currents of the involved thalamic neurons. Here we found extensive diversified pattern formations of neural field potentials when comparing to the modeled activity without neuromodulating NPs addition. This model provides predictions about the influences of NPs on spatiotemporal neural field oscillations in thalamocortical networks. These predictions can be validated by high spatiotemporal resolution electrophysiological measurements like voltage sensitive dyes and multiarray recordings.

Spatiotemporal pattern formation in two-dimensional neural circuits: roles of refractoriness and noise

Refractoriness is one of the most fundamental states of neural firing activity, in which neurons that have just fired are unable to produce another spike, regardless of the strength of afferent stimuli. Another essential and unavoidable feature of neural systems is the existence of noise. To study the role of these essential factors in spatiotemporal pattern formation in neural systems, a spatially expended neural network model is constructed, with the dynamics of its individual neurons capturing the three most essential states of the neural firing behavior: firing, refractory and resting, and the network topology consistent with the widely observed center-surround coupling manner in the real brain. By changing the refractory period with and without noise in a systematic way in the network, it is shown numerically and analytically that without refractoriness, or when the refractory period is smaller than a certain value, the collective activity pattern of the system consists of localized, oscillating patterns. However, when the refractory period is greater than a certain value, crescent-shaped, localized propagating patterns emerge in the presence of noise. It is further illustrated that the formation of the dynamical spiking patterns is due to a symmetry breaking mechanism, refractoriness-induced symmetry breaking; that is generated by the interplay of noise and refractoriness in the network model. This refractoriness-induced symmetry breaking provides a novel perspective on the emergence of localized, spiking wave patterns or spike timing sequences as ubiquitously observed in real neural systems; it therefore suggests that refractoriness may benefit neural systems in their temporal information processing, rather than limiting the performance of neurons, as has been conventionally thought. Our results also highlight the importance of considering noise in studying spatially extended neural systems, where it may facilitate the formation of spatiotemporal order.

Dynamic finite size effects in spiking neural networks

We investigate the dynamics of a deterministic finite-sized network of synaptically coupled spiking neurons and present a formalism for computing the network statistics in a perturbative expansion. The small parameter for the expansion is the inverse number of neurons in the network. The network dynamics are fully characterized by a neuron population density that obeys a conservation law analogous to the Klimontovich equation in the kinetic theory of plasmas. The Klimontovich equation does not possess well-behaved solutions but can be recast in terms of a coupled system of well-behaved moment equations, known as a moment hierarchy. The moment hierarchy is impossible to solve but in the mean field limit of an infinite number of neurons, it reduces to a single well-behaved conservation law for the mean neuron density. For a large but finite system, the moment hierarchy can be truncated perturbatively with the inverse system size as a small parameter but the resulting set of reduced moment equations that are still very difficult to solve. However, the entire moment hierarchy can also be re-expressed in terms of a functional probability distribution of the neuron density. The moments can then be computed perturbatively using methods from statistical field theory. Here we derive the complete mean field theory and the lowest order second moment corrections for physiologically relevant quantities. Although we focus on finite-size corrections, our method can be used to compute perturbative expansions in any parameter.

One avenue towards understanding how the brain functions is to create computational and mathematical models. However, a human brain has on the order of a hundred billion neurons with a quadrillion synaptic connections. Each neuron is a complex cell comprised of multiple compartments hosting a myriad of ions, proteins and other molecules. Even if computing power continues to increase exponentially, directly simulating all the processes in the brain on a computer is not feasible in the foreseeable future and even if this could be achieved, the resulting simulation may be no simpler to understand than the brain itself. Hence, the need for more tractable models. Historically, systems with many interacting bodies are easier to understand in the two opposite limits of a small number or an infinite number of elements and most of the theoretical efforts in understanding neural networks have been devoted to these two limits. There has been relatively little effort directed to the very relevant but difficult regime of large but finite networks. In this paper, we introduce a new formalism that borrows from the methods of many-body statistical physics to analyze finite size effects in spiking neural networks.

Phase-locked cluster oscillations in periodically forced integrate-and-fire-or-burst neuronal populations

The minimal integrate-and-fire-or-burst neuron model succinctly describes both tonic firing and postinhibitory rebound bursting of thalamocortical cells in the sensory relay. Networks of integrate-and-fire-or-burst (IFB) neurons with slow inhibitory synaptic interactions have been shown to support stable rhythmic states, including globally synchronous and cluster oscillations, in which network-mediated inhibition cyclically generates bursting in coherent subgroups of neurons. In this paper, we introduce a reduced IFB neuronal population model to study synchronization of inhibition-mediated oscillatory bursting states to periodic excitatory input. Using numeric methods, we demonstrate the existence and stability of 1:1 phase-locked bursting oscillations in the sinusoidally forced IFB neuronal population model. Phase locking is shown to arise when periodic excitation is sufficient to pace the onset of bursting in an IFB cluster without counteracting the inhibitory interactions necessary for burst generation. Phase-locked bursting states are thus found to destabilize when periodic excitation increases in strength or frequency. Further study of the IFB neuronal population model with pulse-like periodic excitatory input illustrates that this synchronization mechanism generalizes to a broad range of n:m phase-locked bursting states across both globally synchronous and clustered oscillatory regimes.

On local bifurcations in neural field models with transmission delays

Neural field models with transmission delays may be cast as abstract delay differential equations (DDE). The theory of dual semigroups (also called sun-star calculus) provides a natural framework for the analysis of a broad class of delay equations, among which DDE. In particular, it may be used advantageously for the investigation of stability and bifurcation of steady states. After introducing the neural field model in its basic functional analytic setting and discussing its spectral properties, we elaborate extensively an example and derive a characteristic equation. Under certain conditions the associated equilibrium may destabilise in a Hopf bifurcation. Furthermore, two Hopf curves may intersect in a double Hopf point in a two-dimensional parameter space. We provide general formulas for the corresponding critical normal form coefficients, evaluate these numerically and interpret the results.

Traveling pulses in a stochastic neural field model of direction selectivity

We analyze the effects of extrinsic noise on traveling pulses in a neural field model of direction selectivity. The model consists of a one-dimensional scalar neural field with an asymmetric weight distribution consisting of an offset Mexican hat function. We first show how, in the absence of any noise, the system supports spontaneously propagating traveling pulses that can lock to externally moving stimuli. Using a separation of time-scales and perturbation methods previously developed for stochastic reaction-diffusion equations, we then show how extrinsic noise in the activity variables leads to a diffusive-like displacement (wandering) of the wave from its uniformly translating position at long time-scales, and fluctuations in the wave profile around its instantaneous position at short time-scales. In the case of freely propagating pulses, the wandering is characterized by pure Brownian motion, whereas in the case of stimulus-locked pulses, it is given by an Ornstein–Uhlenbeck process. This establishes that stimulus-locked pulses are more robust to noise.

Neural field theory of plasticity in the cerebral cortex

A generalized timing-dependent plasticity rule is incorporated into a recent neural field theory to explore synaptic plasticity in the cerebral cortex, with both excitatory and inhibitory populations included. Analysis in the time and frequency domains reveals that cortical network behavior gives rise to a saddle-node bifurcation and resonant frequencies, including a gamma-band resonance. These system resonances constrain cortical synaptic dynamics and divide it into four classes, which depend on the type of synaptic plasticity window. Depending on the dynamical class, synaptic strengths can either have a stable fixed point, or can diverge in the absence of a separate saturation mechanism. Parameter exploration shows that time-asymmetric plasticity windows, which are signatures of spike-timing dependent plasticity, enable the richest variety of synaptic dynamics to occur. In particular, we predict a zone in parameter space which may allow brains to attain the marginal stability phenomena observed experimentally, although additional regulatory mechanisms may be required to maintain these parameters.

Slow dynamics and high variability in balanced cortical networks with clustered connections

Anatomical studies demonstrate that excitatory connections in cortex are not uniformly distributed across a network but instead exhibit clustering into groups of highly connected neurons. The implications of clustering for cortical activity are unclear. We studied the effect of clustered excitatory connections on the dynamics of neuronal networks that exhibited high spike time variability owing to a balance between excitation and inhibition. Even modest clustering substantially changed the behavior of these networks, introducing slow dynamics during which clusters of neurons transiently increased or decreased their firing rate. Consequently, neurons exhibited both fast spiking variability and slow firing rate fluctuations. A simplified model shows how stimuli bias networks toward particular activity states, thereby reducing firing rate variability as observed experimentally in many cortical areas. Our model thus relates cortical architecture to the reported variability in spontaneous and evoked spiking activity.

A neural field model of the somatosensory cortex: formation, maintenance and reorganization of ordered topographic maps

We investigate the formation and maintenance of ordered topographic maps in the primary somatosensory cortex as well as the reorganization of representations after sensory deprivation or cortical lesion. We consider both the critical period (postnatal) where representations are shaped and the post-critical period where representations are maintained and possibly reorganized. We hypothesize that feed-forward thalamocortical connections are an adequate site of plasticity while cortico-cortical connections are believed to drive a competitive mechanism that is critical for learning. We model a small skin patch located on the distal phalangeal surface of a digit as a set of 256 Merkel ending complexes (MEC) that feed a computational model of the primary somatosensory cortex (area 3b). This model is a two-dimensional neural field where spatially localized solutions (a.k.a. bumps) drive cortical plasticity through a Hebbian-like learning rule. Simulations explain the initial formation of ordered representations following repetitive and random stimulations of the skin patch. Skin lesions as well as cortical lesions are also studied and results confirm the possibility to reorganize representations using the same learning rule and depending on the type of the lesion. For severe lesions, the model suggests that cortico-cortical connections may play an important role in complete recovery.

Hebbian learning of recurrent connections: a geometrical perspective

We show how a Hopfield network with modifiable recurrent connections undergoing slow Hebbian learning can extract the underlying geometry of an input space. First, we use a slow and fast analysis to derive an averaged system whose dynamics derives from an energy function and therefore always converges to equilibrium points. The equilibria reflect the correlation structure of the inputs, a global object extracted through local recurrent interactions only. Second, we use numerical methods to illustrate how learning extracts the hidden geometrical structure of the inputs. Indeed, multidimensional scaling methods make it possible to project the final connectivity matrix onto a Euclidean distance matrix in a high-dimensional space, with the neurons labeled by spatial position within this space. The resulting network structure turns out to be roughly convolutional. The residual of the projection defines the nonconvolutional part of the connectivity, which is minimized in the process. Finally, we show how restricting the dimension of the space where the neurons live gives rise to patterns similar to cortical maps. We motivate this using an energy efficiency argument based on wire length minimization. Finally, we show how this approach leads to the emergence of ocular dominance or orientation columns in primary visual cortex via the self-organization of recurrent rather than feedforward connections. In addition, we establish that the nonconvolutional (or long-range) connectivity is patchy and is co-aligned in the case of orientation learning.

Interface dynamics in planar neural field models

Neural field models describe the coarse-grained activity of populations of interacting neurons. Because of the laminar structure of real cortical tissue they are often studied in two spatial dimensions, where they are well known to generate rich patterns of spatiotemporal activity. Such patterns have been interpreted in a variety of contexts ranging from the understanding of visual hallucinations to the generation of electroencephalographic signals. Typical patterns include localized solutions in the form of traveling spots, as well as intricate labyrinthine structures. These patterns are naturally defined by the interface between low and high states of neural activity. Here we derive the equations of motion for such interfaces and show, for a Heaviside firing rate, that the normal velocity of an interface is given in terms of a non-local Biot-Savart type interaction over the boundaries of the high activity regions. This exact, but dimensionally reduced, system of equations is solved numerically and shown to be in excellent agreement with the full nonlinear integral equation defining the neural field. We develop a linear stability analysis for the interface dynamics that allows us to understand the mechanisms of pattern formation that arise from instabilities of spots, rings, stripes and fronts. We further show how to analyze neural field models with linear adaptation currents, and determine the conditions for the dynamic instability of spots that can give rise to breathers and traveling waves.

Neural population representation hypothesis of visual flow and its illusory after effect in the brain: psychophysics, neurophysiology and computational approaches

The neural representation of motion aftereffects induced by various visual flows (translational, rotational, motion-in-depth, and translational transparent flows) was studied under the hypothesis that the imbalances in discharge activities would occur in favor in the direction opposite to the adapting stimulation in the monkey MST cells (cells in the medial superior temporal area) which can discriminate the mode (i.e., translational, rotational, or motion-in-depth) of the given flow. In single-unit recording experiments conducted on anaesthetized monkeys, we found that the rate of spontaneous discharge and the sensitivity to a test stimulus moving in the preferred direction decreased after receiving an adapting stimulation moving in the preferred direction, whereas they increased after receiving an adapting stimulation moving in the null direction. To consistently explain the bidirectional perception of a transparent visual flow and its unidirectional motion aftereffect by the same hypothesis, we need to assume the existence of two subtypes of MST D cells which show directionally selective responses to a translational flow: component cells and integration cells. Our physiological investigation revealed that the MST D cells could be divided into two types: one responded to a transparent flow by two peaks at the instances when the direction of one of the component flow matched the preferred direction of the cell, and the other responded by a single peak at the instance when the direction of the integrated motion matched the preferred direction. In psychophysical experiments on human subjects, we found evidence for the existence of component and integration representations in the human brain. To explain the different motion perceptions, i.e., two transparent flows during presentation of the flows and a single flow in the opposite direction to the integrated flows after stopping the flow stimuli, we suggest that the pattern-discrimination system can select the motion representation that is consistent with the perception of the pattern from two motion representations. We discuss the computational aspects related to the integration of component motion fields.

From invasion to extinction in heterogeneous neural fields

In this paper, we analyze the invasion and extinction of activity in heterogeneous neural fields. We first consider the effects of spatial heterogeneities on the propagation of an invasive activity front. In contrast to previous studies of front propagation in neural media, we assume that the front propagates into an unstable rather than a metastable zero-activity state. For sufficiently localized initial conditions, the asymptotic velocity of the resulting pulled front is given by the linear spreading velocity, which is determined by linearizing about the unstable state within the leading edge of the front. One of the characteristic features of these so-called pulled fronts is their sensitivity to perturbations inside the leading edge. This means that standard perturbation methods for studying the effects of spatial heterogeneities or external noise fluctuations break down. We show how to extend a partial differential equation method for analyzing pulled fronts in slowly modulated environments to the case of neural fields with slowly modulated synaptic weights. The basic idea is to rescale space and time so that the front becomes a sharp interface whose location can be determined by solving a corresponding local Hamilton-Jacobi equation. We use steepest descents to derive the Hamilton-Jacobi equation from the original nonlocal neural field equation. In the case of weak synaptic heterogenities, we then use perturbation theory to solve the corresponding Hamilton equations and thus determine the time-dependent wave speed. In the second part of the paper, we investigate how time-dependent heterogenities in the form of extrinsic multiplicative noise can induce rare noise-driven transitions to the zero-activity state, which now acts as an absorbing state signaling the extinction of all activity. In this case, the most probable path to extinction can be obtained by solving the classical equations of motion that dominate a path integral representation of the stochastic neural field in the weak noise limit. These equations take the form of nonlocal Hamilton equations in an infinite-dimensional phase space.

Spike, rate, field, and hybrid methods for treating neuronal dynamics and interactions

Spike-, rate-, and field-based approaches to neural dynamics are adapted and hybridized to provide new methods of analyzing dynamics of single neurons and large neuronal systems, to elucidate the relationships and intermediate forms between these limiting cases, and to enable faster simulations with reduced memory requirements. At the single-neuron level, the new approaches involve reformulation of dynamics in synapses, dendrites, cell bodies, and axons to enable new types of analysis, longer numerical timesteps, and demonstration that rate-based methods can predict spike times. In multineuron systems, hybrids and intermediates between spike-based and field-based coupling between neurons are used to provide stepping stones between descriptions based on pairwise spike-based interactions between neurons and ones based on neural field-based interactions within and between populations, including arbitrary spatial structure and temporal delays in the connections in general. In particular, a new neuron-in-cell approach is introduced that is a hybrid between neural field theory and spiking-neuron models in analogy to particle-in-cell methods in plasma physics. This approach enables large speedups in computations while preserving spike shapes and times. Various approaches are illustrated numerically for specific cases.

Response of traveling waves to transient inputs in neural fields

We analyze the effects of transient stimulation on traveling waves in neural field equations. Neural fields are modeled as integro-differential equations whose convolution term represents the synaptic connections of a spatially extended neuronal network. The adjoint of the linearized wave equation can be used to identify how a particular input will shift the location of a traveling wave. This wave response function is analogous to the phase response curve of limit cycle oscillators. For traveling fronts in an excitatory network, the sign of the shift depends solely on the sign of the transient input. A complementary estimate of the effective shift is derived using an equation for the time-dependent speed of the perturbed front. Traveling pulses are analyzed in an asymmetric lateral inhibitory network and they can be advanced or delayed, depending on the position of spatially localized transient inputs. We also develop bounds on the amplitude of transient input necessary to terminate traveling pulses, based on the global bifurcation structure of the neural field.

Interrelating anatomical, effective, and functional brain connectivity using propagators and neural field theory

It is shown how to compute effective and functional connection matrices (eCMs and fCMs) from anatomical CMs (aCMs) and corresponding strength-of-connection matrices (sCMs) using propagator methods in which neural interactions play the role of scatterings. This analysis demonstrates how network effects dress the bare propagators (the sCMs) to yield effective propagators (the eCMs) that can be used to compute the covariances customarily used to define fCMs. The results incorporate excitatory and inhibitory connections, multiple structures and populations, asymmetries, time delays, and measurement effects. They can also be postprocessed in the same manner as experimental measurements for direct comparison with data and thereby give insights into the role of coarse-graining, thresholding, and other effects in determining the structure of CMs. The spatiotemporal results show how to generalize CMs to include time delays and how natural network modes give rise to long-range coherence at resonant frequencies. The results are demonstrated using tractable analytic cases via neural field theory of cortical and corticothalamic systems. These also demonstrate close connections between the structure of CMs and proximity to critical points of the system, highlight the importance of indirect links between brain regions and raise the possibility of imaging specific levels of indirect connectivity. Aside from the results presented explicitly here, the expression of the connections among aCMs, sCMs, eCMs, and fCMs in terms of propagators opens the way for propagator theory to be further applied to analysis of connectivity.

New patterns of activity in a pair of interacting excitatory-inhibitory neural fields

In this Letter, we study stationary bump solutions in a pair of interacting excitatory-inhibitory (E-I) neural fields in one dimension. We demonstrate the existence of localized bump solutions of persistent activity that can be maintained by the pair of interacting layers when a stationary bump is not supported by either layer in isolation--a scenario which may be relevant as a mechanism for the persistent activity associated with working memory in the prefrontal cortex and may explain why bumps are not seen in in vitro slice preparations. Furthermore, we describe a new type of stationary bump solution arising from a pitchfork bifurcation which produces a stationary bump in each layer with a spatial offset that increases with the bifurcation parameter.

ON THE ORIGIN AND PROPERTIES OF TWO-POPULATION NEURAL FIELD MODELS - A TUTORIAL INTRODUCTION

Neural field models have a long tradition in mathematical neuroscience, and in the present tutorial paper we outline the neurobiological and biophysical origin of such models, in particular two-population field models describing excitatory and inhibitory neurons interacting via nonlocal spatial connections. Results from investigations of such models on the existence and stability of stationary localized activity pulses ('bumps') and generation of stationary spatial and spatiotemporal oscillations through Turing-type instabilities are described.

The mechanisms for compression and reflection of cortical waves

Waves are common in cortical networks and may be important for carrying information about a stimulus from one local circuit to another. In a recent study of visually evoked waves in rat cortex, compression and reflection of waves are observed as the activation passes from visual areas V1 to V2. The authors of this study apply bicuculline (BMI) and demonstrate that the reflection disappears. They conclude that inhibition plays a major role in compression and reflection. We present several models for propagating waves in heterogeneous media and show that the velocity and thus compression depends weakly on inhibition. We propose that the main site of action of BMI with respect to wave propagation is on the threshold for firing which we suggest is related to action on potassium channels. We combine numerical and analytic methods to explore both compression and reflection in an excitable system with synaptic coupling.

Dendritic slow dynamics enables localized cortical activity to switch between mobile and immobile modes with noisy background input

Mounting lines of evidence suggest the significant computational ability of a single neuron empowered by active dendritic dynamics. This motivates us to study what functionality can be acquired by a network of such neurons. The present paper studies how such rich single-neuron dendritic dynamics affects the network dynamics, a question which has scarcely been specifically studied to date. We simulate neurons with active dendrites networked locally like cortical pyramidal neurons, and find that naturally arising localized activity--called a bump--can be in two distinct modes, mobile or immobile. The mode can be switched back and forth by transient input to the cortical network. Interestingly, this functionality arises only if each neuron is equipped with the observed slow dendritic dynamics and with in vivo-like noisy background input. If the bump activity is considered to indicate a point of attention in the sensory areas or to indicate a representation of memory in the storage areas of the cortex, this would imply that the flexible mode switching would be of great potential use for the brain as an information processing device. We derive these conclusions using a natural extension of the conventional field model, which is defined by combining two distinct fields, one representing the somatic population and the other representing the dendritic population. With this tool, we analyze the spatial distribution of the degree of after-spike adaptation and explain how we can understand the presence of the two distinct modes and switching between the modes. We also discuss the possible functional impact of this mode-switching ability.

Dynamic causal modeling with neural fields

The aim of this paper is twofold: first, to introduce a neural field model motivated by a well-known neural mass model; second, to show how one can estimate model parameters pertaining to spatial (anatomical) properties of neuronal sources based on EEG or LFP spectra using Bayesian inference. Specifically, we consider neural field models of cortical activity as generative models in the context of dynamic causal modeling (DCM). This paper considers the simplest case of a single cortical source modeled by the spatiotemporal dynamics of hidden neuronal states on a bounded cortical surface or manifold. We build this model using multiple layers, corresponding to cortical lamina in the real cortical manifold. These layers correspond to the populations considered in classical (Jansen and Rit) neural mass models. This allows us to formulate a neural field model that can be reduced to a neural mass model using appropriate constraints on its spatial parameters. In turn, this enables one to compare and contrast the predicted responses from equivalent neural field and mass models respectively. We pursue this using empirical LFP data from a single electrode to show that the parameters controlling the spatial dynamics of cortical activity can be recovered, using DCM, even in the absence of explicit spatial information in observed data.

Characterising stimulus-specific adaptation using a multi-layer field model

The response of an auditory neuron to a tone is often affected by the context in which the tone appears. For example, when measuring the response to a random sequence of tones, frequencies that appear rarely elicit a greater number of spikes than those that appear often. This phenomenon is called stimulus-specific adaptation (SSA). This article presents a neural field model in which SSA arises through selective adaptation to the frequently-occurring inputs. Formulating the network as a field model allows one to obtain an analytical expression for the expected response of a simple two-layer model to tones in a random sequence. The sequences of stimuli used in SSA experiments contain hundreds-and sometimes thousands-of tones, and these experiments routinely measure the response to many such sequences. A conventional neural network model (e.g., integrate-and-fire) would require numerical integration over long time periods to obtain results. Consequently, a field model that offers an immediate, analytical solution for a given input sequence is helpful. Two routes to obtaining this solution are discussed. The first involves the convolution of two closed-form expressions; the second relies on a series of approximations involving Gaussian curves. The purpose of the paper is to describe the model, to develop the approximations that allow an analytical solution, and finally, to comment on the output of the model in light of the SSA results published in the physiology literature. This article is part of a Special Issue entitled "Neural Coding".

Neural field theory of synaptic plasticity

Plasticity is crucial to neural development, learning, and memory. In the common in vivo situation where postsynaptic neural activity results from multiple presynaptic inputs, it is shown that a widely used class of correlation-dependent and spike-timing dependent plasticity rules can be written in a form that can be incorporated into neural field theory, which enables their system-level dynamics to be investigated. It is shown that the resulting plasticity dynamics depends strongly on the stimulus spectrum via overall system frequency responses. In the case of perturbations that are approximately linear, explicit formulas are found for the dynamics in terms of stimulus spectra via system transfer functions. The resulting theory is applied to a simple model system to reveal how collective effects, especially resonances, can drastically modify system-level plasticity dynamics from that implied by single-neuron analyses. The simplified model illustrates the potential relevance of these effects in applications to brain stimulation, synaptic homeostasis, and epilepsy.