Extrapolative delay compensation through facilitating synapses and its relation to the flash-lag effect

Neural mechanisms of visual motion extrapolation

Because neural processing takes time, the brain only has delayed access to sensory information. When localising moving objects this is problematic, as an object will have moved on by the time its position has been determined. Here, we consider predictive motion extrapolation as a fundamental delay-compensation strategy. From a population-coding perspective, we outline how extrapolation can be achieved by a forwards shift in the population-level activity distribution. We identify general mechanisms underlying such shifts, involving various asymmetries which facilitate the targeted 'enhancement' and/or 'dampening' of population-level activity. We classify these on the basis of their potential implementation (intra- vs inter-regional processes) and consider specific examples in different visual regions. We consider how motion extrapolation can be achieved during inter-regional signaling, and how asymmetric connectivity patterns which support extrapolation can emerge spontaneously from local synaptic learning rules. Finally, we consider how more abstract 'model-based' predictive strategies might be implemented. Overall, we present an integrative framework for understanding how the brain determines the real-time position of moving objects, despite neural delays.

The Flash-lag Effect in Amblyopia

Purpose

Amblyopes suffer a defect in temporal processing, presumably because of a neural delay in their visual processing. By measuring flash-lag effect (FLE), we investigate whether the amblyopic visual system could compensate for the intrinsic neural delay due to visual information transmissions from the retina to the cortex.

Methods

Eleven adults with amblyopia and 11 controls with normal vision participated in this study. We assessed the monocular FLE magnitude for each subject by using a typical FLE paradigm: a bar moved horizontally, while a flashed bar briefly appeared above or below it. Three luminance contrasts of the flashed bar were tested: 0.2, 0.6, and 1.

Results

All participants, controls and those with amblyopia, showed a typical FLE. However, the FLE magnitude of participants with amblyopia was significantly shorter than that of the control participants, for both their amblyopic eye (AE) and fellow eye (FE). A nonsignificant difference was found in FLE magnitude between the AE and the FE.

Conclusions

We demonstrate a reduced FLE both in the AE as well as the FE of patients with amblyopia, suggesting a global visual processing deficit. We suggest it may be attributed to a more limited spatiotemporal extent of facilitatory anticipatory activity within the amblyopic primary visual cortex.

Asynchronous Event-Based Motion Processing: From Visual Events to Probabilistic Sensory Representation

In this work, we propose a two-layered descriptive model for motion processing from retina to the cortex, with an event-based input from the asynchronous time-based image sensor (ATIS) camera. Spatial and spatiotemporal filtering of visual scenes by motion energy detectors has been implemented in two steps in a simple layer of a lateral geniculate nucleus model and a set of three-dimensional Gabor kernels, eventually forming a probabilistic population response. The high temporal resolution of independent and asynchronous local sensory pixels from the ATIS provides a realistic stimulation to study biological motion processing, as well as developing bio-inspired motion processors for computer vision applications. Our study combines two significant theories in neuroscience: event-based stimulation and probabilistic sensory representation. We have modeled how this might be done at the vision level, as well as suggesting this framework as a generic computational principle among different sensory modalities.

The Flash-Lag Effect as a Motion-Based Predictive Shift

Due to its inherent neural delays, the visual system has an outdated access to sensory information about the current position of moving objects. In contrast, living organisms are remarkably able to track and intercept moving objects under a large range of challenging environmental conditions. Physiological, behavioral and psychophysical evidences strongly suggest that position coding is extrapolated using an explicit and reliable representation of object’s motion but it is still unclear how these two representations interact. For instance, the so-called flash-lag effect supports the idea of a differential processing of position between moving and static objects. Although elucidating such mechanisms is crucial in our understanding of the dynamics of visual processing, a theory is still missing to explain the different facets of this visual illusion. Here, we reconsider several of the key aspects of the flash-lag effect in order to explore the role of motion upon neural coding of objects’ position. First, we formalize the problem using a Bayesian modeling framework which includes a graded representation of the degree of belief about visual motion. We introduce a motion-based prediction model as a candidate explanation for the perception of coherent motion. By including the knowledge of a fixed delay, we can model the dynamics of sensory information integration by extrapolating the information acquired at previous instants in time. Next, we simulate the optimal estimation of object position with and without delay compensation and compared it with human perception under a broad range of different psychophysical conditions. Our computational study suggests that the explicit, probabilistic representation of velocity information is crucial in explaining position coding, and therefore the flash-lag effect. We discuss these theoretical results in light of the putative corrective mechanisms that can be used to cancel out the detrimental effects of neural delays and illuminate the more general question of the dynamical representation at the present time of spatial information in the visual pathways.

Visual illusions are powerful tools to explore the limits and constraints of human perception. One of them has received considerable empirical and theoretical interests: the so-called “flash-lag effect”. When a visual stimulus moves along a continuous trajectory, it may be seen ahead of its veridical position with respect to an unpredictable event such as a punctuate flash. This illusion tells us something important about the visual system: contrary to classical computers, neural activity travels at a relatively slow speed. It is largely accepted that the resulting delays cause this perceived spatial lag of the flash. Still, after three decades of debates, there is no consensus regarding the underlying mechanisms. Herein, we re-examine the original hypothesis that this effect may be caused by the extrapolation of the stimulus’ motion that is naturally generated in order to compensate for neural delays. Contrary to classical models, we propose a novel theoretical framework, called parodiction, that optimizes this process by explicitly using the precision of both sensory and predicted motion. Using numerical simulations, we show that the parodiction theory subsumes many of the previously proposed models and empirical studies. More generally, the parodiction hypothesis proposes that neural systems implement generic neural computations that can systematically compensate the existing neural delays in order to represent the predicted visual scene at the present time. It calls for new experimental approaches to directly explore the relationships between neural delays and predictive coding.

Effects of self-coupling and asymmetric output on metastable dynamical transient firing patterns in arrays of neurons with bidirectional inhibitory coupling

Metastable dynamical transient patterns in arrays of bidirectionally coupled neurons with self-coupling and asymmetric output were studied. First, an array of asymmetric sigmoidal neurons with symmetric inhibitory bidirectional coupling and self-coupling was considered and the bifurcations of its steady solutions were shown. Metastable dynamical transient spatially nonuniform states existed in the presence of a pair of spatially symmetric stable solutions as well as unstable spatially nonuniform solutions in a restricted range of the output gain of a neuron. The duration of the transients increased exponentially with the number of neurons up to the maximum number at which the spatially nonuniform steady solutions were stabilized. The range of the output gain for which they existed reduced as asymmetry in a sigmoidal output function of a neuron increased, while the existence range expanded as the strength of inhibitory self-coupling increased. Next, arrays of spiking neuron models with slow synaptic inhibitory bidirectional coupling and self-coupling were considered with computer simulation. In an array of Class 1 Hindmarsh-Rose type models, in which each neuron showed a graded firing rate, metastable dynamical transient firing patterns were observed in the presence of inhibitory self-coupling. This agreed with the condition for the existence of metastable dynamical transients in an array of sigmoidal neurons. In an array of Class 2 Bonhoeffer-van der Pol models, in which each neuron had a clear threshold between firing and resting, long-lasting transient firing patterns with bursting and irregular motion were observed.

Anisotropic connectivity implements motion-based prediction in a spiking neural network

Predictive coding hypothesizes that the brain explicitly infers upcoming sensory input to establish a coherent representation of the world. Although it is becoming generally accepted, it is not clear on which level spiking neural networks may implement predictive coding and what function their connectivity may have. We present a network model of conductance-based integrate-and-fire neurons inspired by the architecture of retinotopic cortical areas that assumes predictive coding is implemented through network connectivity, namely in the connection delays and in selectiveness for the tuning properties of source and target cells. We show that the applied connection pattern leads to motion-based prediction in an experiment tracking a moving dot. In contrast to our proposed model, a network with random or isotropic connectivity fails to predict the path when the moving dot disappears. Furthermore, we show that a simple linear decoding approach is sufficient to transform neuronal spiking activity into a probabilistic estimate for reading out the target trajectory.

Exponential transient propagating oscillations in a ring of spiking neurons with unidirectional slow inhibitory synaptic coupling

Transient oscillations in a ring of spiking neuron models unidirectionally coupled with slow inhibitory synapses are studied. There are stable spatially fixed steady firing-resting states and unstable symmetric propagating firing-resting states. In transients, firing-resting patterns rotate in the direction of coupling (propagating oscillations), the duration of which increases exponentially with the number of neurons (exponential transients). Further, the duration of randomly generated transient propagating oscillations is distributed in a power law form and spatiotemporal noise of intermediate strength sustains propagating oscillations. These properties agree with those of transient propagating waves in a ring of sigmoidal neuron models.

Multiagent reinforcement learning: spiking and nonspiking agents in the iterated Prisoner's Dilemma

This paper investigates multiagent reinforcement learning (MARL) in a general-sum game where the payoffs' structure is such that the agents are required to exploit each other in a way that benefits all agents. The contradictory nature of these games makes their study in multiagent systems quite challenging. In particular, we investigate MARL with spiking and nonspiking agents in the Iterated Prisoner's Dilemma by exploring the conditions required to enhance its cooperative outcome. The spiking agents are neural networks with leaky integrate-and-fire neurons trained with two different learning algorithms: 1) reinforcement of stochastic synaptic transmission, or 2) reward-modulated spike-timing-dependent plasticity with eligibility trace. The nonspiking agents use a tabular representation and are trained with Q- and SARSA learning algorithms, with a novel reward transformation process also being applied to the Q-learning agents. According to the results, the cooperative outcome is enhanced by: 1) transformed internal reinforcement signals and a combination of a high learning rate and a low discount factor with an appropriate exploration schedule in the case of non-spiking agents, and 2) having longer eligibility trace time constant in the case of spiking agents. Moreover, it is shown that spiking and nonspiking agents have similar behavior and therefore they can equally well be used in a multiagent interaction setting. For training the spiking agents in the case where more than one output neuron competes for reinforcement, a novel and necessary modification that enhances competition is applied to the two learning algorithms utilized, in order to avoid a possible synaptic saturation. This is done by administering to the networks additional global reinforcement signals for every spike of the output neurons that were not "responsible" for the preceding decision.

Facilitating neural dynamics for delay compensation: a road to predictive neural dynamics?

Goal-directed behavior is a hallmark of cognition. An important prerequisite to goal-directed behavior is that of prediction. In order to establish a goal and devise a plan, one needs to see into the future and predict possible future events. Our earlier work has suggested that compensation mechanisms for neuronal transmission delay may have led to a preliminary form of prediction. In that work, facilitating neuronal dynamics was found to be effective in overcoming delay (the Facilitating Activation Network model, or FAN). The extrapolative property of the delay compensation mechanism can be considered as prediction for incoming signals (predicting the present based on the past). The previous FAN model turns out to have a limitation especially when longer delay needs to be compensated, which requires higher facilitation rates than FAN's normal range. We derived an improved facilitating dynamics at the neuronal level to overcome this limitation. In this paper, we tested our proposed approach in controllers for 2D pole balancing, where the new approach was shown to perform better than the previous FAN model. Next, we investigated the differential utilization of facilitating dynamics in sensory vs. motor neurons and found that motor neurons utilize the facilitating dynamics more than the sensory neurons. These findings are expected to help us better understand the role of facilitating dynamics in delay compensation, and its potential development into prediction, a necessary condition for goal-directed behavior.