Primary visual cortex represents the difference between past and present

The perceptual timescape: Perceptual history on the sub-second scale

There is a high-capacity store of brief time span (∼1000 ms) which information enters from perceptual processing, often called iconic memory or sensory memory. It is proposed that a main function of this store is to hold recent perceptual information in a temporally segregated representation, named the perceptual timescape. The perceptual timescape is a continually active representation of change and continuity over time that endows the perceived present with a perceived history. This is accomplished primarily by two kinds of time marking information: time distance information, which marks all items of information in the perceptual timescape according to how far in the past they occurred, and ordinal temporal information, which organises items of information in terms of their temporal order. Added to that is information about connectivity of perceptual objects over time. These kinds of information connect individual items over a brief span of time so as to represent change, persistence, and continuity over time. It is argued that there is a one-way street of information flow from perceptual processing either to the perceived present or directly into the perceptual timescape, and thence to working memory. Consistent with that, the information structure of the perceptual timescape supports postdictive reinterpretations of recent perceptual information. Temporal integration on a time scale of hundreds of milliseconds takes place in perceptual processing and does not draw on information in the perceptual timescape, which is concerned with temporal segregation, not integration.

Response retention and apparent motion effect in visual cortex models

Apparent motion is a visual illusion in which stationary stimuli, flashing in distinct spatial locations at certain time intervals, are perceived as one stimulus moving between these locations. In the primary visual cortex, apparent-motion stimuli produce smooth spatio-temporal patterns of activity similar to those produced by continuously moving stimuli. An important prerequisite for producing such activity patterns is prolongation of responses to brief stimuli. Indeed, a brief stimulus can evoke in the visual cortex a long response, outlasting the stimulus by hundreds of milliseconds. Here we use firing-rate based models with simple ring structure, and biologically-detailed conductance-based refractory density (CBRD) model with retinotopic space representation to analyze the response retention and the origin of smooth profiles of activity in response to apparent-motion stimuli. We show that the strength of recurrent connectivity is the major factor that endorses neuronal networks with the ability for response retention. The same strengths of recurrent connections mediate the appearance of bump attractor in the ring models. Factors such as synaptic depression, NMDA receptor mediated currents, and conductances regulating spike adaptation influence response retention, but cannot substitute for the weakness of recurrent connections to reproduce response retention in models with weak connectivity. However, the weakness of lateral recurrent connections can be compensated by layering: in multi-layer models even with weaker connections the activity retains due to its feedforward propagation from layer to layer. Using CBRD model with retinotopic space representation we further show that smooth spatio-temporal profiles of activity in response to apparent-motion stimuli are produced in the models expressing response retention, but not in the models that fail to produce response retention. Together, these results demonstrate a link between response retention and the ability of neuronal networks to generate spatio-temporal patterns of activity, which are compatible with perception of apparent motion.

Perception of Happening: How the Brain Deals with the No-History Problem

In physics, the temporal dimension has units of infinitesimally brief duration. Given this, how is it possible to perceive things, such as motion, music, and vibrotactile stimulation, that involve extension across many units of time? To address this problem, it is proposed that there is what is termed an "information construct of happening" (ICOH), a simultaneous representation of recent, temporally differentiated perceptual information on the millisecond time scale. The main features of the ICOH are (i) time marking, semantic labeling of all information in the ICOH with ordinal temporal information and distance from what is informationally identified as the present moment, (ii) vector informational features that specify kind, direction, and rate of change for every feature in a percept, and (iii) connectives, information relating vector informational features at adjacent temporal locations in the ICOH. The ICOH integrates products of perceptual processing with recent historical information in sensory memory on the subsecond time scale. Perceptual information about happening in informational sensory memory is encoded in semantic form that preserves connected semantic trails of vector and timing information. The basic properties of the ICOH must be supported by a general and widespread timing mechanism that generates ordinal and interval timing information and it is suggested that state-dependent networks may suffice for that purpose. Happening, therefore, is perceived at a moment and is constituted by an information structure of connected recent historical information.

Perception of the difference between past and present stimulus: A rare orientation illusion may indicate incidental access to prediction error-like signals

A popular model for sensory processing, known as predictive coding, proposes that incoming signals are iteratively compared with top-down predictions along a hierarchical processing scheme. At each step, error signals arising from differences between actual input and prediction are forwarded and recurrently minimized by updating internal models to finally be “explained away”. However, the neuronal mechanisms underlying such computations and their limitations in processing speed are largely unknown. Further, it remains unclear at which step of cortical processing prediction errors are explained away, if at all. In the present study, human subjects briefly viewed the superposition of two orthogonally oriented gratings followed by abrupt removal of one orientation after either 33 or 200 milliseconds. Instead of strictly seeing the remaining orientation, observers report rarely but highly significantly an illusory percept of the arithmetic difference between previous and actual orientations. Previous findings in cats using the identical paradigm suggest that such difference signals are inherited from first steps of visual cortical processing. In light of early modeling accounts of predictive coding, in which visual neurons were interpreted as residual error detectors signaling the difference between actual input and its temporal prediction based on past input, our data may indicate continued access to residual errors. Such strategy permits time-critical perceptual decision making across a spectrum of competing internal signals up to the highest levels of processing. Thus, the occasional appearance of a prediction error-like illusory percept may uncover maintained flexibility at perceptual decision stages when subjects cope with highly dynamic and ambiguous visual stimuli.

The Flash-Lag, Fröhlich and Related Motion Illusions Are Natural Consequences of Discrete Sampling in the Visual System

The Fröhlich effect and flash-lag effect, in which moving objects appear advanced along their trajectories compared to their actual positions, have defied a simple and consistent explanation. Here, I show that these illusions can be understood as a natural consequence of temporal compression in the human visual system. Discrete sampling at some stage of sensory perception has long been considered, and if it were true, it would necessarily lead to these illusions of motion. I show that the discrete perception hypothesis, with a single free parameter, the perceptual moment or sampling rate, can quantitatively explain all of the scenarios of the Fröhlich and flash-lag effect. I interpret discrete perception as the implementation of data compression in the brain, and our conscious perception as the reconstruction of the compressed input.

TMS-induced neuronal plasticity enables targeted remodeling of visual cortical maps

Transcranial magnetic stimulation (TMS) holds promise as a tool for noninvasively facilitating plastic changes in cortical networks. However, highly resolved visualization of its modulatory effects remains elusive because current neuroimaging techniques applicable in humans are limited in spatiotemporal resolution. Here we used an imaging approach with voltage-sensitive dye and tracked, at submillimeter range, TMS-induced plastic changes across cat primary visual cortex. We show that high-frequency 10-Hz TMS induces a state where visual cortical maps are transiently “destabilized.” In turn, the cortex was sensitized to a bias in input—here imposed by prolonged exposure to a single visual orientation—and primed to relearn connectivity patterns. These findings implicate an early post-TMS time window for promising therapeutic interventions through TMS.

Transcranial magnetic stimulation (TMS) has become a popular clinical method to modify cortical processing. The events underlying TMS-induced functional changes remain, however, largely unknown because current noninvasive recording methods lack spatiotemporal resolution or are incompatible with the strong TMS-associated electrical field. In particular, an answer to the question of how the relatively unspecific nature of TMS stimulation leads to specific neuronal reorganization, as well as a detailed picture of TMS-triggered reorganization of functional brain modules, is missing. Here we used real-time optical imaging in an animal experimental setting to track, at submillimeter range, TMS-induced functional changes in visual feature maps over several square millimeters of the brain’s surface. We show that high-frequency TMS creates a transient cortical state with increased excitability and increased response variability, which opens a time window for enhanced plasticity. Visual stimulation (i.e., 30 min of passive exposure) with a single orientation applied during this TMS-induced permissive period led to enlarged imprinting of the chosen orientation on the visual map across visual cortex. This reorganization was stable for hours and was characterized by a systematic shift in orientation preference toward the trained orientation. Thus, TMS can noninvasively trigger a targeted large-scale remodeling of fundamentally mature functional architecture in early sensory cortex.

Is conscious perception a series of discrete temporal frames?

This paper reviews proposals that conscious perception consists, in whole or part, of successive discrete temporal frames on the sub-second time scale, each frame containing information registered as simultaneous or static. Although the idea of discrete frames in conscious perception cannot be regarded as falsified, there are many problems. Evidence does not consistently support any proposed duration or range of durations for frames. EEG waveforms provide evidence of periodicity in brain activity, but not necessarily in conscious perception. Temporal properties of perceptual processes are flexible in response to competing processing demands, which is hard to reconcile with the relative inflexibility of regular frames. There are also problems concerning the definition of frames, the need for informational connections between frames, the means by which boundaries between frames are established, and the apparent requirement for a storage buffer for information awaiting entry to the next frame.

Catching the voltage gradient-asymmetric boost of cortical spread generates motion signals across visual cortex: a brief review with special thanks to Amiram Grinvald

Wide-field voltage imaging is unique in its capability to capture snapshots of activity-across the full gradient of average changes in membrane potentials from subthreshold to suprathreshold levels-of hundreds of thousands of superficial cortical neurons that are simultaneously active. Here, I highlight two examples where voltage-sensitive dye imaging (VSDI) was exploited to track gradual space-time changes of activity within milliseconds across several millimeters of cortex at submillimeter resolution: the line-motion condition, measured in Amiram Grinvald's Laboratory more than 10 years ago and-coming full circle running VSDI in my laboratory-another motion-inducing condition, in which two neighboring stimuli counterchange luminance simultaneously. In both examples, cortical spread is asymmetrically boosted, creating suprathreshold activity drawn out over primary visual cortex. These rapidly propagating waves may integrate brain signals that encode motion independent of direction-selective circuits.

Flexible weighting of diverse inputs makes hippocampal function malleable

Classic theories of hippocampal function have emphasized its role as a dedicated memory system, but recent research has shown that it contributes broadly to many aspects of cognition, including attention and perception. We propose that the reason the hippocampus plays such a broad role in cognition is that its function is particularly malleable. We argue that this malleability arises because the hippocampus receives diverse anatomical inputs and these inputs are flexibly weighted based on behavioral goals. We discuss examples of how hippocampal representations can be flexibly weighted, focusing on hippocampal modulation by attention. Finally, we suggest some general neural mechanisms and core hippocampal computations that may enable the hippocampus to support diverse cognitive functions, including attention, perception, and memory. Together, this work suggests that great progress can and has been made in understanding the hippocampus by considering how the domain-general computations it performs allow it to dynamically contribute to many different behaviors.

Processes of believing: Where do they come from? What are they good for?

Despite the long scholarly discourse in Western theology and philosophy on religion, spirituality, and faith, explanations of what a belief and what believing is are still lacking. Recently, cognitive neuroscience research addressed the human capacity of believing. We present evidence suggesting that believing is a human brain function which results in probabilistic representations with attributes of personal meaning and value and thereby guides individuals’ behavior. We propose that the same mental processes operating on narratives and rituals constitute belief systems in individuals and social groups. Our theoretical model of believing is suited to account for secular and non-secular belief formation.

Processes of believing: Where do they come from? What are they good for?

Despite the long scholarly discourse in Western theology and philosophy on religion, spirituality, and faith, explanations of what a belief and what believing is are still lacking. Recently, cognitive neuroscience research addressed the human capacity of believing. We present evidence suggesting that believing is a human brain function which results in probabilistic representations with attributes of personal meaning and value and thereby guides individuals' behavior. We propose that the same mental processes operating on narratives and rituals constitute belief systems in individuals and social groups. Our theoretical model of believing is suited to account for secular and non-secular belief formation.

Temporal Asymmetry in Dark-Bright Processing Initiates Propagating Activity across Primary Visual Cortex

Differences between visual pathways representing darks and lights have been shown to affect spatial resolution and detection timing. Both psychophysical and physiological studies suggest an underlying retinal origin with amplification in primary visual cortex (V1). Here we show that temporal asymmetries in the processing of darks and lights create motion in terms of propagating activity across V1. Exploiting the high spatiotemporal resolution of voltage-sensitive dye imaging, we captured population responses to abrupt local changes of luminance in cat V1. For stimulation we used two neighboring small squares presented on either bright or dark backgrounds. When a single square changed from dark to bright or vice versa, we found coherent population activity emerging at the respective retinal input locations. However, faster rising and decay times were obtained for the bright to dark than the dark to bright changes. When the two squares changed luminance simultaneously in opposite polarities, we detected a propagating wave front of activity that originated at the cortical location representing the darkened square and rapidly expanded toward the region representing the brightened location. Thus, simultaneous input led to sequential activation across cortical retinotopy. Importantly, this effect was independent of the squares' contrast with the background. We suggest imbalance in dark-bright processing as a driving force in the generation of wave-like activity. Such propagation may convey motion signals and influence perception of shape whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders.

SIGNIFICANCE STATEMENT

An elementary process in vision is the detection of darks and lights through the retina via ON and OFF channels. Psychophysical and physiological studies suggest that differences between these channels affect spatial resolution and detection thresholds. Here we show that temporal asymmetries in the processing of darks and lights create motion signals across visual cortex. Using two neighboring squares, which simultaneously counterchanged luminance, we discovered propagating activity that was strictly drawn out from cortical regions representing the darkened location. Thus, a synchronous stimulus event translated into sequential wave-like brain activation. Such propagation may convey motion signals accessible in higher brain areas, whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders.

Push-Pull Receptive Field Organization and Synaptic Depression: Mechanisms for Reliably Encoding Naturalistic Stimuli in V1

Neurons in the primary visual cortex are known for responding vigorously but with high variability to classical stimuli such as drifting bars or gratings. By contrast, natural scenes are encoded more efficiently by sparse and temporal precise spiking responses. We used a conductance-based model of the visual system in higher mammals to investigate how two specific features of the thalamo-cortical pathway, namely push-pull receptive field organization and fast synaptic depression, can contribute to this contextual reshaping of V1 responses. By comparing cortical dynamics evoked respectively by natural vs. artificial stimuli in a comprehensive parametric space analysis, we demonstrate that the reliability and sparseness of the spiking responses during natural vision is not a mere consequence of the increased bandwidth in the sensory input spectrum. Rather, it results from the combined impacts of fast synaptic depression and push-pull inhibition, the later acting for natural scenes as a form of “effective” feed-forward inhibition as demonstrated in other sensory systems. Thus, the combination of feedforward-like inhibition with fast thalamo-cortical synaptic depression by simple cells receiving a direct structured input from thalamus composes a generic computational mechanism for generating a sparse and reliable encoding of natural sensory events.