Imaging cortical correlates of illusion in early visual cortex

A novel interface for cortical columnar neuromodulation with multipoint infrared neural stimulation

Cutting edge advances in electrical visual cortical prosthetics have evoked perception of shapes, motion, and letters in the blind. Here, we present an alternative optical approach using pulsed infrared neural stimulation. To interface with dense arrays of cortical columns with submillimeter spatial precision, both linear array and 100-fiber bundle array optical fiber interfaces were devised. We deliver infrared stimulation through these arrays in anesthetized cat visual cortex and monitor effects by optical imaging in contralateral visual cortex. Infrared neural stimulation modulation of response to ongoing visual oriented gratings produce enhanced responses in orientation-matched domains and suppressed responses in non-matched domains, consistent with a known higher order integration mediated by callosal inputs. Controls include dynamically applied speeds, directions and patterns of multipoint stimulation. This provides groundwork for a distinct type of prosthetic targeted to maps of visual cortical columns.

Induction of excitatory brain state governs plastic functional changes in visual cortical topology

Adult visual plasticity underlying local remodeling of the cortical circuitry in vivo appears to be associated with a spatiotemporal pattern of strongly increased spontaneous and evoked activity of populations of cells. Here we review and discuss pioneering work by us and others about principles of plasticity in the adult visual cortex, starting with our study which showed that a confined lesion in the cat retina causes increased excitability in the affected region in the primary visual cortex accompanied by fine-tuned restructuring of neuronal function. The underlying remodeling processes was further visualized with voltage-sensitive dye (VSD) imaging that allowed a direct tracking of retinal lesion-induced reorganization across horizontal cortical circuitries. Nowadays, application of noninvasive stimulation methods pursues the idea further of increased cortical excitability along with decreased inhibition as key factors for the induction of adult cortical plasticity. We used high-frequency transcranial magnetic stimulation (TMS), for the first time in combination with VSD optical imaging, and provided evidence that TMS-amplified excitability across large pools of neurons forms the basis for noninvasively targeting reorganization of orientation maps in the visual cortex. Our review has been compiled on the basis of these four own studies, which we discuss in the context of historical developments in the field of visual cortical plasticity and the current state of the literature. Overall, we suggest markers of LTP-like cortical changes at mesoscopic population level as a main driving force for the induction of visual plasticity in the adult. Elevations in excitability that predispose towards cortical plasticity are most likely a common property of all cortical modalities. Thus, interventions that increase cortical excitability are a promising starting point to drive perceptual and potentially motor learning in therapeutic applications.

Encoding luminance surfaces in the visual cortex of mice and monkeys: difference in responses to edge and center

Luminance and spatial contrast provide information on the surfaces and edges of objects. We investigated neural responses to black and white surfaces in the primary visual cortex (V1) of mice and monkeys. Unlike primates that use their fovea to inspect objects with high acuity, mice lack a fovea and have low visual acuity. It thus remains unclear whether monkeys and mice share similar neural mechanisms to process surfaces. The animals were presented with white or black surfaces and the population responses were measured at high spatial and temporal resolution using voltage-sensitive dye imaging. In mice, the population response to the surface was not edge-dominated with a tendency to center-dominance, whereas in monkeys the response was edge-dominated with a "hole" in the center of the surface. The population response to the surfaces in both species exhibited suppression relative to a grating stimulus. These results reveal the differences in spatial patterns to luminance surfaces in the V1 of mice and monkeys and provide evidence for a shared suppression process relative to grating.

Sequentially activated discrete modules appear as traveling waves in neuronal measurements with limited spatiotemporal sampling

Numerous studies have identified traveling waves in the cortex and suggested they play important roles in brain processing. These waves are most often measured using macroscopic methods that are unable to assess the local spiking activity underlying wave dynamics. Here, we investigated the possibility that waves may not be traveling at the single neuron scale. We first show that sequentially activating two discrete brain areas can appear as traveling waves in EEG simulations. We next reproduce these results using an analytical model of two sequentially activated regions. Using this model, we were able to generate wave-like activity with variable directions, velocities, and spatial patterns, and to map the discriminability limits between traveling waves and modular sequential activations. Finally, we investigated the link between field potentials and single neuron excitability using large-scale measurements from turtle cortex ex vivo. We found that while field potentials exhibit wave-like dynamics, the underlying spiking activity was better described by consecutively activated spatially adjacent groups of neurons. Taken together, this study suggests caution when interpreting phase delay measurements as continuously propagating wavefronts in two different spatial scales. A careful distinction between modular and wave excitability profiles across scales will be critical for understanding the nature of cortical computations.

Corrective mechanisms of motion extrapolation

Transmission and processing of sensory information in the visual system takes time. For motion perception, our brain can overcome this intrinsic neural delay through extrapolation mechanisms and accurately predict the current position of a continuously moving object. But how does the system behave when the motion abruptly changes and the prediction becomes wrong? Here we address this question by studying the perceived position of a moving object with various abrupt motion changes by human observers. We developed a task in which a bar is monotonously moving horizontally, and then motion suddenly stops, reverses, or disappears-then-reverses around two vertical stationary reference lines. Our results showed that participants overestimated the position of the stopping bar but did not perceive an overshoot in the motion reversal condition. When a temporal gap was added at the reverse point, the perceptual overshoot of the end point scaled with the gap durations. Our model suggests that the overestimation of the object position when it disappears is not linear as a function of its speeds but gradually fades out. These results can thus be reconciled in a single process where there is an interplay of the cortical motion prediction mechanisms and the late sensory transient visual inputs.

Perceptual Cycles Travel Across Retinotopic Space

Visual perception waxes and wanes periodically over time at low frequencies (theta: 4-7 Hz; alpha: 8-13 Hz), creating "perceptual cycles." These perceptual cycles can be induced when stimulating the brain with a flickering visual stimulus at the theta or alpha frequency. Here, we took advantage of the well-known organization of the visual system into retinotopic maps (topographic correspondence between visual and cortical spaces) to assess the spatial organization of induced perceptual cycles. Specifically, we tested the hypothesis that they can propagate across the retinotopic space. A disk oscillating in luminance (inducer) at 4, 6, 8, or 10 Hz was presented in the periphery of the visual field to induce perceptual cycles at specific frequencies. EEG recordings verified that the brain responded at the corresponding inducer frequencies and their first harmonics. Perceptual cycles were assessed with a concurrent detection task-target stimuli were displayed at threshold contrast (50% detection) at random times during the inducer. Behavioral results confirmed that perceptual performance was modulated periodically by the inducer at each frequency. We additionally manipulated the distance between the target and the inducer (three possible positions) and showed that the optimal phase, that is, moment of highest target detection, shifted across target distance to the inducer, specifically when its flicker frequency was in the alpha range (8 and 10 Hz). These results demonstrate that induced alpha perceptual cycles travel across the retinotopic space in humans at a propagation speed of 0.3-0.5 m/sec, consistent with the speed of unmyelinated horizontal connections in the visual cortex.

Response retention and apparent motion effect in visual cortex models

Apparent motion is a visual illusion in which stationary stimuli, flashing in distinct spatial locations at certain time intervals, are perceived as one stimulus moving between these locations. In the primary visual cortex, apparent-motion stimuli produce smooth spatio-temporal patterns of activity similar to those produced by continuously moving stimuli. An important prerequisite for producing such activity patterns is prolongation of responses to brief stimuli. Indeed, a brief stimulus can evoke in the visual cortex a long response, outlasting the stimulus by hundreds of milliseconds. Here we use firing-rate based models with simple ring structure, and biologically-detailed conductance-based refractory density (CBRD) model with retinotopic space representation to analyze the response retention and the origin of smooth profiles of activity in response to apparent-motion stimuli. We show that the strength of recurrent connectivity is the major factor that endorses neuronal networks with the ability for response retention. The same strengths of recurrent connections mediate the appearance of bump attractor in the ring models. Factors such as synaptic depression, NMDA receptor mediated currents, and conductances regulating spike adaptation influence response retention, but cannot substitute for the weakness of recurrent connections to reproduce response retention in models with weak connectivity. However, the weakness of lateral recurrent connections can be compensated by layering: in multi-layer models even with weaker connections the activity retains due to its feedforward propagation from layer to layer. Using CBRD model with retinotopic space representation we further show that smooth spatio-temporal profiles of activity in response to apparent-motion stimuli are produced in the models expressing response retention, but not in the models that fail to produce response retention. Together, these results demonstrate a link between response retention and the ability of neuronal networks to generate spatio-temporal patterns of activity, which are compatible with perception of apparent motion.

Spatio-temporal activation patterns of neuronal population evoked by optostimulation and the comparison to electrical microstimulation

Optostimulation and electrical microstimulation are well-established techniques that enable to artificially stimulate the brain. While the activation patterns evoked by microstimulation in cortical network are well characterized, much less is known for optostimulation. Specifically, the activation maps of neuronal population at the membrane potential level and direct measurements of these maps were barely reported. In addition, only a few studies compared the activation patterns evoked by microstimulation and optostimulation. In this study we addressed these issues by applying optostimulation in the barrel cortex of anesthetized rats after a short (ShortExp) or a long (LongExp) opsin expression time and compared it to microstimulation. We measured the membrane potential of neuronal populations at high spatial (meso-scale) and temporal resolution using voltage-sensitive dye imaging. Longer optostimulation pulses evoked higher neural responses spreading over larger region relative to short pulses. Interestingly, similar optostimulation pulses evoked stronger and more prolonged population response in the LongExp vs. the ShortExp condition. Finally, the spatial activation patterns evoked in the LongExp condition showed an intermediate state, with higher resemblance to the microstimulation at the stimulation site. Therefore, short microstimulation and optostimulation can induce wide spread activation, however the effects of optostimulation depend on the opsin expression time.

Complexity of cortical wave patterns of the wake mouse cortex

Rich spatiotemporal dynamics of cortical activity, including complex and diverse wave patterns, have been identified during unconscious and conscious brain states. Yet, how these activity patterns emerge across different levels of wakefulness remain unclear. Here we study the evolution of wave patterns utilizing data from high spatiotemporal resolution optical voltage imaging of mice transitioning from barbiturate-induced anesthesia to wakefulness (N = 5) and awake mice (N = 4). We find that, as the brain transitions into wakefulness, there is a reduction in hemisphere-scale voltage waves, and an increase in local wave events and complexity. A neural mass model recapitulates the essential cellular-level features and shows how the dynamical competition between global and local spatiotemporal patterns and long-range connections can explain the experimental observations. These mechanisms possibly endow the awake cortex with enhanced integrative processing capabilities.

A static paradigm based on illusion-induced VEP for brain-computer interfaces

OBJECTIVE

Visual evoked potentials (VEPs) have been commonly applied in brain-computer interfaces (BCIs) due to their satisfactory classification performance recently. However, most existing methods with flickering or oscillating stimuli will induce visual fatigue under long-term training, thus restricting the implementation of VEP-based BCIs. To address this issue, a novel paradigm adopting static motion illusion based on illusion-induced visual evoked potential (IVEP) is proposed for BCIs to enhance visual experience and practicality.

APPROACH

This study explored the responses to baseline and illusion tasks including the Rotating-Tilted-Lines (RTL) illusion and Rotating-Snakes (RS) illusion. The distinguishable features were examined between different illusions by analyzing the event-related potentials (ERPs) and amplitude modulation of evoked oscillatory responses.

MAIN RESULTS

The illusion stimuli elicited VEPs in an early time window encompassing a negative component (N1) from 110 to 200 ms and a positive component (P2) between 210 and 300 ms. Based on the feature analysis, a filter bank was designed to extract discriminative signals. The task-related component analysis (TRCA) was used to evaluate the binary classification task performance of the proposed method. Then the highest accuracy of 86.67% was achieved with a data length of 0.6 s.

SIGNIFICANCE

The results of this study demonstrate that the static motion illusion paradigm has the feasibility of implementation and is promising for VEP-based BCI applications.

Spatiotemporal patterns of population response in the visual cortex under isoflurane: from wakefulness to loss of consciousness

Anesthetic drugs are widely used in medicine and research to mediate loss of consciousness (LOC). Isoflurane is a commonly used anesthetic drug; however, its effects on cortical sensory processing, in particular around LOC, are not well understood. Using voltage-sensitive dye imaging, we measured visually evoked neuronal population response from the visual cortex in awake and anesthetized mice at 3 increasing concentrations of isoflurane, thus controlling the level of anesthesia from wakefulness to deep anesthesia. At low concentration of isoflurane, the effects on neuronal measures were minor relative to the awake condition. These effects augmented with increasing isoflurane concentration, while around LOC point, they showed abrupt and nonlinear changes. At the network level, we found that isoflurane decreased the stimulus-evoked intra-areal spatial spread of local neural activation, previously reported to be mediated by horizontal connections, and also reduced intra-areal synchronization of neuronal population. The synchronization between different visual areas decreased with higher isoflurane levels. Isoflurane reduced the population response amplitude and prolonged their latencies while higher visual areas showed increased vulnerability to isoflurane concentration. Our results uncover the changes in neural activity and synchronization at isoflurane concentrations leading to LOC and suggest reverse hierarchical shutdown of cortical areas.

Microstimulation in the primary visual cortex: activity patterns and their relation to visual responses and evoked saccades

Intracortical microstimulation (ICMS) in the primary visual cortex (V1) can generate the visual perception of a small point of light, termed phosphene, and evoke saccades directed to the receptive field of the stimulated neurons. Although ICMS is widely used, a direct measurement of the spatio-temporal patterns of neural activity evoked by ICMS and their relation to the neural responses evoked by visual stimuli or how they relate to ICMS-evoked saccades are still missing. To investigate this, we combined ICMS with voltage-sensitive dye imaging in V1 of behaving monkeys and measured neural activity at a high spatial (meso-scale) and temporal resolution. We then compared the population response evoked by small visual stimuli to those evoked by microstimulation. Both stimulation types evoked population activity that spread over few millimeters in V1 and propagated to extrastriate areas. However, the population responses evoked by ICMS have shown faster dynamics for the activation transients and the horizontal propagation of activity revealed a wave-like propagation. Finally, neural activity in the ICMS condition was higher for trials with evoked saccades as compared with trials without saccades. Our results uncover the spatio-temporal patterns evoked by ICMS and their relation to visual processing and saccade generation.

Revisiting horizontal connectivity rules in V1: from like-to-like towards like-to-all

Horizontal connections in the primary visual cortex of carnivores, ungulates and primates organize on a near-regular lattice. Given the similar length scale for the regularity found in cortical orientation maps, the currently accepted theoretical standpoint is that these maps are underpinned by a like-to-like connectivity rule: horizontal axons connect preferentially to neurons with similar preferred orientation. However, there is reason to doubt the rule's explanatory power, since a growing number of quantitative studies show that the like-to-like connectivity preference and bias mostly observed at short-range scale, are highly variable on a neuron-to-neuron level and depend on the origin of the presynaptic neuron. Despite the wide availability of published data, the accepted model of visual processing has never been revised. Here, we review three lines of independent evidence supporting a much-needed revision of the like-to-like connectivity rule, ranging from anatomy to population functional measures, computational models and to theoretical approaches. We advocate an alternative, distance-dependent connectivity rule that is consistent with new structural and functional evidence: from like-to-like bias at short horizontal distance to like-to-all at long horizontal distance. This generic rule accounts for the observed high heterogeneity in interactions between the orientation and retinotopic domains, that we argue is necessary to process non-trivial stimuli in a task-dependent manner.

Nonlinear collision between propagating waves in mouse somatosensory cortex

How does cellular organization shape the spatio-temporal patterns of activity in the cortex while processing sensory information? After measuring the propagation of activity in the mouse primary somatosensory cortex (S1) in response to single whisker deflections with Voltage Sensitive Dye (VSD) imaging, we developed a two dimensional model of S1. We designed an inference method to reconstruct model parameters from VSD data, revealing that a spatially heterogeneous organization of synaptic strengths between pyramidal neurons in S1 is likely to be responsible for the heterogeneous spatio-temporal patterns of activity measured experimentally. The model shows that, for strong enough excitatory cortical interactions, whisker deflections generate a propagating wave in S1. Finally, we report that two consecutive stimuli activating different spatial locations in S1 generate two waves which collide sub-linearly, giving rise to a suppressive wave. In the inferred model, the suppressive wave is explained by a lower sensitivity to external perturbations of neural networks during activated states.

The time-course of prediction formation and revision in human visual motion processing

Establishing the real-time position of a moving object poses a challenge to the visual system due to neural processing delays. While sensory information is travelling through the visual hierarchy, the object continues moving and information about its position becomes outdated. By extrapolating the position of a moving object along its trajectory, predictive mechanisms might effectively decrease the processing time associated with these objects. Here, we use time-resolved decoding of electroencephalographic (EEG) data from an apparent motion paradigm to demonstrate the interaction of two separate predictive mechanisms. First, we reveal predictive latency advantages for position representations as soon as the second object in an apparent motion sequence - even before the stimulus contains any physical motion energy. This is consistent with the existence of omni-directional, within-layer waves of sub-threshold activity that bring neurons coding for adjacent positions closer to their firing threshold, thereby reducing the processing time of the second stimulus in one of those positions. Second, we show that an additional direction-specific latency advantage emerges from the third sequence position onward, once the direction of the apparent motion stimulus is uniquely determined. Because the receptive fields of early visual areas are too small to encompass sequential apparent motion positions (as evidenced by the lack of latency modulation for the second stimulus position), this latency advantage most likely arises from descending predictions from higher to lower visual areas through feedback connections. Finally, we reveal that the same predictive activation that facilitates the processing of the object in its expected position needs to be overcome when the object's trajectory unexpectedly reverses, causing an additional latency disadvantage for stimuli that violate predictions. Altogether, our results suggest that two complementary mechanisms interact to form and revise predictions in visual motion processing, modulating the latencies of neural position representations at different levels of visual processing.

The Flash-lag Effect in Amblyopia

Purpose

Amblyopes suffer a defect in temporal processing, presumably because of a neural delay in their visual processing. By measuring flash-lag effect (FLE), we investigate whether the amblyopic visual system could compensate for the intrinsic neural delay due to visual information transmissions from the retina to the cortex.

Methods

Eleven adults with amblyopia and 11 controls with normal vision participated in this study. We assessed the monocular FLE magnitude for each subject by using a typical FLE paradigm: a bar moved horizontally, while a flashed bar briefly appeared above or below it. Three luminance contrasts of the flashed bar were tested: 0.2, 0.6, and 1.

Results

All participants, controls and those with amblyopia, showed a typical FLE. However, the FLE magnitude of participants with amblyopia was significantly shorter than that of the control participants, for both their amblyopic eye (AE) and fellow eye (FE). A nonsignificant difference was found in FLE magnitude between the AE and the FE.

Conclusions

We demonstrate a reduced FLE both in the AE as well as the FE of patients with amblyopia, suggesting a global visual processing deficit. We suggest it may be attributed to a more limited spatiotemporal extent of facilitatory anticipatory activity within the amblyopic primary visual cortex.

Motion Extrapolation in Visual Processing: Lessons from 25 Years of Flash-Lag Debate

Because of the delays inherent in neural transmission, the brain needs time to process incoming visual information. If these delays were not somehow compensated, we would consistently mislocalize moving objects behind their physical positions. Twenty-five years ago, Nijhawan used a perceptual illusion he called the flash-lag effect (FLE) to argue that the brain's visual system solves this computational challenge by extrapolating the position of moving objects (Nijhawan, 1994). Although motion extrapolation had been proposed a decade earlier (e.g., Finke et al., 1986), the proposal that it caused the FLE and functioned to compensate for computational delays was hotly debated in the years that followed, with several alternative interpretations put forth to explain the effect. Here, I argue, 25 years later, that evidence from behavioral, computational, and particularly recent functional neuroimaging studies converges to support the existence of motion extrapolation mechanisms in the visual system, as well as their causal involvement in the FLE. First, findings that were initially argued to challenge the motion extrapolation model of the FLE have since been explained, and those explanations have been tested and corroborated by more recent findings. Second, motion extrapolation explains the spatial shifts observed in several FLE conditions that cannot be explained by alternative (temporal) models of the FLE. Finally, neural mechanisms that actually perform motion extrapolation have been identified at multiple levels of the visual system, in multiple species, and with multiple different methods. I outline key questions that remain, and discuss possible directions for future research.

Themes of advanced information processing in the primate brain

Here is a review of several empirical examples of information processing that occur in the primate cerebral cortex. These include visual processing, object identification and perception, information encoding, and memory. Also, there is a discussion of the higher scale neural organization, mainly theoretical, which suggests hypotheses on how the brain internally represents objects. Altogether they support the general attributes of the mechanisms of brain computation, such as efficiency, resiliency, data compression, and a modularization of neural function and their pathways. Moreover, the specific neural encoding schemes are expectedly stochastic, abstract and not easily decoded by theoretical or empirical approaches.

Refractory density model of cortical direction selectivity: Lagged-nonlagged, transient-sustained, and On-Off thalamic neuron-based mechanisms and intracortical amplification

A biophysically detailed description of the mechanisms of the primary vision is still being developed. We have incorporated a simplified, filter-based description of retino-thalamic visual signal processing into the detailed, conductance-based refractory density description of the neuronal population activity of the primary visual cortex. We compared four mechanisms of the direction selectivity (DS), three of them being based on asymmetrical projections of different types of thalamic neurons to the cortex, distinguishing between (i) lagged and nonlagged, (ii) transient and sustained, and (iii) On and Off neurons. The fourth mechanism implies a lack of subcortical bias and is an epiphenomenon of intracortical interactions between orientation columns. The simulations of the cortical response to moving gratings have verified that first three mechanisms provide DS to an extent compared with experimental data and that the biophysical model realistically reproduces characteristics of the visual cortex activity, such as membrane potential, firing rate, and synaptic conductances. The proposed model reveals the difference between the mechanisms of both the intact and the silenced cortex, favoring the second mechanism. In the fourth case, DS is weaker but significant; it completely vanishes in the silenced cortex.DS in the On-Off mechanism derives from the nonlinear interactions within the orientation map. Results of simulations can help to identify a prevailing mechanism of DS in V1. This is a step towards a comprehensive biophysical modeling of the primary visual system in the frameworks of the population rate coding concept.

A major mechanism that underlies tuning of cortical neurons to the direction of a moving stimulus is still debated. Considering the visual cortex structured with orientation-selective columns, we have realized and compared in our biophysically detailed mathematical model four hypothetical mechanisms of the direction selectivity (DS) known from experiments. The present model accomplishes our previous model that was tuned to experimental data on excitability in slices and reproduces orientation tuning effects in vivo. In simulations, we have found that the convergence of inputs from so-called transient and sustained (or lagged and nonlagged) thalamic neurons in the cortex provides an initial bias for DS, whereas cortical interactions amplify the tuning. In the absence of any bias, DS emerges as an epiphenomenon of the orientation map. In the case of a biased convergence of On- and Off- thalamic inputs, DS emerges with the help of the intracortical interactions on the orientation map, also. Thus, we have proposed a comprehensive description of the primary vision and revealed characteristic features of different mechanisms of DS in the visual cortex with columnar structure.

Direction-selective motion discrimination by traveling waves in visual cortex

The majority of neurons in primary visual cortex respond selectively to bars of light that have a specific orientation and move in a specific direction. The spatial and temporal responses of such neurons are non-separable. How neurons accomplish that computational feat without resort to explicit time delays is unknown. We propose a novel neural mechanism whereby visual cortex computes non-separable responses by generating endogenous traveling waves of neural activity that resonate with the space-time signature of the visual stimulus. The spatiotemporal characteristics of the response are defined by the local topology of excitatory and inhibitory lateral connections in the cortex. We simulated the interaction between endogenous traveling waves and the visual stimulus using spatially distributed populations of excitatory and inhibitory neurons with Wilson-Cowan dynamics and inhibitory-surround coupling. Our model reliably detected visual gratings that moved with a given speed and direction provided that we incorporated neural competition to suppress false motion signals in the opposite direction. The findings suggest that endogenous traveling waves in visual cortex can impart direction-selectivity on neural responses without resort to explicit time delays. They also suggest a functional role for motion opponency in eliminating false motion signals.

It is well established that the so-called ‘simple cells’ of the primary visual cortex respond preferentially to oriented bars of light that move across the visual field with a particular speed and direction. The spatiotemporal responses of such neurons are said to be non-separable because they cannot be constructed from independent spatial and temporal neural mechanisms. Contemporary theories of how neurons compute non-separable responses typically rely on finely tuned transmission delays between signals from disparate regions of the visual field. However the existence of such delays is controversial. We propose an alternative neural mechanism for computing non-separable responses that does not require transmission delays. It instead relies on the predisposition of the cortical tissue to spontaneously generate spatiotemporal waves of neural activity that travel with a particular speed and direction. We propose that the endogenous wave activity resonates with the visual stimulus to elicit direction-selective neural responses to visual motion. We demonstrate the principle in computer models and show that competition between opposing neurons robustly enhances their ability to discriminate between visual gratings that move in opposite directions.

Apparent Motion Induces Activity Suppression in Early Visual Cortex and Impairs Visual Detection

Apparent motion (AM) is induced when two stationary visual stimuli are presented in alternating sequence. Intriguingly, AM leads to an impaired detectability of stimuli along the AM path (i.e., AM-induced masking). It has been hypothesized that AM triggers an internal representation of a moving object in early visual cortex, which competes with stimulus-evoked representations of visual stimuli on the motion path in early visual cortex of 25 human adults (16 female). We tested this hypothesis by measuring BOLD responses in early visual cortex during the process of AM-induced masking, using fMRI and population receptive field methods. Surprisingly, and counter to our hypothesis, we showed that AM suppressed, rather than increased, BOLD responses along early visual (V1 and V2) representations of the AM path, including regions that were not directly activated by the AM inducer stimuli. This activity suppression of the visual response predicted the subsequent reduction in detectability of the target that appeared in the middle of the AM path. Our data thereby provide direct empirical evidence for suppressive neural mechanisms underlying AM and suggest that illusory motion can render us blind to objects on the motion path by suppressing neural activity at the earliest cortical stages of visual perception.SIGNIFICANCE STATEMENT When two spatially distinct visual objects are presented in alternating sequence, apparent motion (AM) occurs and impairs detectability of stimuli along its path. The underlying mechanism is thought to be that increased activation in human early visual cortex evoked by AM interferes with the representation of the stimulus. Strikingly, however, we show that AM suppresses neural activity along the motion path, and the strength of activity suppression predicts the subsequent behavioral performance decrement in terms of detecting a stimulus along the AM path. Our findings provide empirical evidence for a suppressive, rather than faciliatory, mechanism underlying AM.

Dimensional reduction of emergent spatiotemporal cortical dynamics via a maximum entropy moment closure

Modern electrophysiological recordings and optical imaging techniques have revealed a diverse spectrum of spatiotemporal neural activities underlying fundamental cognitive processing. Oscillations, traveling waves and other complex population dynamical patterns are often concomitant with sensory processing, information transfer, decision making and memory consolidation. While neural population models such as neural mass, population density and kinetic theoretical models have been used to capture a wide range of the experimentally observed dynamics, a full account of how the multi-scale dynamics emerges from the detailed biophysical properties of individual neurons and the network architecture remains elusive. Here we apply a recently developed coarse-graining framework for reduced-dimensional descriptions of neuronal networks to model visual cortical dynamics. We show that, without introducing any new parameters, how a sequence of models culminating in an augmented system of spatially-coupled ODEs can effectively model a wide range of the observed cortical dynamics, ranging from visual stimulus orientation dynamics to traveling waves induced by visual illusory stimuli. In addition to an efficient simulation method, this framework also offers an analytic approach to studying large-scale network dynamics. As such, the dimensional reduction naturally leads to mesoscopic variables that capture the interplay between neuronal population stochasticity and network architecture that we believe to underlie many emergent cortical phenomena.

Machine classification of spatiotemporal patterns: automated parameter search in a rebounding spiking network

Various patterns of electrical activities, including travelling waves, have been observed in cortical experimental data from animal models as well as humans. By applying machine learning techniques, we investigate the spatiotemporal patterns, found in a spiking neuronal network with inhibition-induced firing (rebounding). Our cortical sheet model produces a wide variety of network activities including synchrony, target waves, and travelling wavelets. Pattern formation is controlled by modifying a Gaussian derivative coupling kernel through varying the level of inhibition, coupling strength, and kernel geometry. We have designed a computationally efficient machine classifier, based on statistical, textural, and temporal features, to identify the parameter regimes associated with different spatiotemporal patterns. Our results reveal that switching between synchrony and travelling waves can occur transiently and spontaneously without a stimulus, in a noise-dependent fashion, or in the presence of stimulus when the coupling strength and level of inhibition are at moderate values. They also demonstrate that when a target wave is formed, its wave speed is most sensitive to perturbations in the coupling strength between model neurons. This study provides an automated method to characterize activities produced by a novel spiking network that phenomenologically models large scale dynamics in the cortex.

Dynamic Patterns of Spontaneous Ongoing Activity in the Visual Cortex of Anesthetized and Awake Monkeys are Different

Ongoing internal cortical activity plays a major role in perception and behavior both in animals and humans. Previously we have shown that spontaneous patterns resembling orientation-maps appear over large cortical areas in the primary visual-cortex of anesthetized cats. However, it remains unknown 1) whether spontaneous-activity in the primate also displays similar patterns and 2) whether a significant difference exists between cortical ongoing-activity in the anesthetized and awake primate. We explored these questions by combining voltage-sensitive-dye imaging with multiunit and local-field-potential recordings. Spontaneously emerging orientation and ocular-dominance maps, spanning up to 6 × 6 mm2, were readily observed in anesthetized but not in awake monkeys. Nevertheless, spontaneous correlated-activity involving orientation-domains was observed in awake monkeys. Under both anesthetized and awake conditions, spontaneous correlated-activity coincided with traveling waves. We found that spontaneous activity resembling orientation-maps in awake animals spans smaller cortical areas in each instance, but over time it appears across all of V1. Furthermore, in the awake monkey, our results suggest that the synaptic strength had been completely reorganized including connections between dissimilar elements of the functional architecture. These findings lend support to the notion that ongoing-activity has many more fast switching representations playing an important role in cortical function and behavior.

Expecting the unexpected: Temporal expectation increases the flash-grab effect

In the flash-grab effect, when a disk is flashed on a moving background at the moment it reverses direction, the perceived location of the disk is strongly displaced in the direction of the motion that follows the reversal. Here, we ask whether increased expectation of the reversal reduces its effect on the motion-induced shift, as suggested by predictive coding models with first order predictions. Across four experiments we find that when the reversal is expected, the illusion gets stronger, not weaker. We rule out accumulating motion adaptation as a contributing factor. The pattern of results cannot be accounted for by first-order predictions of location. Instead, it appears that second-order predictions of event timing play a role. Specifically, we conclude that temporal expectation causes a transient increase in temporal attention, boosting the strength of the motion signal and thereby increasing the strength of the illusion.

Slow Waves in Cortical Slices: How Spontaneous Activity is Shaped by Laminar Structure

Cortical slow oscillations (SO) of neural activity spontaneously emerge and propagate during deep sleep and anesthesia and are also expressed in isolated brain slices and cortical slabs. We lack full understanding of how SO integrate the different structural levels underlying local excitability of cell assemblies and their mutual interaction. Here, we focus on ongoing slow waves (SWs) in cortical slices reconstructed from a 16-electrode array designed to probe the neuronal activity at multiple spatial scales. In spite of the variable propagation patterns observed, we reproducibly found a smooth strip of loci leading the SW fronts, overlapping cortical layers 4 and 5, along which Up states were the longest and displayed the highest firing rate. Propagation modes were uncorrelated in time, signaling a memoryless generation of SWs. All these features could be modeled by a multimodular large-scale network of spiking neurons with a specific balance between local and intermodular connectivity. Modules work as relaxation oscillators with a weakly stable Down state and a peak of local excitability to model layers 4 and 5. These conditions allow for both optimal sensitivity to the network structure and richness of propagation modes, both of which are potential substrates for dynamic flexibility in more general contexts.

Advanced Circuit and Cellular Imaging Methods in Nonhuman Primates

Novel genetically encoded tools and advanced microscopy methods have revolutionized neural circuit analyses in insects and rodents over the last two decades. Whereas numerous technical hurdles originally barred these methodologies from success in nonhuman primates (NHPs), current research has started to overcome those barriers. In some cases, methodological advances developed with NHPs have even surpassed their precursors. One such advance includes new ultra-large imaging windows on NHP cortex, which are larger than the entire rodent brain and allow analysis unprecedented ultra-large-scale circuits. NHP imaging chambers now remain patent for periods longer than a mouse's lifespan, allowing for long-term all-optical interrogation of identified circuits and neurons over timeframes that are relevant to human cognitive development. Here we present some recent imaging advances brought forth by research teams using macaques and marmosets. These include technical developments in optogenetics; voltage-, calcium- and glutamate-sensitive dye imaging; two-photon and wide-field optical imaging; viral delivery; and genetic expression of indicators and light-activated proteins that result in the visualization of tens of thousands of identified cortical neurons in NHPs. We describe a subset of the many recent advances in circuit and cellular imaging tools in NHPs focusing here primarily on the research presented during the corresponding mini-symposium at the 2019 Society for Neuroscience annual meeting.

Suppressive Traveling Waves Shape Representations of Illusory Motion in Primary Visual Cortex of Awake Primate

How does the brain link visual stimuli across space and time? Visual illusions provide an experimental paradigm to study these processes. When two stationary dots are flashed in close spatial and temporal succession, human observers experience a percept of apparent motion. Large spatiotemporal separation challenges the visual system to keep track of object identity along the apparent motion path, the so-called "correspondence problem." Here, we use voltage-sensitive dye imaging in primary visual cortex (V1) of awake monkeys to show that intracortical connections within V1 can solve this issue by shaping cortical dynamics to represent the illusory motion. We find that the appearance of the second stimulus in V1 creates a systematic suppressive wave traveling toward the retinotopic representation of the first. Using a computational model, we show that the suppressive wave is the emergent property of a recurrent gain control fed by the intracortical network. This suppressive wave acts to explain away ambiguous correspondence problems and contributes to precisely encode the expected motion velocity at the surface of V1. Together, these results demonstrate that the nonlinear dynamics within retinotopic maps can shape cortical representations of illusory motion. Understanding these dynamics will shed light on how the brain links sensory stimuli across space and time, by preformatting population responses for a straightforward read-out by downstream areas.SIGNIFICANCE STATEMENT Traveling waves have recently been observed in different animal species, brain areas, and behavioral states. However, it is still unclear what are their functional roles. In the case of cortical visual processing, waves propagate across retinotopic maps and can hereby generate interactions between spatially and temporally separated instances of feedforward driven activity. Such interactions could participate in processing long-range apparent motion stimuli, an illusion for which no clear neuronal mechanisms have yet been proposed. Using this paradigm in awake monkeys, we show that suppressive traveling waves produce a spatiotemporal normalization of apparent motion stimuli. Our study suggests that cortical waves shape the representation of illusory moving stimulus within retinotopic maps for a straightforward read-out by downstream areas.

Comparisons of flashILM, transformational apparent motion, and polarized gamma motion indicate these are three independent and separable illusions

Illusory line motion (ILM) refers to perceived motion in a bar when it is presented all at once. Explanations for ILM include low-level visual accounts, visual attention, and object tracking. These explanations tend to arise from studies using different protocols to induce ILM, based on the assumption that the same illusion is being generated. Using real motion in the same and in the opposite direction as the ILM quantifies the illusions from all protocols as the area between response curves for the left- and right-side inducers. This common measure enables testing of the assumption that two display configurations result in the same illusion. If there is a common underlying cause, an individual who shows a strong illusion in one situation should show a strong illusion in the other, but illusions that arise through different systems should not correlate. This approach has differentiated ILM induced by a flash (_flashILM) from ILM induced by matching the bar to an attribute of the inducing stimuli (transformational apparent motion, TAM). The former is thought to reflect attention, while the latter is thought to reflect object processing. Low-level visual explanations are often offered based on ILM that occurs when the bar is adjacent to only a single inducer (polarized gamma motion, PGM) rather than between two stimuli (_flashILM and TAM). The present study replicates the independence of _flashILM and TAM and shows that neither is related to PGM, suggesting that all three explanations for ILM are warranted and that the debates in the literature are conflating at least three different illusions.

Focal activation of neuronal circuits induced by microstimulation in the visual cortex

OBJECTIVE

Microstimulation to the cortical tissue applied with penetrating electrodes delivers current that spreads concentrically around the electrode tip and is known to evoke focal visual sensations, i.e. phosphenes. However, to date, there is no direct evidence depicting the spatiotemporal properties of neuronal activity induced immediately after microstimulation and how such activity drives the subsequent local cortical circuits.

APPROACH

In the present study, we imaged the spatiotemporal distribution of action potentials (APs) directly induced by microstimulation and the subsequent trans-synaptic signal propagation using a voltage-sensitive dye (VSD) and a calcium-sensitive dye (CaSD) in slice preparations of the mouse primary visual cortex.

MAIN RESULTS

The directly induced APs were confined to the close vicinity of the electrode tip, and the effective distance of excitation was proportional to the square root of the current intensity. The excitation around the electrode tip in layer IV mainly propagated to layer II/III to further induce the subsequent focal activation in downstream local cortical circuits. The extent of activation in the downstream circuits was restrained by competitive interactions between excitatory and inhibitory signals. Namely, the spread of the excitation to lateral neighbor neurons along the layer II/III was confined by the delayed inhibition that also spread laterally at a faster rate.

SIGNIFICANCE

These observations indicate that dynamic interactions between excitatory and inhibitory signals play a critical role in the focal activation of a cortical circuit in response to intracortical microstimulation and, therefore, in evoking a localized phosphene.

Building perception block by block: a response to Fekete et al

Is consciousness a continuous stream, or do percepts occur only at certain moments of time? This age-old question is still under debate. Both positions face difficult problems, which we proposed to overcome with a 2-stage model, where unconscious processing continuously integrates information before a discrete, conscious percept occurs. Recently, Fekete et al. criticized our model. Here, we show that, contrary to their proposal, simple sliding windows cannot explain apparent motion and related phenomena within a continuous framework, and that their supervenience argument only holds true for qualia realists, a philosophical position we do not adopt.

Cancelling Flash Illusory Line Motion by Cancelling the Attentional Gradient and a Consideration of Consciousness

Illusory line motion (ILM) refers to the perception of motion in a line that is, in fact, presented in full at one time. One form of this illusion (flashILM) occurs when the line is presented between two objects following a brief luminance change in one of them and flashILM is thought to result from exogenous attention being captured by the flash. Exogenous attention fades with increasing delays, which predicts that flashILM should show a similar temporal pattern. Exogenous attention appears to follow flashILM to become more or less equally distributed along the line.The current study examines flashILM in order to test these predictions derived from the attentional explanation for flashILM and the results were consistent with them. The discussion then concludes with an exploratory analysis approach concerning states of consciousness and decision making and suggests a possible role for attention.

Large deviations for randomly connected neural networks: I. Spatially extended systems

In a series of two papers, we investigate the large deviations and asymptotic behavior of stochastic models of brain neural networks with random interaction coefficients. In this first paper, we take into account the spatial structure of the brain and consider first the presence of interaction delays that depend on the distance between cells and then the Gaussian random interaction amplitude with a mean and variance that depend on the position of the neurons and scale as the inverse of the network size. We show that the empirical measure satisfies a large deviations principle with a good rate function reaching its minimum at a unique spatially extended probability measure. This result implies an averaged convergence of the empirical measure and a propagation of chaos. The limit is characterized through a complex non-Markovian implicit equation in which the network interaction term is replaced by a nonlocal Gaussian process with a mean and covariance that depend on the statistics of the solution over the whole neural field.

Faster processing of moving compared with flashed bars in awake macaque V1 provides a neural correlate of the flash lag illusion

When the brain has determined the position of a moving object, because of anatomical and processing delays the object will have already moved to a new location. Given the statistical regularities present in natural motion, the brain may have acquired compensatory mechanisms to minimize the mismatch between the perceived and real positions of moving objects. A well-known visual illusion-the flash lag effect-points toward such a possibility. Although many psychophysical models have been suggested to explain this illusion, their predictions have not been tested at the neural level, particularly in a species of animal known to perceive the illusion. To this end, we recorded neural responses to flashed and moving bars from primary visual cortex (V1) of awake, fixating macaque monkeys. We found that the response latency to moving bars of varying speed, motion direction, and luminance was shorter than that to flashes, in a manner that is consistent with psychophysical results. At the level of V1, our results support the differential latency model positing that flashed and moving bars have different latencies. As we found a neural correlate of the illusion in passively fixating monkeys, our results also suggest that judging the instantaneous position of the moving bar at the time of flash-as required by the postdiction/motion-biasing model-may not be necessary for observing a neural correlate of the illusion. Our results also suggest that the brain may have evolved mechanisms to process moving stimuli faster and closer to real time compared with briefly appearing stationary stimuli. NEW & NOTEWORTHY We report several observations in awake macaque V1 that provide support for the differential latency model of the flash lag illusion. We find that the equal latency of flash and moving stimuli as assumed by motion integration/postdiction models does not hold in V1. We show that in macaque V1, motion processing latency depends on stimulus luminance, speed and motion direction in a manner consistent with several psychophysical properties of the flash lag illusion.

Spatio-temporal characteristics of population responses evoked by microstimulation in the barrel cortex

Intra-cortical microstimulation (ICMS) is a widely used technique to artificially stimulate cortical tissue. This method revealed functional maps and provided causal links between neuronal activity and cognitive, sensory or motor functions. The effects of ICMS on neural activity depend on stimulation parameters. Past studies investigated the effects of stimulation frequency mainly at the behavioral or motor level. Therefore the direct effect of frequency stimulation on the evoked spatio-temporal patterns of cortical activity is largely unknown. To study this question we used voltage-sensitive dye imaging to measure the population response in the barrel cortex of anesthetized rats evoked by high frequency stimulation (HFS), a lower frequency stimulation (LFS) of the same duration or a single pulse stimulation. We found that single pulse and short trains of ICMS induced cortical activity extending over few mm. HFS evoked a lower population response during the sustained response and showed a smaller activation across time and space compared with LFS. Finally the evoked population response started near the electrode site and spread horizontally at a propagation velocity in accordance with horizontal connections. In summary, HFS was less effective in cortical activation compared to LFS although HFS had 5 fold more energy than LFS.

Sensory-evoked propagating waves of activity in the primary sensory cortices: poorly understood, yet ubiquitous

Any sensory stimulus evokes a propagating wave of activity in the corresponding sensory cortex that exceeds its topographical boundaries within the primary sensory map. Hama and colleagues (Hama N, Kawai M, Ito S-I, Hirota A. J Neurophysiol 119: 1934–1946, 2018) provided a first study, in the tactile modality, of the interactions between two successively evoked waves. We argue that the difficulty in finding a simple rule to account for all the various observed interactions calls for an effort to clarify the mechanisms and substrates of the propagating waves and their role in sensory processing.

In the interest of saving time: a critique of discrete perception

A recently proposed model of sensory processing suggests that perceptual experience is updated in discrete steps. We show that the data advanced to support discrete perception are in fact compatible with a continuous account of perception. Physiological and psychophysical constraints, moreover, as well as our awake-primate imaging data, imply that human neuronal networks cannot support discrete updates of perceptual content at the maximal update rates consistent with phenomenology. A more comprehensive approach to understanding the physiology of perception (and experience at large) is therefore called for, and we briefly outline our take on the problem.

LFP beta amplitude is linked to mesoscopic spatio-temporal phase patterns

Beta oscillations observed in motor cortical local field potentials (LFPs) recorded on separate electrodes of a multi-electrode array have been shown to exhibit non-zero phase shifts that organize into planar waves. Here, we generalize this concept to additional classes of salient patterns that fully describe the spatial organization of beta oscillations. During a delayed reach-to-grasp task we distinguish planar, synchronized, random, circular, and radial phase patterns in monkey primary motor and dorsal premotor cortices. We observe that patterns correlate with the beta amplitude (envelope): Coherent planar/radial wave propagation accelerates with growing amplitude, and synchronized patterns are observed at largest amplitudes. In contrast, incoherent random or circular patterns are observed almost exclusively when beta is strongly attenuated. The occurrence probability of a particular pattern modulates with behavioral epochs in the same way as beta amplitude: Coherent patterns are more present during movement preparation where amplitudes are large, while incoherent phase patterns are dominant during movement execution where amplitudes are small. Thus, we uncover a trigonal link between the spatial arrangement of beta phases, beta amplitude, and behavior. Together with previous findings, we discuss predictions on the spatio-temporal organization of precisely coordinated spiking on the mesoscopic scale as a function of beta power.

Cortical travelling waves: mechanisms and computational principles

Multichannel recording technologies have revealed travelling waves of neural activity in multiple sensory, motor and cognitive systems. These waves can be spontaneously generated by recurrent circuits or evoked by external stimuli. They travel along brain networks at multiple scales, transiently modulating spiking and excitability as they pass. Here, we review recent experimental findings that have found evidence for travelling waves at single-area (mesoscopic) and whole-brain (macroscopic) scales. We place these findings in the context of the current theoretical understanding of wave generation and propagation in recurrent networks. During the large low-frequency rhythms of sleep or the relatively desynchronized state of the awake cortex, travelling waves may serve a variety of functions, from long-term memory consolidation to processing of dynamic visual stimuli. We explore new avenues for experimental and computational understanding of the role of spatiotemporal activity patterns in the cortex.

Intrinsic optical imaging study on cortical responses to electrical stimulation in ventral posterior medial nucleus of thalamus

Intracortical electrical micro-stimulation has been applied widely for the attempts on reconstruction of sensory functions. More recently, thalamic electrical stimulation has been proposed as a promising target for somatosensory stimulation. However, the cortical activations and mechanisms evoked by VPM stimulation remained unclear. In this report, the cortical neural responses to electrical stimulations were recorded by optical imaging of intrinsic signals. The impact of stimulation parameters was characterized to illustrate how the VPM stimulation alter cortical activities. Significant increases were found in cortical responses with increased stimulation amplitude or pulse width. However, frequency modulation exhibited significant inhibition with higher frequency stimulation. Our results suggest that optical imaging of intrinsic signals is sensitive and reliable to deep brain stimulations. These results may not only help to understand the modulation effects through thalamocortical pathway, but also show the possibility to use VPM stimulation to evoke frequency-tuned tactile sensations in rats.

Flash-induced forward and reverse illusory line motion in offset bars

Illusory line motion (ILM) refers to perception of motion in a bar that onsets or offsets all at once. When the bar onsets or offsets between two boxes after one of the boxes flashes, the bar appears to shoot out of the flashed box (_flashILM). If the bar offsets during the flash, it appears to contract into the flashed box (reverse ILM; rILM). Onset bars do not show rILM. Moreover, rILM and _flashILM are not correlated, indicating they are two different illusions. To date, rILM has only been studied using a 50-ms flash where the bar offsets 16.7 ms after flash onset. It is not clear if rILM is due to the 16.7-ms flash-bar-removal stimulus onset asynchrony (SOA) or due to the flash offsetting after the bar. The current studies explore these parameters to better understand the conditions that lead to rILM. The results suggest that _flashILM is sensitive to the temporal interval between flash onset and bar offset, while rILM appears to arise when the flash offsets after the bar has been removed regardless of the temporal interval between flash onset and bar removal. These results are consistent with _flashILM reflecting visual exogenous attention while rILM may reflect the low-level spreading of subthreshold activation radiating from the flashed box. The findings are incorporated into the recent work that suggests that the literature concerning ILM is possibly conflating a number of different illusions of line motion, including polarized gamma motion (PGM), transformational apparent motion (TAM), and exogenous attention induced motion (_flashILM).

Illusory line motion in onset and offset bars

Illusory line motion (ILM) refers to the perception of motion in a bar that is presented all at once next to an inducing stimulus. The experimental methods for producing and quantifying ILM are varied, and the resulting explanations are likewise at odds. The current study examined the explanations for ILM away from the inducing stimulus (bright or dark flash) using bars that either suddenly appear (onset bars) or suddenly disappear (offset bars). Real motion is used to cancel ILM, providing three measures to quantify ILM: the consistency of responding to only ILM in the absence of real motion; the distance between the points of subjective equality between ILM and the real motion; and the area between the curves relating perception of motion to the real and illusory conditions. ILM quantities for onset and offset bars are strongly correlated when the bar change occurs after the flash. However, onset bars presented during the flash do not show any evidence of ILM, whereas offset bars removed during the flash result in reverse ILM (rILM). Moreover, rILM and ILM are not correlated, suggesting they reflect two separate illusions. These results are consistent over the various measures of ILM.

The reference frame for encoding and retention of motion depends on stimulus set size

The goal of this study was to investigate the reference frames used in perceptual encoding and storage of visual motion information. In our experiments, observers viewed multiple moving objects and reported the direction of motion of a randomly selected item. Using a vector-decomposition technique, we computed performance during smooth pursuit with respect to a spatiotopic (nonretinotopic) and to a retinotopic component and compared them with performance during fixation, which served as the baseline. For the stimulus encoding stage, which precedes memory, we found that the reference frame depends on the stimulus set size. For a single moving target, the spatiotopic reference frame had the most significant contribution with some additional contribution from the retinotopic reference frame. When the number of items increased (Set Sizes 3 to 7), the spatiotopic reference frame was able to account for the performance. Finally, when the number of items became larger than 7, the distinction between reference frames vanished. We interpret this finding as a switch to a more abstract nonmetric encoding of motion direction. We found that the retinotopic reference frame was not used in memory. Taken together with other studies, our results suggest that, whereas a retinotopic reference frame may be employed for controlling eye movements, perception and memory use primarily nonretinotopic reference frames. Furthermore, the use of nonretinotopic reference frames appears to be capacity limited. In the case of complex stimuli, the visual system may use perceptual grouping in order to simplify the complexity of stimuli or resort to a nonmetric abstract coding of motion information.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Space-Time Dynamics of Membrane Currents Evolve to Shape Excitation, Spiking, and Inhibition in the Cortex at Small and Large Scales

In the cerebral cortex, membrane currents, i.e., action potentials and other membrane currents, express many forms of space-time dynamics. In the spontaneous asynchronous irregular state, their space-time dynamics are local non-propagating fluctuations and sparse spiking appearing at unpredictable positions. After transition to active spiking states, larger structured zones with active spiking neurons appear, propagating through the cortical network, driving it into various forms of widespread excitation, and engaging the network from microscopic scales to whole cortical areas. At each engaged cortical site, the amount of excitation in the network, after a delay, becomes matched by an equal amount of space-time fine-tuned inhibition that might be instrumental in driving the dynamics toward perception and action.

Study of single and multidigit activation in monkey somatosensory cortex using voltage-sensitive dye imaging

Toward the goal of understanding cutaneous sensory integration during manual behavior, we used voltage-sensitive dye (VSD) imaging to study the organization and dynamics of anesthetized monkey primary somatosensory cortex (SI) in response to single and multidigit tactile stimulation. We find that in both macaque and squirrel monkey SI, VSD reveals clear focal digit topography consistent with previous electrophysiological and intrinsic signal imaging studies. VSD also reveals interactions in SI in response to multidigit stimulation. With a tactile funneling paradigm in areas 3b and 1 in squirrel monkeys, VSD reveals two-digit induction of subthreshhold influences, consistent with lateral intracortical inhibition. In response to tactile apparent motion stimuli, VSD reveals preferential response to motion stimuli over static tactile stimuli in both areas 1 and 3b. Comparison of the response at different digit locations to "toward digit" stimuli suggests the presence of direction-selective response in area 1; however, further study is needed. These exciting results indicate that VSD constitutes a powerful tool for studying somatosensory cortical processing in nonhuman primates and should be further developed for future somatosensory studies in awake behaving monkeys.

Catching the voltage gradient-asymmetric boost of cortical spread generates motion signals across visual cortex: a brief review with special thanks to Amiram Grinvald

Wide-field voltage imaging is unique in its capability to capture snapshots of activity-across the full gradient of average changes in membrane potentials from subthreshold to suprathreshold levels-of hundreds of thousands of superficial cortical neurons that are simultaneously active. Here, I highlight two examples where voltage-sensitive dye imaging (VSDI) was exploited to track gradual space-time changes of activity within milliseconds across several millimeters of cortex at submillimeter resolution: the line-motion condition, measured in Amiram Grinvald's Laboratory more than 10 years ago and-coming full circle running VSDI in my laboratory-another motion-inducing condition, in which two neighboring stimuli counterchange luminance simultaneously. In both examples, cortical spread is asymmetrically boosted, creating suprathreshold activity drawn out over primary visual cortex. These rapidly propagating waves may integrate brain signals that encode motion independent of direction-selective circuits.