Strength of figure-ground activity in monkey primary visual cortex predicts saccadic reaction time in a delayed detection task

Eye movements are made to the centre of gravity of texture-defined targets

Saccadic localisation of targets of various properties has been extensively studied, but rarely for texture-defined figures. In this paper, three experiments that investigate the way information from a texture target is processed in order to provide a signal for eye movement control are presented. Participants made saccades to target regions embedded in a background structure, and the saccade landing position and latency were measured. The textures comprised line elements, with orientations of the lines configured to form the figure and ground. Various orientation profile configurations (Block, Blur, and Cornsweet), were used in order to measure the role of edge profiles in driving eye movements and producing salience. We found that in all cases the visual system is in fact able to effectively segregate a texture figure from the ground in order to accurately plan a saccade to the target-figure. While saccadic latency was the highest for the Blur profile, the mean saccadic landing position was mostly unaffected by the various profiles (Experiment 1). More specifically, we showed that saccades were directed to the centre-of-gravity of the target (Experiment 2). We also found that figures with information of orientation contrast at both the edge and centre of figure (i.e. Block) produced the highest level of saliency in attracting eye movements (Experiment 3). Overall, the results show that saccades are planned on the representation of the whole target shape rather than a local salient region based on orientation contrast cues, and that the various texture profiles were important only to the extent that they affected the time to programme a saccade.

The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons

Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.

Temporal structure of human magnetic evoked fields

Nonlinear analysis of the multifocal cortical visual evoked potential has allowed the identification of neural generation of higher-order nonlinear components by magnocellular and parvocellular neural streams. However, the location of individual brain sources that make such contributions to these evoked responses has not been studied. Thus, an m-sequence pseudorandom stimulus system was developed for use in magnetoencephalographic (MEG) studies. Five normal young adults were recorded using an Elekta TRIUX MEG with 306 sensors. Visual stimuli comprised a nine-patch dartboard stimulus, and each patch fluctuated between two luminance levels with separate recordings carried out at low (24 %) and high (96 %) temporal contrast. Sensor-space analysis of MEG evoked fields identified components of the first- and second-order Wiener kernel decomposition that showed qualitative similarity with EEG-based cortical VEP recordings. The first slice of the second-order response (K2.1) was already saturated at 24 % contrast, while the major waveform of the second slice of the second-order response (K2.2) grew strongly with contrast, consistent with properties of the magnocellular and parvocellular neurons. Minimum norm estimates of cortical source localization showed almost simultaneous activation of V1 and MT+ activations with latencies only a little greater that those reported for first neural spikes in primate single cell studies. Time-frequency analysis of the kernel responses from five minimum norm estimate scout sources shows contributions from higher-frequency bands for the first compared with the second slice response, consistent with the proposed neural sources. In support of this magno/parvo break-up, the onset latencies of the K2.2 responses were delayed by approximately 30 ms compared with K2.1 responses.

Cortical high-density counterstream architectures

Small-world networks provide an appealing description of cortical architecture owing to their capacity for integration and segregation combined with an economy of connectivity. Previous reports of low-density interareal graphs and apparent small-world properties are challenged by data that reveal high-density cortical graphs in which economy of connections is achieved by weight heterogeneity and distance-weight correlations. These properties define a model that predicts many binary and weighted features of the cortical network including a core-periphery, a typical feature of self-organizing information processing systems. Feedback and feedforward pathways between areas exhibit a dual counterstream organization, and their integration into local circuits constrains cortical computation. Here, we propose a bow-tie representation of interareal architecture derived from the hierarchical laminar weights of pathways between the high-efficiency dense core and periphery.

Population response to natural images in the primary visual cortex encodes local stimulus attributes and perceptual processing

The primary visual cortex (V1) is extensively studied with a large repertoire of stimuli, yet little is known about its encoding of natural images. Using voltage-sensitive dye imaging in behaving monkeys, we measured neural population response evoked in V1 by natural images presented during a face/scramble discrimination task. The population response showed two distinct phases of activity: an early phase that was spread over most of the imaged area, and a late phase that was spatially confined. To study the detailed relation between the stimulus and the population response, we used a simple encoding model to compute a continuous map of the expected neural response based on local attributes of the stimulus (luminance and contrast), followed by an analytical retinotopic transformation. Then, we computed the spatial correlation between the maps of the expected and observed response. We found that the early response was highly correlated with the local luminance of the stimulus and was sufficient to effectively discriminate between stimuli at the single trial level. The late response, on the other hand, showed a much lower correlation to the local luminance, was confined to central parts of the face images, and was highly correlated with the animal's perceptual report. Our study reveals a continuous spatial encoding of low- and high-level features of natural images in V1. The low level is directly linked to the stimulus basic local attributes and the high level is correlated with the perceptual outcome of the stimulus processing.

Noise destroys feedback enhanced figure-ground segmentation but not feedforward figure-ground segmentation

Figure-ground (FG) segmentation is the separation of visual information into background and foreground objects. In the visual cortex, FG responses are observed in the late stimulus response period, when neurons fire in tonic mode, and are accompanied by a switch in cortical state. When such a switch does not occur, FG segmentation fails. Currently, it is not known what happens in the brain on such occasions. A biologically plausible feedforward spiking neuron model was previously devised that performed FG segmentation successfully. After incorporating feedback the FG signal was enhanced, which was accompanied by a change in spiking regime. In a feedforward model neurons respond in a bursting mode whereas in the feedback model neurons fired in tonic mode. It is known that bursts can overcome noise, while tonic firing appears to be much more sensitive to noise. In the present study, we try to elucidate how the presence of noise can impair FG segmentation, and to what extent the feedforward and feedback pathways can overcome noise. We show that noise specifically destroys the feedback enhanced FG segmentation and leaves the feedforward FG segmentation largely intact. Our results predict that noise produces failure in FG perception.

Masking of figure-ground texture and single targets by surround inhibition: a computational spiking model

A visual stimulus can be made invisible, i.e. masked, by the presentation of a second stimulus. In the sensory cortex, neural responses to a masked stimulus are suppressed, yet how this suppression comes about is still debated. Inhibitory models explain masking by asserting that the mask exerts an inhibitory influence on the responses of a neuron evoked by the target. However, other models argue that the masking interferes with recurrent or reentrant processing. Using computer modeling, we show that surround inhibition evoked by ON and OFF responses to the mask suppresses the responses to a briefly presented stimulus in forward and backward masking paradigms. Our model results resemble several previously described psychophysical and neurophysiological findings in perceptual masking experiments and are in line with earlier theoretical descriptions of masking. We suggest that precise spatiotemporal influence of surround inhibition is relevant for visual detection.

Visual processing in rapid-chase systems: image processing, attention, and awareness

Visual stimuli can be classified so rapidly that their analysis may be based on a single sweep of feedforward processing through the visuomotor system. Behavioral criteria for feedforward processing can be evaluated in response priming tasks where speeded pointing or keypress responses are performed toward target stimuli which are preceded by prime stimuli. We apply this method to several classes of complex stimuli. (1) When participants classify natural images into animals or non-animals, the time course of their pointing responses indicates that prime and target signals remain strictly sequential throughout all processing stages, meeting stringent behavioral criteria for feedforward processing (rapid-chase criteria). (2) Such priming effects are boosted by selective visual attention for positions, shapes, and colors, in a way consistent with bottom-up enhancement of visuomotor processing, even when primes cannot be consciously identified. (3) Speeded processing of phobic images is observed in participants specifically fearful of spiders or snakes, suggesting enhancement of feedforward processing by long-term perceptual learning. (4) When the perceived brightness of primes in complex displays is altered by means of illumination or transparency illusions, priming effects in speeded keypress responses can systematically contradict subjective brightness judgments, such that one prime appears brighter than the other but activates motor responses as if it was darker. We propose that response priming captures the output of the first feedforward pass of visual signals through the visuomotor system, and that this output lacks some characteristic features of more elaborate, recurrent processing. This way, visuomotor measures may become dissociated from several aspects of conscious vision. We argue that "fast" visuomotor measures predominantly driven by feedforward processing should supplement "slow" psychophysical measures predominantly based on visual awareness.

Trial-to-trial variability of spike response of V1 and saccadic response time

Single neurons in the primary visual cortex (V1) show variability in spike activity in response to an identical visual stimulus. In the current study, we examined the behavioral significance of the variability in spike activity of V1 neurons for visually guided saccades. We recorded single-cell activity from V1 of monkeys trained to detect and make saccades toward visual targets of varying contrast and analyzed trial-to-trial covariation between the onset time or firing rate of neural response and saccadic response time (RT). Neural latency (NL, the time of the first spike of neural response) was correlated with RT, whereas firing rate (FR) was not. When FR was computed with respect to target onset ignoring NL, a "false" correlation between FR and RT emerged. Multiple regression and partial correlation analyses on NL and FR for predictability of RT variability, as well as a simulation with artificial Poisson spike trains, supported the conclusion that the correlation between FR with respect to target onset and RT was mediated by a correlation between NL and RT, emphasizing the role of trial-to-trial variability of NL for extracting RT-related signals. We attempted to examine laminar differences in RT-related activity. Neurons recorded in the superficial layers tended to show a higher sensitivity to stimulus contrast and a lower correlation with RT compared with those in the lower layers, suggesting a sensory-to-motor transformation within V1 that follows the order of known anatomical connections. These results demonstrate that the trial-to-trial variability of neural response in V1 propagates to the stage of saccade execution, resulting in trial-to-trial variability of RT of a visually guided saccade.

Magnocellular visual evoked potential delay with high autism spectrum quotient yields a neural mechanism for altered perception

Everyone has autistic characteristics to a greater or lesser degree, encapsulated in the Autism Spectrum Quotient, a scale that measures the degree to which an adult of normal intelligence displays traits associated with autism spectrum disorders. Recent psychophysical analyses of autism spectrum disorders point to superior local processing, and impaired or ignored global and contextual processing. The aim of this study was to test whether low- and high-scoring individuals on the Autism Spectrum Quotient differ on a measure of local and global processing, motion processing and visual pathway integrity. Fifteen low-scoring individuals and 14 high-scoring individuals derived from a normal population participated in the study. The results indicate that the initial cortical response to the magnocellular afferents is weaker at low contrast in the high autistic tendency group and that a second-order response, reflecting magnocellular activity, demonstrated a delay for high versus low scorers when the parvocellular pathway was also active in response to a high contrast stimulus. High-scoring individuals also demonstrated difficulty in identifying the global components of locally salient hierarchical Navon figures. Furthermore, cross-validated discriminant analysis, using four physiologically and three psychophysically derived parameters, correctly classified 83% of individuals who scored either high or low on the Autism Spectrum Quotient. These findings in the group scoring high on the Autism Spectrum Quotient indicate that a delay in primary visual/prestriate cortical processing of magnocellular input diminishes the advantage of its early arrival to primary visual cortex. This appears to be associated with impaired global visual perception, predicting with high accuracy behavioural tendencies associated with autism spectrum disorders. It has been proposed that perceptual impairment in autism may be attributed to a dysfunction of horizontal connections within early visual areas, presumably parvocellular in nature. However, the timing of such form processing aberrations is much later than the timing of abnormal magnocellular visual processing measured directly here. Thus it is proposed that a magnocellular processing delay decreases the ability of autistic individuals to benefit perceptually from feedback normally associated with the magnocellular advantage.

Changes in the response rate and response variability of area V4 neurons during the preparation of saccadic eye movements

The visually driven responses of macaque area V4 neurons are modulated during the preparation of saccadic eye movements, but the relationship between presaccadic modulation in area V4 and saccade preparation is poorly understood. Recent neurophysiological studies suggest that the variability across trials of spiking responses provides a more reliable signature of motor preparation than mean firing rate across trials. We compared the dynamics of the response rate and the variability in the rate across trials for area V4 neurons during the preparation of visually guided saccades. As in previous reports, we found that the mean firing rate of V4 neurons was enhanced when saccades were prepared to stimuli within a neuron's receptive field (RF) in comparison with saccades to a non-RF location. Further, we found robust decreases in response variability prior to saccades and found that these decreases predicted saccadic reaction times for saccades both to RF and non-RF stimuli. Importantly, response variability predicted reaction time whether or not there were any accompanying changes in mean firing rate. In addition to predicting saccade direction, the mean firing rate could also predict reaction time, but only for saccades directed to the RF stimuli. These results demonstrate that response variability of area V4 neurons, like mean response rate, provides a signature of saccade preparation. However, the two signatures reflect complementary aspects of that preparation.

Saccades to a remembered location elicit spatially specific activation in human retinotopic visual cortex

The possible impact upon human visual cortex from saccades to remembered target locations was investigated using functional magnetic resonance imaging (fMRI). A specific location in the upper-right or upper-left visual quadrant served as the saccadic target. After a delay of 2,400 msec, an auditory signal indicated whether to execute a saccade to that location (go trial) or to cancel the saccade and remain centrally fixated (no-go). Group fMRI analysis revealed activation specific to the remembered target location for executed saccades, in the contralateral lingual gyrus. No-go trials produced similar, albeit significantly reduced, effects. Individual retinotopic mapping confirmed that on go trials, quadrant-specific activations arose in those parts of ventral V1, V2, and V3 that coded the target location for the saccade, whereas on no-go trials, only the corresponding parts of V2 and V3 were significantly activated. These results indicate that a spatial-motor saccadic task (i.e., making an eye movement to a remembered location) is sufficient to activate retinotopic visual cortex spatially corresponding to the target location, and that this activation is also present (though reduced) when no saccade is executed. We discuss the implications of finding that saccades to remembered locations can affect early visual cortex, not just those structures conventionally associated with eye movements, in relation to recent ideas about attention, spatial working memory, and the notion that recently activated representations can be "refreshed" when needed.