Saccade-related activity in areas 18 and 21a of cats freely viewing complex scenes

Distinct fMRI Responses to Self-Induced versus Stimulus Motion during Free Viewing in the Macaque

Visual motion responses in the brain are shaped by two distinct sources: the physical movement of objects in the environment and motion resulting from one's own actions. The latter source, termed visual reafference, stems from movements of the head and body, and in primates from the frequent saccadic eye movements that mark natural vision. To study the relative contribution of reafferent and stimulus motion during natural vision, we measured fMRI activity in the brains of two macaques as they freely viewed >50 hours of naturalistic video footage depicting dynamic social interactions. We used eye movements obtained during scanning to estimate the level of reafferent retinal motion at each moment in time. We also estimated the net stimulus motion by analyzing the video content during the same time periods. Mapping the responses to these distinct sources of retinal motion, we found a striking dissociation in the distribution of visual responses throughout the brain. Reafferent motion drove fMRI activity in the early retinotopic areas V1, V2, V3, and V4, particularly in their central visual field representations, as well as lateral aspects of the caudal inferotemporal cortex (area TEO). However, stimulus motion dominated fMRI responses in the superior temporal sulcus, including areas MT, MST, and FST as well as more rostral areas. We discuss this pronounced separation of motion processing in the context of natural vision, saccadic suppression, and the brain's utilization of corollary discharge signals.

SIGNIFICANCE STATEMENT

Visual motion arises not only from events in the external world, but also from the movements of the observer. For example, even if objects are stationary in the world, the act of walking through a room or shifting one's eyes causes motion on the retina. This "reafferent" motion propagates into the brain as signals that must be interpreted in the context of real object motion. The delineation of whole-brain responses to stimulus versus self-generated retinal motion signals is critical for understanding visual perception and is of pragmatic importance given the increasing use of naturalistic viewing paradigms. The present study uses fMRI to demonstrate that the brain exhibits a fundamentally different pattern of responses to these two sources of retinal motion.

(Micro)Saccades, corollary activity and cortical oscillations

In natural vision, attention and eye movements are linked. Furthermore, eye movements structure the inflow of information into the visual system. Saccades, where little vision occurs, alternate with fixations, when most vision occurs. A mechanism must be in place to maximize information intake during fixations. Oscillatory synchrony has been proposed as a mechanism for rapid and reliable communication of signals, subserving cognitive functions such as attention and object identification. We propose that saccade-related corollary activity has a crucial role in anticipatory preparation of visual centers, which interacts with ongoing oscillation, favoring the processing of postfixational signals. During prolonged fixations, microsaccades could be generated to exploit this mechanism. Studying this interplay between the sensory and the motor system will provide novel insight into the dynamics of natural vision.

Changes in orientation discrimination at the time of saccadic eye movements

Perceptual performance has been known to change around the time of saccadic eye movement. In the current study, we measured the accuracy and sensitivity of orientation discrimination of bar stimuli presented during fixation and before saccadic eye movements. Human participants compared the orientations of the test and reference bar stimuli with the head erect in a two-interval forced choice task. For the targets presented during steady fixation, the accuracy and sensitivity of orientation discrimination were better near the cardinal than oblique axes, a perceptual anisotropy known as the oblique effect. For the targets presented during the 100 ms interval immediately before a saccade was executed, the anisotropy decreased mainly due to reduction in sensitivity for cardinal orientations. Directing attention to the goal location of the impending saccade emulated the saccadic effects on orientation discrimination for the targets at saccadic goal, suggesting that the saccadic effects on orientation discrimination are partly mediated by the shift of spatial attention that accompanies the saccade. These results were in line with the anti-oblique effect that perceptual judgment of motion direction along the oblique angle becomes relatively accurate for motion targets presented before saccadic eye movements [Lee, J., & Lee, C. (2005). Changes in visual motion perception before saccadic eye movements. Vision Research, 45(11), 1447-1457].

Macaque V1 activity during natural vision: effects of natural scenes and saccades

In the present study, we examined the way that scene complexity and saccades combine to sculpt the temporal response patterns of V1 neurons. To bridge the gap between conventional and free viewing experiments, we compared responses of neurons across four paradigms ranging from less to more natural. An optimal bar stimulus was either flashed into a receptive field (RF) or brought into it via saccade and was embedded in either a natural scene or a uniform gray background. Responses to a flashed bar tended to be higher with a uniform rather than natural background. The most novel result reported here is that responses evoked by stimuli brought into the RF via saccades were enhanced compared with the same stimuli flashed during steady fixation. No single factor appears to account entirely for this surprising effect, but there were small contributions from fixational saccades and residual activity carried over from the previous fixation. We also found a negative correlation with cells' response "history" in that a larger response on one fixation was associated with a lower response on the subsequent fixation. The effects of the natural background and saccades exhibited a significant nonlinear interaction with the suppressive effects of the natural background less for stimuli entering RFs with saccades. Together, these results suggest that even responses to standard optimal stimuli are difficult to predict under conditions similar to natural vision, and further demonstrate the importance of naturalistic experimental paradigms to the study of visual processing in V1.