Perception during double-step saccades

Compression of time in double-step saccades

Temporal intervals appear compressed at the time of saccades. Here, I asked if saccadic compression of time is related to motor planning or to saccade execution. To dissociate saccade motor planning from its execution, I used the double-step paradigm, in which subjects have to perform two horizontal saccades successively. At various times around the saccade sequence, I presented two large horizontal bars, which marked an interval lasting 100 ms. After 700 ms, a second temporal interval was presented, varying in duration across trials. Subjects were required to judge which interval appeared shorter. I found that during the first saccades in the double-step paradigm, temporal intervals were compressed. Maximum temporal compression coincided with saccade onset. Around the time of the second saccade, I found temporal compression as well, however, the time of maximum compression preceded saccade onset by about 70 ms. I compared the magnitude and time of temporal compression between double-step saccades and amplitude-matched single saccades, which I measured separately. Although I found no difference in time compression magnitude, the time when maximum compression occurred differed significantly. I conclude that the temporal shift of time compression in double-step saccades demonstrates the influence of saccade motor planning on time perception.NEW & NOTEWORTHY Visually defined temporal intervals appear compressed at the time of saccades. Here, I tested time perception during double-step saccades dissociating saccade planning from execution. Although around the time of the first saccade, peak compression was found at saccade onset, compression around the time of the second saccade peaked 70 ms before saccade onset. The results suggest that saccade motor planning influences time perception.

Visuo-motor updating in individuals with heightened autistic traits

Autism spectrum disorder (ASD) presents a range of challenges, including heightened sensory sensitivities. Here, we examine the idea that sensory overload in ASD may be linked to issues with efference copy mechanisms, which predict the sensory outcomes of self-generated actions, such as eye movements. Efference copies play a vital role in maintaining visual and motor stability. Disrupted efference copies hinder precise predictions, leading to increased reliance on actual feedback and potential distortions in perceptions across eye movements. In our first experiment, we tested how well healthy individuals with varying levels of autistic traits updated their mental map after making eye movements. We found that those with more autistic traits had difficulty using information from their eye movements to update the spatial representation of their mental map, resulting in significant errors in object localization. In the second experiment, we looked at how participants perceived an object displacement after making eye movements. Using a trans-saccadic spatial updating task, we found that those with higher autism scores exhibited a greater bias, indicating under-compensation of eye movements and a failure to maintain spatial stability during saccades. Overall, our study underscores efference copy's vital role in visuo-motor stability, aligning with Bayesian theories of autism, potentially informing interventions for improved action-perception integration in autism.

Repetition blindness in a saccadic persistence of vision display

A form of repetition blindness in visually unimpaired individuals was found for objects presented during saccades. Observers were asked to draw their percepts after making saccades across an LED strip that "painted" an image on their retinas by presenting sequential columns of a bitmap at a speed to match a 30-degree saccade. During experimental trials, repetitions of a single letter (either "A," "X," "H," or "V") were presented across saccades. Although an average of six letters were presented across each saccade, observers typically indicated perceiving only a single instance of the letter in their drawings. This inability to perceive multiple instances of a letter was not due to a limited region of attentional processing, as it only attained for multiple instances along the axis of the saccade-horizontal saccades did not affect perception of multiple letters along the vertical axis. This effect is likely due to selective suppression of visual areas during saccades.

Sound reduces saccadic chronostasis illusion

The saccadic chronostasis illusion refers to the duration overestimation of the first visual stimulation after saccadic eye movement, which is also known as "stopped clock illusion." The present study investigated whether saccadic chronostasis would be observed in the auditory modality and whether the saccade-induced time dilation in the visual modality would be reduced by a synchronously presented sound. In each trial, a unisensory visual stimulus, unisensory sound, or bimodal audio-visual stimulus with a duration of 200-800 ms (probe stimulus) was presented at the saccade target location and temporally around the offset of the saccade, followed by a unisensory visual or auditory standard stimulus for a fixed 500 ms. Participants were required to identify which of the two stimuli (probe or standard) presented in the target modality (visual or auditory) was perceived as longer. The results showed that no saccadic chronostasis was observed in the auditory modality, regardless of whether the sound was presented alone or synchronously accompanied by a visual stimulus. Interestingly, the magnitude of the saccadic chronostasis illusion was reduced by the synchronously presented sound. Moreover, the combined effect of the saccade and sound on visual time perception fits well with the standard scalar model, and the weight of the cross-modal effect was higher than that of saccadic visual time dilation. These results suggest that sound dominates vision in time processing during saccades and linearly modulates saccadic chronostasis, which follows the Scalar Expectancy Theory.

Proof of Concept of Novel Visuo-Spatial-Motor Fall Prevention Training for Old People

Falls in the geriatric population are one of the most important causes of disabilities in this age group. Its consequences impose a great deal of economic burden on health and insurance systems. This study was conducted by a multidisciplinary team with the aim of evaluating the effect of visuo-spatial-motor training for the prevention of falls in older adults. The subjects consisted of 31 volunteers aged 60 to 92 years who were studied in three groups: (1) A group under standard physical training, (2) a group under visuo-spatial-motor interventions, and (3) a control group (without any intervention). The results of the study showed that visual-spatial motor exercises significantly reduced the risk of falls of the subjects.

Transsaccadic visual perception of foveal compared to peripheral environmental changes

The maintenance of stable visual perception across eye movements is hypothesized to be aided by extraretinal information (e.g., corollary discharge [CD]). Previous studies have focused on the benefits of this information for perception at the fovea. However, there is little information on the extent that CD benefits peripheral visual perception. Here we systematically examined the extent that CD supports the ability to perceive transsaccadic changes at the fovea compared to peripheral changes. Human subjects made saccades to targets positioned at different amplitudes (4° or 8°) and directions (rightward or upward). On each trial there was a reference point located either at (fovea) or 4° away (periphery) from the target. During the saccade the target and reference disappeared and, after a blank period, the reference reappeared at a shifted location. Subjects reported the perceived shift direction, and we determined the perceptual threshold for detection and estimate of the reference location. We also simulated the detection and location if subjects solely relied on the visual error of the shifted reference experienced after the saccade. The comparison of the reference location under these two conditions showed that overall the perceptual estimate was approximately 53% more accurate and 30% less variable than estimates based solely on visual information at the fovea. These values for peripheral shifts were consistently lower than that at the fovea: 34% more accurate and 9% less variable. Overall, the results suggest that CD information does support stable visual perception in the periphery, but is consistently less beneficial compared to the fovea.

Visuomotor learning from postdictive motor error

Sensorimotor learning adapts motor output to maintain movement accuracy. For saccadic eye movements, learning also alters space perception, suggesting a dissociation between the performed saccade and its internal representation derived from corollary discharge (CD). This is critical since learning is commonly believed to be driven by CD-based visual prediction error. We estimate the internal saccade representation through pre- and trans-saccadic target localization, showing that it decouples from the actual saccade during learning. We present a model that explains motor and perceptual changes by collective plasticity of spatial target percept, motor command, and a forward dynamics model that transforms CD from motor into visuospatial coordinates. We show that learning does not follow visual prediction error but instead a postdictive update of space after saccade landing. We conclude that trans-saccadic space perception guides motor learning via CD-based postdiction of motor error under the assumption of a stable world.

Blink- and saccade-related suppression effects in early visual areas of the human brain: Intracranial EEG investigations during natural viewing conditions

Blinks and saccades, both ubiquitous in natural viewing conditions, cause rapid changes of visual inputs that are hardly consciously perceived. The neural dynamics in early visual areas of the human brain underlying this remarkable visual stability are still incompletely understood. We used electrocorticography (ECoG) from electrodes directly implanted on the human early visual areas V1, V2, V3d/v, V4d/v and the fusiform gyrus to investigate blink- and saccade-related neuronal suppression effects during non-experimental, free viewing conditions. We found a characteristic, biphasic, broadband gamma power decrease-increase pattern in all investigated visual areas. During saccades, a decrease in gamma power clearly preceded eye movement onset, at least in V1. This may indicate that cortical information processing is actively suppressed in human early visual areas before and during saccades, which then possibly mediates perceptual visual suppression. The following eye movement offset-related increase in gamma power may indicate the recovery of visual perception and the resumption of visual processing.

Object identity determines trans-saccadic integration

Humans make two to four rapid eye movements (saccades) per second, which, surprisingly, does not lead to abrupt changes in vision. To the contrary, we perceive a stable world. Hence, an important question is how information is integrated across saccades. To investigate this question, we used the sequential metacontrast paradigm (SQM), where two expanding streams of lines are presented. When one line is spatially offset, the other lines are perceived as being offset, too. When more lines are offset, all offsets integrate mandatorily; that is, observers cannot report the individual offsets but perceive one integrated offset. Here, we asked observers to make a saccade during the SQM. Even though the saccades caused a highly disrupted motion trajectory on the retina, offsets presented before and after the saccade integrated mandatorily. When observers made no saccade and the streams were displaced on the screen so that a similarly disrupted retinal image occurred as in the previous condition, no integration occurred. We suggest that trans-saccadic integration and perception are determined by object identity in spatiotopic coordinates and not by the retinal image.

The parallel programming of landing position in saccadic eye movement sequences

Saccadic eye movements occur in sequences, gathering new information about the visual environment to support successful task completion. Here, we examine the control of these saccadic sequences and specifically the extent to which the spatial aspects of the saccadic responses are programmed in parallel. We asked participants to saccade to a series of visual targets and, while they shifted their gaze around the display, we displaced select targets. We found that saccade landing position was deviated toward the previous location of the target suggesting that partial parallel programming of target location information was occurring. The saccade landing position was also affected by the new target location, which demonstrates that the saccade landing position was also partially updated following the shift. This pattern was present even for targets that were the subject of the next fixation. Having a greater preview about the sequence path influenced saccade accuracy with saccades being less affected by relocations when there is less preview information. The results demonstrate that landing positions from a saccade sequence are programmed in parallel and combined with more immediate visual signals.

The role of fixation disengagement in the parallel programming of sequences of saccades

One of the core mechanisms involved in the control of saccade responses to selected target stimuli is the disengagement from the current fixation location, so that the next saccade can be executed. To carry out everyday visual tasks, we make multiple eye movements that can be programmed in parallel. However, the role of disengagement in the parallel programming of saccades has not been examined. It is well established that the need for disengagement slows down saccadic response time. This may be important in allowing the system to program accurate eye movements and have a role to play in the control of multiple eye movements but as yet this remains untested. Here, we report two experiments that seek to examine whether fixation disengagement reduces saccade latencies when the task completion demands multiple saccade responses. A saccade contingent paradigm was employed and participants were asked to execute saccadic eye movements to a series of seven targets while manipulating when these targets were shown. This both promotes fixation disengagement and controls the extent that parallel programming can occur. We found that trial duration decreased as more targets were made available prior to fixation: this was a result both of a reduction in the number of saccades being executed and in their saccade latencies. This supports the view that even when fixation disengagement is not required, parallel programming of multiple sequential saccadic eye movements is still present. By comparison with previous published data, we demonstrate a substantial speeded of response times in these condition ("a gap effect") and that parallel programming is attenuated in these conditions.

The programming of sequences of saccades

Saccadic eye movements move the high-resolution fovea to point at regions of interest. Saccades can only be generated serially (i.e., one at a time). However, what remains unclear is the extent to which saccades are programmed in parallel (i.e., a series of such moments can be planned together) and how far ahead such planning occurs. In the current experiment, we investigate this issue with a saccade contingent preview paradigm. Participants were asked to execute saccadic eye movements in response to seven small circles presented on a screen. The extent to which participants were given prior information about target locations was varied on a trial-by-trial basis: participants were aware of the location of the next target only, the next three, five, or all seven targets. The addition of new targets to the display was made during the saccade to the next target in the sequence. The overall time taken to complete the sequence was decreased as more targets were available up to all seven targets. This was a result of a reduction in the number of saccades being executed and a reduction in their saccade latencies. Surprisingly, these results suggest that, when faced with a demand to saccade to a large number of target locations, saccade preparation about all target locations is carried out in parallel.

Eye Movement Compensation and Spatial Updating in Visual Prosthetics: Mechanisms, Limitations and Future Directions

Despite appearing automatic and effortless, perceiving the visual world is a highly complex process that depends on intact visual and oculomotor function. Understanding the mechanisms underlying spatial updating (i.e., gaze contingency) represents an important, yet unresolved issue in the fields of visual perception and cognitive neuroscience. Many questions regarding the processes involved in updating visual information as a function of the movements of the eyes are still open for research. Beyond its importance for basic research, gaze contingency represents a challenge for visual prosthetics as well. While most artificial vision studies acknowledge its importance in providing accurate visual percepts to the blind implanted patients, the majority of the current devices do not compensate for gaze position. To-date, artificial percepts to the blind population have been provided either by intraocular light-sensing circuitry or by using external cameras. While the former commonly accounts for gaze shifts, the latter requires the use of eye-tracking or similar technology in order to deliver percepts based on gaze position. Inspired by the need to overcome the hurdle of gaze contingency in artificial vision, we aim to provide a thorough overview of the research addressing the neural underpinnings of eye compensation, as well as its relevance in visual prosthetics. The present review outlines what is currently known about the mechanisms underlying spatial updating and reviews the attempts of current visual prosthetic devices to overcome the hurdle of gaze contingency. We discuss the limitations of the current devices and highlight the need to use eye-tracking methodology in order to introduce gaze-contingent information to visual prosthetics.

Vision During Saccadic Eye Movements

The perceptual consequences of eye movements are manifold: Each large saccade is accompanied by a drop of sensitivity to luminance-contrast, low-frequency stimuli, impacting both conscious vision and involuntary responses, including pupillary constrictions. They also produce transient distortions of space, time, and number, which cannot be attributed to the mere motion on the retinae. All these are signs that the visual system evokes active processes to predict and counteract the consequences of saccades. We propose that a key mechanism is the reorganization of spatiotemporal visual fields, which transiently increases the temporal and spatial uncertainty of visual representations just before and during saccades. On one hand, this accounts for the spatiotemporal distortions of visual perception; on the other hand, it implements a mechanism for fusing pre- and postsaccadic stimuli. This, together with the active suppression of motion signals, ensures the stability and continuity of our visual experience.

Interactions Elicited by the Contradiction Between Figure Direction Discrimination and Figure-Ground Segregation

Figure-ground (FG) segregation that separates an object from the rest of the image is a fundamental problem in vision science. A majority of neurons in monkey V2 showed the selectivity to border ownership (BO) that indicates which side of a contour owns the border. Although BO could be a precursor of FG segregation, the contribution of BO to FG segregation has not been clarified. Because FG segregation is the perception of the global region that belongs to an object, whereas BO determination provides the local direction of figure (DOF) along a contour, a spatial integration of BO might be expected for the generation of FG. To understand the mechanisms underlying the perception of figural regions, we investigated the interaction between the local BO determination and the global FG segregation through the quantitative analysis of the visual perception and the spatiotemporal characteristics of eye movements. We generated a set of novel stimuli in which translucency induces local DOF along the contour and global FG independently so that DOF and FG could be either consistent or contradictory. The perceptual responses showed better performance in DOF discrimination than FG segregation, supporting distinct mechanisms for the DOF discrimination and the FG segregation. We examined whether the contradiction between DOF and FG modulates the eye movement while participants judged DOF and FG. The duration of the first eye fixation was modulated by the contradiction during FG segregation but not DOF discrimination, suggesting a sequential processing from the BO determination to the FG segregation. These results of human perception and eye fixation provide important clues for understanding the visual processing for FG segregation.

All is not lost: Post-saccadic contributions to the perceptual omission of intra-saccadic streaks

Saccades rapidly jerk the eye into new positions, yet we rarely experience the motion streaks imposed on the retinal image. Here we examined spatial and temporal properties of post-saccadic masking-one potential explanation of this perceptual omission. Observers judged the motion direction of a target stimulus, a Gaussian blob, that moved vertically upwards or downwards and then back to its initial position, just as observers made a saccade. We manipulated the onset and offset of the target and of distractors in various spatial relations to the target, and assessed their effect on performance and subjective confidence. Although the presence of the target after the saccade caused the strongest omission, the offset of spatially distant distractor stimuli upon saccade offset also impaired performance. The temporal properties of these two separate effects suggest that, in addition to masking, an independent effect of attentional distraction further accentuates perceptual omission of intra-saccadic motion streaks.