The allocation of attention during smooth pursuit eye movements

Gaze and attention: Mechanisms underlying the therapeutic effect of optokinetic stimulation in spatial neglect

Left smooth pursuit eye movement training in response to large-field visual motion (optokinetic stimulation) has become a promising rehabilitation method in left spatial inattention or neglect. The mechanisms underlying the therapeutic effect, however, remain unknown. During optokinetic stimulation, there is an error in visual localisation ahead of the line of sight. This could indicate a change in the brain's estimate of one's own direction of gaze. We hypothesized that optokinetic stimulation changes the brain's estimate of gaze. Because this estimate is critical for coding the locus of attention in the visual space relative to the body and across sensory modalities, its change might underlie the change in spatial attention. Here, we report that in healthy participants optokinetic stimulation causes not only a directional bias in the proprioceptive signal from the extraocular muscles, but also a corresponding shift of the locus of attention. Both changes outlasted the period of stimulation. This result forms a step in investigating a causal link between the adaptation in the sensorimotor gaze signals and the recovery in spatial neglect.

A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception

Due to the close relationship between oculomotor behavior and visual processing, eye movements have been studied in many different areas of research over the last few decades. While these studies have brought interesting insights, specialization within each research area comes at the potential cost of a narrow and isolated view of the oculomotor system. In this review, we want to expand this perspective by looking at the interactions between the two most important types of voluntary eye movements: saccades and pursuit. Recent evidence indicates multiple interactions and shared signals at the behavioral and neurophysiological level for oculomotor control and for visual perception during pursuit and saccades. Oculomotor control seems to be based on shared position- and velocity-related information, which leads to multiple behavioral interactions and synergies. The distinction between position- and velocity-related information seems to be also present at the neurophysiological level. In addition, visual perception seems to be based on shared efferent signals about upcoming eye positions and velocities, which are to some degree independent of the actual oculomotor response. This review suggests an interactive perspective on the oculomotor system, based mainly on different types of sensory input, and less so on separate subsystems for saccadic or pursuit eye movements.

Replicability and reliability of the background and target velocity effects in smooth pursuit eye movements

When we follow a slowly moving target with our eyes, we perform smooth pursuit eye movements (SPEM). Previous investigations point to significantly and robustly reduced SPEM performance in the presence of a stationary background and at higher compared to lower target velocities. However, the reliability of these background and target velocity effects has not yet been investigated systematically. To address this issue, 45 healthy participants (17 m, 28 f) took part in two experimental sessions 7 days apart. In each session, participants were instructed to follow a horizontal SPEM target moving sinusoidally between ±7.89° at three different target velocities, corresponding to frequencies of 0.2, 0.4 and 0.6 Hz. Each target velocity was presented once with and once without a stationary background, resulting in six blocks. The blocks were presented twice per session in order to additionally explore potential task length effects. To assess SPEM performance, velocity gain was calculated as the ratio of eye to target velocity. In line with previous research, detrimental background and target velocity effects were replicated robustly in both sessions with large effect sizes. Good to excellent test-retest reliabilities were obtained at higher target velocities and in the presence of a stationary background, whereas lower reliabilities occurred with slower targets and in the absence of background stimuli. Target velocity and background effects resulted in largely good to excellent reliabilities. These findings not only replicated robust experimental effects of background and target velocity at group level, but also revealed that these effects can be translated into reliable individual difference measures.

A review of interactions between peripheral and foveal vision

Visual processing varies dramatically across the visual field. These differences start in the retina and continue all the way to the visual cortex. Despite these differences in processing, the perceptual experience of humans is remarkably stable and continuous across the visual field. Research in the last decade has shown that processing in peripheral and foveal vision is not independent, but is more directly connected than previously thought. We address three core questions on how peripheral and foveal vision interact, and review recent findings on potentially related phenomena that could provide answers to these questions. First, how is the processing of peripheral and foveal signals related during fixation? Peripheral signals seem to be processed in foveal retinotopic areas to facilitate peripheral object recognition, and foveal information seems to be extrapolated toward the periphery to generate a homogeneous representation of the environment. Second, how are peripheral and foveal signals re-calibrated? Transsaccadic changes in object features lead to a reduction in the discrepancy between peripheral and foveal appearance. Third, how is peripheral and foveal information stitched together across saccades? Peripheral and foveal signals are integrated across saccadic eye movements to average percepts and to reduce uncertainty. Together, these findings illustrate that peripheral and foveal processing are closely connected, mastering the compromise between a large peripheral visual field and high resolution at the fovea.

Visual selective attention and the control of tracking eye movements: a critical review

People’s eyes are directed at objects of interest with the aim of acquiring visual information. However, processing this information is constrained in capacity, requiring task-driven and salience-driven attentional mechanisms to select few among the many available objects. A wealth of behavioral and neurophysiological evidence has demonstrated that visual selection and the motor selection of saccade targets rely on shared mechanisms. This coupling supports the premotor theory of visual attention put forth more than 30 years ago, postulating visual selection as a necessary stage in motor selection. In this review, we examine to which extent the coupling of visual and motor selection observed with saccades is replicated during ocular tracking. Ocular tracking combines catch-up saccades and smooth pursuit to foveate a moving object. We find evidence that ocular tracking requires visual selection of the speed and direction of the moving target, but the position of the motion signal may not coincide with the position of the pursuit target. Further, visual and motor selection can be spatially decoupled when pursuit is initiated (open-loop pursuit). We propose that a main function of coupled visual and motor selection is to serve the coordination of catch-up saccades and pursuit eye movements. A simple race-to-threshold model is proposed to explain the variable coupling of visual selection during pursuit, catch-up and regular saccades, while generating testable predictions. We discuss pending issues, such as disentangling visual selection from preattentive visual processing and response selection, and the pinpointing of visual selection mechanisms, which have begun to be addressed in the neurophysiological literature.

In pursuit of visual attention: SSVEP frequency-tagging moving targets

Previous research has shown that visual attention does not always exactly follow gaze direction, leading to the concepts of overt and covert attention. However, it is not yet clear how such covert shifts of visual attention to peripheral regions impact the processing of the targets we directly foveate as they move in our visual field. The current study utilised the co-registration of eye-position and EEG recordings while participants tracked moving targets that were embedded with a 30 Hz frequency tag in a Steady State Visually Evoked Potentials (SSVEP) paradigm. When the task required attention to be divided between the moving target (overt attention) and a peripheral region where a second target might appear (covert attention), the SSVEPs elicited by the tracked target at the 30 Hz frequency band were significantly, but transiently, lower than when participants did not have to covertly monitor for a second target. Our findings suggest that neural responses of overt attention are only briefly reduced when attention is divided between covert and overt areas. This neural evidence is in line with theoretical accounts describing attention as a pool of finite resources, such as the perceptual load theory. Altogether, these results have practical implications for many real-world situations where covert shifts of attention may discretely reduce visual processing of objects even when they are directly being tracked with the eyes.

Facilitating sensorimotor integration via blocked practice underpins imitation learning of atypical biological kinematics in autism spectrum disorder

The reduced efficacy of voluntary imitation in autism is suggested to be underpinned by differences in sensorimotor processing. We examined whether the imitation of novel atypical biological kinematics by autistic adults is enhanced by imitating a model in a predictable blocked practice trial order. This practice structure is expected to facilitate trial-to-trial sensorimotor processing, integration and encoding of biological kinematics. The results showed that neurotypical participants were generally more effective at imitating the biological kinematics across all experimental phases. Importantly, and compared to a pre-test where imitation was performed in a randomised (unpredictable) trial order, the autistic participants learned to imitate the atypical kinematics more effectively following an acquisition phase of repeatedly imitating the same model during blocked practice. Data from the post-test showed that autistic participants remained effective at imitating the atypical biological kinematics when the models were subsequently presented in a randomised trial order. These findings show that the reduced efficacy of voluntary imitation in autism can be enhanced during learning by facilitating trial-to-trial processing and integration of sensorimotor information using blocked practice.

Effects of nicotine on smooth pursuit eye movements in healthy non-smokers

RATIONALE

The non-selective nicotinic acetylcholine receptor (nAChR) agonist nicotine has been argued to improve attention via enhanced filtering of irrelevant stimuli. Here, we tested this hypothesis in the context of smooth pursuit eye movements (SPEMs), an oculomotor function previously shown to improve with nicotine in some but not all studies.

OBJECTIVES

In order to test whether nicotine improves performance particularly when the inhibition of distracting stimuli is required, SPEM was elicited in conditions with or without peripheral distractors. Additionally, different target frequencies were employed in order to parametrically vary general processing demands on the SPEM system.

METHODS

Healthy adult non-smokers (N = 18 females, N = 13 males) completed a horizontal sinusoidal SPEM task at different target frequencies (0.2 Hz, 0.4 Hz, 0.6 Hz) in the presence or absence of peripheral distractors in a double-blind, placebo-controlled, cross-over design using a 2 mg nicotine gum.

RESULTS

Nicotine increased peak pursuit gain relative to placebo (p < .001), but an interaction with distractor condition (p = .001) indicated that this effect was most pronounced in the presence of distractors. Catch-up saccade frequency was reduced by nicotine (p = .01), particularly at higher target frequencies (two-way interaction, p = .04). However, a three-way interaction (p = .006) indicated that the reduction with nicotine was strongest at the highest target frequency (0.6 Hz) only without distractors, whereas in the presence of distractors, it was strongest at 0.4-Hz target frequency. There were no effects of nicotine on subjective state measures.

CONCLUSIONS

Together, these findings support a role of both distractor inhibition and general processing load in the effects of nicotine on smooth pursuit.

The effect of food type on the portion size effect in children aged 2-12 years: A systematic review and meta-analysis

Visual cues such as plate size, amount of food served and packaging are known to influence the effects of portion size on food intake. Unit bias is a well characterised heuristic and helps to determine consumption norms. In an obesogenic environment where large portions are common place, the unit or segmentation bias may be overridden promoting overconsumption of both amorphous or unit foods. The aim of this review was to investigate the impact of offering unit or amorphous food on the portion size effect (PSE) in children aged 2-12 years. A systematic search for literature was conducted in Medline, PsycInfo and Web of Science in February 2018. A total of 1197 papers were retrieved following the searches. Twenty-one papers were included in the systematic review, of which 15 provided requisite statistical information for inclusion in a random effects meta-analysis. Increasing children's food portion size by 51-100% led to a significant increase in intake (SMD = 0.47, 95% CI: 0.39-0.55). There was no evidence to suggest that increases in consumption were related to food type (p = 0.33), child age (p = 0.47) or initial portion size served (p=0.14). Residual heterogeneity was not significant (p=0.24). The PSE was demonstrated in children aged 2-12 years when offered both unit and amorphous food items. The effect was not restricted by food type, child age or influenced by initial portion size served. Of the studies included in the meta-analysis between study heterogeneity was low suggesting minimal variation in treatment effects between studies, however, more research is required to understand the mechanisms of the PSE in preschool children. Future research should determine feasible methods to downsize portion sizes served to children.

Visualization and quantification of eye tracking data for the evaluation of oculomotor function

Oculomotor dysfunction may originate from physical, physiological or psychological causes and may be a marker for schizophrenia or other disorders. Observational tests for oculomotor dysfunction are easy to administer, but are subjective and transient, and it is difficult to quantify deviations. To date, video-based eye tracking systems have not provided a contextual overview of gaze data that integrates the eye video recording with the stimulus and gaze data together with quantitative feedback of metrics in relation to typical values. A system was developed with an interactive timeline to allow the analyst to scroll through a recording frame-by-frame while comparing data from three different sources. The visual and integrated nature of the analysis allows localisation and quantification of saccadic under- and overshoots as well as determination of the frequency and amplitude of catch-up and anticipatory saccades. Clinicians will be able to apply their expertise to diagnose disorders based on abnormal patterns in the gaze plots. They can use the line charts to quantify deviations from benchmark values for reaction time, saccadic accuracy and smooth pursuit gain. A clinician can refer to the eye video at any time to confirm that observed deviations originated from gaze behaviour and not from systemic errors.

Asymmetrical time-to-contact error with two moving objects persists across different vertical separations

When human observers estimate the time-to-contact (TTC) of more than one object there is an asymmetric pattern of error consistent with prioritizing the lead object at the expense of the trail object. Here, we examined TTC estimation in a prediction motion task where two objects moved along horizontal trajectories (5 or 7.5 °/s) that had different vertical separation, and thus placed specific demands on visuospatial attention. Results showed that participants were able to accurately judge arrival order, irrespective of vertical separation, in all but two conditions where the object trajectories crossed close to the arrival location. Constant error was significantly higher for the object that trailed, as opposed to led, by 250 or 500 ms. Asymmetry in constant error between the lead and trail object was not influenced by vertical separation, and was also evident across a range of arrival times. However, while the lag between the two consecutive TTC estimations was scaled to the actual difference in object arrival times, lag did increase with vertical separation. Taken together, our results confirm that TTC estimation of two moving objects in the prediction motion task suffers from an asymmetrical interference, which is likely related to factors that influence attentional allocation.

Using Smooth Pursuit Calibration for Difficult-to-Calibrate Participants

Although the 45-dots calibration routine of a previous study ( 2) provided very good accuracy, it requires intense mental effort and the routine proved to be unsuccessful for young children who struggle to maintain concentration. The calibration procedures that are normally used for difficult-to-calibrate participants, such as autistic children and infants, do not suffice since they are not accurate enough and the reliability of research results might be jeopardised. Smooth pursuit has been used before for calibration and is applied in this paper as an alternative routine for participants who are difficult to calibrate with conventional routines. Gaze data is captured at regular intervals and many calibration targets are generated while the eyes are following a moving target. The procedure could take anything between 30 s and 60 s to complete, but since an interesting target and/or a conscious task may be used, participants are assisted to maintain concentration. It was proven that the accuracy that can be attained through calibration with a moving target along an even horizontal path is not significantly worse than the accura-cy that can be attained with a standard method of watching dots appearing in random order. The routine was applied successfully for a group of children with ADD, ADHD and learning abilities. This result is important as it provides for easier calibration - especially in the case of participants who struggle to keep their gaze focused and stable on a stationary target for long enough.

Interference between smooth pursuit and color working memory

Spatial working memory (WM) and spatial attention are closely related, but the relationship between non-spatial WM and spatial attention still remains unclear. The present study aimed to investigate the interaction between color WM and smooth pursuit eye movements. A modified delayed-match-to-sample paradigm (DMS) was applied with 2 or 4 items presented in each visual field. Subjects memorized the colors of items in the cued visual field and smoothly moved eyes towards or away from memorized items during retention interval despite that the colored items were no longer visible. The WM performance decreased with higher load in general. More importantly, the WM performance was better when subjects pursued towards rather than away from the cued visual field. Meanwhile, the pursuit gain decreased with higher load and demonstrated a higher result when pursuing away from the cued visual field. These results indicated that spatial attention, guiding attention to the memorized items, benefits color WM. Therefore, we propose that a competition for attention resources exists between color WM and smooth pursuit eye movements.

Neural correlate of spatial (mis-)localization during smooth eye movements

The dependence of neuronal discharge on the position of the eyes in the orbit is a functional characteristic of many visual cortical areas of the macaque. It has been suggested that these eye-position signals provide relevant information for a coordinate transformation of visual signals into a non-eye-centered frame of reference. This transformation could be an integral part for achieving visual perceptual stability across eye movements. Previous studies demonstrated close to veridical eye-position decoding during stable fixation as well as characteristic erroneous decoding across saccadic eye-movements. Here we aimed to decode eye position during smooth pursuit. We recorded neural activity in macaque area VIP during steady fixation, saccades and smooth-pursuit and investigated the temporal and spatial accuracy of eye position as decoded from the neuronal discharges. Confirming previous results, the activity of the majority of neurons depended linearly on horizontal and vertical eye position. The application of a previously introduced computational approach (isofrequency decoding) allowed eye position decoding with considerable accuracy during steady fixation. We applied the same decoder on the activity of the same neurons during smooth-pursuit. On average, the decoded signal was leading the current eye position. A model combining this constant lead of the decoded eye position with a previously described attentional bias ahead of the pursuit target describes the asymmetric mislocalization pattern for briefly flashed stimuli during smooth pursuit eye movements as found in human behavioral studies.

A geometric method for computing ocular kinematics and classifying gaze events using monocular remote eye tracking in a robotic environment

BACKGROUND

Robotic and virtual-reality systems offer tremendous potential for improving assessment and rehabilitation of neurological disorders affecting the upper extremity. A key feature of these systems is that visual stimuli are often presented within the same workspace as the hands (i.e., peripersonal space). Integrating video-based remote eye tracking with robotic and virtual-reality systems can provide an additional tool for investigating how cognitive processes influence visuomotor learning and rehabilitation of the upper extremity. However, remote eye tracking systems typically compute ocular kinematics by assuming eye movements are made in a plane with constant depth (e.g. frontal plane). When visual stimuli are presented at variable depths (e.g. transverse plane), eye movements have a vergence component that may influence reliable detection of gaze events (fixations, smooth pursuits and saccades). To our knowledge, there are no available methods to classify gaze events in the transverse plane for monocular remote eye tracking systems. Here we present a geometrical method to compute ocular kinematics from a monocular remote eye tracking system when visual stimuli are presented in the transverse plane. We then use the obtained kinematics to compute velocity-based thresholds that allow us to accurately identify onsets and offsets of fixations, saccades and smooth pursuits. Finally, we validate our algorithm by comparing the gaze events computed by the algorithm with those obtained from the eye-tracking software and manual digitization.

RESULTS

Within the transverse plane, our algorithm reliably differentiates saccades from fixations (static visual stimuli) and smooth pursuits from saccades and fixations when visual stimuli are dynamic.

CONCLUSIONS

The proposed methods provide advancements for examining eye movements in robotic and virtual-reality systems. Our methods can also be used with other video-based or tablet-based systems in which eye movements are performed in a peripersonal plane with variable depth.

Covert enaction at work: Recording the continuous movements of visuospatial attention to visible or imagined targets by means of Steady-State Visual Evoked Potentials (SSVEPs)

Whereas overt visuospatial attention is customarily measured with eye tracking, covert attention is assessed by various methods. Here we exploited Steady-State Visual Evoked Potentials (SSVEPs) - the oscillatory responses of the visual cortex to incoming flickering stimuli - to record the movements of covert visuospatial attention in a way operatively similar to eye tracking (attention tracking), which allowed us to compare motion observation and motion extrapolation with and without eye movements. Observers fixated a central dot and covertly tracked a target oscillating horizontally and sinusoidally. In the background, the left and the right halves of the screen flickered at two different frequencies, generating two SSVEPs in occipital regions whose size varied reciprocally as observers attended to the moving target. The two signals were combined into a single quantity that was modulated at the target frequency in a quasi-sinusoidal way, often clearly visible in single trials. The modulation continued almost unchanged when the target was switched off and observers mentally extrapolated its motion in imagery, and also when observers pointed their finger at the moving target during covert tracking, or imagined doing so. The amplitude of modulation during covert tracking was ∼25-30% of that measured when observers followed the target with their eyes. We used 4 electrodes in parieto-occipital areas, but similar results were achieved with a single electrode in Oz. In a second experiment we tested ramp and step motion. During overt tracking, SSVEPs were remarkably accurate, showing both saccadic-like and smooth pursuit-like modulations of cortical responsiveness, although during covert tracking the modulation deteriorated. Covert tracking was better with sinusoidal motion than ramp motion, and better with moving targets than stationary ones. The clear modulation of cortical responsiveness recorded during both overt and covert tracking, identical for motion observation and motion extrapolation, suggests to include covert attention movements in enactive theories of mental imagery.

Allocation of attention during pursuit of large objects is no different than during fixation

Attention allocation during pursuit of a spot is usually characterized as asymmetric with more attention placed ahead of the target than behind it. However, attention is symmetrically allocated across larger pursuit stimuli. An unresolved issue is how tightly attention is constrained on large stimuli during pursuit. Although some work shows it is tightly locked to the fovea, other work shows it is allocated flexibly. To investigate this, we had observers perform a character identification task on large pursuit stimuli composed of arrays of five, nine, or 15 characters spaced between 0.6° and 4.0° apart. Initially, the characters were identical, but at a random time, they all changed briefly, rendering one of them unique. Observers identified the unique character. Consistent with previous literature, attention appeared narrow and symmetric around the pursuit target for tightly spaced (0.6°) characters. Increasing spacing dramatically expanded the attention scope, presumably by mitigating crowding. However, when we controlled for crowding, performance was limited by set size, suffering more for eccentric targets. Interestingly, the same limitations on attention allocation were observed with stationary and pursued stimuli-evidence that attention operates similarly during fixation and pursuit of a stimulus that extends into the periphery. The results suggest that attention is flexibly allocated during pursuit, but performance is limited by crowding and set size. In addition, performing the identification task did not hurt pursuit performance, further evidence that pursuit of large stimuli is relatively inattentive.

Individual differences in oscillatory brain activity in response to varying attentional demands during a word recall and oculomotor dual task

Every day, we face situations that involve multi-tasking. How our brain utilizes cortical resources during multi-tasking is one of many interesting research topics. In this study, we tested whether a dual-task can be differentiated in the neural and behavioral responses of healthy subjects with varying degree of working memory capacity (WMC). We combined word recall and oculomotor tasks because they incorporate common neural networks including the fronto-parietal (FP) network. Three different types of oculomotor tasks (eye fixation, Fix-EM; predictive and random smooth pursuit eye movement, P-SPEM and R-SPEM) were combined with two memory load levels (low-load: five words, high-load: 10 words) for a word recall task. Each of those dual-task combinations was supposed to create varying cognitive loads on the FP network. We hypothesize that each dual-task requires different cognitive strategies for allocating the brain's limited cortical resources and affects brain oscillation of the FP network. In addition, we hypothesized that groups with different WMC will show differential neural and behavioral responses. We measured oscillatory brain activity with simultaneous MEG and EEG recordings and behavioral performance by word recall. Prominent frontal midline (FM) theta (4-6 Hz) synchronization emerged in the EEG of the high-WMC group experiencing R-SPEM with high-load conditions during the early phase of the word maintenance period. Conversely, significant parietal upper alpha (10-12 Hz) desynchronization was observed in the EEG and MEG of the low-WMC group experiencing P-SPEM under high-load conditions during the same period. Different brain oscillatory patterns seem to depend on each individual's WMC and varying attentional demands from different dual-task combinations. These findings suggest that specific brain oscillations may reflect different strategies for allocating cortical resources during combined word recall and oculomotor dual-tasks.

Attentional trade-offs maintain the tracking of moving objects across saccades

In many situations like playing sports or driving a car, we keep track of moving objects, despite the frequent eye movements that drastically interrupt their retinal motion trajectory. Here we report evidence that transsaccadic tracking relies on trade-offs of attentional resources from a tracked object's motion path to its remapped location. While participants covertly tracked a moving object, we presented pulses of coherent motion at different locations to probe the allocation of spatial attention along the object's entire motion path. Changes in the sensitivity for these pulses showed that during fixation attention shifted smoothly in anticipation of the tracked object's displacement. However, just before a saccade, attentional resources were withdrawn from the object's current motion path and reflexively drawn to the retinal location the object would have after saccade. This finding demonstrates the predictive choice the visual system makes to maintain the tracking of moving objects across saccades.

Visual selective attention is impaired in children prenatally exposed to opioid agonist medication

AIMS

To examine whether prenatal exposure to opioid agonist medication is associated with visual selective attention and general attention problems in early childhood.

METHOD

Twenty-two children (mean age = 52.17 months, SD = 1.81) prenatally exposed to methadone, 9 children (mean age = 52.41 months, SD = 1.42) prenatally exposed to buprenorphine and 25 nonexposed comparison children (mean age = 51.44 months, SD = 1.31) were tested. Visual selective attention was measured with a Tobii 1750 Eye Tracker using a spatial negative priming paradigm. Attention problems were measured using the Child Behavior Checklist.

RESULTS

The comparison group demonstrated a larger spatial negative priming effect (mean = 23.50, SD = 45.50) than the exposed group [mean = -6.84, SD = 86.39, F(1,50) = 5.91, p = 0.019, η(2) = 0.11]. No difference in reported attention problems was found [F(1,51) = 1.63, p = 0.21, η(2) = 0.03]. Neonatal abstinence syndrome and prenatal exposure to marijuana were found to predict slower saccade latencies in the exposed group (b = 54.55, SE = 23.56, p = 0.03 and b = 88.86, SE = 32.07, p = 0.01, respectively).

CONCLUSION

Although exposed children did not appear to have attention deficits in daily life, lower performance on the SNP task indicates subtle alteration in the attention system.

A P300-based brain-computer interface with stimuli on moving objects: four-session single-trial and triple-trial tests with a game-like task design

Brain-computer interfaces (BCIs) are tools for controlling computers and other devices without using muscular activity, employing user-controlled variations in signals recorded from the user's brain. One of the most efficient noninvasive BCIs is based on the P300 wave of the brain's response to stimuli and is therefore referred to as the P300 BCI. Many modifications of this BCI have been proposed to further improve the BCI's characteristics or to better adapt the BCI to various applications. However, in the original P300 BCI and in all of its modifications, the spatial positions of stimuli were fixed relative to each other, which can impose constraints on designing applications controlled by this BCI. We designed and tested a P300 BCI with stimuli presented on objects that were freely moving on a screen at a speed of 5.4°/s. Healthy participants practiced a game-like task with this BCI in either single-trial or triple-trial mode within four sessions. At each step, the participants were required to select one of nine moving objects. The mean online accuracy of BCI-based selection was 81% in the triple-trial mode and 65% in the single-trial mode. A relatively high P300 amplitude was observed in response to targets in most participants. Self-rated interest in the task was high and stable over the four sessions (the medians in the 1st/4th sessions were 79/84% and 76/71% in the groups practicing in the single-trial and triple-trial modes, respectively). We conclude that the movement of stimulus positions relative to each other may not prevent the efficient use of the P300 BCI by people controlling their gaze, e.g., in robotic devices and in video games.

Dynamic visuomotor synchronization: quantification of predictive timing

When a moving target is tracked visually, spatial and temporal predictions are used to circumvent the neural delay required for the visuomotor processing. In particular, the internally generated predictions must be synchronized with the external stimulus during continuous tracking. We examined the utility of a circular visual-tracking paradigm for assessment of predictive timing, using normal human subjects. Disruptions of gaze–target synchronization were associated with anticipatory saccades that caused the gaze to be temporarily ahead of the target along the circular trajectory. These anticipatory saccades indicated preserved spatial prediction but suggested impaired predictive timing. We quantified gaze–target synchronization with several indices, whose distributions across subjects were such that instances of extremely poor performance were identifiable outside the margin of error determined by test–retest measures. Because predictive timing is an important element of attention functioning, the visual-tracking paradigm and dynamic synchronization indices described here may be useful for attention assessment.

Kinematic property of target motion conditions gaze behavior and eye-hand synergy during manual tracking

This study investigated how frequency demand and motion feedback influenced composite ocular movements and eye-hand synergy during manual tracking. Fourteen volunteers conducted slow and fast force-tracking in which targets were displayed in either line-mode or wave-mode to guide manual tracking with target movement of direct position or velocity nature. The results showed that eye-hand synergy was a selective response of spatiotemporal coupling conditional on target rate and feedback mode. Slow and line-mode tracking exhibited stronger eye-hand coupling than fast and wave-mode tracking. Both eye movement and manual action led the target signal during fast-tracking, while the latency of ocular navigation during slow-tracking depended on the feedback mode. Slow-tracking resulted in more saccadic responses and larger pursuit gains than fast-tracking. Line-mode tracking led to larger pursuit gains but fewer and shorter gaze fixations than wave-mode tracking. During slow-tracking, incidences of saccade and gaze fixation fluctuated across a target cycle, peaking at velocity maximum and the maximal curvature of target displacement, respectively. For line-mode tracking, the incidence of smooth pursuit was phase-dependent, peaking at velocity maximum as well. Manual behavior of slow or line-mode tracking was better predicted by composite eye movements than that of fast or wave-mode tracking. In conclusion, manual tracking relied on versatile visual strategies to perceive target movements of different kinematic properties, which suggested a flexible coordinative control for the ocular and manual sensorimotor systems.

Shared attention for smooth pursuit and saccades

Identification of brief luminance decrements on parafoveal stimuli presented during smooth pursuit improves when a spot pursuit target is surrounded by a larger random dot cinematogram (RDC) that moves with it (Heinen, Jin, & Watamaniuk, 2011). This was hypothesized to occur because the RDC provided an alternative, less attention-demanding pursuit drive, and therefore released attentional resources for visual perception tasks that are shared with those used to pursue the spot. Here, we used the RDC as a tool to probe whether spot pursuit also shares attentional resources with the saccadic system. To this end, we set out to determine if the RDC could release attention from pursuit of the spot to perform a saccade task. Observers made a saccade to one of four parafoveal targets that moved with the spot pursuit stimulus. The targets either moved alone or were surrounded by an RDC (100% coherence). Saccade latency decreased with the RDC, suggesting that the RDC released attention needed to pursue the spot, which was then used for the saccade task. Additional evidence that attention was released by the RDC was obtained in an experiment in which attention was anchored to the fovea by requiring observers to detect a brief color change applied 130 ms before the saccade target appeared. This manipulation eliminated the RDC advantage. The results imply that attentional resources used by the pursuit and saccadic eye movement control systems are shared.

Neural dynamics of saccadic and smooth pursuit eye movement coordination during visual tracking of unpredictably moving targets

How does the brain coordinate saccadic and smooth pursuit eye movements to track objects that move in unpredictable directions and speeds? Saccadic eye movements rapidly foveate peripheral visual or auditory targets, and smooth pursuit eye movements keep the fovea pointed toward an attended moving target. Analyses of tracking data in monkeys and humans reveal systematic deviations from predictions of the simplest model of saccade-pursuit interactions, which would use no interactions other than common target selection and recruitment of shared motoneurons. Instead, saccadic and smooth pursuit movements cooperate to cancel errors of gaze position and velocity, and thus to maximize target visibility through time. How are these two systems coordinated to promote visual localization and identification of moving targets? How are saccades calibrated to correctly foveate a target despite its continued motion during the saccade? The neural model proposed here answers these questions. Modeled interactions encompass motion processing areas MT, MST, FPA, DLPN and NRTP; saccade planning and execution areas FEF, LIP, and SC; the saccadic generator in the brain stem; and the cerebellum. Simulations illustrate the model's ability to functionally explain and quantitatively simulate anatomical, neurophysiological and behavioral data about coordinated saccade-pursuit tracking.

Flexibility of foveal attention during ocular pursuit

Smooth pursuit of natural objects requires flexible allocation of attention to inspect features. However, it has been reported that attention is focused at the fovea during pursuit. We ask here if foveal attention is obligatory during pursuit, or if it can be disengaged. Observers tracked a stimulus composed of a central dot surrounded by four others and identified one of the dots when it dimmed. Extinguishing the center dot before the dimming improved task performance, suggesting that attention was released from it. To determine if the center dot automatically usurped attention, we provided the pursuit system with an alternative sensory signal by adding peripheral motion that moved with the stimulus. This also improved identification performance, evidence that a central target does not necessarily require attention during pursuit. Identification performance at the central dot also improved, suggesting that the spatial extent of the background did not attract attention to the periphery; instead, peripheral motion freed pursuit attention from the central dot, affording better identification performance. The results show that attention can be flexibly allocated during pursuit and imply that attention resources for pursuit of small and large objects come from different sources.

Motion-induced positional biases in the flash-lag configuration

When both stationary and moving objects are present in the visual field, localizing objects in space may become difficult, as shown by illusory phenomena such as the Fröhlich effect and the flash-lag effect. Despite the efforts to decipher how motion and position information are combined to form a coherent visual representation, a unitary picture is still lacking. In the flash-lag effect, a flash presented in alignment with a moving stimulus is perceived to lag behind it. We investigated whether this relative spatial localization (i.e., judging the position of the flash relative to that of the moving stimulus) is the result of a linear combination of two absolute localization mechanisms--that is, the coding of the flash position in space and the coding of the position of the moving stimulus in space. In three experiments we showed that (a) the flash is perceived to be shifted in the direction of motion; (b) the moving stimulus is perceived to be ahead of its physical position, the forward shift being larger than that of the flash; (c) the linear combination of these two shifts is quantitatively equivalent to the flash-lag effect, which was measured independently. The results are discussed in relation to perceptual and motor localization mechanisms.

Involvement of the supplementary eye field in oculomotor predictive behavior

The presentation of saccadic and smooth pursuit eye movements as two separate systems has recently been reconsidered: The two subsystems share a number of anatomical structures, and recent data suggest that this sharing also extends to physiological processes. The aim of our study was first to test whether these two subsystems share a common predictive process. We designed a new predictive smooth pursuit paradigm that requires the triggering of unpredictable saccades, performed either during low (ongoing pursuit) or high (pursuit direction reversal) predictive behavior. Saccade latency was used as a probe to reveal a possible sharing of prediction between the two subsystems. The main finding was that saccade latencies were markedly decreased when triggered around pursuit direction reversal and performed in the direction of the predicted pursuit. The aim of the second part of this study was to determine the neural substrate of this common predictive process. According to previous studies, the supplementary eye field (SEF) would be involved in the control of predictive pursuit. The same subjects therefore performed the same tasks, and transcranial magnetic stimulation (TMS) was applied over this area: Decreased saccade latencies were no longer observed, whereas it continued to be observed when applied over the occipital cortex. These results are consistent with (1) The existence of a common predictive process shared by both oculomotor subsystems; (2) The view of the SEF not as a primary oculomotor area but as a higher order structure able to elaborate complex processes, such as prediction, independently of the oculomotor output.

Eye-target synchronization in mild traumatic brain-injured patients

Eye-target synchronization is critical for effective smooth pursuit of a moving visual target. We apply the nonlinear dynamical technique of stochastic-phase synchronization to human visual pursuit of a moving target, in both normal and mild traumatic brain-injured (mTBI) patients. We observe significant fatigue effects in all subject populations, in which subjects synchronize better with the target during the first half of the trial than in the second half. The fatigue effect differed, however, between the normal and the mTBI populations and between old and young subpopulations of each group. In some cases, the younger (<or=40 years old) normal subjects performed better than mTBI subjects and also better than older (>40 years old) normal subjects. Our results, however, suggest that further studies will be necessary before a standard of "normal" smooth pursuit synchronization can be developed.

Gaze pursuit, ‘attention pursuit’ and their effects on cortical activations

A moving object draws our attention to it and we can track the object with smooth pursuit eye movements (SPEM). Gaze and attention are usually directed to the same object during SPEM. In this study we investigated whether gaze and attention can be divided during pursuit. We explored the cortical control of ocular tracking and attentive tracking and the role of focused and divided attention. We presented a sinusoidally moving target for pursuit and simultaneously a stationary target for fixation. Gaze could be directed to the pursuit target and attention to the fixation target or vice versa, or gaze and attention were directed to the same (moving or stationary) target. We found that gaze (overt) and attentive (covert) pursuit similarly activated the cortical oculomotor network. Gaze pursuit showed higher activations than attentive pursuit. Activations, specific to the dissociation of attention from gaze and independent of eye movements, were found solely in the posterior parietal cortex. A cue indicating a forthcoming attention task activated large parts of the cortical SPEM network, as a kind of preparatory mechanism. We did not find any attention-related regions outside the well-known visuo-oculomotor network. We conclude that attention control during gaze pursuit and gaze fixation occur within the cortical SPEM network, supporting the premotor theory of attention [Rizzolatti, G., Riggio, L., Dascola, I. & Umilta, C. (1987) Neuropsychologia, 25, 31-40].

Low frequency rTMS over posterior parietal cortex impairs smooth pursuit eye tracking

The role of the posterior parietal cortex in smooth pursuit eye movements remains unclear. We used low frequency repetitive transcranial magnetic stimulation (rTMS) to study the cognitive and neural systems involved in the control of smooth pursuit eye movements. Eighteen participants were tested on two separate occasions. On each occasion we measured smooth pursuit eye tracking before and after 6 min of 1 Hz rTMS delivered at 90% of motor threshold. Low frequency rTMS over the posterior parietal cortex led to a significant reduction in smooth pursuit velocity gain, whereas rTMS over the motor cortex had no effect on gain. We conclude that low frequency offline rTMS is a potentially useful tool with which to explore the cortical systems involved in oculomotor control.

The contribution of the human FEF and SEF to smooth pursuit initiation

Smooth pursuit eye movements function to keep moving targets foveated. Behavioral studies have shown that pursuit is particularly effective for predictable target motion. There is evidence that both the frontal eye field (FEF) and supplementary eye field (SEF) (also known as the dorsomedial frontal cortex) contribute to pursuit control. The goal of the current experiment was to determine whether these 2 areas made different contributions to the initiation of pursuit in response to predictable compared with unpredictable target motion. Transcranial magnetic stimulation (TMS) was used in 5 healthy human participants to temporarily disrupt each area around the time of target motion onset. TMS over the FEF delayed contraversive pursuit markedly more than ipsiversive pursuit and this direction-dependent difference was more deeply modulated during pursuit of unpredictable than predictable target motion. By contrast, TMS over the SEF resulted in a much more muted modulation of pursuit latency that was similar across both predictable and unpredictable conditions. Taken together, we conclude that the human FEF, but not the SEF, makes a significant contribution to the processing required during the preparation of contraversive pursuit responses to unpredictable target motion and this contribution is less vital during pursuit to predictable target motion.

The contribution of the human PPC to the orienting of visuospatial attention during smooth pursuit

Smooth pursuit eye movements function to stabilize the retinal image of small moving targets. In order for those targets to be foveated, however, they must first be "captured" by an attentional mechanism which then interacts with the oculomotor system. Cortical sites involved with producing smooth pursuit overlap with areas known to be involved in directing visuospatial attention, particularly the posterior parietal cortex (PPC). The goal of the current study was to characterize the contributions made by the left and right posterior parietal cortices (lPPC and rPPC) to the interaction between visuospatial attention and the generation of smooth pursuit eye movements. Transcranial magnetic stimulation (TMS) was used to temporarily disrupt each area at different times around target motion onset in a pursuit task that explicitly manipulated the covert orienting of attention. TMS over the lPPC, rPPC and a control site (the vertex) evoked a similar pattern of results, in that the earlier TMS delivery times caused a reduced pursuit latency compared to baseline measures, while TMS immediately prior to target motion onset resulted in latencies slower than baseline. In addition, however, TMS over the lPPC and rPPC (but not the vertex) preferentially influenced the generation of contralateral pursuit, with the lPPC doing so in a relatively time-independent manner, and the rPPC doing so in a time-dependent manner. This pattern of results implies that both the left and right PPC are directly involved in the interaction between attention and smooth pursuit preparation.

On the distribution of attention in a visuo-manual adaptation task

We have observed in a previous study that adaptation to reversed visual feedback in a tracking task is better when subjects are instructed to look at the cursor providing feedback (group C) rather than at the target (group T). Since both groups actually looked at the target, irrespective of their instructions, we suggested that the advantage of group C is not related to their eye movements, but rather to their allocation of spatial attention. The present study scrutinized this view by combining the same adaptation task with a concurrent reaction-time task, designed to spread subjects' attention across the whole display area. Again, subjects were instructed to look at the cursor or at the target, and again, both groups actually looked at the target. Adaptation was similar to group T, and poorer than group C of the previous study. We therefore concluded that adaptation indeed depends on the subjects' allocation of attention: focussing attention mainly on the target, or spreading it across the whole display area, is not as good as distributing attention between target and cursor.

Mental extrapolation of motion modulates responsiveness to visual stimuli

Mental imagery is often considered to be an attentional state. We investigated whether imagining a stimulus in motion involves a corresponding movement of attention. Subjects fixating a central target extrapolated in imagery the motion of a spot that moved along a circular trajectory and then vanished. During imagery, a flash was presented with various backward and forward displacements relative to the direction of the imagined spot. Subjects had to make a saccade to the flash. Saccades were delayed by as much as 50 ms when the flash appeared displaced from the imagined spot, compared to when the flash was presented in its proximity. A similar delay in latency was obtained when subjects responded with a button press. In an "Observation" condition, in which the spot did not disappear, saccade latencies were similarly delayed, although mainly for backward flash displacements. These findings suggest that motion imagery is associated with a movement of visuospatial attention.

The role of eye movements in visuo-manual adaptation

The present study evaluated the role of eye movements for manual adaptation to reversed vision. Subjects tracked a visual target using a mouse-driven cursor. In Experiment A, they were instructed to look at the target, look at the cursor, fixate straight ahead, or received no instructions regarding eye movements (Groups T, C, F, and N, respectively). Experiment B involved Groups T and C only. In accordance with literature, baseline manual tracking was more accurate when subjects were instructed to move their eyes rather than to fixate straight ahead. In contrast, no such benefit was observed for the adaptive improvement of tracking. We therefore concluded that transfer of information from the oculomotor to the hand motor system enhances the ongoing control of hand movements but not their adaptive modification; probably because the large computational demand of adaptation does not allow an additional processing of supplementary oculomotor signals. We further found adaptation to be worse in T than in any other group. In particular, adaptation was worse in T than in C although eye movements were the same: subjects in both groups moved their eyes in close relationship with the target rather than the cursor, Group C thus disobeying our instructions. The deficient performance of Group T is therefore not related to eye movements per se, but rather to our instructions. We conclude that an independently moving target strongly attracts eye movements independent of instruction (i.e. Groups T and C), but instructions may redirect spatially selective attention (i.e. Group T vs C), and thus influence adaptation.

Spatial deployment of attention influences both saccadic and pursuit tracking

We examined the effects of changing spatial aspects of attention during oculomotor tracking. Human subjects were instructed to make a discrimination on either the small (0.8 degrees ) central or the large (8 degrees ) peripheral part of a compound stimulus (two counter-rotating concentric rings) while the stimulus either translated across the screen or was stationary. During this period, a transient perturbation with either step or ramp movement profile occurred. For perturbations leading to a change in position larger than the small ring, saccades occurred more frequently and had much shorter latencies (by 135 ms) when attention was directed to the small ring than when attention was directed to the large ring. These latency differences were sufficiently great that from a single saccade one can identify the attentional instruction with 94% accuracy. However, with target steps as small as the small ring, saccade latencies differed less. For pursuit, ramp perturbations caused larger changes in eye velocity with little change in latency when attention was directed to the small ring. Finally, when only the motion of the non-attended ring was perturbed, most subjects showed stronger saccadic responses to perturbations of the small than the large ring, and stronger pursuit responses to perturbations of the large than the small ring. By fitting the saccade latency distributions with the Reddi and Carpenter LATER model, we found that our subjects apparently employed at least two distinct strategies for changing latency when attending large vs. small. We propose that the timing of the saccade decision process depends on both the size of the attended object and the magnitude of the perturbation.

The urgency to look: prompt saccades to the benefit of perception

Researchers have shown that the promptness to initiate a saccade is modulated by countless factors pertaining to the visual context and the task. However, experiments on saccadic eye movements are usually designed in such a way that oculomotor performance is dissociated from the natural role of saccades, namely that of making crucial perceptual information rapidly available for high-resolution, foveal analysis. Here, we demonstrate that the requirement to perform a difficult perceptual judgment at the saccade landing location can reduce saccadic latency (by >15%) and increase saccadic peak velocity. Importantly, the effect cannot be explained in terms of arousal, as latency changes are specific to the location where the perceptual judgement is required. These results indicate that mechanisms for voluntary saccade initiation are under the powerful indirect control of perceptual goals.

The effects of dividing attention on smooth pursuit eye tracking

Attentional processes have traditionally been closely linked to the production of saccadic eye movements, but their role in the control of smooth pursuit eye movements remains unclear. In two experiments we used dual task paradigms to vary the attentional resources available for pursuit eye tracking. In both experiments we found that attentionally demanding secondary tasks impaired smooth pursuit performance, resulting in decreased velocity and increased position error. These findings suggest that attention is important for the maintenance of accurate smooth pursuit, and do not support the hypothesis that pursuit is a relatively automatic function that proceeds optimally in the absence of attentional control. These results add weight to the suggestion that a similar functional architecture underlies both pursuit and saccadic eye movements.

Similar kinematic properties for ocular following and smooth pursuit eye movements

Ocular following (OFR) is a short-latency visual stabilization response to the optic flow experienced during self-motion. It has been proposed that it represents the early component of optokinetic nystagmus (OKN) and that it is functionally linked to the vestibularly driven stabilization reflex during translation (translational vestibuloocular reflex, TVOR). Because no single eye movement can eliminate slip from the whole retina during translation, the OFR and the TVOR appear to be functionally related to maintaining visual acuity on the fovea. Other foveal-specific eye movements, like smooth pursuit and saccades, exhibit an eye-position-dependent torsional component, as dictated by what is known as the "half-angle rule" of Listing's law. In contrast, eye movements that stabilize images on the whole retina, such as the rotational vestibuloocular reflex (RVOR) and steady-state OKN do not. Consistent with the foveal stabilization hypothesis, it was recently shown that the TVOR is indeed characterized by an eye-position-dependent torsion, similar to pursuit eye movements. Here we have investigated whether the OFR exhibits three-dimensional kinematic properties consistent with a foveal response (i.e., similar to the TVOR and smooth pursuit eye movements) or with a whole-field stabilization function (similar to steady-state OKN). The OFR was elicited using 100-ms ramp motion of a full-field random dot pattern that moved horizontally at 20, 62, or 83 degrees/s. To study if an eye-position-dependent torsion is generated during the OFR, we varied the initial fixation position vertically within a range of +/-20 degrees . As a control, horizontal smooth pursuit eye movements were also elicited using step-ramp target motion (10, 20, or 30 degrees/s) at similar eccentric positions. We found that the OFR followed kinematic properties similar to those seen in pursuit and the TVOR with the eye-position-dependent torsional tilt of eye velocity having slopes that averaged 0.73 +/- 0.16 for OFR and 0.57 +/- 0.12 (means +/- SD) for pursuit. These findings support the notion that the OFR, like the TVOR and pursuit, are foveal image stabilization systems.

Blink effects on ongoing smooth pursuit eye movements in humans

Blinks are known to affect eye movements, e.g., saccades, slow and fast vergence, and saccade-vergence interaction, in two ways: by superimposition of blink-associated eye movements and changes of the central premotor activity in the brainstem. The goal of this study was to determine, for the first time, the effects of trigeminal evoked blinks on ongoing smooth pursuit eye movements which could be related to visual sensory or premotor neuronal changes. This was compared to the effect of a target disappearing for 100-300 ms duration during ongoing smooth pursuit (blank paradigm) in order to control for the visual sensory effects of a blink. Eye and blink movements were recorded in eight healthy subjects with the scleral search coil technique. Blink-associated eye movements during the first 50% of the blink duration were non-linearly superimposed on the smooth pursuit eye movements. Immediately after the blink-associated eye movements, the pursuit velocity slowly decreased by an average of 3.2+/-2.1 degrees /s. This decrease was not dependent on the stimulus direction. The pursuit velocity decrease caused by blinks which occluded the pupil more than 50% could be explained mostly by blanking the visual target. However, small blinks that did not occlude the pupil (<10% of lid closure) also decreased smooth pursuit velocity. Thus, this blink effect on pursuit velocity cannot be explained by blink-associated eye movements or by the blink having blanked the visual input. We propose that part of this effect might either be caused by incomplete visual suppression during blinks and/or a change in the activity of omnipause neurons.