Predictive eye movements when hitting a bouncing ball

The role of prediction and visual tracking strategies during manual interception: An exploration of individual differences

The interception (or avoidance) of moving objects is a common component of various daily living tasks; however, it remains unclear whether precise alignment of foveal vision with a target is important for motor performance. Furthermore, there has also been little examination of individual differences in visual tracking strategy and the use of anticipatory gaze adjustments. We examined the importance of in-flight tracking and predictive visual behaviors using a virtual reality environment that required participants (n = 41) to intercept tennis balls projected from one of two possible locations. Here, we explored whether different tracking strategies spontaneously arose during the task, and which were most effective. Although indices of closer in-flight tracking (pursuit gain, tracking coherence, tracking lag, and saccades) were predictive of better interception performance, these relationships were rather weak. Anticipatory gaze shifts toward the correct release location of the ball provided no benefit for subsequent interception. Nonetheless, two interceptive strategies were evident: 1) early anticipation of the ball's onset location followed by attempts to closely track the ball in flight (i.e., predictive strategy); or 2) positioning gaze between possible onset locations and then using peripheral vision to locate the moving ball (i.e., a visual pivot strategy). Despite showing much poorer in-flight foveal tracking of the ball, participants adopting a visual pivot strategy performed slightly better in the task. Overall, these results indicate that precise alignment of the fovea with the target may not be critical for interception tasks, but that observers can adopt quite varied visual guidance approaches.

Properties of Gaze Strategies Based on Eye-Head Coordination in a Ball-Catching Task

Visual motion information plays an important role in the control of movements in sports. Skilled ball players are thought to acquire accurate visual information by using an effective visual search strategy with eye and head movements. However, differences in catching ability and gaze movements due to sports experience and expertise have not been clarified. Therefore, the purpose of this study was to determine the characteristics of gaze strategies based on eye and head movements during a ball-catching task in athlete and novice groups. Participants were softball and tennis players and college students who were not experienced in ball sports (novice). They performed a one-handed catching task using a tennis ball-shooting machine, which was placed at 9 m in front of the participants, and two conditions were set depending on the height of the ball trajectory (high and low conditions). Their head and eye velocities were detected using a gyroscope and electrooculography (EOG) during the task. Our results showed that the upward head velocity and the downward eye velocity were lower in the softball group than in the tennis and novice groups. When the head was pitched upward, the downward eye velocity was induced from the vestibulo-ocular reflex (VOR) during ball catching. Therefore, it is suggested that skilled ball players have relatively stable head and eye movements, which may lead to an effective gaze strategy. An advantage of the stationary gaze in the softball group could be to acquire visual information about the surroundings other than the ball.

Investigating how Explicit Contextual Cues Affect Predictive Sensorimotor Control in Autistic Adults

Research suggests that sensorimotor difficulties in autism could be reduced by providing individuals with explicit contextual information. To test this, we examined autistic visuomotor control during a virtual racquetball task, in which participants hit normal and unexpectedly-bouncy balls using a handheld controller. The probability of facing each type of ball was varied unpredictably over time. However, during cued trials, participants received explicit information about the likelihood of facing each uncertain outcome. When compared to neurotypical controls, autistic individuals displayed poorer task performance, atypical gaze profiles, and more restricted swing kinematics. These visuomotor patterns were not significantly affected by contextual cues, indicating that autistic people exhibit underlying differences in how prior information and environmental uncertainty are dynamically modulated during movement tasks.

Spatial contextual cues that help predict how a target will accelerate can be used to guide interception

Objects in one's environment do not always move at a constant velocity but often accelerate or decelerate. People are very poor at visually judging acceleration and normally make systematic errors when trying to intercept accelerating objects. If the acceleration is perpendicular to the direction of motion, it gives rise to a curved path. Can spatial contextual cues help one predict such accelerations and thereby help interception? To answer this question, we asked participants to hit a target that moved as if it were attached to a rolling disk, like a valve (target) on a bicycle wheel (disk) moves when cycling: constantly accelerating toward the wheel's center. On half the trials, the disk was visible such that participants could use the spatial relations between the target and the rolling disk to guide their interception. On the other half, the disk was not visible, so participants had no help in predicting the target's complicated pattern of accelerations and decelerations. Importantly, the target's path was the same in both cases. Participants hit more targets when the disk was visible than when it was invisible, even when using a strategy that can compensate for neglecting acceleration. We conclude that spatial contextual cues that help predict the target's accelerations can help intercept it.

Studies of Vision in Cricket-A Narrative Review

Vision is thought to play a substantial role in hitting and fielding in cricket. An understanding of which visual skills contribute during cricket play could inform future clinical training trials. This paper reviews what has been reported thus far regarding the relationship of visual skills to cricket performance and reviews the results of clinical trials in which the impact of visual skills training on cricket performance has been addressed. Fundamental or low-level visual skills, with the exception of color vision and perhaps near stereopsis and dynamic visual acuity, are similar between cricket players and the general population. Simple reaction time has been found to be shorter in cricket players in some but not all studies. While there is mixed or no evidence that the aforementioned visual skills are superior in cricket players compared to non-players, comparisons of eye and head movements and gaze tracking have revealed consistent differences between elite cricket batters and sub-elite batters. Future training studies could examine whether teaching sub-elite batters to emulate the gaze tracking patterns of elite batters is beneficial for batting. Lastly, clinical trials in which visual skills of cricket players have been trained have in many cases resulted in positive effects on visual skills, or judgments required in cricket, or cricket play. However, clinical trials with larger and more diverse groups of participants and correlations to on-field metrics and on-field performance (i.e., domain-specific assessments) are necessary before conclusions can be drawn regarding the efficacy of vision training.

The effect of performance pressure and error-feedback on anxiety and performance in an interceptive task

Introduction

Whilst the disruptive effects of anxiety on attention and performance have been well documented, the antecedents to anxiety in motivated performance scenarios are less well understood. We therefore sought to understand the cognitive appraisals that mediate the relationship between pressurised performance situations and the onset of anxiety.

Methods

We tested the effects of performance pressure and error feedback on appraisals of the probability and cost of failure, the experience of anxiety, and subsequent impacts on visual attention, movement kinematics, and task performance during a virtual reality interception task.

Results

A series of linear mixed effects models indicated that failure feedback and situational pressure influenced appraisals of the probability and cost of failure, which subsequently predicted the onset of anxious states. We did not, however, observe downstream effects on performance and attention.

Discussion

The findings support the predictions of Attentional Control Theory Sport, that (i) momentary errors lead to negative appraisals of the probability of future failure; and (ii) that appraisals of both the cost and probability of future failure are important predictors of anxiety. The results contribute to a better understanding of the precursors to anxiety and the feedback loops that may maintain anxious states.

Task-evoked pupillary responses track precision-weighted prediction errors and learning rate during interceptive visuomotor actions

In this study, we examined the relationship between physiological encoding of surprise and the learning of anticipatory eye movements. Active inference portrays perception and action as interconnected inference processes, driven by the imperative to minimise the surprise of sensory observations. To examine this characterisation of oculomotor learning during a hand-eye coordination task, we tested whether anticipatory eye movements were updated in accordance with Bayesian principles and whether trial-by-trial learning rates tracked pupil dilation as a marker of 'surprise'. Forty-four participants completed an interception task in immersive virtual reality that required them to hit bouncing balls that had either expected or unexpected bounce profiles. We recorded anticipatory eye movements known to index participants' beliefs about likely ball bounce trajectories. By fitting a hierarchical Bayesian inference model to the trial-wise trajectories of these predictive eye movements, we were able to estimate each individual's expectations about bounce trajectories, rates of belief updating, and precision-weighted prediction errors. We found that the task-evoked pupil response tracked prediction errors and learning rates but not beliefs about ball bounciness or environmental volatility. These findings are partially consistent with active inference accounts and shed light on how encoding of surprise may shape the control of action.

Are predictive saccades linked to the processing of peripheral information?

High-level athletes can predict the actions of an opposing player. Interestingly, such predictions are also reflected by the athlete's gaze behavior. In cricket, for example, players first pursue the ball with their eyes before they very often initiate two predictive saccades: one to the predicted ball-bounce point and a second to the predicted ball-bat-contact point. That means, they move their eyes ahead of the ball and "wait" for the ball at the new fixation location, potentially using their peripheral vision to update information about the ball's trajectory. In this study, we investigated whether predictive saccades are linked to the processing of information in peripheral vision and if predictive saccades are superior to continuously following the ball with foveal vision using smooth-pursuit eye-movements (SPEMs). In the first two experiments, we evoked the typical eye-movements observed in cricket and showed that the information gathered during SPEMs is sufficient to predict when the moving object will hit the target location and that (additional) peripheral monitoring of the object does not help to improve performance. In a third experiment, we show that it could actually be beneficial to use SPEMs rather than predictive saccades to improve performance. Thus, predictive saccades ahead of a target are unlikely to be performed to enhance the peripheral monitoring of target.

Tau and kappa in interception - how perceptual spatiotemporal interrelations affect movements

Batting and catching are real-life examples of interception. Due to latencies between the processing of sensory input and the corresponding motor response, successful interception requires accurate spatiotemporal prediction. However, spatiotemporal predictions can be subject to bias. For instance, the more spatially distant two sequentially presented objects are, the longer the interval between their presentations is perceived (kappa effect) and vice versa (tau effect). In this study, we deployed these phenomena to test in two sensory modalities whether temporal representations depend asymmetrically on spatial representations, or whether both are symmetrically interrelated. We adapted the tau and kappa paradigms to an interception task by presenting four stimuli (visually or auditorily) one after another on four locations, from left to right, with constant spatial and temporal intervals in between. In two experiments, participants were asked to touch the screen where and when they predicted a fifth stimulus to appear. In Exp. 2, additional predictive gaze measures were examined. Across experiments, auditory but not visual stimuli produced a tau effect for interception, supporting the idea that the relationship between space and time is moderated by the sensory modality. Results did not reveal classical auditory or visual kappa effects and no visual tau effects. Gaze data in Exp. 2 showed that the (spatial) gaze orientation depended on temporal intervals while the timing of fixations was modulated by spatial intervals, thereby indicating tau and kappa effects across modalities. Together, the results suggest that sensory modality plays an important role in spatiotemporal predictions in interception.

Visual Strategies for Eye and Head Movements During Table Tennis Rallies

The purpose of this study was to clarify the properties of visual strategies for gaze, eye, and head movements in skilled table tennis players during rallies. Collegiate expert and semi-expert table tennis players conducted forehand rallies at a constant tempo using a metronome. Two tempo conditions were used in the order of 130 and 150 bpm. Participants conducted a 20-stroke rally under each tempo condition. Horizontal and vertical angles between the gaze point and ball positions at the time the ball bounced (gaze-ball angle) were analyzed with the image that was recorded by an eye tracking device equipped with Gyro sensor. Eye and head movements during rallies were also recorded with the eye tracking device and Gyro sensor, respectively. The results showed that the gaze-ball angle of expert players was significantly larger than that of semi-expert players. This result indicates that expert players tended to keep their gaze position on the ball shorter than semi-expert players. We also found that eye movements of expert players were significantly smaller than that of semi-expert players. Furthermore, as the result of multiple regression analysis, the effect of eye movements on the gaze-ball angle was significantly higher than that of head movements. This result indicates that the gaze-ball angle during table tennis rallies could be associated with eye movements rather than head movements. Our findings suggest that the visual strategies used during table tennis rallies are different between expert and semi-expert players, even though they both have more than 10 years of experience.

Spatial Accuracy of Predictive Saccades Determines the Performance of Continuous Visuomotor Action

In a table tennis rally, players perform interceptive actions on a moving ball continuously in a short time, such that the acquisition process of visual information is an important determinant of the performance of the action. However, because it is technically hard to measure gaze movement in a real game, little is known about how gaze behavior is conducted during the continuous visuomotor actions and contributes to the performance. To examine these points, we constructed a novel psychophysical experiment model enabling a continuous visuomotor task without spatial movement of any body parts, including the arm and head, and recorded the movement of the gaze and effector simultaneously at high spatiotemporal resolution. In the task, Gabor patches (target) moved one after another at a constant speed from right to left at random vertical positions on an LC display. Participants hit the target with a cursor moving vertically on the left side of the display by controlling their prehensile force on a force sensor. Participants hit the target with the cursor using a rapid-approaching movement (rapid cursor approach, RCA). Their gaze also showed rapid saccadic approaching movement (saccadic eye approach, SEA), reaching the predicted arrival point of the target earlier than the cursor. The RCA reached in or near the Hit zone in the successful (Hit) trial, but ended up away from it in the unsuccessful (Miss) trial, suggesting the spatial accuracy of the RCA determines the task's success. The SEA in the Hit trial ended nearer the target than the Miss trial. The spatial accuracy of the RCA diminished when the target disappeared 100 ms just after the end of the SEA, suggesting that visual information acquired after the saccade acted as feedback information to correct the cursor movement online for the cursor to reach the target. There was a target speed condition that the target disappearance did not compromise RCA's spatial accuracy, implying the possible RCA correction based on the post-saccadic gaze location information. These experiments clarified that gaze behavior conducted during fast continuous visuomotor actions enables online correction of the ongoing interceptive movement of an effector, improving visuomotor performance.

Spatial Accuracy of Predictive Saccades Determines the Performance of Continuous Visuomotor Action

In a table tennis rally, players perform interceptive actions on a moving ball continuously in a short time, such that the acquisition process of visual information is an important determinant of the performance of the action. However, because it is technically hard to measure gaze movement in a real game, little is known about how gaze behavior is conducted during the continuous visuomotor actions and contributes to the performance. To examine these points, we constructed a novel psychophysical experiment model enabling a continuous visuomotor task without spatial movement of any body parts, including the arm and head, and recorded the movement of the gaze and effector simultaneously at high spatiotemporal resolution. In the task, Gabor patches (target) moved one after another at a constant speed from right to left at random vertical positions on an LC display. Participants hit the target with a cursor moving vertically on the left side of the display by controlling their prehensile force on a force sensor. Participants hit the target with the cursor using a rapid-approaching movement (rapid cursor approach, RCA). Their gaze also showed rapid saccadic approaching movement (saccadic eye approach, SEA), reaching the predicted arrival point of the target earlier than the cursor. The RCA reached in or near the Hit zone in the successful (Hit) trial, but ended up away from it in the unsuccessful (Miss) trial, suggesting the spatial accuracy of the RCA determines the task's success. The SEA in the Hit trial ended nearer the target than the Miss trial. The spatial accuracy of the RCA diminished when the target disappeared 100 ms just after the end of the SEA, suggesting that visual information acquired after the saccade acted as feedback information to correct the cursor movement online for the cursor to reach the target. There was a target speed condition that the target disappearance did not compromise RCA's spatial accuracy, implying the possible RCA correction based on the post-saccadic gaze location information. These experiments clarified that gaze behavior conducted during fast continuous visuomotor actions enables online correction of the ongoing interceptive movement of an effector, improving visuomotor performance.

Predictive eye movements are adjusted in a Bayes-optimal fashion in response to unexpectedly changing environmental probabilities

This study examined the application of active inference to dynamic visuomotor control. Active inference proposes that actions are dynamically planned according to uncertainty about sensory information, prior expectations, and the environment, with motor adjustments serving to minimise future prediction errors. We investigated whether predictive gaze behaviours are indeed adjusted in this Bayes-optimal fashion during a virtual racquetball task. In this task, participants intercepted bouncing balls with varying levels of elasticity, under conditions of higher or lower environmental volatility. Participants' gaze patterns differed between stable and volatile conditions in a manner consistent with generative models of Bayes-optimal behaviour. Partially observable Markov models also revealed an increased rate of associative learning in response to unpredictable shifts in environmental probabilities, although there was no overall effect of volatility on this parameter. Findings extend active inference frameworks into complex and unconstrained visuomotor tasks and present important implications for a neurocomputational understanding of the visual guidance of action.

An examination of active inference in autistic adults using immersive virtual reality

The integration of prior expectations, sensory information, and environmental volatility is proposed to be atypical in Autism Spectrum Disorder, yet few studies have tested these predictive processes in active movement tasks. To address this gap in the research, we used an immersive virtual-reality racquetball paradigm to explore how visual sampling behaviours and movement kinematics are adjusted in relation to unexpected, uncertain, and volatile changes in environmental statistics. We found that prior expectations concerning ball 'bounciness' affected sensorimotor control in both autistic and neurotypical participants, with all individuals using prediction-driven gaze strategies to track the virtual ball. However, autistic participants showed substantial differences in visuomotor behaviour when environmental conditions were more volatile. Specifically, uncertainty-related performance difficulties in these conditions were accompanied by atypical movement kinematics and visual sampling responses. Results support proposals that autistic people overestimate the volatility of sensory environments, and suggest that context-sensitive differences in active inference could explain a range of movement-related difficulties in autism.

Effects of visual blur and contrast on spatial and temporal precision in manual interception

The visual system is said to be especially sensitive towards spatial but lesser so towards temporal information. To test this, in two experiments, we systematically reduced the acuity and contrast of a visual stimulus and examined the impact on spatial and temporal precision (and accuracy) in a manual interception task. In Experiment 1, we blurred a virtual, to-be-intercepted moving circle (ball). Participants were asked to indicate (i.e., finger tap) on a touchscreen where and when the virtual ball crossed a ground line. As a measure of spatial and temporal accuracy and precision, we analyzed the constant and variable errors, respectively. With increasing blur, the spatial and temporal variable error, as well as the spatial constant error increased, while the temporal constant error decreased. Because in the first experiment, blur was potentially confounded with contrast, in Experiment 2, we re-ran the experiment with one difference: instead of blur, we included five levels of contrast matched to the blur levels. We found no systematic effects of contrast. Our findings confirm that blurring vision decreases spatial precision and accuracy and that the effects were not mediated by concomitant changes in contrast. However, blurring vision also affected temporal precision and accuracy, thereby questioning the generalizability of the theoretical predictions to the applied interception task.

Review: Head and Eye Movements and Gaze Tracking in Baseball Batting

SIGNIFICANCE

After a 30-year gap, several studies on head and eye movements and gaze tracking in baseball batting have been performed in the last decade. These baseball studies may lead to training protocols for batting. Here we review these studies and compare the tracking behaviors with those in other sports.Baseball batters are often instructed to "keep your eye on the ball." Until recently, the evidence regarding whether batters follow this instruction and if there are benefits to following this instruction was limited. Baseball batting studies demonstrate that batters tend to move the head more than the eyes in the direction of the ball at least until a saccade occurs. Foveal gaze tracking is often maintained on the ball through the early portion of the pitch, so it can be said that baseball batters do keep the eyes on the ball. While batters place gaze at or near the point of bat-ball contact, the way this is accomplished varies. In some studies, foveal gaze tracking continues late in the pitch trajectory, whereas in other studies, anticipatory saccades occur. The relative advantages of these discrepant gaze strategies on perceptual processing and motor planning speed and accuracy are discussed, and other variables that may influence anticipatory saccades including the predictability of the pitch and the level of batter expertise are described. Further studies involving larger groups with different levels of expertise under game conditions are required to determine which gaze tracking strategies are most beneficial for baseball batting.

Topical Review: Perceptual-cognitive Skills, Methods, and Skill-based Comparisons in Interceptive Sports

SIGNIFICANCE

We give a comprehensive picture of perceptual-cognitive (PC) skills that could contribute to performance in interceptive sports. Both visual skills that are low level and unlikely influenced by experience and higher-level cognitive-attentional skills are considered, informing practitioners for identification and training and alerting researchers to gaps in the literature.Perceptual-cognitive skills and abilities are keys to success in interceptive sports. The interest in identifying which skills and abilities underpin success and hence should be selected and developed is likely going to grow as technologies for skill testing and training continue to advance. Many different methods and measures have been applied to the study of PC skills in the research laboratory and in the field, and research findings across studies have often been inconsistent. In this article, we provide definitional clarity regarding whether a skill is primarily visual attentional (ranging from fundamental/low-level skills to high-level skills) or cognitive. We review those skills that have been studied using sport-specific stimuli or tests, such as postural cue anticipation in baseball, as well as those that are mostly devoid of sport context, considered general skills, such as dynamic visual acuity. In addition to detailing the PC skills and associated methods, we provide an accompanying table of published research since 1995, highlighting studies (for various skills and sports) that have and have not differentiated across skill groups.

Visuo-motor attention during object interaction in children with developmental coordination disorder

Developmental coordination disorder (DCD) describes a condition of poor motor performance in the absence of intellectual impairment. Despite being one of the most prevalent developmental disorders, little is known about how fundamental visuomotor processes might function in this group. One prevalent idea is children with DCD interact with their environment in a less predictive fashion than typically developing children. A metric of prediction which has not been examined in this group is the degree to which the hands and eyes are coordinated when performing manual tasks. To this end, we examined hand and eye movements during an object lifting task in a group of children with DCD (n = 19) and an age-matched group of children without DCD (n = 39). We observed no differences between the groups in terms of how well they coordinated their hands and eyes when lifting objects, nor in terms of the degree by which the eye led the hand. We thus find no evidence to support the proposition that children with DCD coordinate their hands and eyes in a non-predictive fashion. In a follow-up exploratory analysis we did, however, note differences in fundamental patterns of eye movements between the groups, with children in the DCD group showing some evidence of atypical visual sampling strategies and gaze anchoring behaviours during the task.

The role of eye movements in manual interception: A mini-review

When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.

Somatosensory target information is used for reaching but not for saccadic eye movements

A systematic investigation of contributions of different somatosensory modalities (proprioception, kinesthesia, tactile) for goal-directed movements is missing. Here we demonstrate that while eye movements are not affected by different types of somatosensory information, reach precision improves when two different types of information are available. Moreover, reach accuracy and gaze precision to unseen somatosensory targets improve when performing coordinated eye-hand movements, suggesting bidirectional contributions of efferent information in reach and eye movement control.

Evidence of inverted gravity-driven variation in predictive sensorimotor function

We move our eyes to place the fovea into the part of a viewed scene currently of interest. Recent evidence suggests that each human has signature patterns of eye movements like handwriting which depend on their sensitivity, allocation of attention and experience. Use of implicit knowledge of how earth's gravity influences object motion has been shown to aid dynamic perception. We used a projected ball-tracking task with a plain background offering no context cues to probe the effect of acquired experience about physical laws of gravitation on performance differences of 44 participants under a simulated gravity and an atypical (upward) antigravity condition. Performance measured by the unsigned difference between instantaneous eye and stimulus positions (RMSE) was consistently worse in the antigravity condition. In the vertical RMSE, participants took about 200 ms longer to improve to the best performance for antigravity compared to gravity trials. The antigravity condition produced a divergence of individual performance which was correlated with levels of questionnaire-based quantified traits of schizotypy but not control traits. Grouping participants by high or low traits revealed a negative relationship between schizotypy trait level and both initiation and maintenance of tracking, a result consistent with trait-related impoverished sensory prediction. The findings confirm for the first time that where cues enabling exact estimation of acceleration are unavailable, knowledge of gravity contributes to dynamic prediction improving motion processing. With acceleration expectations violated, we demonstrate that antigravity tracking could act as a multivariate diagnostic window into predictive brain function.

Introduction to special issue on "Prediction in Perception and Action"

The wide diversity of articles in this issue reveals an explosion of evidence for the mechanisms of prediction in the visual system. When thought of as visual priors, predictive mechanisms can be seen as tightly interwoven with incoming sensory data. Prediction is thus a fundamental and essential aspect not only of visual perception but of the actions that are guided by perception.