Perceptual decisions about object shape bias visuomotor coordination during rapid interception movements

Eye-hand coordination all the way: from discrete to continuous hand movements

The differentiation between continuous and discrete actions is key for behavioral neuroscience. Although many studies have characterized eye-hand coordination during discrete (e.g., reaching) and continuous (e.g., pursuit tracking) actions, all these studies were conducted separately, using different setups and participants. In addition, how eye-hand coordination might operate at the frontier between discrete and continuous movements remains unexplored. Here we filled these gaps by means of a task that could elicit different movement dynamics. Twenty-eight participants were asked to simultaneously track with their eyes and a joystick a visual target that followed an unpredictable trajectory and whose position was updated at different rates (from 1.5 to 240 Hz). This procedure allowed us to examine actions ranging from discrete point-to-point movements (low refresh rate) to continuous pursuit (high refresh rate). For comparison, we also tested a manual tracking condition with the eyes fixed and a pure eye tracking condition (hand fixed). The results showed an abrupt transition between discrete and continuous hand movements around 3 Hz contrasting with a smooth trade-off between fixations and smooth pursuit. Nevertheless, hand and eye tracking accuracy remained strongly correlated, with each of these depending on whether the other effector was recruited. Moreover, gaze-cursor distance and lag were smaller when eye and hand performed the task conjointly than separately. Altogether, despite some dissimilarities in eye and hand dynamics when transitioning between discrete and continuous movements, our results emphasize that eye-hand coordination continues to smoothly operate and support the notion of synergies across eye movement types.NEW & NOTEWORTHY The differentiation between continuous and discrete actions is key for behavioral neuroscience. By using a visuomotor task in which we manipulate the target refresh rate to trigger different movement dynamics, we explored eye-hand coordination all the way from discrete to continuous actions. Despite abrupt changes in hand dynamics, eye-hand coordination continues to operate via a gradual trade-off between fixations and smooth pursuit, an observation confirming the notion of synergies across eye movement types.

Perceptual-Cognitive Integration for Goal-Directed Action in Naturalistic Environments

Real-world actions require one to simultaneously perceive, think, and act on the surrounding world, requiring the integration of (bottom-up) sensory information and (top-down) cognitive and motor signals. Studying these processes involves the intellectual challenge of cutting across traditional neuroscience silos, and the technical challenge of recording data in uncontrolled natural environments. However, recent advances in techniques, such as neuroimaging, virtual reality, and motion tracking, allow one to address these issues in naturalistic environments for both healthy participants and clinical populations. In this review, we survey six topics in which naturalistic approaches have advanced both our fundamental understanding of brain function and how neurologic deficits influence goal-directed, coordinated action in naturalistic environments. The first part conveys fundamental neuroscience mechanisms related to visuospatial coding for action, adaptive eye-hand coordination, and visuomotor integration for manual interception. The second part discusses applications of such knowledge to neurologic deficits, specifically, steering in the presence of cortical blindness, impact of stroke on visual-proprioceptive integration, and impact of visual search and working memory deficits. This translational approach-extending knowledge from lab to rehab-provides new insights into the complex interplay between perceptual, motor, and cognitive control in naturalistic tasks that are relevant for both basic and clinical research.

Functional changes in fusional vergence-related brain areas and correlation with clinical features in intermittent exotropia using functional magnetic resonance imaging

To explore the functional changes of the frontal eye field (FEF) and relevant brain regions and its role in the pathogenesis of intermittent exotropia (IXT) children via functional magnetic resonance imaging (fMRI). Twenty-four IXT children (mean age, 11.83 ± 1.93 years) and 28 normal control (NC) subjects (mean age, 11.11 ± 1.50 years) were recruited. During fMRI scans, the IXT children and NCs were provided with static visual stimuli (to evoke sensory fusion) and dynamic visual stimuli (to evoke motor fusion and vergence eye movements) with binocular disparity. Brain activation in the relevant brain regions and clinical characteristics were evaluated. Group differences of brain activation and brain-behavior correlations were investigated. For dynamic and static visual disparity relative to no visual disparity, reduced brain activation in the right FEF and right inferior occipital gyrus (IOG), and increased brain activation in the left middle temporal gyrus complex (MT+) were found in the IXT children compared with NCs. Significant positive correlations between the fusional vergence amplitude and the brain activation values were found in the right FEF, right IPL, and left cerebellum in the NC group. Positive correlations between brain activation values and Newcastle Control Scores (NCS) were found in the left MT+ in the IXT group. For dynamic visual disparity relative to static visual disparity, reduced brain activation in the right middle occipital gyrus, left cerebellum, and bilateral IPL was found in the IXT children compared with NCs. Significant positive correlations between brain activation values and the fusional vergence amplitude were found in the right FEF and right cerebellum in the NC group. Negative correlations between brain activation values and NCS were found in the right middle occipital gyrus, right cerebellum, left IPL, and right FEF in the IXT group. These results suggest that the reduced brain activation in the right FEF, left IPL, and cerebellum may play an important role in the pathogenesis of IXT by influencing fusional vergence function. While the increased brain activation in the left MT+ may compensate for this dysfunction in IXT children.

Object motion influences feedforward motor responses during mechanical stopping of virtual projectiles: a preliminary study

An important window into sensorimotor function is how humans interact and stop moving projectiles, such as stopping a door from closing shut or catching a ball. Previous studies have suggested that humans time the initiation and modulate the amplitude of their muscle activity based on the momentum of the approaching object. However, real-world experiments are constrained by laws of mechanics, which cannot be manipulated experimentally to probe the mechanisms of sensorimotor control and learning. An augmented-reality variant of such tasks allows for experimental manipulation of the relationship between motion and force to obtain novel insights into how the nervous system prepares motor responses to interact with moving stimuli. Existing paradigms for studying interactions with moving projectiles use massless objects and are primarily focused on quantifying gaze and hand kinematics. Here, we developed a novel collision paradigm using a robotic manipulandum where participants mechanically stopped a virtual object moving in the horizontal plane. On each block of trials, we varied the virtual object's momentum by increasing either its velocity or mass. Participants stopped the object by applying a force impulse that matched the object momentum. We observed that hand force increased as a function of object momentum linked to changes in virtual mass or velocity, similar to results from studies involving catching free-falling objects. In addition, increasing object velocity resulted in later onset of hand force relative to the impending time-to-contact. These findings show that the present paradigm can be used to determine how humans process projectile motion for hand motor control.

Capacity Limits Lead to Information Bottlenecks in Ongoing Rapid Motor Behaviors

Studies of ongoing, rapid motor behaviors have often focused on the decision-making implicit in the task. Here, we instead study how decision-making integrates with the perceptual and motor systems and propose a framework of limited-capacity, pipelined processing with flexible resources to understand rapid motor behaviors. Results from three experiments show that human performance is consistent with our framework: participants perform objectively worse as task difficulty increases, and, surprisingly, this drop in performance is largest for the most skilled performers. As well, our analysis shows that the worst-performing participants can perform equally well under increased task demands, which is consistent with flexible neural resources being allocated to reduce bottleneck effects and improve overall performance. We conclude that capacity limits lead to information bottlenecks and that processes like attention help reduce the effects that these bottlenecks have on maximal performance.

Age-related deficits in rapid visuomotor decision-making

Many goal-directed actions that require rapid visuomotor planning and perceptual decision-making are affected in older adults, causing difficulties in execution of many functional activities of daily living. Visuomotor planning and perceptual identification are mediated by the dorsal and ventral visual streams, respectively, but it is unclear how age-induced changes in sensory processing in these streams contribute to declines in visuomotor decision-making performance. Previously, we showed that in young adults, task demands influenced movement strategies during visuomotor decision-making, reflecting differential integration of sensory information between the two streams. Here, we asked the question if older adults would exhibit deficits in interactions between the two streams during demanding motor tasks. Older adults (n = 15) and young controls (n = 26) performed reaching or interception movements toward virtual objects. In some blocks of trials, participants also had to select an appropriate movement goal based on the shape of the object. Our results showed that older adults corrected fewer initial decision errors during both reaching and interception movements. During the interception decision task, older adults made more decision- and execution-related errors than young adults, which were related to early initiation of their movements. Together, these results suggest that older adults have a reduced ability to integrate new perceptual information to guide online action, which may reflect impaired ventral-dorsal stream interactions.NEW & NOTEWORTHY Older adults show declines in vision, decision-making, and motor control, which can lead to functional limitations. We used a rapid visuomotor decision task to examine how these deficits may interact to affect task performance. Compared with healthy young adults, older adults made more errors in both decision-making and motor execution, especially when the task required intercepting moving targets. This suggests that age-related declines in integrating perceptual and motor information may contribute to functional deficits.

Effects of visual blur and contrast on spatial and temporal precision in manual interception

The visual system is said to be especially sensitive towards spatial but lesser so towards temporal information. To test this, in two experiments, we systematically reduced the acuity and contrast of a visual stimulus and examined the impact on spatial and temporal precision (and accuracy) in a manual interception task. In Experiment 1, we blurred a virtual, to-be-intercepted moving circle (ball). Participants were asked to indicate (i.e., finger tap) on a touchscreen where and when the virtual ball crossed a ground line. As a measure of spatial and temporal accuracy and precision, we analyzed the constant and variable errors, respectively. With increasing blur, the spatial and temporal variable error, as well as the spatial constant error increased, while the temporal constant error decreased. Because in the first experiment, blur was potentially confounded with contrast, in Experiment 2, we re-ran the experiment with one difference: instead of blur, we included five levels of contrast matched to the blur levels. We found no systematic effects of contrast. Our findings confirm that blurring vision decreases spatial precision and accuracy and that the effects were not mediated by concomitant changes in contrast. However, blurring vision also affected temporal precision and accuracy, thereby questioning the generalizability of the theoretical predictions to the applied interception task.

The role of eye movements in manual interception: A mini-review

When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.

Functional Use of Eye Movements for an Acting System

Movements of the eyes assist vision and support hand and body movements in a cooperative way. Despite their strong functional coupling, different types of movements are usually studied independently. We integrate knowledge from behavioral, neurophysiological, and clinical studies on how eye movements are coordinated with goal-directed hand movements and how they facilitate motor learning. Understanding the coordinated control of eye and hand movements can provide important insights into brain functions that are essential for performing or learning daily tasks in health and disease. This knowledge can also inform applications such as robotic manipulation and clinical rehabilitation.