Eye-hand coordination during flexible manual interception of an abruptly appearing, moving target

Seeing does not mean processing: where we look and the visual information we rely on change independently as we learn a novel walking task

People use vision to inform motor control strategies during walking. With practice performing a target stepping task, people shift their gaze farther ahead, transitioning from watching their feet contact the target to looking for future target locations. The shift in gaze focus suggests the role of vision in motor control changes from emphasizing feedback to feedforward control. The present study examines whether changing visual fixation location is accompanied by a similar change in reliance upon visual information. Twenty healthy young adults practiced stepping on moving targets projected on the surface of a treadmill. Periodically, participants' visual reliance was probed by hiding stepping targets which inform feedback or feedforward (targets < or > 1.5 steps ahead, respectively) motor control strategies. We calculated visual reliance as the increase in step error when targets were hidden. We hypothesized that with practice, participant reliance on feedback visual information would decrease and their reliance on feedforward visual information would increase. Contrary to our hypothesis, participants became significantly more reliant on feedback visual information with practice (p < 0.001) but their reliance on feedforward visual information did not change (p = 0.49). Participants' reliance on visual information increased despite looking significantly farther ahead with practice (p < 0.016). Together, these results suggest that participants fixated on feedback information less. However, changes in fixation pattern did not reduce their reliance upon feedback information as stepping performance still significantly decreased when feedback information was removed after training. These findings provide important context for how the role of vision in controlling walking changes with practice.

Flexible multichannel electrodes for acute recording in nonhuman primates

Flexible electrodes have demonstrated better biocompatibility than rigid electrodes in relieving tissue encapsulation and long-term recording. Nonhuman primates are closer to humans in their brains' structural and functional properties, thus making them more suitable than rodents as animal models for potential clinical usage. However, the application of flexible electrodes on nonhuman primates has rarely been reported. In the present study, a flexible multichannel electrode array for nonhuman primates was developed and implemented for extracellular recording in behaving monkeys. To minimize the window of durotomy for reducing possible risks, a guide-tube-compatible implantation solution was designed to deliver the flexible electrodes through the dura into the cortex. The proposed structure for inserting flexible electrodes was characterized ex vivo and validated in vivo. Furthermore, acute recording of multichannel flexible electrodes for the primates was performed. The results showed that the flexible electrodes and implantation method used in this study meet the needs of extracellular recording in nonhuman primates. Task-related neuronal activities with a high signal-to-noise ratio of spikes demonstrated that our whole device is currently a minimally invasive and clinically viable approach for extracellular recording.

Hierarchical Motion Learning for Goal-Oriented Movements With Speed-Accuracy Tradeoff of a Musculoskeletal System

Generating various goal-oriented movements via the flexible muscle model of the musculoskeletal system as fast and accurately as possible is a pressing problem, which is also the basis of most human adaptive behaviors, such as reaching, catching, interception, and pointing. This article focuses on the adaptive motion generation of fast goal-oriented motion on the musculoskeletal system by implementing the speed-accuracy tradeoff (SAT) in a hierarchical motion learning framework. First, we introduce Fitts' Law into the modified basal ganglia circuit-inspired iterative decision-making model for achieving dynamic and adaptive decision making. Then, as a time constraint, the decision is decomposed into a series of supervised terms by the proposed striatal FSI-SPN interneuron circuit-inspired velocity modulator to implement the tradeoff smoothly on the musculoskeletal system. Finally, an improved policy gradient algorithm is suggested to generate the muscle excitations of the modulated motion via the proposed muscle co-contraction policy, which promotes general cooperation between flexor and extensor muscles. In experiments, a redundant musculoskeletal arm model is trained to perform the adaptive quick pointing movements. By combining the muscle co-contraction policy with SAT, our algorithm shows the most efficient training and the best performance in the adaptive motion generation among the other three popular reinforcement learning algorithms on the musculoskeletal model.

Posterior parietal cortex predicts upcoming movement in dynamic sensorimotor control

SignificanceMost studies in sensorimotor neurophysiology have utilized reactive movements to stationary goals pre-defined by sensory cues, but this approach is fundamentally incapable of determining whether the observed neural activity reflects current sensory stimuli or predicts future movements. In the present study, we recorded single-neuron activity from behaving monkeys engaged in a dynamic, flexible, stimulus-response contingency task that enabled us to distinguish activity co-varying with sensory inflow from that co-varying with motor outflow in the posterior parietal cortex.

From Parametric Representation to Dynamical System: Shifting Views of the Motor Cortex in Motor Control

In contrast to traditional representational perspectives in which the motor cortex is involved in motor control via neuronal preference for kinetics and kinematics, a dynamical system perspective emerging in the last decade views the motor cortex as a dynamical machine that generates motor commands by autonomous temporal evolution. In this review, we first look back at the history of the representational and dynamical perspectives and discuss their explanatory power and controversy from both empirical and computational points of view. Here, we aim to reconcile the above perspectives, and evaluate their theoretical impact, future direction, and potential applications in brain-machine interfaces.

The role of eye movements in manual interception: A mini-review

When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.

More precise tracking of horizontal than vertical target motion with both the eyes and hand

When tracking targets moving in various directions with one's eyes, horizontal components of pursuit are more precise than vertical ones. Is this because horizontal target motion is predicted better or because horizontal movements of the eyes are controlled more precisely? When tracking a visual target with the hand, the eyes also track the target. We investigated whether the directional asymmetries that have been found during isolated eye movements are also present during such manual tracking, and if so, whether individual participants' asymmetry in eye movements is accompanied by a similar asymmetry in hand movements. We examined the data of 62 participants who used a joystick to track a visual target with a cursor. The target followed a smooth but unpredictable trajectory in two dimensions. Both the mean gaze-target distance and the mean cursor-target distance were about 20% larger in the vertical direction than in the horizontal direction. Gaze and cursor both followed the target with a slightly longer delay in the vertical than in the horizontal direction, irrespective of the target's trajectory. The delays of gaze and cursor were correlated, as were their errors in tracking the target. Gaze clearly followed the target rather than the cursor, so the asymmetry in both eye and hand movements presumably results from better predictions of the target's horizontal than of its vertical motion. Altogether this study speaks for the presence of anisotropic predictive processes that are shared across effectors.

Ocular tracking of occluded ballistic trajectories: Effects of visual context and of target law of motion

In tracking a moving target, the visual context may provide cues for an observer to interpret the causal nature of the target motion and extract features to which the visual system is weakly sensitive, such as target acceleration. This information could be critical when vision of the target is temporarily impeded, requiring visual motion extrapolation processes. Here we investigated how visual context influences ocular tracking of motion either congruent or not with natural gravity. To this end, 28 subjects tracked computer-simulated ballistic trajectories either perturbed in the descending segment with altered gravity effects (0g/2g) or retaining natural-like motion (1g). Shortly after the perturbation (550 ms), targets disappeared for either 450 or 650 ms and became visible again until landing. Target motion occurred with either quasi-realistic pictorial cues or a uniform background, presented in counterbalanced order. We analyzed saccadic and pursuit movements after 0g and 2g target-motion perturbations and for corresponding intervals of unperturbed 1g trajectories, as well as after corresponding occlusions. Moreover, we considered the eye-to-target distance at target reappearance. Tracking parameters differed significantly between scenarios: With a neutral background, eye movements did not depend consistently on target motion, whereas with pictorial background they showed significant dependence, denoting better tracking of accelerated targets. These results suggest that oculomotor control is tuned to realistic properties of the visual scene.

Eye movements do not play an important role in the adaptation of hand tracking to a visuomotor rotation

Adapting hand movements to changes in our body or the environment is essential for skilled motor behavior. Although eye movements are known to assist hand movement control, how eye movements might contribute to the adaptation of hand movements remains largely unexplored. To determine to what extent eye movements contribute to visuomotor adaptation of hand tracking, participants were asked to track a visual target that followed an unpredictable trajectory with a cursor using a joystick. During blocks of trials, participants were either allowed to look wherever they liked or required to fixate a cross at the center of the screen. Eye movements were tracked to ensure gaze fixation as well as to examine free gaze behavior. The cursor initially responded normally to the joystick, but after several trials, the direction in which it responded was rotated by 90°. Although fixating the eyes had a detrimental influence on hand tracking performance, participants exhibited a rather similar time course of adaptation to rotated visual feedback in the gaze-fixed and gaze-free conditions. More importantly, there was extensive transfer of adaptation between the gaze-fixed and gaze-free conditions. We conclude that although eye movements are relevant for the online control of hand tracking, they do not play an important role in the visuomotor adaptation of such tracking. These results suggest that participants do not adapt by changing the mapping between eye and hand movements, but rather by changing the mapping between hand movements and the cursor’s motion independently of eye movements.

NEW & NOTEWORTHY Eye movements assist hand movements in everyday activities, but their contribution to visuomotor adaptation remains largely unknown. We compared adaptation of hand tracking under free gaze and fixed gaze. Although our results confirm that following the target with the eyes increases the accuracy of hand movements, they unexpectedly demonstrate that gaze fixation does not hinder adaptation. These results suggest that eye movements have distinct contributions for online control and visuomotor adaptation of hand movements.

Different gaze strategies during eye versus hand tracking of a moving target

The ability to visually track, using smooth pursuit eye movements, moving objects is critical in both perceptual and action tasks. Here, by asking participants to view a moving target or track it with their hand, we tested whether different task demands give rise to different gaze strategies. We hypothesized that during hand tracking, in comparison to eye tracking, the frequency of catch-up saccades would be lower, and the smooth pursuit gain would be greater, because it limits the loss of stable retinal and extra-retinal information due to saccades. In our study participants viewed a visual target that followed a smooth but unpredictable trajectory in a horizontal plane and were instructed to either track the target with their gaze or with a cursor controlled by a manipulandum. Although the mean distance between gaze and target was comparable in both tasks, we found, consistent with our hypothesis, an increase in smooth pursuit gain and a decrease in the frequency of catch-up saccades during hand tracking. We suggest that this difference in gaze behavior arises from different tasks demands. Whereas keeping gaze close to the target is important in both tasks, obtaining stable retinal and extra-retinal information is critical for guiding hand movement.