Large-field visual motion directly induces an involuntary rapid manual following response

Visually induced involuntary arm, head, and torso movements

We explored in 75 s long trials the effects of visually induced self-rotation and displacement (SR&D) on the horizontally extended right arm of standing subjects (N = 12). A "tool condition" was included in which subjects held a long rod. The extent of arm movement was contingent on whether the arm was extended out Freely or Pointing at a briefly proprioceptively specified target position. The results were nearly identical when subjects held the rod. Subjects in the Free conditions showed significant unintentional arm deviations, averaging 55° in the direction opposite the induced illusory self-motion. Deviations in the Pointing conditions were on average a fifth of those in the Free condition. Deviations of head and torso positions also occurred in all conditions. Total arm and head deviations were the sum of deviations of the arm and head with respect to the torso and deviations of the torso with respect to space. Pointing subjects were able to detect and correct for arm and head deviations with respect to the torso but not for the arm and head deviations with respect to space due to deviations of the torso. In all conditions, arm, head, and torso deviations began before subjects experienced SR&D. We relate our findings to being an extension of the manual following response (MFR) mechanism to influence passive arm control and arm target maintenance as well. Visual-vestibular convergence at vestibular nuclei cells and multiple cortical movement related areas can explain our results, MFR results, and classical Pass Pointing. We distinguish two Phases in the induction of SR&D. In Phase 1, the visual stimulation period prior to SR&D onset, the arm, head, and torso deviations are first apparent, circa < 1 s after stimulus begins. They are augmented at the onset of Phase 2 that starts when SR&D is first sensed. In Phase 2, reaching movements first show curved paths that are compensatory for the Coriolis forces that would be generated on the reaching arm were subjects actually physically rotating. These movement deviations are in the opposite direction to the MFR and the arm, head, and torso deviations reported here. Our results have implications for vehicle control in environments that can induce illusory self motion and displacement.

Inverse relation between motion perception and postural responses induced by motion of a touched object

Self vs. external attribution of motions based on vestibular cues is suggested to underlie our coherent perception of object motion and self-motion. However, it remains unclear whether such attribution also underlies sensorimotor responses. Here, we examined this issue in the context of touch. We asked participants to lightly touch a moving object with their thumb while standing still on an unstable surface. We measured both the accuracy of judging the object motion direction and the postural response. If the attribution underlies both object-motion perception and posture control, sensitivity of posture to object motion should decrease with motion speed since high speed motion is unlikely to reflect self-motion. Furthermore, when motion perception is erroneous, there should be a corresponding increase in postural responses. Our results are consistent with these predictions and suggest that self-external attribution of somatosensory motion underlies both object motion perception and postural responses.

Superior performance by two new methods in identifying the online reaction time of reaching movements

Reaching movements can be redirected during their progress to handle unexpected visual changes, such as a change in target location. It is important to know when these redirections start, i.e., the online reaction time (oRT), but this information is not readily evident since redirections are embedded within a time-varying baseline movement that differs from trial to trial. The one previous study that evaluated the performance of different oRT identification methods utilized simulated redirections with the exact same onset, rather than a range of onsets as would be typically encountered. We addressed this gap by utilizing batches of "hybrid" trials with temporal spread in their oRTs. Each hybrid trial combined a sampled baseline movement with an idealized corrective response. Two new methods had the most accurate identification of online reaction times: 1) a threshold-aligned grand mean regression, and 2) a template-based approach we term the canonical correction search. The threshold-aligned grand mean regression is simple to implement and effective. The canonical correction search is a more complex procedure but arguably better linked to the underlying response. Applying the two methods to a published dataset revealed more delayed oRTs than was previously reported along with new information such as the width of oRT distributions. Taken together, our results demonstrate the utility of two new methods for dissecting corrective action from ongoing movement.NEW & NOTEWORTHY Advancing our understanding of visual feedback control requires methods that accurately identify the onset of corrective action. We developed a modified regression approach and a template-based approach to identify the online reaction time of single-reaching movements. Both outperform previous methods when challenged by temporal jitter in the response onset and increased background noise.

Reach Corrections Toward Moving Objects are Faster Than Reach Corrections Toward Instantaneously Switching Targets

Visually guided reaching is a common motor behavior that engages subcortical circuits to mediate rapid corrections. Although these neural mechanisms have evolved for interacting with the physical world, they are often studied in the context of reaching toward virtual targets on a screen. These targets often change position by disappearing from one place reappearing in another instantaneously. In this study, we instructed participants to perform rapid reaches to physical objects that changed position in different ways. In one condition, the objects moved very rapidly from one place to another. In the other condition, illuminated targets instantaneously switched position by being extinguished in one position and illuminating in another. Participants were consistently faster in correcting their reach trajectories when the object moved continuously.

Slightly perturbing the arm influences choices between multiple targets

We constantly make choices about how to interact with objects in the environment. Do we immediately consider changes in our posture when making such choices? To find out, we examined whether motion in the background, which is known to influence the trajectory of goal-directed hand movements, influences participants' choices when suddenly faced with two options. The participants' task was to tap on as many sequentially presented targets as possible within 90 seconds. Sometime after a new target appeared, it split into two targets and participants had to choose which of them to hit. Shortly before the split, the background moved in a way that was expected to result in the finger shifting slightly towards one of the two new targets. We examined whether such shifts influenced the choice between the two targets. The moving background influenced the finger movements in the expected manner: participants moved in the direction of the background motion. It also influenced the choice that participants made between the two targets: participants more frequently chose the target in the direction of the background motion. There was a positive correlation across participants between the magnitude of the response to background motion and the bias to choose the target in the direction of such motion. Thus, people consider sudden changes in their posture when choosing between different movement options.

Done in 65 ms: Express Visuomotor Responses in Upper Limb Muscles in Rhesus Macaques

How rapidly can the brain transform vision into action? Work in humans has established that the transformation for visually-guided reaching can be remarkably rapid, with the first phase of upper limb muscle recruitment, the express visuomotor response, beginning within less than 100 ms of visual target presentation. Such short-latency responses limit the opportunities for extensive cortical processing, leading to the hypothesis that they are generated via the subcortical tecto-reticulo-spinal pathway. Here, we examine whether nonhuman primates (NHPs) exhibit express visuomotor responses. Two male macaques made visually-guided reaches in a behavioral paradigm known to elicit express visuomotor responses in humans, while we acquired intramuscular recordings from the deltoid muscle. Across several variants of this paradigm, express visuomotor responses began within 65 ms (range: 48-91 ms) of target presentation. Although the timing of the express visuomotor response did not co-vary with reaction time, larger express visuomotor responses tended to precede shorter latency reaches. Further, we observed that the magnitude of the express visuomotor response could be muted by contextual context, although this effect was quite variable. Overall, the response properties in NHPs resemble those in humans. Our results establish a new benchmark for visuomotor transformations underlying visually-guided reaches, setting the stage for experiments that can directly compare the role of cortical and subcortical areas in reaching when time is of the essence.

Decoding self-motion from visual image sequence predicts distinctive features of reflexive motor responses to visual motion

Visual motion analysis is crucial for humans to detect external moving objects and self-motion which are informative for planning and executing actions for various interactions with environments. Here we show that the image motion analysis trained to decode the self-motion during human natural movements by a convolutional neural network exhibits similar specificities with the reflexive ocular and manual responses induced by a large-field visual motion, in terms of stimulus spatiotemporal frequency tuning. The spatiotemporal frequency tuning of the decoder peaked at high-temporal and low-spatial frequencies, as observed in the reflexive ocular and manual responses, but differed significantly from the frequency power of the visual image itself and the density distribution of self-motion. Further, artificial manipulations of the learning data sets predicted great changes in the specificity of the spatiotemporal tuning. Interestingly, despite similar spatiotemporal frequency tunings in the vertical-axis rotational direction and in the transversal direction to full-field visual stimuli, the tunings for center-masked stimuli were different between those directions, and the specificity difference is qualitatively similar to the discrepancy between ocular and manual responses, respectively. In addition, the representational analysis demonstrated that head-axis rotation was decoded by relatively simple spatial accumulation over the visual field, while the transversal motion was decoded by more complex spatial interaction of visual information. These synthetic model examinations support the idea that visual motion analyses eliciting the reflexive motor responses, which are critical in interacting with the external world, are acquired for decoding self-motion.

Body and visual instabilities functionally modulate implicit reaching corrections

Hierarchical brain-information-processing schemes have frequently assumed that the flexible but slow voluntary action modulates a direct sensorimotor process that can quickly generate a reaction in dynamical interaction. Here we show that the quick visuomotor process for manual movement is modulated by postural and visual instability contexts that are related but remote and prior states to manual movements. A preceding unstable postural context significantly enhanced the reflexive manual response induced by a large-field visual motion during hand reaching while the response was evidently weakened by imposing a preceding random-visual-motion context. These modulations are successfully explained by the Bayesian optimal formulation in which the manual response elicited by visual motion is ascribed to the compensatory response to the estimated self-motion affected by the preceding contextual situations. Our findings suggest an implicit and functional mechanism that links the variability and uncertainty of remote states to the quick sensorimotor transformation.

Daily fluctuations in visual motion discriminability contribute to daily fluctuations in continuous visuomotor performance

In ball sports such as table tennis, in which a ball moving at high speed is hit, an athlete's brain needs to process the motion information of the ball, predict the arrival point, and form a motor command to direct the racket there. Therefore, day-to-day fluctuations in visuomotor performance may be ascribed to fluctuations in visual motion discriminability, but it is not clear how the two are related. To examine this point, university table tennis players performed a motion direction discrimination (MDD) task and continuous visuomotor (CVM) task over 10 days as an estimation of visual motion discriminability and visuomotor performance, respectively. In the MDD task, using a joystick, participants distinguished the direction of a global coherent motion of target dots moving in the same direction on a PC monitor from innumerable dots moving in random directions. In the CVM task, participants hit sequential targets moving fast from right to left on the PC monitor by operating the cursor on the left side of the monitor up and down using the prehensile force of their thumb and index finger. The scores in the MDD and CVM tasks fluctuated day by day and showed a significant and moderate correlation between the MDD task score for the visual field in which the participants captured the target in the CVM task and the CVM task score. This correlation was confirmed even with the target moving from left to right. The fluctuations in the onset latency and the endpoint position of the cursor movement approaching the target were correlated with those of the visual motion discriminability, suggesting the contribution of motion vision to the speed and accuracy of the visuomotor performance. Moreover, these relationships were prominent in veteran players. For table tennis athletes, especially experienced players, fluctuations in the visual motion discrimination performance in a visual field specific for capturing a ball may be responsible for the fluctuations in continuous visuomotor (striking) performance.

How similar are responses to background motion and target displacements?

When making a goal-directed movement towards a target, our hand follows abrupt background motion. This response resembles that of a shift in the target’s position. Does background motion simply change the position towards which the movement is guided? If so, the response to background motion should resemble the response to a target displacement. To find out whether this is the case, we ran two exploratory studies where we asked participants to hit a moving target at a specified moment. At various times during the hand’s movement, the background could move briefly at one of several speeds, and for various durations. The response to abrupt background motion was larger when the background moved later in the movement and when the background moved faster, in line with known responses to target displacements. The response to a second epoch of background motion was smaller than it would have been if there had been no first epoch, in contrast to responses to multiple target displacements. If the background was already moving before the target appeared, the hand even moved in the opposite direction. Thus, the response to background motion and that to a target displacement are clearly not identical, but they do share several features.

Contextual cues are not unique for motor learning: Task-dependant switching of feedback controllers

The separation of distinct motor memories by contextual cues is a well known and well studied phenomenon of feedforward human motor control. However, there is no clear evidence of such context-induced separation in feedback control. Here we test both experimentally and computationally if context-dependent switching of feedback controllers is possible in the human motor system. Specifically, we probe visuomotor feedback responses of our human participants in two different tasks—stop and hit—and under two different schedules. The first, blocked schedule, is used to measure the behaviour of stop and hit controllers in isolation, showing that it can only be described by two independent controllers with two different sets of control gains. The second, mixed schedule, is then used to compare how such behaviour evolves when participants regularly switch from one task to the other. Our results support our hypothesis that there is contextual switching of feedback controllers, further extending the accumulating evidence of shared features between feedforward and feedback control.

Extensive evidence has demonstrated that humans can learn distinct motor memories (i.e. independent feedforward controllers) using contextual cues. However, there is little evidence that such contextual cues produce similar separation of feedback controllers. As accumulating evidence highlights the connection between feedforward and feedback control, we propose that context may be used to separate feedback controllers as well. It has not been trivial to test experimentally whether a change in context also modulates the feedback control, as the controller output is affected by other non-contextual factors such as movement kinematics, time-to-target or the properties of the perturbation used to probe the control. Here we present a computational approach based on normative modelling where we separate the effects of the context from other non-contextual effects on the visuomotor feedback system. We then show experimentally that task context independently modulates the feedback control in a particular manner that can be reliably predicted using optimal feedback control.

The Effect of Target Velocity on the Fast Corrective Response during Reaching Movement

Online motor control is often required to correct errors in rapid adjustments during reaching movements. It has been established that the initial arm trajectory during reaching is corrected by a target displacement. Since this corrective response occurs without perception of target perturbation, this is regarded as an automatic response. However, an object rarely "jumps" in daily life, rather it often "moves" as a chronological change of the position that causes visual motion. Therefore, the purpose of this study was to investigate whether the implicit visuomotor response is induced by target motion stimuli and to clarify the effects of target motion velocity on initial arm trajectory. Participants were asked to move a cursor from a start circle to a visual target. The target moved either leftward or rightward when the cursor passed 20 mm from the start circle. Four target velocities (10, 20, 30, 40 deg/s) were randomly presented. Our results showed that the initial velocity (first 50 ms) of the fast corrective response increased with the target velocity. Therefore, it is indicated that the fast corrective response is induced by the target motion stimulus with a short latency and its amplitude is dependent on the target velocity.

Hand movements respond to any motion near the endpoint

Hand movements are pulled in the direction of motion near their planned endpoints. Is this an automatic response to motion signals near those positions, or do we consider what is moving? To find out, we asked participants to hit a target that moved rightward across a patterned surface when it reached an interception zone that was indicated by a circle. The circle was initially at the center of a square. The square was either filled, occluding the patterned surface (tile), or open, such that the patterned surface was not occluded (frame). The square briefly moved leftward or rightward shortly after the target appeared. Thus, participants were either aiming to hit the target on the surface that moved (the tile) or to hit the target on the patterned surface that did not move. Moving the two types of squares produced very similar local motion signals, but for the tile this could be interpreted as motion of an extended surface, while for the frame it could not. Motion onset of the two types of squares yielded very similar responses. Increasing the size of the square, and thus the eccentricity of the local motion signal, reduced the magnitude of the response. Since this reduction was seen for both types of squares, the surface on which the interception zone was presented was clearly not considered. We conclude that the response is driven by local motion signals near the endpoint of the action without considering whether the local surface is moving.

Spatial Accuracy of Predictive Saccades Determines the Performance of Continuous Visuomotor Action

In a table tennis rally, players perform interceptive actions on a moving ball continuously in a short time, such that the acquisition process of visual information is an important determinant of the performance of the action. However, because it is technically hard to measure gaze movement in a real game, little is known about how gaze behavior is conducted during the continuous visuomotor actions and contributes to the performance. To examine these points, we constructed a novel psychophysical experiment model enabling a continuous visuomotor task without spatial movement of any body parts, including the arm and head, and recorded the movement of the gaze and effector simultaneously at high spatiotemporal resolution. In the task, Gabor patches (target) moved one after another at a constant speed from right to left at random vertical positions on an LC display. Participants hit the target with a cursor moving vertically on the left side of the display by controlling their prehensile force on a force sensor. Participants hit the target with the cursor using a rapid-approaching movement (rapid cursor approach, RCA). Their gaze also showed rapid saccadic approaching movement (saccadic eye approach, SEA), reaching the predicted arrival point of the target earlier than the cursor. The RCA reached in or near the Hit zone in the successful (Hit) trial, but ended up away from it in the unsuccessful (Miss) trial, suggesting the spatial accuracy of the RCA determines the task's success. The SEA in the Hit trial ended nearer the target than the Miss trial. The spatial accuracy of the RCA diminished when the target disappeared 100 ms just after the end of the SEA, suggesting that visual information acquired after the saccade acted as feedback information to correct the cursor movement online for the cursor to reach the target. There was a target speed condition that the target disappearance did not compromise RCA's spatial accuracy, implying the possible RCA correction based on the post-saccadic gaze location information. These experiments clarified that gaze behavior conducted during fast continuous visuomotor actions enables online correction of the ongoing interceptive movement of an effector, improving visuomotor performance.

Spatial Accuracy of Predictive Saccades Determines the Performance of Continuous Visuomotor Action

In a table tennis rally, players perform interceptive actions on a moving ball continuously in a short time, such that the acquisition process of visual information is an important determinant of the performance of the action. However, because it is technically hard to measure gaze movement in a real game, little is known about how gaze behavior is conducted during the continuous visuomotor actions and contributes to the performance. To examine these points, we constructed a novel psychophysical experiment model enabling a continuous visuomotor task without spatial movement of any body parts, including the arm and head, and recorded the movement of the gaze and effector simultaneously at high spatiotemporal resolution. In the task, Gabor patches (target) moved one after another at a constant speed from right to left at random vertical positions on an LC display. Participants hit the target with a cursor moving vertically on the left side of the display by controlling their prehensile force on a force sensor. Participants hit the target with the cursor using a rapid-approaching movement (rapid cursor approach, RCA). Their gaze also showed rapid saccadic approaching movement (saccadic eye approach, SEA), reaching the predicted arrival point of the target earlier than the cursor. The RCA reached in or near the Hit zone in the successful (Hit) trial, but ended up away from it in the unsuccessful (Miss) trial, suggesting the spatial accuracy of the RCA determines the task's success. The SEA in the Hit trial ended nearer the target than the Miss trial. The spatial accuracy of the RCA diminished when the target disappeared 100 ms just after the end of the SEA, suggesting that visual information acquired after the saccade acted as feedback information to correct the cursor movement online for the cursor to reach the target. There was a target speed condition that the target disappearance did not compromise RCA's spatial accuracy, implying the possible RCA correction based on the post-saccadic gaze location information. These experiments clarified that gaze behavior conducted during fast continuous visuomotor actions enables online correction of the ongoing interceptive movement of an effector, improving visuomotor performance.

Integration of proprioceptive and visual feedback during online control of reaching

Visual and proprioceptive feedback both contribute to perceptual decisions, but it remains unknown how these feedback signals are integrated together or consider factors such as delays and variance during online control. We investigated this question by having participants reach to a target with randomly applied mechanical and/or visual disturbances. We observed that the presence of visual feedback during a mechanical disturbance did not increase the size of the muscle response significantly but did decrease variance, consistent with a dynamic Bayesian integration model. In a control experiment, we verified that vision had a potent influence when mechanical and visual disturbances were both present but opposite in sign. These results highlight a complex process for multisensory integration, where visual feedback has a relatively modest influence when the limb is mechanically disturbed, but a substantial influence when visual feedback becomes misaligned with the limb.

NEW & NOTEWORTHY Visual feedback is more accurate, but proprioceptive feedback is faster. How should you integrate these sources of feedback to guide limb movement? As predicted by dynamic Bayesian models, the size of the muscle response to a mechanical disturbance was essentially the same whether visual feedback was present or not. Only under artificial conditions, such as when shifting the position of a cursor representing hand position, can one observe a muscle response from visual feedback.

The response to background motion: Characteristics of a movement stabilization mechanism

When making goal-directed movements toward a target, our hand deviates from its path in the direction of sudden background motion. We propose that this manual following response arises because ongoing movements are constantly guided toward the planned movement endpoint. Such guidance is needed to compensate for modest, unexpected self-motion. Our proposal is that the compensation for such self-motion does not involve a sophisticated analysis of the global optic flow. Instead, we propose that any motion in the vicinity of the planned endpoint is attributed to the endpoint's egocentric position having shifted in the direction of the motion. The ongoing movement is then stabilized relative to the shifted endpoint. In six experiments, we investigate what aspects of motion determine this shift of planned endpoint. We asked participants to intercept a moving target when it reached a certain area. During the target's motion, background structures briefly moved either leftward or rightward. Participants’ hands responded to background motion even when each background structure was only briefly visible or when the vast majority of background structures remained static. The response was not restricted to motion along the target's path but was most sensitive to motion close to where the target was to be hit, both in the visual field and in depth. In this way, a movement stabilization mechanism provides a comprehensive explanation of many aspects of the manual following response.

Contribution of Retinal Motion to the Impulse Control of Target-Directed Aiming

Contemporary models of sensorimotor control contend that visually regulated movement adjustments may unfold early during a target-directed limb movement through an impulse control process that makes use of anticipatory forward models. To date, evidence surrounding impulse control has involved adjustments to a purported misperception in limb velocity following the unexpected onset of a moving background. That is, the limb is perceived to move faster and undershoots more when there is an incongruent moving background and vice versa. However, this particular behavior may manifest from an independent oculo-manual-following response. The present study aimed to deconstruct these proposals and, with them, the processes that underlie impulse control. Participants had to rapidly reach upward to land their index finger accurately on a target. On 33% of trials, the background, over which the movement was made, moved either up, down, right, or left. Displacements in the primary and perpendicular directions of movement showed spatial trajectories that were consistent with the directions of the moving backgrounds. This behavior was most prevalent in measurements taken at the movements’ peak negative acceleration and endpoints. Moreover, analysis of standardized displacements in the moving background conditions indicated no significant differences in the extent of the movements toward each of the moving backgrounds. These findings indicate that movement adjustments can manifest from an oculo-manual-following response rather than a misperception of limb velocity. We suggest that the anticipatory forward model that comprises impulse control may incorporate features of the environment that surround the vicinity of the limb.

Enhancement of Anticipatory Postural Adjustments by Virtual Reality in Older Adults with Cognitive and Motor Deficits: A Randomised Trial

BACKGROUND

Postural activities involved in balance control integrate the anticipatory postural adjustments (APA) that stabilize balance and posture, facilitating arm movements and walking initiation and allowing an optimal coordination between posture and movement. Several studies reported the significant benefits of virtual reality (VR) exercises in frail older adults to decrease the anxiety of falling and to induce improvements in behavioural and cognitive abilities in rehabilitation processes. The aim of this study was thus to test the efficiency of a VR system on the enhancement of the APA period, compared to the use of a Nintendo Wii system.

METHODS

Frail older adults (n = 37) were included in this study who were randomized and divided into a VR exercises group (VR group) or a control group using the Nintendo Wii system (CTRL group). Finally, 22 patients were included in the data treatment. APA were studied through muscular activation timings measured with electromyographic activities. The functional reach test, the gait speed, and the time up and go were also evaluated before and after a 3-week training phase.

RESULTS AND DISCUSSION

As the main results, the training phase with VR improved the APA and the functional reach test score along the antero-posterior axis. Together, these results highlight the ability of a VR training phase to induce neuromuscular adaptations during the APA period in frail older adults. Then, it underlines the effective transfer from learning carried out during the VR training movements to control balance abilities in a more daily life context.

Preparatory activity links the frontal eye field response with small amplitude motor unit recruitment of neck muscles during gaze planning

A hallmark of intelligent behavior is that we can separate intention from action. To understand the mechanism that gates the flow of information between motor planning and execution, we compared the activity of frontal eye field neurons with motor unit activity from neck muscles in the presence of an intervening delay period in which spatial information regarding the target was available to plan a response. Although spatially specific delay period activity was present in the activity of frontal eye field neurons, it was absent in motor unit activity. Nonetheless, motor unit activity was correlated with the time it took to initiate saccades. Interestingly, we observed a heterogeneity of responses among motor units, such that only units with smaller amplitudes showed a clear modulation during the delay period. These small amplitude motor units also had higher spontaneous activity compared with the units which showed modulation only during the movement epoch. Taken together, our results suggest the activity of smaller motor units convey temporal information and explains how the delay period primes muscle activity leading to faster reaction times.NEW & NOTEWORTHY This study shows that the temporal aspects of a motor plan in the oculomotor circuitry can be accessed by peripheral neck muscles hundreds of milliseconds before the instruction to initiate a saccadic eye movement. The coupling between central and peripheral processes during the delay time is mediated by the recruitment pattern of motor units with smaller amplitude. These findings suggest that information processed in cortical areas could be read from periphery before execution.

Can ongoing movements be guided by allocentric visual information when the target is visible?

People use both egocentric (object-to-self) and allocentric (object-to-object) spatial information to interact with the world. Evidence for allocentric information guiding ongoing actions stems from studies in which people reached to where targets had previously been seen while other objects were moved. Since egocentric position judgments might fade or change when the target is removed, we sought for conditions in which people might benefit from relying on allocentric information when the target remains visible. We used a task that required participants to intercept targets that moved across a screen using a cursor that represented their finger but that moved by a different amount in a different plane. During each attempt, we perturbed the target, cursor, or background individually or all three simultaneously such that their relative positions did not change and there was no need to adjust the ongoing movement. An obvious way to avoid responding to such simultaneous perturbations is by relying on allocentric information. Relying on egocentric information would give a response that resembles the combined responses to the three isolated perturbations. The hand responded in accordance with the responses to the isolated perturbations despite the differences between how the finger and cursor moved. This response remained when the simultaneous perturbation was repeated many times, suggesting that participants hardly relied upon allocentric spatial information to control their ongoing visually guided actions.

Visuomotor control of intermittent circular tracking movements with visually guided orbits in 3D VR environment

The analysis of visually guided tracking movements is important to the understanding of imitation exercises and movements carried out using the human visuomotor control system. In this study, we analyzed the characteristics of visuomotor control in the intermittent performance of circular tracking movements by applying a system that can differentiate between the conditions of invisible and visible orbits and visible and invisible target phases implemented in a 3D VR space. By applying visuomotor control based on velocity control, our study participants were able to track objects with visible orbits with a precision of approximately 1.25 times greater than they could track objects with invisible orbits. We confirmed that position information is an important parameter related to intermittent motion at low speeds (below 0.5 Hz) and that tracked target velocity information could be obtained more precisely than position information at speeds above 0.5 Hz. Our results revealed that the feedforward (FF) control corresponding to velocity was delayed under the visible-orbit condition at speeds over 0.5 Hz, suggesting that, in carrying out imitation exercises and movements, the use of visually presented 3D guides can interfere with exercise learning and, therefore, that the effects of their use should be carefully considered.

The relationship between the implicit visuomotor control and the motor planning accuracy

It has been well established that an implicit motor response can be elicited by a target perturbation or a visual background motion during a reaching movement. Computational studies have suggested that the mechanism of this response is based on the error signal between the efference copy and the actual sensory feedback. If the implicit motor response is based on the efference copy, the motor command accuracy would affect the amount of the modulation of the motor response. Therefore, the purpose of the current study was to investigate the relationship between the implicit motor response and the motor planning accuracy. We used a memory-guided reaching task and a manual following response (MFR) which is induced by visual grating motion. Participants performed reaching movements toward a memorized-target location with a beep cue which was presented 0 or 3 s after the target disappeared (0-s delay and 3-s delay conditions). Leftward or rightward visual grating motion was applied 400 ms after the cue. In addition, an event-related potential (ERP) was recorded during the reaching task, which reflects the motor command accuracy. Our results showed that the N170 ERP amplitude in the parietal electrodes and the MFR amplitude were significantly larger for the 3-s delay condition than the 0-s delay condition. These results suggest that the motor planning accuracy affects the amount of the implicit visuomotor response. Furthermore, there was a significant within-subjects correlation between the MFR and the N170 amplitude, which could corroborate the relationship between the implicit motor response and the motor planning accuracy.

Consistent Hand Dynamics Are Achieved by Controlling Variabilities Among Joint Movements During Fastball Pitching

This study aimed to determine whether covariations among joint movements are utilized to stabilize hand orientation and movement and to determine which of the upper or lower extremities make effective use of the covariation. Joint angles during pitching were measured in 12 skilled baseball pitchers, using a motion capture system. The joint angles in 10 successful trials were used for the reconstructed motions. The reconstructed motion in the first condition was the same as for the measured motion. In the second condition, the reconstructed motion was generated with joint angles that were pseudo-randomly selected to artificially break off covariation in the measured joint-angle combination. In the third and fourth conditions, the reconstructed motions were generated with the same joint-angle combinations as the measured angles in the throwing arm and the stride leg, respectively, but pseudo-randomly selected in the other joint angles. Ten reconstructed motions were generated for each condition. Standard deviations (SDs) of hand orientation and movement direction were calculated and compared among the conditions. All SDs for the first condition were the smallest among the conditions, indicating that the movements in the measured condition used the covariation in joint angles to make the hand movement stable. The results also illustrated that some SDs in the fourth condition were smaller than those in the third condition, suggesting that the lower extremity made effective use of the covariation. These results imply that it is necessary not only to reduce variability in each joint but also to regulate joint movements to stabilize hand orientation and movement.

Voluntary modification of rapid tactile-motor responses during reaching differs from its visuomotor counterpart

People commonly hold and manipulate a variety of objects in everyday life, and these objects have different physical properties. To successfully control this wide range of objects, people must associate new patterns of tactile stimuli with appropriate motor outputs. We performed a series of experiments investigating the extent to which people can voluntarily modify tactile-motor associations in the context of a rapid tactile-motor response guiding the hand to a moving target (previously described in Pruszynski JA, Johansson RS, Flanagan JR. Curr Biol 26: 788-792, 2016) by using an anti-reach paradigm in which participants were instructed to move their hands in the opposite direction of a target jump. We compared performance to that observed when people make visually guided reaches to a moving target (cf. Day BL, Lyon IN. Exp Brain Res 130: 159-168, 2000; Pisella L, Grea H, Tilikete C, Vighetto A, Desmurget M, Rode G, Boisson D, Rossetti Y. Nat Neurosci 3: 729-736, 2000). When participants had visual feedback, motor responses during the anti-reach task showed early automatic responses toward the moving target before later modification to move in the instructed direction. When the same participants had only tactile feedback, however, they were able to suppress this early phase of the motor response, which occurs <100 ms after the target jump. Our results indicate that while the tactile motor and visual motor systems both support rapid responses that appear similar under some conditions, the circuits underlying responses show sharp distinctions in terms of their malleability.NEW & NOTEWORTHY When people reach toward a visual target that moves suddenly, they automatically correct their reach to follow the object; even when explicitly instructed not to follow a moving visual target, people exhibit an initial incorrect movement before moving in the correct direction. We show that when people use tactile feedback, they do not show an initial incorrect response, even though early muscle activity still occurs.

Visually-updated hand state estimates modulate the proprioceptive reflex independently of motor task requirements

Fast signaling from vision and proprioception to muscle activation plays essential roles in quickly correcting movement. Though many studies have demonstrated modulation of the quick sensorimotor responses as depending on context in each modality, the contribution of multimodal information has not been established. Here, we examined whether state estimates contributing to stretch reflexes are represented solely by proprioceptive information or by multimodal information. Unlike previous studies, we newly found a significant stretch-reflex attenuation by the distortion and elimination of visual-feedback without any change in motor tasks. Furthermore, the stretch-reflex amplitude reduced with increasing elimination durations which would degrade state estimates. By contrast, even though a distortion was introduced in the target-motor-mapping, the stretch reflex was not simultaneously attenuated with visuomotor reflex. Our results therefore indicate that the observed stretch-reflex attenuation is specifically ascribed to uncertainty increase in estimating hand states, suggesting multimodal contributions to the generation of stretch reflexes.

Stimulus-Locked Responses on Human Upper Limb Muscles and Corrective Reaches Are Preferentially Evoked by Low Spatial Frequencies

In situations requiring immediate action, humans can generate visually-guided responses at remarkably short latencies. Here, to better understand the visual attributes that best evoke such rapid responses, we recorded upper limb muscle activity while participants performed visually-guided reaches towards Gabor patches composed of differing spatial frequencies (SFs). We studied reaches initiated from a stable posture (experiment 1, a static condition), or during on-line reach corrections to an abruptly displaced target (experiment 2, a dynamic condition). In both experiments, we detail the latency and prevalence of stimulus-locked responses (SLRs), which are brief bursts of EMG activity that are time-locked to target presentation rather than movement onset. SLRs represent the first wave of EMG recruitment influenced by target presentation, and enable quantification of rapid visuomotor transformations. In both experiments, reach targets composed of low SFs elicited the shortest latency and most prevalent SLRs, with SLR latency increasing and SLR prevalence decreasing for reach targets composed of progressively higher SFs. SLRs could be evoked in either the static or dynamic condition, and when present in experiment 2, were associated with shorter latency and larger magnitude corrections. The results in experiment 2 are consistent with a linkage between the forces produced by SLRs and the earliest portion of on-line reach corrections. Overall, our results demonstrate that stimuli composed of low SFs preferentially evoke the most rapid visuomotor responses that, in the context of rapidly correcting an on-going reaching movement, are associated with earlier and larger on-line reach corrections.

Visual Feedback Processing of the Limb Involves Two Distinct Phases

Muscle responses to mechanical disturbances exhibit two distinct phases: a response starting at ~20 ms that is fairly stereotyped, and a response starting at ~60 ms modulated by many behavioral contexts including goal-redundancy and environmental obstacles. Muscle responses to disturbances of visual feedback of the hand arise within ~90 ms. However, little is known whether these muscle responses are sensitive to behavioral contexts. We had 49 human participants (27 male) execute goal-directed reaches with visual feedback of their hand presented as a cursor. On random trials, the cursor jumped laterally to the reach direction, and thus, required a correction to attain the goal. The first experiment demonstrated that the response amplitude starting at 90 ms scaled with jump magnitude, but only for jumps <2 cm. For larger jumps, the duration of the muscle response scaled with the jump size starting after 120 ms. The second experiment demonstrated that the early response was sensitive to goal redundancy as wider targets evoked a smaller corrective response. The third experiment demonstrated that the early response did not consider the presence of obstacles, as this response routinely drove participants directly to the goal even though this path was blocked by an obstacle. Instead, the appropriate muscle response to navigate around the obstacle started after 120 ms. Our findings highlight that visual feedback of the limb involves two distinct phases: a response starting at 90 ms with limited sensitivity to jump magnitude and sensitive to goal-redundancy, and a response starting at 120 ms with increased sensitivity to jump magnitude and environmental factors.SIGNIFICANCE STATEMENT The motor system can integrate proprioceptive feedback to guide an ongoing action in ~60 ms and is flexible to a broad range of behavioral contexts. In contrast, the present study identified that the motor response to a visual disturbance exhibits two distinct phases: an early response starting at 90 ms with limited scaling with disturbance size and sensitivity to goal-redundancy, and a slower response starting after 120 ms with increased sensitivity to disturbance size and sensitive to environmental obstacles. These data suggest visual feedback of the hand is processed through two distinct feedback processes.

Distinct temporal developments of visual motion and position representations for multi-stream visuomotor coordination

A fundamental but controversial question in information coding of moving visual target is which of 'motion' or 'position' signal is employed in the brain for producing quick motor reactions. Prevailing theory assumed that visually guided reaching is driven always via target position representation influenced by various motion signals (e.g., target texture and surroundings). To rigorously examine this theory, we manipulated the nature of the influence of internal texture motion on the position representation of the target in reaching correction tasks. By focusing on the difference in illusory position shift of targets with the soft- and hard-edges, we succeeded in extracting the temporal development of an indirect effect only ascribed to changes in position representation. Our data revealed that the onset of indirect effect is significantly slower than the adjustment onset itself. This evidence indicates multi-stream processing in visuomotor control: fast and direct contribution of visual motion for quick action initiation, and relatively slow contribution of position representation updated by relevant motion signals for continuous action regulation. The distinctive visuomotor mechanism would be crucial in successfully interacting with time-varying environments in the real world.

Is the manual following response an attempt to compensate for inferred self-motion?

If the surrounding of a visual target unexpectedly starts to move during a fast goal-directed hand movement, the hand reflexively moves along with it. This is known as the ‘manual following response’. One explanation for this response is that it is a compensation for inferred self-motion in space. Previous studies have shown that background motion gives rise to both postural responses and deviations in goal-directed hand movements. To evaluate whether compensation for inferred self-motion is responsible for the manual responses we examined whether galvanic stimulation of the vestibular system would give rise to similar deviations in hand movements. Standing participants tried to quickly tap on targets that were presented on a horizontal screen. Participants could infer self-motion on some of the trials, either from galvanic vestibular stimulation or from background motion. Both perturbations took place during the hand movement. It took both the head and hand about 45 ms longer to respond to background motion than to respond to galvanic stimulation. The head responded in a similar manner to both types of perturbations. The hand responded about as expected to galvanic stimulation, but much more vigorously to background motion. Thus, the manual response to background motion is probably not a direct consequence of trying to compensate for inferred self-motion. Perhaps the manual following response is a consequence of an error in binding motion information to objects.

Proprioceptive loss and the perception, control and learning of arm movements in humans: evidence from sensory neuronopathy

It is uncertain how vision and proprioception contribute to adaptation of voluntary arm movements. In normal participants, adaptation to imposed forces is possible with or without vision, suggesting that proprioception is sufficient; in participants with proprioceptive loss (PL), adaptation is possible with visual feedback, suggesting that proprioception is unnecessary. In experiment 1 adaptation to, and retention of, perturbing forces were evaluated in three chronically deafferented participants. They made rapid reaching movements to move a cursor toward a visual target, and a planar robot arm applied orthogonal velocity-dependent forces. Trial-by-trial error correction was observed in all participants. Such adaptation has been characterized with a dual-rate model: a fast process that learns quickly, but retains poorly and a slow process that learns slowly and retains well. Experiment 2 showed that the PL participants had large individual differences in learning and retention rates compared to normal controls. Experiment 3 tested participants’ perception of applied forces. With visual feedback, the PL participants could report the perturbation’s direction as well as controls; without visual feedback, thresholds were elevated. Experiment 4 showed, in healthy participants, that force direction could be estimated from head motion, at levels close to the no-vision threshold for the PL participants. Our results show that proprioceptive loss influences perception, motor control and adaptation but that proprioception from the moving limb is not essential for adaptation to, or detection of, force fields. The differences in learning and retention seen between the three deafferented participants suggest that they achieve these tasks in idiosyncratic ways after proprioceptive loss, possibly integrating visual and vestibular information with individual cognitive strategies.

Postural responses to target jumps and background motion in a fast pointing task

When reaching towards an object while standing, one’s hand responds very quickly to visual perturbations such as the target being displaced or the background moving. Such responses require postural adjustments. When the background moves, its motion might be attributed to self-motion in a stable world, and thereby induce compensatory postural adjustments that affect the hand. The changes in posture associated with a given hand movement response may, therefore, be different for the two types of perturbations. To see whether they are, we asked standing participants to move their hand in the sagittal direction away from their body to targets displayed on a horizontal screen in front of them. The target displacements and background motion were in the lateral direction. We found hand movement responses that were in line with earlier reports, with a latency that was slightly shorter for target displacements than for background motion, and that was independent of target displacement size or background motion speed. The trunk responded to both perturbations with a modest lateral sway. The two main findings were that the upper trunk responded even before the hand did so and that the head responded to background motion but hardly responded to target displacements. These findings suggest that postural adjustments associated with adjusting the hand movement precede the actual adjustments to the movement of the hand, while at the same time, participants try to keep their head stable on the basis of visual information.

Aging and Sensitivity to Illusory Target Motion With or Without Secondary Tasks

Older individuals seem to find it more difficult to ignore inaccurate sensory cues than younger individuals. We examined whether this could be quantified using an interception task. Twenty healthy young adults (age 18–34) and twenty-four healthy older adults (age 60–82) were asked to tap on discs that were moving downwards on a screen with their finger. Moving the background to the left made the discs appear to move more to the right. Moving the background to the right made them appear to move more to the left. The discs disappeared before the finger reached the screen, so participants had to anticipate how the target would continue to move. We examined how misjudging the disc’s motion when the background moves influenced tapping. Participants received veridical feedback about their performance, so their sensitivity to the illusory motion indicates to what extent they could ignore the task-irrelevant visual information. We expected older adults to be more sensitive to the illusion than younger adults. To investigate whether sensorimotor or cognitive load would increase this sensitivity, we also asked participants to do the task while standing on foam or counting tones. Background motion influenced older adults more than younger adults. The secondary tasks did not increase the background’s influence. Older adults might be more sensitive to the moving background because they find it more difficult to ignore irrelevant sensory information in general, but they may rely more on vision because they have less reliable proprioceptive and vestibular information.

Rapid visuomotor feedback gains are tuned to the task dynamics

Here, we test whether rapid visuomotor feedback responses are selectively tuned to the task dynamics. The responses do not exhibit gain scaling, but they do vary with the level and stability of task dynamics. Moreover, these feedback gains are independently tuned to perturbations to the left and right, depending on these dynamics. Our results demonstrate that the sensorimotor control system regulates the feedback gain as part of the adaptation process, tuning them appropriately to the environment.

Adaptation to novel dynamics requires learning a motor memory, or a new pattern of predictive feedforward motor commands. Recently, we demonstrated the upregulation of rapid visuomotor feedback gains early in curl force field learning, which decrease once a predictive motor memory is learned. However, even after learning is complete, these feedback gains are higher than those observed in the null field trials. Interestingly, these upregulated feedback gains in the curl field were not observed in a constant force field. Therefore, we suggest that adaptation also involves selectively tuning the feedback sensitivity of the sensorimotor control system to the environment. Here, we test this hypothesis by measuring the rapid visuomotor feedback gains after subjects adapt to a variety of novel dynamics generated by a robotic manipulandum in three experiments. To probe the feedback gains, we measured the magnitude of the motor response to rapid shifts in the visual location of the hand during reaching. While the feedback gain magnitude remained similar over a larger than a fourfold increase in constant background load, the feedback gains scaled with increasing lateral resistance and increasing instability. The third experiment demonstrated that the feedback gains could also be independently tuned to perturbations to the left and right, depending on the lateral resistance, demonstrating the fractionation of feedback gains to environmental dynamics. Our results show that the sensorimotor control system regulates the gain of the feedback system as part of the adaptation process to novel dynamics, appropriately tuning them to the environment.

NEW & NOTEWORTHY Here, we test whether rapid visuomotor feedback responses are selectively tuned to the task dynamics. The responses do not exhibit gain scaling, but they do vary with the level and stability of task dynamics. Moreover, these feedback gains are independently tuned to perturbations to the left and right, depending on these dynamics. Our results demonstrate that the sensorimotor control system regulates the feedback gain as part of the adaptation process, tuning them appropriately to the environment.

A Trial-by-Trial Window into Sensorimotor Transformations in the Human Motor Periphery

The appearance of a novel visual stimulus generates a rapid stimulus-locked response (SLR) in the motor periphery within 100 ms of stimulus onset. Here, we recorded SLRs from an upper limb muscle while humans reached toward (pro-reach) or away (anti-reach) from a visual stimulus. The SLR on anti-reaches encoded the location of the visual stimulus rather than the movement goal. Further, SLR magnitude was attenuated when subjects reached away from rather than toward the visual stimulus. Remarkably, SLR magnitudes also correlated with reaction times on both pro-reaches and anti-reaches, but did so in opposite ways: larger SLRs preceded shorter latency pro-reaches but longer latency anti-reaches. Although converging evidence suggests that the SLR is relayed via a tectoreticulospinal pathway, our results show that task-related signals modulate visual signals feeding into this pathway. The SLR therefore provides a trial-by-trial window into how visual information is integrated with cognitive control in humans.

SIGNIFICANCE STATEMENT

The presentation of a visual stimulus elicits a trial-by-trial stimulus-locked response (SLR) on the human limb within 100 ms. Here, we show that the SLR continues to reflect stimulus location even when subjects move in the opposite direction (an anti-reach). Remarkably, the attenuation of SLR magnitude reflected the cognitive control required to generate a correct anti-reach, with greater degrees of attenuation preceding shorter-latency anti-reaches and no attenuation preceding error trials. Our results are strikingly similar to neurophysiological recordings in the superior colliculus of nonhuman primates generating anti-saccades, implicating the tectoreticulospinal pathway. Measuring SLR magnitude therefore provides an unprecedented trial-by-trial opportunity to assess the influence of cognitive control on the initial processing of a visual stimulus in humans.

Context effects on smooth pursuit and manual interception of a disappearing target

In our natural environment, we interact with moving objects that are surrounded by richly textured, dynamic visual contexts. Yet most laboratory studies on vision and movement show visual objects in front of uniform gray backgrounds. Context effects on eye movements have been widely studied, but it is less well known how visual contexts affect hand movements. Here we ask whether eye and hand movements integrate motion signals from target and context similarly or differently, and whether context effects on eye and hand change over time. We developed a track-intercept task requiring participants to track the initial launch of a moving object ("ball") with smooth pursuit eye movements. The ball disappeared after a brief presentation, and participants had to intercept it in a designated "hit zone." In two experiments (n = 18 human observers each), the ball was shown in front of a uniform or a textured background that either was stationary or moved along with the target. Eye and hand movement latencies and speeds were similarly affected by the visual context, but eye and hand interception (eye position at time of interception, and hand interception timing error) did not differ significantly between context conditions. Eye and hand interception timing errors were strongly correlated on a trial-by-trial basis across all context conditions, highlighting the close relation between these responses in manual interception tasks. Our results indicate that visual contexts similarly affect eye and hand movements but that these effects may be short-lasting, affecting movement trajectories more than movement end points.NEW & NOTEWORTHY In a novel track-intercept paradigm, human observers tracked a briefly shown object moving across a textured, dynamic context and intercepted it with their finger after it had disappeared. Context motion significantly affected eye and hand movement latency and speed, but not interception accuracy; eye and hand position at interception were correlated on a trial-by-trial basis. Visual context effects may be short-lasting, affecting movement trajectories more than movement end points.

Parallel specification of competing sensorimotor control policies for alternative action options

Recent theory proposes that the brain, when confronted with several action possibilities, prepares multiple competing movements before deciding among them. Psychophysical supporting evidence for this idea comes from the observation that when reaching towards multiple potential targets, the initial movement is directed towards the average location of the targets, consistent with multiple prepared reaches being executed simultaneously. However, reach planning involves far more than specifying movement direction; it requires the specification of a sensorimotor control policy that sets feedback gains shaping how the motor system responds to errors induced by noise or external perturbations. Here we found that, when a subject is reaching towards multiple potential targets, the feedback gain corresponds to an average of the gains specified when reaching to each target presented alone. Our findings provide evidence that the brain, when presented with multiple action options, computes multiple competing sensorimotor control policies in parallel before implementing one of them.

Transient visual responses reset the phase of low-frequency oscillations in the skeletomotor periphery

We recorded muscle activity from an upper limb muscle while human subjects reached towards peripheral targets. We tested the hypothesis that the transient visual response sweeps not only through the central nervous system, but also through the peripheral nervous system. Like the transient visual response in the central nervous system, stimulus-locked muscle responses (< 100 ms) were sensitive to stimulus contrast, and were temporally and spatially dissociable from voluntary orienting activity. Also, the arrival of visual responses reduced the variability of muscle activity by resetting the phase of ongoing low-frequency oscillations. This latter finding critically extends the emerging evidence that the feedforward visual sweep reduces neural variability via phase resetting. We conclude that, when sensory information is relevant to a particular effector, detailed information about the sensorimotor transformation, even from the earliest stages, is found in the peripheral nervous system.

Cross-species comparison of anticipatory and stimulus-driven neck muscle activity well before saccadic gaze shifts in humans and nonhuman primates

Recent studies have described a phenomenon wherein the onset of a peripheral visual stimulus elicits short-latency (<100 ms) stimulus-locked recruitment (SLR) of neck muscles in nonhuman primates (NHPs), well before any saccadic gaze shift. The SLR is thought to arise from visual responses within the intermediate layers of the superior colliculus (SCi), hence neck muscle recordings may reflect presaccadic activity within the SCi, even in humans. We obtained bilateral intramuscular recordings from splenius capitis (SPL, an ipsilateral head-turning muscle) from 28 human subjects performing leftward or rightward visually guided eye-head gaze shifts. Evidence of an SLR was obtained in 16/55 (29%) of samples; we also observed examples where the SLR was present only unilaterally. We compared these human results with those recorded from a sample of eight NHPs from which recordings of both SPL and deeper suboccipital muscles were available. Using the same criteria, evidence of an SLR was obtained in 8/14 (57%) of SPL recordings, but in 26/29 (90%) of recordings from suboccipital muscles. Thus, both species-specific and muscle-specific factors contribute to the low SLR prevalence in human SPL. Regardless of the presence of the SLR, neck muscle activity in both human SPL and in NHPs became predictive of the reaction time of the ensuing saccade gaze shift ∼70 ms after target appearance; such pregaze recruitment likely reflects developing SCi activity, even if the tectoreticulospinal pathway does not reliably relay visually related activity to SPL in humans.

How moving backgrounds influence interception

Reaching movements towards an object are continuously guided by visual information about the target and the arm. Such guidance increases precision and allows one to adjust the movement if the target unexpectedly moves. On-going arm movements are also influenced by motion in the surrounding. Fast responses to motion in the surrounding could help cope with moving obstacles and with the consequences of changes in one’s eye orientation and vantage point. To further evaluate how motion in the surrounding influences interceptive movements we asked subjects to tap a moving target when it reached a second, static target. We varied the direction and location of motion in the surrounding, as well as details of the stimuli that are known to influence eye movements. Subjects were most sensitive to motion in the background when such motion was near the targets. Whether or not the eyes were moving, and the direction of the background motion in relation to the direction in which the eyes were moving, had very little influence on the response to the background motion. We conclude that the responses to background motion are driven by motion near the target rather than by a global analysis of the optic flow and its relation with other information about self-motion.

Effect of sensory experience on motor learning strategy

It is well known that the central nervous system automatically reduces a mismatch in the visuomotor coordination. Can the underlying learning strategy be modified by environmental factors or a subject's learning experiences? To elucidate this matter, two groups of subjects learned to execute reaching arm movements in environments with task-irrelevant visual cues. However, one group had previous experience of learning these movements using task-relevant visual cues. The results demonstrate that the two groups used different learning strategies for the same visual environment and that the learning strategy was influenced by prior learning experience.

Reach target selection in humans using ambiguous decision cues containing variable amounts of conflicting sensory evidence supporting each target choice

Human subjects chose between two color-coded reach targets using multicolored checkerboard-like decision cues (DCs) that presented variable amounts of conflicting sensory evidence supporting both target choices. Different DCs contained different numbers of small squares of the two target colors. The most ambiguous DCs contained nearly equal numbers of squares of both target colors. The subjects reached as soon as they selected a target after the appearance of the DC (“choose-and-go” task). The choice behavior of the subjects showed many similarities to prior studies using other stimulus properties (e.g., visual motion coherence, brightness), including progressively longer response times and higher target-choice error rates for more ambiguous DCs. However, certain trends in their choice behavior could not be fully captured by simple drift-diffusion models. Allowing the subjects to view the DCs for a period of time before presenting the targets (“match-to-sample” task) resulted in much shorter response times overall, but also revealed a reluctance of subjects to commit to a decision about the predominant color of the more ambiguous DCs during the initial extended observation period. Model processing and simulation analyses suggest that the subjects might adjust the dynamics of their decision-making process on a trial-to-trial basis in response to the variable level of ambiguous and conflicting evidence in different DCs between trials.

Online gain update for manual following response accompanied by gaze shift during arm reaching

To capture objects by hand, online motor corrections are required to compensate for self-body movements. Recent studies have shown that background visual motion, usually caused by body movement, plays a significant role in such online corrections. Visual motion applied during a reaching movement induces a rapid and automatic manual following response (MFR) in the direction of the visual motion. Importantly, the MFR amplitude is modulated by the gaze direction relative to the reach target location (i.e., foveal or peripheral reaching). That is, the brain specifies the adequate visuomotor gain for an online controller based on gaze-reach coordination. However, the time or state point at which the brain specifies this visuomotor gain remains unclear. More specifically, does the gain change occur even during the execution of reaching? In the present study, we measured MFR amplitudes during a task in which the participant performed a saccadic eye movement that altered the gaze-reach coordination during reaching. The results indicate that the MFR amplitude immediately after the saccade termination changed according to the new gaze-reach coordination, suggesting a flexible online updating of the MFR gain during reaching. An additional experiment showed that this gain updating mostly started before the saccade terminated. Therefore, the MFR gain updating process would be triggered by an ocular command related to saccade planning or execution based on forthcoming changes in the gaze-reach coordination. Our findings suggest that the brain flexibly updates the visuomotor gain for an online controller even during reaching movements based on continuous monitoring of the gaze-reach coordination.

Hitting a target is fundamentally different from avoiding obstacles

To successfully move our hand to a target, it is important not only to consider the target of our movements but also to consider other objects in the environment that may act as obstacles. We previously found that the time needed to respond to a change in position was considerably longer for a displacement of an obstacle than for a displacement of the target (Aivar, Brenner, & Smeets, 2008. Experimental Brain Research 190, 251-264). In that study, the movement constraints imposed by the obstacles differed from those imposed by the target. To examine whether the latency is really different for targets and obstacles, irrespective of any constraints they impose, we modified the design of the previous experiment to make sure that the constraints were matched. In each trial, two aligned 'objects' of the same size were presented at different distances to the left of the initial position of the hand. Each of these objects could either be a target or a gap (opening between two obstacles). Participants were instructed to pass through both objects. All possible combinations of these two objects were tested: gap-target, target-gap, gap-gap, target-target. On some trials one of the objects changed position after movement onset. Participants systematically responded faster to the displacement of a target than to the displacement of a gap at the same location. We conclude that targets are prioritized over obstacles in movement control.

Fractionation of the visuomotor feedback response to directions of movement and perturbation

Recent studies have highlighted the modulation and control of feedback gains as support for optimal feedback control. While many experiments contrast feedback gains across different environments, only a few have demonstrated the appropriate modulation of feedback gains from one movement to the next. Here we extend previous work by examining whether different visuomotor feedback gains can be learned for different directions of movement or perturbation directions in the same posture. To do this we measure visuomotor responses (involuntary motor responses to shifts in the visual feedback of the hand) during reaching movements. Previous work has demonstrated that these feedback responses can be modulated depending on the statistical distributions of the environment. Specifically, feedback gains were upregulated for task-relevant environments and downregulated for task-irrelevant environments. Using these two statistical distributions, the first experiment examined whether these feedback responses could be independently modulated for the same limb posture for two directions of movement (same limb posture but on either an inward or outward movement), while the second examined whether the feedback responses could modulate, within a single movement, to perturbations to the left or right of the reach. Both experiments demonstrated that visuomotor feedback responses could be learned independently such that the response was appropriate for the environment. This work demonstrates that feedback gains can be simultaneously tuned (upregulated and downregulated) depending on the state of the body and the environment. The results indicate the degree to which feedback responses can be fractionated in order to adapt to the world.

Three-dimensional reach trajectories as a probe of real-time decision-making between multiple competing targets

Though several features of cognitive processing can be inferred from the discrete measurement [e.g., reaction time (RT), accuracy, etc.] of participants' conscious reports (e.g., verbal or key-press responses), it is becoming increasingly clear that a much richer understanding of these features can be captured from continuous measures of rapid, largely non-conscious behaviors like hand or eye movements. Here, using new experimental data, we describe in detail both the approach and analyses implemented in some of our previous studies that have used rapid reaching movements under cases of target uncertainty in order to probe the features, constraints and dynamics of stimulus-related processing in the brain. This work, as well as that of others, shows that when individuals are simultaneously presented with multiple potential targets—only one of which will be cued after reach onset—they produce initial reach trajectories that are spatially biased in accordance with the probabilistic distribution of targets. Such “spatial averaging” effects are consistent with observations from neurophysiological studies showing that neuronal populations in sensorimotor brain structures represent multiple target choices in parallel and they compete for selection. These effects also confirm and help extend computational models aimed at understanding the underlying mechanisms that support action-target selection. We suggest that the use of this simple, yet powerful behavioral paradigm for providing a “real-time” visualization of ongoing cognitive processes occurring at the neural level offers great promise for studying processes related to a wide range of psychological phenomena, such as decision-making and the representation of objects.

The influence of visual target information on the online control of movements

The continuously changing properties of our environment require constant monitoring of our actions and updating of our motor commands based on the task goals. Such updating relies upon our predictions about the sensory consequences of our movement commands, as well as sensory feedback received during movement execution. Here we focus on how visual information about target location is used to update and guide ongoing actions so that the task goal is successfully achieved. We review several studies that have manipulated vision of the target in a variety of ways, ranging from complete removal of visual target information to changes in visual target properties after movement onset to examine how such changes are accounted for during motor execution. We also examined the specific role of a critical neural structure, the parietal cortex, and argue that a fundamental challenge for the future is to understand how visual information about target location is integrated with other streams of information, during movement execution, to estimate the state of the body and the environment in order to ensure optimal motor performance.