Evidence of common and separate eye and hand accumulators underlying flexible eye-hand coordination

Eye-hand coordination during online reach corrections is task dependent

To produce accurate movements, the human motor system needs to deal with errors that can occur due to inherent noise, changes in the body, or disturbances in the environment. Here, we investigated the temporal coupling of rapid corrections of the eye and hand in response to a change in visual target location during the movement. In addition to a "classic" double-step task in which the target stepped to a new position, participants performed a set of modified double-step tasks in which the change in movement goal was indicated by the appearance of an additional target, or by a spatial or symbolic cue. We found that both the absolute correction latencies of the eye and hand and the relative eye-hand correction latencies were dependent on the visual characteristics of the target change, with increasingly longer latencies in tasks that required more visual and cognitive processing. Typically, the hand started correcting slightly earlier than the eye, especially when the target change was indicated by a symbolic cue, and in conditions where visual feedback of the hand position was provided during the reach. Our results indicate that the oculomotor and limb-motor system can be differentially influenced by processing requirements of the task and emphasize that temporal eye-hand coupling is flexible rather than rigid.NEW & NOTEWORTHY Eye movements support hand movements in many situations. Here, we used variations of a double-step task to investigate temporal coupling of corrective hand and eye movements in response to target displacements. Correction latency coupling depended on the visual and cognitive processing demands of the task. The hand started correcting before the eye, especially when the task required decoding a symbolic cue. These findings highlight the flexibility and task dependency of eye-hand coordination.

Vision and Visuomotor Performance Following Acute Ischemic Stroke

Background

As measurable sensory and motor deficits are key to the diagnosis of stroke, we investigated the value of objective tablet based vision and visuomotor capacity assessment in acute mild-moderate ischemic stroke (AIS) patients.

Methods

Sixty AIS patients (65 ± 14 years, 33 males) without pre-existing visual/neurological disorders and acuity better than 6/12 were tested at their bedside during the first week post-stroke and were compared to 40 controls (64 ± 11 years, 15 males). Visual field sensitivity, quantified as mean deviation (dB) and visual acuity (with and without luminance noise), were tested on MRFn (Melbourne Rapid Field-Neural) iPad application. Visuomotor capacity was assessed with the Lee-Ryan Eye-Hand Coordination (EHC) iPad application using a capacitive stylus for iPad held in the preferred hand.Time to trace 3 shapes and displacement errors (deviations of >3.5 mm from the shape) were recorded. Diagnostic capacity was considered with Receiver Operating Characteristics. Vision test outcomes were correlated with National Institutes of Health Stroke Scale (NIHSS) score at the admission.

Results

Of the 60 AIS patients, 58 grasped the iPad stylus in their preferred right hand even though 31 had left hemisphere lesions. Forty-one patients (68%) with better than 6/12 visual acuity (19 right, 19 left hemisphere and 3 multi-territorial lesions) returned significantly abnormal visual fields. The stroke group took significantly longer (AIS: 93.4 ± 60.1 s; Controls: 33.1 ± 11.5 s, p < 0.01) to complete EHC tracing and made larger displacements (AIS: 16,388 ± 36,367 mm; Controls: 2,620 ± 1,359 mm, p < 0.01) although both control and stroke groups made similar numbers of errors. EHC time was not significantly different between participants with R (n = 26, 84.3 ± 55.3 s) and L (n = 31, 101.3 ± 64.7 s) hemisphere lesions. NIHSS scores and EHC measures showed low correlations (Spearman R: −0.15, L: 0.17). ROC analysis of EHC and vision tests found high diagnostic specificity and sensitivity for a fail at EHC time, or visual field, or Acuity-in-noise (sensivity: 93%, specificity: 83%) that shows little relationship to NIHSS scores.

Conclusions

EHC time and vision test outcomes provide an easy and rapid bedside measure that complements existing clinical assessments in AIS. The low correlation between visual function, NIHSS scores and lesion site offers an expanded clinical view of changes following stroke.

Decoupling countermands nonselective response inhibition during selective stopping

Response inhibition is essential for goal-directed behavior within dynamic environments. Selective stopping is a complex form of response inhibition where only part of a multi-effector response must be cancelled. A substantial response delay emerges on unstopped effectors when a cued effector is successfully stopped. This stopping-interference effect is indicative of nonselective response inhibition during selective stopping which may, in-part, be a consequence of functional coupling. The present study examined selective stopping of (de)coupled bimanual responses in healthy human participants of either sex. Participants performed synchronous and asynchronous versions of an anticipatory stop-signal paradigm across two sessions while mu (µ) and beta (β) rhythm were measured with electroencephalography. Results showed that responses were behaviorally decoupled during asynchronous go trials and the extent of response asynchrony was associated with lateralized sensorimotor µ and β desynchronization during response preparation. Selective stopping produced a stopping-interference effect and was marked by a nonselective increase and subsequent rebound in prefrontal and sensorimotor β. In support of the coupling account, stopping-interference was smaller during selective stopping of asynchronous responses, and negatively associated with the magnitude of decoupling. However, the increase in sensorimotor β during selective stopping was equivalent between the stopped and unstopped hand irrespective of response synchrony. Overall, the findings demonstrate that decoupling facilitates selective stopping after a global pause process and emphasizes the importance of considering the influence of both the go and stop context when investigating response inhibition.

Proof of Concept of Novel Visuo-Spatial-Motor Fall Prevention Training for Old People

Falls in the geriatric population are one of the most important causes of disabilities in this age group. Its consequences impose a great deal of economic burden on health and insurance systems. This study was conducted by a multidisciplinary team with the aim of evaluating the effect of visuo-spatial-motor training for the prevention of falls in older adults. The subjects consisted of 31 volunteers aged 60 to 92 years who were studied in three groups: (1) A group under standard physical training, (2) a group under visuo-spatial-motor interventions, and (3) a control group (without any intervention). The results of the study showed that visual-spatial motor exercises significantly reduced the risk of falls of the subjects.

Computational Mechanisms Mediating Inhibitory Control of Coordinated Eye-Hand Movements

Significant progress has been made in understanding the computational and neural mechanisms that mediate eye and hand movements made in isolation. However, less is known about the mechanisms that control these movements when they are coordinated. Here, we outline our computational approaches using accumulation-to-threshold and race-to-threshold models to elucidate the mechanisms that initiate and inhibit these movements. We suggest that, depending on the behavioral context, the initiation and inhibition of coordinated eye-hand movements can operate in two modes-coupled and decoupled. The coupled mode operates when the task context requires a tight coupling between the effectors; a common command initiates both effectors, and a unitary inhibitory process is responsible for stopping them. Conversely, the decoupled mode operates when the task context demands weaker coupling between the effectors; separate commands initiate the eye and hand, and separate inhibitory processes are responsible for stopping them. We hypothesize that the higher-order control processes assess the behavioral context and choose the most appropriate mode. This computational mechanism can explain the heterogeneous results observed across many studies that have investigated the control of coordinated eye-hand movements and may also serve as a general framework to understand the control of complex multi-effector movements.

The role of eye movements in manual interception: A mini-review

When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.

Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum

The role of the cerebellum in non-motor learning is poorly understood. Here, we investigated the activity of Purkinje cells (P-cells) in the mid-lateral cerebellum as the monkey learned to associate one arbitrary symbol with the movement of the left hand and another with the movement of the right hand. During learning, but not when the monkey had learned the association, the simple spike responses of P-cells reported the outcome of the animal's most recent decision without concomitant changes in other sensorimotor parameters such as hand movement, licking, or eye movement. At the population level, P-cells collectively maintained a memory of the most recent decision throughout the entire trial. As the monkeys learned the association, the magnitude of this reward-related error signal approached zero. Our results provide a major departure from the current understanding of cerebellar processing and have critical implications for cerebellum's role in cognitive control.

Spatiotemporal Coupling between Eye and Hand Trajectories during Curved Hand Movements

Eye and hand movements are often made in isolation but for reaching movements they are usually coupled. Despite this, evidence for spatial coupling between the eye and hand effector is mixed and have usually been restricted to straight-line movements, while real-world hand movements have complex trajectories. Here, using a novel obstacle avoidance task where an obstacle appeared in an infrequent number of trials, we establish a stronger link between the saccade and hand trajectory during more naturalistic curved hand trajectories. We illustrate that the hand trajectory was coupled to the end-point of the saccade which was executed just prior to the hand movement onset. Interestingly, while the saccade end-point was related to whether the hand trajectory followed a straight or a curved path, the y-component of saccade end-point was related to whether the hand took a path passing from over or below the obstacle. Further, we observed a relationship between saccade locations and hand sub-movements where the number and timing of saccades and number of hand velocity peaks were related. These results illustrate a robust spatiotemporal and kinematic coupling between saccades and complex hand movement trajectories suggesting a shared kinematic representation underlying eye-hand movements.

Reaction Time Improvements by Neural Bistability

The often reported reduction of Reaction Time (RT) by Vision Training) is successfully replicated by 81 athletes across sports. This enabled us to achieve a mean reduction of RTs for athletes eye-hand coordination of more than 10%, with high statistical significance. We explain how such an observed effect of Sensorimotor systems' plasticity causing reduced RT can last in practice for multiple days and even weeks in subjects, via a proof of principle. Its mathematical neural model can be forced outside a previous stable (but long) RT into a state leading to reduced eye-hand coordination RT, which is, again, in a stable neural state.

Task context determines whether common or separate inhibitory signals underlie the control of eye-hand movements

Whereas inhibitory control of single effector movements has been widely studied, the control of coordinated eye-hand movements has received less attention. Nevertheless, previous studies have contradictorily suggested that either a common or separate signal/s is/are responsible for inhibition of coordinated eye-hand movements. In continuation of our previous study, we varied behavioral contexts and used a stochastic accumulation-to-threshold model, which predicts a scaling of the mean reaction time distribution with its variance, to study the inhibitory control of eye-hand movements. Participants performed eye-hand movements in different task conditions, and in each condition they had to redirect movements in a fraction of trials. Task contexts where the behavior could be best explained by a common initiation signal had similar error responses for eye and hand, despite having different mean reaction times, indicating a common inhibitory signal. In contrast, behavior that could be best explained by separate initiation signals had dissimilar error responses for eye and hand indicating separate inhibitory signals. These behavioral responses were further validated using electromyography and computational models having either a common or separate inhibitory control signal/s. Interestingly, in a particular context, whereas in majority trials a common initiation and inhibitory signal could explain the behavior, in a subset of trials separate initiation and inhibitory signals predicted the behavior better. This highlights the flexibility that exists in the brain and in effect reconciles the heterogeneous results reported by previous studies.

NEW & NOTEWORTHY Prior studies have contradictorily suggested either a single or separate inhibitory signal/s underlying inhibition of coordinated eye-hand movements. With the use of different tasks, we observed that when eye-hand movements were initiated by a common signal, they were controlled by a common inhibitory signal. However, when the two effectors were initiated by separate signals, they were controlled by separate inhibitory signals. This highlights the flexible control of eye-hand movements and reconciles the heterogeneous results previously reported in the literature.

Distinct mechanisms explain the control of reach speed planning: evidence from a race model framework

Previous studies have investigated the computational architecture underlying the voluntary control of reach movements that demands a change in position or direction of movement planning. Here we used a novel task in which subjects had to either increase or decrease the movement speed according to a change in target color that occurred randomly during a trial. The applicability of different race models to such a speed redirect task was assessed. We found that the predictions of an independent race model that instantiated an abort-and-replan strategy was consistent with all aspects of performance in the fast-to-slow speed condition. The results from modeling indicated a peculiar asymmetry, in that although the fast-to-slow speed change required inhibition, none of the standard race models was able to explain how movements changed from slow to fast speeds. Interestingly, a weighted averaging model that simulated the gradual merging of two kinematic plans explained behavior in the slow-to-fast speed task. In summary, our work shows how a race model framework can provide an understanding of how the brain controls different aspects of reach movement planning and help distinguish between an abort-and-replan strategy and merging of plans. NEW & NOTEWORTHY For the first time, a race model framework was used to understand how reach speeds are modified. We provide evidence that a fast-to-slow speed change required aborting the current plan and a complete respecification of a new plan, while none of the race models was able to explain an instructed increase of hand movement speed, which was instead accomplished by a merging of a new kinematic plan with the existing kinematic plan.

Corrective response times in a coordinated eye-head-arm countermanding task

Inhibition of motor responses has been described as a race between two competing decision processes of motor initiation and inhibition, which manifest as the reaction time (RT) and the stop signal reaction time (SSRT); in the case where motor initiation wins out over inhibition, an erroneous movement occurs that usually needs to be corrected, leading to corrective response times (CRTs). Here we used a combined eye-head-arm movement countermanding task to investigate the mechanisms governing multiple effector coordination and the timing of corrective responses. We found a high degree of correlation between effector response times for RT, SSRT, and CRT, suggesting that decision processes are strongly dependent across effectors. To gain further insight into the mechanisms underlying CRTs, we tested multiple models to describe the distribution of RTs, SSRTs, and CRTs. The best-ranked model (according to 3 information criteria) extends the LATER race model governing RTs and SSRTs, whereby a second motor initiation process triggers the corrective response (CRT) only after the inhibition process completes in an expedited fashion. Our model suggests that the neural processing underpinning a failed decision has a residual effect on subsequent actions. NEW & NOTEWORTHY Failure to inhibit erroneous movements typically results in corrective movements. For coordinated eye-head-hand movements we show that corrective movements are only initiated after the erroneous movement cancellation signal has reached a decision threshold in an accelerated fashion.

Active Braking of Whole-Arm Reaching Movements Provides Single-Trial Neuromuscular Measures of Movement Cancellation

Movement inhibition is an aspect of executive control that can be studied using the countermanding paradigm, wherein subjects try to cancel an impending movement following presentation of a stop signal. This paradigm permits estimation of the stop-signal reaction time or the time needed to respond to the stop signal. Numerous countermanding studies have examined fast, ballistic movements, such as saccades, even though many movements in daily life are not ballistic and can be stopped at any point during their trajectory. A benefit of studying the control of nonballistic movements is that antagonist muscle recruitment, which serves to actively brake a movement, presumably arises in response to the stop signal. Here, nine human participants (2 female) performed a center-out whole-arm reaching task with a countermanding component, while we recorded the activity of upper-limb muscles contributing to movement generation and braking. The data show a clear response on antagonist muscles to a stop signal, even for movements that have barely begun. As predicted, the timing of such antagonist recruitment relative to the stop signal covaried with conventional estimates of the stop-signal reaction time, both within and across subjects. The timing of antagonist muscle recruitment also attested to a rapid reprioritization of movement inhibition, with antagonist latencies decreasing across sequences consisting of repeated stop trials; such reprioritization also scaled with error magnitude. We conclude that antagonist muscle recruitment arises as a manifestation of a stopping process, providing a novel, accessible, and within-trial measure of the stop-signal reaction time.SIGNIFICANCE STATEMENT The countermanding or stop-signal paradigm permits estimation of how quickly subjects cancel an impending movement. Traditionally, this paradigm has been studied using simple movements, such as saccadic eye movements or button presses. Here, by measuring upper limb muscle activity while human subjects countermand whole-arm reaching movements, we show that movement cancellation often involves prominent recruitment of antagonist muscles that serves to actively brake the movement, even on movements that have barely begun. The timing of antagonist muscle recruitment correlates with traditional estimates of movement cancellation. Because they can be detected on a single-trial basis, muscle-based measures may provide a new way of characterizing movement cancellation at an unprecedented within-trial resolution.