Influence of the behavioral goal and environmental obstacles on rapid feedback responses

TAT-HUM: Trajectory analysis toolkit for human movements in Python

Human movement trajectories can reveal useful insights regarding the underlying mechanisms of human behaviors. Extracting information from movement trajectories, however, can be challenging because of their complex and dynamic nature. The current paper presents a Python toolkit developed to help users analyze and extract meaningful information from the trajectories of discrete rapid aiming movements executed by humans. This toolkit uses various open-source Python libraries, such as NumPy and SciPy, and offers a collection of common functionalities to analyze movement trajectory data. To ensure flexibility and ease of use, the toolkit offers two approaches: an automated approach that processes raw data and generates relevant measures automatically, and a manual approach that allows users to selectively use different functions based on their specific needs. A behavioral experiment based on the spatial cueing paradigm was conducted to illustrate how one can use this toolkit in practice. Readers are encouraged to access the publicly available data and relevant analysis scripts as an opportunity to learn about kinematic analysis for human movements.

Generalization in de novo learning of virtual upper limb movements is influenced by motor exploration

The acquisition of new motor skills from scratch, also known as de novo learning, is an essential aspect of motor development. In de novo learning, the ability to generalize skills acquired under one condition to others is crucial because of the inherently limited range of motor experiences available for learning. However, the presence of generalization in de novo learning and its influencing factors remain unclear. This study aimed to elucidate the generalization of de novo motor learning by examining the motor exploration process, which is the accumulation of motor experiences. To this end, we manipulated the exploration process during practice by changing the target shape using either a small circular target or a bar-shaped target. Our findings demonstrated that the amount of learning during practice was generalized across different conditions. Furthermore, the extent of generalization is influenced by movement variability in the control space, which is irrelevant to the task, rather than the target shapes themselves. These results confirmed the occurrence of generalization in de novo learning and suggest that the exploration process within the control space plays a significant role in facilitating this generalization.

Modulations of stretch reflex by altering visuomotor contexts

Various functional modulations of the stretch reflex help to stabilize actions, but the computational mechanism behind its context-dependent tuning remains unclear. While many studies have demonstrated that motor contexts associated with the task goal cause functional modulation of the stretch reflex of upper limbs, it is not well understood how visual contexts independent of the task requirements affect the stretch reflex. To explore this issue, we conducted two experiments testing 20 healthy human participants (age range 20-45, average 31.3 ± 9.0), in which visual contexts were manipulated in a visually guided reaching task. During wrist flexion movements toward a visual target, a mechanical load was applied to the wrist joint to evoke stretch reflex of wrist flexor muscle (flexor carpi radialis). The first experiment (n = 10) examined the effect of altering the visuomotor transformation on the stretch reflex that was evaluated with surface electromyogram. We found that the amplitude of the stretch reflex decreased (p = 0.024) when a rotational transformation of 90° was introduced between the hand movement and the visual cursor, whereas the amplitude did not significantly change (p = 0.26) when the rotational transformation was accompanied by a head rotation so that the configuration of visual feedback was maintained in visual coordinates. The results suggest that the stretch reflex was regulated depending on whether the visuomotor mapping had already been acquired or not. In the second experiment (n = 10), we examined how uncertainty in the visual target or hand cursor affects the stretch reflex by removing these visual stimuli. We found that the reflex amplitude was reduced by the disappearance of the hand cursor (p = 0.039), but was not affected by removal of the visual target (p = 0.27), suggesting that the visual state of the body and target contribute differently to the reflex tuning. These findings support the idea that visual updating of the body state is crucial for regulation of quick motor control driven by proprioceptive signals.

Spontaneous Behavioural Recovery Following Stroke Relates to the Integrity of Parietal and Temporal Regions

Stroke is a devastating disease that results in neurological deficits and represents a leading cause of death and disability worldwide. Following a stroke, there is a degree of spontaneous recovery of function, the neural basis of which is of great interest among clinicians in their efforts to reduce disability following stroke and enhance rehabilitation. Conventionally, work on spontaneous recovery has tended to focus on the neural reorganization of motor cortical regions, with comparably little attention being paid to changes in non-motor regions and how these relate to recovery. Here we show, using structural neuroimaging in a macaque stroke model (N = 31) and by exploiting individual differences in spontaneous behavioural recovery, that the preservation of regions in the parietal and temporal cortices predict animal recovery. To characterize recovery, we performed a clustering analysis using Non-Human Primate Stroke Scale (NHPSS) scores and identified a good versus poor recovery group. By comparing the preservation of brain volumes in the two groups, we found that brain areas in integrity of brain areas in parietal, temporal and somatosensory cortex were associated with better recovery. In addition, a decoding approach performed across all subjects revealed that the preservation of specific brain regions in the parietal, somatosensory and medial frontal cortex predicted recovery. Together, these findings highlight the importance of parietal and temporal regions in spontaneous behavioural recovery.

Fast Feedback Responses to Categorical Sensorimotor Errors That Do Not Indicate Error Magnitude Are Optimized Based on Short- and Long-Term Memory

Skilled motor performance depends critically on rapid corrective responses that act to preserve the goal of the movement in the face of perturbations. Although it is well established that the gain of corrective responses elicited while reaching toward objects adapts to different contexts, little is known about the adaptability of corrective responses supporting the manipulation of objects after they are grasped. Here, we investigated the adaptability of the corrective response elicited when an object being lifted is heavier than expected and fails to lift off when predicted. This response involves a monotonic increase in vertical load force triggered, within ∼90 ms, by the absence of expected sensory feedback signaling lift off and terminated when actual lift off occurs. Critically, because the actual weight of the object cannot be directly sensed at the moment the object fails to lift off, any adaptation of the corrective response would have to be based on memory from previous lifts. We show that when humans, including men and women, repeatedly lift an object that on occasional catch trials increases from a baseline weight to a fixed heavier weight, they scale the gain of the response (i.e., the rate of force increase) to the heavier weight within two to three catch trials. We also show that the gain of the response scales, on the first catch trial, with the baseline weight of the object. Thus, the gain of the lifting response can be adapted by both short- and long-term experience. Finally, we demonstrate that this adaptation preserves the efficacy of the response across contexts.SIGNIFICANCE STATEMENT Here, we present the first investigation of the adaptability of the corrective lifting response elicited when an object is heavier than expected and fails to lift off when predicted. A striking feature of the response, which is driven by a sensory prediction error arising from the absence of expected sensory feedback, is that the magnitude of the error is unknown. That is, the motor system only receives a categorical error indicating that the object is heavier than expected but not its actual weight. Although the error magnitude is not known at the moment the response is elicited, we show that the response can be scaled to predictions of error magnitude based on both recent and long-term memories.

Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds

From a baby's babbling to a songbird practising a new tune, exploration is critical to motor learning. A hallmark of exploration is the emergence of random walk behaviour along solution manifolds, where successive motor actions are not independent but rather become serially dependent. Such exploratory random walk behaviour is ubiquitous across species' neural firing, gait patterns and reaching behaviour. The past work has suggested that exploratory random walk behaviour arises from an accumulation of movement variability and a lack of error-based corrections. Here, we test a fundamentally different idea-that reinforcement-based processes regulate random walk behaviour to promote continual motor exploration to maximize success. Across three human reaching experiments, we manipulated the size of both the visually displayed target and an unseen reward zone, as well as the probability of reinforcement feedback. Our empirical and modelling results parsimoniously support the notion that exploratory random walk behaviour emerges by utilizing knowledge of movement variability to update intended reach aim towards recently reinforced motor actions. This mechanism leads to active and continuous exploration of the solution manifold, currently thought by prominent theories to arise passively. The ability to continually explore muscle, joint and task redundant solution manifolds is beneficial while acting in uncertain environments, during motor development or when recovering from a neurological disorder to discover and learn new motor actions.

Evaluation of stretch reflex synergies in the upper limb using principal component analysis (PCA)

The dynamic nature of movement and muscle activation emphasizes the importance of a sound experimental design. To ensure that an experiment determines what we intend, the design must be carefully evaluated. Before analyzing data, it is imperative to limit the number of outliers, biases, and skewness. In the present study, a simple center-out experiment was performed by 16 healthy volunteers. The experiment included three load conditions, two preparatory delays, two perturbations, and four targets placed along a diagonal path on a 2D plane. While the participants performed the tasks, the activity of seven arm muscles were monitored using surface electromyography (EMG). Principal component analysis (PCA) was used to evaluate the study design, identify muscle synergies, and assess the effects of individual quirks. With PCA, we can identify the trials that trigger stretch reflexes and pinpoint muscle synergies. The posterior deltoid, triceps long head, and brachioradialis were engaged when targets were in the direction of muscle shortening and the perturbation was applied in the opposite direction. Similarly, the pectoralis and anterior deltoid were engaged when the targets were in the direction of muscle shortening and the perturbation was applied in the opposite direction. The stretch reflexes were not triggered when the perturbation brought the hand in the direction of, or into the target, except if the muscle was pre-loaded. The use of PCA was also proven valuable when evaluating participant performance. While individual quirks are to be expected, failure to perform trials as expected can adversely affect the study results.

Continuous evaluation of cost-to-go for flexible reaching control and online decisions

Humans consider the parameters linked to movement goal during reaching to adjust their control strategy online. Indeed, rapid changes in target structure or disturbances interfering with their initial plan elicit rapid changes in behavior. Here, we hypothesize that these changes could result from the continuous use of a decision variable combining motor and cognitive components. We combine an optimal feedback controller with a real-time evaluation of the expected cost-to-go, which considers target- and movement-related costs, in a common theoretical framework. This model reproduces human behaviors in presence of changes in the target structure occurring during movement and of online decisions to flexibly change target following external perturbations. It also predicts that the time taken to decide to select a novel goal after a perturbation depends on the amplitude of the disturbance and on the rewards of the different options, which is a direct result of the continuous monitoring of the cost-to-go. We show that this result was present in our previously collected dataset. Together our developments point towards a continuous evaluation of the cost-to-go during reaching to update control online and make efficient decisions about movement goal.

Slightly perturbing the arm influences choices between multiple targets

We constantly make choices about how to interact with objects in the environment. Do we immediately consider changes in our posture when making such choices? To find out, we examined whether motion in the background, which is known to influence the trajectory of goal-directed hand movements, influences participants' choices when suddenly faced with two options. The participants' task was to tap on as many sequentially presented targets as possible within 90 seconds. Sometime after a new target appeared, it split into two targets and participants had to choose which of them to hit. Shortly before the split, the background moved in a way that was expected to result in the finger shifting slightly towards one of the two new targets. We examined whether such shifts influenced the choice between the two targets. The moving background influenced the finger movements in the expected manner: participants moved in the direction of the background motion. It also influenced the choice that participants made between the two targets: participants more frequently chose the target in the direction of the background motion. There was a positive correlation across participants between the magnitude of the response to background motion and the bias to choose the target in the direction of such motion. Thus, people consider sudden changes in their posture when choosing between different movement options.

Continuous use of visual information about the position of the moving hand

People generally look at a target when they want to reach for it. Doing so presumably helps them continuously update their judgments about the target's position and motion. But not looking at their hand does not prevent people from updating judgments about its position on the basis of visual information, because people do respond to experimental perturbations of visual information about the position of their hand. Here, we study such responses by adding jitter to the movement of a cursor that follows participants' fingers. We analyse the response to the jitter in a way that reveals how the vigour of the response depends on the moment during the movement at which the change in cursor position occurs. We compare the change in vigour to that for equivalent jitter in the position of the target. We find that participants respond to jitter in the position of a cursor in much the same way as they respond to jitter in the target's position. The responses are more vigorous late in the movement, when adjustments need to be made within less time, but similarly so for the cursor as for the target. The responses are weaker for the cursor, presumably because of the jitter-free kinaesthetic information about the position of the finger.

The nervous system tunes sensorimotor gains when reaching in variable mechanical environments

Humans often move in the presence of mechanical disturbances that can vary in direction and amplitude throughout movement. These disturbances can jeopardize the outcomes of our actions, such as when drinking from a glass of water on a turbulent flight or carrying a cup of coffee while walking on a busy sidewalk. Here, we examine control strategies that allow the nervous system to maintain performance when reaching in the presence of mechanical disturbances that vary randomly throughout movement. Healthy participants altered their control strategies to make movements more robust against disturbances. The change in control was associated with faster reaching movements and increased responses to proprioceptive and visual feedback that were tuned to the variability of the disturbances. Our findings highlight that the nervous system exploits a continuum of control strategies to increase its responsiveness to sensory feedback when reaching in the presence of increasingly variable physical disturbances.

Online updating of obstacle positions when intercepting a virtual target

People rely upon sensory information in the environment to guide their actions. Ongoing goal-directed arm movements are constantly adjusted to the latest estimate of both the target and hand's positions. Does the continuous guidance of ongoing arm movements also consider the latest visual information of the position of obstacles in the surrounding? To find out, we asked participants to slide their finger across a screen to intercept a laterally moving virtual target while moving through a gap that was created by two virtual circular obstacles. At a fixed time during each trial, the target suddenly jumped slightly laterally while still continuing to move. In half the trials, the size of the gap changed at the same moment as the target jumped. As expected, participants adjusted their movements in response to the target jump. Importantly, the magnitude of this response depended on the new size of the gap. If participants were told that the circles were irrelevant, changing the gap between them had no effect on the responses. This shows that obstacles' instantaneous positions can be considered when visually guiding goal-directed movements.

The sensorimotor system modulates muscular co-contraction relative to visuomotor feedback responses to regulate movement variability

The naturally occurring variability in our movements often poses a significant challenge when attempting to produce precise and accurate actions, which is readily evident when playing a game of darts. Two differing, yet potentially complementary, control strategies that the sensorimotor system may use to regulate movement variability are impedance control and feedback control. Greater muscular co-contraction leads to greater impedance that acts to stabilize the hand, while visuomotor feedback responses can be used to rapidly correct for unexpected deviations when reaching toward a target. Here, we examined the independent roles and potential interplay of impedance control and visuomotor feedback control when regulating movement variability. Participants were instructed to perform a precise reaching task by moving a cursor through a narrow visual channel. We manipulated cursor feedback by visually amplifying movement variability and/or delaying the visual feedback of the cursor. We found that participants decreased movement variability by increasing muscular co-contraction, aligned with an impedance control strategy. Participants displayed visuomotor feedback responses during the task but, unexpectedly, there was no modulation between conditions. However, we did find a relationship between muscular co-contraction and visuomotor feedback responses, suggesting that participants modulated impedance control relative to feedback control. Taken together, our results highlight that the sensorimotor system modulates muscular co-contraction, relative to visuomotor feedback responses, to regulate movement variability and produce accurate actions.NEW & NOTEWORTHY The sensorimotor system has the constant challenge of dealing with the naturally occurring variability in our movements. Here, we investigated the potential roles of muscular co-contraction and visuomotor feedback responses to regulate movement variability. When we visually amplified movements, we found that the sensorimotor system primarily uses muscular co-contraction to regulate movement variability. Interestingly, we found that muscular co-contraction was modulated relative to inherent visuomotor feedback responses, suggesting an interplay between impedance and feedback control.

Assistive Loading Promotes Goal-Directed Tuning of Stretch Reflex Gains

Voluntary movements are prepared before they are executed. Preparatory activity has been observed across the CNS and recently documented in first-order neurons of the human PNS (i.e., in muscle spindles). Changes seen in sensory organs suggest that independent modulation of stretch reflex gains may represent an important component of movement preparation. The aim of the current study was to further investigate the preparatory modulation of short-latency stretch reflex responses (SLRs) and long-latency stretch reflex responses (LLRs) of the dominant upper limb of human subjects. Specifically, we investigated how different target parameters (target distance and direction) affect the preparatory tuning of stretch reflex gains in the context of goal-directed reaching, and whether any such tuning depends on preparation duration and the direction of background loads. We found that target distance produced only small variations in reflex gains. In contrast, both SLR and LLR gains were strongly modulated as a function of target direction, in a manner that facilitated the upcoming voluntary movement. This goal-directed tuning of SLR and LLR gains was present or enhanced when the preparatory delay was sufficiently long (>250 ms) and the homonymous muscle was unloaded [i.e., when a background load was first applied in the direction of homonymous muscle action (assistive loading)]. The results extend further support for a relatively slow-evolving process in reach preparation that functions to modulate reflexive muscle stiffness, likely via the independent control of fusimotor neurons. Such control can augment voluntary goal-directed movement and is triggered or enhanced when the homonymous muscle is unloaded.

Proprioceptive and Visual Feedback Responses in Macaques Exploit Goal Redundancy

A common problem in motor control concerns how to generate patterns of muscle activity when there are redundant solutions to attain a behavioral goal. Optimal feedback control is a theory that has guided many behavioral studies exploring how the motor system incorporates task redundancy. This theory predicts that kinematic errors that deviate the limb should not be corrected if one can still attain the behavioral goal. Studies in humans demonstrate that the motor system can flexibly integrate visual and proprioceptive feedback of the limb with goal redundancy within 90 ms and 70 ms, respectively. Here, we show monkeys (Macaca mulatta) demonstrate similar abilities to exploit goal redundancy. We trained four male monkeys to reach for a goal that was either a narrow square or a wide, spatially redundant rectangle. Monkeys exhibited greater trial-by-trial variability when reaching to the wide goal consistent with exploiting goal redundancy. On random trials we jumped the visual feedback of the hand and found monkeys corrected for the jump when reaching to the narrow goal and largely ignored the jump when reaching for the wide goal. In a separate set of experiments, we applied mechanical loads to the arm of the monkey and found similar corrective responses based on goal shape. Muscle activity reflecting these different corrective responses were detected for the visual and mechanical perturbations starting at ∼90 and ∼70 ms, respectively. Thus, rapid motor responses in macaques can exploit goal redundancy similar to humans, creating a paradigm to study the neural basis of goal-directed motor action and motor redundancy.SIGNIFICANCE STATEMENT Moving in the world requires selecting from an infinite set of possible motor commands. Theories predict that motor commands are selected that exploit redundancies. Corrective responses in humans to either visual or proprioceptive disturbances of the limb can rapidly exploit redundant trajectories to a goal in <100 ms after a disturbance. However, uncovering the neural correlates generating these rapid motor corrections has been hampered by the absence of an animal model. We developed a behavioral paradigm in monkeys that incorporates redundancy in the form of the shape of the goal. Critically, monkeys exhibit corrective responses and timings similar to humans performing the same task. Our paradigm provides a model for investigating the neural correlates of sophisticated rapid motor corrections.

Online reach correction in 6- and 11-month-old infants

The current study investigated the development of online reach control. Six- and 11-month-old infants reached for a toy while their hand position was tracked. The toy either remained stationary (baseline trials) or unexpectedly displaced left- or rightward during the reach (perturbation trials). To obtain a measure of online reach correction, we compared reaches in the perturbation trials to reaches in baseline trials using autoregression analysis. Infants of both age groups adjusted their reach trajectories in the direction of the displacement. Moreover, we divided the reaching movements into movement units, defined as the submovements of a reach between local minima in hand speed. Eleven-month-old infants adjusted their reach within the span of a single movement unit; corrections in 6-month-olds spanned multiple movement units. These results suggest that the reach control system has a rudimentary replanning capacity by 6 months of age, which, with age, further develops to a more sophisticated online control mechanism for ongoing reaches.

Failure induces task-irrelevant exploration during a stencil task

During reward-based motor tasks, performance failure leads to an increase in movement variability along task-relevant dimensions. These increases in movement variability are indicative of exploratory behaviour in search of a better, more successful motor action. It is unclear whether failure also induces exploration along task-irrelevant dimensions that do not influence performance. In this study, we ask whether participants would explore the task-irrelevant dimension while they performed a stencil task. With a stylus, participants applied downward, normal force that influenced whether they received reward (task-relevant) as they simultaneously made erasing-like movement patterns along the tablet that did not influence performance (task-irrelevant). In this task, the movement pattern was analyzed as the distribution of movement directions within a movement. The results showed significant exploration of task-relevant force and task-irrelevant movement patterns. We conclude that failure can induce additional movement variability along a task-irrelevant dimension.

Reach-to-grasp kinematics and kinetics with and without visual feedback in early-stage Alzheimer’s disease

This study aimed to investigate the effects of early-stage Alzheimer’s disease (AD) on the reach-to-grasp kinematics and kinetics with and without visual supervision of the grasping arm and hand. Seventeen patients who had been diagnosed with early-stage AD and 17 age- and gender-matched, cognitive normal (CN) adults participated in the experiment. A mirror operating system was designed to block the visual feedback of their grasping hand and forearms but to virtually show grasped targets. The target for reach-to-grasp kinematics was a reflective marker installed on a base; and the target for reach-to-grasp kinetics was a custom-made apparatus installed with two six-component force/torque transducers. Kinematics and kinetic parameters were used to quantify the reach-to-grasp performances. Results showed that the early-stage AD remarkably decreased the reaching speed, reduced the grasping accuracy and increased the transportation variability for reach-to-grasp kinematics. For kinetic analysis, early-stage AD extended the preload duration, disturbed the grip and lift forces coordination, and increased the feedforward proportion in the grasping force control. The AD-related changes in the reach-to-grasp kinematic and kinetic parameters depended on visual feedback and were associated with nervous system function according to correlation analyses with the neuropsychological testing. These results suggest that the abnormal kinematic and kinetic characteristics may correlate with the neuropsychological status of early-stage AD, and that the reach-to-grasp kinematic and kinetic maneuver could potentially be used as a novel tool for non-invasive screening or evaluation of early-stage AD.

Contextual cues are not unique for motor learning: Task-dependant switching of feedback controllers

The separation of distinct motor memories by contextual cues is a well known and well studied phenomenon of feedforward human motor control. However, there is no clear evidence of such context-induced separation in feedback control. Here we test both experimentally and computationally if context-dependent switching of feedback controllers is possible in the human motor system. Specifically, we probe visuomotor feedback responses of our human participants in two different tasks—stop and hit—and under two different schedules. The first, blocked schedule, is used to measure the behaviour of stop and hit controllers in isolation, showing that it can only be described by two independent controllers with two different sets of control gains. The second, mixed schedule, is then used to compare how such behaviour evolves when participants regularly switch from one task to the other. Our results support our hypothesis that there is contextual switching of feedback controllers, further extending the accumulating evidence of shared features between feedforward and feedback control.

Extensive evidence has demonstrated that humans can learn distinct motor memories (i.e. independent feedforward controllers) using contextual cues. However, there is little evidence that such contextual cues produce similar separation of feedback controllers. As accumulating evidence highlights the connection between feedforward and feedback control, we propose that context may be used to separate feedback controllers as well. It has not been trivial to test experimentally whether a change in context also modulates the feedback control, as the controller output is affected by other non-contextual factors such as movement kinematics, time-to-target or the properties of the perturbation used to probe the control. Here we present a computational approach based on normative modelling where we separate the effects of the context from other non-contextual effects on the visuomotor feedback system. We then show experimentally that task context independently modulates the feedback control in a particular manner that can be reliably predicted using optimal feedback control.

An approximate stochastic optimal control framework to simulate nonlinear neuro-musculoskeletal models in the presence of noise

Optimal control simulations have shown that both musculoskeletal dynamics and physiological noise are important determinants of movement. However, due to the limited efficiency of available computational tools, deterministic simulations of movement focus on accurately modelling the musculoskeletal system while neglecting physiological noise, and stochastic simulations account for noise while simplifying the dynamics. We took advantage of recent approaches where stochastic optimal control problems are approximated using deterministic optimal control problems, which can be solved efficiently using direct collocation. We were thus able to extend predictions of stochastic optimal control as a theory of motor coordination to include muscle coordination and movement patterns emerging from non-linear musculoskeletal dynamics. In stochastic optimal control simulations of human standing balance, we demonstrated that the inclusion of muscle dynamics can predict muscle co-contraction as minimal effort strategy that complements sensorimotor feedback control in the presence of sensory noise. In simulations of reaching, we demonstrated that nonlinear multi-segment musculoskeletal dynamics enables complex perturbed and unperturbed reach trajectories under a variety of task conditions to be predicted. In both behaviors, we demonstrated how interactions between task constraint, sensory noise, and the intrinsic properties of muscle influence optimal muscle coordination patterns, including muscle co-contraction, and the resulting movement trajectories. Our approach enables a true minimum effort solution to be identified as task constraints, such as movement accuracy, can be explicitly imposed, rather than being approximated using penalty terms in the cost function. Our approximate stochastic optimal control framework predicts complex features, not captured by previous simulation approaches, providing a generalizable and valuable tool to study how musculoskeletal dynamics and physiological noise may alter neural control of movement in both healthy and pathological movements.

Having several options does not increase the time it takes to make a movement to an adequate end point

Throughout the day, people constantly make choices such as where to direct their gaze or place their foot. When making such movement choices, there are usually multiple acceptable options, although some are more advantageous than others. How much time does it take to make such choices and to what extent is the most advantageous option chosen from the available alternatives? To find out, we asked participants to collect points by tapping on any of several targets with their index finger. It did not take participants more time to direct their movements to an advantageous target when there were more options. Participants chose targets that were advantageous because they were easier to reach. Targets could be easier to reach because the finger was already moving in their direction when they appeared, or because they were larger or oriented along the movement direction so that the finger could move faster towards them without missing them. When the target’s colour indicated that it was worth more points they chose it slightly less fast, presumably because it generally takes longer to respond to colour than to respond to attributes such as size. They also chose it less often than they probably should have, presumably because the advantage of choosing it was established arbitrarily. We conclude that having many options does not increase the time it takes to move to an adequate target.

Neural Correlates of Multisensory Integration for Feedback Stabilization of the Wrist

Robust control of action relies on the ability to perceive, integrate, and act on information from multiple sensory modalities including vision and proprioception. How does the brain combine sensory information to regulate ongoing mechanical interactions between the body and its physical environment? Some behavioral studies suggest that the rules governing multisensory integration for action may differ from the maximum likelihood estimation rules that appear to govern multisensory integration for many perceptual tasks. We used functional magnetic resonance (MR) imaging techniques, a MR-compatible robot, and a multisensory feedback control task to test that hypothesis by investigating how neural mechanisms involved in regulating hand position against mechanical perturbation respond to the presence and fidelity of visual and proprioceptive information. Healthy human subjects rested supine in a MR scanner and stabilized their wrist against constant or pseudo-random torque perturbations imposed by the robot. These two stabilization tasks were performed under three visual feedback conditions: “No-vision”: Subjects had to rely solely on proprioceptive feedback; “true-vision”: visual cursor and hand motions were congruent; and “random-vision”: cursor and hand motions were uncorrelated in time. Behaviorally, performance errors accumulated more quickly during trials wherein visual feedback was absent or incongruous. We analyzed blood-oxygenation level-dependent (BOLD) signal fluctuations to compare task-related activations in a cerebello-thalamo-cortical neural circuit previously linked with feedback stabilization of the hand. Activation in this network varied systematically depending on the presence and fidelity of visual feedback of task performance. Addition of task related visual information caused activations in the cerebello-thalamo-cortical network to expand into neighboring brain regions. Specific loci and intensity of expanded activity depended on the fidelity of visual feedback. Remarkably, BOLD signal fluctuations within these regions correlated strongly with the time series of proprioceptive errors—but not visual errors—when the fidelity of visual feedback was poor, even though visual and hand motions had similar variability characteristics. These results provide insight into the neural control of the body’s physical interactions with its environment, rejecting the standard Gaussian cue combination model of multisensory integration in favor of models that account for causal structure in the sensory feedback.

Different planning policies for the initial movement velocity depending on whether the known uncertainty is in the cursor or in the target: Motor planning in situations where two potential movement distances exist

During goal-directed behaviors, individuals can be required to start a movement before deciding on the final goal. Previous studies have focused on the initial movement direction in situations involving multiple targets in different directions from the starting position and have shown that the movement is initiated in the average direction among the target directions. However, the previous studies only included situations with targets at equivalent distances, and the characteristics of motor planning in situations with multiple movement possibilities over different potential distances are unclear. In such situations, movement velocity is another important control variable. Furthermore, while previous studies examined situations with an uncertain motor target position, uncertainty can also exist in the effector position (e.g., body or tool locations). Therefore, we examined (1) whether the average output is confirmed in the initial movement velocity during execution in situations involving two potential movements with different distances. In addition, we examined (2) whether planning of the movement velocity can differ depending on the presence of uncertainty in the cursor or the target. In the main conditions, the participants were required to start a reaching movement with two potential movement distances; in the two-cursor condition, two cursors were presented before the start of the trial, and in the two-target condition, two targets were presented. As a control condition, a distance condition corresponding to each main condition was also performed. In the control condition, the initial movement velocity varied linearly with distance. Then, we tested whether the initial movement velocity in situations with two potential movement distances would follow the averaging output of the corresponding control condition. The results revealed that while the initial movement velocity in the two-target condition was slower than the averaging output, that in the two-cursor condition approached the averaging output. These results suggest that the velocity profile of the goal-directed movement is not simply averaged in a situation where two potential targets exist, and that there is a difference in the planning policy of the initial movement depending on whether the known uncertainty is for the movement goal or the effector.

Cognitive Control as a Multivariate Optimization Problem

A hallmark of adaptation in humans and other animals is our ability to control how we think and behave across different settings. Research has characterized the various forms cognitive control can take-including enhancement of goal-relevant information, suppression of goal-irrelevant information, and overall inhibition of potential responses-and has identified computations and neural circuits that underpin this multitude of control types. Studies have also identified a wide range of situations that elicit adjustments in control allocation (e.g., those eliciting signals indicating an error or increased processing conflict), but the rules governing when a given situation will give rise to a given control adjustment remain poorly understood. Significant progress has recently been made on this front by casting the allocation of control as a decision-making problem. This approach has developed unifying and normative models that prescribe when and how a change in incentives and task demands will result in changes in a given form of control. Despite their successes, these models, and the experiments that have been developed to test them, have yet to face their greatest challenge: deciding how to select among the multiplicity of configurations that control can take at any given time. Here, we will lay out the complexities of the inverse problem inherent to cognitive control allocation, and their close parallels to inverse problems within motor control (e.g., choosing between redundant limb movements). We discuss existing solutions to motor control's inverse problems drawn from optimal control theory, which have proposed that effort costs act to regularize actions and transform motor planning into a well-posed problem. These same principles may help shed light on how our brains optimize over complex control configuration, while providing a new normative perspective on the origins of mental effort.

Hierarchical Integration of Communicative and Spatial Perspective‐Taking Demands in Sensorimotor Control of Referential Pointing

Recognized as a simple communicative behavior, referential pointing is cognitively complex because it invites a communicator to consider an addressee's knowledge. Although we know referential pointing is affected by addressees’ physical location, it remains unclear whether and how communicators’ inferences about addressees’ mental representation of the interaction space influence sensorimotor control of referential pointing. The communicative perspective‐taking task requires a communicator to point at one out of multiple referents either to instruct an addressee which one should be selected (communicative, COM) or to predict which one the addressee will select (non‐communicative, NCOM), based on either which referents can be seen (Level‐1 perspective‐taking, PT1) or how the referents were perceived (Level‐2 perspective‐taking, PT2) by the addressee. Communicators took longer to initiate the movements in PT2 than PT1 trials, and they held their pointing fingers for longer at the referent in COM than NCOM trials. The novel findings of this study pertain to trajectory control of the pointing movements. Increasing both communicative and perspective‐taking demands led to longer pointing trajectories, with an under‐additive interaction between those two experimental factors. This finding suggests that participants generate communicative behaviors that are as informative as required rather than overly exaggerated displays, by integrating communicative and perspective‐taking information hierarchically during sensorimotor control. This observation has consequences for models of human communication. It implies that the format of communicative and perspective‐taking knowledge needs to be commensurate with the movement dynamics controlled by the sensorimotor system.

Revisiting the Role of the Medial Temporal Lobe in Motor Learning

Classic taxonomies of memory distinguish explicit and implicit memory systems, placing motor skills squarely in the latter branch. This assertion is in part a consequence of foundational discoveries showing significant motor learning in amnesics. Those findings suggest that declarative memory processes in the medial temporal lobe (MTL) do not contribute to motor learning. Here, we revisit this issue, testing an individual (L. S. J.) with severe MTL damage on four motor learning tasks and comparing her performance to age-matched controls. Consistent with previous findings in amnesics, we observed that L. S. J. could improve motor performance despite having significantly impaired declarative memory. However, she tended to perform poorly relative to age-matched controls, with deficits apparently related to flexible action selection. Further supporting an action selection deficit, L. S. J. fully failed to learn a task that required the acquisition of arbitrary action-outcome associations. We thus propose a modest revision to the classic taxonomic model: Although MTL-dependent memory processes are not necessary for some motor learning to occur, they play a significant role in the acquisition, implementation, and retrieval of action selection strategies. These findings have implications for our understanding of the neural correlates of motor learning, the psychological mechanisms of skill, and the theory of multiple memory systems.

Detecting Endpoint Error of an Ongoing Reaching Movement: the Role of Vision, Proprioception, and Efference

Brief windows of vision presented during reaching movements contribute to endpoint error estimates. It is not clear whether such error detection processes depend on other sources of information (e.g., proprioception and efference). In the current study, participants were presented with a brief window of vision and then judged whether their movement endpoint under- or over-shot the target after: 1) performing an active reach; 2) being passively guided by a robotic arm; and 3) observing a fake hand moved by the robot arm. Participants were most accurate at estimating their endpoint error in the active movement conditions and least accurate in the action observation condition. Thus, both efferent and proprioceptive information significantly contribute to endpoint error detection processes even with brief visual feedback.

Integration of proprioceptive and visual feedback during online control of reaching

Visual and proprioceptive feedback both contribute to perceptual decisions, but it remains unknown how these feedback signals are integrated together or consider factors such as delays and variance during online control. We investigated this question by having participants reach to a target with randomly applied mechanical and/or visual disturbances. We observed that the presence of visual feedback during a mechanical disturbance did not increase the size of the muscle response significantly but did decrease variance, consistent with a dynamic Bayesian integration model. In a control experiment, we verified that vision had a potent influence when mechanical and visual disturbances were both present but opposite in sign. These results highlight a complex process for multisensory integration, where visual feedback has a relatively modest influence when the limb is mechanically disturbed, but a substantial influence when visual feedback becomes misaligned with the limb.

NEW & NOTEWORTHY Visual feedback is more accurate, but proprioceptive feedback is faster. How should you integrate these sources of feedback to guide limb movement? As predicted by dynamic Bayesian models, the size of the muscle response to a mechanical disturbance was essentially the same whether visual feedback was present or not. Only under artificial conditions, such as when shifting the position of a cursor representing hand position, can one observe a muscle response from visual feedback.

Rotational dynamics in motor cortex are consistent with a feedback controller

Recent studies have identified rotational dynamics in motor cortex (MC), which many assume arise from intrinsic connections in MC. However, behavioral and neurophysiological studies suggest that MC behaves like a feedback controller where continuous sensory feedback and interactions with other brain areas contribute substantially to MC processing. We investigated these apparently conflicting theories by building recurrent neural networks that controlled a model arm and received sensory feedback from the limb. Networks were trained to counteract perturbations to the limb and to reach toward spatial targets. Network activities and sensory feedback signals to the network exhibited rotational structure even when the recurrent connections were removed. Furthermore, neural recordings in monkeys performing similar tasks also exhibited rotational structure not only in MC but also in somatosensory cortex. Our results argue that rotational structure may also reflect dynamics throughout the voluntary motor system involved in online control of motor actions.

Parallel and hierarchical neural mechanisms for adaptive and predictive behavioral control

Our brain can be recognized as a network of largely hierarchically organized neural circuits that operate to control specific functions, but when acting in parallel, enable the performance of complex and simultaneous behaviors. Indeed, many of our daily actions require concurrent information processing in sensorimotor, associative, and limbic circuits that are dynamically and hierarchically modulated by sensory information and previous learning. This organization of information processing in biological organisms has served as a major inspiration for artificial intelligence and has helped to create in silico systems capable of matching or even outperforming humans in several specific tasks, including visual recognition and strategy-based games. However, the development of human-like robots that are able to move as quickly as humans and respond flexibly in various situations remains a major challenge and indicates an area where further use of parallel and hierarchical architectures may hold promise. In this article we review several important neural and behavioral mechanisms organizing hierarchical and predictive processing for the acquisition and realization of flexible behavioral control. Then, inspired by the organizational features of brain circuits, we introduce a multi-timescale parallel and hierarchical learning framework for the realization of versatile and agile movement in humanoid robots.

Body-powered variable impedance: An approach to augmenting humans with a passive device by reshaping lifting posture

The movement patterns appropriate for exercise and manual labor do not always correspond to what people instinctively choose for better comfort. Without expert guidance, people can even increase the risk of injury by choosing a comfortable posture rather than the appropriate one, notably when lifting objects. Even in situations where squatting is accepted as a desirable lifting strategy, people tend to choose the more comfortable strategy of stooping or semisquatting. The common approach to correcting lifting posture, immobilizing vulnerable joints via fixation, is insufficient for preventing back injuries sustained from repetitive lifting. Instead, when lifting small but heavy objects, the entire kinetic chain should cooperate to achieve a series of squat-lifting patterns. Inspired by the observation that force fields affect the coordination of voluntary human motion, we devised a passive exosuit embedded with a body-powered variable-impedance mechanism. The exosuit adds impedance to the human joints according to how far the wearer's movement is from the squat-lifting trajectories so that it hinders stooping but facilitates squatting. In an experiment that entailed lifting a small 10-kg box, 10 first-time users changed their voluntary lifting motion closer to squatting on average. Simulation results based on recorded kinematic and kinetic data showed that this postural change reduced the compression force, shear force, and moment on the lumbosacral joint. Our work demonstrates the potential of using an exosuit to help people move in a desirable manner without requiring a complicated, bulky mechanical system.

Task Oriented Training Activities Post Stroke Will Produce Measurable Alterations in Brain Plasticity Concurrent with Skill Improvement

BACKGROUND

Task-oriented training with upper extremity (UE) skilled movements has been established as a method to regain function post stroke. Although improved UE function has been shown after this type of therapy, there is minimal evidence that brain plasticity is associated with this training. The accelerated skill acquisition program (ASAP) is an example of an approach for promoting UE function using targeting movements.

OBJECTIVE

To investigate the effects of a single 2-hour session of ASAP in individuals with stroke on measures of brain plasticity as represented by corticospinal excitability (CE) and determine associations with reach-to-grasp (RTG) performance.

METHODS

Eighteen post-acute stroke patients were randomized to two groups. Experimental group (n = 9) underwent ASAP for 2 hours, while the control group (n = 9) received dose equivalent usual and customary care. Both groups were evaluated for CE and RTG performance prior to the session and then four times after training: immediately, 1 day, 6 days, and 12 days.

RESULTS

Significant alterations in CE were found in the peak-to-peak of Motor Evoked Potential amplitude of elbow and wrist extensor muscles in the lesioned hemisphere. The experimental group also demonstrated improved execution (shortened total movement time, TMT), feed-forward mechanism (deceleration time, DT) and planning (lengthened relative time to maximum hand aperture, RTApmax) compared to the control group.

CONCLUSION

Alterations in brain plasticity occur concurrently with improvements in RTG performance in post-acute stroke patients with mild impairment after a single 2-hour session of task-oriented training and persist for at least 12 days.

Similar stretch reflexes and behavioral patterns are expressed by the dominant and nondominant arms during postural control

Limb dominance is evident in many daily activities, leading to the prominent idea that each hemisphere of the brain specializes in controlling different aspects of movement. Past studies suggest that the dominant arm is primarily controlled via an internal model of limb dynamics that enables the nervous system to produce efficient movements. In contrast, the nondominant arm may be primarily controlled via impedance mechanisms that rely on the strong modulation of sensory feedback from individual joints to control limb posture. We tested whether such differences are evident in behavioral responses and stretch reflexes following sudden displacement of the arm during posture control. Experiment 1 applied specific combinations of elbow-shoulder torque perturbations (the same for all participants). Peak joint displacements, return times, end point accuracy, and the directional tuning and amplitude of stretch reflexes in nearly all muscles were not statistically different between the two arms. Experiment 2 induced specific combinations of joint motion (the same for all participants). Again, peak joint displacements, return times, end point accuracy, and the directional tuning and amplitude of stretch reflexes in nearly all muscles did not differ statistically when countering the imposed loads with each arm. Moderate to strong correlations were found between stretch reflexes and behavioral responses to the perturbations with the two arms across both experiments. Collectively, the results do not support the idea that the dominant arm specializes in exploiting internal models and the nondominant arm in impedance control by increasing reflex gains to counter sudden loads imposed on the arms during posture control.NEW & NOTEWORTHY A prominent hypothesis is that the nervous system controls the dominant arm through predictive internal models and the nondominant arm through impedance mechanisms. We tested whether stretch reflexes of muscles in the two arms also display such specialization during posture control. Nearly all behavioral responses and stretch reflexes did not differ statistically but were strongly correlated between the arms. The results indicate individual signatures of feedback control that are common for the two arms.

Rapid Feedback Responses Parallel the Urgency of Voluntary Reaching Movements

Optimal feedback control is a prominent theory used to interpret human motor behaviour. The theory posits that skilled actions emerge from control policies that link voluntary motor control (feedforward) with flexible feedback corrections (feedback control). It is clear the nervous system can generate flexible motor corrections (reflexes) when performing actions with different goals. We know little, however, about shared features of voluntary actions and feedback control in human movement. Here we reveal a link between the timing demands of voluntary actions and flexible responses to mechanical perturbations. In two experiments, 40 human participants (21 females) made reaching movements with different timing demands. We disturbed the arm with mechanical perturbations at movement onset (Experiment 1) and at locations ranging from movement onset to completion (Experiment 2). We used the resulting muscle responses and limb displacements as a proxy for the control policies that support voluntary reaching movements. We observed an increase in the sensitivity of elbow and shoulder muscle responses and a reduction in limb motion when the task imposed greater urgency to respond to the same perturbations. The results reveal a relationship between voluntary actions and feedback control as the limb was displaced less when moving faster in perturbation trials. Muscle responses scaled with changes in the displacement of the limb in perturbation trials within each timing condition. Across both experiments, human behaviour was captured by simulations based on stochastic optimal feedback control. Taken together, the results highlight flexible control that links sensory processing with features of human reaching movements.

Scaling of Joint Motion and Muscle Activation for 3-Dimensional Control of Reach Extent

This study investigated the scaling of upper arm kinematics, joint motion, and muscle activation for three-dimensional (3D) reaches to targets of increasing distance. Fifteen participants completed 108 total reaches to targets placed 7, 14, and 21 cm across midline. Peak velocity, acceleration, and time to peak velocity scaled to both target and movement distance. Shoulder and elbow excursion scaled to target distance and were highly coordinated. Anterior deltoid activation scaled to both target and movement distance in the early and late phases of reach control. Biceps and triceps activation scaled to movement distance primarily in the late phase. Scaling of these outcome variables provides a model for understanding the control of reach distance in a 3D environment.

Stochastic optimal feedforward-feedback control determines timing and variability of arm movements with or without vision

Human movements with or without vision exhibit timing (i.e. speed and duration) and variability characteristics which are not well captured by existing computational models. Here, we introduce a stochastic optimal feedforward-feedback control (SFFC) model that can predict the nominal timing and trial-by-trial variability of self-paced arm reaching movements carried out with or without online visual feedback of the hand. In SFFC, movement timing results from the minimization of the intrinsic factors of effort and variance due to constant and signal-dependent motor noise, and movement variability depends on the integration of visual feedback. Reaching arm movements data are used to examine the effect of online vision on movement timing and variability, and test the model. This modelling suggests that the central nervous system predicts the effects of sensorimotor noise to generate an optimal feedforward motor command, and triggers optimal feedback corrections to task-related errors based on the available limb state estimate.

Online modification of goal-directed control in human reaching movements

Humans are able to perform very sophisticated reaching movements in a myriad of contexts based on flexible control strategies influenced by the task goal and environmental constraints such as obstacles. However, it remains unknown whether these control strategies can be adjusted online. The objective of this study was to determine whether the factors that determine control strategies during planning also modify the execution of an ongoing movement following sudden changes in task demand. More precisely, we investigated whether, and at which latency, feedback responses to perturbation loads followed the change in the structure of the goal target or environment. We changed the target width (square or rectangle) to alter the task redundancy, or the presence of obstacles to induce different constraints on the reach path, and assessed based on surface electromyography (EMG) recordings when the change in visual display altered the feedback response to mechanical perturbations. Task-related EMG responses were detected within 150 ms of a change in target shape. Considering visuomotor delays of ∼ 100 ms, these results suggest that it takes 50 ms to change control policy within a trial. An additional 30-ms delay was observed when the change in context involved sudden appearance or disappearance of obstacles. Overall, our results demonstrate that the control policy within a reaching movement is not static: contextual factors that influence movement planning also influence movement execution at surprisingly short latencies. Moreover, the additional 30 ms associated with obstacles suggests that these two types of changes may be mediated via distinct processes.NEW & NOTEWORTHY The present work demonstrates that the control strategies used to perform reaching movements are adjusted online when the structure of the target or the presence of obstacles are altered during movements. Thus, the properties of goal-directed reaching control are not simply selected during the planning stage of a movement prior to execution. Rather, they are dynamically and rapidly adjusted online, within ∼150 ms, according to changes in environment.

The cone method: Inferring decision times from single-trial 3D movement trajectories in choice behavior

Ongoing goal-directed movements can be rapidly adjusted following new environmental information, e.g., when chasing pray or foraging. This makes movement trajectories in go-before-you-know decision-making a suitable behavioral readout of the ongoing decision process. Yet, existing methods of movement analysis are often based on statistically comparing two groups of trial-averaged trajectories and are not easily applied to three-dimensional data, preventing them from being applicable to natural free behavior. We developed and tested the cone method to estimate the point of overt commitment (POC) along a single two- or three-dimensional trajectory, i.e., the position where the movement is adjusted towards a newly selected spatial target. In Experiment 1, we established a “ground truth” data set in which the cone method successfully identified the experimentally constrained POCs across a wide range of all but the shallowest adjustment angles. In Experiment 2, we demonstrate the power of the method in a typical decision-making task with expected decision time differences known from previous findings. The POCs identified by cone method matched these expected effects. In both experiments, we compared the cone method’s single trial performance with a trial-averaging method and obtained comparable results. We discuss the advantages of the single-trajectory cone method over trial-averaging methods and possible applications beyond the examples presented in this study. The cone method provides a distinct addition to existing tools used to study decisions during ongoing movement behavior, which we consider particularly promising towards studies of non-repetitive free behavior.

Flexible planning of corrective responses for double-step reduction in the number of potential targets

Humans are often required to plan/execute movements in the presence of multiple motor targets simultaneously. Under such situations, it is widely confirmed that humans frequently initiate movements towards the weighted average direction of distinct motor plans toward each potential target. However, in situations where the potential targets change in a step-by-step manner, the strategy to proceed towards the weighted average direction at each time could be sub-optimal in light of the costs of the corrective response. Herein, we tested the sensorimotor strategy followed during a step-by-step reduction of potential goals. To test the hypothesis, we compared the corrective responses when the number of targets went from three to two, and when the number of targets went from three to one at the same time. As the results, weak corrections were confirmed when the number of targets was reduced from three to two. Moreover, the corrective responses when the number of targets went from three to two was smaller than the average behavior estimated from the corrective responses when the number of targets went from three to one at the same time. This pattern of corrective responses reflects the suppression of unnecessary corrections that generate noise and cost to the control system. These results suggest that the corrective responses are flexibly modulated depending on the necessity, and cannot be explained by weighted average behavior.

Transient deactivation of dorsal premotor cortex or parietal area 5 impairs feedback control of the limb in macaques

We can generate goal-directed motor corrections with surprising speed, but their neural basis is poorly understood. Here, we show that temporary cooling of dorsal premotor cortex (PMd) impaired both spatial accuracy and the speed of corrective responses, whereas cooling parietal area 5 (A5) impaired only spatial accuracy. Simulations based on optimal feedback control (OFC) models demonstrated that "deactivation" of the control policy (reduction in feedback gain) and state estimation (reduction in Kalman gain) caused impairments similar to that observed for PMd and A5 cooling, respectively. Furthermore, combined deactivation of both cortical regions led to additive impairments of individual deactivations, whereas reducing the amount of cooling to PMd led to impairments in response speed but not spatial accuracy, both also predicted by OFC models. These results provide causal support that frontoparietal circuits beyond primary somatosensory and motor cortices are involved in generating goal-directed motor corrections.

Vestibular contributions to online reach execution are processed via mechanisms with knowledge about limb biomechanics

Studies of reach control with the body stationary have shown that proprioceptive and visual feedback signals contributing to rapid corrections during reaching are processed by neural circuits that incorporate knowledge about the physical properties of the limb (an internal model). However, among the most common spatial and mechanical perturbations to the limb are those caused by our body's own motion, suggesting that processing of vestibular signals for online reach control may reflect a similar level of sophistication. We investigated this hypothesis using galvanic vestibular stimulation (GVS) to selectively activate the vestibular sensors, simulating body rotation, as human subjects reached to remembered targets in different directions (forward, leftward, rightward). If vestibular signals contribute to purely kinematic/spatial corrections for body motion, GVS should evoke reach trajectory deviations of similar size in all directions. In contrast, biomechanical modeling predicts that if vestibular processing for online reach control takes into account knowledge of the physical properties of the limb and the forces applied on it by body motion, then GVS should evoke trajectory deviations that are significantly larger during forward and leftward reaches as compared with rightward reaches. When GVS was applied during reaching, the observed deviations were on average consistent with this prediction. In contrast, when GVS was instead applied before reaching, evoked deviations were similar across directions, as predicted for a purely spatial correction mechanism. These results suggest that vestibular signals, like proprioceptive and visual feedback, are processed for online reach control via sophisticated neural mechanisms that incorporate knowledge of limb biomechanics.NEW & NOTEWORTHY Studies examining proprioceptive and visual contributions to rapid corrections for externally applied mechanical and spatial perturbations during reaching have provided evidence for flexible processing of sensory feedback that accounts for musculoskeletal system dynamics. Notably, however, such perturbations commonly arise from our body's own motion. In line with this, we provide compelling evidence that, similar to proprioceptive and visual signals, vestibular signals are processed for online reach control via sophisticated mechanisms that incorporate knowledge of limb biomechanics.

Interactions between initial posture and task-level goal explain experimental variability in postural responses to perturbations of standing balance

Postural responses to similar perturbations of standing balance vary widely within and across subjects. Here, we identified two sources of variability and their interactions by combining experimental observations with computational modeling: differences in posture at perturbation onset across trials and differences in task-level goals across subjects. We first collected postural responses to unpredictable backward support-surface translations during standing in 10 young adults. We found that maximal trunk lean in postural responses to backward translations were highly variable both within subjects (mean of ranges = 28.3°) and across subjects (range of means = 39.9°). Initial center of mass (COM) position was correlated with maximal trunk lean during the response, but this relation was subject specific (R² = 0.29-0.82). We then used predictive simulations to assess causal relations and interactions with task-level goal. Our simulations showed that initial posture explains the experimentally observed intrasubject variability with a more anterior initial COM position increasing the use of the hip strategy. Differences in task-level goal explain observed intersubject variability with prioritizing effort minimization leading to ankle strategies and prioritizing stability leading to hip strategies. Interactions between initial posture and task-level goal explain observed differences in intrasubject variability across subjects. Our findings suggest that variability in initial posture due to increased sway as observed in older adults might increase the occurrence of less stable postural responses to perturbations. Insight in factors causing movement variability will advance our ability to study the origin of differences between groups and conditions.NEW & NOTEWORTHY Responses to perturbations of standing balance vary both within and between individuals. By combining experimental observations with computational modeling, we identified causes of observed kinematic variability in healthy young adults. First, we found that trial-by-trial differences in posture at perturbation onset explain most of the kinematic variability observed within subjects. Second, we found that differences in prioritizing effort versus stability explained differences in the postural response as well as differences in trial-by-trial variability across subjects.

Balance perturbation-evoked cortical N1 responses are larger when stepping and not influenced by motor planning

The cortical N1 response to balance perturbation is observed in electroencephalography recordings simultaneous to automatic balance-correcting muscle activity. We recently observed larger cortical N1s in individuals who had greater difficulty resisting compensatory steps, suggesting the N1 may be influenced by stepping or changes in response strategy. Here, we test whether the cortical N1 response is influenced by stepping (planned steps versus feet-in-place) or prior planning (planned vs. unplanned steps). We hypothesized that prior planning of a step would reduce the amplitude of the cortical N1 response to balance perturbations. In 19 healthy young adults (ages 19-38; 8 men and 11 women), we measured the cortical N1 amplitude evoked by 48 backward translational support-surface perturbations of unpredictable timing and amplitude in a single experimental session. Participants were asked to plan a stepping reaction on half of perturbations, but to resist stepping otherwise. Perturbations included an easy (8 cm, 16 cm/s) perturbation that was identical across participants and did not naturally elicit compensatory steps, and a height-adjusted difficult (18-22 cm, 38-42 cm/s) perturbation that frequently elicited compensatory steps despite instructions to resist stepping. In contrast to our hypothesis, cortical N1 response amplitudes did not differ between planned and unplanned stepping reactions, but cortical responses were 11% larger with the execution of planned compensatory steps compared with nonstepping responses to difficult perturbations. These results suggest a possible role for the cortical N1 in the execution of compensatory steps for balance recovery, and this role is not influenced by whether the compensatory step was planned before the perturbation.NEW & NOTEWORTHY The cortical N1 response to balance perturbation is larger when executing compensatory steps, suggesting a relationship between the cortical N1 and subsequent motor behavior. Additionally, the cortical N1 response is not impacted by prior planning of the stepping reaction, suggesting that predictability of the motor outcome does not impact the N1 in the same way as predictability of the perturbation stimulus.

Visual-reward driven changes of movement during action execution

Motor decision-making is often described as a sequential process, beginning with the assessment of available options and leading to the execution of a selected movement. While this view is likely to be accurate for decisions requiring significant deliberation, it would seem unfit for choices between movements in dynamic environments. In this study, we examined whether and how non-selected motor options may be considered post-movement onset. We hypothesized that a change in reward at any point in time implies a dynamic reassessment of options, even after an initial decision has been made. To test this, we performed a decision-making task in which human participants were instructed to execute a reaching movement from an origin to a rectangular target to attain a reward. Reward depended on arrival precision and on the specific distribution of reward presented along the target. On a third of trials, we changed the initial reward distribution post-movement onset. Our results indicated that participants frequently change their initially selected movements when a change is associated with an increase in reward. This process occurs quicker than overall, average reaction times. Finally, changes in movement are not only dependent on reward but also on the current state of the motor apparatus.

Effort-Based Decision-Making and Gross Motor Performance: Are They Linked?

The purpose of this study was to investigate the relationship between effort-based decision making and gross motor performance. Effort-based decision making was measured using a modified version of the Effort Expenditure for Rewards Task (EEfRT), in which participants pressed a button on a keyboard to fill a bar on a screen for monetary reward. Participants received monetary rewards that were commensurate with the level of effort that they were willing to expend. Gross motor performance was measured with a walking task, in which participants matched their steps to the beat of an audio metronome; they walked to metronome beats that were slower and also faster than their normal walking pace. We hypothesized that increased effort during the effort-based decision making task would be paired with an increase in steps taken per minute during the gross motor task. However, the results of this study indicated a lack of a statistically significant relationship between the effort-based decision making task and the gross motor task. Planning rather than decision-making may have been the cognitive construct that governed our gross motor task. These findings can be beneficial when thinking about potential interventions for populations who experience deficits in motor performance and cognition as well as for understanding the relationship between both cognitive and motor performance in healthy adults.

Time-to-Target Simplifies Optimal Control of Visuomotor Feedback Responses

Visuomotor feedback responses vary in intensity throughout a reach, commonly explained by optimal control. Here, we show that the optimal control for a range of movements with the same goal can be simplified to a time-to-target dependent control scheme. We measure our human participants’ visuomotor responses in five reaching conditions, each with different hand or cursor kinematics. Participants only produced different feedback responses when these kinematic changes resulted in different times-to-target. We complement our experimental data with a range of finite and non-finite horizon optimal feedback control (OFC) models, finding that the model with time-to-target as one of the input parameters best replicates the experimental data. Overall, this suggests that time-to-target is a critical control parameter in online feedback control. Moreover, we propose that for a specific task and known dynamics, humans can instantly produce a control signal without any additional online computation allowing rapid response onset and close to optimal control.

Reaching around obstacles accounts for uncertainty in coordinate transformations

When reaching to a visual target, humans need to transform the spatial target representation into the coordinate system of their moving arm. It has been shown that increased uncertainty in such coordinate transformations, for instance, when the head is rolled toward one shoulder, leads to higher movement variability and influence movement decisions. However, it is unknown whether the brain incorporates such added variability in planning and executing movements. We designed an obstacle avoidance task in which participants had to reach with or without visual feedback of the hand to a visual target while avoiding collisions with an obstacle. We varied coordinate transformation uncertainty by varying head roll (straight, 30° clockwise, and 30° counterclockwise). In agreement with previous studies, we observed that the reaching variability increased when the head was tilted. Indeed, head roll did not influence the number of collisions during reaching compared with the head-straight condition, but it did systematically change the obstacle avoidance behavior. Participants changed the preferred direction of passing the obstacle and increased the safety margins indicated by stronger movement curvature. These results suggest that the brain takes the added movement variability during head roll into account and compensates for it by adjusting the reaching trajectories.NEW & NOTEWORTHY We show that changing body geometry such as head roll results in compensatory reaching behaviors around obstacles. Specifically, we observed head roll causes changed preferred movement direction and increased trajectory curvature. As has been shown before, head roll increases movement variability due to stochastic coordinate transformations. Thus these results provide evidence that the brain must consider the added movement variability caused by coordinate transformations for accurate reach movements.

Visually-updated hand state estimates modulate the proprioceptive reflex independently of motor task requirements

Fast signaling from vision and proprioception to muscle activation plays essential roles in quickly correcting movement. Though many studies have demonstrated modulation of the quick sensorimotor responses as depending on context in each modality, the contribution of multimodal information has not been established. Here, we examined whether state estimates contributing to stretch reflexes are represented solely by proprioceptive information or by multimodal information. Unlike previous studies, we newly found a significant stretch-reflex attenuation by the distortion and elimination of visual-feedback without any change in motor tasks. Furthermore, the stretch-reflex amplitude reduced with increasing elimination durations which would degrade state estimates. By contrast, even though a distortion was introduced in the target-motor-mapping, the stretch reflex was not simultaneously attenuated with visuomotor reflex. Our results therefore indicate that the observed stretch-reflex attenuation is specifically ascribed to uncertainty increase in estimating hand states, suggesting multimodal contributions to the generation of stretch reflexes.