Hedging your bets: intermediate movements as optimal behavior in the context of an incomplete decision

The role of explicit knowledge in compensating for a visuo-proprioceptive cue conflict

It is unclear how explicit knowledge of an externally imposed mismatch between visual and proprioceptive cues of hand position affects perceptual recalibration. The Bayesian causal inference framework might suggest such knowledge should abolish the visual and proprioceptive recalibration that occurs when individuals perceive these cues as coming from the same source (their hand), while the visuomotor adaptation literature suggests explicit knowledge of a cue conflict does not eliminate implicit compensatory processes. Here we compared visual and proprioceptive recalibration in three groups with varying levels of knowledge about the visuo-proprioceptive cue conflict. All participants estimated the position of visual, proprioceptive, or combined targets related to their left index fingertip, with a 70 mm visuo-proprioceptive offset gradually imposed. Groups 1, 2, and 3 received no information, medium information, and high information, respectively, about the offset. Information was manipulated using instructional and visual cues. All groups performed the task similarly at baseline in terms of variance, weighting, and integration. Results suggest the three groups recalibrated vision and proprioception differently, but there was no difference in variance or weighting. Participants who received only instructional cues about the mismatch (Group 2) did not recalibrate less, on average, than participants provided no information about the mismatch (Group 1). However, participants provided instructional cues and extra visual cues of their hands during the perturbation (Group 3) demonstrated significantly less recalibration than other groups. These findings are consistent with the idea that instructional cues alone are insufficient to override participants' intrinsic belief in common cause and reduce recalibration.

Rapid, systematic updating of movement by accumulated decision evidence

Acting in the natural world requires not only deciding among multiple options but also converting decisions into motor commands. How the dynamics of decision formation influence the fine kinematics of response movement remains, however, poorly understood. Here we investigate how the accumulation of decision evidence shapes the response orienting trajectories in a task where freely-moving rats combine prior expectations and auditory information to select between two possible options. Response trajectories and their motor vigor are initially determined by the prior. Rats movements then incorporate sensory information as early as 60 ms after stimulus onset by accelerating or slowing depending on how much the stimulus supports their initial choice. When the stimulus evidence is in strong contradiction, rats change their mind and reverse their initial trajectory. Human subjects performing an equivalent task display a remarkably similar behavior. We encapsulate these results in a computational model that, by mapping the decision variable onto the movement kinematics at discrete time points, captures subjects' choices, trajectories and changes of mind. Our results show that motor responses are not ballistic. Instead, they are systematically and rapidly updated, as they smoothly unfold over time, by the parallel dynamics of the underlying decision process.

Continuous evaluation of cost-to-go for flexible reaching control and online decisions

Humans consider the parameters linked to movement goal during reaching to adjust their control strategy online. Indeed, rapid changes in target structure or disturbances interfering with their initial plan elicit rapid changes in behavior. Here, we hypothesize that these changes could result from the continuous use of a decision variable combining motor and cognitive components. We combine an optimal feedback controller with a real-time evaluation of the expected cost-to-go, which considers target- and movement-related costs, in a common theoretical framework. This model reproduces human behaviors in presence of changes in the target structure occurring during movement and of online decisions to flexibly change target following external perturbations. It also predicts that the time taken to decide to select a novel goal after a perturbation depends on the amplitude of the disturbance and on the rewards of the different options, which is a direct result of the continuous monitoring of the cost-to-go. We show that this result was present in our previously collected dataset. Together our developments point towards a continuous evaluation of the cost-to-go during reaching to update control online and make efficient decisions about movement goal.

Single-Trial Dynamics of Competing Reach Plans in the Human Motor Periphery

Contemporary motor control theories propose competition between multiple motor plans before the winning command is executed. While most competitions are completed before movement onset, movements are often initiated before the competition has been resolved. An example of this is saccadic averaging, wherein the eyes land at an intermediate location between two visual targets. Behavioral and neurophysiological signatures of competing motor commands have also been reported for reaching movements, but debate remains about whether such signatures attest to an unresolved competition, arise from averaging across many trials, or reflect a strategy to optimize behavior given task constraints. Here, we recorded EMG activity from an upper limb muscle (m. pectoralis) while 12 (8 female) participants performed an immediate response reach task, freely choosing between one of two identical and suddenly presented visual targets. On each trial, muscle recruitment showed two distinct phases of directionally tuned activity. In the first wave, time-locked ∼100 ms of target presentation, muscle activity was clearly influenced by the nonchosen target, reflecting a competition between reach commands that was biased in favor of the ultimately chosen target. This resulted in an initial movement intermediate between the two targets. In contrast, the second wave, time-locked to voluntary reach onset, was not biased toward the nonchosen target, showing that the competition between targets was resolved. Instead, this wave of activity compensated for the averaging induced by the first wave. Thus, single-trial analysis reveals an evolution in how the nonchosen target differentially influences the first and second wave of muscle activity.SIGNIFICANCE STATEMENT Contemporary theories of motor control suggest that multiple motor plans compete for selection before the winning command is executed. Evidence for this is found in intermediate reach movements toward two potential target locations, but recent findings have challenged this notion by arguing that intermediate reaching movements reflect an optimal response strategy. By examining upper limb muscle recruitment during a free-choice reach task, we show early recruitment of a suboptimal averaged motor command to the two targets that subsequently transitions to a single motor command that compensates for the initially averaged motor command. Recording limb muscle activity permits single-trial resolution of the dynamic influence of the nonchosen target through time.

Capacity Limits Lead to Information Bottlenecks in Ongoing Rapid Motor Behaviors

Studies of ongoing, rapid motor behaviors have often focused on the decision-making implicit in the task. Here, we instead study how decision-making integrates with the perceptual and motor systems and propose a framework of limited-capacity, pipelined processing with flexible resources to understand rapid motor behaviors. Results from three experiments show that human performance is consistent with our framework: participants perform objectively worse as task difficulty increases, and, surprisingly, this drop in performance is largest for the most skilled performers. As well, our analysis shows that the worst-performing participants can perform equally well under increased task demands, which is consistent with flexible neural resources being allocated to reduce bottleneck effects and improve overall performance. We conclude that capacity limits lead to information bottlenecks and that processes like attention help reduce the effects that these bottlenecks have on maximal performance.

Parallel movement planning is achieved via an optimal preparatory state in motor cortex

How do patterns of neural activity in the motor cortex contribute to the planning of a movement? A recent theory developed for single movements proposes that the motor cortex acts as a dynamical system whose initial state is optimized during the preparatory phase of the movement. This theory makes important yet untested predictions about preparatory dynamics in more complex behavioral settings. Here, we analyze preparatory activity in non-human primates planning not one but two movements simultaneously. As predicted by the theory, we find that parallel planning is achieved by adjusting preparatory activity within an optimal subspace to an intermediate state reflecting a trade-off between the two movements. The theory quantitatively accounts for the relationship between this intermediate state and fluctuations in the animals' behavior down at the trial level. These results uncover a simple mechanism for planning multiple movements in parallel and further point to motor planning as a controlled dynamical process.

A neurocomputational theory of action regulation predicts motor behavior in neurotypical individuals and patients with Parkinson’s disease

Surviving in an uncertain environment requires not only the ability to select the best action, but also the flexibility to withhold inappropriate actions when the environmental conditions change. Although selecting and withholding actions have been extensively studied in both human and animals, there is still lack of consensus on the mechanism underlying these action regulation functions, and more importantly, how they inter-relate. A critical gap impeding progress is the lack of a computational theory that will integrate the mechanisms of action regulation into a unified framework. The current study aims to advance our understanding by developing a neurodynamical computational theory that models the mechanism of action regulation that involves suppressing responses, and predicts how disruption of this mechanism can lead to motor deficits in Parkinson’s disease (PD) patients. We tested the model predictions in neurotypical individuals and PD patients in three behavioral tasks that involve free action selection between two opposed directions, action selection in the presence of conflicting information and abandoning an ongoing action when a stop signal is presented. Our results and theory suggest an integrated mechanism of action regulation that affects both action initiation and inhibition. When this mechanism is disrupted, motor behavior is affected, leading to longer reaction times and higher error rates in action inhibition.

Age-related increases in reaction time result from slower preparation, not delayed initiation

Recent work indicates that healthy younger adults can prepare accurate responses faster than their voluntary reaction times would suggest, leaving a seemingly unnecessary delay of 80-100 ms before responding. Here, we examined how the preparation of movements, initiation of movements, and the delay between them are affected by aging. Participants made planar reaching movements in two conditions. The "free reaction time" condition assessed the voluntary reaction times with which participants responded to the appearance of a stimulus. The "forced reaction time" condition assessed the minimum time actually needed to prepare accurate movements by controlling the time allowed for movement preparation. The time taken to both initiate movements in the free reaction time and to prepare movements in the forced response condition increased with age. Notably, the time required to prepare accurate movements was significantly shorter than participants' self-selected initiation times; however, the delay between movement preparation and initiation remained consistent across the lifespan (∼90 ms). These results indicate that the slower reaction times of healthy older adults are not due to an increased hesitancy to respond, but can instead be attributed to changes in their ability to process stimuli and prepare movements accordingly, consistent with age-related changes in brain structure and function.NEW & NOTEWORTHY Previous research argues that older adults have slower response times because they hesitate to react, favoring accuracy over speed. The present results challenge this proposal. We found the delay between the minimum time required to prepare movements and the self-selected time at which they initiated remained consistent at ∼90 ms from ages 21 to 80. We therefore suggest older adults' slower response times can be attributed to changes in their ability to process stimuli and prepare movements.

Anticipatory action planning for stepping onto competing potential targets

The brain plans an anticipatory action for performing tasks successfully and effortlessly even if there are multiple possible options. There is increasing evidence that, when multiple actions are possible, the brain considers two factors when planning an anticipatory action—the probabilistic value and the action cost for each potential action. When the action involves maintaining upright balance, such as standing, stepping, or walking, the action cost for maintaining postural stability could be considered dominantly. We addressed this issue by using a “go-before-you-know” task to step onto a target on the floor. In this task, two potential targets were located on the medial or lateral side of the stepping foot, and the true target was cued only after participants shifted their loads to leave that foot. Participants initiated their stepping actions without knowing which of the potential targets would be the true one. The results showed that, for the majority of participants, lateral displacements of the center of pressure (COP) with two potential targets were similar to those when a single target exists on the individual’s medial side. Given that mediolateral postural stability became more destabilized with stepping onto the medial target than stepping onto the lateral target, they were likely to plan their mediolateral components of the postural adjustments for the worst-case scenario (i.e., falling). Additionally, posterior COP movements with two potential targets became smaller than those with a single target, suggesting an effort to create extra time to determine the true target and to adjust the swing foot. Based on these findings, we concluded that action costs for maintaining postural stability were considered dominantly for planning an anticipatory action to accomplish a stepping task successfully while ensuring upright balance.

Symbolic cues enhance express visuomotor responses in human arm muscles at the motor planning rather than the visuospatial processing stage

Humans can produce "express" (~100ms) arm muscle responses that are inflexibly locked in time and space to visual target presentations, consistent with subcortical visuomotor transformations via the tecto-reticulo-spinal pathway. These express visuomotor responses are sensitive to explicit cue-driven expectations, but it is unclear at what stage of sensory-to-motor transformation such modulation occurs. Here, we recorded electromyographic activity from shoulder muscles as participants reached toward one of four virtual targets whose physical location was partially predictable from a symbolic cue. In an experiment in which targets could be veridically reached, express responses were inclusive of the biomechanical requirements for reaching the cued locations and not systematically modulated by cue validity. In a second experiment, movements were restricted to the horizontal plane so that the participants could perform only rightward or leftward reaches, irrespective of target position on the vertical axis. Express muscle responses were almost identical for targets that were validly cued in the horizontal direction, regardless of cue validity in the vertical dimension. Together, these findings suggest that the cue-induced enhancements of express responses are dominated by effects at the level of motor plans and not solely via facilitation of early visuospatial target processing. Notably, direct cortico-tectal and cortico-reticular projections exist that are well-placed to modulate pre-stimulus motor preparation state in subcortical circuits. Our results could reflect a neural mechanism by which contextually relevant motor responses to compatible visual inputs are rapidly released via subcortical circuits that are sufficiently along the sensory- to-motor continuum.

Dissociable use-dependent processes for volitional goal-directed reaching

Repetition of specific movement biases subsequent actions towards the practiced movement, a phenomenon known as use-dependent learning (UDL). Recent experiments that impose strict constraints on planning time have revealed two sources of use-dependent biases, one arising from dynamic changes occurring during motor planning and another reflecting a stable shift in motor execution. Here, we used a distributional analysis to examine the contribution of these biases in reaching. To create the conditions for UDL, the target appeared at a designated 'frequent' location on most trials, and at one of six 'rare' locations on other trials. Strikingly, the heading angles were bimodally distributed, with peaks at both frequent and rare target locations. Despite having no constraints on planning time, participants exhibited a robust bias towards the frequent target when movements were self-initiated quickly, the signature of a planning bias; notably, the peak near the rare target was shifted in the frequently practiced direction, the signature of an execution bias. Furthermore, these execution biases were not only replicated in a delayed-response task but were also insensitive to reward. Taken together, these results extend our understanding of how volitional movements are influenced by recent experience.

Different planning policies for the initial movement velocity depending on whether the known uncertainty is in the cursor or in the target: Motor planning in situations where two potential movement distances exist

During goal-directed behaviors, individuals can be required to start a movement before deciding on the final goal. Previous studies have focused on the initial movement direction in situations involving multiple targets in different directions from the starting position and have shown that the movement is initiated in the average direction among the target directions. However, the previous studies only included situations with targets at equivalent distances, and the characteristics of motor planning in situations with multiple movement possibilities over different potential distances are unclear. In such situations, movement velocity is another important control variable. Furthermore, while previous studies examined situations with an uncertain motor target position, uncertainty can also exist in the effector position (e.g., body or tool locations). Therefore, we examined (1) whether the average output is confirmed in the initial movement velocity during execution in situations involving two potential movements with different distances. In addition, we examined (2) whether planning of the movement velocity can differ depending on the presence of uncertainty in the cursor or the target. In the main conditions, the participants were required to start a reaching movement with two potential movement distances; in the two-cursor condition, two cursors were presented before the start of the trial, and in the two-target condition, two targets were presented. As a control condition, a distance condition corresponding to each main condition was also performed. In the control condition, the initial movement velocity varied linearly with distance. Then, we tested whether the initial movement velocity in situations with two potential movement distances would follow the averaging output of the corresponding control condition. The results revealed that while the initial movement velocity in the two-target condition was slower than the averaging output, that in the two-cursor condition approached the averaging output. These results suggest that the velocity profile of the goal-directed movement is not simply averaged in a situation where two potential targets exist, and that there is a difference in the planning policy of the initial movement depending on whether the known uncertainty is for the movement goal or the effector.

The dynamics of decision-making and action during active sampling

Embodied Cognition Theories (ECTs) of decision-making propose that the decision process pervades the execution of choice actions and manifests itself in these actions. Decision-making scenarios where actions not only express the choice but also help sample information can provide a valuable, ecologically relevant model for this framework. We present a study to address this paradigmatic situation in humans. Subjects categorized (2AFC task) a central object image, blurred to different extents, by moving a cursor toward the left or right of the display. Upward cursor movements reduced the image blur and could be used to sample information. Thus, actions for decision and actions for sampling were orthogonal to each other. We analyzed response trajectories to test whether information-sampling movements co-occurred with the ongoing decision process. Trajectories were bimodally distributed, with one kind being direct towards one response option (non-sampling), and the other kind containing an initial upward component before veering off towards an option (sampling). This implies that there was an initial decision at the early stage of a trial, whether to sample information or not. Importantly, in sampling trials trajectories were not purely upward, but rather had a significant horizontal deviation early on. This result suggests that movements to sample information exhibit an online interaction with the decision process, therefore supporting the prediction of the ECTs under ecologically relevant constrains.

Modulation of initial movement for double potential targets with specific time constraints

In goal-directed behavior, individuals are often required to plan and execute a movement with multiple competing reach targets simultaneously. The time constraint assigned to the target is an important factor that affect the initial movement planning, but the adjustments made to the starting behavior considering the time constraints specific to each target have not yet been clarified. The current study examined how humans adjusted their motor planning for double potential targets with independent time constraints under a go-before-you-know situation. The results revealed that the initial movements were modulated depending on the time constraints for potential targets. However, under tight time constraints, the performance in the double-target condition was lower than the single-target condition, which was a control condition implemented to estimate performance when one target is ignored. These results indicate that the initial movement for multiple potential targets with independent time constraints can be modified, but the planning is suboptimal.

Sensorimotor strategy selection under time constraints in the presence of two motor targets with different values

Goal-directed movements often require choosing an option from multiple potential goals under time constraints. However, there are limited studies on how humans change their time spent on decision-making and movement patterns according to time constraints. Here, we examined how sensorimotor strategies are selected under time constraints when the target values are uncertain. In the double-target condition, the values were uncertain until the movement onset and presented immediately afterwards. The behavior in this condition was compared to the single-target condition, in relation to time constraints and target-separation-angles. The results showed that the participants frequently used the choice-reaction even under tight time constraints, and their performance was consistently lower than that in the single-target condition. Additionally, in the double-target condition, differences in the movement trajectory depending on the time constraint and target-separation angle were confirmed. Specifically, the longer the time constraint, the higher the frequency of the intermediate behavior (to initiate movement toward the intermediate direction of two targets) or the change-of-mind behavior (to change the aiming target during movement). Furthermore, the smaller the target-separation angle, the higher the frequency of intermediate behavior, but the frequency of change-of-mind was not affected by the target-separation angle. These results suggest that the participants initiated the movement at an incomplete value judgment stage in some trials. Furthermore, they seemed to select a strategy to utilize the information obtained during the movement, taking into account the time constraints and target-separation angle. Our results show a consistent cognitive bias in choosing a higher value when multiple alternatives have different values. Additionally, we also suggest flexibility and adaptability in the movement patterns in response to time constraints.

Action planning and control under uncertainty emerge through a desirability-driven competition between parallel encoding motor plans

Living in an uncertain world, nearly all of our decisions are made with some degree of uncertainty about the consequences of actions selected. Although a significant progress has been made in understanding how the sensorimotor system incorporates uncertainty into the decision-making process, the preponderance of studies focus on tasks in which selection and action are two separate processes. First people select among alternative options and then initiate an action to implement the choice. However, we often make decisions during ongoing actions in which the value and availability of the alternatives can change with time and previous actions. The current study aims to decipher how the brain deals with uncertainty in decisions that evolve while acting. To address this question, we trained individuals to perform rapid reaching movements towards two potential targets, where the true target location was revealed only after the movement initiation. We found that reaction time and initial approach direction are correlated, where initial movements towards intermediate locations have longer reaction times than movements that aim directly to the target locations. Interestingly, the association between reaction time and approach direction was independent of the target probability. By modeling the task within a recently proposed neurodynamical framework, we showed that action planning and control under uncertainty emerge through a desirability-driven competition between motor plans that are encoded in parallel.

Motor planning under uncertainty

Actions often require the selection of a specific goal amongst a range of possibilities, like when a softball player must precisely position her glove to field a fast-approaching ground ball. Previous studies have suggested that during goal uncertainty the brain prepares for all potential goals in parallel and averages the corresponding motor plans to command an intermediate movement that is progressively refined as additional information becomes available. Although intermediate movements are widely observed, they could instead reflect a neural decision about the single best action choice given the uncertainty present. Here we systematically dissociate these possibilities using novel experimental manipulations and find that when confronted with uncertainty, humans generate a motor plan that optimizes task performance rather than averaging potential motor plans. In addition to accurate predictions of population-averaged changes in motor output, a novel computational model based on this performance-optimization theory accounted for a majority of the variance in individual differences between participants. Our findings resolve a long-standing question about how the brain selects an action to execute during goal uncertainty, providing fundamental insight into motor planning in the nervous system.

Movement preparation time determines movement variability

Faster movements are typically more variable-a speed-accuracy trade-off known as Fitts' law. Are movements that are initiated faster also more variable? Neurophysiological work has associated larger neural variability during motor preparation with longer reaction time (RT) and larger movement variability, implying that movement variability decreases with increasing RT. Here, we recorded over 30,000 reaching movements in 11 human participants who moved to visually cued targets. Half of the visual cues were accompanied by a beep to evoke a wide RT range in each participant. Results show that initial reach variability decreases with increasing RT, for voluntarily produced RTs up to ∼300 ms, whereas other kinematic aspects and endpoint accuracy remained unaffected. We conclude that movement preparation time determines initial movement variability. We suggest that the chosen movement preparation time reflects a trade-off between movement initiation and precision.NEW & NOTEWORTHY Fitts' law describes the speed-accuracy trade-off in the execution of human movements. We examined whether there is also a trade-off between movement planning time and initial movement precision. We show that shorter reaction times result in higher initial movement variability. In other words, movement preparation time determines movement variability.

Flexible planning of corrective responses for double-step reduction in the number of potential targets

Humans are often required to plan/execute movements in the presence of multiple motor targets simultaneously. Under such situations, it is widely confirmed that humans frequently initiate movements towards the weighted average direction of distinct motor plans toward each potential target. However, in situations where the potential targets change in a step-by-step manner, the strategy to proceed towards the weighted average direction at each time could be sub-optimal in light of the costs of the corrective response. Herein, we tested the sensorimotor strategy followed during a step-by-step reduction of potential goals. To test the hypothesis, we compared the corrective responses when the number of targets went from three to two, and when the number of targets went from three to one at the same time. As the results, weak corrections were confirmed when the number of targets was reduced from three to two. Moreover, the corrective responses when the number of targets went from three to two was smaller than the average behavior estimated from the corrective responses when the number of targets went from three to one at the same time. This pattern of corrective responses reflects the suppression of unnecessary corrections that generate noise and cost to the control system. These results suggest that the corrective responses are flexibly modulated depending on the necessity, and cannot be explained by weighted average behavior.

Visuomotor associations facilitate movement preparation

Many motor skills require rapidly choosing a movement goal and preparing a movement to that goal, such as in sports where circumstances often change quickly and many actions are possible. Humans can benefit from learning the perceptual cues that predict the requirements of movement so that the choice of a movement goal and movement preparation can occur earlier. However, there remains uncertainty about how these perceptual cues are learned. Here we investigate the use and learning of these perceptual-motor associations. First, we ask if episodic memory for associations can support learning. In Experiment 1, participants first memorized associations between symbols and movement goals. When these symbols were subsequently presented as cues, reaching movements were prepared as efficiently as if the goals themselves were previewed, without the need for additional practice. Next, we ask whether statistical learning can be used to learn the associations. In Experiment 2, participants had to learn the associations during the movement task itself. This learning enabled efficient movement preparation, and the rate of improvement scaled with the number and complexity of associations. These findings suggest that movement preparation can be facilitated by perceptual cues via statistical learning and memory recall, highlighting a potential role for learning and memory systems not conventionally implicated in motor behavior. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Reaching movements are automatically redirected to nearby options during target split

Motor behavior often occurs in environments with multiple goal options that can vary during the ongoing action. We explored this situation by requiring subjects to select between different target options during an ongoing reach. During split trials the original target was replaced with a left and a right flanking target, and participants had to select between them. This contrasted with the standard jump trials, where the original target would be replaced with a single flanking target, left or right. When participants were instructed to follow their natural tendency, they all tended to select the split target nearest the original. The near-target preference was more prominent with increased spatial disparity between the options and when participants could preview the potential options. Moreover, explicit instruction to obtain the "far" target during split trials resulted many errors compared with a "near" instruction, ~50% vs. ~15%. Online reaction times to target change were delayed in split trials compared with jump trials, ~200 ms vs. ~150 ms, but also highly automatic. Trials in which the instructed far target was correctly obtained were delayed by a further ~50 ms, unlike those in which the near target was incorrectly obtained. We also observed nonspecific responses from arm muscles at the jump trial latency during split trials. Taken together, our results indicate that online selection of reach targets is automatically linked to the spatial distribution of the options, though at greater delays than redirecting to a single target.NEW & NOTEWORTHY This work demonstrates that target selection during an ongoing reach is automatically linked to the option nearest a voided target. Online reaction times for two options are longer than redirection to a single option. Attempts to override the near-target tendency result in a high number of errors at the normal delay and further delays when the attempt is successful.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

Perceptual decisions about object shape bias visuomotor coordination during rapid interception movements

Visual processing for perception and for action is thought to be mediated by two specialized neural pathways. Using a visuomotor decision-making task, we show that participants differentially utilized online perceptual decision-making in reaching and interception and that eye movements necessary for perception influenced motor decision strategies. These results provide evidence that task complexity modulates how pathways processing perception versus action information interact during the visual control of movement.

Reaching decisions during ongoing movements

Neurophysiological studies suggest that when decisions are made between concrete actions, the selection process involves a competition between potential action representations in the same sensorimotor structures involved in executing those actions. However, it is unclear how such models can explain situations, often encountered during natural behavior, in which we make decisions while were are already engaged in performing an action. Does the process of deliberation characterized in classical studies of decision-making proceed the same way when subjects are deciding while already acting? In the present study, human subjects continuously tracked a target moving in the horizontal plane and were occasionally presented with a new target to which they could freely choose to switch at any time, whereupon it became the new tracked target. We found that the probability of choosing to switch increased with decreasing distance to the new target and increasing size of the new target relative to the tracked target, as well as when the direction to the new target was aligned (either toward or opposite) to the current tracking direction. However, contrary to our expectations, subjects did not choose targets that minimized the energetic costs of execution, as calculated by a biomechanical model of the arm. When the constraints of continuous tracking were removed in variants of the task involving point-to-point movements, the expected preference for lower cost choices was seen. These results are discussed in the context of current theories of nested feedback control, internal models of forward dynamics, and high-dimensional neural spaces.NEW & NOTEWORTHY Current theories of decision-making primarily address how subjects make decisions before executing selected actions. However, in our daily lives we often make decisions while already performing some action (e.g., while playing a sport or navigating through a crowd). To gain insight into how current theories can be extended to such "decide-while-acting" scenarios, we examined human decisions during continuous manual tracking and found some intriguing departures from how decisions are made in classical "decide-then-act" paradigms.

Movement Repetition Facilitates Response Preparation

Our sensorimotor system appears to be influenced by the recent history of our movements. Repeating movements toward a particular direction is known to have a dramatic effect on involuntary movements elicited by cortical stimulation-a phenomenon that has been termed use-dependent plasticity. However, analogous effects of repetition on behavior have proven elusive. Here, we show that movement repetition enhances the generation of similar movements in the future by reducing the time required to select and prepare the repeated movement. We further show that this reaction time advantage for repeated movements is attributable to more rapid, but still flexible, preparation of the repeated movement rather than anticipation and covert advance preparation of the previously repeated movement. Our findings demonstrate a powerful and beneficial effect of movement repetition on response preparation, which may represent a behavioral counterpart to use-dependent plasticity effects in primary motor cortex.

Decision-making in sensorimotor control

Skilled sensorimotor interactions with the world result from a series of decision-making processes that determine, on the basis of information extracted during the unfolding sequence of events, which movements to make and when and how to make them. Despite this inherent link between decision-making and sensorimotor control, research into each of these two areas has largely evolved in isolation, and it is only fairly recently that researchers have begun investigating how they interact and, together, influence behaviour. Here, we review recent behavioural, neurophysiological and computational research that highlights the role of decision-making processes in the selection, planning and control of goal-directed movements in humans and nonhuman primates.

The temporal and spatial constraints of saccade planning to double-step target displacements

The double-step paradigm investigates the characteristics of planning and execution when the motor system must rapidly adjust for a new goal location. Studies have provided detailed temporal information based on the duration available for the motor system to prepare a new movement trajectory (here referred to as re-preparation time). However, previous work has largely examined single displacement sizes, limiting the spatiotemporal understanding of movement planning and execution. The lack of a description of this behavioral timecourse across increasing displacement sizes is true for saccades, rapid eye movements that redirect the fovea. Furthermore, during the double-step paradigm, the primary saccade often fails to accurately foveate the final target location and a secondary saccade brings the target onto the fovea. However, it is also unknown how this compensation is concurrently modified with the exposure duration and displacement of the movement goal. Here, we examined the amount of time required to change the initial saccade direction to a new target location for relatively small (20°, 30°, and 40°) and large (60° and 90°) target spatial separations. Interestingly, we found a clear relationship between the saccade direction and the amount of time allowed to redirect the movement; across separations, intermediate saccades occurred when approximately 60-140 ms was available to readjust the movement plan. Additionally, there was a consistent relationship between the timing of the secondary saccade and the re-preparation time across jump sizes, suggesting that concurrent movement correction planning was dependent on the amount of exposure to the final movement goal.

Simultaneous motor preparation and execution in a last-moment reach correction task

Motor preparation typically precedes movement and is thought to determine properties of upcoming movements. However, preparation has mostly been studied in point-to-point delayed reaching tasks. Here, we ask whether preparation is engaged during mid-reach modifications. Monkeys reach to targets that occasionally jump locations prior to movement onset, requiring a mid-reach correction. In motor cortex and dorsal premotor cortex, we find that the neural activity that signals when to reach predicts monkeys’ jump responses on a trial-by-trial basis. We further identify neural patterns that signal where to reach, either during motor preparation or during motor execution. After a target jump, neural activity responds in both preparatory and movement-related dimensions, even though error in preparatory dimensions can be small at that time. This suggests that the same preparatory process used in delayed reaching is also involved in reach correction. Furthermore, it indicates that motor preparation and execution can be performed simultaneously.

Motor preparation processes guide movement. Here, by recording neural activity in monkeys reaching toward targets that can change location, the authors provide evidence that changing a prepared movement midway through completion reengages motor preparation.

Dissociable cognitive strategies for sensorimotor learning

Computations underlying cognitive strategies in human motor learning are poorly understood. Here we investigate such strategies in a common sensorimotor transformation task. We show that strategies assume two forms, likely reflecting distinct working memory representations: discrete caching of stimulus-response contingencies, and time-consuming parametric computations. Reaction times and errors suggest that both strategies are employed during learning, and trade off based on task complexity. Experiments using pressured preparation time further support dissociable strategies: In response caching, time pressure elicits multi-modal distributions of movements; during parametric computations, time pressure elicits a shifting distribution of movements between visual targets and distal goals, consistent with analog re-computing of a movement plan. A generalization experiment reveals that discrete and parametric strategies produce, respectively, more localized or more global transfer effects. These results describe how qualitatively distinct cognitive representations are leveraged for motor learning and produce downstream consequences for behavioral flexibility.

Single reach plans in dorsal premotor cortex during a two-target task

In many situations, we are faced with multiple potential actions, but must wait for more information before knowing which to perform. Movement scientists have long asked whether in these delayed-response situations the brain plans both potential movements simultaneously, or if it simply chooses one and then switches later if necessary. To answer this question, we used simultaneously recorded activity from populations of neurons in macaque dorsal premotor cortex to track moment-by-moment deliberation between two potential reach targets. We found that the neural activity only ever indicated a single-reach plan (with some targets favored more than others), and that initial plans often predicted the monkeys’ behavior on both Free-Choice trials and incorrect Cued trials. Our results suggest that premotor cortex plans only one option at a time, and that decisions are strongly influenced by the initial response to the available set of movement options.

It is debated whether motor cortical activity reflects plans for multiple potential actions. Here, the authors report that in a delayed response task with two potential reach targets, population activity in the dorsal premotor cortex at any moment in time represents only one of the targets.

Complex Upper-Limb Movements Are Generated by Combining Motor Primitives that Scale with the Movement Size

The hand trajectory of motion during the performance of one-dimensional point-to-point movements has been shown to be marked by motor primitives with a bell-shaped velocity profile. Researchers have investigated if motor primitives with the same shape mark also complex upper-limb movements. They have done so by analyzing the magnitude of the hand trajectory velocity vector. This approach has failed to identify motor primitives with a bell-shaped velocity profile as the basic elements underlying the generation of complex upper-limb movements. In this study, we examined upper-limb movements by analyzing instead the movement components defined according to a Cartesian coordinate system with axes oriented in the medio-lateral, antero-posterior, and vertical directions. To our surprise, we found out that a broad set of complex upper-limb movements can be modeled as a combination of motor primitives with a bell-shaped velocity profile defined according to the axes of the above-defined coordinate system. Most notably, we discovered that these motor primitives scale with the size of movement according to a power law. These results provide a novel key to the interpretation of brain and muscle synergy studies suggesting that human subjects use a scale-invariant encoding of movement patterns when performing upper-limb movements.

Economic Choice as an Untangling of Options into Actions

We propose that economic choice can be understood as a gradual transformation from a domain of options to one of the actions. We draw an analogy with the idea of untangling information in the form vision system and propose that form vision and economic choice may be two aspects of a larger process that sculpts actions based on sensory inputs. From this viewpoint, choice results from the accumulated effect of repetitions of simple computations. These may consist primarily of relative valuations (evaluations relative to the value of rejection, perhaps in a manner akin to divisive normalization) applied to individual offers. With regard to economic choice, cortical brain regions differ primarily in their position and in what information they prioritize, and do not-with a few exceptions-have categorically distinct roles. Each region's specific contribution is determined largely by its inputs; thus, understanding connectivity is crucial for understanding choice. This view suggests that there is no single site of choice, that there is no meaningful distinction between pre- and post-decisionality, and that there is no explicit representation of value in the brain.

Population coding of conditional probability distributions in dorsal premotor cortex

Our bodies and the environment constrain our movements. For example, when our arm is fully outstretched, we cannot extend it further. More generally, the distribution of possible movements is conditioned on the state of our bodies in the environment, which is constantly changing. However, little is known about how the brain represents such distributions, and uses them in movement planning. Here, we record from dorsal premotor cortex (PMd) and primary motor cortex (M1) while monkeys reach to randomly placed targets. The hand’s position within the workspace creates probability distributions of possible upcoming targets, which affect movement trajectories and latencies. PMd, but not M1, neurons have increased activity when the monkey’s hand position makes it likely the upcoming movement will be in the neurons’ preferred directions. Across the population, PMd activity represents probability distributions of individual upcoming reaches, which depend on rapidly changing information about the body’s state in the environment.

Movements are continually constrained by the current body position and its relation to the surroundings. Here the authors report that the population activity of monkey dorsal premotor cortex neurons dynamically represents the probability distribution of possible reach directions.

A threshold-free model of numerosity comparisons

A dominant mechanism in the Judgment and Decision Making literature states that information is accumulated about each choice option until a decision threshold is met. Only after that threshold does a subject start to execute a motor response to indicate their choice. However, recent research has revealed spatial gradients in motor responses as a function of comparison difficulty as well as changes-of-mind in the middle of an action, both suggesting continued accumulation and processing of decision-related signals after the decision boundary. Here we present a formal model and supporting data from a number comparison task that a continuous motor planner, combined with a simple statistical inference scheme, can model detailed behavioral effects without assuming a threshold. This threshold-free model reproduces subjects’ sensitivity to numerical distance in reaching, accuracy, reaction time, and changes of mind. We argue that the motor system positions the effectors using an optimal biomechanical feedback controller, and continuous statistical inference on outputs from cognitive processes.

Grip force when reaching with target uncertainty provides evidence for motor optimization over averaging

When presented with competing potential reach targets and required to launch a movement before knowing which one will be cued as the target, people initially reach in the average target direction. Although this spatial averaging could arise from executing a weighted average of motor plans for the potential targets, it could also arise from planning a single, optimal movement. To test between these alternatives we used a task in which participants were required to reach to either a single target or towards two potential targets while grasping an object. A robotic device applied a lateral elastic load to the object requiring large grip forces for reaches to targets either side of midline and a minimal grip force for midline movements. As expected, in trials with two targets located either side of midline, participants initially reached straight ahead. Critically, on these trials the initial grip force was minimal, appropriate for the midline movement, and not the average of the large grip forces required for movements to the individual targets. These results indicate that under conditions of target uncertainty, people do not execute an average of planned actions but rather a single movement that optimizes motor costs.

Motor planning flexibly optimizes performance under uncertainty about task goals

In an environment full of potential goals, how does the brain determine which movement to execute? Existing theories posit that the motor system prepares for all potential goals by generating several motor plans in parallel. One major line of evidence for such theories is that presenting two competing goals often results in a movement intermediate between them. These intermediate movements are thought to reflect an unintentional averaging of the competing plans. However, normative theories suggest instead that intermediate movements might actually be deliberate, generated because they improve task performance over a random guessing strategy. To test this hypothesis, we vary the benefit of making an intermediate movement by changing movement speed. We find that participants generate intermediate movements only at (slower) speeds where they measurably improve performance. Our findings support the normative view that the motor system selects only a single, flexible motor plan, optimized for uncertain goals.

Rapid Automatic Motor Encoding of Competing Reach Options

Mounting neural evidence suggests that, in situations in which there are multiple potential targets for action, the brain prepares, in parallel, competing movements associated with these targets, prior to implementing one of them. Central to this interpretation is the idea that competing viewed targets, prior to selection, are rapidly and automatically transformed into corresponding motor representations. Here, by applying target-specific, gradual visuomotor rotations and dissociating, unbeknownst to participants, the visual direction of potential targets from the direction of the movements required to reach the same targets, we provide direct evidence for this provocative idea. Our results offer strong empirical support for theories suggesting that competing action options are automatically represented in terms of the movements required to attain them. The rapid motor encoding of potential targets may support the fast optimization of motor costs under conditions of target uncertainty and allow the motor system to inform decisions about target selection.

A switching cost for motor planning

Movement planning consists of choosing the intended endpoint of the movement and selecting the motor program that will bring the effector on the endpoint. It is widely accepted that movement endpoint is updated on a trial-by-trial basis with respect to the observed errors and that the motor program for a given movement follows the rules of optimal feedback control. In this article, we show clear limitations of these theories. First, participants in the current study could not tune their motor program appropriately for each individual trial. This was true even when the participants selected the width of the target that they reached toward or when they had learned the appropriate motor program previously. These data are compatible with the existence of a switching cost for motor planning, which relates to the drop in performance due to an imposed switch of motor programs. This cost of switching shares many features of costs reported in cognitive task switching experiments and, when tested in the same participants, was correlated with it. Second, we found that randomly changing the width of a target over the course of a reaching experiment prevents the motor system from updating the endpoint of movements on the basis of the performance on the previous trial if the width of the target has changed. These results provide new insights into the process of motor planning and how it relates to optimal control theory and to an action selection based on the reward consequences of the motor program rather than that based on the observed error.

Independence of Movement Preparation and Movement Initiation

Initiating a movement in response to a visual stimulus takes significantly longer than might be expected on the basis of neural transmission delays, but it is unclear why. In a visually guided reaching task, we forced human participants to move at lower-than-normal reaction times to test whether normal reaction times are strictly necessary for accurate movement. We found that participants were, in fact, capable of moving accurately ∼80 ms earlier than their reaction times would suggest. Reaction times thus include a seemingly unnecessary delay that accounts for approximately one-third of their duration. Close examination of participants' behavior in conventional reaction-time conditions revealed that they generated occasional, spontaneous errors in trials in which their reaction time was unusually short. The pattern of these errors could be well accounted for by a simple model in which the timing of movement initiation is independent of the timing of movement preparation. This independence provides an explanation for why reaction times are usually so sluggish: delaying the mean time of movement initiation relative to preparation reduces the risk that a movement will be initiated before it has been appropriately prepared. Our results suggest that preparation and initiation of movement are mechanistically independent and may have a distinct neural basis. The results also demonstrate that, even in strongly stimulus-driven tasks, presentation of a stimulus does not directly trigger a movement. Rather, the stimulus appears to trigger an internal decision whether to make a movement, reflecting a volitional rather than reactive mode of control.

Competition between movement plans increases motor variability: evidence of a shared resource for movement planning

Various lines of evidence indicate that multiple movements can be prepared in parallel. Here, we show that preparing more than one movement comes with a cost: a movement plan is more variable if it is prepared simultaneously with another plan. This suggests that the representations of movement plans share a common neural resource and implies that the number of alternative plans is constrained by noise.

Do movement plans, like representations in working memory, share a limited pool of resources? If so, the precision with which each individual movement plan is specified should decrease as the total number of movement plans increases. To explore this, human participants made speeded reaching movements toward visual targets. We examined if preparing one movement resulted in less variability than preparing two movements. The number of planned movements was manipulated in a delayed response cueing procedure that limited planning to a single target (experiment 1) or hand (experiment 2) or required planning of movements toward two targets (or with two hands). For both experiments, initial movement direction variability was higher in the two-plan condition than in the one-plan condition, demonstrating a cost associated with planning multiple movements, consistent with the limited resource hypothesis. In experiment 3, we showed that the advantage in initial variability of preparing a single movement was present only when the trajectory could be fully specified. This indicates that the difference in variability between one and two plans reflects the specification of full motor plans, not a general preparedness to move. The precision cost related to concurrent plans represents a novel constraint on motor preparation, indicating that multiple movements cannot be planned independently, even if they involve different limbs.

Visuomotor Map Determines How Visually Guided Reaching Movements are Corrected Within and Across Trials

When a visually guided reaching movement is unexpectedly perturbed, it is implicitly corrected in two ways: immediately after the perturbation by feedback control (online correction) and in the next movement by adjusting feedforward motor commands (offline correction or motor adaptation). Although recent studies have revealed a close relationship between feedback and feedforward controls, the nature of this relationship is not yet fully understood. Here, we show that both implicit online and offline movement corrections utilize the same visuomotor map for feedforward movement control that transforms the spatial location of visual objects into appropriate motor commands. First, we artificially distorted the visuomotor map by applying opposite visual rotations to the cursor representing the hand position while human participants reached for two different targets. This procedure implicitly altered the visuomotor map so that changes in the movement direction to the target location were more insensitive or more sensitive. Then, we examined how such visuomotor map distortion influenced online movement correction by suddenly changing the target location. The magnitude of online movement correction was altered according to the shape of the visuomotor map. We also examined offline movement correction; the aftereffect induced by visual rotation in the previous trial was modulated according to the shape of the visuomotor map. These results highlighted the importance of the visuomotor map as a foundation for implicit motor control mechanisms and the intimate relationship between feedforward control, feedback control, and motor adaptation.

The sequential encoding of competing action goals involves dynamic restructuring of motor plans in working memory

Recent neural and behavioral findings provide support for the influential idea that in situations in which multiple action options are presented simultaneously, we prepare action plans for each competing option before deciding between and executing one of those plans. However, in natural, everyday environments, our available action options frequently change from one moment to the next, and there is often uncertainty as to whether additional options will become available before having to select a particular course of action. Here, with the use of a target-directed reaching task, we show that in this situation, the brain specifies a competing action for each new, sequentially presented potential target and that recently formed action plans can be revisited and updated so as to conform with separate, more newly developed, plans. These findings indicate that the brain forms labile motor plans for sequentially arising target options that can be flexibly restructured to accommodate new motor plans.

Parallel specification of competing sensorimotor control policies for alternative action options

Recent theory proposes that the brain, when confronted with several action possibilities, prepares multiple competing movements before deciding among them. Psychophysical supporting evidence for this idea comes from the observation that when reaching towards multiple potential targets, the initial movement is directed towards the average location of the targets, consistent with multiple prepared reaches being executed simultaneously. However, reach planning involves far more than specifying movement direction; it requires the specification of a sensorimotor control policy that sets feedback gains shaping how the motor system responds to errors induced by noise or external perturbations. Here we found that, when a subject is reaching towards multiple potential targets, the feedback gain corresponds to an average of the gains specified when reaching to each target presented alone. Our findings provide evidence that the brain, when presented with multiple action options, computes multiple competing sensorimotor control policies in parallel before implementing one of them.

Development of internal models and predictive abilities for visual tracking during childhood

The prediction of the consequences of our own actions through internal models is an essential component of motor control. Previous studies showed improvement of anticipatory behaviors with age for grasping, drawing, and postural control. Since these actions require visual and proprioceptive feedback, these improvements might reflect both the development of internal models and the feedback control. In contrast, visual tracking of a temporarily invisible target gives specific markers of prediction and internal models for eye movements. Therefore, we recorded eye movements in 50 children (aged 5-19 yr) and in 10 adults, who were asked to pursue a visual target that is temporarily blanked. Results show that the youngest children (5-7 yr) have a general oculomotor behavior in this task, qualitatively similar to the one observed in adults. However, the overall performance of older subjects in terms of accuracy at target reappearance and variability in their behavior was much better than the youngest children. This late maturation of predictive mechanisms with age was reflected into the development of the accuracy of the internal models governing the synergy between the saccadic and pursuit systems with age. Altogether, we hypothesize that the maturation of the interaction between smooth pursuit and saccades that relies on internal models of the eye and target displacement is related to the continuous maturation of the cerebellum.

Explicit and Implicit Processes Constitute the Fast and Slow Processes of Sensorimotor Learning

A popular model of human sensorimotor learning suggests that a fast process and a slow process work in parallel to produce the canonical learning curve (Smith et al., 2006). Recent evidence supports the subdivision of sensorimotor learning into explicit and implicit processes that simultaneously subserve task performance (Taylor et al., 2014). We set out to test whether these two accounts of learning processes are homologous. Using a recently developed method to assay explicit and implicit learning directly in a sensorimotor task, along with a computational modeling analysis, we show that the fast process closely resembles explicit learning and the slow process approximates implicit learning. In addition, we provide evidence for a subdivision of the slow/implicit process into distinct manifestations of motor memory. We conclude that the two-state model of motor learning is a close approximation of sensorimotor learning, but it is unable to describe adequately the various implicit learning operations that forge the learning curve. Our results suggest that a wider net be cast in the search for the putative psychological mechanisms and neural substrates underlying the multiplicity of processes involved in motor learning.