Reaching decisions during ongoing movements

Toward a neuroscience of natural behavior

One of the most exciting new developments in systems neuroscience is the progress being made toward neurophysiological experiments that move beyond simplified laboratory settings and address the richness of natural behavior. This is enabled by technological advances such as wireless recording in freely moving animals, automated quantification of behavior, and new methods for analyzing large data sets. Beyond new empirical methods and data, however, there is also a need for new theories and concepts to interpret that data. Such theories need to address the particular challenges of natural behavior, which often differ significantly from the scenarios studied in traditional laboratory settings. Here, we discuss some strategies for developing such novel theories and concepts and some example hypotheses being proposed.

Explicit effort may not influence perceptuomotor decision-making

Many decisions that humans make are enacted by the action system. For example, humans use reach-to-grasp movements when making perceptuomotor decisions between and obtaining fruits of varying quality from a pile. Recent work suggests that the characteristics of each action alternative may influence the decision itself-there may be a bias away from making perceptuomotor alternatives associated with high effort when participants are unaware of the effort differences between responses. The present study examined if perceptuomotor decisions were influenced by explicit reaching effort differences. Neurotypical human participants were presented with random dot motion stimuli in which most dots moved in random directions and varying percentages of remaining dots moved coherently left- or rightward. Participants reported leftward motion judgements by performing leftward (or left hand) reaching movements and rightward motion judgements by performing rightward (or right hand) reaching movements. A resistance band was affixed to participants' wrists and to the table in different configurations. The configurations allowed for one movement/motion direction judgement to always require stretching of the band and, therefore, require relatively more effort. Across a set of experiments, the response context (i.e. selecting directions within a limb or selecting between limbs) and the effort difference between responses were manipulated. Overall, no experiment revealed a bias away from the perceptuomotor decision associated with high effort. Based on these results, it is concluded that, in this biomechanical context, explicit effort may not influence perceptuomotor decision-making and may point to a contextual influence of action effort on perceptuomotor decision-making.

Self-motion perception and sequential decision-making: where are we heading?

To navigate and guide adaptive behaviour in a dynamic environment, animals must accurately estimate their own motion relative to the external world. This is a fundamentally multisensory process involving integration of visual, vestibular and kinesthetic inputs. Ideal observer models, paired with careful neurophysiological investigation, helped to reveal how visual and vestibular signals are combined to support perception of linear self-motion direction, or heading. Recent work has extended these findings by emphasizing the dimension of time, both with regard to stimulus dynamics and the trade-off between speed and accuracy. Both time and certainty-i.e. the degree of confidence in a multisensory decision-are essential to the ecological goals of the system: terminating a decision process is necessary for timely action, and predicting one's accuracy is critical for making multiple decisions in a sequence, as in navigation. Here, we summarize a leading model for multisensory decision-making, then show how the model can be extended to study confidence in heading discrimination. Lastly, we preview ongoing efforts to bridge self-motion perception and navigation per se, including closed-loop virtual reality and active self-motion. The design of unconstrained, ethologically inspired tasks, accompanied by large-scale neural recordings, raise promise for a deeper understanding of spatial perception and decision-making in the behaving animal. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Continuous evaluation of cost-to-go for flexible reaching control and online decisions

Humans consider the parameters linked to movement goal during reaching to adjust their control strategy online. Indeed, rapid changes in target structure or disturbances interfering with their initial plan elicit rapid changes in behavior. Here, we hypothesize that these changes could result from the continuous use of a decision variable combining motor and cognitive components. We combine an optimal feedback controller with a real-time evaluation of the expected cost-to-go, which considers target- and movement-related costs, in a common theoretical framework. This model reproduces human behaviors in presence of changes in the target structure occurring during movement and of online decisions to flexibly change target following external perturbations. It also predicts that the time taken to decide to select a novel goal after a perturbation depends on the amplitude of the disturbance and on the rewards of the different options, which is a direct result of the continuous monitoring of the cost-to-go. We show that this result was present in our previously collected dataset. Together our developments point towards a continuous evaluation of the cost-to-go during reaching to update control online and make efficient decisions about movement goal.

Beyond simple laboratory studies: Developing sophisticated models to study rich behavior

Psychology and neuroscience are concerned with the study of behavior, of internal cognitive processes, and their neural foundations. However, most laboratory studies use constrained experimental settings that greatly limit the range of behaviors that can be expressed. While focusing on restricted settings ensures methodological control, it risks impoverishing the object of study: by restricting behavior, we might miss key aspects of cognitive and neural functions. In this article, we argue that psychology and neuroscience should increasingly adopt innovative experimental designs, measurement methods, analysis techniques and sophisticated computational models to probe rich, ecologically valid forms of behavior, including social behavior. We discuss the challenges of studying rich forms of behavior as well as the novel opportunities offered by state-of-the-art methodologies and new sensing technologies, and we highlight the importance of developing sophisticated formal models. We exemplify our arguments by reviewing some recent streams of research in psychology, neuroscience and other fields (e.g., sports analytics, ethology and robotics) that have addressed rich forms of behavior in a model-based manner. We hope that these "success cases" will encourage psychologists and neuroscientists to extend their toolbox of techniques with sophisticated behavioral models - and to use them to study rich forms of behavior as well as the cognitive and neural processes that they engage.

Integrated control of non-motor and motor efforts during perceptual decision-making and action execution: a pilot study

Humans daily life is characterized by a succession of voluntary actions. Since energy resources are limited, the ability to invest the appropriate amount of effort for selecting and executing these actions is a hallmark of adapted behavior. Recent studies indicate that decisions and actions share important principles, including the optimization of their duration when the context requires it. In the present pilot study, we test the hypothesis that the management of effort-related energy resources is shared between decision and action too. Healthy human subjects performed a perceptual decision task where they had to choose between two levels of effort to invest in making the decision (i.e. two levels of perceptual difficulty), and report it with a reaching movement. Crucially, the movement accuracy requirement gradually increased from trial to trial depending on participants' decision performance. Results indicate an overall moderate and non-significant impact of the increasing motor difficulty on the choice of the non-motor (decision) effort to invest in each trial and on decision performance. By contrast, motor performance strongly decreased depending on both the motor and decisional difficulties. Together, the results support the hypothesis of an integrated management of the effort-related energy resources between decision and action. They also suggest that in the present task, the mutualized resources are primarily allocated to the decision-making process to the detriment of movements.

Embodied decision biases: individually stable across different tasks?

In everyday life, action and decision-making often run in parallel. Action-based models argue that action and decision-making strongly interact and, more specifically, that action can bias decision-making. This embodied decision bias is thought to originate from changes in motor costs and/or cognitive crosstalk. Recent research confirmed embodied decision biases for different tasks including walking and manual movements. Yet, whether such biases generalize within individuals across different tasks remains to be determined. To test this, we used two different decision-making tasks that have independently been shown to reliably produce embodied decision biases. In a within-participant design, participants performed two tasks in a counterbalanced fashion: (i) a walking paradigm for which it is known that motor costs systematically influence reward decisions, and (ii) a manual movement task in which motor costs and cognitive crosstalk have been shown to impact reward decisions. In both tasks, we successfully replicated the predicted embodied decision biases. However, there was no evidence that the strength of the biases correlated between tasks. Hence, our findings do not confirm that embodied decision biases transfer between tasks. Future research is needed to examine whether this lack of transfer may be due to different causes underlying the impact of motor costs on decisions and the impact of cognitive crosstalk or task-specific differences.

Capacity Limits Lead to Information Bottlenecks in Ongoing Rapid Motor Behaviors

Studies of ongoing, rapid motor behaviors have often focused on the decision-making implicit in the task. Here, we instead study how decision-making integrates with the perceptual and motor systems and propose a framework of limited-capacity, pipelined processing with flexible resources to understand rapid motor behaviors. Results from three experiments show that human performance is consistent with our framework: participants perform objectively worse as task difficulty increases, and, surprisingly, this drop in performance is largest for the most skilled performers. As well, our analysis shows that the worst-performing participants can perform equally well under increased task demands, which is consistent with flexible neural resources being allocated to reduce bottleneck effects and improve overall performance. We conclude that capacity limits lead to information bottlenecks and that processes like attention help reduce the effects that these bottlenecks have on maximal performance.

Humans account for cognitive costs when finding shortcuts: An information-theoretic analysis of navigation

When faced with navigating back somewhere we have been before we might either retrace our steps or seek a shorter path. Both choices have costs. Here, we ask whether it is possible to characterize formally the choice of navigational plans as a bounded rational process that trades off the quality of the plan (e.g., its length) and the cognitive cost required to find and implement it. We analyze the navigation strategies of two groups of people that are firstly trained to follow a "default policy" taking a route in a virtual maze and then asked to navigate to various known goal destinations, either in the way they want ("Go To Goal") or by taking novel shortcuts ("Take Shortcut"). We address these wayfinding problems using InfoRL: an information-theoretic approach that formalizes the cognitive cost of devising a navigational plan, as the informational cost to deviate from a well-learned route (the "default policy"). In InfoRL, optimality refers to finding the best trade-off between route length and the amount of control information required to find it. We report five main findings. First, the navigational strategies automatically identified by InfoRL correspond closely to different routes (optimal or suboptimal) in the virtual reality map, which were annotated by hand in previous research. Second, people deliberate more in places where the value of investing cognitive resources (i.e., relevant goal information) is greater. Third, compared to the group of people who receive the "Go To Goal" instruction, those who receive the "Take Shortcut" instruction find shorter but less optimal solutions, reflecting the intrinsic difficulty of finding optimal shortcuts. Fourth, those who receive the "Go To Goal" instruction modulate flexibly their cognitive resources, depending on the benefits of finding the shortcut. Finally, we found a surprising amount of variability in the choice of navigational strategies and resource investment across participants. Taken together, these results illustrate the benefits of using InfoRL to address navigational planning problems from a bounded rational perspective.

The influence of movement-related costs when searching to act and acting to search

Real-world search behavior often involves limb movements, either during search or after search. Here we investigated whether movement-related costs influence search behavior in two kinds of search tasks. In our visual search tasks, participants made saccades to find a target object among distractors and then moved a cursor, controlled by the handle of a robotic manipulandum, to the target. In our manual search tasks, participants moved the cursor to perform the search, placing it onto objects to reveal their identity as either a target or a distractor. In all tasks, there were multiple targets. Across experiments, we manipulated either the effort or time costs associated with movement such that these costs varied across the search space. We varied effort by applying different resistive forces to the handle, and we varied time costs by altering the speed of the cursor. Our analysis of cursor and eye movements during manual and visual search, respectively, showed that effort influenced manual search but did not influence visual search. In contrast, time costs influenced both visual and manual search. Our results demonstrate that, in addition to perceptual and cognitive factors, movement-related costs can also influence search behavior.NEW & NOTEWORTHY Numerous studies have investigated the perceptual and cognitive factors that influence decision making about where to look, or move, in search tasks. However, little is known about how search is influenced by movement-related costs associated with acting on an object once it has been visually located or acting during manual search. In this article, we show that movement time costs can bias visual and manual search and that movement effort costs bias manual search.

Integrated neural dynamics of sensorimotor decisions and actions

Recent theoretical models suggest that deciding about actions and executing them are not implemented by completely distinct neural mechanisms but are instead two modes of an integrated dynamical system. Here, we investigate this proposal by examining how neural activity unfolds during a dynamic decision-making task within the high-dimensional space defined by the activity of cells in monkey dorsal premotor (PMd), primary motor (M1), and dorsolateral prefrontal cortex (dlPFC) as well as the external and internal segments of the globus pallidus (GPe, GPi). Dimensionality reduction shows that the four strongest components of neural activity are functionally interpretable, reflecting a state transition between deliberation and commitment, the transformation of sensory evidence into a choice, and the baseline and slope of the rising urgency to decide. Analysis of the contribution of each population to these components shows meaningful differences between regions but no distinct clusters within each region, consistent with an integrated dynamical system. During deliberation, cortical activity unfolds on a two-dimensional "decision manifold" defined by sensory evidence and urgency and falls off this manifold at the moment of commitment into a choice-dependent trajectory leading to movement initiation. The structure of the manifold varies between regions: In PMd, it is curved; in M1, it is nearly perfectly flat; and in dlPFC, it is almost entirely confined to the sensory evidence dimension. In contrast, pallidal activity during deliberation is primarily defined by urgency. We suggest that these findings reveal the distinct functional contributions of different brain regions to an integrated dynamical system governing action selection and execution.

What is the contribution of voluntary and reflex processes to sensorimotor control of balance?

The contribution to balance of spinal and transcortical processes including the long-latency reflex is well known. The control of balance has been modelled previously as a continuous, state feedback controller representing, long-latency reflexes. However, the contribution of slower, variable delay processes has not been quantified. Compared with fixed delay processes (spinal, transcortical), we hypothesize that variable delay processes provide the largest contribution to balance and are sensitive to historical context as well as current states. Twenty-two healthy participants used a myoelectric control signal from their leg muscles to maintain balance of their own body while strapped to an actuated, inverted pendulum. We study the myoelectric control signal (u) in relation to the independent disturbance (d) comprising paired, discrete perturbations of varying inter-stimulus-interval (ISI). We fit the closed loop response, u from d, using one linear and two non-linear non-parametric (many parameter) models. Model M1 (ARX) is a generalized, high-order linear-time-invariant (LTI) process with fixed delay. Model M1 is equivalent to any parametric, closed-loop, continuous, linear-time-invariant (LTI), state feedback model. Model M2, a single non-linear process (fixed delay, time-varying amplitude), adds an optimized response amplitude to each stimulus. Model M3, two non-linear processes (one fixed delay, one variable delay, each of time-varying amplitude), add a second process of optimized delay and optimized response amplitude to each stimulus. At short ISI, the myoelectric control signals deviated systematically both from the fixed delay LTI process (M1), and also from the fixed delay, time-varying amplitude process (M2) and not from the two-process model (M3). Analysis of M3 (all fixed delay and variable delay response amplitudes) showed the variable (compared with fixed) delay process 1) made the largest contribution to the response, 2) exhibited refractoriness (increased delay related to short ISI) and 3) was sensitive to stimulus history (stimulus direction 2 relative to stimulus 1). For this whole-body balance task and for these impulsive stimuli, non-linear processes at variable delay are central to control of balance. Compared with fixed delay processes (spinal, transcortical), variable delay processes provided the largest contribution to balance and were sensitive to historical context as well as current states.

Quantitatively assessing aging effects in rapid motor behaviours: a cross-sectional study

BACKGROUND

An individual's rapid motor skills allow them to perform many daily activities and are a hallmark of physical health. Although age and sex are both known to affect motor performance, standardized methods for assessing their impact on upper limb function are limited.

METHODS

Here we perform a cross-sectional study of 643 healthy human participants in two interactive motor tasks developed to quantify sensorimotor abilities, Object-Hit (OH) and Object-Hit-and-Avoid (OHA). The tasks required participants to hit virtual objects with and without the presence of distractor objects. Velocities and positions of hands and objects were recorded by a robotic exoskeleton, allowing a variety of parameters to be calculated for each trial. We verified that these tasks are viable for measuring performance in healthy humans and we examined whether any of our recorded parameters were related to age or sex.

RESULTS

Our analysis shows that both OH and OHA can assess rapid motor behaviours in healthy human participants. It also shows that while some parameters in these tasks decline with age, those most associated with the motor system do not. Three parameters show significant sex-related effects in OH, but these effects disappear in OHA.

CONCLUSIONS

This study suggests that the underlying effect of aging on rapid motor behaviours is not on the capabilities of the motor system, but on the brain's capacity for processing inputs into motor actions. Additionally, this study provides a baseline description of healthy human performance in OH and OHA when using these tasks to investigate age-related declines in sensorimotor ability.

Theta but not beta activity is modulated by freedom of choice during action selection

Large-scale neurophysiological markers of action competition have been almost exclusively investigated in the context of instructed choices, hence it remains unclear whether these markers also apply to free choices. This study aimed to compare the specific brain dynamics underlying instructed and free decisions. Electroencephalography (EEG) was recorded while 31 participants performed a target selection task; the choice relied either on stimulus-response mappings (instructed) or on participants' preferences (free). Choice difficulty was increased by introducing distractors in the informative stimulus in instructed choices, and by presenting targets with similar motor costs in free choices. Results revealed that increased decision difficulty was associated with higher reaction times (RTs) in instructed choices and greater choice uncertainty in free choices. Midfrontal EEG theta (4-8 Hz) power increased with difficulty in instructed choices, but not in free choices. Although sensorimotor beta (15-30 Hz) power was correlated with RTs, it was not significantly influenced by choice context or difficulty. These results suggest that midfrontal theta power may specifically increase with difficulty in externally-driven choices, whereas sensorimotor beta power may be predictive of RTs in both externally- and internally-driven choices.

Having several options does not increase the time it takes to make a movement to an adequate end point

Throughout the day, people constantly make choices such as where to direct their gaze or place their foot. When making such movement choices, there are usually multiple acceptable options, although some are more advantageous than others. How much time does it take to make such choices and to what extent is the most advantageous option chosen from the available alternatives? To find out, we asked participants to collect points by tapping on any of several targets with their index finger. It did not take participants more time to direct their movements to an advantageous target when there were more options. Participants chose targets that were advantageous because they were easier to reach. Targets could be easier to reach because the finger was already moving in their direction when they appeared, or because they were larger or oriented along the movement direction so that the finger could move faster towards them without missing them. When the target’s colour indicated that it was worth more points they chose it slightly less fast, presumably because it generally takes longer to respond to colour than to respond to attributes such as size. They also chose it less often than they probably should have, presumably because the advantage of choosing it was established arbitrarily. We conclude that having many options does not increase the time it takes to move to an adequate target.

Reward-Dependent Selection of Feedback Gains Impacts Rapid Motor Decisions

Target reward influences motor planning strategies through modulation of movement vigor. Considering current theories of sensorimotor control suggesting that movement planning consists in selecting a goal-directed control strategy, we sought to investigate the influence of reward on feedback control. Here, we explored this question in three human reaching experiments. First, we altered the explicit reward associated with the goal target and found an overall increase in feedback gains for higher target rewards, highlighted by larger velocities, feedback responses to external loads, and background muscle activity. Then, we investigated whether the differences in target rewards across multiple goals impacted rapid motor decisions during movement. We observed idiosyncratic switching strategies dependent on both target rewards and, surprisingly, the feedback gains at perturbation onset: the more vigorous movements were less likely to switch to a new goal following perturbations. To gain further insight into a causal influence of the feedback gains on rapid motor decisions, we demonstrated that biasing the baseline activity and reflex gains by means of a background load evoked a larger proportion of target switches in the direction opposite to the background load associated with lower muscle activity. Together, our results demonstrate an impact of target reward on feedback control and highlight the competition between movement vigor and flexibility.

Competition, Conflict and Change of Mind: A Role of GABAergic Inhibition in the Primary Motor Cortex

Deciding between different voluntary movements implies a continuous control of the competition between potential actions. Many theories postulate a leading role of prefrontal cortices in this executive function, but strong evidence exists that a motor region like the primary motor cortex (M1) is also involved, possibly via inhibitory mechanisms. This was already shown during the pre-movement decision period, but not after movement onset. For this pilot experiment we designed a new task compatible with the dynamics of post-onset control to study the silent period (SP) duration, a pause in electromyographic activity after single-pulse transcranial magnetic stimulation that reflects inhibitory mechanisms. A careful analysis of the SP during the ongoing movement indicates a gradual increase in inhibitory mechanisms with the level of competition, consistent with an increase in mutual inhibition between alternative movement options. However, we also observed a decreased SP duration for high-competition trials associated with change-of-mind inflections in their trajectories. Our results suggest a new post-onset adaptive process that consists in a transient reduction of GABAergic inhibition within M1 for highly conflicting situations. We propose that this reduced inhibition softens the competition between concurrent motor options, thereby favoring response vacillation, an adaptive strategy that proved successful at improving behavioral performance.

Dissociating the Impact of Movement Time and Energy Costs on Decision-Making and Action Initiation in Humans

Recent theories and data suggest that adapted behavior involves economic computations during which multiple trade-offs between reward value, accuracy requirement, energy expenditure, and elapsing time are solved so as to obtain rewards as soon as possible while spending the least possible amount of energy. However, the relative impact of movement energy and duration costs on perceptual decision-making and movement initiation is poorly understood. Here, we tested 31 healthy subjects on a perceptual decision-making task in which they executed reaching movements to report probabilistic choices. In distinct blocks of trials, the reaching duration (“Time” condition) and energy (“Effort” condition) costs were independently varied compared to a “Reference” block, while decision difficulty was maintained similar at the block level. Participants also performed a simple delayed-reaching (DR) task aimed at estimating movement initiation duration in each motor condition. Results in that DR task show that long duration movements extended reaction times (RTs) in most subjects, whereas energy-consuming movements led to mixed effects on RTs. In the decision task, about half of the subjects decreased their decision durations (DDs) in the Time condition, while the impact of energy on DDs were again mixed across subjects. Decision accuracy was overall similar across motor conditions. These results indicate that movement duration and, to a lesser extent, energy expenditure, idiosyncratically affect perceptual decision-making and action initiation. We propose that subjects who shortened their choices in the time-consuming condition of the decision task did so to limit a drop of reward rate.

Sensorimotor strategy selection under time constraints in the presence of two motor targets with different values

Goal-directed movements often require choosing an option from multiple potential goals under time constraints. However, there are limited studies on how humans change their time spent on decision-making and movement patterns according to time constraints. Here, we examined how sensorimotor strategies are selected under time constraints when the target values are uncertain. In the double-target condition, the values were uncertain until the movement onset and presented immediately afterwards. The behavior in this condition was compared to the single-target condition, in relation to time constraints and target-separation-angles. The results showed that the participants frequently used the choice-reaction even under tight time constraints, and their performance was consistently lower than that in the single-target condition. Additionally, in the double-target condition, differences in the movement trajectory depending on the time constraint and target-separation angle were confirmed. Specifically, the longer the time constraint, the higher the frequency of the intermediate behavior (to initiate movement toward the intermediate direction of two targets) or the change-of-mind behavior (to change the aiming target during movement). Furthermore, the smaller the target-separation angle, the higher the frequency of intermediate behavior, but the frequency of change-of-mind was not affected by the target-separation angle. These results suggest that the participants initiated the movement at an incomplete value judgment stage in some trials. Furthermore, they seemed to select a strategy to utilize the information obtained during the movement, taking into account the time constraints and target-separation angle. Our results show a consistent cognitive bias in choosing a higher value when multiple alternatives have different values. Additionally, we also suggest flexibility and adaptability in the movement patterns in response to time constraints.

Deciding while moving: Cognitive interference biases value-based decisions

When people act, they repeatedly have to make value-based decisions about the further course of actions. For example, when driving on the highway, they must decide whether to overtake other cars by changing lanes to arrive at their destination quicker; concurrently, they are required to stay on their momentary lane by controlling the steering wheel. Embodied choice models predict that concurrent action execution modulates value-based decisions. Here, we examined whether value-based decisions are influenced by a change of action costs and/or cognitive interference between concurrent actions and decision making. In a novel, computerized multilane tracking task paradigm, participants (N = 50) controlled a cursor moving on one of three horizontal lanes. During tracking (concurrent action), participants had to switch to other lanes to avoid obstacles or collect rewards (value-based decisions). The action costs associated with a lane switch depended on the cursor position relative to the currently tracked lane, and this relationship varied between conditions. Results showed that value-based lane switching decisions were biased by the cursor state. While this influence was partly attributed to minimizing action costs, a considerable part of the influence could be attributed to cognitive interference. Our findings provide further evidence for embodied choice models, showing that both cognitive interference as well as action costs bias value-based decisions.

Action planning and control under uncertainty emerge through a desirability-driven competition between parallel encoding motor plans

Living in an uncertain world, nearly all of our decisions are made with some degree of uncertainty about the consequences of actions selected. Although a significant progress has been made in understanding how the sensorimotor system incorporates uncertainty into the decision-making process, the preponderance of studies focus on tasks in which selection and action are two separate processes. First people select among alternative options and then initiate an action to implement the choice. However, we often make decisions during ongoing actions in which the value and availability of the alternatives can change with time and previous actions. The current study aims to decipher how the brain deals with uncertainty in decisions that evolve while acting. To address this question, we trained individuals to perform rapid reaching movements towards two potential targets, where the true target location was revealed only after the movement initiation. We found that reaction time and initial approach direction are correlated, where initial movements towards intermediate locations have longer reaction times than movements that aim directly to the target locations. Interestingly, the association between reaction time and approach direction was independent of the target probability. By modeling the task within a recently proposed neurodynamical framework, we showed that action planning and control under uncertainty emerge through a desirability-driven competition between motor plans that are encoded in parallel.

The road towards understanding embodied decisions

Most current decision-making research focuses on classical economic scenarios, where choice offers are prespecified and where action dynamics play no role in the decision. However, our brains evolved to deal with different choice situations: "embodied decisions". As examples of embodied decisions, consider a lion that has to decide which gazelle to chase in the savannah or a person who has to select the next stone to jump on when crossing a river. Embodied decision settings raise novel questions, such as how people select from time-varying choice options and how they track the most relevant choice attributes; but they have long remained challenging to study empirically. Here, we summarize recent progress in the study of embodied decisions in sports analytics and experimental psychology. Furthermore, we introduce a formal methodology to identify the relevant dimensions of embodied choices (present and future affordances) and to map them into the attributes of classical economic decisions (probabilities and utilities), hence aligning them. Studying embodied decisions will greatly expand our understanding of what decision-making is.

Action Costs Rapidly and Automatically Interfere with Reward-Based Decision-Making in a Reaching Task

It is widely assumed that we select actions we value the most. While the influence of rewards on decision-making has been extensively studied, evidence regarding the influence of motor costs is scarce. Specifically, how and when motor costs are integrated in the decision process is unclear. Twenty-two right-handed human participants performed a reward-based target selection task by reaching with their right arm toward one of two visual targets. Targets were positioned in different directions according to biomechanical preference, such that one target was systematically associated with a lower motor cost than the other. Only one of the two targets was rewarded, either in a congruent or incongruent manner with respect to the associated motor cost. A timed-response paradigm was used to manipulate participants' reaction times (RT). Results showed that when the rewarded target carried the highest motor cost, movements produced at short RT (<350 ms) were deviated toward the other (i.e., non-rewarded, low-cost (LC) target). In this context participants needed an additional 150-ms delay to reach the same percentage of rewarded trials as when the LC target was rewarded. Crucially, motor costs affected the total earnings of participants. These results demonstrate a robust interference of motor costs in a simple reward-based decision-making task. They point to the rapid and automatic integration of motor costs at an early stage of processing, potentially through the direct modulation of competing action representations in parieto-frontal regions. The progressive overcoming of this bias with increasing RT is likely achieved through top-down signaling pertaining to expected rewards.

Body dynamics of gait affect value-based decisions

Choosing among different options typically entails weighing their anticipated costs and benefits. Previous research has predominantly focused on situations, where the costs and benefits of choices are known before an action is effectuated. Yet many decisions in daily life are made on the fly, for instance, making a snack choice while walking through the grocery store. Notably, the costs of actions change dynamically while moving. Therefore, in this study we examined whether the concurrent action dynamics of gait form part of and affect value-based decisions. In three experiments, participants had to decide which lateral (left vs. right) target (associated with different rewards) they would go to, while they were already walking. Results showed that the target choice was biased by the alternating stepping behavior, even at the expense of receiving less reward. These findings provide evidence that whole-body action dynamics affect value-based decisions.

The cone method: Inferring decision times from single-trial 3D movement trajectories in choice behavior

Ongoing goal-directed movements can be rapidly adjusted following new environmental information, e.g., when chasing pray or foraging. This makes movement trajectories in go-before-you-know decision-making a suitable behavioral readout of the ongoing decision process. Yet, existing methods of movement analysis are often based on statistically comparing two groups of trial-averaged trajectories and are not easily applied to three-dimensional data, preventing them from being applicable to natural free behavior. We developed and tested the cone method to estimate the point of overt commitment (POC) along a single two- or three-dimensional trajectory, i.e., the position where the movement is adjusted towards a newly selected spatial target. In Experiment 1, we established a “ground truth” data set in which the cone method successfully identified the experimentally constrained POCs across a wide range of all but the shallowest adjustment angles. In Experiment 2, we demonstrate the power of the method in a typical decision-making task with expected decision time differences known from previous findings. The POCs identified by cone method matched these expected effects. In both experiments, we compared the cone method’s single trial performance with a trial-averaging method and obtained comparable results. We discuss the advantages of the single-trajectory cone method over trial-averaging methods and possible applications beyond the examples presented in this study. The cone method provides a distinct addition to existing tools used to study decisions during ongoing movement behavior, which we consider particularly promising towards studies of non-repetitive free behavior.

Reaching movements are automatically redirected to nearby options during target split

Motor behavior often occurs in environments with multiple goal options that can vary during the ongoing action. We explored this situation by requiring subjects to select between different target options during an ongoing reach. During split trials the original target was replaced with a left and a right flanking target, and participants had to select between them. This contrasted with the standard jump trials, where the original target would be replaced with a single flanking target, left or right. When participants were instructed to follow their natural tendency, they all tended to select the split target nearest the original. The near-target preference was more prominent with increased spatial disparity between the options and when participants could preview the potential options. Moreover, explicit instruction to obtain the "far" target during split trials resulted many errors compared with a "near" instruction, ~50% vs. ~15%. Online reaction times to target change were delayed in split trials compared with jump trials, ~200 ms vs. ~150 ms, but also highly automatic. Trials in which the instructed far target was correctly obtained were delayed by a further ~50 ms, unlike those in which the near target was incorrectly obtained. We also observed nonspecific responses from arm muscles at the jump trial latency during split trials. Taken together, our results indicate that online selection of reach targets is automatically linked to the spatial distribution of the options, though at greater delays than redirecting to a single target.NEW & NOTEWORTHY This work demonstrates that target selection during an ongoing reach is automatically linked to the option nearest a voided target. Online reaction times for two options are longer than redirection to a single option. Attempts to override the near-target tendency result in a high number of errors at the normal delay and further delays when the attempt is successful.

Humans sacrifice decision-making for action execution when a demanding control of movement is required

A growing body of evidence suggests that decision-making and action execution are governed by partly overlapping operating principles. Especially, previous work proposed that a shared decision urgency/movement vigor signal, possibly computed in the basal ganglia, coordinates both deliberation and movement durations in a way that maximizes the reward rate. Recent data support one aspect of this hypothesis, indicating that the urgency level at which a decision is made influences the vigor of the movement produced to express this choice. Here we investigated whether, conversely, the motor context in which a movement is executed determines decision speed and accuracy. Twenty human subjects performed a probabilistic decision task in which perceptual choices were expressed by reaching movements toward targets whose size and distance from a starting position varied in distinct blocks of trials. We found strong evidence for an influence of the motor context on most of the subjects' decision policy, but contrary to the predictions of the "shared regulation" hypothesis, we observed that slow movements executed in the most demanding motor blocks in terms of accuracy were often preceded by faster and less accurate decisions compared with blocks of trials in which big targets allowed expression of choices with fast and inaccurate movements. These results suggest that decision-making and motor control are not regulated by one unique "invigoration" signal determining both decision urgency and action vigor, but more likely by independent, yet interacting, decision urgency and movement vigor signals.NEW & NOTEWORTHY Recent hypotheses propose that choices and movements share optimization principles derived from economy, possibly implemented by one unique context-dependent regulation signal determining both processes' speed. In the present behavioral study conducted on human subjects, we demonstrate that action properties indeed influence perceptual decision-making, but that decision duration and action vigor are actually independently set depending on the difficulty of the movement executed to report a choice.