Models, movements, and minds: bridging the gap between decision making and action

Circadian rhythm sleep loss impairs motor inhibition more than motor execution in continuous action

Under total sleep deprivation, both inhibitory and motor control are impaired. However, how circadian rhythm sleep loss caused by irregular sleep pattern affects motor inhibition and execution in continuous actions remains unknown. This study utilized a pointing task to investigate the question over 30 days. During regular trials, participants were instructed to tap on a specified location, while in countermanding trials, they were required to countermand their current action. Additionally, there was a control group performed the same task following a normal 24-h rhythm. The results indicated that the decrease in accuracy and the increase in movement time in countermanding trials were more prominent in the shift work group. In contrast, there was no significant difference in reaction time between the two groups. Notably, the shift work group outperformed the control group in terms of movement time in regular trials and radial displacement in countermanding trials. Overall, these results show that circadian rhythm sleep loss predominantly affects inhibitory control, rather than motor control, underscoring the nuanced impacts of sleep disruption on differential aspects of cognitive and motor functions.

Processing of visual social-communication cues during a social-perception of action task in autistic and non-autistic observers

Social perception and communication differ between those with and without autism, even when verbal fluency and intellectual ability are equated. Previous work found that observers responded more quickly to an actor's points if the actor had chosen by themselves where to point instead of being directed where to point. Notably, this 'choice-advantage' effect decreased across non-autistic participants as the number of autistic-like traits and tendencies increased (Pesquita et al., 2016). Here, we build on that work using the same task to study individuals over a broader range of the spectrum, from autistic to non-autistic, measuring both response initiation and mouse movement times, and considering the response to each actor separately. Autistic and non-autistic observers viewed videos of three different actors pointing to one of two locations, without knowing that the actors were sometimes freely choosing to point to one target and other times being directed where to point. All observers exhibited a choice-advantage overall, meaning they responded more rapidly when actors were freely choosing versus when they were directed, indicating a sensitivity to the actors' postural cues and movements. Our fine-grained analyses found a more robust choice-advantage to some actors than others, with autistic observers showing a choice-advantage only in response to one of the actors, suggesting that both actor and observer characteristics influence the overall effect. We briefly explore existing actor characteristics that may have contributed to this effect, finding that both duration of exposure to pre-movement cues and kinematic cues of the actors likely influence the choice advantage to different degrees across the groups. Altogether, the evidence suggested that both autistic and non-autistic individuals could detect the choice-advantage signal, but that for autistic observers the choice-advantage was actor specific. Notably, we found that the influence of the signal, when present, was detected early for all actors by the non-autistic observers, but detected later and only for one actor by the autistic observers. Altogether, we have more accurately characterized the ability of social-perception in autistic individuals as intact, but highlighted that detection of signal is likely delayed/distributed compared to non-autistic observers and that it is important to investigate actor characteristics that may influence detection and use of their social-perception signals.

Toward a neuroscience of natural behavior

One of the most exciting new developments in systems neuroscience is the progress being made toward neurophysiological experiments that move beyond simplified laboratory settings and address the richness of natural behavior. This is enabled by technological advances such as wireless recording in freely moving animals, automated quantification of behavior, and new methods for analyzing large data sets. Beyond new empirical methods and data, however, there is also a need for new theories and concepts to interpret that data. Such theories need to address the particular challenges of natural behavior, which often differ significantly from the scenarios studied in traditional laboratory settings. Here, we discuss some strategies for developing such novel theories and concepts and some example hypotheses being proposed.

Influence of age and cognitive demand on motor decision making under uncertainty: a study on goal directed reaching movements

In everyday life, we constantly make decisions about actions to be performed subsequently. Research on motor decision making has provided empirical evidence for an influence of decision uncertainty on movement execution in young adults. Further, decision uncertainty was suggested to be increased in older adults due to limited cognitive resources for the integration of information and the prediction of the decision outcomes. However, the influence of cognitive aging on decision uncertainty during motor decision making and movement execution has not been investigated, yet. Thus, in the current study, we presented young and older adults with a motor decision making task, in which participants had to decide on pointing towards one out of five potential targets under varying cognitive demands. Statistical analyses revealed stronger decreases in correctly deciding upon the pointing target, i.e. task performance, from low to higher cognitive demand in older as compared to young adults. Decision confidence also decreased more strongly in older adults with increasing cognitive demand, however, only when collapsing across correct and incorrect decision trials, but not when considering correct decision trials, only. Further, older adults executed reaching movements with longer reaction times and increased path length, though the latter, again, not when considering correct decision trials, only. Last, reaction time and variability in movement execution were both affected by cognitive demand. The outcomes of this study provide a differentiated picture of the distinct and joint effects of aging and cognitive demand during motor decision making.

TAT-HUM: Trajectory analysis toolkit for human movements in Python

Human movement trajectories can reveal useful insights regarding the underlying mechanisms of human behaviors. Extracting information from movement trajectories, however, can be challenging because of their complex and dynamic nature. The current paper presents a Python toolkit developed to help users analyze and extract meaningful information from the trajectories of discrete rapid aiming movements executed by humans. This toolkit uses various open-source Python libraries, such as NumPy and SciPy, and offers a collection of common functionalities to analyze movement trajectory data. To ensure flexibility and ease of use, the toolkit offers two approaches: an automated approach that processes raw data and generates relevant measures automatically, and a manual approach that allows users to selectively use different functions based on their specific needs. A behavioral experiment based on the spatial cueing paradigm was conducted to illustrate how one can use this toolkit in practice. Readers are encouraged to access the publicly available data and relevant analysis scripts as an opportunity to learn about kinematic analysis for human movements.

Dual-tasking modulates movement speed but not value-based choices during walking

Value-based decision-making often occurs in multitasking scenarios relying on both cognitive and motor processes. Yet, laboratory experiments often isolate these processes, thereby neglecting potential interactions. This isolated approach reveals a dichotomy: the cognitive process by which reward influences decision-making is capacity-limited, whereas the influence of motor cost is free of such constraints. If true, dual-tasking should predominantly impair reward processing but not affect the impact of motor costs. To test this hypothesis, we designed a decision-making task in which participants made choices to walk toward targets for rewards while navigating past an obstacle. The motor cost to reach these rewards varied in real-time. Participants either solely performed the decision-making task, or additionally performed a secondary pitch-recall task. Results revealed that while both reward and motor costs influenced decision-making, the secondary task did not affect these factors. Instead, dual-tasking slowed down participants' walking, thereby reducing the overall reward rate. Hence, contrary to the prediction that the added cognitive demand would affect the weighing of reward or motor cost differentially, these processes seem to be maintained at the expense of slowing down the motor system. This slowdown may be indicative of interference at the locomotor level, thereby underpinning motor-cognitive interactions during decision-making.

Rapid, systematic updating of movement by accumulated decision evidence

Acting in the natural world requires not only deciding among multiple options but also converting decisions into motor commands. How the dynamics of decision formation influence the fine kinematics of response movement remains, however, poorly understood. Here we investigate how the accumulation of decision evidence shapes the response orienting trajectories in a task where freely-moving rats combine prior expectations and auditory information to select between two possible options. Response trajectories and their motor vigor are initially determined by the prior. Rats movements then incorporate sensory information as early as 60 ms after stimulus onset by accelerating or slowing depending on how much the stimulus supports their initial choice. When the stimulus evidence is in strong contradiction, rats change their mind and reverse their initial trajectory. Human subjects performing an equivalent task display a remarkably similar behavior. We encapsulate these results in a computational model that, by mapping the decision variable onto the movement kinematics at discrete time points, captures subjects' choices, trajectories and changes of mind. Our results show that motor responses are not ballistic. Instead, they are systematically and rapidly updated, as they smoothly unfold over time, by the parallel dynamics of the underlying decision process.

Behavioral Motor Performance

The human sensorimotor control system has exceptional abilities to perform skillful actions. We easily switch between strenuous tasks that involve brute force, such as lifting a heavy sewing machine, and delicate movements such as threading a needle in the same machine. Using a structure with different control architectures, the motor system is capable of updating its ability to perform through our daily interaction with the fluctuating environment. However, there are issues that make this a difficult computational problem for the brain to solve. The brain needs to control a nonlinear, nonstationary neuromuscular system, with redundant and occasionally undesired degrees of freedom, in an uncertain environment using a body in which information transmission is subject to delays and noise. To gain insight into the mechanisms of motor control, here we survey movement laws and invariances that shape our everyday motion. We then examine the major solutions to each of these problems in the three parts of the sensorimotor control system, sensing, planning, and acting. We focus on how the sensory system, the control architectures, and the structure and operation of the muscles serve as complementary mechanisms to overcome deviations and disturbances to motor behavior and give rise to skillful motor performance. We conclude with possible future research directions based on suggested links between the operation of the sensorimotor system across the movement stages. © 2024 American Physiological Society. Compr Physiol 14:5179-5224, 2024.

Explicit effort may not influence perceptuomotor decision-making

Many decisions that humans make are enacted by the action system. For example, humans use reach-to-grasp movements when making perceptuomotor decisions between and obtaining fruits of varying quality from a pile. Recent work suggests that the characteristics of each action alternative may influence the decision itself-there may be a bias away from making perceptuomotor alternatives associated with high effort when participants are unaware of the effort differences between responses. The present study examined if perceptuomotor decisions were influenced by explicit reaching effort differences. Neurotypical human participants were presented with random dot motion stimuli in which most dots moved in random directions and varying percentages of remaining dots moved coherently left- or rightward. Participants reported leftward motion judgements by performing leftward (or left hand) reaching movements and rightward motion judgements by performing rightward (or right hand) reaching movements. A resistance band was affixed to participants' wrists and to the table in different configurations. The configurations allowed for one movement/motion direction judgement to always require stretching of the band and, therefore, require relatively more effort. Across a set of experiments, the response context (i.e. selecting directions within a limb or selecting between limbs) and the effort difference between responses were manipulated. Overall, no experiment revealed a bias away from the perceptuomotor decision associated with high effort. Based on these results, it is concluded that, in this biomechanical context, explicit effort may not influence perceptuomotor decision-making and may point to a contextual influence of action effort on perceptuomotor decision-making.

Exploring the impact of stimulus-stimulus and stimulus-response conflicts on computer mouse trajectories: continuous flow of information from stimulus encoding to response preparation to motor action

In recent years, mouse tracking (designing experiments in which participants provide responses via dynamic computer mouse movements) has enjoyed increasing experience in experimental psychology. Mouse-tracking studies typically involve some form of stimulus-response (S-R) conflict, and S-R effects emerge in movement trajectories (as well as in latencies). By contrast, it is currently unclear how stimulus-stimulus (S-S) compatibility affects movements. Here, we used a spatial arrow task which allowed us to generate S-R and S-S effects within the same experiment. Experiment 1 clarified in a key press experiment that this manipulation generates clear S-S and S-R effects in latencies. More critically, Experiment 2 demonstrated that both types of conflict impact mouse trajectories with incompatibility emerging as increased 'curvature' of responses when compared to congruent responses. We argue that these results are best explained via the assumption of 'continuous flow' of information, from stimulus encoding to response preparation and finally into motor action. By contrast, the S-S effect on trajectories contradicts the notion that processing is 'thresholded' between stimulus encoding and response preparation.

Motor Decision-Making as a Common Denominator in Motor Pathology and a Possible Rehabilitation Target

Despite the substantial progress in motor rehabilitation, patient involvement and motivation remain major challenges. They are typically addressed with communicational and environmental strategies, as well as with improved goal-setting procedures. Here we suggest a new research direction and framework involving Neuroeconomics principles to investigate the role of Motor Decision-Making (MDM) parameters in motivational component and motor performance in rehabilitation. We argue that investigating NE principles could bring new approaches aimed at increasing active patient engagement in the rehabilitation process by introducing more movement choice, and adapting existing goal-setting procedures. We discuss possible MDM implementation strategies and illustrate possible research directions using examples of stroke and psychiatric disorders.

Kinematic priming of action predictions

The ability to anticipate what others will do next is crucial for navigating social, interactive environments. Here, we develop an experimental and analytical framework to measure the implicit readout of prospective intention information from movement kinematics. Using a primed action categorization task, we first demonstrate implicit access to intention information by establishing a novel form of priming, which we term kinematic priming: subtle differences in movement kinematics prime action prediction. Next, using data collected from the same participants in a forced-choice intention discrimination task 1 h later, we quantify single-trial intention readout-the amount of intention information read by individual perceivers in individual kinematic primes-and assess whether it can be used to predict the amount of kinematic priming. We demonstrate that the amount of kinematic priming, as indexed by both response times (RTs) and initial fixations to a given probe, is directly proportional to the amount of intention information read by the individual perceiver at the single-trial level. These results demonstrate that human perceivers have rapid, implicit access to intention information encoded in movement kinematics and highlight the potential of our approach to reveal the computations that permit the readout of this information with single-subject, single-trial resolution.

Integrated control of non-motor and motor efforts during perceptual decision-making and action execution: a pilot study

Humans daily life is characterized by a succession of voluntary actions. Since energy resources are limited, the ability to invest the appropriate amount of effort for selecting and executing these actions is a hallmark of adapted behavior. Recent studies indicate that decisions and actions share important principles, including the optimization of their duration when the context requires it. In the present pilot study, we test the hypothesis that the management of effort-related energy resources is shared between decision and action too. Healthy human subjects performed a perceptual decision task where they had to choose between two levels of effort to invest in making the decision (i.e. two levels of perceptual difficulty), and report it with a reaching movement. Crucially, the movement accuracy requirement gradually increased from trial to trial depending on participants' decision performance. Results indicate an overall moderate and non-significant impact of the increasing motor difficulty on the choice of the non-motor (decision) effort to invest in each trial and on decision performance. By contrast, motor performance strongly decreased depending on both the motor and decisional difficulties. Together, the results support the hypothesis of an integrated management of the effort-related energy resources between decision and action. They also suggest that in the present task, the mutualized resources are primarily allocated to the decision-making process to the detriment of movements.

Embodied choices bypass narratives under radical uncertainty

Johnson et al. suggest that we rely on narratives to make choices under radical uncertainty. We argue that in its current version Conviction Narrative Theory (CNT) does not account for embodied, direct sensorimotor influences on choices under radical uncertainty that may bypass narratives, particularly in highly time-constrained situations. We therefore suggest to extend CNT by an embodied choice perspective.

Cognitive Science Progresses Toward Interactive Frameworks

Despite its many twists and turns, the arc of cognitive science generally bends toward progress, thanks to its interdisciplinary nature. By glancing at the last few decades of experimental and computational advances, it can be argued that-far from failing to converge on a shared set of conceptual assumptions-the field is indeed making steady consensual progress toward what can broadly be referred to as interactive frameworks. This inclination is apparent in the subfields of psycholinguistics, visual perception, embodied cognition, extended cognition, neural networks, dynamical systems theory, and more. This pictorial essay briefly documents this steady progress both from a bird's eye view and from the trenches. The conclusion is one of optimism that cognitive science is getting there, albeit slowly and arduously, like any good science should.

Embodied decision biases: individually stable across different tasks?

In everyday life, action and decision-making often run in parallel. Action-based models argue that action and decision-making strongly interact and, more specifically, that action can bias decision-making. This embodied decision bias is thought to originate from changes in motor costs and/or cognitive crosstalk. Recent research confirmed embodied decision biases for different tasks including walking and manual movements. Yet, whether such biases generalize within individuals across different tasks remains to be determined. To test this, we used two different decision-making tasks that have independently been shown to reliably produce embodied decision biases. In a within-participant design, participants performed two tasks in a counterbalanced fashion: (i) a walking paradigm for which it is known that motor costs systematically influence reward decisions, and (ii) a manual movement task in which motor costs and cognitive crosstalk have been shown to impact reward decisions. In both tasks, we successfully replicated the predicted embodied decision biases. However, there was no evidence that the strength of the biases correlated between tasks. Hence, our findings do not confirm that embodied decision biases transfer between tasks. Future research is needed to examine whether this lack of transfer may be due to different causes underlying the impact of motor costs on decisions and the impact of cognitive crosstalk or task-specific differences.

A mouse-tracking study of the composite nature of the Stroop effect at the level of response execution

By forcing selection into response execution processes, the present mouse-tracking study investigated whether the ongoing process of response selection in the colour-word Stroop task is influenced by conflict and facilitation at both the level of response and stimulus. Mouse-tracking measures including partial errors provided credible evidence that both response and semantic conflict (i.e., distinct constituents of interference) contribute to the overall Stroop interference effect even after a response has been initiated. This contribution was also observed for the overall facilitation effect (that was credibly decomposed into response and semantic components in response times but not in mouse deviation measures). These results run counter to the dominant single-stage response competition models that currently fail to explain: 1) the expression of Stroop effects in measures of response execution and; 2) the composite nature of both interference and facilitation. By showing that Stroop effects-originating from multiple levels of processing-can cascade into movement parameters, the present study revealed the potential overlap between selection and execution process. It therefore calls for further theoretical efforts to account for when, where and under what conditions Stroop effects originating from different loci are controlled.

The influence of movement-related costs when searching to act and acting to search

Real-world search behavior often involves limb movements, either during search or after search. Here we investigated whether movement-related costs influence search behavior in two kinds of search tasks. In our visual search tasks, participants made saccades to find a target object among distractors and then moved a cursor, controlled by the handle of a robotic manipulandum, to the target. In our manual search tasks, participants moved the cursor to perform the search, placing it onto objects to reveal their identity as either a target or a distractor. In all tasks, there were multiple targets. Across experiments, we manipulated either the effort or time costs associated with movement such that these costs varied across the search space. We varied effort by applying different resistive forces to the handle, and we varied time costs by altering the speed of the cursor. Our analysis of cursor and eye movements during manual and visual search, respectively, showed that effort influenced manual search but did not influence visual search. In contrast, time costs influenced both visual and manual search. Our results demonstrate that, in addition to perceptual and cognitive factors, movement-related costs can also influence search behavior.NEW & NOTEWORTHY Numerous studies have investigated the perceptual and cognitive factors that influence decision making about where to look, or move, in search tasks. However, little is known about how search is influenced by movement-related costs associated with acting on an object once it has been visually located or acting during manual search. In this article, we show that movement time costs can bias visual and manual search and that movement effort costs bias manual search.

Motor demands influence conflict processing in a mouse-tracking Simon task

Previous studies have shown incorrect motor activation when making perceptual decisions under conflict, but the potential involvement of motor processes in conflict resolution is still unclear. The present study tested whether the effects of distracting information may be reduced when anticipated motor processing demands increase. Specifically, across two mouse-tracking Simon experiments, we manipulated blockwise motor demands (high vs. low) by requiring participants to move a mouse cursor to either large versus small (Experiment 1) or near versus far (Experiment 2) response boxes presented on the screen. We reasoned that participants would increase action control in blocks with high versus low motor demands and that this would reduce the distracting effect of location-based activation. The results support this hypothesis: Simon effects were reduced under high versus low motor demands and this modulation held even when controlling for time-varying fluctuations in distractor-based activation via distributional analyses (i.e., delta plots). Thus, the present findings indicate that anticipation of different motor costs can influence conflict processing. We propose that the competition between distractor-based and target-based activation is biased at premotor and/or motor stages in anticipation of motor demands, but also discuss alternative implementations of action control.

Moving beyond response times with accessible measures of manual dynamics

Button-press measures of response time (RT) and accuracy have long served a central role in psychological research. However, RT and accuracy provide limited insight into how cognitive processes unfold over time. To address this limitation, researchers have used hand-tracking techniques to investigate how cognitive processes unfold over the course of a response, are modulated by recent experience, and function across the lifespan. Despite the efficacy of these techniques for investigating a wide range of psychological phenomena, widespread adoption of hand-tracking techniques within the field is hindered by a range of factors, including equipment costs and the use of specialized software. Here, we demonstrate that the behavioral dynamics previously observed with specialized motion-tracking equipment in an Eriksen flanker task can be captured with an affordable, portable, and easy-to-assemble response box. Six-to-eight-year-olds and adults (N = 90) completed a computerized version of the flanker task by pressing and holding a central button until a stimulus array appeared. Participants then responded by releasing the central button and reaching to press one of two response buttons. This method allowed RT to be separated into initiation time (when the central button was released) and movement time (time elapsed between initiation and completion of the response). Consistent with previous research using motion-tracking techniques, initiation times and movement times revealed distinct patterns of effects across trials and between age groups, indicating that the method used in the current study presents a simple solution for researchers from across the psychological and brain sciences looking to move beyond RTs.

Theta but not beta activity is modulated by freedom of choice during action selection

Large-scale neurophysiological markers of action competition have been almost exclusively investigated in the context of instructed choices, hence it remains unclear whether these markers also apply to free choices. This study aimed to compare the specific brain dynamics underlying instructed and free decisions. Electroencephalography (EEG) was recorded while 31 participants performed a target selection task; the choice relied either on stimulus-response mappings (instructed) or on participants' preferences (free). Choice difficulty was increased by introducing distractors in the informative stimulus in instructed choices, and by presenting targets with similar motor costs in free choices. Results revealed that increased decision difficulty was associated with higher reaction times (RTs) in instructed choices and greater choice uncertainty in free choices. Midfrontal EEG theta (4-8 Hz) power increased with difficulty in instructed choices, but not in free choices. Although sensorimotor beta (15-30 Hz) power was correlated with RTs, it was not significantly influenced by choice context or difficulty. These results suggest that midfrontal theta power may specifically increase with difficulty in externally-driven choices, whereas sensorimotor beta power may be predictive of RTs in both externally- and internally-driven choices.

Action Selection and Motor Decision Making: Insights from Transcranial Magnetic Stimulation

In everyday life, goal-oriented motor behaviour relies on the estimation of the rewards/costs associated with alternative actions and on the appropriate selection of movements. Motor decision making is defined as the process by which a motor plan is chosen among a set of competing actions based on the expected value. In the present literature review we discuss evidence from transcranial magnetic stimulation (TMS) studies of motor control. We focus primarily on studies of action selection for instructed movements and motor decision making. In the first section, we delve into the usefulness of various TMS paradigms to characterise the contribution of motor areas and distributed brain networks to cued action selection. Then, we address the influence of motivational information (e.g., reward and biomechanical cost) in guiding action choices based on TMS findings. Finally, we conclude that TMS represents a powerful tool for elucidating the neurophysiological mechanisms underlying action choices in humans.

Effects of early life stress during stress hyporesponsive period (SHRP) on anxiety and curiosity in adolescent rats

Repeated exposure to adverse experiences in early life, termed Early Life Stress (ELS), can increase anxiety disorders later in life. Anxiety is directly associated with curiosity, a form of intrinsic drive state associated with increased novelty-seeking behaviour and risk taking for challenging opportunities and could probably modulate learning and memory. In humans, elevated curiosity during adolescence tends to elicit increased exploration, novelty seeking, high risk-taking behaviour and heightened emotionality. Such behaviours are beneficial in maintaining social skills and cognitive functions later in life. We investigated whether ELS-induced anxiety impacts curiosity-like behaviour at adolescence in an animal model. ELS was induced by subjecting Sprague Dawley rat pups to maternal separation and isolation (MS) stress during the stress hyporesponsive period (SHRP) from post-natal days (PND) 4-PND 14. This rat model was tested for anxiety, spontaneous exploratory behaviour and curiosity-like behaviour in a custom-designed arena during adolescence (PND 30-45). ELS-induced changes in the stress were confirmed by corticosterone, while, basal dopamine level was estimated to understand the neurochemical basis of MS stress-induced changes in curiosity. We observed an increase in the levels of anxiety and intrinsic drive state such as curiosity-like behaviour, which was associated with elevated plasma corticosterone and dopamine in MS animals during adolescence suggesting the impact of ELS during SHRP on adolescent behaviour.

The dynamics of decision-making and action during active sampling

Embodied Cognition Theories (ECTs) of decision-making propose that the decision process pervades the execution of choice actions and manifests itself in these actions. Decision-making scenarios where actions not only express the choice but also help sample information can provide a valuable, ecologically relevant model for this framework. We present a study to address this paradigmatic situation in humans. Subjects categorized (2AFC task) a central object image, blurred to different extents, by moving a cursor toward the left or right of the display. Upward cursor movements reduced the image blur and could be used to sample information. Thus, actions for decision and actions for sampling were orthogonal to each other. We analyzed response trajectories to test whether information-sampling movements co-occurred with the ongoing decision process. Trajectories were bimodally distributed, with one kind being direct towards one response option (non-sampling), and the other kind containing an initial upward component before veering off towards an option (sampling). This implies that there was an initial decision at the early stage of a trial, whether to sample information or not. Importantly, in sampling trials trajectories were not purely upward, but rather had a significant horizontal deviation early on. This result suggests that movements to sample information exhibit an online interaction with the decision process, therefore supporting the prediction of the ECTs under ecologically relevant constrains.

Sensorimotor strategy selection under time constraints in the presence of two motor targets with different values

Goal-directed movements often require choosing an option from multiple potential goals under time constraints. However, there are limited studies on how humans change their time spent on decision-making and movement patterns according to time constraints. Here, we examined how sensorimotor strategies are selected under time constraints when the target values are uncertain. In the double-target condition, the values were uncertain until the movement onset and presented immediately afterwards. The behavior in this condition was compared to the single-target condition, in relation to time constraints and target-separation-angles. The results showed that the participants frequently used the choice-reaction even under tight time constraints, and their performance was consistently lower than that in the single-target condition. Additionally, in the double-target condition, differences in the movement trajectory depending on the time constraint and target-separation angle were confirmed. Specifically, the longer the time constraint, the higher the frequency of the intermediate behavior (to initiate movement toward the intermediate direction of two targets) or the change-of-mind behavior (to change the aiming target during movement). Furthermore, the smaller the target-separation angle, the higher the frequency of intermediate behavior, but the frequency of change-of-mind was not affected by the target-separation angle. These results suggest that the participants initiated the movement at an incomplete value judgment stage in some trials. Furthermore, they seemed to select a strategy to utilize the information obtained during the movement, taking into account the time constraints and target-separation angle. Our results show a consistent cognitive bias in choosing a higher value when multiple alternatives have different values. Additionally, we also suggest flexibility and adaptability in the movement patterns in response to time constraints.

Deciding while moving: Cognitive interference biases value-based decisions

When people act, they repeatedly have to make value-based decisions about the further course of actions. For example, when driving on the highway, they must decide whether to overtake other cars by changing lanes to arrive at their destination quicker; concurrently, they are required to stay on their momentary lane by controlling the steering wheel. Embodied choice models predict that concurrent action execution modulates value-based decisions. Here, we examined whether value-based decisions are influenced by a change of action costs and/or cognitive interference between concurrent actions and decision making. In a novel, computerized multilane tracking task paradigm, participants (N = 50) controlled a cursor moving on one of three horizontal lanes. During tracking (concurrent action), participants had to switch to other lanes to avoid obstacles or collect rewards (value-based decisions). The action costs associated with a lane switch depended on the cursor position relative to the currently tracked lane, and this relationship varied between conditions. Results showed that value-based lane switching decisions were biased by the cursor state. While this influence was partly attributed to minimizing action costs, a considerable part of the influence could be attributed to cognitive interference. Our findings provide further evidence for embodied choice models, showing that both cognitive interference as well as action costs bias value-based decisions.

Attentional capture in goal-directed action during childhood, adolescence, and early adulthood

Attentional capture occurs when salient but task-irrelevant information disrupts our ability to respond to task-relevant information. Although attentional capture costs have been found to decrease between childhood and adulthood, it is currently unclear the extent to which such age-related changes reflect an improved ability to recover from attentional capture or to avoid attentional capture. In addition, recent research using hand-tracking techniques with adults indicates that attentional capture by a distractor can generate response activations corresponding to the distractor's location, consistent with action-centered models of attention. However, it is unknown whether attentional capture can also result in the capture of action in children and adolescents. Therefore, we presented 5-year-olds, 9-year-olds, 13- and 14-year-olds, and adults (N = 96) with a singleton search task in which participants responded by reaching to touch targets on a digital display. Consistent with action-centered models of attention, distractor effects were evident in each age group's movement trajectories. In contrast to movement trajectories, movement times revealed significant age-related reductions in the costs of attentional capture, suggesting that age-related improvements in attentional control may be driven in part by an enhanced ability to recover from-as opposed to avoid-attentional capture. Children's performance was also significantly affected by response repetition effects, indicating that children may be more susceptible to interference from a wider range of task-irrelevant factors than adults. In addition to presenting novel insights into the development of attention and action, these results highlight the benefits of incorporating hand-tracking techniques into developmental research.

In the hands of the beholder: Wearing a COVID-19 mask is associated with its attractiveness

Protective facial masks reduce the spread of COVID-19 infection and save lives. Yet a substantial number of people have been resistant to wearing them. Considerable effort has been invested in convincing people to put on a mask, if not for their own sake than for those more vulnerable. Social and cognitive psychologists know that use and liking go both ways: people use what they like, and they like what they use. Here we asked whether positive attitudes towards facial masks were higher in those who had been wearing them longer. We asked participants in a diverse sample (N = 498 from five countries and more than 30 US states) to rate how attractive and emotionally arousing masks and other objects associated with COVID-19 were in comparison to neutral objects, as well as reporting on their mask-wearing habits. To confirm reliability of findings, the experiment was repeated in a subset of participants 8–10 weeks later. The findings show that regular use of protective masks was linked to their positive appraisal, with a higher frequency and a longer history of wearing a mask predicting increased mask attractiveness. These results extended to other COVID-related objects relative to controls. They also provide critical ecological validity for the idea that emotional appraisal of everyday objects is associated with our experience of using them. Practically, they imply that societal measures to encourage mask wearing may have contributed to positive emotional appraisals in those who put them on, whether due to personal choice or societal pressure.

Action Costs Rapidly and Automatically Interfere with Reward-Based Decision-Making in a Reaching Task

It is widely assumed that we select actions we value the most. While the influence of rewards on decision-making has been extensively studied, evidence regarding the influence of motor costs is scarce. Specifically, how and when motor costs are integrated in the decision process is unclear. Twenty-two right-handed human participants performed a reward-based target selection task by reaching with their right arm toward one of two visual targets. Targets were positioned in different directions according to biomechanical preference, such that one target was systematically associated with a lower motor cost than the other. Only one of the two targets was rewarded, either in a congruent or incongruent manner with respect to the associated motor cost. A timed-response paradigm was used to manipulate participants' reaction times (RT). Results showed that when the rewarded target carried the highest motor cost, movements produced at short RT (<350 ms) were deviated toward the other (i.e., non-rewarded, low-cost (LC) target). In this context participants needed an additional 150-ms delay to reach the same percentage of rewarded trials as when the LC target was rewarded. Crucially, motor costs affected the total earnings of participants. These results demonstrate a robust interference of motor costs in a simple reward-based decision-making task. They point to the rapid and automatic integration of motor costs at an early stage of processing, potentially through the direct modulation of competing action representations in parieto-frontal regions. The progressive overcoming of this bias with increasing RT is likely achieved through top-down signaling pertaining to expected rewards.

Body dynamics of gait affect value-based decisions

Choosing among different options typically entails weighing their anticipated costs and benefits. Previous research has predominantly focused on situations, where the costs and benefits of choices are known before an action is effectuated. Yet many decisions in daily life are made on the fly, for instance, making a snack choice while walking through the grocery store. Notably, the costs of actions change dynamically while moving. Therefore, in this study we examined whether the concurrent action dynamics of gait form part of and affect value-based decisions. In three experiments, participants had to decide which lateral (left vs. right) target (associated with different rewards) they would go to, while they were already walking. Results showed that the target choice was biased by the alternating stepping behavior, even at the expense of receiving less reward. These findings provide evidence that whole-body action dynamics affect value-based decisions.

The Effect of Attentional Direction on Sub-Stages of Preparing for Motor Skill Execution Across Practice

While several empirical studies using dual-task methodology have examined the effect of attentional direction on motor skill execution; few have studied the effect of attentional direction on just the preparation phase of motor practice. In this study, via a keying sequence paradigm, we explored processing stages of preparation for a motor skill and disentangled the effect of attentional direction on various stages across practice. First, participants learned two keying sequences (three versus six keys). Then, they practiced the keying sequences in response to corresponding sequence labels under two block-wise alternating dual-task conditions. To dissect the preparation phase into sequence selection and sequence initiation stages, participants received varying amounts of preparation time (0, 300, 900 ms) before a starting signal instructed them to begin sequence execution. In each trial, a tone was paired with one of the three or six keypresses, and participants indicated either the keypress with which the tone was presented (skill-focused dual task) or the tone's pitch (extraneous dual task) after the sequence execution. We found that attentional direction affected only the sequence selection stage, not the sequence initiation stage. During early practice, compared to drawing attention away from execution, directing attention toward execution led to faster sequence selection. This advantage decreased with practice and vanished during late blocks of trials. Moreover, for the execution phase, relative to directing attention toward execution, drawing attention away from execution led to better performance of keying sequence execution across practice. Thus, attentional direction alone does not fully explain the difference between performance patterns at different skill levels in the dual-task literature; rather, types of motor skills and dual task difficulty levels may also drive performance differences.

The cone method: Inferring decision times from single-trial 3D movement trajectories in choice behavior

Ongoing goal-directed movements can be rapidly adjusted following new environmental information, e.g., when chasing pray or foraging. This makes movement trajectories in go-before-you-know decision-making a suitable behavioral readout of the ongoing decision process. Yet, existing methods of movement analysis are often based on statistically comparing two groups of trial-averaged trajectories and are not easily applied to three-dimensional data, preventing them from being applicable to natural free behavior. We developed and tested the cone method to estimate the point of overt commitment (POC) along a single two- or three-dimensional trajectory, i.e., the position where the movement is adjusted towards a newly selected spatial target. In Experiment 1, we established a “ground truth” data set in which the cone method successfully identified the experimentally constrained POCs across a wide range of all but the shallowest adjustment angles. In Experiment 2, we demonstrate the power of the method in a typical decision-making task with expected decision time differences known from previous findings. The POCs identified by cone method matched these expected effects. In both experiments, we compared the cone method’s single trial performance with a trial-averaging method and obtained comparable results. We discuss the advantages of the single-trajectory cone method over trial-averaging methods and possible applications beyond the examples presented in this study. The cone method provides a distinct addition to existing tools used to study decisions during ongoing movement behavior, which we consider particularly promising towards studies of non-repetitive free behavior.

A Hierarchical Attractor Network Model of perceptual versus intentional decision updates

Changes of Mind are a striking example of our ability to flexibly reverse decisions and change our own actions. Previous studies largely focused on Changes of Mind in decisions about perceptual information. Here we report reversals of decisions that require integrating multiple classes of information: 1) Perceptual evidence, 2) higher-order, voluntary intentions, and 3) motor costs. In an adapted version of the random-dot motion task, participants moved to a target that matched both the external (exogenous) evidence about dot-motion direction and a preceding internally-generated (endogenous) intention about which colour to paint the dots. Movement trajectories revealed whether and when participants changed their mind about the dot-motion direction, or additionally changed their mind about which colour to choose. Our results show that decision reversals about colour intentions are less frequent in participants with stronger intentions (Exp. 1) and when motor costs of intention pursuit are lower (Exp. 2). We further show that these findings can be explained by a hierarchical, multimodal Attractor Network Model that continuously integrates higher-order voluntary intentions with perceptual evidence and motor costs. Our model thus provides a unifying framework in which voluntary actions emerge from a dynamic combination of internal action tendencies and external environmental factors, each of which can be subject to Change of Mind.

Reaching for known unknowns: Rapid reach decisions accurately reflect the future state of dynamic probabilistic information

Everyday tasks such as catching a ball appear effortless, but in fact require complex interactions and tight temporal coordination between the brain's visual and motor systems. What makes such interceptive actions particularly impressive is the capacity of the brain to account for temporal delays in the central nervous system-a limitation that can be mitigated by making predictions about the environment as well as one's own actions. Here, we wanted to assess how well human participants can plan an upcoming movement based on a dynamic, predictable stimulus that is not the target of action. A central stationary or rotating stimulus determined the probability that each of two potential targets would be the eventual target of a rapid reach-to-touch movement. We examined the extent to which reach movement trajectories convey internal predictions about the future state of dynamic probabilistic information conveyed by the rotating stimulus. We show that movement trajectories reflect the target probabilities determined at movement onset, suggesting that humans rapidly and accurately integrate visuospatial predictions and estimates of their own reaction times to effectively guide action.

Reaching movements are attracted by stimuli that signal reward

When presented with a set of possible reach targets, the movement trajectory can reveal aspects of the underlying competition for action selection. Current goals and physical salience can affect the trajectory of reaching movements to be attracted towards a distractor. Some studies demonstrated that stimuli associated with reward can also cause an attraction when reaching towards the reward stimulus was previously rewarded and the reward stimulus was physically salient. Here we demonstrate that a non-salient stimulus that signals the availability of reward attracts reaching movements even when moving towards it was never necessary nor rewarded. Moreover, the attraction by reward is particularly evident with short-latency movements. We conclude that neither physical salience nor reinforcing the movement towards a stimulus is necessary for reward to gain priority in the selection for action.

Individual difference in serial dependence results from opposite influences of perceptual choices and motor responses

Natural image statistics exhibit temporal regularities of slow changes and short-term correlations and visual perception, too, is biased toward recently seen stimuli, i.e., a positive serial dependence. Some studies report strong individual differences in serial dependence in perceptual decision-making: some observers show positive serial effects, others repulsive effects, and some show no bias. To understand these contrasting results, this study separates the influences of physical stimuli per se, perceptual choices, and motor responses on serial dependence in perceptual decision making. In two experiments, human observers reported which orientation (45° or −45°, at threshold contrast) they perceived. Experiment 1, used a consistent mapping between stimulus and response buttons whereas in Experiment 2, observers did two tasks: one with a consistent stimulus-response mapping, the other with a random stimulus-response mapping (perceptual choice and motor response unrelated). Results show that the stimulus percept (not the physical stimulus per se) affected subsequent perceptual choices in an attractive way and that motor responses produced a repulsive serial effect. When the choice-response mapping was consistent (inseparable choice and response, typical of most experiments), individual differences in the overall serial effect was observed: some were positive, some repulsive, and some were bias-free. The multiple regression analysis revealed that observers’ overall serial effects in the consistent choice-response mapping task could be predicted by their serial effects for choices and motor responses in the random mapping task. These individual differences likely reflect relative weightings of a positive choice bias and a repulsive motor bias.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

No one knows what attention is

In this article, we challenge the usefulness of "attention" as a unitary construct and/or neural system. We point out that the concept has too many meanings to justify a single term, and that "attention" is used to refer to both the explanandum (the set of phenomena in need of explanation) and the explanans (the set of processes doing the explaining). To illustrate these points, we focus our discussion on visual selective attention. It is argued that selectivity in processing has emerged through evolution as a design feature of a complex multi-channel sensorimotor system, which generates selective phenomena of "attention" as one of many by-products. Instead of the traditional analytic approach to attention, we suggest a synthetic approach that starts with well-understood mechanisms that do not need to be dedicated to attention, and yet account for the selectivity phenomena under investigation. We conclude that what would serve scientific progress best would be to drop the term "attention" as a label for a specific functional or neural system and instead focus on behaviorally relevant selection processes and the many systems that implement them.

So, It's Pricier Than Before, but Why? Price Increase Justifications Influence Risky Decision Making and Emotional Response

In this paper, we investigated how justifications for price increases are associated with risky decision making and emotional responses. Across two studies with paired lottery choices and sequential decisions, we found that participants presented with a justification for price increases based on increasing demand decided to invest in a comparatively riskier asset more often than participants presented with a justification for price increases based on increasing tax or those presented with no justification at all. We also found that participants presented with justifications for price increases based on increasing demand also reported higher arousal and displayed higher galvanic skin response than people in the other two justification conditions. Together, these studies provide evidence that only the increasing demand condition underlying a price increase of a risky asset can influence the decision to buy and suggests that emotional activation has a crucial role in such a decision process.

Beyond reach: Do symmetric changes in motor costs affect decision making? A registered report

Executing an important decision can be as easy as moving a mouse cursor or reaching towards the preferred option with a hand. But would we decide differently if choosing required walking a few steps towards an option? More generally, is our preference invariant to the means and motor costs of reporting it? Previous research demonstrated that asymmetric motor costs can nudge the decision-maker towards a less costly option. However, virtually all traditional decision-making theories predict that increasing motor costs symmetrically for all options should not affect choice in any way. This prediction is disputed by the theory of embodied cognition, which suggests that motor behavior is an integral part of cognitive processes, and that motor costs can affect our choices. In this registered report, we investigated whether varying motor costs can affect response dynamics and the final choices in an intertemporal choice task: choosing between a readily available small reward and a larger but delayed reward. Our study compared choices reported by moving a computer mouse cursor towards the preferred option with the choices executed via a more motor costly walking procedure. First, we investigated whether relative values of the intertemporal choice options affect walking trajectories in the same way as they affect mouse cursor dynamics. Second, we tested a hypothesis that, in the walking condition, increased motor costs of a preference reversal would decrease the number of changes-of-mind and therefore increase the proportion of impulsive, smaller-but-sooner choices. We confirmed the hypothesis that walking trajectories reflect covert dynamics of decision making, and rejected the hypothesis that increased motor costs of responding affect decisions in an intertemporal choice task. Overall, this study contributes to the empirical basis enabling the decision-making theories to address the complex interplay between cognitive and motor processes.

Clarifying frequency-dependent brightness enhancement: delta- and theta-band flicker, not alpha-band flicker, consistently seen as brightest

Frequency-dependent brightness enhancement, a perceptual illusion in which a flickering light can appear twice as bright as a constant light, has historically been reported to produce maximum effects at a flicker rate within the alpha (8-12 Hz) band (Bartley in J Exp Psychol 23(3):313-319, 1938). Our recent examinations of this phenomenon using brightness discrimination between two flickering stimuli, however, have instead revealed the brightest percepts from theta-band (4-7 Hz) flicker (Bertrand et al. in Sci Rep 8(1):6152, 2018). Two primary questions arise from these seemingly contradictory findings: first, could task differences between these studies have caused recruitment of discrete oscillatory processes? Second, could the reported theta-band flicker enhancement be the result of an aliased alpha rhythm, sequentially sampling two stimulus locations, resulting in an ~ 5 Hz half-alpha rhythm? Here, we investigated these questions with two experiments: one replicating Bartley's (1938) adjustment paradigm, and one containing both Bartley's adjustment task and Bertrand's (2018) discrimination task, but presenting stimuli only sequentially (rather than concurrently). Examination of a range of frequencies (2-12 Hz) revealed the greatest brightness enhancement arising from flicker in the delta- and theta-band across all conditions, regardless of the spatial or temporal configuration of the stimuli. We speculate that these slower rhythms play an integral role in complex visual operations (e.g., a discrimination decision) where the entrainment of the endogenous neural rhythm to matched exogenous rhythmic stimulation promotes more efficient processing of visual information and thus produces perceptual biases as seen in frequency-dependent brightness enhancement.

Reaching trajectories unravel modality-dependent temporal dynamics of the automatic process in the Simon task: a model-based approach

The Simon effect represents a phenomenon in which the location of the stimuli affects the speed and accuracy of the response, despite being irrelevant for the task demands. This is believed to be due to an automatic activation of a response corresponding to the location of the stimuli, which conflicts with the controlled decision process based on relevant stimuli features. Previously, differences in the nature of the Simon effect (i.e., the pattern of change of the effect across the distribution of response times) between visual and somatosensory stimuli were reported. We hypothesize that the temporal dynamics of visual and somatosensory automatic and controlled processes vary, thus driving the reported behavioral differences. While most studies have used response times to study the underlying mechanisms involved, in this study we had participants reach out to touch the targets and recorded their arm movements using a motion capture system. Importantly, the participants started their movements before a final decision was made. In this way, we could analyze the movements to gain insights into the competition between the automatic and controlled processes. We used this technique to describe the results in terms of a model assuming automatic activation due to location-based evidence, followed by inhibition. We found that for the somatosensory Simon effect, the decay of the automatic process is significantly slower than for the visual Simon effect, suggesting quantitative differences in this automatic process between the visual and somatosensory modalities.