A review of contemporary ideomotor theory

The multisensory nature of human action imagery

Imagination can appeal to all our senses and may, therefore, manifest in very different qualities (e.g., visual, tactile, proprioceptive, or kinesthetic). One line of research addresses action imagery that refers to a process by which people imagine the execution of an action without actual body movements. In action imagery, visual and kinesthetic aspects of the imagined action are particularly important. However, other sensory modalities may also play a role. The purpose of the paper will be to address issues that include: (i) the creation of an action image, (ii) how the brain generates images of movements and actions, (iii) the richness and vividness of action images. We will further address possible causes that determine the sensory impression of an action image, like task specificity, instruction and experience. In the end, we will outline open questions and future directions.

Why motor imagery is not really motoric: towards a re-conceptualization in terms of effect-based action control

Overt and imagined action seem inextricably linked. Both have similar timing, activate shared brain circuits, and motor imagery influences overt action and vice versa. Motor imagery is, therefore, often assumed to recruit the same motor processes that govern action execution, and which allow one to play through or simulate actions offline. Here, we advance a very different conceptualization. Accordingly, the links between imagery and overt action do not arise because action imagery is intrinsically motoric, but because action planning is intrinsically imaginistic and occurs in terms of the perceptual effects one want to achieve. Seen like this, the term 'motor imagery' is a misnomer of what is more appropriately portrayed as 'effect imagery'. In this article, we review the long-standing arguments for effect-based accounts of action, which are often ignored in motor imagery research. We show that such views provide a straightforward account of motor imagery. We review the evidence for imagery-execution overlaps through this new lens and argue that they indeed emerge because every action we execute is planned, initiated and controlled through an imagery-like process. We highlight findings that this new view can now explain and point out open questions.

Neural Dynamic Principles for an Intentional Embodied Agent

How situated embodied agents may achieve goals using knowledge is the classical question of natural and artificial intelligence. How organisms achieve this with their nervous systems is a central challenge for a neural theory of embodied cognition. To structure this challenge, we borrow terms from Searle's analysis of intentionality in its two directions of fit and six psychological modes (perception, memory, belief, intention-in-action, prior intention, desire). We postulate that intentional states are instantiated by neural activation patterns that are stabilized by neural interaction. Dynamic instabilities provide the neural mechanism for initiating and terminating intentional states and are critical to organizing sequences of intentional states. Beliefs represented by networks of concept nodes are autonomously learned and activated in response to desired outcomes. The neural dynamic principles of an intentional agent are demonstrated in a toy scenario in which a robotic agent explores an environment and paints objects in desired colors based on learned color transformation rules.

Brain-consistent architecture for imagination

Background

Imagination represents a pivotal capability of human intelligence. To develop human-like artificial intelligence, uncovering the computational architecture pertinent to imaginative capabilities through reverse engineering the brain's computational functions is essential. The existing Structure-Constrained Interface Decomposition (SCID) method, leverages the anatomical structure of the brain to extract computational architecture. However, its efficacy is limited to narrow brain regions, making it unsuitable for realizing the function of imagination, which involves diverse brain areas such as the neocortex, basal ganglia, thalamus, and hippocampus.

Objective

In this study, we proposed the Function-Oriented SCID method, an advancement over the existing SCID method, comprising four steps designed for reverse engineering broader brain areas. This method was applied to the brain's imaginative capabilities to design a hypothetical computational architecture. The implementation began with defining the human imaginative ability that we aspire to simulate. Subsequently, six critical requirements necessary for actualizing the defined imagination were identified. Constraints were established considering the unique representational capacity and the singularity of the neocortex's modes, a distributed memory structure responsible for executing imaginative functions. In line with these constraints, we developed five distinct functions to fulfill the requirements. We allocated specific components for each function, followed by an architectural proposal aligning each component with a corresponding brain organ.

Results

In the proposed architecture, the distributed memory component, associated with the neocortex, realizes the representation and execution function; the imaginary zone maker component, associated with the claustrum, accomplishes the dynamic-zone partitioning function; the routing conductor component, linked with the complex of thalamus and basal ganglia, performs the manipulation function; the mode memory component, related to the specific agranular neocortical area executes the mode maintenance function; and the recorder component, affiliated with the hippocampal formation, handles the history management function. Thus, we have provided a fundamental cognitive architecture of the brain that comprehensively covers the brain's imaginative capacities.

Force reflections of auditory and tactile action-effect weighting in motor planning

Most voluntary actions have only few goals, which provides considerable freedom in the selection of action parameters. Recent studies showed that task-irrelevant aspects of the task context influence the motor parameters of the actions in a way which seems to reflect the relative importance of these aspects within the underlying action representation. The present study investigated how the intensity of auditory action-effects affected force exertion patterns in a self-paced action production task. Participants applied force impulses with their index finger on a force-sensitive resistor every three seconds. In four separate conditions, force impulses elicited no sound, or elicited tones with 69, 59 or 49 dB intensity. The results showed that participants applied more force when tone intensity was lower, and when tones were absent. These force differences were also present in the first 60 ms following tone onset, implying that these reflected differences in motor planning. The results are compatible with the notion that actions are represented in terms of their sensory effects, which are weighted differently-presumably to maintain an optimal level of overall auditory and tactile stimulation in the present case. These results hint at the potential usefulness of motor parameters as readouts of action intentions.

Concurrent response and action effect representations across the somatomotor cortices during novel task preparation

Instructions allow us to fulfill novel and complex tasks on the first try. This skill has been linked to preparatory brain signals that encode upcoming demands in advance, facilitating novel performance. To deepen insight into these processes, we explored whether instructions pre-activated task-relevant motoric and perceptual neural states. Critically, we addressed whether these representations anticipated activity patterns guiding overt sensorimotor processing, which could reflect that internally simulating novel tasks facilitates the preparation. To do so, we collected functional magnetic resonance imaging data while female and male participants encoded and implemented novel stimulus-response associations. Participants also completed localizer tasks designed to isolate the neural representations of the mappings-relevant motor responses, perceptual consequences, and stimulus categories. Using canonical template tracking, we identified whether and where these sensorimotor representations were pre-activated. We found that response-related templates were encoded in advance in regions linked with action control, entailing not only the instructed responses but also their somatosensory consequences. This result was particularly robust in primary motor and somatosensory cortices. While, following our predictions, we found a systematic decrease in the irrelevant stimulus templates' representational strength compared to the relevant ones, this difference was due to below-zero estimates linked to the irrelevant category activity patterns. Overall, our findings reflect that instruction processing relies on the sensorimotor cortices to anticipate motoric and kinesthetic representations of prospective action plans, suggesting the engagement of motor imagery during novel task preparation. More generally, they stress that the somatomotor system could participate with higher-level frontoparietal regions during anticipatory task control.

Computation on Demand: Action-Specific Representations of Visual Task Features Arise during Distinct Movement Phases

The intention to act influences the computations of various task-relevant features. However, little is known about the time course of these computations. Furthermore, it is commonly held that these computations are governed by conjunctive neural representations of the features. But, support for this view comes from paradigms arbitrarily combining task features and affordances, thus requiring representations in working memory. Therefore, the present study used electroencephalography and a well-rehearsed task with features that afford minimal working memory representations to investigate the temporal evolution of feature representations and their potential integration in the brain. Female and male human participants grasped objects or touched them with a knuckle. Objects had different shapes and were made of heavy or light materials with shape and weight being relevant for grasping, not for "knuckling." Using multivariate analysis showed that representations of object shape were similar for grasping and knuckling. However, only for grasping did early shape representations reactivate at later phases of grasp planning, suggesting that sensorimotor control signals feed back to the early visual cortex. Grasp-specific representations of material/weight only arose during grasp execution after object contact during the load phase. A trend for integrated representations of shape and material also became grasp-specific but only briefly during the movement onset. These results suggest that the brain generates action-specific representations of relevant features as required for the different subcomponents of its action computations. Our results argue against the view that goal-directed actions inevitably join all features of a task into a sustained and unified neural representation.

Neural oscillations guiding action during effects imagery

Goal-directed acting requires the integration of sensory information but can also be performed without direct sensory input. Examples of this can be found in sports and can be conceptualized by feedforward processes. There is, however, still a lack of understanding of the temporal neural dynamics and neuroanatomical structures involved in such processes. In the current study, we used EEG beamforming methods and examined 37 healthy participants in two well-controlled experiments varying the necessity of anticipatory processes during goal-directed action. We found that alpha and beta activity in the medial and posterior cingulate cortex enabled feedforward predictions about the position of an object based on the latest sensorimotor state. On this basis, theta band activity seems more related to sensorimotor representations, while beta band activity would be more involved in setting up the structure of the neural representations themselves. Alpha band activity in sensory cortices reflects an intensified gating of the anticipated perceptual consequences of the to-be-executed action. Together, the findings indicate that goal-directed acting through the anticipation of the predicted state of an effector is based on accompanying processes in multiple frequency bands in midcingulate and sensory brain regions.

Voluntary task switching is affected by modality compatibility and preparation

Cognitive task control can be examined in task-switching studies. Performance costs in task switches are usually smaller with compatible stimulus-response modality mappings (visual-manual and auditory-vocal) than with incompatible mappings (visual-vocal and auditory-manual). Modality compatibility describes the modality match of sensory input and of the anticipated response effect (e.g., vocal responses produce auditory effects, so that auditory stimuli are modality-compatible with vocal responses). Fintor et al. (Psychological Research, 84(2), 380-388, 2020) found that modality compatibility also biased task choice rates in voluntary task switching (VTS). In that study, in each trial participants were presented with a visual or auditory spatial stimulus and were free to choose the response modality (manual vs. vocal). In this free-choice task, participants showed a bias to create more modality-compatible than -incompatible mappings. In the present study, we assessed the generality of Fintor et al.'s (2020) findings, using verbal rather than spatial stimuli, and more complex tasks, featuring an increased number of stimulus-response alternatives. Experiment 1 replicated the task-choice bias to preferentially create modality-compatible mappings. We also found a bias to repeat the response modality just performed, and a bias to repeat entire stimulus-response modality mappings. In Experiment 2, we manipulated the response-stimulus interval (RSI) to examine whether more time for proactive cognitive control would help resolve modality-specific crosstalk in this free-choice paradigm. Long RSIs led to a decreased response-modality repetition bias and mapping repetition bias, but the modality-compatibility bias was unaffected. Together, the findings suggest that modality-specific priming of response modality influences task choice.

Cognitive simulation along with neural adaptation explain effects of suggestions: a novel theoretical framework

Hypnosis is an effective intervention with proven efficacy that is employed in clinical settings and for investigating various cognitive processes. Despite their practical success, no consensus exists regarding the mechanisms underlying well-established hypnotic phenomena. Here, we suggest a new framework called the Simulation-Adaptation Theory of Hypnosis (SATH). SATH expands the predictive coding framework by focusing on (a) redundancy elimination in generative models using intrinsically generated prediction errors, (b) adaptation due to amplified or prolonged neural activity, and (c) using internally generated predictions as a venue for learning new associations. The core of our treatise is that simulating proprioceptive, interoceptive, and exteroceptive signals, along with the top-down attenuation of the precision of sensory prediction errors due to neural adaptation, can explain objective and subjective hypnotic phenomena. Based on these postulations, we offer mechanistic explanations for critical categories of direct verbal suggestions, including (1) direct-ideomotor, (2) challenge-ideomotor, (3) perceptual, and (4) cognitive suggestions. Notably, we argue that besides explaining objective responses, SATH accounts for the subjective effects of suggestions, i.e., the change in the sense of agency and reality. Finally, we discuss individual differences in hypnotizability and how SATH accommodates them. We believe that SATH is exhaustive and parsimonious in its scope, can explain a wide range of hypnotic phenomena without contradiction, and provides a host of testable predictions for future research.

The Simon effect under reversed visual feedback

Our aim was to study the processes involved in the spatial coding of the body during actions producing multiple simultaneous effects. We specifically aimed to challenge the intentional-based account, which proposes that the effects used to code responses are those deemed relevant to the agent's goal. Accordingly, we used a Simon paradigm (widely recognized as a suitable method to investigate the spatial coding of responses) combined with a setup inducing a multimodal discrepancy between visual and tactile/proprioceptive effects (known to be crucial for body schema construction and action control). To be more precise, the setup allowed to horizontally reverse the visual effects of the hands compared to the tactile/proprioceptive effects (e.g., the right hand was seen as being on the left). In Experiment 1, the visual effects were not reversed. However, in Experiment 2, the visual effects were reversed, and the task emphasized the relevance of these effects to the participants. In Experiment 3, the visual effects were also reversed, but the task emphasized the relevance of tactile/proprioceptive effects. A Simon effect, based on the location of the tactile/proprioceptive effects, was observed in Experiments 1 and 3. However, in Experiment 2, the Simon effect was partially driven by the location of the visual effects. These findings collectively support that the agent's intention plays a prominent role in the representation of their body during action. This work also suggests a promising avenue for research in linking action and body representations.

Me or we? Action-outcome learning in synchronous joint action

Goal-directed behaviour requires mental representations that encode instrumental relationships between actions and their outcomes. The present study investigated how people acquire representations of joint actions where co-actors perform synchronized action contributions to produce joint outcomes in the environment. Adapting an experimental procedure to assess individual action-outcome learning, we tested whether co-acting individuals link jointly produced action outcomes to individual-level features of their own action contributions or to group-level features of their joint action instead. In a learning phase, pairs of participants produced musical chords by synchronizing individual key press responses. In a subsequent test phase, the previously produced chords were presented as imperative stimuli requiring forced-choice responses by both pair members. Stimulus-response mappings were systematically manipulated to be either compatible or incompatible with the individual and joint action-outcome mappings of the preceding learning phase. Only joint but not individual compatibility was found to modulate participants' performance in the test phase. Yet, opposite to predictions of associative accounts of action-outcome learning, jointly incompatible mappings between learning and test phase resulted in better performance. We discuss a possible explanation of this finding, proposing that pairs' group-level learning experience modulated how participants encoded ambiguous task instructions in the test phase. Our findings inform current debates about mechanistic explanations of action-outcome learning effects and provide novel evidence that joint action is supported by dedicated mental representations encoding own and others' actions on a group level.

What Role Does Striatal Dopamine Play in Goal-directed Action?

Evidence suggests that dopamine activity provides a US-related prediction error for Pavlovian conditioning and the reinforcement signal supporting the acquisition of habits. However, its role in goal-directed action is less clear. There are currently few studies that have assessed dopamine release as animals acquire and perform self-paced instrumental actions. Here we briefly review the literature documenting the psychological, behavioral and neural bases of goal-directed actions in rats and mice, before turning to describe recent studies investigating the role of dopamine in instrumental learning and performance. Plasticity in dorsomedial striatum, a central node in the network supporting goal-directed action, clearly requires dopamine release, the timing of which, relative to cortical and thalamic inputs, determines the degree and form of that plasticity. Beyond this, bilateral release appears to reflect reward prediction errors as animals experience the consequences of an action. Such signals feedforward to update the value of the specific action associated with that outcome during subsequent performance, with dopamine release at the time of action reflecting the updated predicted action value. More recently, evidence has also emerged for a hemispherically lateralised signal associated with the action; dopamine release is greater in the hemisphere contralateral to the spatial target of the action. This effect emerges over the course of acquisition and appears to reflect the strength of the action-outcome association. Thus, during goal-directed action, dopamine release signals the action, the outcome and their association to shape the learning and performance processes necessary to support this form of behavioral control.

Production benefits on encoding are modulated by language experience: Less experience may help

Several lines of research have shown that performing movements while learning new information aids later retention of that information, compared to learning by perception alone. For instance, articulated words are more accurately remembered than words that are silently read (the production effect). A candidate mechanism for this movement-enhanced encoding, sensorimotor prediction, assumes that acquired sensorimotor associations enable movements to prime associated percepts and hence improve encoding. Yet it is still unknown how the extent of prior sensorimotor experience influences the benefits of movement on encoding. The current study addressed this question by examining whether the production effect is modified by prior language experience. Does the production effect reduce or persist in a second language (L2) compared to a first language (L1)? Two groups of unbalanced bilinguals, German (L1) - English (L2) bilinguals (Experiment 1) and English (L1) - German (L2) bilinguals (Experiment 2), learned lists of German and English words by reading the words silently or reading the words aloud, and they subsequently performed recognition tests. Both groups showed a pronounced production effect (higher recognition accuracy for spoken compared to silently read words) in the first and second languages. Surprisingly, the production effect was greater in the second languages compared to the first languages, across both bilingual groups. We discuss interpretations based on increased phonological encoding, increased effort or attention, or both, when reading aloud in a second language.

Action control costs in task selection: Agents avoid actions with incompatible movement and effect features

When a movement triggers effects with incompatible features, conflict between action and effect features creates costs for action planning and initiation. We investigated whether such action control costs also factor into action choices in terms of the principle of least effort. Participants completed a reaction-time experiment, where they were instructed to perform left and right mouse swipes in response to directional cues presented on the screen. Participants could select between two action options on each trial: Depending on which part of the screen (upper or lower) the action was performed in, the swipe resulted in a visual stimulus moving in the same (compatible) or in the opposite (incompatible) direction as the mouse. Incompatible action-effect mappings did indeed incur action control costs. In accordance with effort avoidance, the proportion of compatible choices was significantly above chance level, suggesting that action selection and initiation costs factor into participants preferences. Interestingly, however, participants' choice tendencies were not predicted by the actual increase in action-initiation costs in the incompatible condition. This indicates that effort-related decisions are not simply based on monitoring performance in the actual task, but they are also influenced by preestablished notions of action-planning costs.

Repetition costs in sequence chunking

We examined how flexibly we plan sequences of actions when we switch between multiple action sequences. Mastering a sequential skill is assumed to involve integrating successive actions into groups known as chunks that can be efficiently planned and smoothly executed. Chunking is suggested by gains in planning efficiency for long compared to short action sequences following practice and learning associations between actions and perceptual outcomes. Less is understood about how efficiently we plan sequential chunks when we switch between multiple action sequences. Do we plan learned chunks less efficiently when we switch to a different action sequence? We examined this question by comparing the initiation and execution latencies of long versus short action sequences, performed from memory, when sequences switched or repeated across trials. Additionally, each action within the sequences generated predictable perceptual outcomes that were either spatially compatible or spatially incompatible with the action sequences. Results suggested repetition costs (instead of benefits) when performing long sequences. Repetition, as opposed to switching, prolonged initiation and increased the error rate of long compared to short sequences. We attribute these results to the flexible coordination of chunk planning and execution. Repetition may prolong advanced planning of long sequences in order to resolve conflict between multiple chunks, and switching may allow the planning of later chunks to be postponed until execution. We propose that the chunking of action sequences can both facilitate and interfere with action-switching performance.

The role of environmental contextual cues in sequence learning: evidence from a virtual maze context

Studies on sequence learning usually focus on single, isolated stimuli that are presented sequentially. For example, in the serial reaction time (RT) task, stimuli are either presented in a predictable sequence or in a random sequence, and better performance with the predictable sequence is taken as evidence for sequence-specific learning. Yet, little is known about the role of environmental context cues in sequence learning. If the target stimuli are embedded in a meaningful context, would this facilitate learning by providing helpful contextual associations or would it hinder learning by adding distracting stimuli? This question was examined in two studies. A pilot study compared sequence learning in a virtual maze with a horizontal vs. vertical maze context, in which arrow stimuli guide spatial lever movement responses that resulted in a corresponding virtual transport on the screen. The results showed only overall somewhat better performance with the vertical maze compared to the horizontal maze, but general practice effects and sequence-specific learning effects were the same for both contexts. The main study compared sequence learning with a maze context to sequence learning of arrows without a maze context. The results showed significantly better learning with maze context than without context. These data suggest that the maze context facilitated sequence learning by inducing a meaningful spatial representation ("mental map") similar to that formed in wayfinding.

Rethinking Movement Disorders

At present, clinical practice and research in movement disorders (MDs) focus on the "normalization" of altered movements. In this review, rather than concentrating on problems and burdens people with MDs undoubtedly have, we highlight their hidden potentials. Starting with current definitions of Parkinson's disease (PD), dystonia, chorea, and tics, we outline that solely conceiving these phenomena as signs of dysfunction falls short of their complex nature comprising both problems and potentials. Such potentials can be traced and understood in light of well-established cognitive neuroscience frameworks, particularly ideomotor principles, and their influential modern derivatives. Using these frameworks, the wealth of data on altered perception-action integration in the different MDs can be explained and systematized using the mechanism-oriented concept of perception-action binding. According to this concept, MDs can be understood as phenomena requiring and fostering flexible modifications of perception-action associations. Consequently, although conceived as being caught in a (trough) state of deficits, given their high flexibility, people with MDs also have high potential to switch to (adaptive) peak activity that can be conceptualized as hidden potentials. Currently, clinical practice and research in MDs are concerned with deficits and thus the "deep and wide troughs," whereas "scattered narrow peaks" reflecting hidden potentials are neglected. To better delineate and utilize the latter to alleviate the burden of affected people, and destigmatize their conditions, we suggest some measures, including computational modeling combined with neurophysiological methods and tailored treatment. © 2024 International Parkinson and Movement Disorder Society.

Somatosensory omissions reveal action-related predictive processing

The intricate relation between action and somatosensory perception has been studied extensively in the past decades. Generally, a forward model is thought to predict the somatosensory consequences of an action. These models propose that when an action is reliably coupled to a tactile stimulus, unexpected absence of the stimulus should elicit prediction error. Although such omission responses have been demonstrated in the auditory modality, it remains unknown whether this mechanism generalizes across modalities. This study therefore aimed to record action-induced somatosensory omission responses using EEG in humans. Self-paced button presses were coupled to somatosensory stimuli in 88% of trials, allowing a prediction, or in 50% of trials, not allowing a prediction. In the 88% condition, stimulus omission resulted in a neural response consisting of multiple components, as revealed by temporal principal component analysis. The oN1 response suggests similar sensory sources as stimulus-evoked activity, but an origin outside primary cortex. Subsequent oN2 and oP3 responses, as previously observed in the auditory domain, likely reflect modality-unspecific higher order processes. Together, findings straightforwardly demonstrate somatosensory predictions during action and provide evidence for a partially amodal mechanism of prediction error generation.

Motor strength as a feature of concepts and visual representations

In this article, we define motor strength as the extent to which a concept is associated with body movements and the motor system that guides body movements. We extend this notion to one of the features of visual representations of some concepts and discuss the role of the motor system in understanding concepts and visual representations that have a significant degree of motor strength. It is suggested that when a concept is understood in its literal sense, the employment of the motor system and gestures in processing that concept depends on its degree of motor strength. If a concept is understood in its metaphorical sense, the employment of the motor system and gestures is dependent on the degree of motor strength of the base of the metaphor through which that concept is understood. The degree of motor strength of a concept relies on its motor affordances and its associations with people's past experiences. Because the motor system plays an essential role in the grounding of many abstract concepts in the physical environment, the notion of motor strength can help psychologists acquire a clearer understanding of how concepts with varying degrees of motor strength are grounded in the physical environment.

Articulation posture influences pitch during singing imagery

Facial muscle activity contributes to singing and to articulation: in articulation, mouth shape can alter vowel identity; and in singing, facial movement correlates with pitch changes. Here, we examine whether mouth posture causally influences pitch during singing imagery. Based on perception-action theories and embodied cognition theories, we predict that mouth posture influences pitch judgments even when no overt utterances are produced. In two experiments (total N = 160), mouth posture was manipulated to resemble the articulation of either /i/ (as in English meet; retracted lips) or /o/ (as in French rose; protruded lips). Holding this mouth posture, participants were instructed to mentally "sing" given songs (which were all positive in valence) while listening with their inner ear and, afterwards, to assess the pitch of their mental chant. As predicted, compared to the o-posture, the i-posture led to higher pitch in mental singing. Thus, bodily states can shape experiential qualities, such as pitch, during imagery. This extends embodied music cognition and demonstrates a new link between language and music.

Effects of short-term hand immobilization on anticipatory mechanism for tool use

The short-term immobilization of a limb such as the right arm can impair sensorimotor mechanisms, which in turn reduces motor control of this arm. However, it is not known whether immobilization also impairs the anticipatory mechanism for tool use without actual enactment. In two experiments, we asked participants to judge how they would use a tool in a particular environment (e.g., "Take the pencil to write on a sheet of paper"). Prior to this tool-use judgment task, some participants had been immobilized (right arm) for 24 h. Results revealed that compared to controls, immobilized participants performed more poorly on the tool-use judgment task (accuracy and response time) as well as in a manual dexterity task. As our tool-use judgment task involved anticipating the expected perceptual effect of using a tool to achieve an environmental goal (e.g., writing on a sheet of paper), our data are discussed in line with theories of motor control (e.g., ideomotor theory) that emphasize the expected perceptual consequences of the action.

A perceptual control theory of emotional action

A theory is proposed that views emotional feelings as pivotal for action control. Feelings of emotions are valued interoceptive signals from the body that become multimodally integrated with perceptual contents from registered and mentally simulated events. During the simulation of a perceptual change from one event to the next, a conative feeling signal is created that codes for the wanting of a specific perceptual change. A wanted perceptual change is weighted more strongly than alternatives, increasing its activation level on the cognitive level and that of associated motor structures that produced this perceptual change in the past. As a consequence, a tendency for action is generated that is directed at the production of the wanted perception.

A primitive-based representation of dance: modulations by experience and perceptual validity

The generation of complex movements such as dance might be possible due to the utilization of movement building blocks, i.e., movement primitives. However, it is largely unexplored how the temporal structure of a movement sequence and the recruitment of these primitives change with experience. Therefore, we obtained a representation of primitives with the temporal movement primitive model from the motion capture data of dancers with varying experiences, both for improvised and choreographed movements (elements from contemporary/modern/jazz) with different qualitative expressions. We analyzed differences between movement conditions regarding the number of temporal segments and the number of primitives, as well as their association with dance experience. Especially for the choreography with a neutral expression, the results indicate a negative association between experience and the number of segments and a positive association between experience and the number of primitives. The variation in the recruitment of these primitives suggests an increased consistency of modular control with experience, particularly for improvised dance. A prerequisite for the meaningful interpretation of these results regarding human movement production is that the model can generate perceptually valid dance movements. This was confirmed in a subsequent experiment, although the validity was slightly impaired for improvised movements. Overall, the results of the choreographed movement sequences suggest that experience is associated with an increase in motor repertoire that might facilitate fewer and longer temporal segments.NEW & NOTEWORTHY This study demonstrates that a temporal movement primitive model, trained with movements performed by dancers with different levels of experience, is able to generate natural-looking dance movements. The results suggest that motor experience in dance is associated not only with fewer temporal segments but also with an increase in the number of underlying movement building blocks. The recruitment of these primitives, which might be used to simplify movement production, additionally seems to become more consistent with experience.

The Motivational Determinants of Human Action, Their Neural Bases and Functional Impact in Adolescents With Obsessive-Compulsive Disorder

Background

Establishing the motivational influences on human action is essential for understanding choice and decision making in health and disease. Here we used tests of value-based decision making, manipulating both predicted and experienced reward values to assess the motivational control of goal-directed action in healthy adolescents and those with obsessive-compulsive disorder (OCD).

Methods

After instrumental training on a two action-two outcome probabilistic task, adolescents (n = 21) underwent Pavlovian conditioning using distinct stimuli predicting either the instrumental outcomes, a third outcome, or nothing. We then assessed functional magnetic resonance imaging during choice tests in which we varied the predicted value, using specific and general Pavlovian-instrumental transfer, and the experienced value, using outcome devaluation. To establish functional significance, we tested a matched cohort of adolescents with OCD (n = 20).

Results

In healthy adolescents, both predicted and experienced values influenced the performance of goal-directed actions, mediated by distinct orbitofrontal-striatal circuits involving the lateral orbitofrontal cortex (OFC) and medial OFC, respectively. However, in adolescents with OCD, choice was insensitive to changes in either predicted or experienced values. These impairments were related to hypoactivity in the lateral OFC and hyperactivity in the medial OFC during specific Pavlovian-instrumental transfer and hypoactivity in the anterior prefrontal cortex, caudate nucleus, and their connectivity in the devaluation test.

Conclusions

We found that predicted and experienced values exerted a potent influence on the performance of goal-directed actions in adolescents via distinct orbitofrontal- and prefrontal-striatal circuits. Furthermore, the influence of these motivational processes was severely blunted in OCD, as was the functional segregation of circuits involving medial and lateral OFC, producing dysregulated action control.

Action-effect knowledge transfers to similar effect stimuli

The ability to anticipate the sensory consequences of our actions (i.e., action-effects) is known to be important for intentional action initiation and control. Learned action-effects can select the responses that previously have been associated with them. What has been largely unexplored is how learned action-effect associations can aid action selection for effects that have not previously associated with an action but are similar to learned effects. In two studies, we aimed to show that when presented new, unknown action-effects, participants select the responses that have previously been associated with similar action-effects. In the first study (n = 27), action-effect similarity was operationalized via stimuli belonging to the same or different categories as the previously learned action-effects. In the second study (n = 31), action-effect similarity was realized via stimuli that require comparable motor responses in real life. Participants first learned that specific responses are followed by specific visual effect stimuli. In the test phase, learned effect stimuli, new but similar effect stimuli and new but dissimilar effect stimuli were presented ahead of the response. The findings revealed that both learned effect stimuli and new similar effect stimuli affected response times, whereas new dissimilar effects did not. When a learned or a new similar effect was followed by a learned response, compared to an unlearned response, the responses were faster. We interpret these findings in terms of action-effect learning. The action-effect once bound to an action is used to select an action if a similar effect for which no action has been learned yet is presented. However, it is noteworthy that, due to our design, other explanations for the found transfer are conceivable. We address these limitations in the General Discussion.

Assessing the influence of cognitive response conflict on balance control: an event-related approach using response-aligned force-plate time series data

Process interference or sharing of attentional resources between cognitive tasks and balance control during upright standing has been well documented. Attentional costs increase with greater balancing demands of a balance activity, for example in standing compared to sitting. The traditional approach for analyzing balance control using posturography with a force plate integrates across relative long trial periods of up to several minutes, which blends any balance adjustments and cognitive operations within this period. In the present study, we pursued an event-related approach to assess if single cognitive operations resolving response selection conflict in the Simon task interfere with concurrent balance control in quiet standing. In addition to traditional outcome measures (response latency, error proportions) in the cognitive Simon task, we investigated the effect of spatial congruency on measures of sway control. We expected that conflict resolution in incongruent trials would alter short-term progression of sway control. Our results demonstrated the expected congruency effect on performance in the cognitive Simon task and the mediolateral variability of balance control within 150 ms before the onset of the manual response was reduced to a greater degree in incongruent compared to congruent trials. In addition, mediolateral variability before and after the manual response was generally reduced compared to variability following target presentation, where no effect of congruency was observed. Assuming that response conflict in incongruent conditions requires suppression of the incorrect response tendencies, our results may imply that mechanisms of cognitive conflict resolution may also carry over to intermittent balance control mechanisms in a direction-specific manner.

The (cognitive) future of motor control and learning

An ongoing debate exists regarding the compatibility of dynamic systems theory (DST) and symbol processing accounts (SPA), where SPA assume abstract representations and processing. Another aspect under discussion is if either one appropriately describes and explains motor control and the modification of motor skills. Both frameworks have their strengths and weaknesses. DST provides mechanistic explanations and takes system complexity and the environment into account without reference to mental entities. System behaviour is described mathematically and considered deterministic. In contrast, SPA propose that abstract content, that is, mental representations of the (own) body, and task requirements are critically important for movement control. It is argued that neither approach nor an (unaccomplished) unification of these frameworks can achieve a comprehensive understanding of motor control and learning. In this perspective article, it is argued that further effective sources of motor learning, such as emotional support and motivational guidance, have the potential to improve and preserve motor skills indirectly and should, thus, be recognised. Qualitative approaches focussing on understanding the athlete and the situation might be appropriate for applied work.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Preserved perception-action integration in adolescents after a COVID-19 infection

Evidence is accumulating that the Coronavirus disease (COVID-19) can bring forth deficits in executive functioning via alterations in the dopaminergic system. Importantly, dopaminergic pathways have been shown to modulate how actions and perceptions are integrated within the brain. Such alterations in event file binding could thus underlie the cognitive deficits developing after a COVID-19 infection. We examined action-perception integration in a group of young people (11-19 years of age) that had been infected with COVID-19 before study participation (n = 34) and compared them to a group of uninfected healthy controls (n = 29) on the behavioral (i.e., task accuracy, reaction time) and neurophysiological (EEG) level using an established event file binding paradigm. Groups did not differ from each other regarding demographic variables or in reporting psychiatric symptoms. Overall, multiple lines of evidence (behavioral and neurophysiological) suggest that action-perception integration is preserved in adolescents who suffered from COVID-19 prior to study participation. Event file binding processes were intact in both groups on all levels. While cognitive impairments can occur following a COVID-19 infection, the study demonstrates that action-perception integration as one of the basic building blocks of cognition seems to be largely unaffected in adolescents with a rather mild course of the disease.

Effect-less? Event-files are not terminated by distal action effects

Event-files that bind features of stimuli, responses, and action effects figure prominently in contemporary views of action control. When a previous feature repeats, a previous event-file is retrieved and can influence current performance. It is unclear, however, what terminates an event-file. A tacit assumption is that registering the distal (e.g., visual or auditory) sensory consequences of an action (i.e., the "action effect") terminates the event-file, thereby making it available for retrieval. We tested three different action-effect conditions (no distal action effect, visual action effect, or auditory action effect) in the same stimulus-response (S-R) binding task and observed no modulation of S-R binding effects. Instead, there were comparably large binding effects in all conditions. This suggests that proximal (e.g., somatosensory, proprioceptive) action effects terminate event-files independent of distal (e.g., visual, auditory) action effects or that the role event-file termination plays for S-R binding effects needs to be corrected. We conclude that current views of action control require further specification.

Perception-Action Integration Is Altered in Functional Movement Disorders

BACKGROUND

Although functional neurological movement disorders (FMD) are characterized by motor symptoms, sensory processing has also been shown to be disturbed. However, how the integration of perception and motor processes, essential for the control of goal-directed behavior, is altered in patients with FMD is less clear. A detailed investigation of these processes is crucial to foster a better understanding of the pathophysiology of FMD and can systematically be achieved in the framework of the theory of event coding (TEC).

OBJECTIVE

The aim was to investigate perception-action integration processes on a behavioral and neurophysiological level in patients with FMD.

METHODS

A total of 21 patients and 21 controls were investigated with a TEC-related task, including concomitant electroencephalogram (EEG) recording. We focused on EEG correlates established to reflect perception-action integration processes. Temporal decomposition allowed to distinguish between EEG codes reflecting sensory (S-cluster), motor (R-cluster), and integrated sensory-motor processing (C-cluster). We also applied source localization analyses.

RESULTS

Behaviorally, patients revealed stronger binding between perception and action, as evidenced by difficulties in reconfiguring previously established stimulus-response associations. Such hyperbinding was paralleled by a modulation of neuronal activity clusters, including reduced C-cluster modulations of the inferior parietal cortex and altered R-cluster modulations in the inferior frontal gyrus. Correlations of these modulations with symptom severity were also evident.

CONCLUSIONS

Our study shows that FMD is characterized by altered integration of sensory information with motor processes. Relations between clinical severity and both behavioral performance and neurophysiological abnormalities indicate that perception-action integration processes are central and a promising concept for the understanding of FMD. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Associative Learning from Verbal Action-Effect Instructions: A Replication and Investigation of Underlying Mechanisms

According to the ideomotor principle, repeated experience with an action and its perceivable consequences (effects) establish action-effect associations. Research on verbal instructions indicates that such associations are also acquired from verbal information. In the present experiment (N = 651), first, we aimed to replicate unintentional response-priming effects from verbal action-effect instructions (direct replication; Condition 1). Second, we investigated the involvement of perceptual processes in the verbally induced response-priming effect by perceptually presenting (Condition 1) versus not presenting (Condition 2) the color that was subsequently named as an effect in the instructions. Third, we tested a saliency-based explanation of the verbally induced response-priming effect by highlighting all components (action and effect) without an association between them (Condition 3). Overall, we found the predicted response-priming effect following verbal action-effect instructions (overall conditions and in the replication Condition 1). Condition 2, which did not include perceptual information in the instructions, still showed a significant response-priming effect but was descriptively weaker compared to the effect of the replication Condition 1. Condition 3, which merely highlighted the action and effect component without endorsing an association, did not show a significant effect. In sum, our study provides further solid evidence that verbal instructions lead to unintentional response-priming effects. Other conclusions must be considered preliminary: The between-condition comparisons were descriptively in the predicted direction-perceptual aspects are relevant, and a saliency-based account can be excluded-but the differences in accuracy between conditions were not statistically significant.

Tool mastering today - an interdisciplinary perspective

Tools have coined human life, living conditions, and culture. Recognizing the cognitive architecture underlying tool use would allow us to comprehend its evolution, development, and physiological basis. However, the cognitive underpinnings of tool mastering remain little understood in spite of long-time research in neuroscientific, psychological, behavioral and technological fields. Moreover, the recent transition of tool use to the digital domain poses new challenges for explaining the underlying processes. In this interdisciplinary review, we propose three building blocks of tool mastering: (A) perceptual and motor abilities integrate to tool manipulation knowledge, (B) perceptual and cognitive abilities to functional tool knowledge, and (C) motor and cognitive abilities to means-end knowledge about tool use. This framework allows for integrating and structuring research findings and theoretical assumptions regarding the functional architecture of tool mastering via behavior in humans and non-human primates, brain networks, as well as computational and robotic models. An interdisciplinary perspective also helps to identify open questions and to inspire innovative research approaches. The framework can be applied to studies on the transition from classical to modern, non-mechanical tools and from analogue to digital user-tool interactions in virtual reality, which come with increased functional opacity and sensorimotor decoupling between tool user, tool, and target. By working towards an integrative theory on the cognitive architecture of the use of tools and technological assistants, this review aims at stimulating future interdisciplinary research avenues.

Exploring the internal forward model: action-effect prediction and attention in sensorimotor processing

Action-effect predictions are believed to facilitate movement based on its association with sensory objectives and suppress the neurophysiological response to self- versus externally generated stimuli (i.e. sensory attenuation). However, research is needed to explore theorized differences in the use of action-effect prediction based on whether movement is uncued (i.e. volitional) or in response to external cues (i.e. stimulus-driven). While much of the sensory attenuation literature has examined effects involving the auditory N1, evidence is also conflicted regarding this component's sensitivity to action-effect prediction. In this study (n = 64), we explored the influence of action-effect contingency on event-related potentials associated with visually cued and uncued movement, as well as resultant stimuli. Our findings replicate recent evidence demonstrating reduced N1 amplitude for tones produced by stimulus-driven movement. Despite influencing motor preparation, action-effect contingency was not found to affect N1 amplitudes. Instead, we explore electrophysiological markers suggesting that attentional mechanisms may suppress the neurophysiological response to sound produced by stimulus-driven movement. Our findings demonstrate lateralized parieto-occipital activity that coincides with the auditory N1, corresponds to a reduction in its amplitude, and is topographically consistent with documented effects of attentional suppression. These results provide new insights into sensorimotor coordination and potential mechanisms underlying sensory attenuation.

Perception and action as viewed from the Theory of Event Coding: a multi-lab replication and effect size estimation of common experimental designs

The Theory of Event Coding (TEC) has influenced research on action and perception across the past two decades. It integrates several seminal empirical phenomena and it has continued to stimulate novel experimental approaches on the representational foundations of action control and perceptual experience. Yet, many of the most notable results surrounding TEC originate from an era of psychological research that relied on rather small sample sizes as judged by today's standards. This state hampers future research aiming to build on previous phenomena. We, therefore, provide a multi-lab re-assessment of the following six classical observations: response-effect compatibility, action-induced blindness, response-effect learning, stimulus-response binding, code occupation, and short-term response-effect binding. Our major goal is to provide precise estimates of corresponding effect sizes to facilitate future scientific endeavors. These effect sizes turned out to be considerably smaller than in the original reports, thus allowing for informed decisions on how to address each phenomenon in future work. Of note, the most relevant results of the original observations were consistently obtained in the present experiments as well.

Action representations in prevention behavior: Evidence from motor execution

Human actions sometimes aim at preventing an event from occurring. How these to-be-prevented events are represented, however, is poorly understood. Recent proposals in the literature point to a possible divide between effect-producing, operant actions, and effect-precluding, prevention actions, suggesting that the control of operant actions relies on codes of environment-related effects whereas prevention actions do not. Here we report two experiments on this issue, showing that spatial features (Experiment 1) as well as temporal features (Experiment 2) of to-be-prevented events influence actions in the same way as corresponding features of to-be-produced effects. This implies that selecting and executing prevention actions relies on anticipated environmental changes, comparable to operant actions.

Strong evidence for ideomotor theory: Unwilled manifestation of the conceptual attribute in movement control

Scientific understanding of how the mind generates bodily actions remains opaque. In the early 19th century, the ideomotor theory proposed that humans generate voluntary actions by imagining the sensory consequence of those actions, implying that the idea of an action’s consequence mediates between the intention to act and motor control. Despite its long history and theoretical importance, existing empirical evidence for the ideomotor theory is not strong enough to rule out alternative hypotheses. In this study, we devised a categorization-action task to evaluate ideomotor theory by testing whether an idea, distinguished from a stimulus, can modulate task-irrelevant movements. In Experiment 1, participants categorized a stimulus duration as long or short by pressing an assigned key. The results show that participants pressed the key longer when categorizing the stimulus as long than they did when characterizing it as short. In Experiment 2, we showed that the keypressing durations were not modulated by the decision category when the property of the decision category, the brightness of a stimulus, was not easily transferable to the action. In summary, our results suggest that while the perceived stimulus features have a marginal effect on response duration linearly, the decision category is the main factor affecting the response duration. Our results indicate that an abstract category attribute can strongly modulate action execution, constraining theoretical conjectures about the ideomotor account of how people voluntarily generate action.

On the Role of Interoception in Body and Object Perception: A Multisensory-Integration Account

Various "embodied perception" phenomena suggest that what people sense of their body shapes what they perceive of the environment and that what they perceive of the environment shapes what they perceive of their bodies. For example, an observer's own hand can be felt where a fake hand is seen, events produced by own body movements seem to occur earlier than they did, and feeling a heavy weight at an observer's back may prompt hills to look steeper. Here we argue that such and various other phenomena are instances of multisensory integration of interoceptive signals from the body and exteroceptive signals from the environment. This overarching view provides a mechanistic description of what embodiment in perception means and how it works. It suggests new research questions while questioning a special role of the body itself and various phenomenon-specific explanations in terms of ownership, agency, or action-related scaling of visual information.

Compatibility effects with touchless gestures

Human actions are suspect to various compatibility phenomena. For example, responding is faster to the side where a stimulus appears than to the opposite side, referred to as stimulus-response (S-R) compatibility. This is even true, if the response is given to a different stimulus feature, while location itself is irrelevant (Simon compatibility). In addition, responses typically produce perceivable effects on the environment. If they do so in a predictable way, responses are faster if they produce a (e.g., spatially) compatible effect on the same side than on the other side. That it, a left response is produced faster if it results predictably in a left effect than in a right effect. This effect is called response-effect (R-E) compatibility. Finally, compatibility could also exist between stimuli and the effects, which is accordingly called stimulus-effect (S-E) compatibility. Such compatibility phenomena are also relevant for applied purposes, be it in laparoscopic surgery or aviation. The present study investigates Simon and R-E compatibility for touchless gesture interactions. In line with a recent study, no effect of R-E compatibility was observed, yet irrelevant stimulus location yielded a large Simon effect. Touchless gestures thus seem to behave differently with regard to compatibility phenomena than interactions via (other) tools such as levers.

The evolutionary roots of goal-directed mechanisms: A communication account

Unleashed expressions for cooperation are mainly based on the expected perceptual effects of behaviours and not the behaviours themselves. From an evolutionary viewpoint, this goal-directed mechanism allows for a comprehensive story for the theory proposed by Heintz & Scott-Phillips. Over the past 2 million years, this situated mechanism has been reused for tool use and the language development for hominids.

Compatibility effects with destination and origin of motion

Previous studies highlighted spatial compatibility effects other than those strictly arising from stimulus-response locations. In particular, the so-called Destination Compatibility (DC) effect refers to faster responses for dynamic (i.e., moving) stimuli the end point of which is spatially compatible with the response key. Four experiments examined whether the DC effect also occurs with static visual stimuli symbolically representing either motion destination alone (Experiment 1a), or both motion origin and destination (Experiments 1b, 2a, and 2b). Overall, our results are consistent in showing a DC effect; most importantly, the present findings reveal a predominance of the effect of destination of motion over that of origin, even when both the starting and ending positions of the stimulus are symbolically represented and participants are instructed to respond according to motion origin. This finding suggests that the DC effect is independent from other stimulus-response compatibility (SRC) effects.

Towards a systematization of brain oscillatory activity in actions

Information processing in the brain is governed by oscillatory activity. Activity oscillations in specific frequency bands (theta, alpha, beta and gamma) have been associated with various cognitive functions. A drawback of this is that the plethora of findings led to considerable uncertainty as to the functional relevance of activity in different frequency bands and their interrelation. Here, we use a novel cognitive-science theoretical framework to better understand and conceptually harmonize neurophysiological research on human action control. We outline how this validated starting point can systematize and probably reframe the functional relevance of oscillatory activity relevant for action control and beyond.

Interaction between habits as action sequences and goal-directed behavior under time pressure

Human behavior consists in large parts of action sequences that are often repeated in mostly the same way. Through extensive repetition, sequential responses become automatic or habitual, but our environment often confronts us with events to which we have to react flexibly and in a goal-directed manner. To assess how implicitly learned action sequences interfere with goal-directed control, we developed a novel behavioral paradigm in which we combined action sequence learning through repetition with a goal-directed task component. So-called dual-target trials require the goal-directed selection of the response with the highest reward probability in a fast succession of trials with short response deadlines. Importantly, the response primed by the learned action sequence is sometimes different from that required by the goal-directed task. As expected, we found that participants learned the action sequence through repetition, as evidenced by reduced reaction times (RT) and error rates (ER), while still acting in a goal-directed manner in dual-target trials. Specifically, we found that the learned action sequence biased choices in the goal-directed task toward the sequential response, and this effect was more pronounced the better individuals had learned the sequence. Our novel task may help shed light on the acquisition of automatic behavioral patterns and habits through extensive repetition, allows to assess positive features of habitual behavior (e.g., increased response speed and reduced error rates), and importantly also the interaction of habitual and goal-directed behaviors under time pressure.

Unintentional response priming from verbal action-effect instructions

Action-effect learning is based on a theoretical concept that actions are associated with their perceivable consequences through bidirectional associations. Past research has mostly investigated how these bidirectional associations are formed through actual behavior and perception of the consequences. The present research expands this idea by investigating how verbally formulated action-effect instructions contribute to action-effect learning. In two online experiments (Exp. 1, N = 41, student sample; Exp. 2, N = 349, non-student sample), participants memorized a specific action-effect instruction before completing a speeded categorization task. We assessed the consequences of the instructions by presenting the instructed effect as an irrelevant stimulus in the classification task and compared response errors and response times for instruction-compatible and instruction-incompatible responses. Overall, we found evidence that verbal action-effect instructions led to associations between an action and perception (effect) that are automatically activated upon encountering the previously verbally presented effect. In addition, we discuss preliminary evidence suggesting that the order of the action-effect components plays a role; only instructions in a perception-action order showed the expected effect. The present research contributes evidence to the idea that action-effect learning is not exclusively related to actual behavior but also achievable through verbally formulated instructions, thereby providing a flexible learning mechanism that does not rely on specific actual experiences.

Replacing vertical actions by mouse movements: a web-suited paradigm for investigating vertical spatial associations

The number of web-based studies in experimental psychology has been growing tremendously throughout the last few years. However, a straightforward web-based implementation does not exist for all types of experimental paradigms. In the current paper, we focus on how vertical response movements-which play a crucial role in spatial cognition and language research-can be translated into a web-based setup. Specifically, we introduce a web-suited counterpart of the vertical Stroop task (e.g., Fox & Shor, in Bull Psychon Soc 7:187-189, 1976; Lachmair et al., in Psychon Bull Rev 18:1180-1188, 2011; Thornton et al., in J Exp Psychol Hum Percept Perform 39:964-973, 2013). We employed nouns referring to entities typically located in lower or upper vertical space (e.g., "worm" and "bird", respectively) in Experiments 1 and 2, and emotional valence words associated with a crouched or an upward bodily posture (e.g., "sadness" and "excitement", respectively) in Experiment 3. Depending on the font color, our participants used their mouse to drag the words to the lower or upper screen location. Across all experiments, we consistently observed congruency effects analogous to those obtained with the lab paradigm using actual vertical arm movements. Consequently, we conclude that our web-suited paradigm establishes a reliable approach to examining vertical spatial associations.

Similar proactive effect monitoring in free and forced choice action modes

When our actions yield predictable consequences in the environment, our eyes often already saccade towards the locations we expect these consequences to appear at. Such spontaneous anticipatory saccades occur based on bi-directional associations between action and effect formed by prior experience. That is, our eye movements are guided by expectations derived from prior learning history. Anticipatory saccades presumably reflect a proactive effect monitoring process that prepares a later comparison of expected and actual effect. Here, we examined whether anticipatory saccades emerged under forced choice conditions when only actions but not target stimuli were predictive of future effects and whether action mode (forced choice vs. free choice, i.e., stimulus-based vs. stimulus-independent choice) affected proactive effect monitoring. Participants produced predictable visual effects on the left/right side via forced choice and free choice left/right key presses. Action and visual effect were spatially compatible in one half of the experiment and spatially incompatible in the other half. Irrespective of whether effects were predicted by target stimuli in addition to participants' actions, in both action modes, we observed anticipatory saccades towards the location of future effects. Importantly, neither the frequency, nor latency or amplitude of these anticipatory saccades significantly differed between forced choice and free choice action modes. Overall, our findings suggest that proactive effect monitoring of future action consequences, as reflected in anticipatory saccades, is comparable between forced choice and free choice action modes.