The structure of affective action representations: temporal binding of affective response codes

Bound to a spider without its web: Task-type modulates the retrieval of affective information in subsequent responses

Action control theories assume that upon responding to a stimulus response and stimulus features are integrated into a short episodic memory trace; repeating any component spurs on retrieval, affecting subsequent performance. The resulting so-called "binding effects" are reliably observed in discrimination tasks. In contrast, in localization performance, these effects are absent and only inhibition of return (IOR) emerges - a location change benefit. Affective information has been found to modulate binding effects; yet a modulation of IOR has led to mixed results, with many finding no influence at all. In the current study, participants discriminated letters (Experiment 1) or localized dots (Experiment 2) on a touchpad in prime-probe sequences. During the prime display two images - one with fruits and one with a spider - appeared, one of which spatially congruent with the to-be-touched area. In the discrimination task, previously touching a spider compared to a fruit slowed down response repetitions. In contrast, the localization task only showed IOR. This suggests that task-irrelevant valence is integrated with the response and affects subsequent responses due to retrieval. However, this is not ubiquitous but depends on task type. The results shed further light on the impact of affective information on actions.

A perceptual control theory of emotional action

A theory is proposed that views emotional feelings as pivotal for action control. Feelings of emotions are valued interoceptive signals from the body that become multimodally integrated with perceptual contents from registered and mentally simulated events. During the simulation of a perceptual change from one event to the next, a conative feeling signal is created that codes for the wanting of a specific perceptual change. A wanted perceptual change is weighted more strongly than alternatives, increasing its activation level on the cognitive level and that of associated motor structures that produced this perceptual change in the past. As a consequence, a tendency for action is generated that is directed at the production of the wanted perception.

Perspective Taking and Avatar-Self Merging

Today, avatars often represent users in digital worlds such as in video games or workplace applications. Avatars embody the user and perform their actions in these artificial environments. As a result, users sometimes develop the feeling that their self merges with their avatar. The user realizes that they are the avatar, but the avatar is also the user-meaning that avatar's appearance, character, and actions also affect their self. In the present paper, we first introduce the event-coding approach of the self and then argue based on the reviewed literature on human-avatar interaction that a self-controlled avatar can lead to avatar-self merging: the user sets their own goals in the virtual environment, plans and executes the avatar's actions, and compares the predicted with the actual motion outcomes of the avatar. This makes the user feel body ownership and agency over the avatar's action. Following the event-coding account, avatar-self merging should not be seen as an all-or-nothing process, but rather as a continuous process to which various factors contribute, including successfully taking the perspective of the avatar. Against this background, we discuss affective, cognitive, and visuo-spatial perspective taking of the avatar. As evidence for avatar-self merging, we present findings showing that when users take the avatar's perspective, they can show spontaneous behavioral tendencies that run counter to their own.

Animal models of action control and cognitive dysfunction in Parkinson's disease

Parkinson's disease (PD) has historically been considered a motor disorder induced by a loss of dopaminergic neurons in the substantia nigra pars compacta. More recently, it has been recognized to have significant non-motor symptoms, most prominently cognitive symptoms associated with a dysexecutive syndrome. It is common in the literature to see motor and cognitive symptoms treated separately and, indeed, there has been a general call for specialized treatment of the latter, particularly in the more severe cases of PD with mild cognitive impairment and dementia. Animal studies have similarly been developed to model the motor or non-motor symptoms. Nevertheless, considerable research has established that segregating consideration of cognition from the precursors to motor movement, particularly movement associated with goal-directed action, is difficult if not impossible. Indeed, on some contemporary views cognition is embodied in action control, something that is particularly prevalent in theory and evidence relating to the integration of goal-directed and habitual control processes. The current paper addresses these issues within the literature detailing animal models of cognitive dysfunction in PD and their neural and neurochemical bases. Generally, studies using animal models of PD provide some of the clearest evidence for the integration of these action control processes at multiple levels of analysis and imply that consideration of this integrative process may have significant benefits for developing new approaches to the treatment of PD.

Positive and negative action-effects improve task-switching performance

Anticipation of one's own actions' effects drives goal-directed behavior. In multitasking environments, the learning of stable action-effect associations seems particularly important, because establishing reliable response-effect associations for multiple competing tasks may help to differentiate between these tasks and thereby improve task-switching performance. Action-effects not only have cognitive, but also motivational aspects and often the consequences of our actions are hedonically marked. Thus, the anticipated hedonic quality of action-effects may also become part of the task representation, and positive and negative affect may distinctly modulate task-switching performance. We report a pre-registered experiment (N = 120) designed to examine how positive, negative, and neutral valence of action-effects impact performance in a cued task-switching paradigm. Pictures from the IAPS database were used to manipulate the action-effects' valence. Affective valence determined reaction times: participants who learned positive or negative action-effects responded faster than participants in the control condition. In particular, task-switch trials were faster in both conditions than in the control condition, while task-repetition trials were comparable across valence conditions. Our results further suggest that performance improvements in the positive and negative valence conditions occurred for different reasons. Negative action-effects expedited responses specifically for the task that produced the unpleasant outcome, while positive affect more generally promoted performance of both tasks. These findings point toward distinct roles of positive and negative valence of action-effects in regulating multitasking performance.

Response-response binding across effector-set switches

A single encounter of a response together with a stimulus results in short-lived binding between the stimulus and the response. A repetition of any part of such a stimulus-response episode can then retrieve the whole episode, including the response. Recent findings have shown that similar binding is also possible between two successive but independently planned manual responses, indicating that binding processes also play a role in the coordination of action sequences. Action coordination in everyday life often includes alternation between different effector sets. Yet switching effectors has been shown to result in very clear partitioning of actions. Thus, it is unclear whether responses carried out via different effector sets (feet and hands) are as easily integrated as responses via a single effector set (hands). In two experiments, we investigated whether response-response integration is possible across effector-set switches, and compared the binding effects across effector sets to those within one effector set. In a prime-probe design, participants executed two responses at the prime and the probe-the first via their hands and the second via their feet (Exp. 1), or the first via either hands or feet and the second via hands (Exp. 2). The data from both experiments indicated binding between responses, even if the actions were carried out via different effector sets. However, bindings between responses that were carried out via different effector sets were weaker than bindings between responses via a single effector set. We concluded that binding constitutes a main function of action sequences in human behavior.

Implicit process interventions in eating behaviour: a meta-analysis examining mediators and moderators

Dual-process models integrate deliberative and impulsive mental systems and predict dietary behaviours better than deliberative processes alone. Computerised tasks such as the Go/No-Go, Stop-Signal, Approach-Avoidance, and Evaluative Conditioning have been used as interventions to directly alter implicit biases. This meta-analysis examines the effects of these tasks on dietary behaviours, explores potential moderators of effectiveness, and examines implicit bias change as a proposed mechanism. Thirty randomised controlled trials testing implicit bias interventions (47 comparisons) were included in a random-effects meta-analysis, which indicated small cumulative effects on eating-related behavioural outcomes (g = -0.17, CI₉₅ = [-0.29; -0.05], p = .01) and implicit biases (g = -0.18, CI₉₅= [-0.34; -0.02], p = .02). Task type moderated these effects, with Go/No-Go tasks producing larger effects than other tasks. Effects of interventions on implicit biases were positively related to effects on eating behaviour (B = 0.42, CI₉₅= [0.02; 0.81], p = .03). Go/No-Go tasks seem to have most potential for altering dietary behaviours through implicit processes. While changes in implicit biases seem related to the effects of these interventions on dietary outcomes, more research should explore whether repeated exposure to implicit bias interventions may have any practical intervention value in real world settings.

Audiomotor integration of angry and happy prosodies

Different parts of our brain code the perceptual features and actions related to an object, causing a binding problem: how does the brain discriminate the information of a particular event from the features of other events? Hommel (1998) suggested the event file concept: an episodic memory trace binding perceptual and motor information pertaining to an object. By adapting Hommel's paradigm to emotional faces in a previous study (Coll & Grandjean, 2016), we demonstrated that emotion could take part in an event file with motor responses. We also postulate such binding to occur with emotional prosodies, due to an equal importance of automatic reactions to such events. However, contrary to static emotional expressions, prosodies develop through time and temporal dynamics may influence the integration of these stimuli. To investigate this effect, we developed three studies with task-relevant and -irrelevant emotional prosodies. Our results showed that emotion could interact with motor responses when it was task relevant. When it was task irrelevant, this integration was also observed, but only when participants were led to focus on the details of the voices, that is, in a loudness task. No such binding was observed when participants performed a location task, in which emotion could be ignored. These results indicate that emotional binding is not restricted to visual information but is a general phenomenon allowing organisms to integrate emotion and action in an efficient and adaptive way. We discuss the influence of temporal dynamics in the emotion-action binding and the implication of Hommel's paradigm.

Coding valence in touchscreen interactions: hand dominance and lateral movement influence valence appraisals of emotional pictures

The Body-Specificity Hypothesis postulates that the space surrounding the dominant hand is perceived as positive due to the motor fluency of this hand, whereas the space surrounding the non-dominant hand is perceived as negative. Experimental studies based on this theoretical framework also revealed associations between affective valence and hand dominance (i.e., dominant hand-positive; non-dominant hand-negative), or lateral movements of the hands (i.e., right hand toward the right space-positive; left hand toward the left space-positive). Interestingly, these associations have not been examined with regard to how lateral actions of the hands may influence affective experiences as, for example, in valence appraisals of affective objects that have been manipulated. The study presented here has considered this question in light of the emerging interest of embodied cognition approaches to interactive technologies, particularly in affective experiences with touchscreen interfaces. Accordingly, right-handed participants evaluated the valence of positive and negative emotional pictures after interacting with them either with the dominant right or with the non-dominant left hand. Specifically, they moved the pictures either from left to right or from right to left sides of a touchscreen monitor. The results indicated that a valence matching between the hand used for the interactions, the picture's valence category, and the movement's starting side reinforced the valence appraisals of the pictures (i.e., positive/negative pictures were more positively/negatively evaluated). The findings are discussed against the background of the Theory of Event Coding, which accounts for both the affective properties of the stimuli and the affective connotation of the related action.

Visuomotor integration of relevant and irrelevant angry and fearful facial expressions

Our brain codes the features of perceptual events in a distributed fashion, raising the question of how information belonging to one event is processed without any interference of features from other events. Hommel (1998) suggested the "event file" concept to elucidate these mechanisms: an episodic memory trace "binding" together perceptual features and actions related to an object. Using a similar paradigm, we designed a pilot experiment and four additional experiments to investigate whether emotion, similarly than perceptual features, could bind with a motor response when the emotion was relevant and irrelevant for the task. Few studies have revealed this to be the case. We investigated how angry and fearful faces expressed by avatars and humans might be subject to a binding phenomenon. Our results show that at least three degrees of visuomotor binding seem to coexist: one implicating the relevant feature of the task with a strong effect on behavior, another implicating the location with a smaller behavioral effect (even if not task related), and a third implicating non-task-related features with behavioral effects only under specific conditions in which emotion could play a role. Our adaptation of Hommel's paradigm showed that emotional percepts can be subject to visuomotor binding effects even if the emotion is not task related confirming the important role of emotional information for the central nervous system. These findings offer new perspective in the investigation of the emotion-action binding at the neuronal level.

Anticipatory affect during action preparation: evidence from backward compatibility in dual-task performance

Upcoming responses in the second of two subsequently performed tasks can speed up compatible responses in the temporally preceding first task. Two experiments extend previous demonstration of such backward compatibility to affective features: responses to affective stimuli were faster in Task 1 when an affectively compatible response effect was anticipated for Task 2. This emotional backward-compatibility effect demonstrates that representations of the affective consequences of the Task 2 response were activated before the selection of a response in Task 1 was completed. This finding is problematic for the assumption of a serial stimulus-response translation stage. It also shows that the affective consequence of a response is anticipated during, and has an impact on stimulus-response translation, which implies that action planning considers codes representing and predicting the emotional consequences of actions. Implications for the control of emotional actions are discussed.

The implicit power motive predicts action selection

Previous research has indicated that implicit motives can reliably predict which behaviors people select or decide to perform. However, so far, the question of how these motives are able to predict this action selection process has received little attention. Based on ideomotor theory, we argue that implicit motives can predict action selection when an action has become associated with a motive-congruent (dis)incentive through repeated experiences with the action-outcome relationship. This idea was investigated by examining whether the implicit need for power (nPower) would come to predict action selection (i.e., choosing to press either of two buttons) when these actions had repeatedly resulted in motive-congruent (dis)incentives (i.e., submissive or dominant faces). Both Studies 1 and 2 indicated that participants became more likely to select the action predictive of the motive-congruent outcome as their history with the action-outcome relationship increased. Study 2 indicated that this effect stemmed from both an approach towards incentives and an avoidance of disincentives. These results indicate that implicit motives (particularly the power motive) can predict action selection as a result of learning which actions yield motive-congruent (dis)incentives. Our findings therefore offer a model of how implicit motives can come to predict which behaviors people select to perform.

From hands to feet: Abstract response representations in distractor-response bindings

Evidence suggests that, when people respond to target stimuli, distractors that accompany the target become integrated with the response, and can thus subsequently serve as a retrieval cue of that response-an example of distractor-response binding. In two experiments, we investigated whether the response codes that become part of such distractor-response bindings are effector-specific or abstract. In a prime-probe design, participants gave left and right responses with their hands or their feet. The required effector set was systematically varied between prime and probe responses. If participants executed each response immediately, effects of distractor-response binding were only observed for effector repetitions but not for effector changes. However, distractor-response binding was observed in effector-change trials if participants were keeping the prime-action plan active during probe-response execution. These results indicate that it is rather abstract response codes that are integrated with distractor stimuli and retrieved upon distractor repetition.

A hierarchical instrumental decision theory of nicotine dependence

It is important to characterize the learning processes governing tobacco-seeking in order to understand how best to treat this behavior. Most drug learning theories have adopted a Pavlovian framework wherein the conditioned response is the main motivational process. We favor instead a hierarchical instrumental decision account, wherein expectations about the instrumental contingency between voluntary tobacco-seeking and the receipt of nicotine reward determines the probability of executing this behavior. To support this view, we review titration and nicotine discrimination research showing that internal signals for deprivation/satiation modulate expectations about the current incentive value of smoking, thereby modulating the propensity of this behavior. We also review research on cue-reactivity which has shown that external smoking cues modulate expectations about the probability of the tobacco-seeking response being effective, thereby modulating the propensity of this behavior. Economic decision theory is then considered to elucidate how expectations about the value and probability of response-nicotine contingency are integrated to form an overall utility estimate for that option for comparison with qualitatively different, nonsubstitute reinforcers, to determine response selection. As an applied test for this hierarchical instrumental decision framework, we consider how well it accounts for individual liability to smoking uptake and perseveration, pharmacotherapy, cue-extinction therapies, and plain packaging. We conclude that the hierarchical instrumental account is successful in reconciling this broad range of phenomenon precisely because it accepts that multiple diverse sources of internal and external information must be integrated to shape the decision to smoke.

Plain cigarette packs do not exert Pavlovian to instrumental transfer of control over tobacco-seeking

AIMS

To gain insight into the potential impact of plain tobacco packaging policy, two experiments were undertaken to test whether 'prototype' plain compared with branded UK cigarette pack stimuli would differentially elicit instrumental tobacco-seeking in a nominal Pavlovian to instrumental transfer (PIT) procedure.

DESIGN, SETTING AND PARTICIPANTS

Two experiments were undertaken at the University of Bristol UK, with a convenience sample of adult smokers (experiment 1, n = 23, experiment 2, n = 121).

MEASUREMENT

In both experiments, smokers were trained on a concurrent choice procedure in which two responses earned points for cigarettes and chocolate, respectively, before images of branded and plain packs were tested for capacity to elicit the tobacco-seeking response in extinction. The primary outcome was percentage choice of the tobacco- over the chocolate-seeking response in plain pack, branded pack and no-stimulus conditions.

FINDINGS

Both experiments found that branded packs primed a greater percentage of tobacco-seeking (overall mean = 62%) than plain packs (overall mean = 53%) and the no-stimulus condition (overall mean = 52%; Ps ≤ 0.01, ŋp (2) s ≥ 0.16), and that there was no difference in percentage tobacco-seeking between plain packs and the no-stimulus condition (Ps ≥ 0.17, ŋp (2) s ≤ 0.04). Plain tobacco packs showed an overall 9% reduction in the priming of a tobacco choice response compared to branded tobacco packs.

CONCLUSIONS

Plain packaging may reduce smoking in current smokers by degrading cue-elicited tobacco-seeking.

Affective coding: the emotional dimension of agency

The sense of agency (SoA) (i.e., the registration that I am the initiator and controller of my actions and relevant events) is associated with several affective dimensions. This makes it surprising that the emotion factor has been largely neglected in the field of agency research. Current empirical investigations of the SoA mainly focus on sensorimotor signals (i.e., efference copy) and cognitive cues (i.e., intentions, beliefs) and on how they are integrated. Here we argue that this picture is not sufficient to explain agency experience, since agency and emotions constantly interact in our daily life by several ways. Reviewing first recent empirical evidence, we show that self-action perception is in fact modulated by the affective valence of outcomes already at the sensorimotor level. We hypothesize that the "affective coding" between agency and action outcomes plays an essential role in agency processing, i.e., the prospective, immediate or retrospective shaping of agency representations by affective components. This affective coding of agency be differentially altered in various neuropsychiatric diseases (e.g., schizophrenia vs. depression), thus helping to explain the dysfunctions and content of agency experiences in these diseases.

Extinction of cue-evoked drug-seeking relies on degrading hierarchical instrumental expectancies

There has long been need for a behavioural intervention that attenuates cue-evoked drug-seeking, but the optimal method remains obscure. To address this, we report three approaches to extinguish cue-evoked drug-seeking measured in a Pavlovian to instrumental transfer design, in non-treatment seeking adult smokers and alcohol drinkers. The results showed that the ability of a drug stimulus to transfer control over a separately trained drug-seeking response was not affected by the stimulus undergoing Pavlovian extinction training in experiment 1, but was abolished by the stimulus undergoing discriminative extinction training in experiment 2, and was abolished by explicit verbal instructions stating that the stimulus did not signal a more effective response-drug contingency in experiment 3. These data suggest that cue-evoked drug-seeking is mediated by a propositional hierarchical instrumental expectancy that the drug-seeking response is more likely to be rewarded in that stimulus. Methods which degraded this hierarchical expectancy were effective in the laboratory, and so may have therapeutic potential.

Stimulus-response bindings in priming

People can rapidly form arbitrary associations between stimuli and the responses they make in the presence of those stimuli. Such stimulus-response (S-R) bindings, when retrieved, affect the way that people respond to the same, or related, stimuli. Only recently, however, has the flexibility and ubiquity of these S-R bindings been appreciated, particularly in the context of priming paradigms. This is important for the many cognitive theories that appeal to evidence from priming. It is also important for the control of action generally. An S-R binding is more than a gradually learned association between a specific stimulus and a specific response; instead, it captures the full, context-dependent behavioral potential of a stimulus.

Subthalamic nucleus: a key structure for emotional component synchronization in humans

Affective neuroscience is concerned with identifying the neural bases of emotion. For historical and methodological reasons, models describing the brain architecture that supports emotional processes in humans have tended to neglect the basal ganglia, focusing instead on cortical and amygdalar mechanisms. Now, however, deep brain stimulation (DBS) of the subthalamic nucleus (STN), a neurosurgical treatment for Parkinson's disease and obsessive-compulsive disorder, is helping researchers explore the possible functional role of this particular basal ganglion in emotional processes. After reviewing studies that have used DBS in this way, we propose a model in which the STN plays a crucial role in producing temporally organized neural co-activation patterns at the cortical and subcortical levels that are essential for generating emotions and related feelings.

Investigating ideomotor cognition with motorvisual priming paradigms: key findings, methodological challenges, and future directions

Ideomotor theory claims that perceptual representations of action-effects are functionally involved in the planning of actions. Strong evidence for this claim comes from a phenomenon called motorvisual priming. Motorvisual priming refers to the finding that action planning directly affects perception, and that the effects are selective for stimuli that share features with the planned action. Motorvisual priming studies have provided detailed insights into the processing of perceptual representations in action planning. One important finding is that such representations in action planning have a categorical format, whereas metric representations are not anticipated in planning. Further essential findings regard the processing mechanisms and the time course of ideomotor cognition. Perceptual representations of action-effects are first activated by action planning and then bound into a compound representation of the action plan. This compound representation is stabilized throughout the course of the action by the shielding of all involved representations from other cognitive processes. Despite a rapid growth in the number of motorvisual priming studies in the current literature, there are still many aspects of ideomotor cognition which have not yet been investigated. These aspects include the scope of ideomotor processing with regard to action types and stimulus types, as well as the exact nature of the binding and shielding mechanisms involved.

On the influence of reward on action-effect binding

Ideomotor theory states that the formation of anticipatory representations about the perceptual consequences of an action [i.e., action-effect (A-E) binding] provides the functional basis of voluntary action control. A host of studies have demonstrated that A-E binding occurs fast and effortlessly, yet little is known about cognitive and affective factors that influence this learning process. In the present study, we sought to test whether the motivational value of an action modulates the acquisition of A-E associations. To this end, we linked specific actions with monetary incentives during the acquisition of novel A-E mappings. In a subsequent test phase, the degree of binding was assessed by presenting the former effect stimuli as task-irrelevant response primes in a forced-choice response task, absent reward. Binding, as indexed by response priming through the former action-effects, was only found for reward-related A-E mappings. Moreover, the degree to which reward associations modulated the binding strength was predicted by individuals’ trait sensitivity to reward. These observations indicate that the association of actions and their immediate outcomes depends on the motivational value of the action during learning, as well as on the motivational disposition of the individual. On a larger scale, these findings also highlight the link between ideomotor theories and reinforcement-learning theories, providing an interesting perspective for future research on anticipatory regulation of behavior.

The planning and control model (PCM) of motorvisual priming: reconciling motorvisual impairment and facilitation effects

Previous research on dual-tasks has shown that, under some circumstances, actions impair the perception of action-consistent stimuli, whereas, under other conditions, actions facilitate the perception of action-consistent stimuli. We propose a new model to reconcile these contrasting findings. The planning and control model (PCM) of motorvisual priming proposes that action planning binds categorical representations of action features so that their availability for perceptual processing is inhibited. Thus, the perception of categorically action-consistent stimuli is impaired during action planning. Movement control processes, on the other hand, integrate multi-sensory spatial information about the movement and, therefore, facilitate perceptual processing of spatially movement-consistent stimuli. We show that the PCM is consistent with a wider range of empirical data than previous models on motorvisual priming. Furthermore, the model yields previously untested empirical predictions. We also discuss how the PCM relates to motorvisual research paradigms other than dual-tasks.

Harleß' Apparatus of Will: 150 years later

As the empirical study of action control via ideomotor effect anticipations continues to uncover more and more aspects of this fundamental process, it is time to look back to the 19th century roots of the theory to assess which classical ideas are supported by contemporary research. In turn, classic ideas might stimulate studies on aspects of the ideomotor mechanism that have not yet been addressed empirically. The present article is a tribute to this classical work—more precisely to the article “Der Apparat des Willens” [The Apparatus of Will], published by Emil Harleß 150 years ago. At a closer look, Harleß does not only present a concise description of the ideomotor mechanism; he also presents a wealth of intriguing ideas that deserve empirical investigation.