Stimulus-response bindings in priming

It's not distance but similarity of distance: changing stimulus relations affect the control of action sequences

Interacting with our environment happens on different levels of complexity: While there are individual and simple actions like an isolated button press, most actions are more complex and involve sequences of simpler actions. The degree to which multiple simple actions are represented as one action sequence can be measured via so-called response-response binding effects. When two or more responses are executed consecutively, they are integrated into one representation so that repetition of one response can start retrieval of the other. Executing such an action sequence typically involves responding to multiple objects or stimuli. Here, we investigated whether the spatial relation of these stimuli affects action sequence execution. To that end, we varied the distance between stimuli in a response-response binding task. Stimulus distance might affect response-response binding effects in one of two ways: It might directly affect the representation of the response sequence, making integration and retrieval between responses more likely if the responses relate to close stimuli. Alternatively, the similarity of stimulus distribution during integration and retrieval might be decisive, leading to larger binding effects if stimulus distance is identical during integration and retrieval. We found stronger binding effects with constant than with changing stimulus distance, indicating that action integration and retrieval can easily affect performance also if responses refer to separated objects. However, this effect on performance is diminished by changing spatial distribution of stimuli at the times of integration and retrieval.

Instructed speed and accuracy affect binding

In the past few decades, binding and retrieval mechanisms have gained increased interest in research on human action control. Recent studies show that these mechanisms also play a role in the control of multiple independent actions. Here, two or more successively executed responses seem to be bound to each other so that repeating one of them can retrieve the other, affecting performance in this second response and resulting in so-called response-response binding effects. Binding effects are typically found in the response time data and, somewhat less reliably, also in the error rates. Whether binding effects show in the response times, the error rates, or both, is likely influenced by the current speed-accuracy settings of the participants, with binding effects more likely showing in error rates under a speed setting, while more likely showing in RTs under an accuracy setting. Alternatively, different speed-accuracy settings might also entail changes in executive control, affecting the size of observed binding effects. In this study, we tested these assumptions by comparing binding effects under different speed-accuracy settings that were induced via instructions focusing on speed, accuracy, or both (ambivalent). Binding effects were observed in response times independent of instructions, while in error rates, they only showed under speed or ambivalent instructions. These findings indicate that binding effects can be affected by instructions regarding speed and accuracy.

Inequivalent and uncorrelated response priming in motor imagery and execution

Introduction

Theoretical considerations on motor imagery and motor execution have long been dominated by the functional equivalence view. Previous empirical works comparing these two modes of actions, however, have largely relied on subjective judgments on the imagery process, which may be exposed to various biases. The current study aims to re-examine the commonality and distinguishable aspects of motor imagery and execution via a response repetition paradigm. This framework aims to offer an alternative approach devoid of self-reporting, opening the opportunity for less subjective evaluation of the disparities and correlations between motor imagery and motor execution.

Methods

Participants performed manual speeded-choice on prime-probe pairs in each trial under three conditions distinguished by the modes of response on the prime: mere observation (Perceptual), imagining response (Imagery), and actual responses (Execution). Responses to the following probe were all actual execution of button press. While Experiment 1 compared the basic repetition effects in the three prime conditions, Experiment 2 extended the prime duration to enhance the quality of MI and monitored electromyography (EMG) for excluding prime imagery with muscle activities to enhance specificity of the underlying mechanism.

Results

In Experiment 1, there was no significant repetition effect after mere observation. However, significant repetition effects were observed in both imagery and execution conditions, respectively, which were also significantly correlated. In Experiment 2, trials with excessive EMG activities were excluded before further statistical analysis. A consistent repetition effect pattern in both Imagery and Execution but not the Perception condition. Now the correlation between Imagery and Execution conditions were not significant.

Conclusion

Findings from the current study provide a novel application of a classical paradigm, aiming to minimize the subjectivity inherent in imagery assessments while examining the relationship between motor imagery and motor execution. By highlighting differences and the absence of correlation in repetition effects, the study challenges the functional equivalence hypothesis of imagery and execution. Motor representations of imagery and execution, when measured without subjective judgments, appear to be more distinguishable than traditionally thought. Future studies may examine the neural underpinnings of the response repetition paradigm to further elucidating the common and separable aspects of these two modes of action.

Separating binding and retrieval of event files in older adults

In the literature on human action control, it is assumed that features of stimuli (S) and responses (R) are integrated into internal representations (so-called event files) that are involved in the execution of an action. Experimentally, the impact of this integration on action control is typically analyzed via S-R binding effects. Recent theorizing in the BRAC framework (Frings et al., 2020) suggests to disentangle the processes of S-R binding proper from S-R retrieval as two independent components contributing to S-R binding effects. Since the literature on age effects on S-R binding effects is scarce and does not provide information on whether the existing findings about the two processes can be generalized to older age groups, this is the first study addressing the effects of older age separately on S-R binding proper vs. S-R retrieval. In two established variants of S-R binding tasks (cumulative n = 262), we contrasted binding (by using a saliency manipulation at the time of binding proper) versus retrieval processes (by manipulating the onset of the distractor at the time of retrieval), replicating previous results in younger (18-30 years) and also in older healthy controls (50-70 years). We therefore found no evidence for age effects on S-R binding proper or S-R retrieval. We thus conclude that the processes contributing to S-R binding effects are - at least in the age groups analyzed in this study - robust and age-independent. STATEMENT OF SIGNIFICANCE: In human action control, binding proper and retrieval of features in stimulus-response episodes typically lead to so-called S-R binding effects. Against the background of recent theorizing, binding proper and retrieval should be studied independently. In this article, we ran a younger and an older age group and analyzed possible age-related differences in integration or retrieval. Both groups showed the expected pattern for binding and retrieval as expected from the literature.

Repetition costs in task switching are not equal to cue switching costs: evidence from a cue-independent context

Recent task-switching studies highlighted the presence of feature binding processes. These studies documented that even a task-irrelevant feature (the context, henceforth) may be bound with the task and the response in each trial. When the context repeated in the following trial, it supposedly retrieved the bound features, causing benefits when the task and the response repeated and costs otherwise (i.e. full repetition benefits). In the present study, we aim to rule out an alternative explanation for such full repetition benefits in task switching. These benefits were observed in studies that used a cue-related context so that full repetition conditions always implied a cue repetition. Therefore, these full repetition benefits may be ascribed to the priming of cue encoding, instead of the binding of the context. In the present study, we implemented a similar context manipulation but used univalent target stimuli and did not present any cue. Hence, the varying context was never cue-related. We still found full repetition benefits but only when the context appeared before the target and not when they appeared simultaneously. Thus, full repetition benefits can be observed in the absence of priming of cue encoding. However, the context must occupy a prominent position (i.e. at the beginning of the trial). These results, therefore, reinforce the hypothesis that full repetition benefits stem from binding processes that take place on a trial-by-trial basis and involve both task-relevant (the task and the response) and task-irrelevant features (the context).

Distributional analyses reveal the polymorphic nature of the Stroop interference effect: It's about (response) time

The study addressed the still-open issue of whether semantic (in addition to response) conflict does indeed contribute to Stroop interference (which along with facilitation contributes to the overall Stroop effect also known as Congruency effect). To this end, semantic conflict was examined across the entire response time (RT) distribution (as opposed to mean RTs). Three (out of four) reported experiments, along with cross-experimental analyses, revealed that semantic conflict was absent in the participants' faster responses. This result characterizes Stroop interference as a unitary phenomenon (i.e., driven uniquely by response conflict). When the same participants' responses were slower, Stroop interference became a composite phenomenon with an additional contribution of semantic conflict that was statistically independent of both response conflict and facilitation. While the present findings allow us to account for the fact that semantic conflict has not been consistently found in past studies, further empirical and theoretical efforts are still needed to explain why exactly it is restricted to longer responses. Indeed, since neither unitary nor composite models can account for this polymorphic nature of Stroop interference on their own, the implications for the current state of theory are outlined.

Memory for abstract control states does not decay with increasing retrieval delays

Recent studies have suggested that abstract control states (i.e., internal attentional states independent from concrete stimuli and responses) can be stored in episodic memory and retrieved subsequently. However, the duration of such a control state memory remains unclear. Previous research has found a quick and complete decay for stimulus-response bindings after 2000-5000 ms. Here, we tested a possible decay of control state bindings with retrieval delays of 2000, 3000, or 5000 ms. Five preregistered experiments used a confound-minimized prime-target task to measure the congruency sequence effect (CSE) separately for trials in which a nominally irrelevant context feature changed or repeated across trials. Analyses of the individual experiments did not result in conclusive evidence. A mega-analysis integrating the data of all experiments (Ntotal = 326) replicated evidence for binding and retrieval of control states, in that larger CSEs were found for context repetition trials. Importantly, Bayesian analysis indicated that this effect was not modulated by the length of retrieval delay. While this finding suggests that bindings of abstract control states can be relatively robust, we also discuss possible limitations of the present research.

Transfer of strategic task components across unique tasks that share some common structures

Flexible, adaptive behaviour depends on the application of prior learning to novel contexts (transfer). Transfer can take many forms, but the focus of the present study was on "task schemas"-learning strategies that guide the earliest stages of engaging in a novel task. The central aim was to examine the architecture of task schemas and determine whether strategic task components can expedite learning novel tasks that share some structural components with the training tasks. Groups of participants across two experiments were exposed to different training regimes centred around multiple unique tasks that shared some/all/none of the structural task components (the kinds of stimuli, classifications, and/or responses) but none of the surface features (the specific stimuli, classifications, and/or responses) with the test task (a dot-pattern classification task). Initial test performance was improved (to a degree) in all groups relative to a control group whose training did not include any of the structural components relevant to the test task. The strongest evidence of transfer was found in the motoric, perceptual + categorization, and full schema training groups. This observation indicates that training with some (or all) strategic task components expedited learning of a novel task that shared those components. That is, task schemas were found to be componential and were able to expedite learning a novel task where similar (learning) strategies could be applied to specific elements of the test task.

Responding, fast and slow: Visual detection and localization performance is unaffected by retrieval

According to action control theories, responding to a stimulus leads to the binding of the response and stimulus features into an event file. Repeating any component of the latter retrieves previous information, affecting ongoing performance. Based on years of attentional orienting research, recent boundaries of such binding theories have been proposed as binding effects are fully absent in visual detection (e.g., Schöpper et al., 2020, Attention, Perception, & Psychophysics, 82(4), 2085-2097) and localization (e.g., Schöpper & Frings, 2022; Visual Cognition, 30(10), 641-658) performance. While this can be attributed to specific task demands, the possibility remains that retrieval of previous event files is hampered in such tasks due to overall fast responding. In the current study we instructed participants to signal the detection (Experiment 1) and location (Experiment 2) of dots orthogonally repeating or changing their nonspatial identity and location. Crucially, the dots were either hard or easy to perceive. As expected, making targets hard to perceive drastically slowed down detection and localization response speed. Importantly, binding effects were absent irrespective of perceptibility. In contrast, discriminating the nonspatial identity of targets (Experiment 3) showed strong binding effects. These results highlight the impact of task-dependence for binding approaches in action control.

Turning the Light Switch on Binding: Prefrontal Activity for Binding and Retrieval in Action Control

According to action control theories, responding to a stimulus leads to the binding of response and stimulus features into a common representation, that is, an event file. Repeating any component of an event file retrieves all previously bound information, leading to performance costs for partial repetitions measured in so-called binding effects. Although otherwise robust and stable, binding effects are typically completely absent in "localization tasks," in which participants localize targets with spatially compatible responses. Yet, it is possible to observe binding effects in such when location features have to be translated into response features. We hypothesized that this modulation of binding effects is reflected in task involvement of the dorsolateral pFC (DLPFC). Participants localized targets with either direct (i.e., spatially compatible key) or translated (i.e., diagonally opposite to the spatially compatible key) responses. We measured DLPFC activity with functional near-infrared spectroscopy. On the behavioral level, we observed binding effects in the translated response condition, but not in the direct response condition. Importantly, prefrontal activity was also higher in the translated mapping condition. In addition, we found some evidence for the strength of the difference in binding effects in behavioral data being correlated with the corresponding effects in prefrontal activity. This suggests that activity in the DLPFC reflects the amount of executive control needed for translating location features into responses. More generally, binding effects seem to emerge only when the task at hand involves DLPFC recruitment.

Facial first impressions are not mandatory: A priming investigation

A common assertion is that, based around prominent character traits, first impressions are spontaneously extracted from faces. Specifically, mere exposure to a person is sufficient to trigger the involuntary extraction of core personality characteristics (e.g., trustworthiness, dominance, competence), an outcome that supports a range of significant judgments (e.g., hiring, investing, electing). But is this in fact the case? Noting ambiguities in the extant literature, here we used a repetition priming procedure to probe the extent to which impressions of dominance are extracted from faces absent the instruction to evaluate the stimuli in this way. Across five experiments in which either the character trait of interest was made increasingly obvious to participants (Expts. 1-3) or attention was explicitly directed toward the faces to generate low-level/high-level judgments (Expts. 4 & 5), no evidence for the spontaneous extraction of first impressions was observed. Instead, priming only emerged when judgments of dominance were an explicit requirement of the task at hand. Thus, at least using a priming methodology, the current findings contest the notion that first impressions are a mandatory product of person perception.

Bound to a spider without its web: Task-type modulates the retrieval of affective information in subsequent responses

Action control theories assume that upon responding to a stimulus response and stimulus features are integrated into a short episodic memory trace; repeating any component spurs on retrieval, affecting subsequent performance. The resulting so-called "binding effects" are reliably observed in discrimination tasks. In contrast, in localization performance, these effects are absent and only inhibition of return (IOR) emerges - a location change benefit. Affective information has been found to modulate binding effects; yet a modulation of IOR has led to mixed results, with many finding no influence at all. In the current study, participants discriminated letters (Experiment 1) or localized dots (Experiment 2) on a touchpad in prime-probe sequences. During the prime display two images - one with fruits and one with a spider - appeared, one of which spatially congruent with the to-be-touched area. In the discrimination task, previously touching a spider compared to a fruit slowed down response repetitions. In contrast, the localization task only showed IOR. This suggests that task-irrelevant valence is integrated with the response and affects subsequent responses due to retrieval. However, this is not ubiquitous but depends on task type. The results shed further light on the impact of affective information on actions.

Detection cost: A nonnegligible factor contributing to inhibition of return in the discrimination task under the cue-target paradigm

The three-factor model argues that the spatial orienting benefit triggered by the cue, the spatial selection benefit of cue-target matching, and the detection cost of distinguishing the cue from the target contribute to the measured inhibition of return (IOR) effect. According to the three-factor model, the spatial selection benefit dominates the occurrence of the IOR effect in the discrimination task, while the detection cost is negligible. The present study verified the three-factor model in the discrimination task under the cue-target paradigm by manipulating the spatial location and nonspatial feature consistency of the cue and the target as well as the promotion or hindrance of attentional disengagement from the cued location with a central reorienting cue. The results indicated that the three factors of the three-factor model contributed to the measured IOR effect in the discrimination task. Interestingly, the IOR effect was stable when the cue and target were perfectly repeated and attention was maintained at the cued location, implying that detection cost was not a negligible factor. The current study supported the contribution of all three factors in the three-factor model to the measured IOR effect; however, we argue that the role of detection cost in the discrimination task under different paradigms should be further refined.

Sleep consolidates stimulus-response learning

Performing a motor response to a sensory stimulus creates a memory trace whose behavioral correlates are classically investigated in terms of repetition priming effects. Such stimulus-response learning entails two types of associations that are partly independent: (1) an association between the stimulus and the motor response and (2) an association between the stimulus and the classification task in which it is encountered. Here, we tested whether sleep supports long-lasting stimulus-response learning on a task requiring participants (1) for establishing stimulus-classification associations to classify presented objects along two different dimensions ("size" and "mechanical") and (2) as motor response (action) to respond with either the left or right index finger. Moreover, we examined whether strengthening of stimulus-classification associations is preferentially linked to nonrapid eye movement (non-REM) sleep and strengthening of stimulus-action associations to REM sleep. We tested 48 healthy volunteers in a between-subjects design comparing postlearning retention periods of nighttime sleep versus daytime wakefulness. At postretention testing, we found that sleep supports consolidation of both stimulus-action and stimulus-classification associations, as indicated by increased reaction times in "switch conditions"; that is, when, at test, the acutely instructed classification task and/or correct motor response for a given stimulus differed from that during original learning. Polysomnographic recordings revealed that both kinds of associations were correlated with non-REM spindle activity. Our results do not support the view of differential roles for non-REM and REM sleep in the consolidation of stimulus-classification and stimulus-action associations, respectively.

Conscious awareness and memory systems in the brain

The term "memory" typically refers to conscious retrieval of events and experiences from our past, but experience can also change our behaviour without corresponding awareness of the learning process or the associated outcome. Based primarily on early neuropsychological work, theoretical perspectives have distinguished between conscious memory, said to depend critically on structures in the medial temporal lobe (MTL), and a collection of performance-based memories that do not. The most influential of these memory systems perspectives, the declarative memory theory, continues to be a mainstay of scientific work today despite mounting evidence suggesting that contributions of MTL structures go beyond the kinds or types of memory that can be explicitly reported. Consistent with these reports, more recent perspectives have focused increasingly on the processing operations supported by particular brain regions and the qualities or characteristics of resulting representations whether memory is expressed with or without awareness. These alternatives to the standard model generally converge on two key points. First, the hippocampus is critical for relational memory binding and representation even without awareness and, second, there may be little difference between some types of priming and explicit, familiarity-based recognition. Here, we examine the evolution of memory systems perspectives and critically evaluate scientific evidence that has challenged the status quo. Along the way, we highlight some of the challenges that researchers encounter in the context of this work, which can be contentious, and describe innovative methods that have been used to examine unconscious memory in the lab. This article is categorized under: Psychology > Memory Psychology > Theory and Methods Philosophy > Consciousness.

What is behind partial repetition costs? Event-files do not fully occupy bound feature codes

Feature binding accounts state that features of perceived and produced events are bound into event-files. Performance while responding to an event is impaired when some, as opposed to all or none, of this event's features already belong to a previous event-file. While these partial repetition costs are generally considered to be indicators of feature binding, their cause is still unclear. Possibly, features are fully occupied when bound in an event-file and must be unbound in a time-consuming process before they can enter a novel event-file. In this study, we tested this code occupation account. Participants responded to the font color (target) of a word (distractor) by pressing one of three keys (response) while ignoring the word meaning. We measured partial repetition costs from prime to probe while introducing an intermediate trial. We compared sequences in which this intermediate trial did not repeat any prime features and sequences in which it repeated either the prime response or distractor. Partial repetition costs occurred in the probe, even when one (vs. none) of the prime features repeated in the intermediate trial, although significantly reduced. Thus, single bindings do not fully occupy feature codes. By ruling out a possible mechanism behind partial repetition costs, the present study contributes to the further specification of feature binding accounts.

Perception-Action Integration Is Altered in Functional Movement Disorders

BACKGROUND

Although functional neurological movement disorders (FMD) are characterized by motor symptoms, sensory processing has also been shown to be disturbed. However, how the integration of perception and motor processes, essential for the control of goal-directed behavior, is altered in patients with FMD is less clear. A detailed investigation of these processes is crucial to foster a better understanding of the pathophysiology of FMD and can systematically be achieved in the framework of the theory of event coding (TEC).

OBJECTIVE

The aim was to investigate perception-action integration processes on a behavioral and neurophysiological level in patients with FMD.

METHODS

A total of 21 patients and 21 controls were investigated with a TEC-related task, including concomitant electroencephalogram (EEG) recording. We focused on EEG correlates established to reflect perception-action integration processes. Temporal decomposition allowed to distinguish between EEG codes reflecting sensory (S-cluster), motor (R-cluster), and integrated sensory-motor processing (C-cluster). We also applied source localization analyses.

RESULTS

Behaviorally, patients revealed stronger binding between perception and action, as evidenced by difficulties in reconfiguring previously established stimulus-response associations. Such hyperbinding was paralleled by a modulation of neuronal activity clusters, including reduced C-cluster modulations of the inferior parietal cortex and altered R-cluster modulations in the inferior frontal gyrus. Correlations of these modulations with symptom severity were also evident.

CONCLUSIONS

Our study shows that FMD is characterized by altered integration of sensory information with motor processes. Relations between clinical severity and both behavioral performance and neurophysiological abnormalities indicate that perception-action integration processes are central and a promising concept for the understanding of FMD. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Towards a systematization of brain oscillatory activity in actions

Information processing in the brain is governed by oscillatory activity. Activity oscillations in specific frequency bands (theta, alpha, beta and gamma) have been associated with various cognitive functions. A drawback of this is that the plethora of findings led to considerable uncertainty as to the functional relevance of activity in different frequency bands and their interrelation. Here, we use a novel cognitive-science theoretical framework to better understand and conceptually harmonize neurophysiological research on human action control. We outline how this validated starting point can systematize and probably reframe the functional relevance of oscillatory activity relevant for action control and beyond.

Neural circuits underlying language control and modality control in bilinguals: An fMRI study

Human communication not only involves the need to switch between the modalities of speaking and listening, but for bilinguals, it can also involve switching between languages. It is unknown as to whether modality and language switching share underlying control mechanisms or whether one type of switching affects control processes involved in the other. The present study uses behavioral and fMRI measures to examine neural circuits of control during communicative situations that required Chinese-English bilinguals to switch between modalities and their two languages according to associated color cues. The results showed that for both language and modality control, similar brain regions were recruited during speech production and comprehension. For modality control, the specific control processes partly depended on the corresponding modality. Finally, switching between modalities appears to exert more influence on language control in production compared to comprehension. These findings offer a first detailed characterization of the neural bases involved in control mechanisms in bilingual communication.

No effect of attentional modulation by spatial cueing in a masked numerical priming paradigm using continuous flash suppression (CFS)

One notion emerging from studies on unconscious visual processing is that different "blinding techniques" seem to suppress the conscious perception of stimuli at different levels of the neurocognitive architecture. However, even when only the results from a single suppression method are compared, the picture of the scope and limits of unconscious visual processing remains strikingly heterogeneous, as in the case of continuous flash suppression (CFS). To resolve this issue, it has been suggested that high-level semantic processing under CFS is facilitated whenever interocular suppression is attenuated by the removal of visuospatial attention. In this behavioral study, we aimed to further investigate this "CFS-attenuation-by-inattention" hypothesis in a numerical priming study using spatial cueing. Participants performed a number comparison task on a visible target number ("compare number to five"). Prime-target pairs were either congruent (both numbers smaller, or both larger than five) or incongruent. Based on the "CFS-attenuation-by-inattention" hypothesis, we predicted that reaction times (RTs) for congruent prime-target pairs should be faster than for incongruent ones, but only when the prime was presented at the uncued location. In the invisible condition, we observed no priming effects and thus no evidence in support of the "CFS-attenuation-by-inattention" hypothesis. In the visible condition, we found an inverse effect of prime-target congruency. Our results agree with the notion that the representation of CF-suppressed stimuli is fractionated, and limited to their basic, elemental features, thus precluding semantic processing.

Core Mechanisms in Action Control: Binding and Retrieval

This special collection focuses on action control and its two postulated core processes, namely feature binding and retrieval. Action control is an important topic as humans interact with their environment by means of goal-directed behavior, i.e. by means of actions. Cognitive processes were developed and shaped to enhance preparation, execution, and regulation of action. Therefore, it is the current consensus that cognition serves action. To date, research on human action control is comprised mainly of an abundance of paradigm-specific results and models. To gain a better understanding of action control, an integrative framework was proposed (the BRAC framework - for Binding and Retrieval in Action Control, Frings et al., 2020) that can explain a wide range of findings across different experimental paradigms by assuming two core processes as key functions in action control: feature binding and feature retrieval. In this special collection, 20 articles present and discuss different types of sequential paradigms in terms of this integrative account. This editorial explains the major assumptions of the BRAC framework and provides an integrative overview of the articles that are included in this special collection.

What is left after an error? Towards a comprehensive account of goal-based binding and retrieval

The cognitive system readily detects and corrects erroneous actions by establishing episodic bindings between representations of the acted upon stimuli and the intended correct response. If these stimuli are encountered again, they trigger the retrieval of the correct response. Thus, binding and retrieval efficiently pave the way for future success. The current study set out to define the role of the erroneous response itself and explicit feedback for the error during these processes of goal-based binding and retrieval. Two experiments showed robust and similar binding and retrieval effects with and without feedback and pointed towards sustained activation of the unbound, erroneous response. The third experiment confirmed that the erroneous response is more readily available than a neutral alternative. Together, the results demonstrate that episodic binding biases future actions toward success, guided primarily through internal feedback processes, while the erroneous response still leaves detectable traces in human action control.

Predictability reduces event file retrieval

There is growing consensus that stimulus-response bindings (event files) play a central role in human action control. Here, we investigated how the integration and the retrieval of event files are affected by the predictability of stimulus components of event files. We used the distractor-response binding paradigm, in which nominally task-irrelevant distractors are repeated or alternated from a prime to a probe display. The typical outcome of these kinds of tasks is that the effects of distractor repetition and response repetition interact: Performance is worse if the distractor repeats but the response does not, or vice versa. This partial-repetition effect was reduced when the distractor was highly predictable (Experiment 1). Separate manipulations of distractor predictability in the prime and probe trial revealed that this pattern was only replicated if the probe distractors were predictable (Experiment 2b, 3), but not if prime distractors were predictable (Experiment 2a). This suggests that stimulus predictability does not affect the integration of distractor information into event files, but the retrieval of these files when one or more of the integrated features are repeated. We take our findings to support theoretical claims that integration and retrieval of event files might differ concerning their sensitivity to top-down factors.

Emotional arousal does not modulate stimulus-response binding and retrieval effects

The adaptation-by-binding account and the arousal-biased competition model suggest that emotional arousal increases binding effects for transient links between stimuli and responses. Two highly-powered, pre-registered experiments tested whether transient stimulus-response bindings are stronger for high versus low arousing stimuli. Emotional words were presented in a sequential prime-probe design in which stimulus relation, response relation, and stimulus arousal were orthogonally manipulated. In Experiment 1 (N = 101), words with high and low arousal levels were presented individually in prime and probe displays. In Experiment 2 (N = 170), a high arousing affective word was presented simultaneously with a neutral word during the prime display; in the subsequent probe display, either the arousing or the neutral word repeated or a different high versus low arousal word was shown. Data from both experiments did not demonstrate a modulation of SRBR effects by stimulus arousal and SRBR effects were of equal magnitude for word stimuli of high and low arousal levels. These null results are not in line with binding accounts that hypothesise a modulatory influence of emotional arousal on perception-action binding.

Stimulus decay functions in action control

When facing particular combinations of stimuli and responses, people create temporary event-files integrating the corresponding stimulus and response features. Subsequent repetition of one or more of these features retrieves the entire event-file, which impairs performance if not all features are repeated (partial-repetition costs). In the literature, different decay functions have been reported presumably dependent on the type of feature that is repeated (e.g. target vs. distractor features). Here, we use a variant of the S1R1-S2R2 and distractor-response binding task and analyze for the first time target-based and distractor-based event-file decay functions within the same task and sample. While we found evidence for decay functions and also stronger retrieval due to target than distractor repetitions, slopes of the decay functions were comparable suggesting that the decay process itself is equal irrespective of the type of stimulus feature that is repeated. Our study thereby confirms overarching approaches that summarize paradigm specific findings with the same set of core processes.

The role of conjunctive representations in prioritizing and selecting planned actions

For flexible goal-directed behavior, prioritizing and selecting a specific action among multiple candidates are often important. Working memory has long been assumed to play a role in prioritization and planning, while bridging cross-temporal contingencies during action selection. However, studies of working memory have mostly focused on memory for single components of an action plan, such as a rule or a stimulus, rather than management of all of these elements during planning. Therefore, it is not known how post-encoding prioritization and selection operate on the entire profile of representations for prospective actions. Here, we assessed how such control processes unfold over action representations, highlighting the role of conjunctive representations that nonlinearly integrate task-relevant features during maintenance and prioritization of action plans. For each trial, participants prepared two independent rule-based actions simultaneously, then they were retro-cued to select one as their response. Prior to the start of the trial, one rule-based action was randomly assigned to be high priority by cueing that it was more likely to be tested. We found that both full action plans were maintained as conjunctive representations during action preparation, regardless of priority. However, during output selection, the conjunctive representation of the high-priority action plan was more enhanced and readily selected as an output. Furthermore, the strength of the high-priority conjunctive representation was associated with behavioral interference when the low-priority action was tested. Thus, multiple alternate upcoming actions were maintained as integrated representations and served as the target of post-encoding attentional selection mechanisms to prioritize and select an action from within working memory.

Enhancing free choice masked priming via switch trials during repeated practice

The masked priming paradigm has been extensively used to investigate the indirect impacts of unconscious stimuli on conscious behaviors, and the congruency effect of priming on free choices has gained increasing attention. Free choices allow participants to voluntarily choose a response from multiple options during each trial. While repeated practice is known to increase priming effects in subliminal visual tasks, whether practice increases the priming effect of free choices in the masked priming paradigm is unclear. And it is also not clear how the proportions of free choice and forced choice trials in one block will affect the free choice masked priming effect. The present study applied repeated practice in the masked priming paradigm and found that after training, the participants were more likely to be influenced by masked primes during free choice, but this training process did not alter the visibility of masked stimuli. In addition, this study revealed that when the proportions of free choice and forced choice trials were equal during the training stage, this enhanced effect by practice was the strongest. These results indicated that practice could enhance masked stimulus processing in free-choice, and that the learning effect may mainly be derived from the early selection and integrated processing of masked stimuli.

Saccadic landing positions reveal that eye movements are affected by distractor-based retrieval

Binding theories assume that stimulus and response features are integrated into short-lasting episodes and that upon repetition of any feature the whole episode is retrieved, thereby affecting performance. Such binding theories are nowadays the standard explanation for a wide range of action control tasks and aim to explain all simple actions, without making assumptions of effector specificity. Yet, it is unclear if eye movements are affected by integration and retrieval in the same way as manual responses. We asked participants to discriminate letters framed by irrelevant shapes. In Experiment 1, participants gave their responses with eye movements. Saccade landing positions showed a spatial error pattern consistent with predictions of binding theories. Saccadic latencies were not affected. In Experiment 2 with an increased interval between prime and probe, the error pattern diminished, again congruent with predictions of binding theories presuming quickly decaying retrieval effects. Experiment 3 used the same task as in Experiment 1, but participants executed their responses with manual key presses; again, we found a binding pattern in response accuracy. We conclude that eye movements and manual responses are affected by the same integration and retrieval processes, supporting the tacit assumption of binding theories to apply to any effector.

Element-level features in conjoint episodes in dual-tasking

The usual way of thinking about dual-tasking is that the participants represent the two tasks separately. However, several findings suggest that the participants rather seem to integrate the elements of both tasks into a conjoint episode. In three experiments, we aimed at further testing this task integration account in dual-tasking. To this end, we investigated how the processing of the previous Trial n-1 shapes the processing of the current Trial n. We observed performance benefits when the stimulus-response mappings of both tasks repeat in consecutive trials (full repetition: FR) as compared to when only one such mapping repeats (partial repetition: PR). In particular, our experiments focused on the question which elements of the two tasks in dual-tasking might be bound together. For this purpose, in Experiments 1 and 2, all participants performed a dual-task consisting of a visual-manual search task (VST) and an auditory-manual discrimination task (ADT). In the VST the stimulus-response mappings were variable, so that none of the stimuli of this task systematically predicted a certain response. In Experiment 1, the stimuli and responses of the VST were either both repeated or both changed in consecutive trials. In Experiment 2, we removed the stimulus repetitions in the VST and only the responses repeated across trials. In Experiment 3, we changed the ADT into a visual-auditory matching task (VAMT) with variable stimulus-response mappings, so that in both tasks only the responses repeated across trials. In Experiments 1 and 2, we observed better performance for FR than for PR, while this difference disappeared in Experiment 3. Together, the results suggest that the stimulus of one task is sufficient to retrieve the entire episode from the previous trial.

Partial Repetition Costs are Reduced but not Eliminated with Practice

Often, we depart from an intended course of events to react to sudden situational demands (an intervening event) before resuming the originally planned action. Executing an action to an intervening event can be delayed if the features of this action plan partly overlap with an action plan retained in working memory (WM) compared to when they completely overlap or do not overlap. This delay is referred to as a partial repetition cost (PRC). PRCs are typically attributed to code confusion between action plans in WM. We tested this by training the component action plans extensively to reduce their reliance on WM. If PRCs are caused by code confusion within WM, then PRCs should be reduced and possibly eliminated with extensive practice. To test this, participants performed a partial repetition (PR) task after 0, 4 and 8.5 sessions of stimulus-response (S-R) training. In the PR task, participants saw two visual events. They retained an action to the first event while executing a speeded action to a second (intervening) event; afterwards, they executed the retained action. The two action plans either partly overlapped or did not overlap. Results showed that extensive (S-R and PR task) practice reduced but did not eliminate PRCs. A reduction in PRCs (code confusion) with practice is compatible with memory models that assume action events become more specific and less reliant on WM with practice. These findings merit expansions of PR tasks to other domains and broader conceptions of action plans that incorporate the formal structure of memory models.

Contextual Features of the Cue Enter Episodic Bindings in Task Switching

Evidence suggests that the features of a stimulus and the actions performed on it are bound together into a coherent mental representation of the episode, which is retrieved from memory upon reencountering at least one of these features. Effects of such binding and retrieval processes emerge in action control, such as in multitasking situations like task switching. In the task-switching paradigm, response-repetition benefits are observed in task repetitions, but response-repetition costs in task switches. This interaction of task repetition (vs. switch) with response repetition (vs. switch) may be explained in terms of task-response binding. In two experiments, we included a task-irrelevant contextual feature in a cued task-switching paradigm using word identification tasks. In Experiment 1, the cue modality could vary between visual and auditory; in Experiment 2, the cue language could vary between English and Spanish, while the target stimulus was always presented visually and in German. We predicted that repeating the contextual feature in the subsequent trial would retrieve the features of the previous trial, even though cue modality or cue language did not afford any response and were not associated with either task. The results showed that response repetition-benefits in task repetitions were observable when the context (i.e., the modality or the language of the cue) repeated but disappeared when the context switched from the previous trial. These results are consistent with context-specific binding and retrieval processes in task switching.

What Belongs Together Retrieves Together – The Role of Perceptual Grouping in Stimulus-Response Binding and Retrieval

Nowadays there is consensus that stimulus and response features are partially represented in the same coding format furthering the binding of these features into event files. If some or all features comprised in an event file repeat later, the whole file can be retrieved thereby modulating ongoing performance (leading to so-called stimulus-response binding effects). Stimulus-response binding effects are usually investigated in sequential priming paradigms where it is assumed that binding occurs in the prime and retrieval in the probe. Importantly, binding and retrieval are not exclusive for targets but also apply to distractor stimuli. A previous study showed that distractor-binding effects were affected by perceptual grouping: Binding effects were significantly larger when stimuli were grouped compared to ungrouped stimuli. Recent theorizing suggests that binding and retrieval are two separate processes that can be individually modulated. Against this background, it is not possible to pinpoint the modulating influence of perceptual grouping on either process at this point in time. Therefore, we adapted the previous study design in two experiments to observe the effect of perceptual grouping on both processes in isolation. Results indicate that perceptual grouping did not impact binding but retrieval: Distractor-response retrieval was reduced when target and distractor were presented in separate objects. Our results thus support recent theorizing on the separation of binding and retrieval.

Animal models of action control and cognitive dysfunction in Parkinson's disease

Parkinson's disease (PD) has historically been considered a motor disorder induced by a loss of dopaminergic neurons in the substantia nigra pars compacta. More recently, it has been recognized to have significant non-motor symptoms, most prominently cognitive symptoms associated with a dysexecutive syndrome. It is common in the literature to see motor and cognitive symptoms treated separately and, indeed, there has been a general call for specialized treatment of the latter, particularly in the more severe cases of PD with mild cognitive impairment and dementia. Animal studies have similarly been developed to model the motor or non-motor symptoms. Nevertheless, considerable research has established that segregating consideration of cognition from the precursors to motor movement, particularly movement associated with goal-directed action, is difficult if not impossible. Indeed, on some contemporary views cognition is embodied in action control, something that is particularly prevalent in theory and evidence relating to the integration of goal-directed and habitual control processes. The current paper addresses these issues within the literature detailing animal models of cognitive dysfunction in PD and their neural and neurochemical bases. Generally, studies using animal models of PD provide some of the clearest evidence for the integration of these action control processes at multiple levels of analysis and imply that consideration of this integrative process may have significant benefits for developing new approaches to the treatment of PD.

Reluctance against the machine: Retrieval of observational stimulus-response episodes in online settings emerges when interacting with a human, but not with a computer partner

Observing how another person responds to a stimulus creates stimulus–response (SR) episodes. These can be retrieved from memory on later occasions, which means that observed responses are utilized for regulating one’s own actions. Until now, evidence for storage and retrieval of observationally acquired SR episodes was limited to dyadic face-to-face interactions between two partners who respond in an alternating fashion. In two preregistered studies (total N = 252), we demonstrate for the first time that observational SR episodes can also be acquired in online interactions: Robust retrieval effects emerged when observers believe to be interacting with another person. In turn, retrieval effects were absent when observers believe to be interacting with a computer. Our findings show that feature-based binding and retrieval principles are pervasive and also apply to social interactions, even under purely virtual conditions. We discuss implications of our findings for different explanatory accounts of social modulations of automatic imitation.

Instructing item-specific switch probability: expectations modulate stimulus-action priming

Both active response execution and passive listening to verbal codes (a form of instruction) in single prime trials lead to item-specific repetition priming effects when stimuli re-occur in single probe trials. This holds for task-specific classification (stimulus-classification, SC priming, e.g., apple-small) and action (stimulus-action, SA priming, e.g., apple-right key press). To address the influence of expectation on item-specific SC and SA associations, we tested if item-specific SC and SA priming effects were modulated by the instructed probability of re-encountering individual SC or SA mappings (25% vs. 75% instructed switch probability). Importantly, the experienced item-specific switch probability was always 50%. In Experiment 1 (N = 78), item-specific SA/SC switch  expectations affected SA, but not SC priming effects exclusively following active response execution. Experiment 2 (N = 40) was designed to emphasize SA priming by only including item-specific SC repetitions. This yielded stronger SA priming for 25% vs. 75% expected switch probability, both following response execution as in Experiment 1 and also following verbally coded SA associations. Together, these results suggest that SA priming effects, that is, the encoding and retrieval of SA associations, is modulated by item-specific switch expectation. Importantly, this expectation effect cannot be explained by item-specific associative learning mechanisms, as stimuli were primed and probed only once and participants experienced item-specific repetitions/switches equally often across stimuli independent of instructed switch probabilities. This corroborates and extends previous results by showing that SA priming effects are modulated by  expectation not only based on experienced item-specific switch probabilities, but also on mere instruction.

The influence of stress on distractor-response bindings

Stimuli and responses that occur in close temporal contiguity are bound to each other and stored in short-term episodic traces or event files. A repetition of any of the features within an event file results in the retrieval of the entire event file and can influence responding. Along with task-relevant features, event files also contain task-irrelevant features, which are also bound to responses - distractor-response binding. In the present study, the distractor-response binding effect was examined under stress. Stress was induced via a Cold Pressor Test (CPT) and was manipulated between subjects. Distractor-response binding effects were measures at pre- and post-intervention. The CPT produced reliable effects on cortisol measurements and subjective ratings, however, no difference in the distractor-response binding effects between the groups was observed. Results are discussed against the background of the inconsistent results in the literature with respect to stimulus-response binding and stress.

Implicitly learning when to be ready: From instances to categories

There is growing appreciation for the role of long-term memory in guiding temporal preparation in speeded reaction time tasks. In experiments with variable foreperiods between a warning stimulus (S1) and a target stimulus (S2), preparation is affected by foreperiod distributions experienced in the past, long after the distribution has changed. These effects from memory can shape preparation largely implicitly, outside of participants' awareness. Recent studies have demonstrated the associative nature of memory-guided preparation. When distinct S1s predict different foreperiods, they can trigger differential preparation accordingly. Here, we propose that memory-guided preparation allows for another key feature of learning: the ability to generalize across acquired associations and apply them to novel situations. Participants completed a variable foreperiod task where S1 was a unique image of either a face or a scene on each trial. Images of either category were paired with different distributions with predominantly shorter versus predominantly longer foreperiods. Participants displayed differential preparation to never-before seen images of either category, without being aware of the predictive nature of these categories. They continued doing so in a subsequent Transfer phase, after they had been informed that these contingencies no longer held. A novel rolling regression analysis revealed at a fine timescale how category-guided preparation gradually developed throughout the task, and that explicit information about these contingencies only briefly disrupted memory-guided preparation. These results offer new insights into temporal preparation as the product of a largely implicit process governed by associative learning from past experiences.

All together now: Simultaneous feature integration and feature retrieval in action control

Accounts of human action control assume integration of stimulus and response features at response execution and, upon repetition of some of those features, retrieval of other previously integrated features. Even though both processes contribute sequentially to observed binding effects in studies using a sequential prime-probe design, integration and retrieval processes theoretically affect human action simultaneously. That is, every action that we execute leads to bindings between features of stimuli and responses, while at the same time these features also trigger retrieval of other previously integrated features. Nevertheless, the paradigms used to measure binding effects in action control can only testify for integration of stimulus and response features at the first (R1, n-1, or prime) and retrieval of the past event via feature repetition at the second (R2, n, or probe) response. Here we combined two paradigms used in the action control literature to show that integration and retrieval do indeed function simultaneously. We found both significant stimulus-response and significant response-response binding effects, indicating that integration of responses must have occurred at the same time as response retrieval due to feature repetition and vice versa.

Examining the transition of novel information toward familiarity

Throughout their lives, humans encounter multiple instances of new information that can be inconsistent with prior knowledge (novel). Over time, the once-novel information becomes integrated into their established knowledge base, shifting from novelty to familiarity. In this study, we investigated the processes by which the first steps of this transition take place. We hypothesized that the neural representations of initially novel items gradually change over the course of repeated presentations, expressing a shift toward familiarity. We further assumed that this shift could be traced by examining neural patterns using fMRI. In two experiments, while being scanned, participants read noun-adjective word pairs that were either consistent or inconsistent with their prior knowledge. Stimuli were repeated 3-6 times within the scans. Employing mass univariate and multivariate similarity analyses, we showed that the neural representations associated with the initial presentation of familiar versus novel objects differed in lateral frontal and temporal regions, the medial prefrontal cortex, and the medial temporal lobe. Importantly, the neural representations of novel stimuli gradually changed throughout repetitions until they became indistinguishable from their respective familiar items. We interpret these findings as indicating that an early phase of familiarization can be completed within a few repetitions. This initial familiarization can then serve as the prerequisite to the integration of novel items into existing knowledge. Future empirical and theoretical works can build on the current findings to develop a comprehensive model of the transition from novelty to familiarity.

Remote binding counts: measuring distractor-response binding effects online

Bindings between stimulus- and response features have received increasing attention in recent research and theorizing regarding human action control. Apparently, very simple mechanisms that lead to feature binding and retrieval of recently integrated features have an important influence on planning and execution of actions. Regarding the importance of these mechanisms, it seems to be reasonable to test whether they can be measured outside of a formal laboratory situation. Here we ran an online version of the distractor-response binding task reaching participants via crowdsourcing. Distractor-response binding effects were significant in this setup showing that basic mechanisms of feature binding and retrieval indeed influence human action in less formal situations. Besides arguing for the generality and robustness of the effect practical implications are discussed.

Mind wandering at encoding, but not at retrieval, disrupts one-shot stimulus-control learning

The one-shot pairing of a stimulus with a specific cognitive control process, such as task switching, can bind the two together in memory. The episodic control-binding hypothesis posits that the formation of temporary stimulus-control bindings, which are held in event-files supported by episodic memory, can guide the contextually appropriate application of cognitive control. Across two experiments, we sought to examine the role of task-focused attention in the encoding and implementation of stimulus-control bindings in episodic event-files. In Experiment 1, we obtained self-reports of mind wandering during encoding and implementation of stimulus-control bindings. Results indicated that, whereas mind wandering during the implementation of stimulus-control bindings does not decrease their efficacy, mind wandering during the encoding of these control-state associations interferes with their successful deployment at a later point. In Experiment 2, we complemented these results by using trial-by-trial pupillometry to measure attention, again demonstrating that attention levels at encoding predict the subsequent implementation of stimulus-control bindings better than attention levels at implementation. These results suggest that, although encoding stimulus-control bindings in episodic memory requires active attention and engagement, once encoded, these bindings are automatically deployed to guide behavior when the stimulus recurs. These findings expand our understanding of how cognitive control processes are integrated into episodic event files.

Study-test congruence of response levels in item stimulus-response priming

We investigated stimulus-response (S-R) memory links during object priming using a binary associative size judgement paradigm. At study, participants decided which of two objects was bigger in real life and, at test, made the same or the reverse judgement. We examined the effects of response congruence on item S-R priming in the associative paradigm. In Experiment 1, a task reversal manipulation had minimal impact on RT priming when classifications were congruent for both recombined objects between study and test. Experiment 2 found that RT priming was more disrupted by classification incongruence of the selected than of the nonselected item alone, with incongruence of the nonselected object having no effect on RTs. Experiment 3, however, found that classification incongruence of both items eliminated RT priming, indicating that a significant effect of classification incongruence for the nonselected item is only evident if both items are classification-incongruent. Finally, across all experiments, we found that accuracy was more sensitive than RTs to decision/action incongruence. We interpret these findings in light of a two-stream account of S-R priming, and suggest a few extensions to account for interactions between S-R links of recombined items.

The Influence of Cognitive Load on Distractor-Response Bindings

Binding theories postulate an integration of stimulus and response features into temporary episodic traces or event files. In general, in the visual binding literature, attention is considered to be necessary to feature binding, and a higher cognitive load can lead to worse performance. On the other hand, in stimulus-response binding theories, central attention is not regarded as necessary in binding effects. A possible discrepancy between the visual feature binding findings and the findings in stimulus-response binding studies could lie in the amount of central load implemented, whereas another discrepancy was related to a specific type of process that was manipulated. In the present study, load was manipulated in three levels, such as no load, low load, and high load, and the binding effects were tested under each condition. Load was manipulated by using a secondary task, which was to be carried out simultaneously with the primary task. Additionally, the influence of targeting different working memory processes (maintenance and updating) was examined by varying the time point of the presentation of the secondary task. The results indicate that, under high load, binding effects are observed if memory contents are merely maintained, but not observed when memory contents are actively updated.

Watching the Brain as It (Un)Binds: Beta Synchronization Relates to Distractor-Response Binding

Human action control relies on event files, that is, short-term stimulus-response bindings that result from the integration of perception and action. The present EEG study examined oscillatory brain activities related to the integration and disintegration of event files in the distractor-response binding (DRB) task, which relies on a sequential prime-probe structure with orthogonal variation of distractor and response relations between prime and probe. Behavioral results indicated a DRB effect in RTs, which was moderated by the duration of the response-stimulus interval (RSI) between prime response and probe stimulus onset. Indeed, a DRB effect was observed for a short RSI of 500 msec but not for a longer RSI of 2000 msec, indicating disintegration of event files over time. EEG results revealed a positive correlation between individual DRB in the RSI-2000 condition and postmovement beta synchronization after both prime and probe responses. Beamformer analysis localized this correlation effect to the middle occipital gyrus, which also showed highest coherency with precentral and inferior parietal brain regions. Together, these findings suggest that postmovement beta synchronization is a marker of event file disintegration, with the left middle occipital gyrus being a hub region for stimulus-response bindings in the visual DRB task.