Two faces of temporal binding: Action- and effect-binding are not correlated

The time course of Temporal Binding in social and nonsocial interactions

Temporal Binding (TB) is the subjective compression of action-effect intervals. While the effects of nonsocial actions are highly predictable, it is not the case when interacting with conspecifics, who often act under their own volition, at a time of their choosing. Given the relative differences in action-effect predictability in non-social and social interactions, it is plausible that TB and its properties differ across these situations. To examine this, in two experiments, we compared the time course of TB in social and nonsocial interactions, systematically varying action-effect intervals (200-2,100 ms). Participants were told they were (a) interacting with another person via a live webcam, who was in fact a confederate (social condition), (b) interacting with pre-recorded videos (nonsocial condition), or (c) observing two pre-recorded videos (control condition; Experiment 2). Results across experiments showed greater TB for social compared to nonsocial conditions, and the difference was proportional to the action-effect intervals. Further, in Experiment 1, TB was consistently observed throughout the experiment for social interactions, whereas nonsocial TB decreased from the first to the second half of the experiment. In Experiment 2, the nonsocial condition did not differ from control, whereas the social condition did, exhibiting enhanced binding. We argue these results suggest that the sociality of an interaction modulates the 'internal clock' of time perception.

Arousal, interindividual differences and temporal binding a psychophysiological study

The sense of agency varies as a function of arousal in negative emotional contexts. As yet, it is unknown whether the same is true for positive affect, and how inter-individual characteristics might predict these effects. Temporal binding, an implicit measure of the sense of agency, was measured in 59 participants before and after watching either an emotionally neutral film clip or a positive film clip with high or low arousal. Analyses included participants' individual differences in subjective affective ratings, physiological arousal (pupillometry, skin conductance, heart rate), striatal dopamine levels via eye blink rates, and psychopathy. Linear mixed models showed that sexual arousal decreased temporal binding whereas calm pleasure had no facilitation effect on binding. Striatal dopamine levels were positively linked whereas subjective and physiological arousal may be negatively associated with binding towards actions. Psychopathic traits reduced the effect of high arousal on binding towards actions. These results provide evidence that individual differences influence the extent to which the temporal binding is affected by high arousing states with positive valence.

The fusion point of temporal binding: Promises and perils of multisensory accounts

Performing an action to initiate a consequence in the environment triggers the perceptual illusion of temporal binding. This phenomenon entails that actions and following effects are perceived to occur closer in time than they do outside the action-effect relationship. Here we ask whether temporal binding can be explained in terms of multisensory integration, by assuming either multisensory fusion or partial integration of the two events. We gathered two datasets featuring a wide range of action-effect delays as a key factor influencing integration. We then tested the fit of a computational model for multisensory integration, the statistically optimal cue integration (SOCI) model. Indeed, qualitative aspects of the data on a group-level followed the principles of a multisensory account. By contrast, quantitative evidence from a comprehensive model evaluation indicated that temporal binding cannot be reduced to multisensory integration. Rather, multisensory integration should be seen as one of several component processes underlying temporal binding on an individual level.

Temporal binding and sense of agency in major depression

Background

Alterations in the experience of controlling oneself and one's environment are of high relevance to understanding the psychopathology of depression. This study investigated the relationship between Temporal Binding for action-event sequences, sense of agency, self-efficacy and symptom severity in Major Depressive Disorder.

Method

We employed the Sense of Agency Scale (SoAS) and the General Self-Efficacy Scale (GSE) to assess explicit Sense of Agency and self-efficacy in a group of 42 persons diagnosed with Major Depressive Disorder (MDD) [20 identifying as female, 19 as male; mean age 37.8 years (± 13.3)] and 40 control persons without a psychiatric diagnosis (CG) [22 identifying as female, 20 as male; mean age 38.0 years ( ± 13.3)]. Depressive symptom severity was measured using the BDI-II. We additionally performed a temporal binding paradigm as a potential correlate to Sense of Agency. Participants partook in a time estimation task judging three intervals (250ms, 450ms, 650ms) while either observing or causing stimulus presentations. The underestimation of intervals following intentional actions causing stimulus presentations (compared to merely observing the stimulus presentation) is interpreted as temporal binding.

Results

SoAS scores demonstrated an inverse correlation with depressive symptoms (CG: p=.032, R2=.113; MDD: p<.001, R2=.260) and a positive correlation with GSE scores (CG: p<.001, R2=.379; MDD: p<.001, R2=.254). We found distinct differences in temporal binding between healthy participants and the Major Depressive Disorder group without significant correlation between temporal binding and the SoAS or GSE scores. The data suggest group differences in time estimation particular pertaining to time intervals involving intentional action and increasingly complex multisensory stimuli.

Discussion

We investigated parameters of subjective control, namely Sense of Agency and Self Efficacy. Here, we were able to reveal their inverse relationship with depressive symptoms in patients with major depressive disorder, highlighting a profound experience of loss of control with increasing symptom load. Deficits in experiencing control, particularly involving intentional motor actions (and more complex multisensory stimuli), appear to be more pronounced in Major Depressive Disorder, involving not only negative self-efficacy expectations but also an altered Sense of Agency and temporal binding. Temporal binding and SoAS scores did not correlate, adding to the growing evidence that the two measures may not be directly related. We propose that future research be directed at this contiguous relationship between Sense of Agency and Self Efficacy in Major Depressive Disorder.

You do you: susceptibility of temporal binding to self-relevance

The self-prioritization effect suggests that self-relevant information has a processing advantage over information that is not directly associated with the self. In consequence, reaction times are faster and accuracy rates higher when reacting to self-associated stimuli rather than to other-related stimuli (Sui et al., Journal of Experimental Psychology: Human Perception and Performance 38:1105-1117, 2012). This spurs the assumption that self-associated action-effects should also be perceived earlier than other-related outcomes. One way to measure this is temporal binding. Previous research indeed showed that the perceived temporal interval between actions and self-associated outcomes was reduced compared to friend- and other-associated outcomes. However, the employed method (interval estimations) and several experimental design choices make it impossible to discern whether the perceived shortening of the interval between a keypress and a self-relevant outcome is due to a perceptual shift of the action or of the action-effect or both. Thus, we conducted four experiments to assess whether temporal binding can indeed be modulated by self-relevance and if so where this perceptual bias is located. The results did not support stronger temporal binding for self- vs other-related action-effects. We discuss these results against the backdrop of the attentional basis of self-prioritization and propose directions for future research.

Eye did this! Sense of agency in eye movements

This study investigates the sense of agency (SoA) for saccades with implicit and explicit agency measures. In two eye tracking experiments, participants moved their eyes towards on-screen stimuli that subsequently changed color. Participants then either reproduced the temporal interval between saccade and color-change (Experiment 1) or reported the time points of these events with an auditory Libet clock (Experiment 2) to measure temporal binding effects as implicit indices of SoA. Participants were either made to believe to exert control over the color change or not (agency manipulation). Explicit ratings indicated that the manipulation of causal beliefs and hence agency was successful. However, temporal binding was only evident for caused effects, and only when a sufficiently sensitive procedure was used (auditory Libet clock). This suggests a feebler connection between temporal binding and SoA than previously proposed. The results also provide evidence for a relatively fast acquisition of sense of agency for previously never experienced types of action-effect associations. This indicates that the underlying processes of action control may be rooted in more intricate and adaptable cognitive models than previously thought. Oculomotor SoA as addressed in the present study presumably represents an important cognitive foundation of gaze-based social interaction (social sense of agency) or gaze-based human-machine interaction scenarios. PUBLIC SIGNIFICANCE STATEMENT: In this study, sense of agency for eye movements in the non-social domain is investigated in detail, using both explicit and implicit measures. Therefore, it offers novel and specific insights into comprehending sense of agency concerning effects induced by eye movements, as well as broader insights into agency pertaining to entirely newly acquired types of action-effect associations. Oculomotor sense of agency presumably represents an important cognitive foundation of gaze-based social interaction (social agency) or gaze-based human-machine interaction scenarios. Due to peculiarities of the oculomotor domain such as the varying degree of volitional control, eye movements could provide new information regarding more general theories of sense of agency in future research.

Evaluating the Bayesian causal inference model of intentional binding through computational modeling

Intentional binding refers to the subjective compression of the time interval between an action and its consequence. While intentional binding has been widely used as a proxy for the sense of agency, its underlying mechanism has been largely veiled. Bayesian causal inference (BCI) has gained attention as a potential explanation, but currently lacks sufficient empirical support. Thus, this study implemented various computational models to describe the possible mechanisms of intentional binding, fitted them to individual observed data, and quantitatively evaluated their performance. The BCI models successfully isolated the parameters that potentially contributed to intentional binding (i.e., causal belief and temporal prediction) and generally better explained an observer's time estimation than traditional models such as maximum likelihood estimation. The estimated parameter values suggested that the time compression resulted from an expectation that the actions would immediately cause sensory outcomes. Furthermore, I investigated the algorithm that realized this BCI and found probability-matching to be a plausible candidate; people might heuristically reconstruct event timing depending on causal uncertainty rather than optimally integrating causal and temporal posteriors. The evidence demonstrated the utility of computational modeling to investigate how humans infer the causal and temporal structures of events and individual differences in that process.

Feelings of responsibility and temporal binding: A comparison of two measures of the sense of agency

Temporal binding refers to a subjective shortening of the interval between an action and its perceptual consequences. Temporal binding has often been used by researchers to indirectly measure participants' sense of agency (SoA), or the subjective sense of causing something to happen. Other studies have proposed links between temporal binding and feelings of moral responsibility. The present study compared subjective interval estimates to feelings of responsibility in a between-subjects design (Exp 1) and a within-subjects design (Exp 2). Participants either estimated the interval between two events (two tones in the passive condition, or a keypress followed by a tone in active conditions) or rated their feeling of responsibility for the tone(s). Manipulations of participant involvement and choice impacted feelings of responsibility more than temporal estimates. Overall, the two dependent variables followed different patterns, suggesting subjective interval estimates may not be a reliable proxy for feelings of responsibility.

Attention and expectation likely underlie temporal binding measured using the Libet Clock

An interesting finding that has emerged in studies of the sense of agency is that of a perceived compression of the temporal interval between actions and the outcomes they produce. This is generally referred to as temporal binding. Although temporal binding has been studied using various paradigms, possibly the most popular of these is the Libet Clock task. The Libet task is also interesting because it suggests that temporal binding can be decomposed into two components, one purportedly relating to actions and the other relating to outcomes. These are termed action binding and outcome binding, respectively. In this article, I focus specifically on temporal binding revealed using the Libet Clock task and propose the idea that attention underpins the action binding effect, while outcome binding, on the other hand, is driven by the effects of expectation.

When did it happen? Verbal information about causal relations affects time estimation

Usually, the closer two events occur, the more likely people infer a causal relationship between them. Recent studies have shown that this relationship between time and causality is bidirectional. Participants also tend to judge events closer in time if they assume that they are causally related. We present six experiments showing causal binding, but unlike other experiments, participants do not emit any motor action, and no physical feedback is given. Rather, all stimuli and causal information are provided verbally. After reading a list of events, participants were asked to estimate the time elapsed between two of them. Those participants who were informed that there was a causal relationship between the two events estimated them as occurring closer to each other. These results support causality- and heuristic-based explanations of temporal binding, as opposed to other explanations such as sensory integration or intentionality of action.

Action representations in prevention behavior: Evidence from motor execution

Human actions sometimes aim at preventing an event from occurring. How these to-be-prevented events are represented, however, is poorly understood. Recent proposals in the literature point to a possible divide between effect-producing, operant actions, and effect-precluding, prevention actions, suggesting that the control of operant actions relies on codes of environment-related effects whereas prevention actions do not. Here we report two experiments on this issue, showing that spatial features (Experiment 1) as well as temporal features (Experiment 2) of to-be-prevented events influence actions in the same way as corresponding features of to-be-produced effects. This implies that selecting and executing prevention actions relies on anticipated environmental changes, comparable to operant actions.

Distracted to a fault: Attention, actions, and time perception

In the last years, it has become general consensus that actions change our time perception. Performing an action to elicit a specific event seems to lead to a systematic underestimation of the interval between action and effect, a phenomenon termed temporal (or previously intentional) binding. Temporal binding has been closely associated with sense of agency, our perceived control over our actions and our environment, and because of its robust behavioral effects has indeed been widely utilized as an implicit correlate of sense of agency. The most robust and clear temporal binding effects are typically found via Libet clock paradigms. In the present study, we investigate a crucial methodological confound in these paradigms that provides an alternative explanation for temporal binding effects: a redirection of attentional resources in two-event sequences (as in classical operant conditions) versus singular events (as in classical baseline conditions). Our results indicate that binding effects in Libet clock paradigms may be based to a large degree on such attentional processes, irrespective of intention or action-effect sequences. Thus, these findings challenge many of the previously drawn conclusions and interpretations with regard to actions and time perception.

Depressive traits are associated with a reduced effect of choice on intentional binding

A sense of agency (SoA) over wilful actions is thought to be dependent on the level of choice and the nature of the outcome. In a preregistered study, we manipulated choice and valence of outcome to assess the relationship between SoA across the depression and psychosis continuum. Participants (N = 151) completed a Libet Clock task, in which they had either a free or forced choice to press one of two buttons and received either a rewarding or punishing outcome. Participants also completed questionnaires on depressive and psychosis-like traits. Rewarding outcomes increased intentional binding. The evidence favoured no effect of choice on average, but this was influenced by inter-individual differences. Individuals reporting more depressive traits had less of a difference in intentional binding between free and forced choice conditions. We show that implicit SoA is sensitive to outcome valence and the effect of choice differs across the depression continuum.

Never run a changing system: Action-effect contingency shapes prospective agency

Human action control is highly sensitive to action-effect contingencies in the agent's environment. Here we show that the subjective sense of agency (SoA) contributes to this sensitivity as a subjective counterpart to instrumental action decisions. Participants (N = 556) experienced varying reward probabilities and were prompted to give summary evaluations of their SoA after a series of action-effect episodes. Results first revealed a quadratic relation of contingency and SoA, driven by a disproportionally strong impact of perfect action-effect contingencies. In addition to this strong situational determinant of SoA, we observed small but reliable interindividual differences as a function of gender, assertiveness, and neuroticism that applied especially at imperfect action-effect contingencies. Crucially, SoA not only reflected the reward structure of the environment but was also associated with the agent's future action decisions across situational and personal factors. These findings call for a paradigm shift in research on perceived agency, away from the retrospective assessment of single behavioral episodes and towards a prospective view that draws on statistical regularities of an agent's environment.