Psychometrics of the continuous mind: Measuring cognitive sub-processes via mouse tracking

Temporal dynamics of costly avoidance in naturalistic fears: Evidence for sequential-sampling of fear and reward information

Excessive avoidance is characteristic for anxiety disorders, even when approach would lead to positive outcomes. The process of how such approach-avoidance conflicts are resolved is not sufficiently understood. We examined the temporal dynamics of approach-avoidance in intense fear of spiders. Highly fearful and non-fearful participants chose repeatedly between a fixed no spider/low reward and a spider/high reward option with varying fear (probability of spider presentation) and reward information (reward magnitude). By sequentially presenting fear and reward information, we distinguished whether decisions are dynamically driven by both information (sequential-sampling) or whether the impact of fear information is inhibited (cognitive control). Mouse movements were recorded to assess temporal decision dynamics (i.e., how strongly which information impacts decision preference at which timepoint). Highly fearful participants showed stronger avoidance despite lower gains (i.e., costly avoidance). Time-continuous multiple regression of their mouse movements yielded a stronger impact of fear compared to reward information. Importantly, presenting either information first (fear or reward) enhanced its impact during the early decision process. These findings support sequential sampling of fear and reward information, but not inhibitory control. Hence, pathological avoidance may be characterized by biased evidence accumulation rather than altered cognitive control.

Focusing on Future Consequences Enhances Self-Controlled Dietary Choices

Self-controlled dietary decisions, i.e., choosing a healthier food over a tastier one, are a major challenge for many people. Despite the potential profound consequences of frequent poor choices, maintaining a healthy diet proves challenging. This raises the question of how to facilitate self-controlled food decisions to promote healthier choices. The present study compared the influence of implicit and explicit information on food choices and their underlying decision processes. Participants watched two video clips as an implicit manipulation to induce different mindsets. Instructions to focus on either the short-term or long-term consequences of choices served as an explicit manipulation. Participants performed a binary food choice task, including foods with different health and taste values. The choice was made using a computer mouse, whose trajectories we used to calculate the influence of the food properties. Instruction to focus on long-term consequences compared to short-term consequences increased the number of healthy choices, reduced response times for healthy decisions, and increased the influence of health aspects during the decision-making process. The effect of video manipulation showed greater variability. While focusing on long-term consequences facilitated healthy food choices and reduced the underlying decision conflict, the current mindset appeared to have a minor influence.

To see or not to see: the parallel processing of self-relevance and facial expressions

The self, like the concept of central "gravity", facilitates the processing of information that is directly relevant to the self. This phenomenon is known as the self-prioritization effect. However, it remains unclear whether the self-prioritization effect extends to the processing of emotional facial expressions. To fill this gap, we used a self-association paradigm to investigate the impact of self-relevance on the recognition of emotional facial expressions while controlling for confounding factors such as familiarity and overlearning. Using a large and diverse sample, we replicated the effect of self-relevance on face processing but found no evidence for a modulation of self-relevance on facial emotion recognition. We propose two potential theoretical explanations to account for these findings and emphasize that further research with different experimental designs and a multitasks measurement approach is needed to understand this mechanism fully. Overall, our study contributes to the literature on the parallel cognitive processing of self-relevance and facial emotion recognition, with implications for both social and cognitive psychology.

Exploring the impact of stimulus-stimulus and stimulus-response conflicts on computer mouse trajectories: continuous flow of information from stimulus encoding to response preparation to motor action

In recent years, mouse tracking (designing experiments in which participants provide responses via dynamic computer mouse movements) has enjoyed increasing experience in experimental psychology. Mouse-tracking studies typically involve some form of stimulus-response (S-R) conflict, and S-R effects emerge in movement trajectories (as well as in latencies). By contrast, it is currently unclear how stimulus-stimulus (S-S) compatibility affects movements. Here, we used a spatial arrow task which allowed us to generate S-R and S-S effects within the same experiment. Experiment 1 clarified in a key press experiment that this manipulation generates clear S-S and S-R effects in latencies. More critically, Experiment 2 demonstrated that both types of conflict impact mouse trajectories with incompatibility emerging as increased 'curvature' of responses when compared to congruent responses. We argue that these results are best explained via the assumption of 'continuous flow' of information, from stimulus encoding to response preparation and finally into motor action. By contrast, the S-S effect on trajectories contradicts the notion that processing is 'thresholded' between stimulus encoding and response preparation.

Mouse-cursor trajectories reveal reduced contextual influence on decision conflict during delay discounting in anorexia nervosa

OBJECTIVE

The capacity of individuals with anorexia nervosa (AN) to forgo immediate food rewards in their long-term pursuit of thinness is thought to reflect elevated self-control and/or abnormal reward sensitivity. Prior research attempted to capture an increased tendency to delay gratification in AN using delay-discounting tasks that assess how rapidly the subjective value of rewards decreases as a function of time until receipt. However, significant effects were mostly subtle or absent. Here, we tested whether the process leading to such decisions might be altered in AN.

METHOD

We recorded mouse-cursor movement trajectories leading to the final choice in a computerized delay-discounting task (238 trials) in 55 acutely underweight females with AN and pairwise age-matched female healthy controls (HC). We tested for group differences in deviations from a direct choice path, a measure of conflict strength in decision making, and whether group moderated the effect of several predictors of conflict strength (e.g., choice difficulty, consistency). We also explored reaction times and changes in trajectory directions (X-flips).

RESULTS

No group differences in delay-discounting parameters or movement trajectories were detected. However, the effect of the aforementioned predictors on deviations (and to a lesser extent reaction times) was reduced in AN.

DISCUSSION

These findings suggest that while delay discounting and conflict strength in decision making are generally unaltered in AN, conflict strength was more stable across different decisions in the disorder. This might enable individuals with AN to pursue (maladaptive) long-term body-weight goals, because particularly conflicting choices may not be experienced as such.

PUBLIC SIGNIFICANCE

The deviations from a direct path of mouse-cursor movements during a computerized delay-discounting task varied less in people with anorexia nervosa. Assuming such deviations measure decision conflict, we speculate that this increased stability might help people with anorexia nervosa achieve their long-term weight goals, as for them the struggle with the decision to eat high-calorie meals when hungry will be milder, so they would be more likely to skip them.

Temporal aspects of two types of backward crosstalk in dual-tasks: An analysis of continuous mouse-tracking data

A common explanation for processing limitations in dual-tasking is the existence of a bottleneck during response selection, meaning that the selection of responses can only occur serially for different tasks. However, a large body of data shows that features of a (secondary) Task 2 can already influence the processing of a (primary) Task 1. Such effects are referred to as backward crosstalk effects (BCEs). In the present study, two types of such BCEs were investigated: the compatibility-based BCE, which depends on the dimensional (often spatial) overlap between task features, and a BCE based on a go/no-go task in Task 2 (no-go BCE). Joining a line of research that suggests different mechanisms for these two types of BCEs, we investigated them using a mouse-tracking setup. Time continuous analyses revealed that the compatibility-based BCE triggered a spatial activation of the Task 2 response early during Task 1 processing, whereas the no-go BCE triggered an inhibitory effect in the case of a no-go Task 2, which spills over to Task 1 execution. This occurred, however, earlier in the time course than expected. The results are discussed with regard to recent models of dual-task processing.

Effects of conflict in cognitive control: Evidence from mouse tracking

It has long been debated whether the "congruency sequence effect (CSE)" in conflict tasks such as Flanker could reflect adaptive control. The current study used "mouse tracking" to tackle the issue in a combination of three conflict tasks (i.e., Flanker, Simon, and Spatial Stroop tasks). Congruency effects from previous and current trials emerged in latencies as well as curvature of movement trajectories in all three tasks. Critically, movement initiation times were affected only by congruency on previous but not on current trials. A further analysis showed that even when initiation time on the previous trials was taken into account, a subtle but highly significant effect of conflict arising from trial N-1 on initiation times remained. Although not necessarily implying "conflict adaptation," i.e., a dynamic up- and downregulation of cognitive control in response to a recent conflict, our finding indicates a specific sensitivity to the presence or absence of recent "conflict" in the cognitive environment.

Motor demands influence conflict processing in a mouse-tracking Simon task

Previous studies have shown incorrect motor activation when making perceptual decisions under conflict, but the potential involvement of motor processes in conflict resolution is still unclear. The present study tested whether the effects of distracting information may be reduced when anticipated motor processing demands increase. Specifically, across two mouse-tracking Simon experiments, we manipulated blockwise motor demands (high vs. low) by requiring participants to move a mouse cursor to either large versus small (Experiment 1) or near versus far (Experiment 2) response boxes presented on the screen. We reasoned that participants would increase action control in blocks with high versus low motor demands and that this would reduce the distracting effect of location-based activation. The results support this hypothesis: Simon effects were reduced under high versus low motor demands and this modulation held even when controlling for time-varying fluctuations in distractor-based activation via distributional analyses (i.e., delta plots). Thus, the present findings indicate that anticipation of different motor costs can influence conflict processing. We propose that the competition between distractor-based and target-based activation is biased at premotor and/or motor stages in anticipation of motor demands, but also discuss alternative implementations of action control.

Moving beyond response times with accessible measures of manual dynamics

Button-press measures of response time (RT) and accuracy have long served a central role in psychological research. However, RT and accuracy provide limited insight into how cognitive processes unfold over time. To address this limitation, researchers have used hand-tracking techniques to investigate how cognitive processes unfold over the course of a response, are modulated by recent experience, and function across the lifespan. Despite the efficacy of these techniques for investigating a wide range of psychological phenomena, widespread adoption of hand-tracking techniques within the field is hindered by a range of factors, including equipment costs and the use of specialized software. Here, we demonstrate that the behavioral dynamics previously observed with specialized motion-tracking equipment in an Eriksen flanker task can be captured with an affordable, portable, and easy-to-assemble response box. Six-to-eight-year-olds and adults (N = 90) completed a computerized version of the flanker task by pressing and holding a central button until a stimulus array appeared. Participants then responded by releasing the central button and reaching to press one of two response buttons. This method allowed RT to be separated into initiation time (when the central button was released) and movement time (time elapsed between initiation and completion of the response). Consistent with previous research using motion-tracking techniques, initiation times and movement times revealed distinct patterns of effects across trials and between age groups, indicating that the method used in the current study presents a simple solution for researchers from across the psychological and brain sciences looking to move beyond RTs.

Costly avoidance of Pavlovian fear stimuli and the temporal dynamics of its decision process

Conflicts between avoiding feared stimuli versus approaching them for competing rewards are essential for functional behavior and anxious psychopathology. Yet, little is known about the underlying decision process. We examined approach-avoidance decisions and their temporal dynamics when avoiding Pavlovian fear stimuli conflicted with gaining rewards. First, a formerly neutral stimulus (CS+) was repeatedly paired with an aversive stimulus (US) to establish Pavlovian fear. Another stimulus (CS−) was never paired with the US. A control group received neutral tones instead of aversive USs. Next, in each of 324 trials, participants chose between a CS−/low reward and a CS+/high reward option. For the latter, probability of CS+ presentation (Pavlovian fear information) and reward magnitude (reward information) varied. Computer mouse movements were tracked to capture the decision dynamics. Although no more USs occurred, pronounced and persistent costly avoidance of the Pavlovian fear CS+ was found. Time-continuous multiple regression of movement trajectories revealed a stronger and faster impact of Pavlovian fear compared to reward information during decision-making. The impact of fear information, but not reward information, modestly decreased across trials. These findings suggest a persistently stronger weighting of fear compared to reward information during approach-avoidance decisions, which may facilitate the development of pathological avoidance.

The Specificity and Reliability of Conflict Adaptation: A Mouse-Tracking Study

Researchers have recently begun to question the specificity and reliability of conflict adaptation effects, also known as sequential congruency effects (SCEs), a highly cited effect in cognitive psychology. Some have even used the lack of reliability across tasks (e.g., Flanker, and Stroop) to argue against models of cognitive control that have dominated the field for decades. The present study tested the possibility that domain-general processes across tasks might appear on more sensitive mouse-tracking metrics rather than overall reaction times. The relationship between SCE effects on the Stroop and Flanker tasks were examined for the first time using a mouse-tracking paradigm. Three main findings emerged: (1) Robust SCEs were observed for both the Stroop and Flanker tasks at the group level, (2) Within-task split-half reliabilities for the SCE across dependent variables were weak at best and non-existent in many cases, and (3) SCEs for the Flanker and Stroop tasks did not correlate with each other for overall reaction times, but did show significant correlations between tasks on more dynamic measures that captured processes before response execution. These findings contribute to the literature by highlighting how mouse-tracking may be a fruitful avenue by which future studies can examine the specificity and reliability of conflict adaptation and tease apart different theoretical models producing the effects.

Adjustments of selective attention to response conflict - controlling for perceptual conflict, target-distractor identity, and congruency level sequence pertaining to the congruency sequence effect

The congruency sequence effect (CSE) describes the performance difference of congruent trials (in which target and distractor stimuli are associated with the same response) compared to incongruent trials (in which target and distractor stimuli are associated with different responses) as a function of the preceding congruency level (congruent trials relative to incongruent trials). The CSE is commonly interpreted as a measure of conflict-induced attentional adjustment. Although previous research has made substantial progress aiming at controlling for alternative explanations of the CSE, both task-specific and fundamental confounds have remained. In the current study, we used a temporal flanker task, in which two stimuli (i.e., distractor and target) are presented in rapid succession, and extended previous demonstrations of a CSE in flanker tasks by deconfounding target-distractor congruency from perceptual similarity. Using a four-choice task, we could also control for the reversal of distractor-response priming after incongruent trials (which is only feasible in two-choice tasks). Furthermore, we controlled for all confounds based on the sequence (i.e., repetition versus alternation) of the congruency level – such as feature sequence effects, distractor-response contingency switch costs, or temporal learning – by probing the allocation of attention to the points in time of presentation of the first and the second stimulus of a trial. This was achieved by intermixing trials of a temporal search task. The performance accuracy results in this task were consistent with a stronger attentional bias in favor of the target stimulus’ temporal position after incongruent than after congruent trials.

A method for estimating the time of initiating correct categorization in mouse-tracking

Mouse-tracking facilitates exploration of the mental processes underlying decision-making. As the cognitive system works to settle on a decision, response competition manifests in the motor movements of the hand, bringing the mouse relatively closer to one alternative versus the other. Many metrics provide insight into decision-making processes by indexing the shape or complexity of the mouse trajectory. Lacking, however, is a metric that estimates the point in time when a participant begins to correctly categorize a stimulus. We rectify this absence by introducing a metric we refer to as time of initiating correct categorization (TICC), which is the point in time when people began moving relatively closer to the selected target relative to the distractor. We briefly review existing approaches to measuring time in mouse-tracking before describing the TICC and demonstrating its utility in three data sets.

The cone method: Inferring decision times from single-trial 3D movement trajectories in choice behavior

Ongoing goal-directed movements can be rapidly adjusted following new environmental information, e.g., when chasing pray or foraging. This makes movement trajectories in go-before-you-know decision-making a suitable behavioral readout of the ongoing decision process. Yet, existing methods of movement analysis are often based on statistically comparing two groups of trial-averaged trajectories and are not easily applied to three-dimensional data, preventing them from being applicable to natural free behavior. We developed and tested the cone method to estimate the point of overt commitment (POC) along a single two- or three-dimensional trajectory, i.e., the position where the movement is adjusted towards a newly selected spatial target. In Experiment 1, we established a “ground truth” data set in which the cone method successfully identified the experimentally constrained POCs across a wide range of all but the shallowest adjustment angles. In Experiment 2, we demonstrate the power of the method in a typical decision-making task with expected decision time differences known from previous findings. The POCs identified by cone method matched these expected effects. In both experiments, we compared the cone method’s single trial performance with a trial-averaging method and obtained comparable results. We discuss the advantages of the single-trajectory cone method over trial-averaging methods and possible applications beyond the examples presented in this study. The cone method provides a distinct addition to existing tools used to study decisions during ongoing movement behavior, which we consider particularly promising towards studies of non-repetitive free behavior.

Using mouse cursor tracking to investigate online cognition: Preserving methodological ingenuity while moving toward reproducible science

Mouse cursor tracking has become a prominent method for characterizing cognitive processes, used in a wide variety of domains of psychological science. Researchers have demonstrated considerable ingenuity in the application of the approach, but the methodology has not undergone systematic analysis to facilitate the development of best practices. Furthermore, recent research has demonstrated effects of experimental design features on a number of mousetracking outcomes. We conducted a systematic review of the mouse-tracking literature to survey the reporting and spread of mouse variables (Cursor speed, Sampling rate, Training), physical characteristics of the experiments (Stimulus position, Response box position) and response requirements (Start procedure, Response procedure, Response deadline). This survey reveals that there is room for improvement in reporting practices, especially of subtler design features that researchers may have assumed would not impact research results (e.g., Cursor speed). We provide recommendations for future best practices in mouse-tracking studies and consider how best to standardize the mouse-tracking literature without excessively constraining the methodological flexibility that is essential to the field.