MouseTracker: software for studying real-time mental processing using a computer mouse-tracking method

Cognitive miserliness in argument literacy? Effects of intuitive and analytic thinking on recognizing fallacies

Fallacies are a particular type of informal argument that are psychologically compelling and often used for rhetorical purposes. Fallacies are unreasonable because the reasons they provide for their claims are irrelevant or insufficient. Ability to recognize the weakness of fallacies is part of what we call argument literacy and imporatant in rational thinking. Here we examine classic fallacies of types found in textbooks. In an experiment, participants evaluated the quality of fallacies and reasonable arguments. We instructed participants to think either intuitively, using their first impressions, or analytically, using rational deliberation. We analyzed responses, response times, and cursor trajectories (captured using mouse tracking). The results indicate that instructions to think analytically made people spend more time on the task but did not make them change their minds more often. When participants made errors, they were drawn towards the correct response, while responding correctly was more straightforward. The results are compatible with “smart intuition” accounts of dual-process theories of reasoning, rather than with corrective default-interventionist accounts. The findings are discussed in relation to whether theories developed to account for formal reasoning can help to explain the processing of everyday arguments.

Modeling random and non-random decision uncertainty in ratings data: a fuzzy beta model

Modeling human ratings data subject to raters’ decision uncertainty is an attractive problem in applied statistics. In view of the complex interplay between emotion and decision making in rating processes, final raters’ choices seldom reflect the true underlying raters’ responses. Rather, they are imprecisely observed in the sense that they are subject to a non-random component of uncertainty, namely the decision uncertainty. The purpose of this article is to illustrate a statistical approach to analyse ratings data which integrates both random and non-random components of the rating process. In particular, beta fuzzy numbers are used to model raters’ non-random decision uncertainty and a variable dispersion beta linear model is instead adopted to model the random counterpart of rating responses. The main idea is to quantify characteristics of latent and non-fuzzy rating responses by means of random observations subject to fuzziness. To do so, a fuzzy version of the Expectation–Maximization algorithm is adopted to both estimate model’s parameters and compute their standard errors. Finally, the characteristics of the proposed fuzzy beta model are investigated by means of a simulation study as well as two case studies from behavioral and social contexts.

The Specificity and Reliability of Conflict Adaptation: A Mouse-Tracking Study

Researchers have recently begun to question the specificity and reliability of conflict adaptation effects, also known as sequential congruency effects (SCEs), a highly cited effect in cognitive psychology. Some have even used the lack of reliability across tasks (e.g., Flanker, and Stroop) to argue against models of cognitive control that have dominated the field for decades. The present study tested the possibility that domain-general processes across tasks might appear on more sensitive mouse-tracking metrics rather than overall reaction times. The relationship between SCE effects on the Stroop and Flanker tasks were examined for the first time using a mouse-tracking paradigm. Three main findings emerged: (1) Robust SCEs were observed for both the Stroop and Flanker tasks at the group level, (2) Within-task split-half reliabilities for the SCE across dependent variables were weak at best and non-existent in many cases, and (3) SCEs for the Flanker and Stroop tasks did not correlate with each other for overall reaction times, but did show significant correlations between tasks on more dynamic measures that captured processes before response execution. These findings contribute to the literature by highlighting how mouse-tracking may be a fruitful avenue by which future studies can examine the specificity and reliability of conflict adaptation and tease apart different theoretical models producing the effects.

I change my mind to get better: Process tracing-based microanalysis of food choice processes reveals differences between anorexia nervosa and bulimia nervosa during inpatient treatment

Food choice and its underlying processes is understudied in bulimia nervosa (BN) and anorexia nervosa (AN). Thus, we examined cognitive processes during food choice through mouse tracing in AN (n = 36) and BN (n = 27) undergoing inpatient treatment. Both patient groups and matched healthy controls (HC, n = 59) made 153 binary food choices before rating all foods on their liking and calorie density. Choice outcomes and corresponding mouse movements were modelled as a function of inpatient treatment stage in our analyses. Compared to patients with BN and HC, those with AN showed a clear calorie avoidance on most trials. Yet, mouse paths in AN patients early in treatment, revealed a late direction reversal ('change of mind', CoM) on high-calorie choices. AN patients later in treatment, by contrast, showed fewer CoM alongside more choices for - and liking of - high-calorie foods. Patients with BN showed more CoM trials during low-calorie choices and low-calorie choices were more frequent in patients later in treatment. Thus, relative to patients early in treatment, patients who are later in treatment show less of the overall group pattern of consistently choosing low-calorie food (AN) or high-calorie food (BN). Less cognitive regulation (fewer CoM trials) went along with higher liking for high-calorie foods in AN. These cross-sectional differences between AN early and late in treatment might reflect the formation of healthier habits. In addition, clear patient group differences suggest more specific treatment strategies.

Joint Simon effect in movement trajectories

In joint action literature it is often assumed that acting together is driven by pervasive and automatic process of co-representation, that is, representing the co-actor's part of the task in addition to one's own. Much of this research employs joint stimulus-response compatibility tasks varying the stimuli employed or the physical and social relations between participants. In this study we test the robustness of co-representation effects by focusing instead on variation in response modality. Specifically, we implement a mouse-tracking version of a Joint Simon Task in which participants respond by producing continuous movements with a computer mouse rather than pushing discrete buttons. We have three key findings. First, in a replication of an earlier study we show that in a classical individual Simon Task movement trajectories show greater curvature on incongruent trials, paralleling longer response times. Second, this effect largely disappears in a Go-NoGo Simon Task, in which participants respond to only one of the cues and refrain from responding to the other. Third, contrary to previous studies that use button pressing responses, we observe no overall effect in the joint variants of the task. However, we also detect a notable diversity in movement strategies adopted by the participants, with some participants showing the effect on the individual level. Our study casts doubt on the pervasiveness of co-representation, highlights the usefulness of mouse-tracking methodology and emphasizes the need for looking at individual variation in task performance.

Long-Term Motor Learning in the "Wild" With High Volume Video Game Data

Motor learning occurs over long periods of practice during which motor acuity, the ability to execute actions more accurately, precisely, and in less time, improves. Laboratory-based studies of motor learning are typically limited to a small number of participants and a time frame of minutes to several hours per participant. There is a need to assess the generalizability of theories and findings from lab-based motor learning studies on larger samples and time scales. In addition, laboratory-based studies of motor learning use relatively simple motor tasks which participants are unlikely to be intrinsically motivated to learn, limiting the interpretation of their findings in more ecologically valid settings ("in the wild"). We studied the acquisition and longitudinal refinement of a complex sensorimotor skill embodied in a first-person shooter video game scenario, with a large sample size (N = 7174, 682,564 repeats of the 60 s game) over a period of months. Participants voluntarily practiced the gaming scenario for up to several hours per day up to 100 days. We found improvement in performance accuracy (quantified as hit rate) was modest over time but motor acuity (quantified as hits per second) improved considerably, with 40-60% retention from 1 day to the next. We observed steady improvements in motor acuity across multiple days of video game practice, unlike most motor learning tasks studied in the lab that hit a performance ceiling rather quickly. Learning rate was a non-linear function of baseline performance level, amount of daily practice, and to a lesser extent, number of days between practice sessions. In addition, we found that the benefit of additional practice on any given day was non-monotonic; the greatest improvements in motor acuity were evident with about an hour of practice and 90% of the learning benefit was achieved by practicing 30 min per day. Taken together, these results provide a proof-of-concept in studying motor skill acquisition outside the confines of the traditional laboratory, in the presence of unmeasured confounds, and provide new insights into how a complex motor skill is acquired in an ecologically valid setting and refined across much longer time scales than typically explored.

Reappraisal-but not Suppression-Tendencies Determine Negativity Bias After Laboratory and Real-World Stress Exposure

Higher reactivity to stress exposure is associated with an increased tendency to appraise ambiguous stimuli as negative. However, it remains unknown whether tendencies to use emotion regulation strategies—such as cognitive reappraisal, which involves altering the meaning or relevance of affective stimuli—can shape individual differences regarding how stress affects perceptions of ambiguity. Here, we examined whether increased reappraisal use is one factor that can determine whether stress exposure induces increased negativity bias. In Study 1, healthy participants (n = 43) rated the valence of emotionally ambiguous (surprised) faces before and after an acute stress or control manipulation and reported reappraisal habits. Increased negativity ratings were milder for stressed individuals that reported more habitual reappraisal use. In Study 2 (n = 97), we extended this investigation to real-world perceived stress before and during the COVID-19 pandemic. We found that reappraisal tendency moderates the relationship between perceived stress and increased negativity bias. Collectively, these findings suggest that the propensity to reappraise determines negativity bias when evaluating ambiguity under stress.

Emotion prediction errors guide socially adaptive behaviour

People make decisions based on deviations from expected outcomes, known as prediction errors. Past work has focused on reward prediction errors, largely ignoring violations of expected emotional experiences—emotion prediction errors. We leverage a method to measure real-time fluctuations in emotion as people decide to punish or forgive others. Across four studies (N=1,016), we reveal that emotion and reward prediction errors have distinguishable contributions to choice, such that emotion prediction errors exert the strongest impact during decision-making. We additionally find that a choice to punish or forgive can be decoded in less than a second from an evolving emotional response, suggesting emotions swiftly influence choice. Finally, individuals reporting significant levels of depression exhibit selective impairments in using emotion—but not reward—prediction errors. Evidence for emotion prediction errors potently guiding social behaviors challenge standard decision-making models that have focused solely on reward.

Escaping from the meat paradox: How morality and disgust affect meat-related ambivalence

Meat production and its consumption harm animals, the environment, and human health; nevertheless, many people like to eat meat. If people become aware of this so-called meat paradox, they experience an aversive cognitive conflict. People, therefore, have to eschew meat if they permanently want to resolve this conflict. Eschewing meat is demanding, however, because people have to resist their temptation to eat meat and challenge social norms. In the present research, we thus conducted two pre-registered studies to investigate how people may overcome these obstacles: We hypothesized that people may go through a hedonic shift in which they establish cognitive consistency by forming univalent instead of ambivalent attitudes and that this process is fueled by the moral emotion disgust. In Study 1, we found that veg*ans who pursued moral goals with their diet reported more disgust towards meat, which was associated with reduced meat-related ambivalence. In Study 2, we found that disgust towards meat was again associated with decreased meat-related ambivalence. That is, veg*ans and omnivores similarly reported greater disgust after reading a text describing bad hygienic conditions in meat production. Besides this physical disgust, they also experienced heightened disgust if they read a text on animal cruelty in meat production. This moral disgust, however, was only elicited in people who did not morally disengage from their harmful behavior, i.e., in people who attributed relatively high emotional and mental capacities towards animals. While the latter findings of Study 2 are rather exploratory, taken together our findings suggest that morality and disgust may indeed promote cognitive consistency. The outlined processes thus could play a pivotal role in adopting and maintaining meat-less diets.

Emotion perception bias associated with the hijab in Austrian and Turkish participants

In a cross-cultural study, we investigated the link between explicit attitudes towards the hijab and implicit measures of cultural and religious bias during the recognition of emotions. Participants tested in Austria (N = 71) and in Turkey (N = 70) reported their attitude towards the hijab, and categorised in a mousetracker task happy and sad faces of women, shown with five levels of intensity, and framed either by a hijab or by an oval-shaped mask. The two samples did not differ in their explicit attitudes towards the hijab. However, negative attitude towards the hijab predicted greater sadness attribution to happy faces with the hijab in Austrian participants. Unrelated to their explicit attitudes, Turkish participants attributed more sadness to happy faces with than without the hijab. Results suggest that the sight of the hijab activated, in both Austrian and Turkish participants, implicit biases resulting in associations with sadness and negative emotions.

Contextualized Knowledge Reduces Misconceived COVID-19 Health Decisions

How do we resolve conflicting ideas about how to protect our health during a pandemic? Prior knowledge influences our decisions, potentially creating implicit cognitive conflict with new, correct information. COVID-19 provides a natural condition for investigating how an individual's health-specific knowledge (e.g., understanding mask efficacy) and their personal context (e.g., outbreak proximity) influence their protective health behavior endorsement, as information about the virus, its spread, and lethality has changed over time. Using a dual-process-model framework, we investigated the role cognitive conflict has on health decision-making. We used a computer mouse-tracking paradigm alongside geographical information systems (GIS) as a proxy for context. The results support a contextualized-deficit-model framework in which relevant knowledge and context-based factors help individuals override cognitive conflict to make more preventative health decisions. Findings from this study may provide evidence for a more effective way for experts to combat non-adherence due to conflicting health information.

Person knowledge shapes face identity perception

Recognition of others' identity through facial features is essential in life. Using both correlational and experimental approaches, we examined how person knowledge biases the perception of others' facial identity. When a participant believed any two individuals were more similar in personality, their faces were perceived to be correspondingly more similar (assessed via mousetracking, Study 1). Further, participants' facial representations of target individuals that were believed to have a more similar personality were found to have a greater physical resemblance (assessed via reverse-correlation, Studies 2 and 3). Finally, when participants learned about novel individuals who had a more similar personality, their faces were visually represented more similarly (Study 4). Together, the findings show that the perception of facial identity is driven not only by facial features but also the person knowledge we have learned about others, biasing it toward alternate identities despite the fact that those identities lack any physical resemblance.

Robocalypse? Yes, Please! The Role of Robot Autonomy in the Development of Ambivalent Attitudes Towards Robots

Attitudes towards robots are not always unequivocally positive or negative: when attitudes encompass both strong positive and strong negative evaluations about an attitude object, people experience an unpleasant state of evaluative conflict, called ambivalence. To shed light on ambivalence towards robots, we conducted a mixed-methods experiment with N = 163 German university students that investigated the influence of robot autonomy on robot-related attitudes. With technological progress, robots become increasingly autonomous. We hypothesized that high levels of robot autonomy would increase both positive and negative robot-related evaluations, resulting in more attitudinal ambivalence. We experimentally manipulated robot autonomy through text vignettes and assessed objective ambivalence (i.e., the amount of reported conflicting thoughts and feelings) and subjective ambivalence (i.e., self-reported experienced conflict) towards the robot ‘VIVA’ using qualitative and quantitative measures. Autonomy did not impact objective ambivalence. However, subjective ambivalence was higher towards the robot high versus low in autonomy. Interestingly, this effect turned non-significant when controlling for individual differences in technology commitment. Qualitative results were categorized by two independent raters into assets (e.g., assistance, companionship) and risks (e.g., privacy/data security, social isolation). Taken together, the present research demonstrated that attitudes towards robots are indeed ambivalent and that this ambivalence might influence behavioral intentions towards robots. Moreover, the findings highlight the important role of technology commitment. Finally, qualitative results shed light on potential users’ concerns and aspirations. This way, these data provide useful insights into factors that facilitate human–robot research.

Computational approaches to the neuroscience of social perception

Across multiple domains of social perception-including social categorization, emotion perception, impression formation and mentalizing-multivariate pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data has permitted a more detailed understanding of how social information is processed and represented in the brain. As in other neuroimaging fields, the neuroscientific study of social perception initially relied on broad structure-function associations derived from univariate fMRI analysis to map neural regions involved in these processes. In this review, we trace the ways that social neuroscience studies using MVPA have built on these neuroanatomical associations to better characterize the computational relevance of different brain regions, and discuss how MVPA allows explicit tests of the correspondence between psychological models and the neural representation of social information. We also describe current and future advances in methodological approaches to multivariate fMRI data and their theoretical value for the neuroscience of social perception.

Grammatical Aspect and Mental Activation of Implied Instruments: A Mouse-Tracking Study in Persian

Can grammatical cues affect the way people activate event knowledge? We used mouse tracking to study the effect of grammatical aspect on the mental activation of instruments in Persian. Verb aspect is defined as how an action or event is extended over time, whether it is perfective (complete) or imperfective (incomplete). We predicted that imperfective aspect would trigger the mental activation of event knowledge, thus making participants mistakenly believe that the instrument with which the action is normally performed was present in the sentence. We tested this hypothesis using manual action verbs. Fifty female participants read a simple active sentence in which an actor had done or was doing an action (e.g., Sara has sliced/is slicing the zucchinis) with an implied instrument (knife). Then, they were presented with a picture of the implied instrument and judged whether the instrument was mentioned in the sentence they just read by clicking on the PRESENT or ABSENT response option. We predicted that participants would be less efficient at clicking ABSENT in the imperfective condition. In line with this prediction, we found that the imperfective condition caused significant deviation to the incorrect response PRESENT. However, no significant time differences emerged. The results are consistent with embodied views of language comprehension.

The role of valence in word processing: Evidence from lexical decision and emotional Stroop tasks

It is widely accepted that the valence of a word (neutral, positive, or negative) influences lexical processing, yet data from the commonly used lexical decision and emotional Stroop tasks has yielded inconsistent findings regarding the direction of this influence. One critical obstacle to investigating the independent effects of valence is the matching of emotional and neutral stimuli on the lexical, sublexical, and conceptual characteristics known to influence word recognition. The second obstacle is that the cognitive processes which lead to a lexical decision and a colour naming response are unobservable from the response latency measures typically gathered. The present study compiled a set of neutral, positive, and negative words matched triplet-wise on 26 influential characteristics. The novel "mouse tracking" technique was used to analyse the development of responses to these materials in variants of the lexical decision and emotional Stroop task. A conventional key-press emotional Stroop task is also reported. Results revealed a significant processing advantage for positive words over negative and neutral words in the lexical decision task, whereas valence alone did not produce any significant effects in the emotional Stroop task. The discrepancy between the effects of valence across these different tasks is discussed. We also suggest that previous conflicting findings may be confounded by unmatched emotional and neutral stimuli, thus inflating the potential effects of valence.

Studying visual search without an eye tracker: an assessment of artificial foveation

Eye tracking is a useful tool for studying human cognition, both in the laboratory and in real-world applications. However, there are cases in which eye tracking is not possible, such as in high-security environments where recording devices cannot be introduced. After facing this challenge in our own work, we sought to test the effectiveness of using artificial foveation as an alternative to eye tracking for studying visual search performance. Two groups of participants completed the same list comparison task, which was a computer-based task designed to mimic an inventory verification process that is commonly performed by international nuclear safeguards inspectors. We manipulated the way in which the items on the inventory list were ordered and color coded. For the eye tracking group, an eye tracker was used to assess the order in which participants viewed the items and the number of fixations per trial in each list condition. For the artificial foveation group, the items were covered with a blurry mask except when participants moused over them. We tracked the order in which participants viewed the items by moving their mouse and the number of items viewed per trial in each list condition. We observed the same overall pattern of performance for the various list display conditions, regardless of the method. However, participants were much slower to complete the task when using artificial foveation and had more variability in their accuracy. Our results indicate that the artificial foveation method can reveal the same pattern of differences across conditions as eye tracking, but it can also impact participants' task performance.

Bodily Information and Top-Down Affective Priming Jointly Affect the Processing of Fearful Faces

According to embodied theories, the processing of emotions such as happiness or fear is grounded in emotion-specific perceptual, bodily, and physiological processes. Under these views, perceiving an emotional stimulus (e.g., a fearful face) re-enacts interoceptive and bodily states congruent with that emotion (e.g., increases heart rate); and in turn, interoceptive and bodily changes (e.g., increases of heart rate) influence the processing of congruent emotional content. A previous study by Pezzulo et al. (2018) provided evidence for this embodied congruence, reporting that experimentally increasing heart rate with physical exercise facilitated the processing of facial expressions congruent with that interoception (fear), but not those conveying incongruent states (disgust or neutrality). Here, we investigated whether the above (bottom-up) interoceptive manipulation and the (top-down) priming of affective content may jointly influence the processing of happy and fearful faces. The fact that happiness and fear are both associated with high heart rate but have different (positive and negative) valence permits testing the hypothesis that their processing might be facilitated by the same interoceptive manipulation (the increase of heart rate) but two opposite (positive and negative) affective primes. To test this hypothesis, we asked participants to perform a gender-categorization task of happy, fearful, and neutral faces, which were preceded by positive, negative, and neutral primes. Participants performed the same task in two sessions (after rest, with normal heart rate, or exercise, with faster heart rate) and we recorded their response times and mouse movements during the choices. We replicated the finding that when participants were in the exercise condition, they processed fearful faces faster than when they were in the rest condition. However, we did not find the same reduction in response time for happy (or neutral) faces. Furthermore, we found that when participants were in the exercise condition, they processed fearful faces faster in the presence of negative compared to positive or neutral primes; but we found no equivalent facilitation of positive (or neutral) primes during the processing of happy (or neutral) faces. While the asymmetries between the processing of fearful and happy faces require further investigation, our findings promisingly indicate that the processing of fearful faces is jointly influenced by both bottom-up interoceptive states and top-down affective primes that are congruent with the emotion.

Faces and Sounds Becoming One: Cross-Modal Integration of Facial and Auditory Cues in Judging Trustworthiness

Face processing has mainly been investigated by presenting facial expressions without any contextual information. However, in everyday interactions with others, the sight of a face is often accompanied by contextual cues that are processed either visually or under different sensory modalities. Here, we tested whether the perceived trustworthiness of a face is influenced by the auditory context in which that face is embedded. In Experiment 1, participants evaluated trustworthiness from faces that were surrounded by either threatening or non-threatening auditory contexts. Results showed that faces were judged more untrustworthy when accompanied by threatening auditory information. Experiment 2 replicated the effect in a design that disentangled the effects of threatening contexts from negative contexts in general. Thus, perceiving facial trustworthiness involves a cross-modal integration of the face and the level of threat posed by the surrounding context.

The Bluegrass corpus: Audio-visual stimuli to investigate foreign accents

The Bluegrass corpus includes sentences from 40 pairs of speakers. Participants from the Bluegrass Region rated one speaker from each pair as having a native North American English accent and the other as having a foreign accent (Experiment 1). Furthermore, speakers within each pair looked very similar in appearance, in that participants rated them similarly likely to speak with a foreign accent (Experiment 2). For each speaker we selected eight sentences based on participants' ratings of difficulty (Experiment 3). The final corpus includes a selection of 640 sentences (80 speakers, 8 stimuli per speaker) freely available through the Open Science Framework. Each sentence can be downloaded in different formats (text, audio, video) so researchers can investigate how audio-visual information influences language processing. Researchers can contribute to the corpus by validating the stimuli with new populations, selecting additional sentences, or finding new TED videos featuring appropriate speakers to answer their research questions.

A method for estimating the time of initiating correct categorization in mouse-tracking

Mouse-tracking facilitates exploration of the mental processes underlying decision-making. As the cognitive system works to settle on a decision, response competition manifests in the motor movements of the hand, bringing the mouse relatively closer to one alternative versus the other. Many metrics provide insight into decision-making processes by indexing the shape or complexity of the mouse trajectory. Lacking, however, is a metric that estimates the point in time when a participant begins to correctly categorize a stimulus. We rectify this absence by introducing a metric we refer to as time of initiating correct categorization (TICC), which is the point in time when people began moving relatively closer to the selected target relative to the distractor. We briefly review existing approaches to measuring time in mouse-tracking before describing the TICC and demonstrating its utility in three data sets.

The cone method: Inferring decision times from single-trial 3D movement trajectories in choice behavior

Ongoing goal-directed movements can be rapidly adjusted following new environmental information, e.g., when chasing pray or foraging. This makes movement trajectories in go-before-you-know decision-making a suitable behavioral readout of the ongoing decision process. Yet, existing methods of movement analysis are often based on statistically comparing two groups of trial-averaged trajectories and are not easily applied to three-dimensional data, preventing them from being applicable to natural free behavior. We developed and tested the cone method to estimate the point of overt commitment (POC) along a single two- or three-dimensional trajectory, i.e., the position where the movement is adjusted towards a newly selected spatial target. In Experiment 1, we established a “ground truth” data set in which the cone method successfully identified the experimentally constrained POCs across a wide range of all but the shallowest adjustment angles. In Experiment 2, we demonstrate the power of the method in a typical decision-making task with expected decision time differences known from previous findings. The POCs identified by cone method matched these expected effects. In both experiments, we compared the cone method’s single trial performance with a trial-averaging method and obtained comparable results. We discuss the advantages of the single-trajectory cone method over trial-averaging methods and possible applications beyond the examples presented in this study. The cone method provides a distinct addition to existing tools used to study decisions during ongoing movement behavior, which we consider particularly promising towards studies of non-repetitive free behavior.

Tracking stress via the computer mouse? Promises and challenges of a potential behavioral stress marker

Computer mouse tracking offers a simple and cost-efficient way to gather continuous behavioral data and has mostly been utilized in psychological science to study cognitive processes. The present study extends the potential applicability of computer mouse tracking and investigates the feasibility of using computer mouse tracking for stress measurement. Drawing on first empirical results and theoretical considerations, we hypothesized that stress affects sensorimotor processes involved in mouse usage. To explore the relationship between stress and computer mouse usage, we conducted a between-participant field experiment in which N = 994 participants worked on four mouse tasks in a high-stress or low-stress condition. In the manipulation check, participants reported different stress levels between the two conditions. However, frequentist and machine learning data analysis approaches did not reveal a clear and systematic relationship between mouse usage and stress. These findings challenge the feasibility of using straightforward computer mouse tracking for generalized stress measurement.

Stereotypes bias face perception via orbitofrontal-fusiform cortical interaction

Previous research has shown that social-conceptual associations, such as stereotypes, can influence the visual representation of faces and neural pattern responses in ventral temporal cortex (VTC) regions, such as the fusiform gyrus (FG). Current models suggest that this social-conceptual impact requires medial orbitofrontal cortex (mOFC) feedback signals during perception. Backward masking can disrupt such signals, as it is a technique known to reduce functional connectivity between VTC regions and regions outside VTC. During functional magnetic resonance imaging (fMRI), subjects passively viewed masked and unmasked faces, and following the scan, perceptual biases and stereotypical associations were assessed. Multi-voxel representations of faces across the VTC, and in the FG and mOFC, reflected stereotypically biased perceptions when faces were unmasked, but this effect was abolished when faces were masked. However, the VTC still retained the ability to process masked faces and was sensitive to their categorical distinctions. Functional connectivity analyses confirmed that masking disrupted mOFC-FG connectivity, which predicted a reduced impact of stereotypical associations in the FG. Taken together, our findings suggest that the biasing of face representations in line with stereotypical associations does not arise from intrinsic processing within the VTC and FG alone, but instead it depends in part on top-down feedback from the mOFC during perception.

Tracking Prejudice: A Mouse-Tracking Measure of Evaluative Conflict Predicts Discriminatory Behavior

Explicit evaluations of racial out-groups often involve conflict between opposing evaluative tendencies. Yet this type of conflict is difficult to capture with standard measures of evaluative processing, which either ignore explicit evaluation or capture only the aspects of explicit evaluation that are consciously accessible and freely reported. A new tool may fill this gap in our ability to measure conflict in racial evaluation. This tool, called the mouse-tracking measure of racial bias (Race-MT), is designed to capture conflict in explicit evaluations of racial groups, even if that conflict is neither consciously accessible nor freely reported. We vetted the Race-MT by exploring whether it predicts discriminatory behavior. Across five studies (four preregistered, N = 1,492), we used the Race-MT to measure conflict in people’s positive, explicit evaluations of racial out-groups versus in-groups. These measures predicted discriminatory behavior in a noisy, naturalistic setting, suggesting that the Race-MT provides theoretically meaningful and predicatively useful insights into racial evaluation.

Tracking Response Dynamics of Sequential Working Memory in Patients With Mild Parkinson's Disease

The ability to sequence thoughts and actions is impaired in Parkinson’s disease (PD). In PD, a distinct error pattern has been found in the offline performance of sequential working memory. This study examined how PD’s performance of sequential working memory unfolds over time using mouse tracking techniques. Non-demented patients with mild PD (N = 40) and healthy controls (N = 40) completed a computerized digit ordering task with a computer mouse. We measured response dynamics in terms of the initiation time, ordering time, movement time, and area under the movement trajectory curve. This approach allowed us to distinguish between the cognitive processes related to sequence processing before the actual movement (initiation time and ordering time) and the execution processes of the actual movement (movement time and area under the curve). PD patients showed longer initiation times, longer movement times, and more constrained movement trajectories than healthy controls. The initiation time and ordering time negatively correlated with the daily exposure to levodopa and D2/3 receptor agonists, respectively. The movement time positively correlated with the severity of motor symptoms. We demonstrated an altered temporal profile of sequential working memory in PD. Stimulating D1 and D2/3 receptors might speed up the maintenance and manipulation of sequences, respectively.

Social connectedness and negative affect uniquely explain individual differences in response to emotional ambiguity

Negativity bias is not only central to mood and anxiety disorders, but can powerfully impact our decision-making across domains (e.g., financial, medical, social). This project builds on previous work examining negativity bias using dual-valence ambiguity. Specifically, although some facial expressions have a relatively clear negative (angry) or positive valence (happy), surprised expressions are interpreted negatively by some and positively by others, providing insight into one's valence bias. Here, we examine putative sources of variability that distinguish individuals with a more negative versus positive valence bias using structural equation modeling. Our model reveals that one's propensity toward negativity (operationalized as temperamental negative affect and internalizing symptomology) predicts valence bias particularly in older adulthood when a more positive bias is generally expected. Further, variability in social connectedness (a propensity to seek out social connections, use those connections to regulate one's own emotions, and be empathic) emerges as a notable and unique predictor of valence bias, likely because these traits help to override an initial, default negativity. We argue that this task represents an important approach to examining variability in affective bias, and can be specifically useful across the lifespan and in populations with internalizing disorders or even subclinical symptomology.

Detecting faking-good response style in personality questionnaires with four choice alternatives

Deliberate attempts to portray oneself in an unrealistic manner are commonly encountered in the administration of personality questionnaires. The main aim of the present study was to explore whether mouse tracking temporal indicators and machine learning models could improve the detection of subjects implementing a faking-good response style when answering personality inventories with four choice alternatives, with and without time pressure. A total of 120 volunteers were randomly assigned to one of four experimental groups and asked to respond to the Virtuous Responding (VR) validity scale of the PPI-R and the Positive Impression Management (PIM) validity scale of the PAI via a computer mouse. A mixed design was implemented, and predictive models were calculated. The results showed that, on the PIM scale, faking-good participants were significantly slower in responding than honest respondents. Relative to VR items, PIM items are shorter in length and feature no negations. Accordingly, the PIM scale was found to be more sensitive in distinguishing between honest and faking-good respondents, demonstrating high classification accuracy (80–83%).

Cognitive Processing of Miscommunication in Interactive Listening: An Evaluation of Listener Indecision and Cognitive Effort

Purpose The purpose of the current study was to evaluate the social and cognitive underpinnings of miscommunication during an interactive listening task. Method An eye and computer mouse-tracking visual-world paradigm was used to investigate how a listener's cognitive effort (local and global) and decision-making processes were affected by a speaker's use of ambiguity that led to a miscommunication. Results Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort (eye-tracking). Experiment 2 also indicated that listeners may develop different processing heuristics dependent upon the speaker's use of ambiguity that led to a miscommunication, exerting a significant impact on cognition and decision making. We also found that perspective-taking effort and decision-making complexity metrics (computer mouse tracking) predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Conclusion Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker.

How preference change induced by mere action versus inaction persists over time

Understanding how sustainable preference change can be achieved is of both scientific and practical importance. Recent work shows that merely responding or not responding to objects during go/no-go training can influence preferences for these objects right after the training, when people choose with a time limit. Here we examined whether and how such immediate preference change in fast choices can affect choices without time limit one week later. In two preregistered experiments, participants responded to go food items and withheld responses toward no-go food items during a go/no-go training. Immediately after the training, they made consumption choices for half of the items (with a time limit in Experiment 1; without time limit in Experiment 2). One week later, participants chose again (without time limit in both experiments). Half of the choices had been presented immediately after the training (repeated choices), while the other half had not (new choices). Participants preferred go over no-go items both immediately after the training and one week later. Furthermore, the effect was observed for both repeated and new choices after one week, revealing a direct effect of mere (non)responses on preferences one week later. Exploratory analyses revealed that the effect after one week is related to the memory of stimulus-response contingencies immediately after the training, and this memory is impaired by making choices. These findings show mere action versus inaction can directly induce preference change that lasts for at least one week, and memory of stimulus-response contingencies may play a crucial role in this effect.

The dynamic process of ambiguous emotion perception

Everyday social interactions hinge on our ability to resolve uncertainty in nonverbal cues. For example, although some facial expressions (e.g. happy, angry) convey a clear affective meaning, others (e.g. surprise) are ambiguous, in that their meaning is determined by the context. Here, we used mouse-tracking to examine the underlying process of resolving uncertainty. Previous work has suggested an initial negativity, in part via faster response times for negative than positive ratings of surprise. We examined valence categorizations of filtered images in order to compare faster (low spatial frequencies; LSF) versus more deliberate processing (high spatial frequencies; HSF). When participants categorised faces as "positive", they first exhibited a partial attraction toward the competing ("negative") response option, and this effect was exacerbated for HSF than LSF faces. Thus, the effect of response conflict due to an initial negativity bias was exaggerated for HSF faces, likely because these images allow for greater deliberation than the LSFs. These results are consistent with the notion that more positive categorizations are characterised by an initial attraction to a default, negative response.

Using mouse cursor tracking to investigate online cognition: Preserving methodological ingenuity while moving toward reproducible science

Mouse cursor tracking has become a prominent method for characterizing cognitive processes, used in a wide variety of domains of psychological science. Researchers have demonstrated considerable ingenuity in the application of the approach, but the methodology has not undergone systematic analysis to facilitate the development of best practices. Furthermore, recent research has demonstrated effects of experimental design features on a number of mousetracking outcomes. We conducted a systematic review of the mouse-tracking literature to survey the reporting and spread of mouse variables (Cursor speed, Sampling rate, Training), physical characteristics of the experiments (Stimulus position, Response box position) and response requirements (Start procedure, Response procedure, Response deadline). This survey reveals that there is room for improvement in reporting practices, especially of subtler design features that researchers may have assumed would not impact research results (e.g., Cursor speed). We provide recommendations for future best practices in mouse-tracking studies and consider how best to standardize the mouse-tracking literature without excessively constraining the methodological flexibility that is essential to the field.

Design choices: Empirical recommendations for designing two-dimensional finger-tracking experiments

The continuous tracking of mouse or finger movements has become an increasingly popular research method for investigating cognitive and motivational processes such as decision-making, action-planning, and executive functions. In the present paper, we evaluate and discuss how apparently trivial design choices of researchers may impact participants' behavior and, consequently, a study's results. We first provide a thorough comparison of mouse- and finger-tracking setups on the basis of a Simon task. We then vary a comprehensive set of design factors, including spatial layout, movement extent, time of stimulus onset, size of the target areas, and hit detection in a finger-tracking variant of this task. We explore the impact of these variations on a broad spectrum of movement parameters that are typically used to describe movement trajectories. Based on our findings, we suggest several recommendations for best practice that avoid some of the pitfalls of the methodology. Keeping these recommendations in mind will allow for informed decisions when planning and conducting future tracking experiments.

MatMouse: A Mouse Movements Tracking and Analysis Toolbox for Visual Search Experiments

The present study introduces a new MATLAB toolbox, called MatMouse, suitable for the performance of experimental studies based on mouse movements tracking and analysis. MatMouse supports the implementation of task-based visual search experiments. The proposed toolbox provides specific functions which can be utilized for the experimental building and mouse tracking processes, the analysis of the recorded data in specific metrics, the production of related visualizations, as well as for the generation of statistical grayscale heatmaps which could serve as an objective ground truth product. MatMouse can be executed as a standalone package or integrated in existing MATLAB scripts and/or toolboxes. In order to highlight the functionalities of the introduced toolbox, a complete case study example is presented. MatMouse is freely distributed to the scientific community under the third version of GNU General Public License (GPL v3) on GitHub platform.

Using dynamic monitoring of choices to predict and understand risk preferences

Navigating conflict is integral to decision-making, serving a central role both in the subjective experience of choice as well as contemporary theories of how we choose. However, the lack of a sensitive, accessible, and interpretable metric of conflict has led researchers to focus on choice itself rather than how individuals arrive at that choice. Using mouse-tracking-continuously sampling computer mouse location as participants decide-we demonstrate the theoretical and practical uses of dynamic assessments of choice from decision onset through conclusion. Specifically, we use mouse tracking to index conflict, quantified by the relative directness to the chosen option, in a domain for which conflict is integral: decisions involving risk. In deciding whether to accept risk, decision makers must integrate gains, losses, status quos, and outcome probabilities, a process that inevitably involves conflict. Across three preregistered studies, we tracked participants' motor movements while they decided whether to accept or reject gambles. Our results show that 1) mouse-tracking metrics of conflict sensitively detect differences in the subjective value of risky versus certain options; 2) these metrics of conflict strongly predict participants' risk preferences (loss aversion and decreasing marginal utility), even on a single-trial level; 3) these mouse-tracking metrics outperform participants' reaction times in predicting risk preferences; and 4) manipulating risk preferences via a broad versus narrow bracketing manipulation influences conflict as indexed by mouse tracking. Together, these results highlight the importance of measuring conflict during risky choice and demonstrate the usefulness of mouse tracking as a tool to do so.

The Influence of Emotional Visual Context on the Judgment of Face Trustworthiness

Background

Previous studies of face trustworthiness have often examined isolated face stimulus, ignoring the role of context.

Purpose

The current study used mouse-tracking technique and the seven-point Likert scale to examine the effect of emotional visual context on face trustworthiness judgment at the levels of the early evaluation process and final evaluation result.

Methods

Experiment 1 used mouse-tracking technique to study the impact of different contexts on the judgment of face trustworthiness at the early evaluation process. Experiment 2 used the seven-point Likert scale to study the effect of different contexts on the judgment of face trustworthiness at the final evaluation result.

Results

Experiment 1 found that when faces are embedded in threatening negative contexts, the mouse trajectories are more tortuous for trustworthy responses and straighter for untrustworthy responses than in neutral contexts. When faces are embedded in non-threatening negative contexts, the mouse trajectories are more tortuous for trustworthy responses but did not significantly differ for untrustworthy responses than in neutral contexts. When faces are embedded in positive contexts, the mouse trajectories are straighter for trustworthy responses and more tortuous for untrustworthy responses than in neutral contexts. Experiment 2 found that faces embedded in threatening and non-threatening negative contexts have lower scores and faces embedded in positive contexts have higher scores than in neutral contexts.

Conclusion

The results show that the emotional visual context significantly influences the judgment of face trustworthiness both at the levels of the early evaluation process and final evaluation result.

Social Judgments of Digitally Manipulated Stuttered Speech: Cognitive Heuristics Drive Implicit and Explicit Bias

Purpose People who stutter are susceptible to discrimination, stemming from negative stereotypes and social misattributions. There has been a recent push to evaluate the underlying explicit and implicit cognitive mechanisms associated with social judgments, moving away from only evaluating explicit social bias about people who stutter. The purpose of the current study was to evaluate how listeners change their implicit and explicit social (mis)attributions after hearing a people who stutter produce disfluent speech. Method The current project was an adaptation of the Byrd et al. (2017) study to evaluate listener implicit/explicit social judgments of stuttered speech across five categories (i.e., confidence, friendliness, intelligence, distractibility, and extroversion) before and after a stuttering self-disclosure. This was done by implementing a modified version of the Ferguson et al. (2019) computer mouse-tracking paradigm. Results Consistent with previous findings, participants made more explicit positive social judgments of confidence, friendliness, extroversion, and intelligence after a stuttering self-disclosure, but the distractedness category was resistant to change. Also consistent with previous findings, participants experienced a higher degree of cognitive competition (i.e., higher area under the curve) shortly after self-disclosure, which lessened over time. Conclusions Explicit and implicit biases exist, but self-disclosure significantly impacts the cognitive system of listeners. Specifically, self-disclosure may reduce explicit bias through experience and explicit belief updating, but when cognitive heuristics are strong, implicit bias may be slower to change.

Pre-exposure to Ambiguous Faces Modulates Top-Down Control of Attentional Orienting to Counterpredictive Gaze Cues

Understanding and reacting to others' nonverbal social signals, such as changes in gaze direction (i.e., gaze cue), are essential for social interactions, as it is important for processes such as joint attention and mentalizing. Although attentional orienting in response to gaze cues has a strong reflexive component, accumulating evidence shows that it can be top-down controlled by context information regarding the signals' social relevance. For example, when a gazer is believed to be an entity "with a mind" (i.e., mind perception), people exert more top-down control on attention orienting. Although increasing an agent's physical human-likeness can enhance mind perception, it could have negative consequences on top-down control of social attention when a gazer's physical appearance is categorically ambiguous (i.e., difficult to categorize as human or nonhuman), as resolving this ambiguity would require using cognitive resources that otherwise could be used to top-down control attention orienting. To examine this question, we used mouse-tracking to explore if categorically ambiguous agents are associated with increased processing costs (Experiment 1), whether categorically ambiguous stimuli negatively impact top-down control of social attention (Experiment 2), and if resolving the conflict related to the agent's categorical ambiguity (using exposure) would restore top-down control to orient attention (Experiment 3). The findings suggest that categorically ambiguous stimuli are associated with cognitive conflict, which negatively impact the ability to exert top-down control on attentional orienting in a counterpredicitive gaze-cueing paradigm; this negative impact, however, is attenuated when being pre-exposed to the stimuli prior to the gaze-cueing task. Taken together, these findings suggest that manipulating physical human-likeness is a powerful way to affect mind perception in human-robot interaction (HRI) but has a diminishing returns effect on social attention when it is categorically ambiguous due to drainage of cognitive resources and impairment of top-down control.

The dynamics of self-control: within-participant modeling of binary food choices and underlying decision processes as a function of restrained eating

Successful self-control during food choice might require inhibition of impulses to avoid indulging in tempting but calorie-dense foods, and this might particularly apply to individuals restraining their food intake. Adopting a novel within-participant modeling approach, we tested 62 females during a mouse-tracking based binary food choice task. Subsequent ratings of foods on palatability, healthiness, and calorie density were modeled as predictors for both decision outcome (choice) and decision process (measures of self-control conflict) while considering the moderating role of restrained eating. Results revealed that individuals higher on restrained eating were less likely to choose more high-calorie foods and showed less self-control conflict when choosing healthier foods. The latter finding is in contrast with the common assumption of self-control as requiring effortful and conscious inhibition of temptation impulses. Interestingly, restrained eaters rated healthy and low-calorie foods as more palatable than individuals with lower restrained eating scores, both in the main experiment and an independent replication study, hinting at an automatic and rather effortless mechanism of self-control (palatability shift) that obviates effortful inhibition of temptation impulses.

Cognitive dynamics of intertemporal choice in gambling disorder

Gambling Disorder (GD) is a behavioral addiction characterized by the persistence of recurrent gambling behaviors despite serious adverse consequences. One of the key features of GD is a marked inability to delay gratification and an overall impairment of decision-making mechanisms. Indeed, in intertemporal choice (ITC) tasks, GD patients usually display a marked tendency to prefer smaller-sooner over larger-later rewards (temporal discounting, TD). However, ITC represents a highly verbal/explicit measure, and as such it might not be sensitive to implicit decision biases. Here we sought to uncover the implicit mechanisms underlying the ITC impairment in GD by employing the process-tracing method of mouse kinematics. To this aim, we collected and analyzed ITCs and kinematics measures from 24 GD patients and 23 matched healthy control participants (HC). In line with the relevant literature, the results showed that GD patients discounted future rewards more steeply compared to HCs. Additionally, the results of kinematics analyses showed that patients were characterized by a strong bias toward the immediate option, which was associated with straight-line trajectories. Conversely, the delayed option was selected with edge-curved trajectories, indicating a bias toward the immediate option which was revised in later stages of processing. Interestingly, kinematics indices were also found to be predictive of individual discounting preferences (i.e., discount rates) across the two groups. Taken together, these results suggest that kinematics indices, by revealing hidden and implicit patterns of attraction toward the unselected choice option, may represent reliable behavioral markers of TD in gambling disorder.

Proactive and reactive control mechanisms in navigational search

Reactive and proactive cognitive control are fundamental for guiding complex human behaviour. In two experiments, we evaluated the role of both types of cognitive control in navigational search. Participants searched for a single hidden target in a floor array where the salience at the search locations varied (flashing or static lights). An a-priori rule of the probable location of the target (either under a static or a flashing light) was provided at the start of each experiment. Both experiments demonstrated a bias towards rule-adherent locations. Search errors, measured as revisits, were more likely to occur under the flashing rule for searching flashing locations, regardless of the salience of target location in Experiment 1 and at rule-congruent (flashing) locations in Experiment 2. Consistent with dual mechanisms of control, rule-adherent search was explained by engaging proactive control to guide goal-maintained search behaviour and by engaging reactive control to avoid revisits to salient (flashing) locations. Experiment 2 provided direct evidence for dual mechanisms of control using a Dot Pattern Expectancy task to distinguish the dominant control mode for a participant. Participants with a reactive control mode generated more revisits to salient (flashing) locations. These data point to complementary roles for proactive and reactive control in guiding navigational search and propose a novel framework for interpreting navigational search.

Looking with the (computer) mouse: How to unveil problem-solving strategies in matrix reasoning without eye-tracking

Problem-solving strategies in visual reasoning tasks are often studied based on the analysis of eye movements, which yields high-quality data but is costly and difficult to implement on a large scale. We devised a new graphical user interface for matrix reasoning tasks where the analysis of computer mouse movements makes it possible to investigate item exploration and, in turn, problem-solving strategies. While relying on the same active perception principles underlying eye-tracking (ET) research, this approach has the additional advantages of being user-friendly and easy to implement in real-world testing conditions, and records only voluntary decisions. A pilot study confirmed that embedding items of Raven's Advanced Progressive Matrices (APM) in the interface did not significantly alter its psychometric properties. Experiment 1 indicated that mouse-based exploration indices, when used to assess two major problem-solving strategies in the APM, are related to final performance-as has been found in past ET research. Experiment 2 suggested that constraining some features of the interface favored the adoption of the more efficient solving strategy for some participants. Overall, the findings support the relevance of the present methodology for accessing and manipulating problem-solving strategies.