Conflict in moral and nonmoral decision making: an empirical study coupled with a computational model

While moral psychology research has extensively studied decision making using moral dilemmas, such high-conflict situations may not fully represent all moral decisions. Moreover, most studies on the effect of conflict have focused on nonmoral decisions, and it is unclear how it applies to the moral realm. The present mixed-method research investigates how conflict impacts moral compared to nonmoral decision making. In a preregistered empirical study ( N = 42 ), participants made moral and nonmoral decisions with varying levels of conflict while their mouse trajectories were recorded. Results indicate that moral decisions were more stable in the presence of conflict, while still seeking compromise. In addition, decisions were more affected when conflict got higher. Mouse-tracking data further indicate that some factors are impacting the decision process earlier than others, supporting the relevance of tracing methods to dig into finer-grained decision dynamics. We also present a computational model that aims to capture decision mechanisms and how conflict and morality influence decision making. The model uses dynamic neural fields coupled with sensorimotor control to map a continuous decision space. Two model versions were compared: one with greater perceptual weight for moral information, and another with earlier processing of moral versus nonmoral information. The simulated data more successfully reproduced empirical patterns for the second version, thus providing insights into the underlying decision processes for both moral and nonmoral decisions, in the presence of conflict or not.

A Dress Is Not a Yes: Towards an Indirect Mouse-Tracking Measure of Men's Overreliance on Global Cues in the Context of Sexual Flirting

Assessing another person's intention to flirt and, relatedly, their sexual interest is based on the interpretation and weighting of global (e.g., clothing style) and specific (e.g., facial expression) cues. Since cue incongruency increases the risk of erroneous judgments and thus can entail undesirable outcomes for both parties involved, detection of an individual propensity for overly relying on global (sexual) rather than specific (affective) cues is of social and clinical-forensic importance. Using a purpose-designed and pre-validated stimulus set, we developed a mouse-tracking task as an indirect behavioral measure for males' overreliance on global cues (OGC) in the context of sexual flirting. In a convenience sample of heterosexual cisgender men (N = 79), experimentally induced sexual arousal was shown to increase the probability of OGC as a function of task difficulty (i.e., congruent or incongruent combinations of global and specific cues displayed by a potential female flirting partner). While error rate and reaction time proved to be indicators of OGC, the spatial measures maximum deviation and area under the curve provided less consistent results. In addition, error rate suggested sex drive and sexual objectification to act as moderators of the relationship between sexual arousal and OGC. Exploratory analysis further revealed a theoretically meaningful pattern of correlations between mouse-tracking measures and self-report measures of problematic (e.g., disinhibited, exploitative) sexuality. Implications of the results are discussed and a framework for differentiating potential causes of OGC (i.e., misperception, lack of self-control, and egocentric hedonism) is proposed.

Predicting Hand Movements With Distributional Semantics: Evidence From Mouse-Tracking

Although mouse-tracking has been taken as a real-time window on different aspects of human decision-making processes, whether purely semantic information affects response conflict at the level of motor output as measured through mouse movements is still unknown. Here, across two experiments, we investigated the effects of semantic knowledge by predicting participants' performance in a standard keyboard task and in a mouse-tracking task through distributional semantics, a usage-based modeling approach to meaning. In Experiment 1, participants were shown word pairs and were required to perform a two-alternative forced choice task selecting either the more abstract or the more concrete word, using standard keyboard presses. In Experiment 2, participants performed the same task, yet this time response selection was achieved by moving the computer mouse. Results showed that the involvement of semantic components in the task at hand is observable using both standard reaction times (Experiment 1) as well as using indexes extracted from mouse trajectories (Experiment 2). In particular, mouse trajectories reflected the response conflict and its temporal evolution, with a larger deviation for increasing word semantic relatedness. These findings support the validity of mouse-tracking as a method to detect deep and implicit decision-making features. Additionally, by demonstrating that a usage-based model of meaning can account for the different degrees of cognitive conflict associated with task achievement, these findings testify the impact of the human semantic memory on decision-making processes.

The temporal development of memory processes in source monitoring: An investigation with mouse tracking

The present study investigated whether we first remember an item (e.g., a word itself) and then its source (e.g., position on the screen) or whether the retrieval of item and source information can (partially) overlap. Participants were tested on the source either in immediate sequence to item recognition (as standard in source-monitoring research) or following as a separate block after full completion of the item recognition test to separate these processes in time, providing a baseline. Using the mouse-tracking procedure during the item and source tests, we analyzed how item and source decisions unfolded qualitatively over time. Despite no significant difference in the aggregated trajectory curvatures, more thorough analyses based on the individual trajectories revealed differences across the test formats. In the standard format, trajectories were less curved in the source than in the item test. In contrast, in the blocked format, this difference was in the other direction with source showing more curved trajectories than item. Alternative interpretations of mouse-trajectory curvatures on the source-monitoring paradigm and what their difference may imply for item and source processing are discussed.

Food induced distractibility in restrictive anorexia nervosa: Different motor patterns for different foods as revealed by a mouse tracker evaluation

An altered automatic processing of food stimuli may contribute to the maintenance of calorie restriction in patients with restrictive Anorexia Nervosa (AN-R). The present study aimed to assess whether task-irrelevant food distractors elicited a different interference effect in the motor actions of patients with AN-R compared to healthy controls (HC). 40 patients with acute AN-R and 40 HC performed an irrelevant distractor task in which they were required to perform a reaching movement from a starting point to a green dot, while an irrelevant distractor (a high-calorie food, low-calorie food, or neutral object) was presented in the middle of the screen. Mouse trajectories and response times (RT) were recorded. The analyses conducted on the kinematic variables revealed that while the trajectories of HC veered similarly toward the three categories of stimuli, AN-R patients showed an increased deviation toward low-calorie foods and a reduced deviation toward high-calorie foods compared to neutral objects. No significant results emerged as regards RT. The pattern of responses observed in patients with AN-R (deviation increased toward low-calorie and reduced toward high-calorie) is consistent with their eating habits and may thus represent an implicit mechanism sustaining calorie restriction in patients with AN-R.

(Mouse cursor)-Tracking food decisions in binge eating disorder reveals preference for high-energy foods and a role of BMI

Binge Eating Disorder (BED) has been associated with deficits in cognitive control and decision-making. Yet, no study has yet investigated the characteristics of food choice and the involved choice conflict in this disorder. In the present study individuals with BED (N = 22) and without BED (N = 61), with a body mass index (BMI) between 21 and 44 completed 153 binary food decisions among foods varying in palatability and energy density. To assess conflict during choice we recorded computer mouse paths and reaction times. Subsequently, participants rated all foods on liking and energy content. Finally, participants completed a bogus taste test with the same foods to measure actual consumption. Predictors were modelled continuously using Bayesian mixed-effects modelling. Individuals with BED liked foods with higher energy content more and chose them more often in the choice task. Yet, actual consumption in the taste test did not differ between groups, neither regarding total consumption, nor of foods with higher energy. Mouse cursor-tracking revealed that control participants with higher BMIs showed more choice conflict than those with lower BMIs. This pattern was reversed in those with BED. The high-energy preference in ratings and food choice represent the first evidence in a controlled laboratory context for disorder-congruent food choice in BED. The fact that this was not reflected in actual consumption might have methodological implications for measuring laboratory eating behaviour. Mouse cursor-tracking gave further insights into choice processes and showed a less conflicted food choice in those with BED with higher BMI compared to those with lower BMI.

A method for estimating the time of initiating correct categorization in mouse-tracking

Mouse-tracking facilitates exploration of the mental processes underlying decision-making. As the cognitive system works to settle on a decision, response competition manifests in the motor movements of the hand, bringing the mouse relatively closer to one alternative versus the other. Many metrics provide insight into decision-making processes by indexing the shape or complexity of the mouse trajectory. Lacking, however, is a metric that estimates the point in time when a participant begins to correctly categorize a stimulus. We rectify this absence by introducing a metric we refer to as time of initiating correct categorization (TICC), which is the point in time when people began moving relatively closer to the selected target relative to the distractor. We briefly review existing approaches to measuring time in mouse-tracking before describing the TICC and demonstrating its utility in three data sets.

Cognitive brakes in interference resolution: A mouse-tracking and EEG co-registration study

Cognitive control is particularly challenged when it is necessary to resolve interference and correct our behavior on-the-fly. To do this, it is necessary to inhibit the ongoing wrong action and reprogram a new motor plan as appropriate for the current task. This ability requires a complex interaction between cognitive and motor control. Here, we aimed at shedding light on this interplay. To do this, we administered a spatial version of the Stroop task comprising blocks with different Proportion Congruency (PC) manipulations (i.e., manipulating the percentage of congruent trials at 25%, 50% or 75%), to elicit different cognitive control demands. Moreover, we used two techniques with high-temporal resolution, as we simultaneously recorded EEG and mouse trajectories, that can be considered the real-time kinematic correlates of the ongoing cognitive processing. Specifically, we analyzed the Event Related Potentials (ERPs) locked to the peak deceleration time, which marks the suppression of ongoing erroneous trajectories, and we estimated their neural sources. We found three PC-dependent ERP components engaging distinct neural regions, which showed a reduction of the Stroop effect for low-PC blocks. By using a novel co-registration of mouse-trajectories and EEG, we suggest that the observed components may reflect different mechanisms engaged by reactive cognitive control to resolve the interference, including the suppression of an ongoing but no longer appropriate response, the selection of the new motor plan and its actual updating.

A 'no' with a trace of 'yes': A mouse-tracking study of negative sentence processing

There is strong evidence that comprehenders can parse sentences in an incremental fashion. However, when the sentence contains a negation, the evidence is less clear. Previous work has shown that increasing the pragmatic felicity of a negative sentence reduces or eliminates any processing overhead relative to affirmative sentences. However, in previous work felicity has gone hand-in-hand with the predictability of critical material in a sentence. In three experiments reported here, we presented equally felicitous sentences with critical material of varying predictability (operationalised as the number of possible completions) to test whether this might be a critical factor determining the ease with which partial sentences containing a negation are interpreted. Participants completed a truth-value judgement task (Experiment 1) or a sentence completion task (Experiments 2 and 3) after viewing a visual environment that provided the context for a test sentence, which could differ in truth value (in Experiment 1 only), polarity (affirmative or negative), and number of possible completions (one, two, or three). In all three experiments, we recorded response times and accuracy, but also response dynamics via participants' computer mouse trajectories, allowing us to test specific hypotheses about the time course of comprehension. Across all experiments, in conditions with one or two possible targets, we observed consistent detrimental effects of negative polarity, suggesting that the difficulty in processing negation cannot be reduced to effects relating to predictability or pragmatic felicity. We discuss this finding in relation to incremental and two-stage models of processing and outline a new account of the processing difficulty arising from negation in terms of a conflict between what is locally activated on the basis of individual words and phrases and the global meaning of a negative sentence.

Pragmatic processing: An investigation of the (anti-)presuppositions of determiners using mouse-tracking

A presupposition is a condition that has to be met in order for a linguistic expression to be appropriate. The definite determiner (as in the banana) triggers the uniqueness-presupposition that there is a uniquely identifiable banana in the relevant discourse context. The indefinite determiner (as in a banana) is similarly associated with anti-uniqueness (that there are several bananas). Application of the Maximize Presupposition principle to the indefinite determiner suggests that this latter effect results indirectly as an anti-presupposition from considering the uniqueness-presupposition of the definite determiner, which is then negated. This results in increased processing difficulty. We utilized mouse-tracking to compare processing of definite and indefinite determiners when used felicitously and infelicitously in a particular context. First, processing of the indefinite determiner was associated with more processing difficulties compared with the definite determiner. Second, we also observed evidence for an initial temporary activation and evaluation of the uniqueness-presupposition, just as derived from anti-presupposition theory and the Maximize Presupposition principle.

Open-source software for mouse-tracking in Qualtrics to measure category competition

Mouse-tracking is a sophisticated tool for measuring rapid, dynamic cognitive processes in real time, particularly in experiments investigating competition between perceptual or cognitive categories. We provide user-friendly, open-source software (https://osf.io/st2ef/) for designing and analyzing such experiments online using the Qualtrics survey platform. The software consists of a Qualtrics template with embedded JavaScript and CSS along with R code to clean, parse, and analyze the data. No special programming skills are required to use this software. As we discuss, this software could be readily modified for use with other online survey platforms that allow the addition of custom JavaScript. We empirically validate the provided software by benchmarking its performance on previously tested stimuli (android robot faces) in a category-competition experiment with realistic crowdsourced data collection.

Design factors in mouse-tracking: What makes a difference?

Investigating cognitive processes by analyzing mouse movements has become a popular method in many psychological disciplines. When creating mouse-tracking experiments, researchers face many design choices-for example, whether participants indicate responses by clicking a button or just by entering the button area. Hitherto, numerous different settings have been employed, but little is known about how these methodological differences affect mouse-tracking data. We systematically investigated the influences of three central design factors, using a classic mouse-tracking paradigm in which participants classified typical and atypical exemplars. In separate experiments, we manipulated the response indication, mouse sensitivity, and starting procedure. The core finding that mouse movements deviate more toward the nonchosen option for atypical exemplars was replicated in all conditions. However, the size of this effect varied. Specifically, it was larger when participants indicated responses via click and when they were instructed to initialize the movement early. Trajectory shapes also differed between setups. For example, a dynamic start led to mostly curved trajectories, responses via click led to a mix of straight and "change-of-mind" trajectories, and responses via touch led to mostly straight trajectories. Moreover, the distribution of curvature indices was classified as bimodal in some setups and as unimodal in others. Because trajectory curvature and shape are frequently used to make inferences about psychological theories, such as differentiating between dynamic and dual-system models, this study shows that the specific design must be carefully considered when drawing theoretical inferences. All methodological designs and analyses were implemented using open-source software and are available from https://osf.io/xdp7a/.

Stuck at the starting line: How the starting procedure influences mouse-tracking data

Mouse-tracking is an increasingly popular method to trace cognitive processes. As is common for a novel method, the exact methodological procedures employed in an individual study are still relatively idiosyncratic and the effects of different methodological setups on mouse-tracking measures have not been explored so far. Here, we study the impact of one commonly occurring methodological variation, namely whether participants have to initiate their mouse movements to trigger stimulus presentation (dynamic starting condition) or whether the stimulus is presented automatically after a fixed delay and participants can freely decide when to initiate their movements (static starting condition). We compared data from a previous study in which participants performed a mouse-tracking version of a Simon task with a dynamic starting condition to data from a new study that employed a static starting condition in an otherwise identical setup. Results showed reliable Simon effects and Congruency Sequence effects on response time (RT) and discrete trial-level mouse-tracking measures (i.e., average deviation) in both starting conditions. In contrast, within-trial continuous measures (i.e., extracted temporal segments) were weaker and occurred in a more temporally compressed way in the static compared to the dynamic starting condition. This was in line with generally less consistent movements within and across participants in the static compared to the dynamic condition. Our results suggest that studies that use within-trial continuous measures to assess dynamic aspects of mouse movements should apply dynamic starting procedures to enhance the leakage of cognitive processing into the mouse movements.

Simultaneous EEG, eye-tracking, behavioral, and screen-capture data during online German language learning

This article presents concurrent multimodal data, including EEG, eye-tracking, and behavioral data (cursor movements and clicks), acquired from individuals (N = 22) while engaging in several German language lessons using the web-based Duolingo interface. Lessons were restricted to visual learning only (excluding audio and speech components), including reading and writing vocabulary words and sentences, and matching vocabulary to images. EEG data was collected using the open-source OpenBCI device utilizing dry Ag-AgCl electrodes, while eye-tracking data was recorded using the Gazepoint GP3 system. Timestamped screen captures associated with mouse click and keypress events and user behavior (cursor movements) were acquired using AutoHotKey macro scripts. These data provide neural (EEG), gaze (eye-tracking), and behavioral (mouse movements, clicks, and keypresses) data, with respect to presented language-learning media (Duolingo screen captures) for a wide range of possible scientific analyses and methods development.

Dynamic competition account of men's perceptions of women's sexual interest

This work applies a dynamic competition framework of decision making to the domain of sexual perception, which is linked theoretically and empirically to college men's risk for exhibiting sexual coercion and aggression toward female acquaintances. Within a mouse-tracking paradigm, 152 undergraduate men viewed full-body photographs of women who varied in affect (sexual interest or rejection), clothing style (provocative or conservative), and attractiveness, and decided whether each woman currently felt sexually interested or rejecting. Participants' mouse movements were recorded to capture competition dynamics during online processing (throughout the decisional process), and as an index of the final categorical decision (endpoint of the decisional process). Participants completed a measure of Rape-Supportive Attitudes (RSA), a well-established correlate of male-initiated sexual aggression toward female acquaintances. Mixed-effects analyses revealed greater curvature toward the incorrect response on conceptually incongruent trials (e.g., rejecting and dressed provocatively) than on congruent trials (e.g., rejecting and dressed conservatively). This suggests that the two decision alternatives are simultaneously active and compete continuously over time, consistent with a dynamic competition account. Congruence effects also emerged at the decisional endpoint; accuracy was typically lower when stimulus features were incongruent, rather than congruent. RSA potentiated online congruence effects (intermediate states of behavior) but not offline congruence effects (endpoint states of behavior). In a hierarchical regression analysis, online processing indices accounted for unique variability in RSA above and beyond offline accuracy rates. The process-based account of men's sexual-interest judgments ultimately may point to novel targets for prevention strategies designed to reduce acquaintance-initiated sexual aggression on college campuses.

The hand in motion of liberals and conservatives reveals the differential processing of positive and negative information

Recent research revealed that political conservatives and liberals differ in the processing of valenced information. In particular, conservatives (vs. liberals) tend to weigh negative information more than positive information in their perception of the physical and social world. In the present work, we further investigated the ideology-based asymmetries in the processing of negative and positive information examining both the attention-grabbing power of negative information and the trajectories of the movements performed by respondents when required to categorize positive and negative stimuli. To this end we employed a modified version of the Mouse-Tracking procedure (Freeman & Ambady, 2010), recording hand movements during the execution of categorization tasks. Results showed that conservatives were indeed slower to start and execute response actions to negative stimuli, and, more specifically, the trajectories of their movements signaled avoidance tendencies aimed at increasing the distance from negative stimuli. In addition, this pattern of findings emerged both when participants were asked to categorize the stimuli according to their valence and when the same stimuli had to be categorized on the basis of irrelevant perceptual features. Overall, results demonstrate that conservatives and liberals process valenced information differently, perform different spontaneous movements when exposed to them, and that such asymmetries are largely independent from current processing goals.

Healthy eating decisions require efficient dietary self-control in children: A mouse-tracking food decision study

Learning how to make healthy eating decisions, (i.e., resisting unhealthy foods and consuming healthy foods), enhances physical development and reduces health risks in children. Although healthy eating decisions are known to be challenging for children, the mechanisms of children's food choice processes are not fully understood. The present study recorded mouse movement trajectories while eighteen children aged 8-13 years were choosing between eating and rejecting foods. Children were inclined to choose to eat rather than to reject foods, and preferred unhealthy foods over healthy foods, implying that rejecting unhealthy foods could be a demanding choice. When children rejected unhealthy foods, mouse trajectories were characterized by large curvature toward an eating choice in the beginning, late decision shifting time toward a rejecting choice, and slowed response times. These results suggested that children exercised greater cognitive efforts with longer decision times to resist unhealthy foods, providing evidence that children require dietary self-control to make healthy eating-decisions by resisting the temptation of unhealthy foods. Developmentally, older children attempted to exercise greater cognitive efforts for consuming healthy foods than younger children, suggesting that development of dietary self-control contributes to healthy eating-decisions. The study also documents that healthy weight children with higher BMIs were more likely to choose to reject healthy foods. Overall, findings have important implications for how children make healthy eating choices and the role of dietary self-control in eating decisions.

When expectancies collide: Action dynamics reveal the interaction between stimulus plausibility and congruency

The cognitive architecture routinely relies on expectancy mechanisms to process the plausibility of stimuli and establish their sequential congruency. In two computer mouse-tracking experiments, we use a cross-modal verification task to uncover the interaction between plausibility and congruency by examining their temporal signatures of activation competition as expressed in a computer- mouse movement decision response. In this task, participants verified the content congruency of sentence and scene pairs that varied in plausibility. The order of presentation (sentence-scene, scene-sentence) was varied between participants to uncover any differential processing. Our results show that implausible but congruent stimuli triggered less accurate and slower responses than implausible and incongruent stimuli, and were associated with more complex angular mouse trajectories independent of the order of presentation. This study provides novel evidence of a disassociation between the temporal signatures of plausibility and congruency detection on decision responses.

Response trajectories reveal the temporal dynamics of fraction representations

Previous studies on mental arithmetic with fractions have been equivocal with respect to the nature of mental representations that are formed with fractions. It is not clear from present evidence whether fractions form perceptual primitives independent from components or whether component magnitudes must be processed in addition to the holistic magnitude. In the present study, we attempt to resolve this issue by using computer mouse-tracking. We analyzed the dynamics of participants' hand movements as they compared presented fractions to 1/2. We found that before settling to the correct answer, hand trajectories showed competitive influences of component magnitude and overall fraction magnitude, but the influence of components happened much earlier. These data support the idea that in fraction comparison, component magnitudes and holistic magnitude are processed together in a continuous, competitive manner.

The neural basis of stereotypic impact on multiple social categorization

Perceivers extract multiple social dimensions from another's face (e.g., race, emotion), and these dimensions can become linked due to stereotypes (e.g., Black individuals → angry). The current research examined the neural basis of detecting and resolving conflicts between top-down stereotypes and bottom-up visual information in person perception. Participants viewed faces congruent and incongruent with stereotypes, via variations in race and emotion, while neural activity was measured using fMRI. Hand movements en route to race/emotion responses were recorded using mouse-tracking to behaviorally index individual differences in stereotypical associations during categorization. The medial prefrontal cortex (mPFC) and anterior cingulate cortex (ACC) showed stronger activation to faces that violated stereotypical expectancies at the intersection of multiple social categories (i.e., race and emotion). These regions were highly sensitive to the degree of incongruency, exhibiting linearly increasing responses as race and emotion became stereotypically more incongruent. Further, the ACC exhibited greater functional connectivity with the lateral fusiform cortex, a region implicated in face processing, when viewing stereotypically incongruent (relative to congruent) targets. Finally, participants with stronger behavioral tendencies to link race and emotion stereotypically during categorization showed greater dorsolateral prefrontal cortex activation to stereotypically incongruent targets. Together, the findings provide insight into how conflicting stereotypes at the nexus of multiple social dimensions are resolved at the neural level to accurately perceive other people.