MouseTracker: software for studying real-time mental processing using a computer mouse-tracking method

Resisting Temptation: Tracking How Self-Control Conflicts Are Successfully Resolved in Real Time

Across four studies, we used mouse tracking to identify the dynamic, on-line cognitive processes that underlie successful self-control decisions. First, we showed that individuals display real-time conflict when choosing options consistent with their long-term goal over short-term temptations. Second, we found that individuals who are more successful at self-control-whether measured or manipulated-show significantly less real-time conflict in only self-control-relevant choices. Third, we demonstrated that successful individuals who choose a long-term goal over a short-term temptation display movements that are smooth rather than abrupt, which suggests dynamic rather than stage-based resolution of self-control conflicts. These findings have important implications for contemporary theories of self-control.

Reversing the Manual Digit Bias in Two-Digit Number Comparison

Though recent work in numerical cognition has supported a strong tie between numerical and spatial representations (e.g., a mental number line), less is known about such ties in multi-digit number representations. Along this line, Bloechle, Huber, and Moeller (2015) found that pointing positions in two-digit number comparison were biased leftward toward the decade digit. Moreover, this bias was reduced in unit-decade incompatible pairs. In the present study, we tracked computer mouse movements as participants compared two-digit numbers to a fixed standard (55). Similar to Bloechle et al. (2015) , we found that trajectories exhibited a leftward bias that was reduced for unit-decade incompatible comparisons. However, when positions of response labels were reversed, the biases reversed. That is, we found a rightward bias for compatible pairs that was reduced for incompatible pairs. This result calls into question a purely embodied representation of place value structure and instead supports a competition model of two-digit number representation.

The role of attention in subliminal semantic processing: A mouse tracking study

Recent evidence suggests that top-down attention facilitates unconscious semantic processing. To clarify the role of attention in unconscious semantic processing, we traced trajectories of the computer mouse in a semantic priming task and scrutinized the extent to which top-down attention enhances unconscious semantic processing in four different stimulus-onset asynchrony (SOA: 50, 200, 500, or 1000ms) conditions. Participants judged whether a target digit (e.g., “6”) was larger or smaller than five, preceded by a masked priming digit (e.g., “9”). The pre-prime duration changed randomly from trial to trial to disrupt participants’ top-down attention in an uncued condition (in a cued condition, a green square cue was presented to facilitate participants’ top-down attention). The results show that top-down attention modifies the time course of subliminal semantic processing, and the temporal attention window lasts more than 1000ms; attention facilitated by the cue may amplify semantic priming to some extent, yet the amplification effect of attention is relatively minor.

Trajectory curvature in saccade sequences: spatiotopic influences vs. residual motor activity

When decisions drive saccadic eye movements, traces of the decision process can be inferred from the movement trajectories. For example, saccades can curve away from distractor stimuli, which was thought to reflect cortical inhibition biasing activity in the superior colliculus. Recent neurophysiological work does not support this theory, and two recent models have replaced top-down inhibition with lateral interactions in the superior colliculus or neural fatigue in the brainstem saccadic burst generator. All current models operate in retinotopic coordinates and are based on single saccade paradigms. To extend these models to sequences of saccades, we assessed whether and how saccade curvature depends on previously fixated locations and the direction of previous saccades. With a two-saccade paradigm, we first demonstrated that second saccades curved away from the initial fixation stimulus. Furthermore, by varying the time from fixation offset and the intersaccadic duration, we distinguished the extent of curvature originating from the spatiotopic representation of the previous fixation location or residual motor activity of the previous saccade. Results suggest that both factors drive curvature, and we discuss how these effects could be implemented in current models. In particular, we propose that the collicular retinotopic maps receive an excitatory spatiotopic update from the lateral interparial region.NEW & NOTEWORTHY Saccades curve away from locations of previous fixation. Varying stimulus timing demonstrates the effects of both 1) spatiotopic representation and 2) motor residual activity from previous saccades. The spatiotopic effect can be explained if current models are augmented with an excitatory top-down spatiotopic signal.

Intonation and Pragmatic Enrichment: How Intonation Constrains Ad Hoc Scalar Inferences

Pragmatic inferences require listeners to use alternatives to arrive at the speaker's intended meaning. Previous research has shown that intonation interacts with alternatives but not how it does so. We present two mouse tracking experiments that test how pitch accents affect the processing of ad hoc scalar implicatures in English. The first shows that L+H* accents facilitate implicatures relative to H* accents. The second replicates this finding and demonstrates that the facilitation is caused by early derivation of the implicature in the L+H* condition. We attribute the effect to a link between L+H* and pragmatic considerations, such as speaker knowledge effects, or the saliency of alternatives relevant to the computation of implicatures. More generally our findings illustrate how intonation interacts at a cognitive level with pragmatic inference.

The detection of faked identity using unexpected questions and mouse dynamics

The detection of faked identities is a major problem in security. Current memory-detection techniques cannot be used as they require prior knowledge of the respondent’s true identity. Here, we report a novel technique for detecting faked identities based on the use of unexpected questions that may be used to check the respondent identity without any prior autobiographical information. While truth-tellers respond automatically to unexpected questions, liars have to “build” and verify their responses. This lack of automaticity is reflected in the mouse movements used to record the responses as well as in the number of errors. Responses to unexpected questions are compared to responses to expected and control questions (i.e., questions to which a liar also must respond truthfully). Parameters that encode mouse movement were analyzed using machine learning classifiers and the results indicate that the mouse trajectories and errors on unexpected questions efficiently distinguish liars from truth-tellers. Furthermore, we showed that liars may be identified also when they are responding truthfully. Unexpected questions combined with the analysis of mouse movement may efficiently spot participants with faked identities without the need for any prior information on the examinee.

A Neural Mechanism of Social Categorization

Humans readily sort one another into multiple social categories from mere facial features. However, the facial features used to do so are not always clear-cut because they can be associated with opponent categories (e.g., feminine male face). Recently, computational models and behavioral studies have provided indirect evidence that categorizing such faces is accomplished through dynamic competition between parallel, coactivated social categories that resolve into a stable categorical percept. Using a novel paradigm combining fMRI with real-time hand tracking, the present study examined how the brain translates diverse social cues into categorical percepts. Participants (male and female) categorized faces varying in gender and racial typicality. When categorizing atypical faces, participants' hand movements were simultaneously attracted toward the unselected category response, indexing the degree to which such faces activated the opposite category in parallel. Multivoxel pattern analyses (MVPAs) provided evidence that such social category coactivation manifested in neural patterns of the right fusiform cortex. The extent to which the hand was simultaneously attracted to the opposite gender or race category response option corresponded to increased neural pattern similarity with the average pattern associated with that category, which in turn associated with stronger engagement of the dorsal anterior cingulate cortex. The findings point to a model of social categorization in which occasionally conflicting facial features are resolved through competition between coactivated ventral-temporal cortical representations with the assistance of conflict-monitoring regions. More broadly, the results offer a promising multimodal paradigm to investigate the neural basis of "hidden", temporarily active representations in the service of a broad range of cognitive processes.SIGNIFICANCE STATEMENT Individuals readily sort one another into social categories (e.g., sex, race), which have important consequences for a variety of interpersonal behaviors. However, individuals routinely encounter faces that contain diverse features associated with multiple categories (e.g., feminine male face). Using a novel paradigm combining neuroimaging with hand tracking, the present research sought to address how the brain comes to arrive at stable social categorizations from multiple social cues. The results provide evidence that opponent social categories coactivate in face-processing regions, which compete and may resolve into an eventual stable categorization with the assistance of conflict-monitoring regions. Therefore, the findings provide a neural mechanism through which the brain may translate inherently diverse social cues into coherent categorizations of other people.

Bilingualism and age are continuous variables that influence executive function

We analyzed the effects of bilingualism and age on executive function. We examined these variables along a continuum, as opposed to dichotomizing them. We investigated the impact that bilingualism and age have on two measures of executive control (Stroop and Flanker). The mouse-tracking paradigm allowed us to examine the continuous dynamics of the responses as participants completed each trial. First, we found that the Stroop effect was reduced with younger age and higher levels of bilingualism; however, no Bilingualism by Age interaction emerged. Second, after controlling for baseline, the Flanker effect was not influenced by bilingualism or age. These results support the notion that bilingualism is one way of enhancing some aspects of executive function - specifically those related to the Stroop task - across the adult life span. In sum, different levels of bilingualism, and different ages, result in varying degrees of executive function as measured by the Stroop task.

Looking the part (to me): effects of racial prototypicality on race perception vary by prejudice

Less racially prototypic faces elicit more category competition during race categorization. Top-down factors (e.g. stereotypes), however, affect categorizations, suggesting racial prototypicality may enhance category competition in certain perceivers. Here, we examined how prejudice affects race category competition and stabilization when perceiving faces varying in racial prototypicality. Prototypically low vs high Black relative to White faces elicited more category competition and slower response latencies during categorization (Experiment 1), suggesting a pronounced racial prototypicality effect on minority race categorization. However, prejudice predicted the extent of category competition between prototypically low vs high Black faces. Suggesting more response conflict toward less prototypic Black vs White faces, anterior cingulate cortex activity increased toward Black vs White faces as they decreased in racial prototypicality, with prejudice positively predicting this difference (Experiment 2). These findings extend the literature on racial prototypicality and categorization by showing that relative prejudice tempers the extent of category competition and response conflict engaged when initially perceiving faces.

Finger Tracking Reveals the Covert Stages of Mental Arithmetic

We introduce a novel method capable of dissecting the succession of processing stages underlying mental arithmetic, thus revealing how two numbers are transformed into a third. We asked adults to point to the result of single-digit additions and subtractions on a number line, while their finger trajectory was constantly monitored. We found that the two operands are processed serially: the finger first points toward the larger operand, then slowly veers toward the correct result. This slow deviation unfolds proportionally to the size of the smaller operand, in both additions and subtractions. We also observed a transient operator effect: a plus sign attracted the finger to the right and a minus sign to the left and a transient activation of the absolute value of the subtrahend. These findings support a model whereby addition and subtraction are computed by a stepwise displacement on the mental number line, starting with the larger number and incrementally adding or subtracting the smaller number.

Hierarchical Brain Systems Support Multiple Representations of Valence and Mixed Affect

We review the psychological literature on the organization of valence, discussing theoretical perspectives that favor a single dimension of valence, multiple valence dimensions, and positivity and negativity as dynamic and flexible properties of mental experience that are contingent upon context. Turning to the neuroscience literature that spans three levels of analysis, we discuss how positivity and negativity can be represented in the brain. We show that the evidence points toward both separable and overlapping brain systems that support affective processes depending on the level of resolution studied. We move from large-scale brain networks that underlie generalized processing, to functionally specific subcircuits, finally to intraregional neuronal distributions, where the organization and interaction across levels allow for multiple types of valence and mixed evaluations.

Sentence context influences the subjective perception of foreign accents

We examined whether sentence context (the predictability of the final word) influences listeners' ratings of foreign-accented words. Previous work has demonstrated that accent manipulations affect listeners' processing of spoken language. We examined the converse of this relationship; whether context manipulations affect listeners' perceptions of accents. If there is a bidirectional relationship, listeners should be more likely to rate an accent as strong when the accented word is not predicted by the sentence. In Experiment 1, the results revealed that participants were significantly more likely to rate words spoken by foreign-accented speakers as "Strong Accent" in the unpredictable sentences when compared to the predictable sentences. Moreover, in Experiment 2, this effect was replicated and extended to a native speaker. These results support the idea that there is a bidirectional relationship between language processing and perceptions of accents. We discuss the practical implications for foreign-accented speakers.

Social Threat and Motor Resonance: When a Menacing Outgroup Delays Motor Response

Motor resonance (MR) involves the activation of matching motor representations while observing others' actions. Recent research has shown that such a phenomenon is likely to be influenced by higher order variables such as social factors (e.g., ethnic group membership). The present study investigates whether and how the perception of a social threat elicited by an outgroup member and by contextual cues can modulate motor responses while an individual observes others' movements. In an experimental study based on an action observation paradigm, we asked participants to provide answers through computer mouse movements (MouseTracker). We manipulated the agents' group membership (ingroup vs. outgroup) and the social valence of the objects present in a context (neutral vs. threatening) to elicit social menace through contextual cues. Response times and computer mouse trajectories were recorded. The results show a higher level of MR (i.e., participants started to respond earlier and were faster at responding) when observing an action performed by the ingroup members rather than by the outgroup members only when threatening objects are present in a given context. Participants seem to resonate better with their ingroup; conversely, the outgroup member movements tend to delay motor responses. Therefore, we extend prior research going beyond the general ingroup bias effect on MR and showing that the interaction between membership and contextual cues is likely to elicit threat-related stereotypes. Practical implications of these findings are discussed.

Differential effects of cognitive load on subjective versus motor responses to ambiguously valenced facial expressions

Valence is a principal dimension by which we understand emotional experiences, but oftentimes events are not easily classified as strictly positive or negative. Inevitably, individuals vary in how they tend to interpret the valence of ambiguous situations. Surprised facial expressions are one example of a well-defined, ambiguous affective event that induces trait-like differences in the propensity to form a positive or negative interpretation. To investigate the nature of this affective bias, we asked participants to organize emotional facial expressions (surprised, happy, sad) into positive/negative categories while recording their hand-movement trajectories en route to each response choice. We found that positivity-negativity bias resulted in differential hand movements for modal versus nonmodal response trajectories, such that when an individual categorized a surprised face according to his or her nonmodal interpretation (e.g., a negatively biased individual selecting a positive interpretation), the hand showed an enhanced spatial attraction to the alternative, modal response option (e.g., negative) in the opposite corner of the computer screen (Experiment 1). Critically, we also demonstrate that this asymmetry between modal versus nonmodal response trajectories is mitigated when the valence interpretations are made under a cognitive load, although the frequency of modal interpretations is unaffected by the load (Experiment 2). These data inform a body of seemingly disparate findings regarding the effect of cognitive effort on affective responses, by showing within a single paradigm that varying cognitive load selectively alters the dynamic motor movements involved in indicating affective interpretations, whereas the subjective interpretations themselves remain consistent across variable cognitive loads. (PsycINFO Database Record

The effects of perceived USB-delay for sensor and embedded system development

Perceiving delay in computer input devices is a problem which gets even more eminent when being used in healthcare applications and/or in small, embedded systems. Therefore, the amount of delay found as acceptable when using computer input devices was investigated in this paper. A device was developed to perform a benchmark test for the perception of delay. The delay can be set from 0 to 999 milliseconds (ms) between a receiving computer and an available USB-device. The USB-device can be a mouse, a keyboard or some other type of USB-connected input device. Feedback from performed user tests with 36 people form the basis for the determination of time limitations for the USB data processing in microprocessors and embedded systems without users' noticing the delay. For this paper, tests were performed with a personal computer and a common computer mouse, testing the perception of delays between 0 and 500 ms. The results of our user tests show that perceived delays up to 150 ms were acceptable and delays larger than 300 ms were not acceptable at all.

The hand in motion of liberals and conservatives reveals the differential processing of positive and negative information

Recent research revealed that political conservatives and liberals differ in the processing of valenced information. In particular, conservatives (vs. liberals) tend to weigh negative information more than positive information in their perception of the physical and social world. In the present work, we further investigated the ideology-based asymmetries in the processing of negative and positive information examining both the attention-grabbing power of negative information and the trajectories of the movements performed by respondents when required to categorize positive and negative stimuli. To this end we employed a modified version of the Mouse-Tracking procedure (Freeman & Ambady, 2010), recording hand movements during the execution of categorization tasks. Results showed that conservatives were indeed slower to start and execute response actions to negative stimuli, and, more specifically, the trajectories of their movements signaled avoidance tendencies aimed at increasing the distance from negative stimuli. In addition, this pattern of findings emerged both when participants were asked to categorize the stimuli according to their valence and when the same stimuli had to be categorized on the basis of irrelevant perceptual features. Overall, results demonstrate that conservatives and liberals process valenced information differently, perform different spontaneous movements when exposed to them, and that such asymmetries are largely independent from current processing goals.

Healthy eating decisions require efficient dietary self-control in children: A mouse-tracking food decision study

Learning how to make healthy eating decisions, (i.e., resisting unhealthy foods and consuming healthy foods), enhances physical development and reduces health risks in children. Although healthy eating decisions are known to be challenging for children, the mechanisms of children's food choice processes are not fully understood. The present study recorded mouse movement trajectories while eighteen children aged 8-13 years were choosing between eating and rejecting foods. Children were inclined to choose to eat rather than to reject foods, and preferred unhealthy foods over healthy foods, implying that rejecting unhealthy foods could be a demanding choice. When children rejected unhealthy foods, mouse trajectories were characterized by large curvature toward an eating choice in the beginning, late decision shifting time toward a rejecting choice, and slowed response times. These results suggested that children exercised greater cognitive efforts with longer decision times to resist unhealthy foods, providing evidence that children require dietary self-control to make healthy eating-decisions by resisting the temptation of unhealthy foods. Developmentally, older children attempted to exercise greater cognitive efforts for consuming healthy foods than younger children, suggesting that development of dietary self-control contributes to healthy eating-decisions. The study also documents that healthy weight children with higher BMIs were more likely to choose to reject healthy foods. Overall, findings have important implications for how children make healthy eating choices and the role of dietary self-control in eating decisions.

Mouse tracking traces the "Camrbidge Unievrsity" effects in monolingual and bilingual minds

Previous monolingual studies have consistently suggested that there was flexibility of letter position encoding in different alphabetic writing systems. This robust letter transposition was named the "Cambridge University" effect. However, to date whether the orthographic neighborhood and cross-language script similarity would modulate the magnitude of the Cambridge University effect during the second-language word recognition in bilingual minds was unknown. We address this question using a mouse-tracking experimental paradigm to trace the internal lexical matching processes underlying the lexical access. Our linear mixed effects models and growth curve analyses revealed that a low orthographic neighborhood can trigger a large magnitude of the Cambridge University effect for monolinguals and bilinguals on their hand trajectories. We also found that different-script bilinguals (Chinese-English bilinguals) exhibited a greater Cambridge University effect than similar-script bilinguals (Spanish-English bilinguals) and English monolinguals. The findings offer compelling evidence that a human lexical match criterion of recognition system can be modified by neighborhood density and cross-language script similarity of readers.

The influence of memory on indoor environment exploration: A numerical study

Understanding human behavior in the context of exploration and navigation is an important but challenging problem. Such understanding can help in the design of safe structures and spaces that implicitly aid humans during evacuation or other emergency situations. In particular, the role that memory plays in this process is something that is crucial to understand. In this paper, we develop a novel serious game-based experimental approach to understanding the non-randomness and the impact of memory on the human exploration process. We show that a simple memory model, with a depth of between 6 and 8 steps, is sufficient to approximate a 'human-like' level of exploration efficiency. We also demonstrate the advantages that a game-based experimental methodology brings to these kinds of experiments in the amount of data that can be collected as compared to traditional experiments. We feel that these findings have important implications for 'safety-by-design' in complex infrastructural structures.

Combined effects of expectations and visual uncertainty upon detection and identification of a target in the fog

Detecting a pedestrian while driving in the fog is one situation where the prior expectation about the target presence is integrated with the noisy visual input. We focus on how these sources of information influence the oculomotor behavior and are integrated within an underlying decision-making process. The participants had to judge whether high-/low-density fog scenes displayed on a computer screen contained a pedestrian or a deer by executing a mouse movement toward the response button (mouse-tracking). A variable road sign was added on the scene to manipulate expectations about target identity. We then analyzed the timing and amplitude of the deviation of mouse trajectories toward the incorrect response and, using an eye tracker, the detection time (before fixating the target) and the identification time (fixations on the target). Results revealed that expectation of the correct target results in earlier decisions with less deviation toward the alternative response, this effect being partially explained by the facilitation of target identification.

When expectancies collide: Action dynamics reveal the interaction between stimulus plausibility and congruency

The cognitive architecture routinely relies on expectancy mechanisms to process the plausibility of stimuli and establish their sequential congruency. In two computer mouse-tracking experiments, we use a cross-modal verification task to uncover the interaction between plausibility and congruency by examining their temporal signatures of activation competition as expressed in a computer- mouse movement decision response. In this task, participants verified the content congruency of sentence and scene pairs that varied in plausibility. The order of presentation (sentence-scene, scene-sentence) was varied between participants to uncover any differential processing. Our results show that implausible but congruent stimuli triggered less accurate and slower responses than implausible and incongruent stimuli, and were associated with more complex angular mouse trajectories independent of the order of presentation. This study provides novel evidence of a disassociation between the temporal signatures of plausibility and congruency detection on decision responses.

A Reverse Stroop Task with Mouse Tracking

In a reverse Stroop task, observers respond to the meaning of a color word irrespective of the color in which the word is printed-for example, the word red may be printed in the congruent color (red), an incongruent color (e.g., blue), or a neutral color (e.g., white). Although reading of color words in this task is often thought to be neither facilitated by congruent print colors nor interfered with incongruent print colors, this interference has been detected by using a response method that does not give any bias in favor of processing of word meanings or processing of print colors. On the other hand, evidence for the presence of facilitation in this task has been scarce, even though this facilitation is theoretically possible. By modifying the task such that participants respond to a stimulus color word by pointing to a corresponding response word on a computer screen with a mouse, the present study investigated the possibility that not only interference but also facilitation would take place in a reverse Stroop task. Importantly, in this study, participants' responses were dynamically tracked by recording the entire trajectories of the mouse. Arguably, this method provided richer information about participants' performance than traditional measures such as reaction time and accuracy, allowing for more detailed (and thus potentially more sensitive) investigation of facilitation and interference in the reverse Stroop task. These trajectories showed that the mouse's approach toward correct response words was significantly delayed by incongruent print colors but not affected by congruent print colors, demonstrating that only interference, not facilitation, was present in the current task. Implications of these findings are discussed within a theoretical framework in which the strength of association between a task and its response method plays a critical role in determining how word meanings and print colors interact in reverse Stroop tasks.

Neural pattern similarity reveals the inherent intersection of social categories

We provide evidence that neural representations of ostensibly unrelated social categories become bound together by their overlapping stereotype associations. While viewing faces, multi-voxel representations of gender, race, and emotion categories in the fusiform and orbitofrontal cortices were stereotypically biased and correlated with subjective perceptions. The findings suggest that social-conceptual knowledge can systematically alter the representational structure of social categories at multiple levels of cortical processing, reflecting bias in visual perceptions.

More Than Meets the Eye: Split-Second Social Perception

Recent research suggests that visual perception of social categories is shaped not only by facial features but also by higher-order social cognitive processes (e.g., stereotypes, attitudes, goals). Building on neural computational models of social perception, we outline a perspective of how multiple bottom-up visual cues are flexibly integrated with a range of top-down processes to form perceptions, and we identify a set of key brain regions involved. During this integration, 'hidden' social category activations are often triggered which temporarily impact perception without manifesting in explicit perceptual judgments. Importantly, these hidden impacts and other aspects of the perceptual process predict downstream social consequences - from politicians' electoral success to several evaluative biases - independently of the outcomes of that process.

PsyGlass: Capitalizing on Google Glass for naturalistic data collection

As commercial technology moves further into wearable technologies, cognitive and psychological scientists can capitalize on these devices to facilitate naturalistic research designs while still maintaining strong experimental control. One such wearable technology is Google Glass (Google, Inc.: www.google.com/glass), which can present wearers with audio and visual stimuli while tracking a host of multimodal data. In this article, we introduce PsyGlass, a framework for incorporating Google Glass into experimental work that is freely available for download and community improvement over time (www.github.com/a-paxton/PsyGlass). As a proof of concept, we use this framework to investigate dual-task pressures on naturalistic interaction. The preliminary study demonstrates how designs from classic experimental psychology may be integrated in naturalistic interactive designs with emerging technologies. We close with a series of recommendations for using PsyGlass and a discussion of how wearable technology more broadly may contribute to new or adapted naturalistic research designs.

A Perceptual Pathway to Bias: Interracial Exposure Reduces Abrupt Shifts in Real-Time Race Perception That Predict Mixed-Race Bias

In two national samples, we examined the influence of interracial exposure in one's local environment on the dynamic process underlying race perception and its evaluative consequences. Using a mouse-tracking paradigm, we found in Study 1 that White individuals with low interracial exposure exhibited a unique effect of abrupt, unstable White-Black category shifting during real-time perception of mixed-race faces, consistent with predictions from a neural-dynamic model of social categorization and computational simulations. In Study 2, this shifting effect was replicated and shown to predict a trust bias against mixed-race individuals and to mediate the effect of low interracial exposure on that trust bias. Taken together, the findings demonstrate that interracial exposure shapes the dynamics through which racial categories activate and resolve during real-time perceptions, and these initial perceptual dynamics, in turn, may help drive evaluative biases against mixed-race individuals. Thus, lower-level perceptual aspects of encounters with racial ambiguity may serve as a foundation for mixed-race prejudice.

Simple lines and shapes are associated with, and communicate, distinct emotions

We investigated whether lines and shapes that present face-like features would be associated with emotions. In Experiment 1, participants associated concave, convex, or straight lines with the words happy or sad. Participants found it easiest to associate the concave line with happy and the convex line with sad. In Experiment 2, participants rated (valence, pleasantness, liking, and tension) and categorised (valence and emotion words) two convex and concave lines that were paired with six distinct pairs of eyes. The presence of eyes affected participants' valence ratings and response latencies; more congruent eye-mouth matches produced more consistent ratings and faster reaction times. In Experiment 3, we examined whether dots that resembled eyes would be associated with emotional words. Participants found it easier to match certain sets of dots with specific emotions. These results suggest that facial gestures that are associated with specific emotions can be captured using relatively simple shapes and lines.

Response trajectories capture the continuous dynamics of the size congruity effect

In a comparison task involving numbers, the size congruity effect refers to the general finding that responses are usually faster when there is a match between numerical size and physical size (e.g., 2-8) than when there is a mismatch (e.g., 2-8). In the present study, we used computer mouse tracking to test two competing models of the size congruity effect: an early interaction model, where interference occurs at an early representational stage, and a late interaction model, where interference occurs as dynamic competition between response options. In three experiments, we found that the curvature of responses for incongruent trials was greater than for congruent trials. In Experiment 2 we showed that this curvature effect was reliably modulated by the numerical distance between the two stimulus numbers, with large distance pairs exhibiting a larger curvature effect than small distance pairs. In Experiment 3 we demonstrated that the congruity effects persist into response execution. These findings indicate that incongruities between numerical and physical sizes are carried throughout the response process and result from competition between parallel and partially active response options, lending further support to a late interaction model of the size congruity effect.

Responding to social and symbolic extrafoveal cues: cue shape trumps biological relevance

Social cues presented at visual fixation have been shown to strongly influence an observer’s attention and response selection. Here we ask whether the same holds for cues (initially) presented away from fixation, as cues are commonly perceived in natural vision. In six experiments, we show that extrafoveally presented cues with a distinct outline, such as pointing hands, rotated heads, and arrow cues result in strong cueing of responses (either to the cue itself, or a cued object). In contrast, cues without a clear outline, such as gazing eyes and direction words exert much weaker effects on participants’ responses to a target cue. We also show that distraction effects on response times are relatively weak, but that strong interference effects can be obtained by measuring mouse trajectories. Eye tracking suggests that gaze cues are slower to respond to because their direction cannot easily be perceived in extrafoveal vision. Together, these data suggest that the strength of an extrafoveal cue is determined by the shape of the cue outline, rather than its biological relevance (i.e., whether the cue is provided by another human being), and that this shape effect is due to how easily the direction of a cue can be perceived in extrafoveal vision.

Subliminal semantic priming in near absence of attention: A cursor motion study

The role of attention in subliminal semantic priming remains controversial: some researchers argue that attention is necessary for subliminal semantic priming, while others suggest that subliminal semantic processing is free from the influence of attention. The present study employs a cursor motion method to measure priming and evaluate the influence of attention. Specifically, by employing a semantic priming task developed by Naccache, Blandin, and Dehaene (2002), we investigate the extent to which top-down attention influences semantic priming. Results indicate that, consistent with the Naccache et al. (2002) results, attention facilitates priming. However, inconsistent with their theory, significant priming is still observed even in near absence of attention. We suggest that top-down attention helps but is not necessary for subliminal semantic processing.

Press to grasp: how action dynamics shape object categorization

Action and object are deeply linked to each other. Not only can viewing an object influence an ongoing action, but motor representations of action can also influence visual categorization of objects. It is tempting to assume that this influence is effector-specific. However, there is indirect evidence suggesting that this influence may be related to the action goal and not just to the effector involved in achieving it. This paper aimed, for the first time, to tackle this issue directly. Participants were asked to categorize different objects in terms of the effector (e.g. hand or foot) typically used to act upon them. The task was delivered before and after a training session in which participants were instructed either just to press a pedal with their foot or to perform the same foot action with the goal of guiding an avatar's hand to grasp a small ball. Results showed that pressing a pedal to grasp a ball influenced how participants correctly identified graspable objects as hand-related ones, making their responses more uncertain than before the training. Just pressing a pedal did not have any similar effect. This is evidence that the influence of action on object categorization can be goal-related rather than effector-specific.

The sweetest thing: the influence of angularity, symmetry, and the number of elements on shape-valence and shape-taste matches

A within-participants experiment was conducted in two countries (the UK and Colombia) in order to investigate the matching of shapes to taste words. Comparing the two countries allowed us to explore some of the cultural differences that have been reported thus far solely in terms of people's visual preferences. In particular, we addressed the question of whether properties other than angularity influence shape-valence and shape-taste matching (crossmodal correspondences). The participants in the present study repeatedly matched eight shapes, varying in terms of their angularity, symmetry, and number of elements to one of two words—pleasant or unpleasant and sweet or sour. Participants' choices, as well as the latency of their responses, and their hand movements, were evaluated. The participants were more likely to judge those shapes that were rounder, symmetrical, and those shapes that had fewer elements as both pleasant and sweet. Those shapes that were more angular, asymmetrical, and that had a greater number of elements, were more likely to be judged as both unpleasant and sour instead. The evidence presented here therefore suggests that aside from angularity and roundness, both symmetry/asymmetry and the number of elements present in a shape also influence valence and taste categorizations.

Effects of Trait Self-Control on Response Conflict About Healthy and Unhealthy Food

Self-control leads to positive life outcomes, but it is poorly understood. While previous research has focused on self-control failure, self-control success remains unexplored. The current studies aim to shed more light on the mechanisms of self-control by focusing on the resolution of response conflict as a key component in self-control success. Trait self-control was measured, and participants reported on the magnitude of response conflict they experienced about healthy and unhealthy foods in Study 1 (N = 146; M_age  = 33.03; 59 females, 83 males, 4 unknown). The response conflict process was assessed in Study 2 (N = 118; M_age  = 21.45; 68 females, 41 males, 9 unknown). Outcomes showed that self-reported evaluative response conflict about food items was smaller for people high in trait self-control. Study 2 revealed that higher trait self-control predicted faster resolution of self-control conflict, and an earlier peak of the response conflict. Taken together, these results provide insight into what makes people with high trait self-control successful, namely, how they handle response conflict. Implications for self-control theories and future directions are discussed.

The path of ambivalence: tracing the pull of opposing evaluations using mouse trajectories

Ambivalence refers to a psychological conflict between opposing evaluations, often experienced as being torn between alternatives. This dynamic aspect of ambivalence is hard to capture with outcome-focused measures, such as response times or self-report. To gain more insight into ambivalence as it unfolds, the current work uses an embodied measure of pull, drawing on research in dynamic systems. In three studies, using different materials, we tracked people’s mouse movements as they chose between negative and positive evaluations of attitude objects. When participants evaluated ambivalent attitude objects, their mouse trajectories showed more pull of the non-chosen evaluative option than when they evaluated univalent attitude objects, revealing that participants were literally torn between the two opposing evaluations. We address the relationship of this dynamic measure to response time and self-reports of ambivalence and discuss implications and avenues for future research.

Response trajectories reveal the temporal dynamics of fraction representations

Previous studies on mental arithmetic with fractions have been equivocal with respect to the nature of mental representations that are formed with fractions. It is not clear from present evidence whether fractions form perceptual primitives independent from components or whether component magnitudes must be processed in addition to the holistic magnitude. In the present study, we attempt to resolve this issue by using computer mouse-tracking. We analyzed the dynamics of participants' hand movements as they compared presented fractions to 1/2. We found that before settling to the correct answer, hand trajectories showed competitive influences of component magnitude and overall fraction magnitude, but the influence of components happened much earlier. These data support the idea that in fraction comparison, component magnitudes and holistic magnitude are processed together in a continuous, competitive manner.

The Sound of Voice: Voice-Based Categorization of Speakers' Sexual Orientation within and across Languages

Empirical research had initially shown that English listeners are able to identify the speakers' sexual orientation based on voice cues alone. However, the accuracy of this voice-based categorization, as well as its generalizability to other languages (language-dependency) and to non-native speakers (language-specificity), has been questioned recently. Consequently, we address these open issues in 5 experiments: First, we tested whether Italian and German listeners are able to correctly identify sexual orientation of same-language male speakers. Then, participants of both nationalities listened to voice samples and rated the sexual orientation of both Italian and German male speakers. We found that listeners were unable to identify the speakers' sexual orientation correctly. However, speakers were consistently categorized as either heterosexual or gay on the basis of how they sounded. Moreover, a similar pattern of results emerged when listeners judged the sexual orientation of speakers of their own and of the foreign language. Overall, this research suggests that voice-based categorization of sexual orientation reflects the listeners' expectations of how gay voices sound rather than being an accurate detector of the speakers' actual sexual identity. Results are discussed with regard to accuracy, acoustic features of voices, language dependency and language specificity.