Do all facial emojis communicate emotion? The impact of facial emojis on perceived sender emotion and text processing

Emotional text messages affect the early processing of emoticons depending on their emotional congruence: evidence from the N170 and EPN event related potentials

Emoticons have been considered pragmatic cues that enhance emotional expressivity during computer-mediated communication. Yet, it is unclear how emoticons are processed in ambiguous text-based communication due to incongruences between the emoticon's emotional valence and its context. In this study, we investigated the electrophysiological correlates of contextual influence on the early emotional processing of emoticons, during an emotional congruence judgment task. Participants were instructed to judge the congruence between a text message expressing an emotional situation (positive or negative), and a subsequent emoticon expressing positive or negative emotions. We analyzed early event-related potentials elicited by emoticons related to face processing (N170) and emotional salience in visual perception processing (Early Posterior Negativity, EPN). Our results show that accuracy and Reaction Times depend on the interaction between the emotional valence of the context and the emoticon. Negative emoticons elicited a larger N170, suggesting that the emotional information of the emoticon is integrated at the early stages of the perceptual process. During emoticon processing, a valence effect was observed with enhanced EPN amplitudes in occipital areas for emoticons representing negative valences. Moreover, we observed a congruence effect in parieto-temporal sites within the same time-window, with larger amplitudes for the congruent condition. We conclude that, similar to face processing, emoticons are processed differently according to their emotional content and the context in which they are embedded. A congruent context might enhance the emotional salience of the emoticon (and therefore, its emotional expression) during the early stages of their processing.

Congruent or conflicting? The interaction between emoji and textual sentence is not that simple!

As a Japanese graphic symbol widely used in the world, Emoji plays an important role in computer mediated communication. Despite its prevalent use, the interaction dynamics between emoji and textual sentences remain inadequately explored. Based on the emotional function of emoji, this study uses the indirect priming method to explore the emotional impact of emoji on subsequent text in computer mediated communication through two progressive behavioral experiments. The results show that: (1) Emoji positioned at the onset of a sentence induce an emotional priming effect; (2) The processing speed is slowest when emoji and text are emotionally conflicting, while in non-conflicting condition, the type of emoji moderates the processing of combined sentences; (3) The emotional influence of emoji plays an auxiliary role, and the valence of textual sentence plays a decisive role in emotional perception.

The electrophysiology of lexical prediction of emoji and text

As emoji often appear naturally alongside text in utterances, they provide a way to study how prediction unfolds in multimodal sentences in direct comparison to unimodal sentences. In this experiment, participants (N = 40) read sentences in which the sentence-final noun appeared in either word form or emoji form, a between-subjects manipulation. The experiment featured both high constraint sentences and low constraint sentences to examine how the lexical processing of emoji interacts with prediction processes in sentence comprehension. Two well-established ERP components linked to lexical processing and prediction - the N400 and the Late Frontal Positivity - are investigated for sentence-final words and emoji to assess whether, to what extent, and in what linguistic contexts emoji are processed like words. Results indicate that the expected effects, namely an N400 effect to an implausible lexical item compared to a plausible one and an LFP effect to an unexpected lexical item compared to an expected one, emerged for both words and emoji. This paper discusses the similarities and differences between the stimulus types and constraint conditions, contextualized within theories of linguistic prediction, ERP components, and a multimodal lexicon.

Emotion recognition of faces and emoji in individuals with moderate-severe traumatic brain injury

BACKGROUND

Facial emotion recognition deficits are common after moderate-severe traumatic brain injury (TBI) and linked to poor social outcomes. We examine whether emotion recognition deficits extend to facial expressions depicted by emoji.

METHODS

Fifty-one individuals with moderate-severe TBI (25 female) and fifty-one neurotypical peers (26 female) viewed photos of human faces and emoji. Participants selected the best-fitting label from a set of basic emotions (anger, disgust, fear, sadness, neutral, surprise, happy) or social emotions (embarrassed, remorseful, anxious, neutral, flirting, confident, proud).

RESULTS

We analyzed the likelihood of correctly labeling an emotion by group (neurotypical, TBI), stimulus condition (basic faces, basic emoji, social emoji), sex (female, male), and their interactions. Participants with TBI did not significantly differ from neurotypical peers in overall emotion labeling accuracy. Both groups had poorer labeling accuracy for emoji compared to faces. Participants with TBI (but not neurotypical peers) had poorer accuracy for labeling social emotions depicted by emoji compared to basic emotions depicted by emoji. There were no effects of participant sex.

DISCUSSION

Because emotion representation is more ambiguous in emoji than human faces, studying emoji use and perception in TBI is an important consideration for understanding functional communication and social participation after brain injury.

Emoji-SP, the Spanish emoji database: Visual complexity, familiarity, frequency of use, clarity, and emotional valence and arousal norms for 1031 emojis

This article presents subjective norms for 1031 emojis in six dimensions: visual complexity, familiarity, frequency of use, clarity, emotional valence, and emotional arousal. This is the largest normative study conducted so far that relies on subjective ratings. Unlike the few existing normative studies, which mainly comprise face emojis, here we present a wide range of emoji categories. We also examine the correlations between the dimensions assessed. Our results show that, in terms of their affective properties, emojis are analogous to other stimuli, such as words, showing the expected U-shaped relationship between valence and arousal. The relationship between affective properties and other dimensions (e.g., between valence and familiarity) is also similar to the relationship observed in words, in the sense that positively valenced emojis are more familiar than negative ones. These findings suggest that emojis are suitable stimuli for studying affective processing. Emoji-SP will be highly valuable for researchers of various fields interested in emojis, including computer science, communication, linguistics, and psychology. The full set of norms is available at: https://osf.io/dtfjv/ .

The power of emojis: The impact of a leader's use of positive emojis on members' creativity during computer-mediated communications

The existing literature on emojis offers limited insights on the effects of using emojis in organizational settings, especially in the context of leader-member relationships. The current research examines how a leader's use of positive emojis can influence members' creative performance, a critical determinant of an organization's success and productivity. We find that a leader's use of positive emojis enhances members' creativity and that this effect is mediated by a decrease in members' perception of objectification by the leader. We further find that this impact of a leader's use of positive emojis on members' creativity is stronger when members have a higher level of relationship orientation. Contrary to the popular belief that the use of emojis in a work setting is inappropriate, our findings reveal that leaders' use of emojis has positive impacts on important workplace outcomes. These findings provide important guidelines on how to apply emojis to computer-mediated communications at work by demonstrating the circumstances in which positive consequences of using emojis occur.

Putting your best face forward: How instructor emoji use influences students' impressions of credibility, immediacy, and liking

This project explores the impacts of emojis on students' impressions when used in a course welcome email. We adopt a 4 × 3 factorial design to determine how different emojis (i.e., , , ) impact students' impressions of credibility, immediacy, and liking. Data from students (N = 368) indicates emoji choice does impact impressions. Consistently, instructors' emoji use resulted in decreased perceived competence and trustworthiness but increased perceived caring, immediacy, and liking. Findings have implications for instructors who engage in technologically-mediated out-of-class communication and want to strengthen early student-instructor relationships. Limitations and future directions are also discussed.

Research on the Influence of Visual Factors on Emotion Regulation Interaction

To guide the design direction of emotion regulation products that improve the positive emotions of users, investigation into the correlation between relevant visual factors and multi-dimensional complex emotions is needed. In the present study, an extended product emotion measurement method was adopted to describe the multi-dimensional emotional set of each influencing factor and calculate their weight according to the order. The positive and negative emotion indicators of all influencing factors were compared and the evaluation and ranking factors that affect users’ emotional value of emotion regulation products were analyzed. The experimental results reveal that specific emotion mapping scenes on positive emotion are the most significant among the key factors affecting user emotion. Further, the influence of emotional stickers, interactive data visualization, and text on positive emotions decreased in turn. The influence of emotional text on positive emotion was the lowest. Through investigating the visual factors that affect the psychological emotions of users, the development of emotion regulating products could be guided in a more scientific and reasonable manner.