A Systematic Review of Emoji: Current Research and Future Perspectives

Emoji as gesture in digital communication: Emoji improve comprehension of indirect speech

As reliance on digital communication grows, so does the importance of communicating effectively with text. Yet when communicating with text, benefits from other channels, such as hand gesture, are diminished. Hand gestures support comprehension and disambiguate characteristics of the spoken message by providing information in a visual channel supporting speech. Can emoji (pictures used to supplement text communication) perform similar functions? Here, we ask whether emoji improve comprehension of indirect speech. Indirect speech is ambiguous, and appropriate comprehension depends on the receiver decoding context cues, such as hand gesture. We adapted gesture conditions from prior research (Kelly et al., 1999, Experiment 2) to a digital, text-based format, using emoji rather than gestures. Participants interpreted 12 hypothetical text-message exchanges that ended with indirect speech, communicated via text only, text+emoji, or emoji only, in a between-subjects design. Like that previously seen for hand gesture, emoji improved comprehension. Participants were more likely to correctly interpret indirect speech in the emoji-only condition compared with the text+emoji and the text-only conditions, and more likely in the text+emoji condition compared to the text-only condition. Thus, emoji are not mere decoration, but rather are integrated with text to communicate and disambiguate complex messages. Similar to gesture in face-to-face communication, emoji improve comprehension during text-based communication.

A systematic literature review of the stereotype content model in the fields of psychology and marketing: main themes examined in the literature and an agenda for future research in marketing

The stereotypes content model indicates that two traits (i.e., warmth and competence) govern individuals' impression formation. The great variety of research that has used this theory since the early 2000s leads to a need for a structured overview of prior findings. The goal of this study is to provide a concise map of research streams and present a research agenda. We conducted a systematic literature review of 955 articles. A bibliographic coupling analysis showed four clusters, i.e., (1) the general theoretical foundations of the SCM, (2) the societal impact of key stereotypes (with emphasis on gender), (3) research in clinical psychology and child development, and (4) marketing. Taking a closer look at research in marketing (using co-occurrence analysis), six research streams were identified, including research on branding, country-of-origin, front-line service providers, prosocial consumer behavior, perception of endorsers, and, more recently, on artificial intelligence (AI). The review presents key findings and research gaps across these topics. Finally, we reviewed the few articles that, although not falling into these streams, opened important research veins. This process provided the essential information to present a promising and complete research agenda, to continue building knowledge with impactful implications in different contexts.

Technology-enhanced mindfulness-based collaborative social reasoning to improve adolescents' social-emotional competencies

This study reports the preliminary efficacy of an innovative school-based, technology-enhanced social-emotional learning program called "mindfulness-based collaborative social reasoning" (MBCSR) for middle school students. MBCSR was developed by an interdisciplinary team of educational psychologists, mindfulness researchers, computer scientists, and health experts. We integrated the strengths of contemplative approaches, collaborative small group discussions, learning technology, and multidimensional assessments of students' social-emotional outcomes. Using a quasi-experimental design, the study was implemented in four sixth-grade English language arts classrooms (2 experimental and 2 business-as-usual control; N = 74) in a public middle school in the Midwest of the United States. It was co-implemented by researchers and teachers, with sessions occurring for 45 minutes, once per week, for 8 weeks. The MBCSR group showed greater self-efficacy for using Upa-yoga and mindful breathing to regulate their emotions and behaviors (η p 2 $$ {\eta}_p^2 $$  = .13), and lower externalizing (η p 2 $$ {\eta}_p^2 $$  = .07) and bullying behaviors (η p 2 $$ {\eta}_p^2 $$  = .09) at the posttest compared to the control group, after controlling for baseline differences. Students in the experimental group overall showed positive and relaxed emotional and physiological states during the sessions. There were no significant differences between the two groups in mindfulness, emotional regulation, and social skills. This program sets an example for integrating social-emotional learning and academic learning into students' daily content instruction.

Attentional Differences Between Males and Females for Emojis During the Emotional Stroop Task

Introduction Cognitive load can be intensified by emotional components such as emotive words or facial expressions. Sex differences influence both emotional and cognitive functions for emotional facial expressions. Emojis, in contrast to human faces, serve as digital cues conveying emotional nuances in communication. The present study aimed to compare attentional differences prompted by emojis. Methods This study aimed to compare attentional differences in males and females elicited by emojis in 100 healthy adults (50 males and 50 females) within the age group of 18 to 40 years (mean ± SD: 27.87 ± 5.37 years) while performing the emotional Stroop task (EST). The EST comprised emojis depicting four emotions (happy, fear, sad, and angry) and emotionally charged words conveying similar emotions. An independent sample t-test was used to compare the reaction times among males and females. Results Results showed males had significantly longer reaction times than females across all task conditions. Both genders exhibited significant differences in reaction times across task conditions, except inhibition. Overall, reaction times increased notably from neutral to incongruent conditions for both genders. This suggests that response times increased significantly from neutral to incongruent conditions. Conclusion Emojis introduced in the EST revealed gender-related differences in attentional processing. This study showed the greater proficiency of females in emotional processing during EST compared to males. These findings contribute to our understanding of how gender is associated with cognitive responses to emotional stimuli in digital communication contexts.

The emoji current mood and experience scale: the development and initial validation of an ultra-brief, literacy independent measure of psychological health

BACKGROUND

There is increasing interest in measuring wellbeing and mental health in a range of settings and services outside conventional mental health care settings. However, ensuring that measurement does not intrude on the primary service activity whilst promoting inclusion through minimizing literacy demands, requires ultra-brief and easy to use tools.

AIMS

To develop and test a brief emoji-based tool to assess mental health, wellbeing, resilience and community connection.

METHOD

In study 1, 672 adults completed an online questionnaire study comprising a new emoji measure and established questionnaires assessing mental health, resilience, community connection and wellbeing. In study 2, 415 participants completed a paper-and-pencil version of the emoji measure, mental health and community connection, with 212 individuals providing data at a second time point.

RESULTS

Multidimensional scaling revealed a meaningful structure to the emoji measure with validity demonstrated through relationships to existing scales. Stability over time and sensitivity to change were also demonstrated.

CONCLUSIONS

The emoji-based measure presented here provides an ultra-brief measure of mood and current experience, with minimal literacy demands on participants. Further research is now needed to test the properties and utility of the scale with other participant groups.

Enhancing Occupant Comfort and Building Sustainability: Lessons from an Internet of Things-Based Study on Centrally Controlled Indoor Shared Spaces in Hot Climatic Conditions

It is well known that buildings have a sizeable energy and environmental footprint. In particular, in environments like university campuses, the occupants as well as occupancy in shared spaces varies over time. Systems for cooling in such environments that are centrally controlled are typically threshold driven and do not account for occupant feedback and thus are often relying on a reactive approach (fix after identifying problems). Therefore, having a fixed thermal operating set point may not be optimal in such cases-both from an occupant comfort and well-being as well as an energy efficiency perspective. To address this issue, a study was conducted which involved development and deployment of an experimental Internet of Things (IoT) prototype system and an Android application that facilitated people engagement on a university campus located in the UAE which typically exhibits hot climatic conditions. This paper showcases data driven insights obtained from this study, and in particular, how to achieve a balance between the conflicting goals of improving occupant comfort and energy efficiency. Findings from this study underscore the need for regular reassessments and adaptation. The proposed solution is low cost and easy to deploy and has the potential to reap significant savings through a reduction in energy consumption with estimates indicating around 50-100 kWh/day of savings per building and the resulting environmental impact. These findings would appeal to stakeholders who are keen to improve energy efficiency and reduce their operating expenses and environmental footprint in such climatic conditions. Furthermore, collective action from a large number of entities could result in significant impact through this cumulative effect.

Emoji use in social media posts: relationships with personality traits and word usage

Prior research has demonstrated relationships between personality traits of social media users and the language used in their posts. Few studies have examined whether there are relationships between personality traits of users and how they use emojis in their social media posts. Emojis are digital pictographs used to express ideas and emotions. There are thousands of emojis, which depict faces with expressions, objects, animals, and activities. We conducted a study with two samples (n = 76 and n = 245) in which we examined how emoji use on X (formerly Twitter) related to users' personality traits and language use in posts. Personality traits were assessed from participants in an online survey. With participants' consent, we analyzed word usage in posts. Word frequencies were calculated using the Linguistic Inquiry Word Count (LIWC). In both samples, the results showed that those who used the most emojis had the lowest levels of openness to experience. Emoji use was unrelated to the other personality traits. In sample 1, emoji use was also related to use of words related to family, positive emotion, and sadness and less frequent use of articles and words related to insight. In sample 2, more frequent use of emojis in posts was related to more frequent use of you pronouns, I pronouns, and more frequent use of negative function words and words related to time. The results support the view that social media users' characteristics may be gleaned from the content of their social media posts.

Digital contact does not promote wellbeing, but face-to-face contact does: A cross-national survey during the COVID-19 pandemic

With restricted face-to-face interactions, COVID-19 lockdowns and distancing measures tested the capability of computer-mediated communication to foster social contact and wellbeing. In a multinational sample (n = 6436), we investigated how different modes of contact related to wellbeing during the pandemic. Computer-mediated communication was more common than face-to-face, and its use was influenced by COVID-19 death rates, more so than state stringency measures. Despite its legal and health threats, face-to-face contact was still positively associated with wellbeing, and messaging apps had a negative association. Perceived household vulnerability to COVID-19 reduced the positive effect of face-to-face communication on wellbeing, but surprisingly, people's own vulnerability did not. Computer-mediated communication was particularly negatively associated with the wellbeing of young and empathetic people. Findings show people endeavored to remain socially connected, yet however, maintain a physical distance, despite the tangible costs to their wellbeing.

Understanding individuals with spinal cord injury's self-care practices: a technology probe study to promote pressure relief adherence

Pressure reliefs (PRs) are self-care practices essential for individuals with spinal cord injury (SCI) to prevent life-threatening pressure injuries (PIs). Despite the benefits, individuals often do not do these exercises at home, leading to increased patient morbidity and mortality. To examine how digital technology could improve this population's adherence to PR exercises, we conducted a technology probe study with five individuals with SCI over ten consecutive business days. A chat-based intervention was created to send user-scheduled PR reminders, which were personalized with visual elements and progress trackers. Participants were interviewed before and after interacting with the probe to better understand their experiences with PIs and PR practices. Results shed light on specific factors that may impact individuals with SCI's behaviours towards PRs and four considerations to design a customisable reminder intervention: (1) easy to use and friendly technology, (2) design-your-own- schedule feature, (3) communication style feature, and (4) dialogue support features. Personalisation supported with gamified visual progress tracking and motivational messages emerged as a strong strategy to increase PR adherence. Both sets of findings expand upon the human-computer interaction (HCI) literature for mobile health tools that encourage self-care practices; in particular, to the specific needs of individuals with SCI and the use of visual elements to increase engagement.

Biodiversity communication in the digital era through the Emoji tree of life

Emojis enable direct expressions of ideas and emotions in digital communication, also contributing to discussions on biodiversity conservation. Nevertheless, the ability of emojis to represent the Earth's tree of life remains unexplored. Here, we quantified the taxonomic comprehensiveness of currently available nature-related emojis and tested whether the expanding availability of emojis enables a better coverage of extant biodiversity. Currently available emojis encompass a broad range of animal species, while plants, fungi, and microorganisms are underrepresented. Within animals, vertebrates are significantly overrepresented compared to their actual richness, while arthropods are underrepresented. Notwithstanding these taxonomic disparities, animal taxa represented by emojis more than doubled from 2015 to 2022, allowing an improved representation of both taxonomic and phylogenetic diversity, driven by the recent addition of cnidarians and annelids. Creating an inclusive emoji set is essential to ensure a fair representation of biodiversity in digital communication and showcase its importance for biosphere functioning.

Identifying Potential Lyme Disease Cases Using Self-Reported Worldwide Tweets: Deep Learning Modeling Approach Enhanced With Sentimental Words Through Emojis

BACKGROUND

Lyme disease is among the most reported tick-borne diseases worldwide, making it a major ongoing public health concern. An effective Lyme disease case reporting system depends on timely diagnosis and reporting by health care professionals, and accurate laboratory testing and interpretation for clinical diagnosis validation. A lack of these can lead to delayed diagnosis and treatment, which can exacerbate the severity of Lyme disease symptoms. Therefore, there is a need to improve the monitoring of Lyme disease by using other data sources, such as web-based data.

OBJECTIVE

We analyzed global Twitter data to understand its potential and limitations as a tool for Lyme disease surveillance. We propose a transformer-based classification system to identify potential Lyme disease cases using self-reported tweets.

METHODS

Our initial sample included 20,000 tweets collected worldwide from a database of over 1.3 million Lyme disease tweets. After preprocessing and geolocating tweets, tweets in a subset of the initial sample were manually labeled as potential Lyme disease cases or non-Lyme disease cases using carefully selected keywords. Emojis were converted to sentiment words, which were then replaced in the tweets. This labeled tweet set was used for the training, validation, and performance testing of DistilBERT (distilled version of BERT [Bidirectional Encoder Representations from Transformers]), ALBERT (A Lite BERT), and BERTweet (BERT for English Tweets) classifiers.

RESULTS

The empirical results showed that BERTweet was the best classifier among all evaluated models (average F1-score of 89.3%, classification accuracy of 90.0%, and precision of 97.1%). However, for recall, term frequency-inverse document frequency and k-nearest neighbors performed better (93.2% and 82.6%, respectively). On using emojis to enrich the tweet embeddings, BERTweet had an increased recall (8% increase), DistilBERT had an increased F1-score of 93.8% (4% increase) and classification accuracy of 94.1% (4% increase), and ALBERT had an increased F1-score of 93.1% (5% increase) and classification accuracy of 93.9% (5% increase). The general awareness of Lyme disease was high in the United States, the United Kingdom, Australia, and Canada, with self-reported potential cases of Lyme disease from these countries accounting for around 50% (9939/20,000) of the collected English-language tweets, whereas Lyme disease-related tweets were rare in countries from Africa and Asia. The most reported Lyme disease-related symptoms in the data were rash, fatigue, fever, and arthritis, while symptoms, such as lymphadenopathy, palpitations, swollen lymph nodes, neck stiffness, and arrythmia, were uncommon, in accordance with Lyme disease symptom frequency.

CONCLUSIONS

The study highlights the robustness of BERTweet and DistilBERT as classifiers for potential cases of Lyme disease from self-reported data. The results demonstrated that emojis are effective for enrichment, thereby improving the accuracy of tweet embeddings and the performance of classifiers. Specifically, emojis reflecting sadness, empathy, and encouragement can reduce false negatives.

Development and validation of a symptom illustration scale from the patient-reported outcome common terminology criteria for adverse events for patients with breast cancer

PURPOSE

Emojis are commonly used for daily communication and may be useful in assessing patient-reported outcomes (PROs) in breast cancer. The purpose of this study is to develop and validate a Symptom Illustration Scale (SIS) as a new PRO measurement.

METHODS

Eighteen original SIS items were developed from the PRO-CTCAE. In cohort one, the SIS validity and reliability were examined in patients with breast cancer, using a semi-structured five-question survey to investigate content validity. PROs with PRO-CTCAE and SIS were examined twice to determine criteria validity and test-retest reliability. In cohort two, the responsiveness of the scales were examined in patients treated with anthracycline, docetaxel, paclitaxel, and endocrine therapy. PROs with PRO-CTCAE and SIS were investigated two or three times, depending on the therapy.

RESULTS

Patients were enrolled from August 2019 to October 2020. In cohort one (n = 70), most patients had no difficulties with the SIS, but 16 patients indicated that it was difficult to understand severities in the SIS. For criterion validity, Spearman rank correlation coefficients (rs) between PRO-CTCAE and SIS items were ≥ 0.41, except for "Decreased appetite." For test-retest reliability, κ coefficients of the SIS were ≥ 0.41 for 16/18 items (88.9%). Response time was significantly shorter for the SIS than for PRO-CTCAE (p < 0.001). In cohort two (n = 106), score changes between PRO-CTCAE and SIS for relevant symptoms all had correlations with rs ≥ 0.41.

CONCLUSION

An original SIS from the PRO-CTCAE for patients with breast cancer were verified the validity, reliability, and responsiveness. Further studies to improve and validate the SIS are needed.

Speech acts and the communicative functions of emojis in LIHKG online discussion forum amid COVID-19

Since the beginning of 2022, the Hong Kong government has imposed strict social distancing measures and changed its stance on various regional policies with the aim to contain the so-called 'fifth wave' of COVID-19. In these pandemic and 'infodemic' times filled with uncertainty and fear, Hong Kong netizens used local online discussion forums as a resource to establish an innovative form of 'helping network.' This study is based on 230 posts from a popular local online discussion forum 'LIHKG' in February 2022 when the pandemic was regarded as most critical by the Department of Health. Speech Acts theoretic approach was adopted to explore how forum users employed speech acts to perform various communicative practices such as expressing concerns, asking for information, and engaging with others in a CMC environment amid a global health crisis. Representatives were found to be the most dominant text-based speech acts, followed by directives, expressives and commissives. Speech acts provide forum users a context in which emoji usage occurs. Forum users not only make use of words to 'do' things in the online self-help forum, but they also employ emojis to either supplement or complement speech acts. This study also shows that emojis perform multiple functions in the discussion posts and argues that they do not merely function as emotion indicators of their textual company, but also carry significant pragmatic meanings by illustrating how they can also carry illocutionary force and in some cases, even alter the illocutionary force of their preceding texts. The findings of this study enhance our understanding of how forum users communicate via verbal and nonverbal means within the underexplored 'helping domain' of online discussion forums. It also suggests that online discussion forum interactions need to be approached differently than other better understood alternatives.

Emotion recognition of faces and emoji in individuals with moderate-severe traumatic brain injury

BACKGROUND

Facial emotion recognition deficits are common after moderate-severe traumatic brain injury (TBI) and linked to poor social outcomes. We examine whether emotion recognition deficits extend to facial expressions depicted by emoji.

METHODS

Fifty-one individuals with moderate-severe TBI (25 female) and fifty-one neurotypical peers (26 female) viewed photos of human faces and emoji. Participants selected the best-fitting label from a set of basic emotions (anger, disgust, fear, sadness, neutral, surprise, happy) or social emotions (embarrassed, remorseful, anxious, neutral, flirting, confident, proud).

RESULTS

We analyzed the likelihood of correctly labeling an emotion by group (neurotypical, TBI), stimulus condition (basic faces, basic emoji, social emoji), sex (female, male), and their interactions. Participants with TBI did not significantly differ from neurotypical peers in overall emotion labeling accuracy. Both groups had poorer labeling accuracy for emoji compared to faces. Participants with TBI (but not neurotypical peers) had poorer accuracy for labeling social emotions depicted by emoji compared to basic emotions depicted by emoji. There were no effects of participant sex.

DISCUSSION

Because emotion representation is more ambiguous in emoji than human faces, studying emoji use and perception in TBI is an important consideration for understanding functional communication and social participation after brain injury.

Emoji-SP, the Spanish emoji database: Visual complexity, familiarity, frequency of use, clarity, and emotional valence and arousal norms for 1031 emojis

This article presents subjective norms for 1031 emojis in six dimensions: visual complexity, familiarity, frequency of use, clarity, emotional valence, and emotional arousal. This is the largest normative study conducted so far that relies on subjective ratings. Unlike the few existing normative studies, which mainly comprise face emojis, here we present a wide range of emoji categories. We also examine the correlations between the dimensions assessed. Our results show that, in terms of their affective properties, emojis are analogous to other stimuli, such as words, showing the expected U-shaped relationship between valence and arousal. The relationship between affective properties and other dimensions (e.g., between valence and familiarity) is also similar to the relationship observed in words, in the sense that positively valenced emojis are more familiar than negative ones. These findings suggest that emojis are suitable stimuli for studying affective processing. Emoji-SP will be highly valuable for researchers of various fields interested in emojis, including computer science, communication, linguistics, and psychology. The full set of norms is available at: https://osf.io/dtfjv/ .

A mixed-methods exploration of attitudes towards pregnant Facebook fitness influencers

BACKGROUND

Exercise during pregnancy is associated with various health benefits for both mother and child. Despite these benefits, most pregnant women do not meet physical activity recommendations. A known barrier to engaging in exercise during pregnancy is a lack of knowledge about appropriate and safe exercise. In our current era of social media, many pregnant women are turning to online information sources for guidance, including social media influencers. Little is known about attitudes towards pregnancy exercise information provided by influencers on social media platforms. This study aimed to explore attitudes towards exercise during pregnancy depicted by social media influencers on Facebook, and user engagement with posted content.

METHODS

A mixed-methods approach was used to analyse data from 10 Facebook video posts of social media influencers exercising during pregnancy. Quantitative descriptive analyses were used to report the number of views, shares, comments and emotive reactions. Qualitative analysis of user comments was achieved using an inductive thematic approach.

RESULTS

The 10 video posts analysed were viewed a total of 12,117,200 times, shared on 11,181 occasions, included 13,455 user comments and 128,804 emotive icon reactions, with the most frequently used icon being 'like' (81.48%). The thematic analysis identified three themes associated with attitudes including [1] exercise during pregnancy [2] influencers and [3] type of exercise. A fourth theme of community was also identified. Most user comments were associated with positive attitudes towards exercise during pregnancy and the influencer. However, attitudes towards the types of exercise the influencer performed were mixed (aerobic and body weight exercises were positive; resistance-based exercise with weights were negative). Finally, the online community perceived by users was mostly positive and recognised for offering social support and guidance.

CONCLUSIONS

User comments imply resistance-based exercise with weights as unsafe and unnecessary when pregnant, a perception that does not align with current best practice guidelines. Collectively, the findings from this study highlight the need for continued education regarding exercise during pregnancy and the potential for social media influencers to disseminate evidence-based material to pregnant women who are highly receptive to, and in need of reliable health information.

Emojis Are Comprehended Better than Facial Expressions, by Male Participants

Emojis are colorful ideograms resembling stylized faces commonly used for expressing emotions in instant messaging, on social network sites, and in email communication. Notwithstanding their increasing and pervasive use in electronic communication, they are not much investigated in terms of their psychological properties and communicative efficacy. Here, we presented 112 different human facial expressions and emojis (expressing neutrality, happiness, surprise, sadness, anger, fear, and disgust) to a group of 96 female and male university students engaged in the recognition of their emotional meaning. Analyses of variance showed that male participants were significantly better than female participants at recognizing emojis (especially negative ones) while the latter were better than male participants at recognizing human facial expressions. Quite interestingly, male participants were better at recognizing emojis than human facial expressions per se. These findings are in line with more recent evidence suggesting that male individuals may be more competent and inclined to use emojis to express their emotions in messaging (especially sarcasm, teasing, and love) than previously thought. Finally, the data indicate that emojis are less ambiguous than facial expressions (except for neutral and surprise emotions), possibly because of the limited number of fine-grained details and the lack of morphological features conveying facial identity.

COVID-19 case prediction using emotion trends via Twitter emoji analysis: A case study in Japan

Introduction

The worldwide COVID-19 pandemic, which began in December 2019 and has lasted for almost 3 years now, has undergone many changes and has changed public perceptions and attitudes. Various systems for predicting the progression of the pandemic have been developed to help assess the risk of COVID-19 spreading. In a case study in Japan, we attempt to determine whether the trend of emotions toward COVID-19 expressed on social media, specifically Twitter, can be used to enhance COVID-19 case prediction system performance.

Methods

We use emoji as a proxy to shallowly capture the trend in emotion expression on Twitter. Two aspects of emoji are studied: the surface trend in emoji usage by using the tweet count and the structural interaction of emoji by using an anomalous score.

Results

Our experimental results show that utilizing emoji improved system performance in the majority of evaluations.

Smile Back at Me, But Only Once: Social Norms of Appropriate Nonverbal Intensity and Reciprocity Apply to Emoji Use

In computer-mediated communication, small graphical icons (emojis) can be used to compensate for the lack of nonverbal cues such as facial expressions or hand gestures. Accordingly, literature suggests that the use of emojis may also be subject to social norms—similar to nonverbal behavior in face-to-face interactions. However, actual empirical investigations into this assumption remain lacking. To remedy this research gap, I explored whether traditional norms of appropriate emotional intensity and reciprocity also apply to emoji usage. A first online experiment (N = 188) revealed that excessive emoji use in a first-contact scenario leads to diminished interpersonal outcomes, corresponding to the drawbacks of overly intense nonverbal displays in natural interactions. Proceeding to a different communicative stage, Experiment 2 (N = 242) explored nonverbal reciprocity with acquainted interaction partners. Inviting participants to reply to fictitious text messages (at varying levels of interpersonal intimacy), it was observed that stimulus messages containing more emojis also evoke stronger emoji use in return—indicating that principles of nonverbal attunement are in full effect during text-based online interactions.

Health persuasion through emoji: How emoji interacted with information source to predict health behaviors in COVID-19 situation

By providing health information through visual communication, public health organizations can effectively guide and persuade people to adopt healthy behaviors, which is critical in the context of public health crises. In this study, drawing upon congruity theory and the premise of visual communication, we examined how information source and emoji may shape people's preventive and self-protective behaviors through perceived fear (PF) and perceived controllability (PC). Using a convenience sample of 210 participants, we conducted a 2 (emoji: with versus without) × 2 (information source: official versus unofficial) between-subject experiment. The results indicated that, compared with nonuse, the use of emoji in information resulted in higher PF, stronger preventive behavioral intention (PBI), and lower PC. In addition, a strong interaction effect was observed between emoji and the source of information on PBI. When emoji were added to health information released by an unofficial organization, the text outperformed that from an official agency in persuading people to adopt preventive behaviors. Furthermore, we determined that PF mediated the effect of emoji on PBI, but only for unofficial information sources. These results provide a reference for enhancing the effectiveness of health information including visual cues, such as emoji.

Non-face emojis in digital marketing: Effects, contingencies, and strategic recommendations

Non-face (NF) emojis are increasingly used to complement or substitute words in digital marketing messages, yet the effects, mechanisms, and contingencies of this communication strategy remain underexplored. In a large-scale longitudinal study of Airbnb listings, we show that NF emojis (vs. simple text) lead to an increase in eWOM volume, an effect we replicate experimentally. This effect is qualified by important boundary conditions whose underlying mechanisms are investigated in two additional experimental studies. At the message level, using multiple substitutive (vs. complementary) NF emojis reduces message evaluations and eWOM volume due to reduced processing fluency. At the source level, seller quality further moderates the interaction between emoji function and emoji number: for premium sellers, using multiple NF emojis reduces message evaluations and eWOM volume irrespective of their function due to reduced perceptions of competence. We distill these findings into detailed managerial guidelines for using NF emojis in digital marketing.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s11747-022-00917-z.

Experiences of giving birth during the COVID-19 pandemic: a qualitative analysis of social media comments through the lens of birth integrity

BACKGROUND

Social media offer women a space to discuss birth-related fears and experiences. This is particularly the case during the COVID-19 pandemic when measures to contain the spread of the virus and high rates of infection have had an impact on the delivery of care, potentially restricting women's rights and increasing the risk of experiencing different forms of mistreatment or violence. Through the lens of birth integrity, we focused on the experiences of women giving birth in Germany as shared on social media, and on what may have sheltered or violated their integrity during birth.

METHODS

Using thematic analysis, we identified key themes in 127 comments and associated reactions (i.e. "likes", emojis) posted on a Facebook public page in response to the dissemination of a research survey on maternity care in the first year of the COVID-19 pandemic.

RESULTS

Women contributing to the dataset gave birth during March and December 2020. They were most negatively affected by own mask-wearing -especially during the active phase of labour, not being allowed a birth companion of choice, lack of supportive care, and exclusion of their partner from the hospital. Those topics generated the most reactions, revealing compassion from other women and mixed feelings about health measures, from acceptation to anger. Many women explicitly formulated how inhumane or disrespectful the care was. While some women felt restricted by the tight visiting rules, those were seen as positive by others, who benefited from the relative quiet of maternity wards and opportunities for postpartum healing and bonding.

CONCLUSION

Exceptional pandemic circumstances have introduced new parameters in maternity care, some of which appear acceptable, necessary, or beneficial to women, and some of which can be considered violations of birth integrity. Our research calls for the investigation of the long-term impact of those violations and the reassessment of the optimal conditions of the delivery of respectful maternity during the pandemic and beyond.

Memojis Pain Scale: A novel pain assessment tool

BACKGROUND

Dental pain exerts a considerable impact on the psychosocial well-being of children; reliable management of pain depends on the ability to assess pain intensity.

AIM

To validate and compare a new memojis pain assessment scale with the Faces Pain Scale-Revised (FPS-R) and Wong-Baker FACES Pain Rating Scale (WBFPS) in assessing dental pain experienced by children.

DESIGN

Two hundred and fifty healthy children aged 5-9 years without any past dental experience and requiring local anaesthesia (LA) administration were recruited. Three different scales [FPS-R, WBFPS and Memojis Pain Scale (MPS)] were applied to assess the children's pain during LA administration. The preferences of each child based on the ease of understanding the faces were recorded.

RESULTS

Pearson correlation test was performed to determine the correlation between MPS with WBFPS and MPS with FPS-R. A strong correlation was seen when comparing MPS with WBFPS (r = .966; p < .001) and MPS with FPS-R (r = .969; p < .001), and 81.6% of the children preferred MPS.

CONCLUSION

The Memojis Pain Scale was an effective pain assessment tool. It can be employed as an alternative scale for pain assessment in children.

Are you really smiling? Display rules for emojis and the relationship between emotion management and psychological well-being

Display rules specify socially appropriate facial expressions in a given situation. However, managing emotions for such a social adaption sometimes leads to deleterious psychological outcomes. Given that people nowadays rely on emojis to express emotions online, the present study investigated (1) whether display rules exist in emoji communications and (2) how emotion management using emojis is associated with psychological well-being. Prior studies have demonstrated the effects of context on the frequency of emoji use. However, the intensity and type of expression may differ, even if emojis are used at the same frequency. The current study thus investigated whether emotional expressions and the types of emojis used are adjusted to contexts similar to facial displays. As many as 1,289 Japanese participants typed emojis in response to Internet chats and reported the intensity of their emotional expressions. The contexts of the chats varied depending on the target of use, the emotional value of contexts, and private or public settings. The results showed that, similar to facial displays, individuals expressed emotions through emojis more with those closely related, more in positive contexts than in negative contexts, and more in private than in public contexts. When the expressions were intense, individuals used emojis consistent with the emotional value of the context. Upon attenuating the expressions, this study found that individuals tended to use euphemistic emojis and sent smiling emojis in negative contexts to manage the expressions. Moreover, expressing emotions with emojis was associated with subjective well-being, whereas managing emotions with emojis was weakly associated with depressive symptoms. Together, this study indicates the existence of display rules for emojis, calling for future research on the psychological impact of online emotion norms.

The power of emojis: The impact of a leader's use of positive emojis on members' creativity during computer-mediated communications

The existing literature on emojis offers limited insights on the effects of using emojis in organizational settings, especially in the context of leader-member relationships. The current research examines how a leader's use of positive emojis can influence members' creative performance, a critical determinant of an organization's success and productivity. We find that a leader's use of positive emojis enhances members' creativity and that this effect is mediated by a decrease in members' perception of objectification by the leader. We further find that this impact of a leader's use of positive emojis on members' creativity is stronger when members have a higher level of relationship orientation. Contrary to the popular belief that the use of emojis in a work setting is inappropriate, our findings reveal that leaders' use of emojis has positive impacts on important workplace outcomes. These findings provide important guidelines on how to apply emojis to computer-mediated communications at work by demonstrating the circumstances in which positive consequences of using emojis occur.

World Health Organization is losing online credibility towards health-sensitive topics: Infodemiological analysis of Facebook users' reactions

Background: The scientific infodemic constitutes one of the greatest threats to public health and safety today. The credibility of the main dissemination agencies is an essential tool for adhering to measures to preserve public health. Methods: The study is a longitudinal retrospective conducted on a web platform to investigate netizens' infodemic attitude towards World Health Organization. Reactions such as "like," "love," "affection," "surprise," "sadness," "anger," and "derision" were collected under World Health Organization (WHO) Facebook posts on climate change (from 2019 to 2022) and vaccines (from 2021 to 2022). Descriptive statistics, linear regression, and correlation methods were implemented to identify possible trends and relationships with the COVID-19 vaccination campaign. Results: These findings showed a worrying increase in derision reactions about climate change-related posts (up to 22% in November 2022, with a quadratically growing trend over time since December 2020). Furthermore, infodemic reactions such as anger and especially derision made up the majority of emotional reactions to vaccine-related posts since 2021 and up to 44% of total reactions in November 2022 (median since July 2021=9%, IQR: 4%-14%). Finally, there is evidence of a correlation between the start of the COVID-19 vaccination campaign and public distrust towards the WHO, even for issues unrelated to vaccines such as climate change. Conclusion: Based on what is known in the literature, these preliminary findings signal that the WHO is losing online public credibility towards extremely relevant issues for global health. Infodemiological interventions in accordance with the recent literature are urgently required.

Understanding the multi-modal affective expression of net language in computer-mediated communication

The fast development of technology and the popularity and prevalence of social media are constantly changing people's way of living especially their communication patterns. Computer-mediated communication facilitates human contact. Meanwhile, net language becomes widely accepted by computer-mediated communicators. Originating from the text-based form, net language evolves into a multi-modal physical form with a combination of texts, symbols, emojis, pictures and other forms of messages. The multi-modality of net language gives rise to difficulties for hearers or readers of the computer-mediated communication to understand the hidden message due to the ambiguous and polysemic nature of symbols. To clarify hearer's understanding and ensure the smooth conduct of computer-mediated communication, the conceptual blending theory will be useful in processing the multi-modal net language. With a four-space network and three operation mechanism, the emergent meaning will be constructed.

Study of the characteristics of ear animations used to convey information and emotion in remote communication without web camera

The use of remote communication has grown globally due to the COVID-19 outbreak. In some remote communication, meeting participants use audio only with their web cameras turned off, resulting in a lack of exchange of nonverbal information. In this study, we defined an "ear animation" as an avatar composed of a simple face-like body with no facial features and ear-like parts coming out from this body which can be animated. The purpose of this study was to design the ear animation and evaluate user impressions of it as nonverbal information. While setting conveying information and conveying emotion as dependent variables, the independent variables we set in this study were three different conditions: when ear animations were presented with no sound, when ear animations were presented simultaneously with simple voice, when only voice was played, and three different kinds of content: "agreement", "skepticism", and "disagreement" conveyed from ear animations. Using Two-way ANOVA (repeated) with these variables, we conducted comparative analysis. The results showed that ear animations presented simultaneously with voice had the potential to be a new way of conveying nonverbal information by combining relevant ear animation movement forms.

Emoji as promising tools for emotional evaluation in orthodontics

Background

Emoji are pictograms frequently used in social networks capable of expressing emotions. These tools can provide insights into people's behavior that could not be obtained with the use of textual communication. Recently, emoji have been introduced to various research fields as successful alternatives to word-based questionnaires for measure emotional responses. The objective of this study was to preliminarily evaluate the discriminating ability and relationship of these tools with different occlusal conditions/malocclusions.

Methods

Online surveys were applied to adult individuals (n = 201; mean age = 27.4 ± 5.7; 37.3% males, 62.7% females). Subjects issued acceptance scores (10-point scale) and expressed their emotional status using a 30-emoji list in relation to nine occlusal conditions: C1–crowding, C2–anterior open bite, C3–interincisal diastema, C4–increased overjet + deep bite (Class II div. 1), C5–anterior crossbite (Class III), C6–ideal occlusion, C7–unilateral posterior crossbite, C8–anterior open bite plus bilateral posterior crossbite plus crowding, and C9–deep bite (Class II div. 2). Cochran's Q and McNemar tests were used to compare the frequencies of choice of emoji between conditions. Correspondence analyses were applied to assess the association between occlusal conditions and emoji. Kendall's correlation coefficient was calculated to evaluate the relationship between mean acceptance scores and frequency counts of each emoji.

Results

The frequency of choice between conditions showed a significant difference for 25 of the 30 emoji (P < 0.05), indicating an adequate discriminating ability of these tools. Emoji were grouped predominantly based on their emotional valence (positive/negative) and arousal/activation (high/low). Positive emoji were associated with the most accepted conditions (i.e., C6, C3), while negative emoji with the most rejected ones (i.e., C8, C1, C2). Although only weak, positive correlations between acceptance and positively valenced emoji, and negative correlations between acceptance and negatively valenced emoji were observed (P < 0.05).

Conclusions

Emoji have an adequate discriminatory ability and would allow determining emotional profiles in the face of different occlusal conditions. Further research is necessary to consolidate the use of these tools in an instrument that allows measuring emotional responses.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40510-022-00418-3.

Emoji meanings (pleasure–arousal–dominance dimensions) in consumer research: Between‐country and interpersonal differences

In line with the increasing popularity of emoji, the need for methodological research into these pictorial representations of emotion remains. The present research contributes to this goal by continuing to establish the meaning of emoji and exploring these according to between-country and interpersonal differences. The emoji (n = 12) were selected to span the valence × arousal emotion space, and the PAD model (Pleasure-Arousal-Dominance) was used to establish emoji meaning for the three dimensions, operationalized as measurement on 6 × 3 semantic differentials. Participants in the main study came from three countries-Germany, Singapore, and Malaysia (n = 2465), and a supplementary study included the United Kingdom and New Zealand (n = 600) (subset of four emoji). The results confirmed that emoji meanings according to the PAD model were largely similar between countries (albeit not identical). There were multiple minor significant differences for individual emoji, and where these existed, they often related to the dimension of Arousal, prompting a need for further investigation. Interpersonal differences were examined for gender (men and women), age group (18-45 and 46-69 years old), and frequency of emoji use. Again, significant differences were smaller rather than larger and supported the notion that emoji are generally applicable for multicountry research. However, caution regarding the participants who use emoji infrequently may be warranted. PRACTICAL APPLICATION: The findings from this research will help academics and practitioners who are interested in using emoji for sensory and consumer research (or are already doing so) with more robust interpretations of their findings. For a set of 12 emoji that provide broad coverage of the valence × arousal emotional space, meanings are provided on the three dimensions of the PAD model. The data is collected in five countries and contributes to increased confidence that emoji meanings are by and large similar in these countries.

Emoji Education: How Students Can Help Increase Health Awareness by Making Emojis

Emojis can improve health communication, especially when incorporating emojis into traditionally word-only texts. Beyond improving communication, emojis also offer greater access to health care, especially for vulnerable and marginalized populations with limited health literacy. A recent study found that 94% of patients with limited health literacy preferred health reports with emojis. Moreover, health officials are considering adding emojis to cardiopulmonary resuscitation guidelines and public health guidelines for handwashing. As the world evolves with new technology and new methods of communication, we must also evolve the language and method we use to communicate health information to patients. In this viewpoint, we aim to discuss the methods health care professionals can use to develop novel communication methods using emojis and the benefits of their incorporation into health care communication.

Are emojis ready to promote the WHO 5 moments for hand hygiene in healthcare?

Background

Hand hygiene is universally recognized as a cornerstone measure for the prevention of healthcare-associated infections. Although the WHO “My five Moments for hand hygiene” poster has been used for more than a decade to delineate hand hygiene indications and promote action, adherence levels among healthcare workers are still notoriously low and disquieting. To compensate for the lack of effective hand hygiene communication, we aimed to evaluate emojis as possible surrogates for the non-verbal aspects of hand hygiene behaviour.

Methods

Following a thorough review of the Unicode version 12.0, the most applicable emojis to the terms used in the WHO 5 Moments poster were extracted. We developed a self-administered questionnaire to assess the view of infection prevention and control (IPC) practitioners regarding the use of emojis to show the WHO 5 Moments. Completed questionnaires were collected and analysed to determine the suitability of the existing emojis to illustrate a unified emoji poster. Data were analysed using R (version 3.6.3).

Results

A total of 95 IPC practitioners completed the questionnaire from May to October 2019 from different countries. Of these, 69 (74%) were female, and the mean age of the participants was 44.6 ± 10.87 years. We found appropriate emojis for six of the words used in the poster, including for touching (72%), for patient (63%), for clean (53%), for procedure (56%), for body fluid (58%), and for exposure risk (71%). The existing emojis proposed for the words “hygiene”, “aseptic”, and “surrounding” seemed to be less satisfactory.

Conclusions

In summary, the findings of this study indicate that the existing emojis may not be able to substitute the words used in the WHO 5 Moments poster. Emojis might be helpful to address hand hygiene indications in healthcare that may eventually play a role in promoting this measure. However, emojis should be further studied to choose the most appropriate ones and avoid ambiguity and misinterpretation. More emojis to convey health related messages are needed. We recommend further research in this area to evaluate the effect of using emojis in healthcare-related behaviours.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13756-022-01164-1.

Sentiment and Emotional Analysis of Risk Perception in the Herculaneum Archaeological Park during COVID-19 Pandemic

This paper proposes a methodology for sentiment analysis with emphasis on the emotional aspects of people visiting the Herculaneum Archaeological Park in Italy during the period of the COVID-19 pandemic. The methodology provides a valuable means of continuous feedback on perceived risk of the site. A semantic analysis on Twitter text messages provided input to the risk management team with which they could respond immediately mitigating any apparent risk and reducing the perceived risk. A two-stage approach was adopted to prune a massively large dataset from Twitter. In the first phase, a social network analysis and visualisation tool NodeXL was used to determine the most recurrent words, which was achieved using polarity. This resulted in a suitable subset. In the second phase, the subset was subjected to sentiment and emotion mapping by survey participants. This led to a hybrid approach of using automation for pruning datasets from social media and using a human approach to sentiment and emotion analysis. Whilst suffering from COVID-19, equally, people suffered due to loneliness from isolation dictated by the World Health Organisation. The work revealed that despite such conditions, people's sentiments demonstrated a positive effect from the online discussions on the Herculaneum site.

Motivation to participate in secondary science communication

The rise of social media provides convenient mechanisms for audiences to participate in secondary science communication (SSC). The present study employs the theory of consumption values and theory of planned behavior to predict audiences' SSC intentions. The results indicate that emotional value, social value, altruistic value, attitude, internal perceived behavioral control and subjective norm are significant predictors of audiences' intentions to share or to repost science content on their social media. These results suggest that the theory of consumption values, together with the theory of planned behavior, is a useful framework for understanding SSC behaviors.

Age Differences in the Interpretation of Facial Emojis: Classification on the Arousal-Valence Space

Emojis are universal tools that are frequently used to express people’s emotional states throughout daily communications. They are often applied in various fields of research, such as consumer surveys, as indicators of users’ emotional states. Further analyses of emoji interpretation among people with age are required to ensure the validity of emojis as a metric in such fields of research, thereby reducing misunderstandings. However, details regarding the effect of age on both arousal and valence, as they pertain to the interpretation of emojis, remain unclear. Therefore, in this study, we investigate the effects of the interpretation of facial emojis on the arousal-valence space among people of varying age groups. We conducted an online survey involving 2,000 participants, whereby we employed a nine-point scale to evaluate the valence and arousal levels associated with 74 facial emojis. Based on the two axes of valence and arousal among the age groups involved in this study, emojis are categorized into six similar clusters. For the two negative clusters, i.e., strongly negative and moderately negative sentiments, the group involving middle-aged participants showed significantly higher levels of arousal compared to the group involving young participants. Additionally, not all emojis classified into the aforementioned negative clusters indicate age difference. Based on these results, this study recommends using emojis with no age-related effects on the negative clusters as indices for evaluating human emotions.

Enhancing EFL Learners' Self-Efficacy Beliefs of Learning English with Emoji Feedbacks in CALL: Why and How

Encouraging feedback positively affects learners' self-efficacy; in language learning, self-efficacy predicts language learner performance and behavior. Our research involved three studies to expand knowledge about why and how we can enhance English as a Foreign Language (EFL) learners' self-efficacy beliefs in online settings. In Study 1, based on an online survey with 310 participants, we ascertained the extent to which EFL learners with greater self-efficacy tend to challenge themselves by learning content that requires a proficiency level that is higher than their current proficiency. In Study 2, we recruited 120 EFL learners; the results indicate that positive feedback via emojis embedded in online courses could significantly boost EFL learners' self-efficacy beliefs about learning English. Study 3 involved 35 participants and extended the understanding provided by the first two studies, showing that EFL learners not only like to use emojis for computer-mediated communication (CMC), but also prefer to receive them as feedback. This research adds to knowledge on "why" and "how" we can enhance EFL learners' self-efficacy beliefs in online contexts. We systematically provide empirical evidence regarding the aforementioned issues and demonstrate that positive feedback through emojis has great potential to enhance EFL learners' self-efficacy, even when such feedback is subliminal.

The Multidimensional Lexicon of Emojis: A New Tool to Assess the Emotional Content of Emojis

Emerging studies suggest that emojis can make important contributions to the emotional content and meaning of digital messages. Yet researchers currently lack adequate tools to incorporate emojis into their analyses. To address this gap, we used over 3 million Twitter posts from a period of 17 months and emotion ratings provided by 2,230 human raters to develop and validate the Multidimensional Lexicon of Emojis (MLE). This new lexicon consists of 359 common emojis rated on ten emotion and sentiment dimensions. The MLE is an open-access tool that holds promise for those interested in conducting a comprehensive analysis of the emotional content of digital communication that incorporates emojis and goes beyond the dimensions of negativity and positivity.

The GRANDPACT Project: The Development and Evaluation of an Intergenerational Program for Grandchildren and Their Grandparents to Stimulate Physical Activity and Cognitive Function Using Co-Creation

In recent years, increased attention has been devoted to intergenerational physical activity (PA) programs because they may have several benefits for both children and older adults (e.g., the reduction of ageism). An intergenerational PA program focusing on grandchildren and grandparents in a 'standard' family setting that combines PA and cognitive function is innovative and may hold potential for promoting PA and improving cognitive functioning in both grandchildren and grandparents. The aim of this study is to describe the protocol of the GRANDPACT (GRANDparents and GRANDchildren improve their Physical Activity and Cognitive functions using co-creaTion) Project, focusing on the development of an intergenerational, cognitively enriched, movement program for grandchildren and grandparents using the theoretical framework of the "Behaviour Change Wheel" in combination with a co-creation approach. Two co-creation trajectories will be organized to develop the program, followed by a pilot study to refine the program and an RCT with a pre-test (at baseline), a post-test (after 24 weeks), and a follow-up (after 36 weeks) to measure the outcomes of co-PA, cognitive functions, psychosocial well-being, and the quality of the family relationship ingrandchildren and grandparents. The outcomes will be measured using accelerometry for PA, the Cambridge Neuropsychological Test Automated Battery (CANTAB) for cognitive functions, and questionnaires for the psychological well-being and quality of the family relationship. Co-development with end-users and stakeholders during both co-creation trajectories is expected to result in an effective, attractive, and feasible program. Co-PA is expected to improve PA, cognitive functioning, psychosocial well-being, and the quality of the family relationships between grandchildren and grandparents.