1
|
Zhang H, Yin L, Zhang H. Using subjective emotion, facial expression, and gaze direction to evaluate user affective experience and predict preference when playing single-player games. ERGONOMICS 2024:1-21. [PMID: 38832783 DOI: 10.1080/00140139.2024.2359123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 05/18/2024] [Indexed: 06/05/2024]
Abstract
The affective experience generated when users play computer games can influence their attitude and preference towards the game. Existing evaluation means mainly depend on subjective scales and physiological signals. However, some limitations should not be ignored (e.g. subjective scales are not objective, and physiological signals are complicated). In this paper, we 1) propose a novel method to assess user affective experience when playing single-player games based on pleasure-arousal-dominance (PAD) emotions, facial expressions, and gaze directions, and 2) build an artificial intelligence model to identify user preference. Fifty-four subjects participated in a basketball experiment with three difficulty levels. Their expressions, gaze directions, and subjective PAD emotions were collected and analysed. Experimental results showed that the expression intensities of angry, sad, and neutral, yaw angle degrees of gaze direction, and PAD emotions varied significantly under different difficulties. Besides, the proposed model achieved better performance than other machine-learning algorithms on the collected dataset.
Collapse
Affiliation(s)
- He Zhang
- School of Design, Hunan University, Changsha, China
| | - Lu Yin
- School of Design, Hunan University, Changsha, China
| | | |
Collapse
|
2
|
Yu Y, Wang L, Jiang Y. Gaze-Triggered Communicative Intention Compresses Perceived Temporal Duration. Psychol Sci 2023; 34:1256-1270. [PMID: 37796658 DOI: 10.1177/09567976231198190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/07/2023] Open
Abstract
Eye gaze communicates a person's attentional state and intentions toward objects. Here we demonstrate that this important social signal has the potential to distort time perception of gazed-at objects (N = 70 adults). By using a novel gaze-associated learning paradigm combined with the time-discrimination task, we showed that objects previously associated with others' eye gaze were perceived as significantly shorter in duration than the nonassociated counterparts. The time-compression effect cannot be attributed to general attention allocation because it disappeared when objects were associated with nonsocial attention cues (i.e., arrows). Critically, this effect correlated with observers' autistic traits and vanished when the gazing agent's line of sight was blocked by barriers, reflecting the key role of intention processing triggered by gaze in modulating time perception. Our findings support the existence of a special mechanism tuned to social cues, which can shape our perception of the outer world in time domains.
Collapse
Affiliation(s)
- Yiwen Yu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences
- Department of Psychology, University of Chinese Academy of Sciences
- Chinese Institute for Brain Research
| | - Li Wang
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences
- Department of Psychology, University of Chinese Academy of Sciences
- Chinese Institute for Brain Research
| | - Yi Jiang
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences
- Department of Psychology, University of Chinese Academy of Sciences
- Chinese Institute for Brain Research
| |
Collapse
|
3
|
Gregory SEA, Wang H, Kessler K. EEG alpha and theta signatures of socially and non-socially cued working memory in virtual reality. Soc Cogn Affect Neurosci 2022; 17:531-540. [PMID: 34894148 PMCID: PMC9164206 DOI: 10.1093/scan/nsab123] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Revised: 10/19/2021] [Accepted: 11/20/2021] [Indexed: 11/14/2022] Open
Abstract
In this preregistered study (https://osf.io/s4rm9) we investigated the behavioural and neurological [electroencephalography; alpha (attention) and theta (effort)] effects of dynamic non-predictive social and non-social cues on working memory. In a virtual environment realistic human-avatars dynamically looked to the left or right side of a table. A moving stick served as a non-social control cue. Kitchen items were presented in the valid cued or invalid un-cued location for encoding. Behavioural findings showed a similar influence of the cues on working memory performance. Alpha power changes were equivalent for the cues during cueing and encoding, reflecting similar attentional processing. However, theta power changes revealed different patterns for the cues. Theta power increased more strongly for the non-social cue compared to the social cue during initial cueing. Furthermore, while for the non-social cue there was a significantly larger increase in theta power for valid compared to invalid conditions during encoding, this was reversed for the social cue, with a significantly larger increase in theta power for the invalid compared to valid conditions, indicating differences in the cues' effects on cognitive effort. Therefore, while social and non-social attention cues impact working memory performance in a similar fashion, the underlying neural mechanisms appear to differ.
Collapse
Affiliation(s)
- Samantha E A Gregory
- Department of Psychology, University of Salford, Salford M5 4WT, UK
- Institute of Health and Neurodevelopment, Aston Laboratory for Immersive Virtual Environments, Aston University, Birmingham B4 7ET, UK
| | - Hongfang Wang
- Institute of Health and Neurodevelopment, Aston Laboratory for Immersive Virtual Environments, Aston University, Birmingham B4 7ET, UK
| | - Klaus Kessler
- Institute of Health and Neurodevelopment, Aston Laboratory for Immersive Virtual Environments, Aston University, Birmingham B4 7ET, UK
- School of Psychology, University College Dublin, Dublin D04 V1W8, Ireland
| |
Collapse
|
4
|
Terenzi D, Liu L, Bellucci G, Park SQ. Determinants and modulators of human social decisions. Neurosci Biobehav Rev 2021; 128:383-393. [PMID: 34216653 DOI: 10.1016/j.neubiorev.2021.06.041] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Revised: 06/21/2021] [Accepted: 06/28/2021] [Indexed: 12/17/2022]
Abstract
Social decision making is a highly complex process that involves diverse cognitive mechanisms, and it is driven by the precise processing of information from both the environment and from the internal state. On the one hand, successful social decisions require close monitoring of others' behavior, in order to track their intentions; this can guide not only decisions involving other people, but also one's own choices and preferences. On the other hand, internal states such as own reward or changes in hormonal and neurotransmitter states shape social decisions and their underlying neural function. Here, we review the current literature on modulators and determinants of human social decisions.
Collapse
Affiliation(s)
- Damiano Terenzi
- Department of Decision Neuroscience and Nutrition, German Institute of Human Nutrition (DIfE), Potsdam-Rehbrücke, Germany; Charité-Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, 10117, Berlin, Germany; Berlin Institute of Health, Neuroscience Research Center, 10117, Berlin, Germany; Deutsches Zentrum für Diabetes, Neuherberg, Germany.
| | - Lu Liu
- Department of Decision Neuroscience and Nutrition, German Institute of Human Nutrition (DIfE), Potsdam-Rehbrücke, Germany; Charité-Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, 10117, Berlin, Germany; Berlin Institute of Health, Neuroscience Research Center, 10117, Berlin, Germany; Deutsches Zentrum für Diabetes, Neuherberg, Germany; Department of Psychology, Sun Yat-sen University, Guangzhou, China.
| | - Gabriele Bellucci
- Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics Tübingen, Germany
| | - Soyoung Q Park
- Department of Decision Neuroscience and Nutrition, German Institute of Human Nutrition (DIfE), Potsdam-Rehbrücke, Germany; Charité-Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, 10117, Berlin, Germany; Berlin Institute of Health, Neuroscience Research Center, 10117, Berlin, Germany; Deutsches Zentrum für Diabetes, Neuherberg, Germany
| |
Collapse
|
5
|
Neurogastronomy as a Tool for Evaluating Emotions and Visual Preferences of Selected Food Served in Different Ways. Foods 2021; 10:foods10020354. [PMID: 33562287 PMCID: PMC7914587 DOI: 10.3390/foods10020354] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2021] [Revised: 01/28/2021] [Accepted: 02/04/2021] [Indexed: 01/22/2023] Open
Abstract
The appearance of food provides certain expectations regarding the harmonization of taste, delicacy, and overall quality, which subsequently affects not only the intake itself but also many other features of the behavior of customers of catering facilities. The main goal of this article is to find out what effect the visual design of food (waffles) prepared from the same ingredients and served in three different ways-a stone plate, street food style, and a white classic plate-has on the consumer's preferences. In addition to the classic tablet assistance personal interview (TAPI) tools, biometric methods such as eye tracking and face reading were used in order to obtain unconscious feedback. During testing, air quality in the room by means of the Extech device and the influence of the visual design of food on the perception of its smell were checked. At the end of the paper, we point out the importance of using classical feedback collection techniques (TAPI) and their extension in measuring subconscious reactions based on monitoring the eye movements and facial expressions of the respondents, which provides a whole new perspective on the perception of visual design and serving food as well as more effective targeting and use of corporate resources.
Collapse
|
6
|
Wang Q, Ma L, Huang L, Wang L. Effect of the model eye gaze direction on consumer information processing: a consideration of gender differences. ONLINE INFORMATION REVIEW 2020. [DOI: 10.1108/oir-01-2020-0025] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PurposeThe purpose of this paper aims to investigate the effect of a model's eye gaze direction on the information processing behavior of consumers varying based on their gender.Design/methodology/approachAn eye-tracking experiment and a memory test are conducted to test the research hypotheses.FindingsCompared to an averted gaze, a model with a direct gaze attracts more attention to the model's face among male consumers, leading to deeper processing. However, the findings show that when a model displays a direct gaze rather than an averted gaze, female consumers pay more attention to the brand name, thus leading to deeper processing.Originality/valueThis study contributes to not only the existing eye gaze direction literature by integrating the facilitative effect of direct gaze and considering the moderating role of consumer gender on consumer information processing but also the literature concerning the selectivity hypothesis by providing evidence of gender differences in information processing. Moreover, this study offers practical insights to practitioners regarding how to design appealing webpages to satisfy consumers of different genders.Peer reviewThe peer review history for this article is available at: https://publons.com/publon/10.1108/OIR-01-2020-0025
Collapse
|
7
|
Incidental learning of group trust: Predictive gaze cue matters. Sci Rep 2020; 10:7789. [PMID: 32385309 PMCID: PMC7210988 DOI: 10.1038/s41598-020-64719-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2019] [Accepted: 04/21/2020] [Indexed: 12/02/2022] Open
Abstract
Human gaze is a subtle cue to deliver information and helps impression formation in social interactions. People automatically follow the gaze direction of others and shift their attention accordingly, as well as determine the trustworthiness of others based on the predictable validity of their gaze behavior, yet it remains unclear how this works at the collective level. Therefore, the current study is the first to explore the incidental learning of trust from a group’s gaze behavior. To simulate different patterns of perceiving collective information in real life, two ways of presenting group member gazes were used in the object categorization task, the simultaneous way in Experiment 1 and the sequential way in Experiment 3, and a sampling strategy was ruled out in Experiment 2. Converging findings in experiments demonstrated a typical gaze-cueing effect, and more importantly, the Predictive-valid group obtained more trust compared to the Predictive-invalid group. To enrich and expand the applicability of the incidental trust learning effect from gazes, the current study provides supportive evidence at the collective level, confirming that humans have an efficient capability to process gaze information of groups.
Collapse
|