1
|
Cano Porras D, Louwerse MM. Face to face: The eyes as an anchor in multimodal communication. Cognition 2025; 256:106047. [PMID: 39724801 DOI: 10.1016/j.cognition.2024.106047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 10/16/2024] [Accepted: 12/11/2024] [Indexed: 12/28/2024]
Abstract
Making eye contact with our conversational partners is what is most common in multimodal communication. Yet, little is known about this behavior. Prior studies have reported different findings on what we look at in the narrator's face. Some studies show eye gaze is usually focused on our conversational partner's eyes, other studies have shown evidence for eye gaze primarily on the narrator's mouth, and yet others find evidence for fixations on the narrator's nose bridge perhaps as a transition for eye gaze between the eyes and mouth. The current study aimed to shed light on these different findings by investigating eye gaze on a narrator's face in a fixed cognitive task. Experiment 1 monitored participants' eye gaze when looking at videos of a male and female human narrator. Experiment 2 used a virtual human, allowing manipulation of different parts of the narrator's face to validate the findings in Experiment 1. Gaze behavior on the human faces (Experiment 1) and the virtual human face (Experiment 2) of the narrator was similar, with the narrator's eyes attracting most fixations seemingly serving as an anchor for communication, particularly at the start and the end of a conversation. The mouth, in turn, served as a communicative cue when eye contact has been established. When lip movements were impaired in the virtual human, the eyes immediately took over as the anchor again. These findings can be explained by the theoretical framework of action ladders in multimodal language use. They shed light on cognitive and social psychological aspects of human-human multimodal communication, both in human and embodied conversational agents.
Collapse
Affiliation(s)
- Desiderio Cano Porras
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, the Netherlands.
| | - Max M Louwerse
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, the Netherlands
| |
Collapse
|
2
|
Kerzel D, Prigoda N, Renaud O. Do you look longer at attractive faces? It depends on what you are looking for. Iperception 2024; 15:20416695241286413. [PMID: 39421799 PMCID: PMC11483818 DOI: 10.1177/20416695241286413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2024] [Accepted: 09/04/2024] [Indexed: 10/19/2024] Open
Abstract
Evolutionary psychology suggests that we are attuned to relevant information in the environment. For example, attention may be attracted by physical beauty because it is important for finding a partner with good reproductive health. Consistently, previous studies found that attention stayed longer on attractive than unattractive faces. We asked whether this tendency was automatic and varied participants' implicit search intentions to be either consistent or inconsistent with the presumably automatic tendency to attend to attractive faces. To create an implicit intention to look at attractive faces, participants searched for a happy face in an array of neutral faces because happy faces are rated as more attractive than neutral faces. To create the opposite intention to look at unattractive faces, participants searched for a disgusted or sad face because disgusted or sad faces are rated as less attractive than neutral faces. We found longer fixation durations on attractive faces when participants searched for happy faces. When participants searched for disgusted or sad faces, however, fixation durations were longer on unattractive faces. Thus, the search task determined whether attractive faces were looked at longer. The tendency to attend to attractive faces is therefore not automatic but can be overruled by search intentions.
Collapse
Affiliation(s)
- Dirk Kerzel
- Department of Psychology, University of Geneva, Genève, Switzerland
| | - Nicolas Prigoda
- Department of Psychology, University of Geneva, Genève, Switzerland
| | - Olivier Renaud
- Department of Psychology, University of Geneva, Genève, Switzerland
| |
Collapse
|
3
|
Martinez-Cedillo AP, Foulsham T. Don't look now! Social elements are harder to avoid during scene viewing. Vision Res 2024; 216:108356. [PMID: 38184917 DOI: 10.1016/j.visres.2023.108356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 11/09/2023] [Accepted: 12/28/2023] [Indexed: 01/09/2024]
Abstract
Regions of social importance (i.e., other people) attract attention in real world scenes, but it is unclear how automatic this bias is and how it might interact with other guidance factors. To investigate this, we recorded eye movements while participants were explicitly instructed to avoid looking at one of two objects in a scene (either a person or a non-social object). The results showed that, while participants could follow these instructions, they still made errors (especially on the first saccade). Crucially, there were about twice as many erroneous looks towards the person than there were towards the other object. This indicates that it is hard to suppress the prioritization of social information during scene viewing, with implications for how quickly and automatically this information is perceived and attended to.
Collapse
Affiliation(s)
- A P Martinez-Cedillo
- Department of Psychology, University of York, York YO10 5DD, England; Department of Psychology, University of Essex, Wivenhoe Park, Colchester, Essex CO4 3SQ, England.
| | - T Foulsham
- Department of Psychology, University of Essex, Wivenhoe Park, Colchester, Essex CO4 3SQ, England
| |
Collapse
|
4
|
Zajenkowska A, Duda E, Lawrence C, Bodecka M. Attributional and attentional patterns in the perception of ambiguous harmful encounters involving peer and authority figures. CURRENT ISSUES IN PERSONALITY PSYCHOLOGY 2023; 12:193-201. [PMID: 39184906 PMCID: PMC11339846 DOI: 10.5114/cipp/166751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 02/09/2023] [Accepted: 05/31/2023] [Indexed: 08/27/2024] Open
Abstract
BACKGROUND Self-construal influences the way people ascribe blame to victims, but it is not clear whether the same applies to harm doers, especially those in a position of authority. PARTICIPANTS AND PROCEDURE We examined (N = 122, men n = 60) participants' ascriptions of both blame and intentionality to harm doers (authority figure versus peer) while priming self-construal (relational versus individual self). Using eye-tracking, we explored whether priming relational self, compared to individual self, affects the allocation of attention to faces versus objects. RESULTS Although no effects of priming were found, the type of harm doer influenced the way people interpreted harmful social encounters. Participants attributed both greater intentionality and blame to peer than authority perpetrators. Also, in the case of peer perpetrators, blame ascription was higher than judgements of intentionality, which was the opposite pattern for authority perpetrators, where judgements of intentionality were greater than ascribed blame. In regard to encoding, participants independently of the type of harm doer looked significantly longer at faces than at objects in violent scenes. CONCLUSIONS Our results suggest the status of perpetrator influences judgements of harm independently of intrapersonal factors, such as primed self-construal. Moreover, people perceived as authority figures are not blamed for the hurtful action, despite attributed intentionality.
Collapse
Affiliation(s)
| | - Ewa Duda
- Maria Grzegorzewska University, Warsaw, Poland
| | | | - Marta Bodecka
- Maria Grzegorzewska University, Warsaw, Poland
- Nottingham University, Nottingham, United Kingdom
| |
Collapse
|
5
|
Li S, Ding R, Zhao D, Zhou X, Zhan B, Luo W. Processing of emotions expressed through eye regions attenuates attentional blink. Int J Psychophysiol 2022; 182:1-11. [DOI: 10.1016/j.ijpsycho.2022.07.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 07/13/2022] [Accepted: 07/27/2022] [Indexed: 10/16/2022]
|
6
|
Maran T, Hoffmann A, Sachse P. Early lifetime experience of urban living predicts social attention in real world crowds. Cognition 2022; 225:105099. [PMID: 35334252 DOI: 10.1016/j.cognition.2022.105099] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 02/14/2022] [Accepted: 03/15/2022] [Indexed: 11/03/2022]
Abstract
More than half of the world's population is currently living in cities, with more and more people moving to densely populated areas. The experience of growing up and living in crowded environments might influence the way we explore our social environment, mainly how we attend to others. Yet, we know little about how urbanicity affects this vital function of our social life. In two studies, we use mobile eye-tracking to measure participants' social attention, while walking through a shopping mall. Results show that social density of participants' native place impacts how frequently they look at passing strangers. People who experienced more city living from birth to early adolescence, attend more to strangers' faces than their rural counterparts. Our findings demonstrate that the early experience of urban upbringing configures social attention in adulthood. The urbanicity-related bias towards social gazing might reflect a more efficient processing of social information in urban natives.
Collapse
Affiliation(s)
- Thomas Maran
- University of Innsbruck, Department of Strategic Management and Leadership, Universitätsstraße 15, 6020 Innsbruck, Austria; LeadershipWerk, 9490 Vaduz, Liechtenstein.
| | - Alexandra Hoffmann
- University of Innsbruck, Department of Psychology, Innrain 52a, 6020 Innsbruck, Austria.
| | - Pierre Sachse
- University of Innsbruck, Department of Psychology, Innrain 52a, 6020 Innsbruck, Austria.
| |
Collapse
|
7
|
Svalina A, Vuollo V, Serlo W, Sinikumpu JJ, Silvola AS, Salokorpi N. Craniofacial characteristics and cosmetic satisfaction of patients with sagittal and metopic synostosis: a case-control study using 3D photogrammetric imaging. Childs Nerv Syst 2022; 38:781-788. [PMID: 34940889 PMCID: PMC8940850 DOI: 10.1007/s00381-021-05434-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2021] [Accepted: 12/09/2021] [Indexed: 11/29/2022]
Abstract
PURPOSE The aim of this study was to investigate the craniofacial and aesthetic characteristics of adult metopic and sagittal craniosynostosis patients operated on in early childhood compared to controls. The goal was to find objective measurements that would correlate with the patient's subjective self-evaluation of their own cosmetic appearance. METHODS The study population consisted of 49 patients from whom 41 had premature fusion of the sagittal and in 8 of metopic suture. There were 65 age and gender matching controls from The Finish National Register. The 3D photogrammetric models were created from all patients and controls. The images were analysed using Rapidform 2006. Facial landmarks were set by the standard Farkas points. Facial symmetry parameters were calculated by using the landmarks and the mirror shell of the face. Aesthetic evaluation was done from standard photographs using panels. Subjective satisfaction with one's own appearance was evaluated using questionnaires. RESULTS Patients had the greatest asymmetry in the forehead area when compared to controls (symmetry percentage 59% versus 66%, p = 0.013). In the control group, the gap between the eyes was smaller than in the case group, resulting in an absolute 2 mm difference (p = 0.003). The area of the chin and the landmarks were more located on the left side in the patient group, resulting in up to a 1.1 mm difference between the groups (p = 0.003). Only a weak association was found between craniofacial symmetry and appearance evaluations. CONCLUSION Patients operated on because of sagittal and metopic synostoses were found to have facial asymmetry at long follow-up. However, the differences were < 3 mm and not clinically important. The long-term aesthetical outcome of the surgery performed because of sagittal or metopic craniosynostosis based on the 3D image evaluation was good.
Collapse
Affiliation(s)
- Anja Svalina
- Department of Neurosurgery, Oulu University Hospital, Oulu, Finland. .,Medical Research Center, Oulu University Hospital, Oulu, Finland.
| | - Ville Vuollo
- Medical Research Center, Oulu University Hospital, Oulu, Finland ,Faculty of Medicine, Research Unit of Oral Health Sciences, University of Oulu, Oulu, Finland
| | - Willy Serlo
- Medical Research Center, Oulu University Hospital, Oulu, Finland ,Department of Children and Adolescent, Oulu University Hospital, Oulu, Finland ,PEDEGO Research Group, University of Oulu, Oulu, Finland
| | - Juha-Jaakko Sinikumpu
- Medical Research Center, Oulu University Hospital, Oulu, Finland ,Department of Children and Adolescent, Oulu University Hospital, Oulu, Finland ,PEDEGO Research Group, University of Oulu, Oulu, Finland
| | - Anna-Sofia Silvola
- Medical Research Center, Oulu University Hospital, Oulu, Finland ,Department of Orthodontics, Faculty of Medicine, Oral Health Sciences, University of Oulu, Oulu, Finland
| | - Niina Salokorpi
- Department of Neurosurgery, Oulu University Hospital, Oulu, Finland ,Medical Research Center, Oulu University Hospital, Oulu, Finland ,Research Unit of Clinical Neuroscience, Oulu University Hospital and University of Oulu, Oulu, Finland
| |
Collapse
|
8
|
Automatic gaze to the nose region cannot be inhibited during observation of facial expression in Eastern observers. Conscious Cogn 2021; 94:103179. [PMID: 34364139 DOI: 10.1016/j.concog.2021.103179] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2020] [Revised: 07/24/2021] [Accepted: 07/24/2021] [Indexed: 11/22/2022]
Abstract
Humans can extract a great deal of information about others very quickly. This is partly because the face automatically captures observers' attention. Specifically, the eyes can attract overt attention. Although it has been reported that not only the eyes but also the nose can capture initial oculomotor movement in Eastern observers, its generalizability remains unknown. In this study, we applied the "don't look" paradigm wherein participants are asked not to fixate on a specific facial region (i.e., eyes, nose, and mouth) during an emotion recognition task with upright (Experiment 1) and inverted (Experiment 2) faces. In both experiments, we found that participants were less able to inhibit the initial part of their fixations to the nose, which can be interpreted as the nose automatically capturing attention. Along with previous studies, our overt attention tends to be attracted by a part of the face, which is the nose region in Easterner observers.
Collapse
|
9
|
Where Do We Look? Assessing Gaze Patterns in Cosmetic Face-Lift Surgery with Eye Tracking Technology. Plast Reconstr Surg 2020; 146:820e-821e. [PMID: 33234990 DOI: 10.1097/prs.0000000000007374] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
10
|
Carter BT, Luke SG. Best practices in eye tracking research. Int J Psychophysiol 2020; 155:49-62. [PMID: 32504653 DOI: 10.1016/j.ijpsycho.2020.05.010] [Citation(s) in RCA: 100] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Revised: 05/26/2020] [Accepted: 05/27/2020] [Indexed: 12/14/2022]
Abstract
This guide describes best practices in using eye tracking technology for research in a variety of disciplines. A basic outline of the anatomy and physiology of the eyes and of eye movements is provided, along with a description of the sorts of research questions eye tracking can address. We then explain how eye tracking technology works and what sorts of data it generates, and provide guidance on how to select and use an eye tracker as well as selecting appropriate eye tracking measures. Challenges to the validity of eye tracking studies are described, along with recommendations for overcoming these challenges. We then outline correct reporting standards for eye tracking studies.
Collapse
|
11
|
|
12
|
In the eye of a leader: Eye-directed gazing shapes perceptions of leaders' charisma. THE LEADERSHIP QUARTERLY 2019. [DOI: 10.1016/j.leaqua.2019.101337] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|