1
|
Broda MD, Borovska P, de Haas B. Individual differences in face salience and rapid face saccades. J Vis 2024; 24:16. [PMID: 38913016 PMCID: PMC11204136 DOI: 10.1167/jov.24.6.16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 04/04/2024] [Indexed: 06/25/2024] Open
Abstract
Humans saccade to faces in their periphery faster than to other types of objects. Previous research has highlighted the potential importance of the upper face region in this phenomenon, but it remains unclear whether this is driven by the eye region. Similarly, it remains unclear whether such rapid saccades are exclusive to faces or generalize to other semantically salient stimuli. Furthermore, it is unknown whether individuals differ in their face-specific saccadic reaction times and, if so, whether such differences could be linked to differences in face fixations during free viewing. To explore these open questions, we invited 77 participants to perform a saccadic choice task in which we contrasted faces as well as other salient objects, particularly isolated face features and text, with cars. Additionally, participants freely viewed 700 images of complex natural scenes in a separate session, which allowed us to determine the individual proportion of first fixations falling on faces. For the saccadic choice task, we found advantages for all categories of interest over cars. However, this effect was most pronounced for images of full faces. Full faces also elicited faster saccades compared with eyes, showing that isolated eye regions are not sufficient to elicit face-like responses. Additionally, we found consistent individual differences in saccadic reaction times toward faces that weakly correlated with face salience during free viewing. Our results suggest a link between semantic salience and rapid detection, but underscore the unique status of faces. Further research is needed to resolve the mechanisms underlying rapid face saccades.
Collapse
Affiliation(s)
- Maximilian Davide Broda
- Experimental Psychology, Justus Liebig University Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB), University of Marburg and Justus Liebig University, Giessen, Germany
| | - Petra Borovska
- Experimental Psychology, Justus Liebig University Giessen, Germany
| | - Benjamin de Haas
- Experimental Psychology, Justus Liebig University Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB), University of Marburg and Justus Liebig University, Giessen, Germany
| |
Collapse
|
2
|
Monteiro LCP, Ripardo RC, Torro-Alves N, Souza GS. Facial morphometric differences across face databases: influence of ethnicities and sex. Front Neurosci 2023; 17:1130867. [PMID: 37404467 PMCID: PMC10315459 DOI: 10.3389/fnins.2023.1130867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 06/05/2023] [Indexed: 07/06/2023] Open
Abstract
The scientific need for standardized, high-quality facial stimuli has driven the creation of several face image databases in recent years. These stimuli are particularly important in facial asymmetry research. However, previous studies have reported facial anthropometric differences across a variety of ethnicities. This highlights the need to investigate whether these differences can also impact the use of face image databases, particularly in facial asymmetry research. In this study, we investigated facial asymmetry-based morphometric differences between the multi-ethnic Chicago Face Database (CFD) and the LACOP Face Database, which is composed of Brazilian subjects. We found reliable differences in facial asymmetry between the two databases, which were related to ethnic groups. Specifically, differences in eye and mouth asymmetry seem to drive these differences. The asymmetry-based morphometric differences among databases and ethnicities found in this study reinforce the necessity of creating multi-ethnic face databases.
Collapse
Affiliation(s)
- Luis Carlos Pereira Monteiro
- Neuroscience and Cell Biology Graduate Program, Institute of Biological Sciences, Federal University of Pará, Belém, Brazil
- Center for Tropical Medicine, Federal University of Pará, Belém, Brazil
| | - Rachel Coelho Ripardo
- Neuroscience and Behavior Graduate Program, Center for Behavioral Theory and Research, Federal University of Pará, Belém, Brazil
| | - Nelson Torro-Alves
- Department of Psychology, Federal University of Paraíba, João Pessoa, Brazil
| | - Givago Silva Souza
- Neuroscience and Cell Biology Graduate Program, Institute of Biological Sciences, Federal University of Pará, Belém, Brazil
- Center for Tropical Medicine, Federal University of Pará, Belém, Brazil
| |
Collapse
|
3
|
Lalitharatne TD, Costi L, Hashem R, Nisky I, Jack RE, Nanayakkara T, Iida F. Face mediated human–robot interaction for remote medical examination. Sci Rep 2022; 12:12592. [PMID: 35869154 PMCID: PMC9307637 DOI: 10.1038/s41598-022-16643-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Accepted: 07/13/2022] [Indexed: 11/29/2022] Open
Abstract
Realtime visual feedback from consequences of actions is useful for future safety-critical human–robot interaction applications such as remote physical examination of patients. Given multiple formats to present visual feedback, using face as feedback for mediating human–robot interaction in remote examination remains understudied. Here we describe a face mediated human–robot interaction approach for remote palpation. It builds upon a robodoctor–robopatient platform where user can palpate on the robopatient to remotely control the robodoctor to diagnose a patient. A tactile sensor array mounted on the end effector of the robodoctor measures the haptic response of the patient under diagnosis and transfers it to the robopatient to render pain facial expressions in response to palpation forces. We compare this approach against a direct presentation of tactile sensor data in a visual tactile map. As feedback, the former has the advantage of recruiting advanced human capabilities to decode expressions on a human face whereas the later has the advantage of being able to present details such as intensity and spatial information of palpation. In a user study, we compare these two approaches in a teleoperated palpation task to find the hard nodule embedded in the remote abdominal phantom. We show that the face mediated human–robot interaction approach leads to statistically significant improvements in localizing the hard nodule without compromising the nodule position estimation time. We highlight the inherent power of facial expressions as communicative signals to enhance the utility and effectiveness of human–robot interaction in remote medical examinations.
Collapse
|
4
|
Carlaw BN, Huebert AM, McNeely-White KL, Rhodes MG, Cleary AM. Detecting a familiar person behind the surgical mask: recognition without identification among masked versus sunglasses-covered faces. Cogn Res Princ Implic 2022; 7:90. [PMID: 36195737 PMCID: PMC9531854 DOI: 10.1186/s41235-022-00440-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 09/25/2022] [Indexed: 11/05/2022] Open
Abstract
Previous research has shown that even when famous people’s identities cannot be discerned from faces that have been filtered with monochromatic noise, these unidentifiable famous faces still tend to receive higher familiarity ratings than similarly filtered non-famous faces. Experiment 1 investigated whether a similar face recognition without identification effect would occur among faces whose identification was hindered through the wearing of a surgical mask. Among a mixture of famous and non-famous faces wearing surgical masks and hoods, participants rated how familiar each person seemed then attempted to identify the person. Though surgical masks significantly impaired identification of the famous faces, unidentified masked famous faces received higher familiarity ratings on average than the non-famous masked faces, suggesting that a sense of familiarity could still occur even when identification was impaired by the mask. Experiment 2 compared faces covered by surgical masks with faces covered by sunglasses. Though sunglasses impaired face identification more than surgical masks, the magnitude of the face recognition without identification effect was the same in both cases. This pattern suggests that holistic face processing is not a requirement for the sense of familiarity with a face, and that different facial feature types can contribute.
Collapse
Affiliation(s)
- Brooke N. Carlaw
- grid.47894.360000 0004 1936 8083Department of Psychology, Colorado State University, 1876 Campus Delivery, Fort Collins, CO 80523-1876 USA
| | - Andrew M. Huebert
- grid.47894.360000 0004 1936 8083Department of Psychology, Colorado State University, 1876 Campus Delivery, Fort Collins, CO 80523-1876 USA
| | - Katherine L. McNeely-White
- grid.27860.3b0000 0004 1936 9684Department of Neurology, University of California Davis, Sacramento, CA 95816 USA
| | - Matthew G. Rhodes
- grid.47894.360000 0004 1936 8083Department of Psychology, Colorado State University, 1876 Campus Delivery, Fort Collins, CO 80523-1876 USA
| | - Anne M. Cleary
- grid.47894.360000 0004 1936 8083Department of Psychology, Colorado State University, 1876 Campus Delivery, Fort Collins, CO 80523-1876 USA
| |
Collapse
|
5
|
Gupta S, Kumar P, Tekchandani RK. Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:11365-11394. [PMID: 36105662 PMCID: PMC9461440 DOI: 10.1007/s11042-022-13558-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Revised: 05/14/2022] [Accepted: 07/14/2022] [Indexed: 06/15/2023]
Abstract
The dramatic impact of the COVID-19 pandemic has resulted in the closure of physical classrooms and teaching methods being shifted to the online medium.To make the online learning environment more interactive, just like traditional offline classrooms, it is essential to ensure the proper engagement of students during online learning sessions.This paper proposes a deep learning-based approach using facial emotions to detect the real-time engagement of online learners. This is done by analysing the students' facial expressions to classify their emotions throughout the online learning session. The facial emotion recognition information is used to calculate the engagement index (EI) to predict two engagement states "Engaged" and "Disengaged". Different deep learning models such as Inception-V3, VGG19 and ResNet-50 are evaluated and compared to get the best predictive classification model for real-time engagement detection. Varied benchmarked datasets such as FER-2013, CK+ and RAF-DB are used to gauge the overall performance and accuracy of the proposed system. Experimental results showed that the proposed system achieves an accuracy of 89.11%, 90.14% and 92.32% for Inception-V3, VGG19 and ResNet-50, respectively, on benchmarked datasets and our own created dataset. ResNet-50 outperforms all others with an accuracy of 92.3% for facial emotions classification in real-time learning scenarios.
Collapse
Affiliation(s)
- Swadha Gupta
- Department of Computer Science and Engineering, Thapar Institute of Engineering and Technology, Patiala, India
| | - Parteek Kumar
- Department of Computer Science and Engineering, Thapar Institute of Engineering and Technology, Patiala, India
| | - Raj Kumar Tekchandani
- Department of Computer Science and Engineering, Thapar Institute of Engineering and Technology, Patiala, India
| |
Collapse
|
6
|
Alalawy H, Abdulnabi HA. The use of virtual surgical planning and 3D printing in reconstruction of a mandibular symphesial defect, challenges and gains: A case report. ADVANCES IN ORAL AND MAXILLOFACIAL SURGERY 2022. [DOI: 10.1016/j.adoms.2021.100235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022] Open
|
7
|
Han NX, Chakravarthula PN, Eckstein MP. Peripheral facial features guiding eye movements and reducing fixational variability. J Vis 2021; 21:7. [PMID: 34347018 PMCID: PMC8340657 DOI: 10.1167/jov.21.8.7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Face processing is a fast and efficient process due to its evolutionary and social importance. A majority of people direct their first eye movement to a featureless point just below the eyes that maximizes accuracy in recognizing a person's identity and gender. Yet, the exact properties or features of the face that guide the first eye movements and reduce fixational variability are unknown. Here, we manipulated the presence of the facial features and the spatial configuration of features to investigate their effect on the location and variability of first and second fixations to peripherally presented faces. Our results showed that observers can utilize the face outline, individual facial features, and feature spatial configuration to guide the first eye movements to their preferred point of fixation. The eyes have a preferential role in guiding the first eye movements and reducing fixation variability. Eliminating the eyes or altering their position had the greatest influence on the location and variability of fixations and resulted in the largest detriment to face identification performance. The other internal features (nose and mouth) also contribute to reducing fixation variability. A subsequent experiment measuring detection of single features showed that the eyes have the highest detectability (relative to other features) in the visual periphery providing a strong sensory signal to guide the oculomotor system. Together, the results suggest a flexible multiple-cue approach that might be a robust solution to cope with how the varying eccentricities in the real world influence the ability to resolve individual feature properties and the preferential role of the eyes.
Collapse
Affiliation(s)
- Nicole X Han
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, USA.,
| | - Puneeth N Chakravarthula
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, USA.,
| | - Miguel P Eckstein
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, USA.,
| |
Collapse
|
8
|
Crawford A, Freundlich S, Zhang J, McGhee CNJ. Iris reconstruction: A perspective on the modern surgical armamentarium. Oman J Ophthalmol 2021; 14:69-73. [PMID: 34345138 PMCID: PMC8300278 DOI: 10.4103/ojo.ojo_160_21] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Accepted: 05/21/2021] [Indexed: 11/16/2022] Open
Abstract
The surgical reconstruction of eyes with iris defects is almost invariably complex and challenging. A number of prosthetic iris devices are available including large-incision, rigid diaphragm, aniridic intraocular lens style devices, small-incision devices incorporating a capsular ring, and flexible, customized, small-incision iris prostheses. The surgical techniques for rehabilitation are dictated by the configuration of the iris defect, the presence of concurrent ocular pathology, and the functional complaint of the patient. Successful rehabilitation requires careful surgical planning and appropriate patient selection. Nonetheless, endowed with the modern surgical armamentarium, the reconstructive surgeon may achieve significant functional and cosmetic improvement.
Collapse
Affiliation(s)
- Alexandra Crawford
- Department of Ophthalmology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand.,Department of Ophthalmology, Greenlane Clinical Centre, Auckland District Health Board, Auckland, New Zealand
| | - Simone Freundlich
- Department of Ophthalmology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand
| | - Jie Zhang
- Department of Ophthalmology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand
| | - Charles Ninian John McGhee
- Department of Ophthalmology, New Zealand National Eye Centre, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand.,Department of Ophthalmology, Greenlane Clinical Centre, Auckland District Health Board, Auckland, New Zealand
| |
Collapse
|