1
|
Schmuck J, Voltz E, Gibbons H. You're Beautiful When You Smile: Event-Related Brain Potential (ERP) Evidence of Early Opposite-Gender Bias in Happy Faces. Brain Sci 2024; 14:739. [PMID: 39199434 PMCID: PMC11353154 DOI: 10.3390/brainsci14080739] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Revised: 07/18/2024] [Accepted: 07/22/2024] [Indexed: 09/01/2024] Open
Abstract
Studies of social cognition have shown gender differences regarding human face processing. One interesting finding is the enhanced processing of opposite-gender faces at different time stages, as revealed by event-related brain potentials. Crucially, from an evolutionary perspective, such a bias might interact with the emotional expression of the face. To investigate this, 100 participants (50 female, 50 male) completed an expression-detection task while their EEG was recorded. In three blocks, fearful, happy and neutral faces (female and male) were randomly presented, with participants instructed to respond to only one predefined target expression level in each block. Using linear mixed models, we observed both faster reaction times as well as larger P1 and late positive potential (LPP) amplitudes for women compared to men, supporting a generally greater female interest in faces. Highly interestingly, the analysis revealed an opposite-gender bias at P1 for happy target faces. This suggests that participants' attentional templates may include more opposite-gender facial features when selectively attending to happy faces. While N170 was influenced by neither the face nor the participant gender, LPP was modulated by the face gender and specific combinations of the target status, face gender and expression, which is interpreted in the context of gender-emotion stereotypes. Future research should further investigate this expression and attention dependency of early opposite-gender biases.
Collapse
Affiliation(s)
| | | | - Henning Gibbons
- Department of Psychology, University of Bonn, Kaiser-Karl-Ring 9, 53111 Bonn, Germany; (J.S.); (E.V.)
| |
Collapse
|
2
|
Volfart A, Rossion B. The neuropsychological evaluation of face identity recognition. Neuropsychologia 2024; 198:108865. [PMID: 38522782 DOI: 10.1016/j.neuropsychologia.2024.108865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 03/14/2024] [Accepted: 03/18/2024] [Indexed: 03/26/2024]
Abstract
Facial identity recognition (FIR) is arguably the ultimate form of recognition for the adult human brain. Even if the term prosopagnosia is reserved for exceptionally rare brain-damaged cases with a category-specific abrupt loss of FIR at adulthood, subjective and objective impairments or difficulties of FIR are common in the neuropsychological population. Here we provide a critical overview of the evaluation of FIR both for clinicians and researchers in neuropsychology. FIR impairments occur following many causes that should be identified objectively by both general and specific, behavioral and neural examinations. We refute the commonly used dissociation between perceptual and memory deficits/tests for FIR, since even a task involving the discrimination of unfamiliar face images presented side-by-side relies on cortical memories of faces in the right-lateralized ventral occipito-temporal cortex. Another frequently encountered confusion is between specific deficits of the FIR function and a more general impairment of semantic memory (of people), the latter being most often encountered following anterior temporal lobe damage. Many computerized tests aimed at evaluating FIR have appeared over the last two decades, as reviewed here. However, despite undeniable strengths, they often suffer from ecological limitations, difficulties of instruction, as well as a lack of consideration for processing speed and qualitative information. Taking into account these issues, a recently developed behavioral test with natural images manipulating face familiarity, stimulus inversion, and correct response times as a key variable appears promising. The measurement of electroencephalographic (EEG) activity in the frequency domain from fast periodic visual stimulation also appears as a particularly promising tool to complete and enhance the neuropsychological assessment of FIR.
Collapse
Affiliation(s)
- Angélique Volfart
- School of Psychology and Counselling, Faculty of Health, Queensland University of Technology, Australia.
| | - Bruno Rossion
- Centre for Biomedical Technologies, Queensland University of Technology, Australia; Université de Lorraine, CNRS, IMoPA, F-54000, Nancy, France.
| |
Collapse
|
3
|
Li W, Li J, Chu C, Cao D, Shi W, Zhang Y, Jiang T. Common Sequential Organization of Face Processing in the Human Brain and Convolutional Neural Networks. Neuroscience 2024; 541:1-13. [PMID: 38266906 DOI: 10.1016/j.neuroscience.2024.01.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 01/11/2024] [Accepted: 01/16/2024] [Indexed: 01/26/2024]
Abstract
Face processing includes two crucial processing levels - face detection and face recognition. However, it remains unclear how human brains organize the two processing levels sequentially. While some studies found that faces are recognized as fast as they are detected, others have reported that faces are detected first, followed by recognition. We discriminated the two processing levels on a fine time scale by combining human intracranial EEG (two females, three males, and three subjects without reported sex information) and representation similarity analysis. Our results demonstrate that the human brain exhibits a "detection-first, recognition-later" pattern during face processing. In addition, we used convolutional neural networks to test the hypothesis that the sequential organization of the two face processing levels in the brain reflects computational optimization. Our findings showed that the networks trained on face recognition also exhibited the "detection-first, recognition-later" pattern. Moreover, this sequential organization mechanism developed gradually during the training of the networks and was observed only for correctly predicted images. These findings collectively support the computational account as to why the brain organizes them in this way.
Collapse
Affiliation(s)
- Wenlu Li
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jin Li
- School of Psychology, Capital Normal University, Beijing 100048, China
| | - Congying Chu
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Dan Cao
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Weiyang Shi
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Yu Zhang
- Research Center for Augmented Intelligence, Zhejiang Lab, Hangzhou 311100, China
| | - Tianzi Jiang
- Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China; Research Center for Augmented Intelligence, Zhejiang Lab, Hangzhou 311100, China; Xiaoxiang Institute for Brain Health and Yongzhou Central Hospital, Yongzhou 425000, Hunan Province, China.
| |
Collapse
|
4
|
Wang Z, Ni H, Zhou X, Yang X, Zheng Z, Sun YHP, Zhang X, Jin H. Looking at the upper facial half enlarges the range of holistic face processing. Sci Rep 2023; 13:2419. [PMID: 36765162 PMCID: PMC9918552 DOI: 10.1038/s41598-023-29583-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Accepted: 02/07/2023] [Indexed: 02/12/2023] Open
Abstract
Previous studies suggested that upper and lower facial halves might be involved in the human holistic face processing differently. In this study, we replicated and extended the finding above. In Experiment 1, we used the standard composite-face task to measure holistic face processing when participants made judgements on the upper and lower facial halves separately. Results showed that the composite-face effect was stronger for the upper facial half compared to the lower half. In Experiment 2, we investigated how facial information was integrated when participants focused on different features, using the perceptual field paradigm. Results showed that: (1) more "peripheral faces" were chosen when participants fixated at the eyes than when they fixated at the mouth; (2) less "peripheral faces" were chosen for inverted faces regardless of the fixated features. Findings from both experiments together indicate that more peripheral facial information were integrated when participants focused on the upper facial half, highlighting the significance of focusing on the upper facial half in face processing.
Collapse
Affiliation(s)
- Zhe Wang
- Department of Psychology, Zhejiang Sci-Tech University, Zhejiang, China.
| | - Hao Ni
- Department of Psychology, Zhejiang Sci-Tech University, Zhejiang, China
| | - Xin Zhou
- Department of Psychology, Zhejiang Sci-Tech University, Zhejiang, China
| | - Xiteng Yang
- Department of Psychology, Zhejiang Sci-Tech University, Zhejiang, China
| | - Ziyi Zheng
- Department of Psychology, Zhejiang Sci-Tech University, Zhejiang, China
| | - Yu-Hao P Sun
- Department of Psychology, Zhejiang Sci-Tech University, Zhejiang, China
| | - Xiaohui Zhang
- Department of Psychology, Zhejiang Sci-Tech University, Zhejiang, China
| | - Haiyang Jin
- Division of Science, Department of Psychology, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
5
|
Li C, Burton AM, Ambrus GG, Kovács G. A neural measure of the degree of face familiarity. Cortex 2022; 155:1-12. [DOI: 10.1016/j.cortex.2022.06.012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 06/05/2022] [Accepted: 06/08/2022] [Indexed: 11/03/2022]
|
6
|
Dehaghani NS, Maess B, Khosrowabadi R, Lashgari R, Braeutigam S, Zarei M. Pre-stimulus Alpha Activity Modulates Face and Object Processing in the Intra-Parietal Sulcus, a MEG Study. Front Hum Neurosci 2022; 16:831781. [PMID: 35585993 PMCID: PMC9108229 DOI: 10.3389/fnhum.2022.831781] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 04/08/2022] [Indexed: 11/13/2022] Open
Abstract
Face perception is crucial in all social animals. Recent studies have shown that pre-stimulus oscillations of brain activity modulate the perceptual performance of face vs. non-face stimuli, specifically under challenging conditions. However, it is unclear if this effect also occurs during simple tasks, and if so in which brain regions. Here we used magnetoencephalography (MEG) and a 1-back task in which participants decided if the two sequentially presented stimuli were the same or not in each trial. The aim of the study was to explore the effect of pre-stimulus alpha oscillation on the perception of face (human and monkey) and non-face stimuli. Our results showed that pre-stimulus activity in the left occipital face area (OFA) modulated responses in the intra-parietal sulcus (IPS) at around 170 ms after the presentation of human face stimuli. This effect was also found after participants were shown images of motorcycles. In this case, the IPS was modulated by pre-stimulus activity in the right OFA and the right fusiform face area (FFA). We conclude that pre-stimulus modulation of post-stimulus response also occurs during simple tasks and is therefore independent of behavioral responses.
Collapse
Affiliation(s)
- Narjes Soltani Dehaghani
- Institute of Medical Science and Technology, Shahid Beheshti University, Tehran, Iran
- Institute for Cognitive and Brain Sciences, Shahid Beheshti University, Tehran, Iran
| | - Burkhard Maess
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Reza Khosrowabadi
- Institute for Cognitive and Brain Sciences, Shahid Beheshti University, Tehran, Iran
| | - Reza Lashgari
- Institute of Medical Science and Technology, Shahid Beheshti University, Tehran, Iran
| | - Sven Braeutigam
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Mojtaba Zarei
- Institute of Medical Science and Technology, Shahid Beheshti University, Tehran, Iran
- Department of Neurology, Odense University Hospital, and Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- *Correspondence: Mojtaba Zarei
| |
Collapse
|
7
|
Illusory faces are more likely to be perceived as male than female. Proc Natl Acad Sci U S A 2022; 119:2117413119. [PMID: 35074880 PMCID: PMC8812520 DOI: 10.1073/pnas.2117413119] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/17/2021] [Indexed: 12/04/2022] Open
Abstract
Face pareidolia is the phenomenon of perceiving illusory faces in inanimate objects. Here we show that illusory faces engage social perception beyond the detection of a face: they have a perceived age, gender, and emotional expression. Additionally, we report a striking bias in gender perception, with many more illusory faces perceived as male than female. As illusory faces do not have a biological sex, this bias is significant in revealing an asymmetry in our face evaluation system given minimal information. Our result demonstrates that the visual features that are sufficient for face detection are not generally sufficient for the perception of female. Instead, the perception of a nonhuman face as female requires additional features beyond that required for face detection. Despite our fluency in reading human faces, sometimes we mistakenly perceive illusory faces in objects, a phenomenon known as face pareidolia. Although illusory faces share some neural mechanisms with real faces, it is unknown to what degree pareidolia engages higher-level social perception beyond the detection of a face. In a series of large-scale behavioral experiments (ntotal = 3,815 adults), we found that illusory faces in inanimate objects are readily perceived to have a specific emotional expression, age, and gender. Most strikingly, we observed a strong bias to perceive illusory faces as male rather than female. This male bias could not be explained by preexisting semantic or visual gender associations with the objects, or by visual features in the images. Rather, this robust bias in the perception of gender for illusory faces reveals a cognitive bias arising from a broadly tuned face evaluation system in which minimally viable face percepts are more likely to be perceived as male.
Collapse
|
8
|
de Lissa P, Sokhn N, Lasrado S, Tanaka K, Watanabe K, Caldara R. Rapid saccadic categorization of other-race faces. J Vis 2021; 21:1. [PMID: 34724530 PMCID: PMC8572436 DOI: 10.1167/jov.21.12.1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The human visual system is very fast and efficient at extracting socially relevant information from faces. Visual studies employing foveated faces have consistently reported faster categorization by race response times for other-race compared with same-race faces. However, in everyday life we typically encounter faces outside the foveated visual field. In study 1, we explored whether and how race is categorized extrafoveally in same- and other-race faces normalized for low-level properties by tracking eye movements of Western Caucasian and East Asian observers in a saccadic response task. The results show that not only are people sensitive to race in faces presented outside of central vision, but the speed advantage in categorizing other-race faces occurs astonishingly quickly in as little as 200 ms. Critically, this visual categorization process was approximately 300 ms faster than the typical button press responses on centrally presented foveated faces. Study 2 investigated the genesis of the extrafoveal saccadic response speed advantage by comparing the influences of the response modality (button presses and saccadic responses), as well as the potential contribution of the impoverished low-spatial frequency spectrum characterizing extrafoveal visual information processing. Button press race categorization was not significantly faster with reconstructed retinal-filtered low spatial frequency faces, regardless of the visual field presentation. The speed of race categorization was significantly boosted only by extrafoveal saccades and not centrally foveated faces. Race is a potent, rapid, and effective visual signal transmitted by faces used for the categorization of ingroup/outgroup members. This fast universal visual categorization can occur outside central vision, igniting a cascade of social processes.
Collapse
Affiliation(s)
- Peter de Lissa
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland.,
| | - Nayla Sokhn
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland.,
| | - Sasha Lasrado
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland.,
| | - Kanji Tanaka
- Faculty of Arts and Science, Kyushu University, Fukuoka, Japan.,
| | - Katsumi Watanabe
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan.,Faculty of Arts, Design, and Architecture, University of New South Wales, Sydney, Australia.,
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland.,
| |
Collapse
|
9
|
Yan X, Goffaux V, Rossion B. Coarse-to-Fine(r) Automatic Familiar Face Recognition in the Human Brain. Cereb Cortex 2021; 32:1560-1573. [PMID: 34505130 DOI: 10.1093/cercor/bhab238] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 06/22/2021] [Accepted: 06/24/2021] [Indexed: 01/07/2023] Open
Abstract
At what level of spatial resolution can the human brain recognize a familiar face in a crowd of strangers? Does it depend on whether one approaches or rather moves back from the crowd? To answer these questions, 16 observers viewed different unsegmented images of unfamiliar faces alternating at 6 Hz, with spatial frequency (SF) content progressively increasing (i.e., coarse-to-fine) or decreasing (fine-to-coarse) in different sequences. Variable natural images of celebrity faces every sixth stimulus generated an objective neural index of single-glanced automatic familiar face recognition (FFR) at 1 Hz in participants' electroencephalogram (EEG). For blurry images increasing in spatial resolution, the neural FFR response over occipitotemporal regions emerged abruptly with additional cues at about 6.3-8.7 cycles/head width, immediately reaching amplitude saturation. When the same images progressively decreased in resolution, the FFR response disappeared already below 12 cycles/head width, thus providing no support for a predictive coding hypothesis. Overall, these observations indicate that rapid automatic recognition of heterogenous natural views of familiar faces is achieved from coarser visual inputs than generally thought, and support a coarse-to-fine FFR dynamics in the human brain.
Collapse
Affiliation(s)
- Xiaoqian Yan
- Department of Psychology, Stanford University, Palo Alto, CA 94305, USA.,Université de Lorraine, CNRS, CRAN, 54000 Nancy, France.,Institute of Research in Psychology (IPSY), University of Louvain, Louvain-La-Neuve 1348, Belgium
| | - Valérie Goffaux
- Institute of Research in Psychology (IPSY), University of Louvain, Louvain-La-Neuve 1348, Belgium.,Department of Cognitive Neuroscience, Maastricht University, Maastricht, 6229, the Netherlands.,Institute of Neuroscience (IoNS), University of Louvain, Louvain-La-Neuve 1348, Belgium
| | - Bruno Rossion
- Université de Lorraine, CNRS, CRAN, 54000 Nancy, France.,Institute of Research in Psychology (IPSY), University of Louvain, Louvain-La-Neuve 1348, Belgium.,Université de Lorraine, CHRU-Nancy, Service de Neurologie, 54000 Nancy, France
| |
Collapse
|
10
|
The Efficiency of Demography in Face Perception. Atten Percept Psychophys 2021; 83:3104-3117. [PMID: 34427904 DOI: 10.3758/s13414-021-02351-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/06/2021] [Indexed: 11/08/2022]
Abstract
When we look at a face, we cannot help but "read" it: Beyond simply processing its identity, we also form robust impressions of both transient psychological states (e.g., surprise) and stable character traits (e.g., trustworthiness). But perhaps the most fundamental traits we extract from faces are their social demographics, for example, race, age, and gender. How much exposure is required to extract such properties? Curiously, despite extensive work on the temporal efficiency of extracting both higher-level social properties (such as competence and dominance) and more basic characteristics (such as identity and familiarity), this question remains largely unexplored for demography. We correlated observers' percepts of the race/age/gender of unfamiliar faces viewed at several brief durations (and then masked) with their judgments after unlimited exposure. Performance reached asymptote by 100 ms, was above chance by only 33.33 ms, and had a similar temporal profile to detecting faces in the first place. This was true even when the property to be reported wasn't revealed until after the face had disappeared, and when the faces were matched for several lower-level visual properties. Collectively, these results demonstrate that the extraction of demographic features from faces is highly efficient, and can truly be done at a glance.
Collapse
|
11
|
Quek GL, Rossion B, Liu-Shuang J. Critical information thresholds underlying generic and familiar face categorisation at the same face encounter. Neuroimage 2021; 243:118481. [PMID: 34416398 DOI: 10.1016/j.neuroimage.2021.118481] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 08/06/2021] [Accepted: 08/17/2021] [Indexed: 11/29/2022] Open
Abstract
Seeing a face in the real world provokes a host of automatic categorisations related to sex, emotion, identity, and more. Such individual facets of human face recognition have been extensively examined using overt categorisation judgements, yet their relative informational dependencies during the same face encounter are comparatively unknown. Here we used EEG to assess how increasing access to sensory input governs two ecologically relevant brain functions elicited by seeing a face: Distinguishing faces and nonfaces, and recognising people we know. Observers viewed a large set of natural images that progressively increased in either image duration (experiment 1) or spatial frequency content (experiment 2). We show that in the absence of an explicit categorisation task, the human brain requires less sensory input to categorise a stimulus as a face than it does to recognise whether that face is familiar. Moreover, where sensory thresholds for distinguishing faces/nonfaces were remarkably consistent across observers, there was high inter-individual variability in the lower informational bound for familiar face recognition, underscoring the neurofunctional distinction between these categorisation functions. By i) indexing a form of face recognition that goes beyond simple low-level differences between categories, and ii) tapping multiple recognition functions elicited by the same face encounters, the information minima we report bear high relevance to real-world face encounters, where the same stimulus is categorised along multiple dimensions at once. Thus, our finding of lower informational requirements for generic vs. familiar face recognition constitutes some of the strongest evidence to date for the intuitive notion that sensory input demands should be lower for recognising face category than face identity.
Collapse
Affiliation(s)
- Genevieve L Quek
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands; School of Psychology, The University of Sydney, Sydney, Australia.
| | - Bruno Rossion
- Institute of Research in Psychology (IPSY), University of Louvain, Louvain, Belgium; Université de Lorraine, CNRS, CRAN, F-54000 Nancy, France; Université de Lorraine, CHRU-Nancy, Service de Neurologie, Lorraine F-54000, France
| | - Joan Liu-Shuang
- Institute of Research in Psychology (IPSY), University of Louvain, Louvain, Belgium
| |
Collapse
|
12
|
Retter TL, Jiang F, Webster MA, Michel C, Schiltz C, Rossion B. Varying Stimulus Duration Reveals Consistent Neural Activity and Behavior for Human Face Individuation. Neuroscience 2021; 472:138-156. [PMID: 34333061 DOI: 10.1016/j.neuroscience.2021.07.025] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Revised: 07/14/2021] [Accepted: 07/15/2021] [Indexed: 11/27/2022]
Abstract
Establishing consistent relationships between neural activity and behavior is a challenge in human cognitive neuroscience research. We addressed this issue using variable time constraints in an oddball frequency-sweep design for visual discrimination of complex images (face exemplars). Sixteen participants viewed sequences of ascending presentation durations, from 25 to 333 ms (40-3 Hz stimulation rate) while their electroencephalogram (EEG) was recorded. Throughout each sequence, the same unfamiliar face picture was repeated with variable size and luminance changes while different unfamiliar facial identities appeared every 1 s (1 Hz). A neural face individuation response, tagged at 1 Hz and its unique harmonics, emerged over the occipito-temporal cortex at 50 ms stimulus duration (25-100 ms across individuals), with an optimal response reached at 170 ms stimulus duration. In a subsequent experiment, identity changes appeared non-periodically within fixed-frequency sequences while the same participants performed an explicit face individuation task. The behavioral face individuation response also emerged at 50 ms presentation time, and behavioral accuracy correlated with individual participants' neural response amplitude in a weighted middle stimulus duration range (50-125 ms). Moreover, the latency of the neural response peaking between 180 and 200 ms correlated strongly with individuals' behavioral accuracy in this middle duration range, as measured independently. These observations point to the minimal (50 ms) and optimal (170 ms) stimulus durations for human face individuation and provide novel evidence that inter-individual differences in the magnitude and latency of early, high-level neural responses are predictive of behavioral differences in performance at this function.
Collapse
Affiliation(s)
- Talia L Retter
- Psychological Sciences Research Institute, Institute of Neuroscience, UCLouvain, Belgium; Department of Psychology, Center for Integrative Neuroscience, University of Nevada, Reno, USA; Department of Behavioural and Cognitive Sciences, Institute of Cognitive Science & Assessment, University of Luxembourg, Luxembourg.
| | - Fang Jiang
- Department of Psychology, Center for Integrative Neuroscience, University of Nevada, Reno, USA
| | - Michael A Webster
- Department of Psychology, Center for Integrative Neuroscience, University of Nevada, Reno, USA
| | - Caroline Michel
- Psychological Sciences Research Institute, Institute of Neuroscience, UCLouvain, Belgium
| | - Christine Schiltz
- Department of Behavioural and Cognitive Sciences, Institute of Cognitive Science & Assessment, University of Luxembourg, Luxembourg
| | - Bruno Rossion
- Psychological Sciences Research Institute, Institute of Neuroscience, UCLouvain, Belgium; Université de Lorraine, CNRS, CRAN, F-54000 Nancy, France; Université de Lorraine, CHRU-Nancy, Service de Neurologie, F-54000 Nancy, France
| |
Collapse
|
13
|
Marcolin F, Vezzetti E, Monaci M. Face perception foundations for pattern recognition algorithms. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.02.074] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
14
|
Santo MGE, Wagemans J. Flexibility of emerging face categorization at different levels of abstraction. J Vis 2021; 21:22. [PMID: 34010952 PMCID: PMC8142708 DOI: 10.1167/jov.21.5.22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Categorization of visual stimuli at different levels of abstraction relies on the encoding of relevant diagnostic features present at different spatial scales. We used the Eidolon Factory, an image-manipulation algorithm that introduces random disarray fields across spatial scales, to study how such a process flexibly combines perceptual information to perform successful categorization depending on task demands. Images of animal faces, human faces, and everyday objects were disarrayed coherently (random fields correlated) or incoherently (random fields randomized) to create a family of 50 eidolons per stimulus image with increasing disarray. Participants (N = 243) viewed each family of eidolons in a smooth sequence from maximum disarray to no disarray and performed a category verification task either at the superordinate (any face type) or basic (human face only) levels at two levels of uncertainty: participants in one group used their gut feeling to respond, whereas another group had to be sure of their decision. When participants used their gut feeling to respond, we observed a superordinate-level advantage. When they were sure of their response, we observed a basic-level advantage. Coherently disarrayed sequences impaired target detection compared to incoherently disarrayed sequences for both levels of response certainty. Furthermore, participants' sensitivity in the Any Face condition increased when they observed coherently disarrayed sequences and had to be sure of their response. These results suggest that the visual system does not strictly adhere to feedforward processing but flexibly adjusts to the relevant perceptual information depending on task context.
Collapse
|
15
|
Tu Y, Pantazis D, Wilson G, Khan S, Ahlfors S, Kong J. How expectations of pain elicited by consciously and unconsciously perceived cues unfold over time. Neuroimage 2021; 235:117985. [PMID: 33762214 PMCID: PMC8248481 DOI: 10.1016/j.neuroimage.2021.117985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2021] [Revised: 03/10/2021] [Accepted: 03/14/2021] [Indexed: 11/30/2022] Open
Abstract
Expectation can shape the perception of pain within a fraction of time, but little is known about how perceived expectation unfolds over time and modulates pain perception. Here, we combine magnetoencephalography (MEG) and machine learning approaches to track the neural dynamics of expectations of pain in healthy participants with both sexes. We found that the expectation of pain, as conditioned by facial cues, can be decoded from MEG as early as 150 ms and up to 1100 ms after cue onset, but decoding expectation elicited by unconsciously perceived cues requires more time and decays faster compared to consciously perceived ones. Also, results from temporal generalization suggest that neural dynamics of decoding cue-based expectation were predominately sustained during cue presentation but transient after cue presentation. Finally, although decoding expectation elicited by consciously perceived cues were based on a series of time-restricted brain regions during cue presentation, decoding relied on the medial prefrontal cortex and anterior cingulate cortex after cue presentation for both consciously and unconsciously perceived cues. These findings reveal the conscious and unconscious processing of expectation during pain anticipation and may shed light on enhancing clinical care by demonstrating the impact of expectation cues.
Collapse
Affiliation(s)
- Yiheng Tu
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Dimitrios Pantazis
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA; McGovern Institute of Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Georgia Wilson
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Sheraz Khan
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Seppo Ahlfors
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Jian Kong
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA.
| |
Collapse
|
16
|
Karimi-Rouzbahani H, Ramezani F, Woolgar A, Rich A, Ghodrati M. Perceptual difficulty modulates the direction of information flow in familiar face recognition. Neuroimage 2021; 233:117896. [PMID: 33667671 PMCID: PMC7614447 DOI: 10.1016/j.neuroimage.2021.117896] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Revised: 02/10/2021] [Accepted: 02/17/2021] [Indexed: 02/07/2023] Open
Abstract
Humans are fast and accurate when they recognize familiar faces. Previous neurophysiological studies have shown enhanced representations for the dichotomy of familiar vs. unfamiliar faces. As familiarity is a spectrum, however, any neural correlate should reflect graded representations for more vs. less familiar faces along the spectrum. By systematically varying familiarity across stimuli, we show a neural familiarity spectrum using electroencephalography. We then evaluated the spatiotemporal dynamics of familiar face recognition across the brain. Specifically, we developed a novel informational connectivity method to test whether peri-frontal brain areas contribute to familiar face recognition. Results showed that feed-forward flow dominates for the most familiar faces and top-down flow was only dominant when sensory evidence was insufficient to support face recognition. These results demonstrate that perceptual difficulty and the level of familiarity influence the neural representation of familiar faces and the degree to which peri-frontal neural networks contribute to familiar face recognition.
Collapse
Affiliation(s)
- Hamid Karimi-Rouzbahani
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom; Perception in Action Research Centre and Department of Cognitive Science Macquarie University, Australia.
| | - Farzad Ramezani
- Department of Computer Science, School of Mathematics, Statistics, and Computer Science, University of Tehran, Iran
| | - Alexandra Woolgar
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom; Perception in Action Research Centre and Department of Cognitive Science Macquarie University, Australia
| | - Anina Rich
- Perception in Action Research Centre and Department of Cognitive Science Macquarie University, Australia
| | - Masoud Ghodrati
- Neuroscience Program, Biomedicine Discovery Institute, Monash University, Australia.
| |
Collapse
|
17
|
Quiñones M, Gómez D, Montefusco-Siegmund R, Aylwin MDLL. Early Visual Processing and Perception Processes in Object Discrimination Learning. Front Neurosci 2021; 15:617824. [PMID: 33584188 PMCID: PMC7876415 DOI: 10.3389/fnins.2021.617824] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Accepted: 01/11/2021] [Indexed: 11/13/2022] Open
Abstract
A brief image presentation is sufficient to discriminate and individuate objects of expertise. Although perceptual expertise is acquired through extensive practice that increases the resolution of representations and reduces the latency of image decoding and coarse and fine information extraction, it is not known how the stages of visual processing impact object discrimination learning (ODL). Here, we compared object discrimination with brief (100 ms) and long (1,000 ms) perceptual encoding times to test if the early and late visual processes are required for ODL. Moreover, we evaluated whether encoding time and discrimination practice shape perception and recognition memory processes during ODL. During practice of a sequential matching task with initially unfamiliar complex stimuli, we find greater discrimination with greater encoding times regardless of the extent of practice, suggesting that the fine information extraction during late visual processing is necessary for discrimination. Interestingly, the overall discrimination learning was similar for brief and long stimuli, suggesting that early stages of visual processing are sufficient for ODL. In addition, discrimination practice enhances perceive and know for brief and long stimuli and both processes are associated with performance, suggesting that early stage information extraction is sufficient for modulating the perceptual processes, likely reflecting an increase in the resolution of the representations and an early availability of information. Conversely, practice elicited an increase of familiarity which was not associated with discrimination sensitivity, revealing the acquisition of a general recognition memory. Finally, the recall is likely enhanced by practice and is associated with discrimination sensitivity for long encoding times, suggesting the engagement of recognition memory in a practice independent manner. These findings contribute to unveiling the function of early stages of visual processing in ODL, and provide evidence on the modulation of the perception and recognition memory processes during discrimination practice and its relationship with ODL and perceptual expertise acquisition.
Collapse
Affiliation(s)
- Matías Quiñones
- Centro de Investigaciones Médicas, Universidad de Talca, Talca, Chile
| | - David Gómez
- Facultad de Educación, Universidad de O'Higgins, Rancagua, Chile
| | - Rodrigo Montefusco-Siegmund
- Instituto de Aparato Locomotor y Rehabilitación, Facultad de Medicina, Universidad Austral de Chile, Valdivia, Chile
| | - María de la Luz Aylwin
- Centro de Investigaciones Médicas, Universidad de Talca, Talca, Chile.,Escuela de Medicina, Universidad de Talca, Talca, Chile.,Programa de Investigación Asociativa (PIA) en Ciencias Cognitivas, Centro de Investigación en Ciencias Cognitivas, Universidad de Talca, Talca, Chile
| |
Collapse
|
18
|
Yan X, Rossion B. A robust neural familiar face recognition response in a dynamic (periodic) stream of unfamiliar faces. Cortex 2020; 132:281-295. [DOI: 10.1016/j.cortex.2020.08.016] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2020] [Revised: 07/22/2020] [Accepted: 08/10/2020] [Indexed: 01/23/2023]
|
19
|
Lavan N, Mileva M, McGettigan C. How does familiarity with a voice affect trait judgements? Br J Psychol 2020; 112:282-300. [PMID: 32445499 DOI: 10.1111/bjop.12454] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2019] [Revised: 05/05/2020] [Indexed: 11/27/2022]
Abstract
From only a single spoken word, listeners can form a wealth of first impressions of a person's character traits and personality based on their voice. However, due to the substantial within-person variability in voices, these trait judgements are likely to be highly stimulus-dependent for unfamiliar voices: The same person may sound very trustworthy in one recording but less trustworthy in another. How trait judgements differ when listeners are familiar with a voice is unclear: Are listeners who are familiar with the voices as susceptible to the effects of within-person variability? Does the semantic knowledge listeners have about a familiar person influence their judgements? In the current study, we tested the effect of familiarity on listeners' trait judgements from variable voices across 3 experiments. Using a between-subjects design, we contrasted trait judgements by listeners who were familiar with a set of voices - either through laboratory-based training or through watching a TV show - with listeners who were unfamiliar with the voices. We predicted that familiarity with the voices would reduce variability in trait judgements for variable voice recordings from the same identity (cf. Mileva, Kramer & Burton, Perception, 48, 471 and 2019, for faces). However, across the 3 studies and two types of measures to assess variability, we found no compelling evidence to suggest that trait impressions were systematically affected by familiarity.
Collapse
Affiliation(s)
- Nadine Lavan
- Department of Speech, Hearing and Phonetic Sciences, University College London, UK
| | - Mila Mileva
- Department of Psychology, University of York, UK.,School of Psychology, University of Plymouth, UK
| | - Carolyn McGettigan
- Department of Speech, Hearing and Phonetic Sciences, University College London, UK
| |
Collapse
|
20
|
Campbell A, Louw R, Michniak E, Tanaka JW. Identity-specific neural responses to three categories of face familiarity (own, friend, stranger) using fast periodic visual stimulation. Neuropsychologia 2020; 141:107415. [DOI: 10.1016/j.neuropsychologia.2020.107415] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Revised: 02/25/2020] [Accepted: 02/26/2020] [Indexed: 01/19/2023]
|
21
|
Yan X, Zimmermann FGS, Rossion B. An implicit neural familiar face identity recognition response across widely variable natural views in the human brain. Cogn Neurosci 2020; 11:143-156. [DOI: 10.1080/17588928.2020.1712344] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Affiliation(s)
- Xiaoqian Yan
- CNRS, CRAN, Université de Lorraine, Nancy, France
- Institute of Research in Psychological Science, Institute of Neuroscience, Université de Louvain, Belgium
| | - Friederike GS Zimmermann
- Institute of Research in Psychological Science, Institute of Neuroscience, Université de Louvain, Belgium
- BG Klinikum Humburg, Neurologie, Hamburg, Germany
| | - Bruno Rossion
- CNRS, CRAN, Université de Lorraine, Nancy, France
- Institute of Research in Psychological Science, Institute of Neuroscience, Université de Louvain, Belgium
- CHRU-Nancy, Service de Neurologie, France
| |
Collapse
|
22
|
Despouy E, Curot J, Deudon M, Gardy L, Denuelle M, Sol JC, Lotterie JA, Valton L, Barbeau EJ. A Fast Visual Recognition Memory System in Humans Identified Using Intracerebral ERP. Cereb Cortex 2019; 30:2961-2971. [DOI: 10.1093/cercor/bhz287] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2018] [Revised: 10/06/2019] [Accepted: 10/31/2019] [Indexed: 11/13/2022] Open
Abstract
Abstract
One key item of information retrieved when surveying our visual world is whether or not objects are familiar. However, there is no consensus on the respective roles of medial temporal lobe structures, particularly the perirhinal cortex (PRC) and hippocampus. We considered whether the PRC could support a fast recognition memory system independently from the hippocampus. We recorded the intracerebral electroencephalograph activity of epileptic patients while they were performing a fast visual recognition memory task, constraining them to use their quickest strategy. We performed event-related potential (ERP) and classification analyses. The PRC was, by far, the earliest region involved in recognition memory. This activity occurred before the first behavioral responses and was found to be related to reaction times, unlike the hippocampus. Single-trial analyses showed that decoding power was equivalent in the PRC and hippocampus but occurred much earlier in the PRC. A critical finding was that recognition memory-related activity occurred in different frontal and parietal regions, including the supplementary motor area, before the hippocampus. These results, based on ERP analyses, suggest that the human brain is equipped with a fast recognition memory system, which may bypass the hippocampus and in which the PRC plays a critical role.
Collapse
Affiliation(s)
- Elodie Despouy
- Centre de Recherche Cerveau et Cognition, Université de Toulouse, Université Paul Sabatier Toulouse, Toulouse 31052, France
- Centre National de la Recherche Scientifique, CerCo (UMR5549), Toulouse 31052, France
- Dixi medical, Chaudefontaine 25640, France
| | - Jonathan Curot
- Centre de Recherche Cerveau et Cognition, Université de Toulouse, Université Paul Sabatier Toulouse, Toulouse 31052, France
- Centre National de la Recherche Scientifique, CerCo (UMR5549), Toulouse 31052, France
- Explorations neurophysiologiques, Hôpital Purpan, Université de Toulouse, Toulouse 31059, France
| | - Martin Deudon
- Centre de Recherche Cerveau et Cognition, Université de Toulouse, Université Paul Sabatier Toulouse, Toulouse 31052, France
- Centre National de la Recherche Scientifique, CerCo (UMR5549), Toulouse 31052, France
| | - Ludovic Gardy
- Centre de Recherche Cerveau et Cognition, Université de Toulouse, Université Paul Sabatier Toulouse, Toulouse 31052, France
- Centre National de la Recherche Scientifique, CerCo (UMR5549), Toulouse 31052, France
| | - Marie Denuelle
- Explorations neurophysiologiques, Hôpital Purpan, Université de Toulouse, Toulouse 31059, France
| | - Jean-Christophe Sol
- INSERM, U1214, TONIC, Toulouse Mind and Brain Institute, Toulouse 31024, France
- Neurochirurgie, Hôpital Purpan, Université de Toulouse, Toulouse 31059, France
| | - Jean-Albert Lotterie
- INSERM, U1214, TONIC, Toulouse Mind and Brain Institute, Toulouse 31024, France
- Radiochirurgie stéréotaxique, Hôpital Purpan, Université de Toulouse, Toulouse 31059, France
| | - Luc Valton
- Centre de Recherche Cerveau et Cognition, Université de Toulouse, Université Paul Sabatier Toulouse, Toulouse 31052, France
- Centre National de la Recherche Scientifique, CerCo (UMR5549), Toulouse 31052, France
- Explorations neurophysiologiques, Hôpital Purpan, Université de Toulouse, Toulouse 31059, France
| | - Emmanuel J Barbeau
- Centre de Recherche Cerveau et Cognition, Université de Toulouse, Université Paul Sabatier Toulouse, Toulouse 31052, France
- Centre National de la Recherche Scientifique, CerCo (UMR5549), Toulouse 31052, France
| |
Collapse
|
23
|
Zimmermann FGS, Yan X, Rossion B. An objective, sensitive and ecologically valid neural measure of rapid human individual face recognition. ROYAL SOCIETY OPEN SCIENCE 2019; 6:181904. [PMID: 31312474 PMCID: PMC6599768 DOI: 10.1098/rsos.181904] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/07/2018] [Accepted: 05/10/2019] [Indexed: 06/10/2023]
Abstract
Humans may be the only species able to rapidly and automatically recognize a familiar face identity in a crowd of unfamiliar faces, an important social skill. Here, by combining electroencephalography (EEG) and fast periodic visual stimulation (FPVS), we introduce an ecologically valid, objective and sensitive neural measure of this human individual face recognition function. Natural images of various unfamiliar faces are presented at a fast rate of 6 Hz, allowing one fixation per face, with variable natural images of a highly familiar face identity, a celebrity, appearing every seven images (0.86 Hz). Following a few minutes of stimulation, a high signal-to-noise ratio neural response reflecting the generalized discrimination of the familiar face identity from unfamiliar faces is observed over the occipito-temporal cortex at 0.86 Hz and harmonics. When face images are presented upside-down, the individual familiar face recognition response is negligible, being reduced by a factor of 5 over occipito-temporal regions. Differences in the magnitude of the individual face recognition response across different familiar face identities suggest that factors such as exposure, within-person variability and distinctiveness mediate this response. Our findings of a biological marker for fast and automatic recognition of individual familiar faces with ecological stimuli open an avenue for understanding this function, its development and neural basis in neurotypical individual brains along with its pathology. This should also have implications for the use of facial recognition measures in forensic science.
Collapse
Affiliation(s)
- Friederike G. S. Zimmermann
- Institute of Research in Psychological Science, Institute of Neuroscience, Université de Louvain, Louvain-la-Neuve, Belgium
- BG Klinikum Hamburg, Bergedorfer Straße 10, 21033 Hamburg, Germany
| | - Xiaoqian Yan
- Institute of Research in Psychological Science, Institute of Neuroscience, Université de Louvain, Louvain-la-Neuve, Belgium
| | - Bruno Rossion
- Institute of Research in Psychological Science, Institute of Neuroscience, Université de Louvain, Louvain-la-Neuve, Belgium
- Université de Lorraine, CNRS, CRAN, 54000 Nancy, France
- CHRU-Nancy, Service de Neurologie, 54000 Nancy, France
| |
Collapse
|
24
|
Xu B, Kankanhalli MS, Zhao Q. Ultra-rapid object categorization in real-world scenes with top-down manipulations. PLoS One 2019; 14:e0214444. [PMID: 30969988 PMCID: PMC6457495 DOI: 10.1371/journal.pone.0214444] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2017] [Accepted: 03/13/2019] [Indexed: 11/18/2022] Open
Abstract
Humans are able to achieve visual object recognition rapidly and effortlessly. Object categorization is commonly believed to be achieved by interaction between bottom-up and top-down cognitive processing. In the ultra-rapid categorization scenario where the stimuli appear briefly and response time is limited, it is assumed that a first sweep of feedforward information is sufficient to discriminate whether or not an object is present in a scene. However, whether and how feedback/top-down processing is involved in such a brief duration remains an open question. To this end, here, we would like to examine how different top-down manipulations, such as category level, category type and real-world size, interact in ultra-rapid categorization. We have constructed a dataset comprising real-world scene images with a built-in measurement of target object display size. Based on this set of images, we have measured ultra-rapid object categorization performance by human subjects. Standard feedforward computational models representing scene features and a state-of-the-art object detection model were employed for auxiliary investigation. The results showed the influences from 1) animacy (animal, vehicle, food), 2) level of abstraction (people, sport), and 3) real-world size (four target size levels) on ultra-rapid categorization processes. This had an impact to support the involvement of top-down processing when rapidly categorizing certain objects, such as sport at a fine grained level. Our work on human vs. model comparisons also shed light on possible collaboration and integration of the two that may be of interest to both experimental and computational vision researches. All the collected images and behavioral data as well as code and models are publicly available at https://osf.io/mqwjz/.
Collapse
Affiliation(s)
- Bingjie Xu
- NUS Graduate School for Integrative Sciences and Engineering, National University of Singapore, Singapore, Singapore
| | | | - Qi Zhao
- Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, United States of America
| |
Collapse
|
25
|
Sable AH, Talbar SN. Adaptive GLOH with PSO-trained NN for the recognition of plastic surgery faces and their types. BIO-ALGORITHMS AND MED-SYSTEMS 2019. [DOI: 10.1515/bams-2018-0033] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Abstract
Numerous algorithms have met complexity in recognizing the face, which is invariant to plastic surgery, owing to the texture variations in the skin. Though plastic surgery serves to be a challenging issue in the domain of face recognition, the concerned theme has to be restudied for its hypothetical and experimental perspectives. In this paper, Adaptive Gradient Location and Orientation Histogram (AGLOH)-based feature extraction is proposed to accomplish effective plastic surgery face recognition. The proposed features are extracted from the granular space of the faces. Additionally, the variants of the local binary pattern are also extracted to accompany the AGLOH features. Subsequently, the feature dimensionality is reduced using principal component analysis (PCA) to train the artificial neural network. The paper trains the neural network using particle swarm optimization, despite utilizing the traditional learning algorithms. The experimentation involved 452 plastic surgery faces from blepharoplasty, brow lift, liposhaving, malar augmentation, mentoplasty, otoplasty, rhinoplasty, rhytidectomy and skin peeling. Finally, the proposed AGLOH proves its performance dominance.
Collapse
|
26
|
Dobs K, Isik L, Pantazis D, Kanwisher N. How face perception unfolds over time. Nat Commun 2019; 10:1258. [PMID: 30890707 PMCID: PMC6425020 DOI: 10.1038/s41467-019-09239-1] [Citation(s) in RCA: 98] [Impact Index Per Article: 19.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2018] [Accepted: 02/24/2019] [Indexed: 11/08/2022] Open
Abstract
Within a fraction of a second of viewing a face, we have already determined its gender, age and identity. A full understanding of this remarkable feat will require a characterization of the computational steps it entails, along with the representations extracted at each. Here, we used magnetoencephalography (MEG) to measure the time course of neural responses to faces, thereby addressing two fundamental questions about how face processing unfolds over time. First, using representational similarity analysis, we found that facial gender and age information emerged before identity information, suggesting a coarse-to-fine processing of face dimensions. Second, identity and gender representations of familiar faces were enhanced very early on, suggesting that the behavioral benefit for familiar faces results from tuning of early feed-forward processing mechanisms. These findings start to reveal the time course of face processing in humans, and provide powerful new constraints on computational theories of face perception.
Collapse
Affiliation(s)
- Katharina Dobs
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
- McGovern Institute of Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
- The Center for Brains, Minds, and Machines, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
| | - Leyla Isik
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- McGovern Institute of Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- The Center for Brains, Minds, and Machines, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Dimitrios Pantazis
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- McGovern Institute of Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Nancy Kanwisher
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- McGovern Institute of Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- The Center for Brains, Minds, and Machines, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| |
Collapse
|
27
|
Decisional space modulates visual categorization - Evidence from saccadic reaction times. Cognition 2019; 186:42-49. [PMID: 30739058 DOI: 10.1016/j.cognition.2019.01.019] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2018] [Revised: 01/24/2019] [Accepted: 01/29/2019] [Indexed: 11/24/2022]
Abstract
Manual and saccadic reaction times (SRTs) have been used to determine the minimum time required for different types of visual categorizations. Such studies have demonstrated extremely rapid detection of faces within natural scenes, whereas increasingly complex decisions (i.e. levels of processing) require longer processing times. We reasoned that visual categorization speed is not only dependent on the processing level, but is further affected by decisional space constraints. In the context of two different tasks, observers performed choice saccades towards female (gender categorization) or personally familiar (familiarity categorization) faces. Additionally, familiarity categorizations were completed with stimulus sets that differed in the number of individuals presented (3 vs. 7 identities) to investigate the effect of decisional space constraints. We observe an inverse relationship between visual categorization proficiency and decisional space. Observers were most accurate for categorization of gender, which could be achieved in as little as 140 ms. Categorization of highly predictable targets was more error-prone and required an additional ∼100 ms processing time. Our findings add to an increasing body of evidence demonstraing that pre-activation of identity-information can modulate early visual processing in a top-down manner. They also emphasize the importance of considering procedural aspects, as well as terminology when aiming to characterize cognitive processes.
Collapse
|
28
|
Ambrus GG, Kaiser D, Cichy RM, Kovács G. The Neural Dynamics of Familiar Face Recognition. Cereb Cortex 2019; 29:4775-4784. [DOI: 10.1093/cercor/bhz010] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2018] [Revised: 12/20/2018] [Accepted: 01/15/2019] [Indexed: 11/14/2022] Open
Affiliation(s)
- Géza Gergely Ambrus
- Institute of Psychology, Friedrich Schiller University Jena, Leutragraben 1, Jena, Germany
| | - Daniel Kaiser
- Department of Education and Psychology, Freie Universität Berlin, Habelschwerdter Allee 45, Berlin, Germany
| | - Radoslaw Martin Cichy
- Department of Education and Psychology, Freie Universität Berlin, Habelschwerdter Allee 45, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität Berlin, Luisenstraβe 56, Haus 1, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Philippstraβe 13/Haus 6, Berlin, Germany
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Leutragraben 1, Jena, Germany
| |
Collapse
|
29
|
Schroer R, Schroer JW. Putting psychology before metaphysics in moral responsibility: Reactive attitudes and a “gut feeling” that can trigger and justify them. PHILOSOPHICAL PSYCHOLOGY 2018. [DOI: 10.1080/09515089.2018.1555800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Robert Schroer
- Department of Philosophy, University of Minnesota Duluth, Duluth, MN, USA
| | | |
Collapse
|
30
|
Jonin PY, Besson G, La Joie R, Pariente J, Belliard S, Barillot C, Barbeau EJ. Superior explicit memory despite severe developmental amnesia: In-depth case study and neural correlates. Hippocampus 2018; 28:867-885. [PMID: 29995351 DOI: 10.1002/hipo.23010] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2017] [Revised: 06/18/2018] [Accepted: 07/01/2018] [Indexed: 11/09/2022]
Abstract
The acquisition of new semantic memories is sometimes preserved in patients with hippocampal amnesia. Robust evidence for this comes from case reports of developmental amnesia suggesting that low-to-normal levels of semantic knowledge can be achieved despite compromised episodic learning. However, it is unclear whether this relative preservation of semantic memory results from normal acquisition and retrieval or from residual episodic memory, combined with effortful repetition. Furthermore, lesion studies have mainly focused on the hippocampus itself, and have seldom reported the state of structures in the extended hippocampal system. Preserved components of this system may therefore mediate residual episodic abilities, contributing to the apparent semantic preservation. We report an in-depth study of Patient KA, a 27-year-old man who had severe hypoxia at birth, in which we carefully explored his residual episodic learning abilities. We used novel speeded recognition paradigms to assess whether KA could explicitly acquire and retrieve new context-free memories. Despite a pattern of very severe amnesia, with a 44-point discrepancy between his intelligence and memory quotients, KA exhibited normal-to-superior levels of knowledge, even under strict time constraints. He also exhibited normal-to-superior recognition memory for new material, again under strict time constraints. Multimodal neuroimaging revealed an unusual pattern of selective atrophy within each component of the extended hippocampal system, contrasting with the preservation of anterior subhippocampal cortices. A cortical thickness analysis yielded a pattern of thinner but also thicker regional cortices, pointing toward specific temporal lobe reorganization following early injury. We thus report the first case of superior explicit learning and memory in a severe case of amnesia, raising important questions about how such knowledge can be acquired.
Collapse
Affiliation(s)
- Pierre-Yves Jonin
- Brain and Cognition Research Center, CNRS UMR 5549, Université de Toulouse Paul Sabatier, Toulouse, France.,IRISA, UMR CNRS 6074, VisAGeS U1228, INSERM, INRIA, Université de Rennes 1, Rennes, France.,Neurology Department, Pontchaillou University Hospital, Rennes, France
| | - Gabriel Besson
- Brain and Cognition Research Center, CNRS UMR 5549, Université de Toulouse Paul Sabatier, Toulouse, France
| | - Renaud La Joie
- "Neuropsychology and Imaging of Human Memory" Research Unit, Normandy University-PSL Research University-INSERM U1077, Caen University Hospital, Caen, France
| | - Jérémie Pariente
- Toulouse Neuroimaging Center, INSERM U1214, Université de Toulouse Paul Sabatier, Toulouse, France
| | - Serge Belliard
- Neurology Department, Pontchaillou University Hospital, Rennes, France.,"Neuropsychology and Imaging of Human Memory" Research Unit, Normandy University-PSL Research University-INSERM U1077, Caen University Hospital, Caen, France
| | - Christian Barillot
- IRISA, UMR CNRS 6074, VisAGeS U1228, INSERM, INRIA, Université de Rennes 1, Rennes, France
| | - Emmanuel J Barbeau
- Brain and Cognition Research Center, CNRS UMR 5549, Université de Toulouse Paul Sabatier, Toulouse, France
| |
Collapse
|
31
|
Quek GL, Liu-Shuang J, Goffaux V, Rossion B. Ultra-coarse, single-glance human face detection in a dynamic visual stream. Neuroimage 2018; 176:465-476. [DOI: 10.1016/j.neuroimage.2018.04.034] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2017] [Revised: 04/09/2018] [Accepted: 04/13/2018] [Indexed: 12/24/2022] Open
|
32
|
Lorenzino M, Caminati M, Caudek C. Tolerance to spatial-relational transformations in unfamiliar faces: A further challenge to a configural processing account of identity recognition. Acta Psychol (Amst) 2018; 188:25-38. [PMID: 29807303 DOI: 10.1016/j.actpsy.2018.05.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2017] [Revised: 05/04/2018] [Accepted: 05/09/2018] [Indexed: 01/16/2023] Open
Abstract
One of the most important questions in face perception research is to understand what information is extracted from a face in order to recognize its identity. Recognition of facial identity has been attributed to a special sensitivity to "configural" information. However, recent studies have challenged the configural account by showing that participants are poor in discriminating variations of metric distances among facial features, especially for familiar as opposed to unfamiliar faces, whereas a configural account predicts the opposite. We aimed to extend these previous results by examining classes of unfamiliar faces with which we have different levels of expertise. We hypothesized an inverse relation between sensitivity to configural information and expertise with a given class of faces, but only for neutral expressions. By first matching perceptual discriminability, we measured tolerance to subtle configural transformations with same-race (SR) versus other-race (OR) faces, and with upright versus upside-down faces. Consistently with our predictions, we found a lower sensitivity to at-threshold configural changes for SR compared to OR faces. We also found that, for our stimuli, the face inversion effect disappeared for neutral but not for emotional faces - a result that can also be attributed to a lower sensitivity to configural transformations for faces presented in a more familiar orientation. The present findings question a purely configural account of face processing and suggest that the role of spatial-relational information in face processing varies according to the functional demands of the task and to the characteristics of the stimuli.
Collapse
Affiliation(s)
- Martina Lorenzino
- Department of Neuroscience, Psychology, Drug Research, and Child Health, Section of Psychology, Università degli Studi di Firenze, Via di San Salvi 12, Complesso di San Salvi, Padiglione 26, Firenze (FI) 50135, Italy.
| | - Martina Caminati
- Department of Neuroscience, Psychology, Drug Research, and Child Health, Section of Psychology, Università degli Studi di Firenze, Via di San Salvi 12, Complesso di San Salvi, Padiglione 26, Firenze (FI) 50135, Italy.
| | - Corrado Caudek
- Department of Neuroscience, Psychology, Drug Research, and Child Health, Section of Psychology, Università degli Studi di Firenze, Via di San Salvi 12, Complesso di San Salvi, Padiglione 26, Firenze (FI) 50135, Italy.
| |
Collapse
|
33
|
Abstract
In this study, we explore the automaticity of encoding for different facial characteristics and ask whether it is influenced by face familiarity. We used a matching task in which participants had to report whether the gender, identity, race, or expression of two briefly presented faces was the same or different. The task was made challenging by allowing nonrelevant dimensions to vary across trials. To test for automaticity, we compared performance on trials in which the task instruction was given at the beginning of the trial, with trials in which the task instruction was given at the end of the trial. As a strong criterion for automatic processing, we reasoned that if perception of a given characteristic (gender, race, identity, or emotion) is fully automatic, the timing of the instruction should not influence performance. We compared automaticity for the perception of familiar and unfamiliar faces. Performance with unfamiliar faces was higher for all tasks when the instruction was given at the beginning of the trial. However, we found a significant interaction between instruction and task with familiar faces. Accuracy of gender and identity judgments to familiar faces was the same regardless of whether the instruction was given before or after the trial, suggesting automatic processing of these properties. In contrast, there was an effect of instruction for judgments of expression and race to familiar faces. These results show that familiarity enhances the automatic processing of some types of facial information more than others.
Collapse
|
34
|
Ramon M, Sokhn N, Lao J, Caldara R. Decisional space determines saccadic reaction times in healthy observers and acquired prosopagnosia. Cogn Neuropsychol 2018; 35:304-313. [PMID: 29749293 DOI: 10.1080/02643294.2018.1469482] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
Abstract
Determining the familiarity and identity of a face have been considered as independent processes. Covert face recognition in cases of acquired prosopagnosia, as well as rapid detection of familiarity have been taken to support this view. We tested P.S. a well-described case of acquired prosopagnosia, and two healthy controls (her sister and daughter) in two saccadic reaction time (SRT) experiments. Stimuli depicted their family members and well-matched unfamiliar distractors in the context of binary gender, or familiarity decisions. Observers' minimum SRTs were estimated with Bayesian approaches. For gender decisions, P.S. and her daughter achieved sufficient performance, but displayed different SRT distributions. For familiarity decisions, her daughter exhibited above chance level performance and minimum SRTs corresponding to those reported previously in healthy observers, while P.S. performed at chance. These findings extend previous observations, indicating that decisional space determines performance in both the intact and impaired face processing system.
Collapse
Affiliation(s)
- Meike Ramon
- a Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology , University of Fribourg , Fribourg , Switzerland
| | - Nayla Sokhn
- a Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology , University of Fribourg , Fribourg , Switzerland
| | - Junpeng Lao
- a Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology , University of Fribourg , Fribourg , Switzerland
| | - Roberto Caldara
- a Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology , University of Fribourg , Fribourg , Switzerland
| |
Collapse
|
35
|
Stoll C, Palluel-Germain R, Caldara R, Lao J, Dye MWG, Aptel F, Pascalis O. Face Recognition is Shaped by the Use of Sign Language. JOURNAL OF DEAF STUDIES AND DEAF EDUCATION 2018; 23:62-70. [PMID: 28977622 DOI: 10.1093/deafed/enx034] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/11/2017] [Accepted: 08/24/2017] [Indexed: 06/07/2023]
Abstract
Previous research has suggested that early deaf signers differ in face processing. Which aspects of face processing are changed and the role that sign language may have played in that change are however unclear. Here, we compared face categorization (human/non-human) and human face recognition performance in early profoundly deaf signers, hearing signers, and hearing non-signers. In the face categorization task, the three groups performed similarly in term of both response time and accuracy. However, in the face recognition task, signers (both deaf and hearing) were slower than hearing non-signers to accurately recognize faces, but had a higher accuracy rate. We conclude that sign language experience, but not deafness, drives a speed-accuracy trade-off in face recognition (but not face categorization). This suggests strategic differences in the processing of facial identity for individuals who use a sign language, regardless of their hearing status.
Collapse
Affiliation(s)
| | | | | | | | - Matthew W G Dye
- National Technical Institute for the Deaf, Rochester Institute of Technology
| | | | | |
Collapse
|
36
|
Ramon M, Gobbini MI. Familiarity matters: A review on prioritized processing of personally familiar faces. VISUAL COGNITION 2017. [DOI: 10.1080/13506285.2017.1405134] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Affiliation(s)
- Meike Ramon
- Department of Psychology, Visual and Social Neuroscience, University of Fribourg, Fribourg, Switzerland
| | - Maria Ida Gobbini
- Dipartimento di Medicina Specialistica, Diagnostica e Sperimentale (DIMES), Medical School, University of Bologna, Bologna, Italy
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, USA
| |
Collapse
|