1
|
Volfart A, Rossion B. The neuropsychological evaluation of face identity recognition. Neuropsychologia 2024; 198:108865. [PMID: 38522782 DOI: 10.1016/j.neuropsychologia.2024.108865] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 03/14/2024] [Accepted: 03/18/2024] [Indexed: 03/26/2024]
Abstract
Facial identity recognition (FIR) is arguably the ultimate form of recognition for the adult human brain. Even if the term prosopagnosia is reserved for exceptionally rare brain-damaged cases with a category-specific abrupt loss of FIR at adulthood, subjective and objective impairments or difficulties of FIR are common in the neuropsychological population. Here we provide a critical overview of the evaluation of FIR both for clinicians and researchers in neuropsychology. FIR impairments occur following many causes that should be identified objectively by both general and specific, behavioral and neural examinations. We refute the commonly used dissociation between perceptual and memory deficits/tests for FIR, since even a task involving the discrimination of unfamiliar face images presented side-by-side relies on cortical memories of faces in the right-lateralized ventral occipito-temporal cortex. Another frequently encountered confusion is between specific deficits of the FIR function and a more general impairment of semantic memory (of people), the latter being most often encountered following anterior temporal lobe damage. Many computerized tests aimed at evaluating FIR have appeared over the last two decades, as reviewed here. However, despite undeniable strengths, they often suffer from ecological limitations, difficulties of instruction, as well as a lack of consideration for processing speed and qualitative information. Taking into account these issues, a recently developed behavioral test with natural images manipulating face familiarity, stimulus inversion, and correct response times as a key variable appears promising. The measurement of electroencephalographic (EEG) activity in the frequency domain from fast periodic visual stimulation also appears as a particularly promising tool to complete and enhance the neuropsychological assessment of FIR.
Collapse
Affiliation(s)
- Angélique Volfart
- School of Psychology and Counselling, Faculty of Health, Queensland University of Technology, Australia.
| | - Bruno Rossion
- Centre for Biomedical Technologies, Queensland University of Technology, Australia; Université de Lorraine, CNRS, IMoPA, F-54000, Nancy, France.
| |
Collapse
|
2
|
Kobylkov D, Vallortigara G. Face detection mechanisms: Nature vs. nurture. Front Neurosci 2024; 18:1404174. [PMID: 38812973 PMCID: PMC11133589 DOI: 10.3389/fnins.2024.1404174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 05/02/2024] [Indexed: 05/31/2024] Open
Abstract
For many animals, faces are a vitally important visual stimulus. Hence, it is not surprising that face perception has become a very popular research topic in neuroscience, with ca. 2000 papers published every year. As a result, significant progress has been made in understanding the intricate mechanisms underlying this phenomenon. However, the ontogeny of face perception, in particular the role of innate predispositions, remains largely unexplored at the neural level. Several influential studies in monkeys have suggested that seeing faces is necessary for the development of the face-selective brain domains. At the same time, behavioural experiments with newborn human babies and newly-hatched domestic chicks demonstrate that a spontaneous preference towards faces emerges early in life without pre-existing experience. Moreover, we were recently able to record face-selective neural responses in the brain of young, face-naïve chicks, thus demonstrating the existence of an innate face detection mechanism. In this review, we discuss these seemingly contradictory results and propose potential experimental approaches to resolve some of the open questions.
Collapse
|
3
|
Hagen S, Laguesse R, Rossion B. Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect. Brain Sci 2024; 14:146. [PMID: 38391720 PMCID: PMC10886861 DOI: 10.3390/brainsci14020146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Revised: 01/16/2024] [Accepted: 01/26/2024] [Indexed: 02/24/2024] Open
Abstract
Face identity recognition (FIR) in humans is supported by specialized neural processes whose function is spectacularly impaired when simply turning a face upside-down: the face inversion effect (FIE). While the FIE appears to have a slow developmental course, little is known about the plasticity of the neural processes involved in this effect-and in FIR in general-at adulthood. Here, we investigate whether extensive training (2 weeks, ~16 h) in young human adults discriminating a large set of unfamiliar inverted faces can reduce an implicit neural marker of the FIE for a set of entirely novel faces. In all, 28 adult observers were trained to individuate 30 inverted face identities presented under different depth-rotated views. Following training, we replicate previous behavioral reports of a significant reduction (56% relative accuracy rate) in the behavioral FIE as measured with a challenging four-alternative delayed-match-to-sample task for individual faces across depth-rotated views. Most importantly, using EEG together with a validated frequency tagging approach to isolate a neural index of FIR, we observe the same substantial (56%) reduction in the neural FIE at the expected occipito-temporal channels. The reduction in the neural FIE correlates with the reduction in the behavioral FIE at the individual participant level. Overall, we provide novel evidence suggesting a substantial degree of plasticity in processes that are key for face identity recognition in the adult human brain.
Collapse
Affiliation(s)
- Simen Hagen
- Université de Lorraine, CNRS, IMoPA, F-54000 Nancy, France
| | - Renaud Laguesse
- Psychological Sciences Research Institute, UCLouvain, 1348 Louvain-La-Neuve, Belgium
| | - Bruno Rossion
- Université de Lorraine, CNRS, IMoPA, F-54000 Nancy, France
- Université de Lorraine, CHRU-Nancy, Service de Neurologie, F-54000 Nancy, France
- Université de Lorraine, CHRU-Nancy, Service de Neurochirurgie, F-54000 Nancy, France
| |
Collapse
|
4
|
Gerlach C, Mogensen E. The face inversion effect does not provide a pure measure of holistic face processing. Behav Res Methods 2024; 56:330-341. [PMID: 36624338 DOI: 10.3758/s13428-022-02054-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/13/2022] [Indexed: 01/10/2023]
Abstract
It is widely held that upright faces are processed more holistically than inverted faces and that this difference is reflected in the face inversion effect. It is not clear, however, how the inversion effect can best be measured, whether it is task specific, or even whether it specifically correlates with processing of upright faces. We examined these questions in a large sample (N = 420) who provided data on processing of upright and inverted stimuli in two different tasks with faces and one with objects. We find that the inversion effects are task dependent, and that they do not correlate better among face processing tasks than they do across face and object processing tasks. These findings were obtained regardless of whether inversion effects were measured by means of difference scores or regression. In comparison, only inversion effects based on regression predicted performance with upright faces in tasks other than those the inversion effects were derived from. Critically, however, inversion effects based on regression also predicted performance with inverted faces to a similar degree as they predicted performance with upright faces. Consequently, and contrary to what is commonly assumed, inversion effects do not seem to capture effects specific to holistic processing of upright faces. While the present findings do not bring us closer to an understanding of which changes in cognitive processing are induced by inversion, they do suggest that inversion effects do not reflect a unitary construct; an implicit assumption that seems to characterize much of the research regarding face processing.
Collapse
Affiliation(s)
- Christian Gerlach
- Department of Psychology, University of Southern Denmark, Campusvej 55, DK-5230, Odense, Denmark.
| | - Erik Mogensen
- Department of Psychology, University of Southern Denmark, Campusvej 55, DK-5230, Odense, Denmark
| |
Collapse
|
5
|
Gerlach C, Kühn CD, Mathiassen AB, Kristensen CL, Starrfelt R. The face inversion effect or the face upright effect? Cognition 2023; 232:105335. [PMID: 36446285 DOI: 10.1016/j.cognition.2022.105335] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/17/2022] [Accepted: 11/20/2022] [Indexed: 11/29/2022]
Abstract
The face inversion effect (FIE) refers to the observation that presenting stimuli upside-down impairs the processing of faces disproportionally more than other mono-oriented objects. This has been taken as evidence that processing of faces and objects differ qualitatively. However, nearly all FIE studies are based on comparing individuation of upright faces, which most people are rather good at, with individuation of objects most people are much less familiar with individuating (e.g., radios and airplanes). Consequently, the FIE may mainly reflect differences between categories in how they are processed prior to inversion, with within-category discrimination of upright faces being a much more familiar task than within-category discrimination among members belonging to other object classes. We tested this hypothesis by comparing inversion effects for faces and objects using object recognition tasks that do not require within-category discrimination (object decision and old/new recognition memory tasks). In all tasks (seven with objects and two with faces) we find credible inversion effects, but in no instance were these effects significantly larger for faces than for objects. This suggests that the FIE can be a product of familiarity with the type of identification process required in the upright conditions rather than some process that is selectively affected for faces when stimuli are inverted.
Collapse
Affiliation(s)
| | - Christina D Kühn
- Department of Psychology, University of Southern Denmark, Denmark; Department of Psychology, Copenhagen University, Denmark
| | | | | | | |
Collapse
|
6
|
Intracerebral Electrophysiological Recordings to Understand the Neural Basis of Human Face Recognition. Brain Sci 2023; 13:brainsci13020354. [PMID: 36831897 PMCID: PMC9954066 DOI: 10.3390/brainsci13020354] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Revised: 02/09/2023] [Accepted: 02/10/2023] [Indexed: 02/22/2023] Open
Abstract
Understanding how the human brain recognizes faces is a primary scientific goal in cognitive neuroscience. Given the limitations of the monkey model of human face recognition, a key approach in this endeavor is the recording of electrophysiological activity with electrodes implanted inside the brain of human epileptic patients. However, this approach faces a number of challenges that must be overcome for meaningful scientific knowledge to emerge. Here we synthesize a 10 year research program combining the recording of intracerebral activity (StereoElectroEncephaloGraphy, SEEG) in the ventral occipito-temporal cortex (VOTC) of large samples of participants and fast periodic visual stimulation (FPVS), to objectively define, quantify, and characterize the neural basis of human face recognition. These large-scale studies reconcile the wide distribution of neural face recognition activity with its (right) hemispheric and regional specialization and extend face-selectivity to anterior regions of the VOTC, including the ventral anterior temporal lobe (VATL) typically affected by magnetic susceptibility artifacts in functional magnetic resonance imaging (fMRI). Clear spatial dissociations in category-selectivity between faces and other meaningful stimuli such as landmarks (houses, medial VOTC regions) or written words (left lateralized VOTC) are found, confirming and extending neuroimaging observations while supporting the validity of the clinical population tested to inform about normal brain function. The recognition of face identity - arguably the ultimate form of recognition for the human brain - beyond mere differences in physical features is essentially supported by selective populations of neurons in the right inferior occipital gyrus and the lateral portion of the middle and anterior fusiform gyrus. In addition, low-frequency and high-frequency broadband iEEG signals of face recognition appear to be largely concordant in the human association cortex. We conclude by outlining the challenges of this research program to understand the neural basis of human face recognition in the next 10 years.
Collapse
|
7
|
Rossion B. Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part I: Function. Neuropsychologia 2022; 173:108278. [DOI: 10.1016/j.neuropsychologia.2022.108278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 03/28/2022] [Accepted: 05/25/2022] [Indexed: 10/18/2022]
|
8
|
Behrmann M, Avidan G. Face perception: computational insights from phylogeny. Trends Cogn Sci 2022; 26:350-363. [PMID: 35232662 DOI: 10.1016/j.tics.2022.01.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 01/21/2022] [Accepted: 01/25/2022] [Indexed: 10/19/2022]
Abstract
Studies of face perception in primates elucidate the psychological and neural mechanisms that support this critical and complex ability. Recent progress in characterizing face perception across species, for example in insects and reptiles, has highlighted the ubiquity over phylogeny of this key ability for social interactions and survival. Here, we review the competence in face perception across species and the types of computation that support this behavior. We conclude that the computational complexity of face perception evinced by a species is not related to phylogenetic status and is, instead, largely a product of environmental context and social and adaptive pressures. Integrating findings across evolutionary data permits the derivation of computational principles that shed further light on primate face perception.
Collapse
Affiliation(s)
- Marlene Behrmann
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA.
| | - Galia Avidan
- Department of Psychology, Ben Gurion University of the Negev, Beer Sheva, Israel
| |
Collapse
|
9
|
Does automatic human face categorization depend on head orientation? Cortex 2021; 141:94-111. [PMID: 34049256 DOI: 10.1016/j.cortex.2021.03.030] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 11/11/2020] [Accepted: 03/19/2021] [Indexed: 01/23/2023]
Abstract
Whether human categorization of visual stimuli as faces is optimal for full-front views, best revealing diagnostic features but lacking depth cues, remains largely unknown. To address this question, we presented 16 human observers with unsegmented natural images of different living and non-living objects at a fast rate (f = 12 Hz), with natural face images appearing at f/9 = 1.33 Hz. Faces posing all full-front or at ¾ side view angles appeared in separate sequences. Robust frequency-tagged 1.33 Hz (and harmonic) occipito-temporal electroencephalographic (EEG) responses reflecting face-selective neural activity did not differ in overall amplitude between full-front and ¾ side views. Despite this, alternating between full-front and ¾ side views within a sequence led to significant responses at specific harmonics of .67 Hz (f/18), objectively isolating view-dependent face-selective responses over occipito-temporal regions. Critically, a time-domain analysis showed that these view-dependent face-selective responses reflected only an earlier response to full-front than ¾ side views by 8-13 ms. Overall, these findings indicate that the face-selective neural representation is as robust for ¾ side faces as for full-front faces in the human brain, but full-front views provide a slightly earlier processing-time advantage as compared to rotated face views.
Collapse
|
10
|
Jacques C, Rossion B, Volfart A, Brissart H, Colnat-Coulbois S, Maillard L, Jonas J. The neural basis of rapid unfamiliar face individuation with human intracerebral recordings. Neuroimage 2020; 221:117174. [DOI: 10.1016/j.neuroimage.2020.117174] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 05/19/2020] [Accepted: 07/14/2020] [Indexed: 12/24/2022] Open
|
11
|
Rossion B. Are facing body dyads as special as (single) faces for the human brain? Cortex 2020; 135:S0010-9452(20)30356-7. [PMID: 34756372 PMCID: PMC7530582 DOI: 10.1016/j.cortex.2020.09.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Accepted: 09/24/2020] [Indexed: 11/15/2022]
Affiliation(s)
- Bruno Rossion
- Université de Lorraine, CNRS, CRAN, Nancy, France; CHRU-Nancy, Service de Neurologie, France.
| |
Collapse
|
12
|
Rossion B, Retter TL, Liu‐Shuang J. Understanding human individuation of unfamiliar faces with oddball fast periodic visual stimulation and electroencephalography. Eur J Neurosci 2020; 52:4283-4344. [DOI: 10.1111/ejn.14865] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Revised: 05/19/2020] [Accepted: 05/30/2020] [Indexed: 01/08/2023]
Affiliation(s)
- Bruno Rossion
- CNRS, CRAN UMR7039 Université de Lorraine F‐54000Nancy France
- Service de Neurologie, CHRU‐Nancy Université de Lorraine F‐54000Nancy France
| | - Talia L. Retter
- Department of Behavioural and Cognitive Sciences Faculty of Language and Literature Humanities, Arts and Education University of Luxembourg Luxembourg Luxembourg
| | - Joan Liu‐Shuang
- Institute of Research in Psychological Science Institute of Neuroscience Université de Louvain Louvain‐la‐Neuve Belgium
| |
Collapse
|
13
|
Typical visual unfamiliar face individuation in left and right mesial temporal epilepsy. Neuropsychologia 2020; 147:107583. [PMID: 32771474 DOI: 10.1016/j.neuropsychologia.2020.107583] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Revised: 07/07/2020] [Accepted: 08/05/2020] [Indexed: 12/14/2022]
Abstract
Patients with chronic mesial temporal lobe epilepsy have difficulties at identifying familiar faces as well as at explicit old/new face recognition tasks. However, the extent to which these difficulties can be attributed to visual individuation of faces, independently of general explicit learning and semantic memory processes, is unknown. We tested 42 mesial temporal lobe epilepsy patients divided into two groups according to the side of epilepsy (left and right) and 42 matched controls on an extensive series of individuation tasks of unfamiliar faces and control visual stimuli, as well as on face detection, famous face recognition and naming, and face and non-face learning. Overall, both patient groups had difficulties at identifying and naming famous faces, and at explicitly learning face and non-face images. However, there was no group difference in accuracy between patients and controls at the two most widely used neuropsychological tests assessing visual individuation of unfamiliar faces (Benton Facial Recognition Test and Cambridge Face Memory Test). While patients with right mesial temporal lobe epilepsy were slowed down at all tasks, this effect was not specific to faces or even high-level stimuli. Importantly, both groups showed the same profile of response as typical participants across various stimulus manipulations, showing no evidence of qualitative processing impairments. Overall, these results point to largely preserved visual face individuation processes in patients with mesial temporal lobe epilepsy, with semantic and episodic memory difficulties being consistent with the localization of the neural structures involved in their epilepsy (anterior temporal cortex and hippocampus). These observations have implications for the prediction of neuropsychological outcomes in the case of surgery and support the validity of intracranial electroencephalographic recordings performed in this population to understand neural mechanisms of human face individuation, notably through intracranial electrophysiological recordings and stimulations.
Collapse
|