1
|
Yovel G, Bash E, Bate S. Humans' extreme face recognition abilities challenge the well-established familiarity effect. Cognition 2024; 251:105904. [PMID: 39106626 DOI: 10.1016/j.cognition.2024.105904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 06/15/2024] [Accepted: 07/22/2024] [Indexed: 08/09/2024]
Abstract
Classification performance is better for learned than unlearned stimuli. This was also reported for faces, where identity matching of unfamiliar faces is worse than for familiar faces. This familiarity advantage led to the conclusion that variability across appearances of the same identity is partly idiosyncratic and cannot be generalized from familiar to unfamiliar identities. Recent advances in machine vision challenge this claim by showing that the performance for untrained (unfamiliar) identities reached the level of trained identities as the number of identities that the algorithm is trained with increases. We therefore asked whether humans who reportedly can identify a vast number of identities, such as super recognizers, may close the gap between familiar and unfamiliar face classification. Consistent with this prediction, super recognizers classified unfamiliar faces just as well as typical participants who are familiar with the same faces, on a task that generates a sizable familiarity effect in controls. Additionally, prosopagnosics' performance for familiar faces was as bad as that of typical participants who were unfamiliar with the same faces, indicating that they struggle to learn even identity-specific information. Overall, these findings demonstrate that by studying the extreme ends of a system's ability we can gain novel insights into its actual capabilities.
Collapse
Affiliation(s)
- Gailt Yovel
- School of Psychological Sciences Tel Aviv University, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel.
| | - Eden Bash
- School of Psychological Sciences Tel Aviv University, Tel Aviv, Israel
| | - Sarah Bate
- Department of Psychology, Bournemouth University, UK
| |
Collapse
|
2
|
Nørkær E, Gobbo S, Roald T, Starrfelt R. Disentangling developmental prosopagnosia: A scoping review of terms, tools and topics. Cortex 2024; 176:161-193. [PMID: 38795651 DOI: 10.1016/j.cortex.2024.04.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 03/08/2024] [Accepted: 04/30/2024] [Indexed: 05/28/2024]
Abstract
The goal of this preregistered scoping review is to create an overview of the research on developmental prosopagnosia (DP). Through analysis of all empirical studies of DP in adults, we investigate 1) how DP is conceptualized and defined, 2) how individuals are classified with DP and 3) which aspects of DP are investigated in the literature. We reviewed 224 peer-reviewed studies of DP. Our analysis of the literature reveals that while DP is predominantly defined as a lifelong face recognition impairment in the absence of acquired brain injury and intellectual/cognitive problems, there is far from consensus on the specifics of the definition with some studies emphasizing e.g., deficits in face perception, discrimination and/or matching as core characteristics of DP. These differences in DP definitions is further reflected in the vast heterogeneity in classification procedures. Only about half of the included studies explicitly state how they classify individuals with DP, and these studies adopt 40 different assessment tools. The two most frequently studied aspects of DP are the role of holistic processing and the specificity of face processing, and alongside a substantial body of neuroimaging studies of DP, this paints a picture of a research field whose scientific interests and aims are rooted in cognitive neuropsychology and neuroscience. We argue that these roots - alongside the heterogeneity in DP definition and classification - may have limited the scope and interest of DP research unnecessarily, and we point to new avenues of research for the field.
Collapse
Affiliation(s)
- Erling Nørkær
- Department of Psychology, University of Copenhagen, Denmark.
| | - Silvia Gobbo
- Department of Psychology, Università degli Studi di Milano-Bicocca, Italy
| | - Tone Roald
- Department of Psychology, University of Copenhagen, Denmark
| | | |
Collapse
|
3
|
Davies-Thompson J, Morgan D, Davis JP, Towler JR. Face Feature Change Detection Ability in Developmental Prosopagnosia and Super-Recognisers. Brain Sci 2024; 14:561. [PMID: 38928560 PMCID: PMC11201608 DOI: 10.3390/brainsci14060561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Revised: 05/27/2024] [Accepted: 05/28/2024] [Indexed: 06/28/2024] Open
Abstract
In non-clinical populations, facial features (eyes, nose, mouth) may vary in their contribution to face identity perception. Changes to whole faces are easier to detect than changes to individual features, and eye changes are typically easier to detect than mouth changes, which in turn are easier to detect than nose changes. However, how this differs for people with face recognition difficulties (developmental prosopagnosia; DP) and for individuals with superior face recognition abilities (super-recognisers; SR) is not clear; although findings from previous studies have suggested differences, the nature of this difference is not understood. The aim of this study was to examine whether differences in the ability to detect feature changes in DPs and SRs were (a) quantitative, meaning that the pattern across feature changes remained the same but there was an overall upwards or downwards shift in performance, or (b) qualitative, meaning that the pattern across feature changes was different. Using a change detection task in which individual face features (eyes, nose, mouth) changed between sequentially presented faces, we found that while prosopagnosics showed a quantitative difference in performance with a downwards shift across all conditions, super-recognisers only showed qualitative differences: they were better able to detect when the face was the same and were marginally (but not non-significantly) worse at detecting when the eyes changed. Further, the only condition which distinguished between the three groups was the ability to identify when the same face was presented, with SRs being better than controls, and controls being better than DPs. Our findings suggest that, in feature-matching tasks, differences for DPs are due to them being overall worse at the task, while SRs use a qualitatively different strategy.
Collapse
Affiliation(s)
- Jodie Davies-Thompson
- School of Psychology, Vivian Tower, Faculty of Medicine, Human & Health Sciences, Swansea University, Swansea SA2 8PP, UK (J.R.T.)
| | - Daniel Morgan
- School of Psychology, Vivian Tower, Faculty of Medicine, Human & Health Sciences, Swansea University, Swansea SA2 8PP, UK (J.R.T.)
| | | | - John R. Towler
- School of Psychology, Vivian Tower, Faculty of Medicine, Human & Health Sciences, Swansea University, Swansea SA2 8PP, UK (J.R.T.)
| |
Collapse
|
4
|
Shoham A, Grosbard ID, Patashnik O, Cohen-Or D, Yovel G. Using deep neural networks to disentangle visual and semantic information in human perception and memory. Nat Hum Behav 2024:10.1038/s41562-024-01816-9. [PMID: 38332339 DOI: 10.1038/s41562-024-01816-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Accepted: 12/22/2023] [Indexed: 02/10/2024]
Abstract
Mental representations of familiar categories are composed of visual and semantic information. Disentangling the contributions of visual and semantic information in humans is challenging because they are intermixed in mental representations. Deep neural networks that are trained either on images or on text or by pairing images and text enable us now to disentangle human mental representations into their visual, visual-semantic and semantic components. Here we used these deep neural networks to uncover the content of human mental representations of familiar faces and objects when they are viewed or recalled from memory. The results show a larger visual than semantic contribution when images are viewed and a reversed pattern when they are recalled. We further reveal a previously unknown unique contribution of an integrated visual-semantic representation in both perception and memory. We propose a new framework in which visual and semantic information contribute independently and interactively to mental representations in perception and memory.
Collapse
Affiliation(s)
- Adva Shoham
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel.
| | - Idan Daniel Grosbard
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
- The Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Or Patashnik
- The Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Daniel Cohen-Or
- The Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel
| | - Galit Yovel
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel.
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel.
| |
Collapse
|
5
|
Leong BQZ, Estudillo AJ, Hussain Ismail AM. Holistic and featural processing's link to face recognition varies by individual and task. Sci Rep 2023; 13:16869. [PMID: 37803085 PMCID: PMC10558561 DOI: 10.1038/s41598-023-44164-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 10/03/2023] [Indexed: 10/08/2023] Open
Abstract
While it is generally accepted that holistic processing facilitates face recognition, recent studies suggest that poor recognition might also arise from imprecise perception of local features in the face. This study aimed to examine to what extent holistic and featural processing relates to individual differences in face recognition ability (FRA), during face learning (Experiment 1) and face recognition (Experiment 2). Participants performed two tasks: (1) The "Cambridge Face Memory Test-Chinese" which measured participants' FRAs, and (2) an "old/new recognition memory test" encompassing whole faces (preserving holistic and featural processing) and faces revealed through a dynamic aperture (impairing holistic processing but preserving featural processing). Our results showed that participants recognised faces more accurately in conditions when holistic information was preserved, than when it is impaired. We also show that the better use of holistic processing during face learning and face recognition was associated with better FRAs. However, enhanced featural processing during recognition, but not during learning, was related to better FRAs. Together, our findings demonstrate that good face recognition depends on distinct roles played by holistic and featural processing at different stages of face recognition.
Collapse
Affiliation(s)
- Bryan Qi Zheng Leong
- School of Psychology, University of Nottingham Malaysia, Semenyih, Malaysia.
- Department of Psychology, Bournemouth University, Poole House Talbot Campus, Poole, BH12 5BB, UK.
| | - Alejandro J Estudillo
- School of Psychology, University of Nottingham Malaysia, Semenyih, Malaysia.
- Department of Psychology, Bournemouth University, Poole House Talbot Campus, Poole, BH12 5BB, UK.
| | | |
Collapse
|
6
|
DeGutis J, Bahierathan K, Barahona K, Lee E, Evans TC, Shin HM, Mishra M, Likitlersuang J, Wilmer JB. What is the prevalence of developmental prosopagnosia? An empirical assessment of different diagnostic cutoffs. Cortex 2023; 161:51-64. [PMID: 36905701 PMCID: PMC10065901 DOI: 10.1016/j.cortex.2022.12.014] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 10/23/2022] [Accepted: 12/19/2022] [Indexed: 02/05/2023]
Abstract
The prevalence of developmental prosopagnosia (DP), lifelong face recognition deficits, is widely reported to be 2-2.5%. However, DP has been diagnosed in different ways across studies, resulting in differing prevalence rates. In the current investigation, we estimated the range of DP prevalence by administering well-validated objective and subjective face recognition measures to an unselected web-based sample of 3116 18-55 year-olds and applying DP diagnostic cutoffs from the last 14 years. We found estimated prevalence rates ranged from .64-5.42% when using a z-score approach and .13-2.95% when using a percentile approach, with the most commonly used cutoffs by researchers having a prevalence rate of .93% (z-score, .45% when using percentiles). We next used multiple cluster analyses to examine whether there was a natural grouping of poorer face recognizers but failed to find consistent grouping beyond those with generally above versus below average face recognition. Lastly, we investigated whether DP studies with more relaxed diagnostic cutoffs were associated with better performance on the Cambridge Face Perception Test. In a sample of 43 studies, there was a weak nonsignificant association between greater diagnostic strictness and better DP face perception accuracy (Kendall's tau-b correlation, τb =.18 z-score; τb = .11 percentiles). Together, these results suggest that researchers have used more conservative DP diagnostic cutoffs than the widely reported 2-2.5% prevalence. We discuss the strengths and weaknesses of using more inclusive cutoffs, such as identifying mild and major forms of DP based on DSM-5.
Collapse
Affiliation(s)
- Joseph DeGutis
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA; Department of Psychiatry, Harvard Medical School, Boston, MA, USA.
| | - Kanisha Bahierathan
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA; Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Katherine Barahona
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA; Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - EunMyoung Lee
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA; Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Travis C Evans
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA; Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Hye Min Shin
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA
| | - Maruti Mishra
- Department of Psychology, University of Richmond, Richmond, VA, USA
| | - Jirapat Likitlersuang
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA; Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Jeremy B Wilmer
- Department of Psychology, Wellesley College, Wellesley, MA, USA
| |
Collapse
|
7
|
Baker KA, Mondloch CJ. Unfamiliar face matching ability predicts the slope of face learning. Sci Rep 2023; 13:5248. [PMID: 37002382 PMCID: PMC10066355 DOI: 10.1038/s41598-023-32244-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Accepted: 03/23/2023] [Indexed: 04/03/2023] Open
Abstract
We provide the first examination of individual differences in the efficiency of face learning. Investigating individual differences in face learning can illuminate potential mechanisms and provide greater understanding of why certain individuals might be more efficient face learners. Participants completed two unfamiliar face matching tasks and a learning task in which learning was assessed after viewing 1, 3, 6, and 9 images of to-be-learned identities. Individual differences in the slope of face learning (i.e., increases in sensitivity to identity) were predicted by the ability to discriminate between matched (same-identity) vs. mismatched (different-identity) pairs of wholly unfamiliar faces. A Dual Process Signal Detection model showed that three parameters increased with learning: Familiarity (an unconscious type of memory that varies in strength), recollection-old (conscious recognition of a learned identity), and recollection-new (conscious/confident rejection of novel identities). Good (vs. poor) matchers had higher Recollection-Old scores throughout learning and showed a steeper increase in Recollection-New. We conclude that good matchers are better able to capitalize on exposure to within-person variability in appearance, an effect that is attributable to their conscious memory for both learned and novel faces. These results have applied implications and will inform contemporary and traditional models of face identification.
Collapse
Affiliation(s)
- Kristen A Baker
- Department of Psychology, Brock University, 1812 Sir Isaac Brock Way, St. Catharines, ON, L2S 3A1, Canada.
| | - Catherine J Mondloch
- Department of Psychology, Brock University, 1812 Sir Isaac Brock Way, St. Catharines, ON, L2S 3A1, Canada
| |
Collapse
|
8
|
Rossion B. Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part I: Function. Neuropsychologia 2022; 173:108278. [DOI: 10.1016/j.neuropsychologia.2022.108278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 03/28/2022] [Accepted: 05/25/2022] [Indexed: 10/18/2022]
|
9
|
Berger A, Fry R, Bobak A, Juliano A, DeGutis J. EXPRESS: Distinct abilities associated with matching same identity faces vs. discriminating different faces: Evidence from individual differences in prosopagnosics and controls. Q J Exp Psychol (Hove) 2022; 75:2256-2271. [PMID: 35034524 DOI: 10.1177/17470218221076817] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Previous face matching studies provide evidence that matching same identity faces (match trials) and discriminating different face identities (non-match trials) rely on distinct processes. For example, instructional studies geared towards improving face matching in applied settings have often found selective improvements in match or non-match trials only. Additionally, a small study found that developmental prosopagnosics (DPs) have specific deficits in making match but not non-match judgments. In the current study, we sought to replicate this finding in DPs and examine how individual differences across DPs and controls in match vs. non-match performance relate to featural vs. holistic processing abilities. 43 DPs and 27 controls matched face images shown from similar front views or with varied lighting or viewpoint. Participants also performed tasks measuring featural (eyes/mouth) and holistic processing (part-whole task). We found that DPs showed worse overall matching performance than controls and that their relative match vs. non-match deficit depended on image variation condition, indicating that DPs do not consistently show match- or non-match-specific deficits. When examining the association between holistic and featural processing abilities and match vs. non-match trials in the entire group of DPs and controls, we found a very clear dissociation: Match trials significantly correlated with eye processing ability (r=.48) but not holistic processing (r=.11), whereas non-match trials significantly correlated with holistic processing (r=.32) but not eye processing (r=.03). This suggests that matching same identity faces relies more on eye processing while discriminating different faces relies more on holistic processing.
Collapse
Affiliation(s)
- Amy Berger
- Department of Psychology, Tufts University, Medford, MA, USA 1810.,Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA
| | - Regan Fry
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA 1811.,Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA, USA
| | - Anna Bobak
- Psychology, University of Stirling, Stirling, UK 7622
| | - Angela Juliano
- Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA 1861.,Brigham and Women's Hospital, Boston, MA
| | - Joseph DeGutis
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA 1811.,Boston Attention and Learning Laboratory, VA Boston Healthcare System, Boston, MA
| |
Collapse
|