Conditions for facelike expertise with objects: becoming a Ziggerin expert--but which type?

Autistic adults exhibit typical sensitivity to changes in interpersonal distance

The visual processing differences seen in autism often impede individuals' visual perception of the social world. In particular, many autistic people exhibit poor face recognition. Here, we sought to determine whether autistic adults also show impaired perception of dyadic social interactions-a class of stimulus thought to engage face-like visual processing. Our focus was the perception of interpersonal distance. Participants completed distance change detection tasks, in which they had to make perceptual decisions about the distance between two actors. On half of the trials, participants judged whether the actors moved closer together; on the other half, whether they moved further apart. In a nonsocial control task, participants made similar judgments about two grandfather clocks. We also assessed participants' face recognition ability using standardized measures. The autistic and nonautistic observers showed similar levels of perceptual sensitivity to changes in interpersonal distance when viewing social interactions. As expected, however, the autistic observers showed clear signs of impaired face recognition. Despite putative similarities between the visual processing of faces and dyadic social interactions, our results suggest that these two facets of social vision may dissociate.

Learned Attentional Strategies in Word Holistic Processing

Previous research has shown that, like faces, words are processed either holistically or through the automatic representation of their parts combined. The automaticity assumed to underlie the holistic processing of words presupposes that individuals have a relatively low level of control over these processes. However, they may also be capable of learning from their environments whether processing words as a whole is the most efficient processing strategy-which would require at least some control over the corresponding processes. In fact, previous research supports this latter account in the context of the holistic processing of faces: when provided a task in which participants should ignore half of a stimuli (the irrelevant part) and pay selective attention to the other half (the target part), the participants become better at ignoring the irrelevant part when it is commonly misleading (i.e., this suggests a response that is different from that of the relevant part in the context of the task). In the present work, we extend these considerations to holistic word processing. Our results support a learned attentional account in the context of holistic word processing. When an irrelevant word part is systematically helpful for the judgment of a target word half, participants engage more in holistic processing (vs. when the irrelevant word half is misleading). This reflects an incidental statistical learning process in which individuals identify the irrelevant word half as either providing helpful or misleading information about the target half.

Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect

Face identity recognition (FIR) in humans is supported by specialized neural processes whose function is spectacularly impaired when simply turning a face upside-down: the face inversion effect (FIE). While the FIE appears to have a slow developmental course, little is known about the plasticity of the neural processes involved in this effect-and in FIR in general-at adulthood. Here, we investigate whether extensive training (2 weeks, ~16 h) in young human adults discriminating a large set of unfamiliar inverted faces can reduce an implicit neural marker of the FIE for a set of entirely novel faces. In all, 28 adult observers were trained to individuate 30 inverted face identities presented under different depth-rotated views. Following training, we replicate previous behavioral reports of a significant reduction (56% relative accuracy rate) in the behavioral FIE as measured with a challenging four-alternative delayed-match-to-sample task for individual faces across depth-rotated views. Most importantly, using EEG together with a validated frequency tagging approach to isolate a neural index of FIR, we observe the same substantial (56%) reduction in the neural FIE at the expected occipito-temporal channels. The reduction in the neural FIE correlates with the reduction in the behavioral FIE at the individual participant level. Overall, we provide novel evidence suggesting a substantial degree of plasticity in processes that are key for face identity recognition in the adult human brain.

From Perugino to Picasso revisited: Electrophysiological responses to faces in paintings from different art styles

Behavioral research (Ventura, et al., 2023) suggested that pictorial representations of faces varying along a realism-distortion spectrum elicit holistic processing as natural faces. Whether holistic face neural responses are engaged similarly remains, however, underexplored. In the present study, we evaluated the neural correlates of naturalist and artistic face processing, by exploring electrophysiological responses to faces in photographs versus in four major painting styles. The N170 response to faces in photographs was indistinguishable from that elicited by faces in the renaissance art style (depicting the most realistic faces), whilst both categories elicited larger N170 than faces in other art styles (post-impressionism, expressionism, and cubism), with a gradation in brain activity. The present evidence suggest that visual processing may become finer grained the more the realistic nature of the face. Despite behavioral equivalence, the neural mechanisms for holistic processing of natural faces and faces in diverse art styles are not equivalent.

Action initiation and punishment learning differ from childhood to adolescence while reward learning remains stable

Theoretical and empirical accounts suggest that adolescence is associated with heightened reward learning and impulsivity. Experimental tasks and computational models that can dissociate reward learning from the tendency to initiate actions impulsively (action initiation bias) are thus critical to characterise the mechanisms that drive developmental differences. However, existing work has rarely quantified both learning ability and action initiation, or it has relied on small samples. Here, using computational modelling of a learning task collected from a large sample (N = 742, 9-18 years, 11 countries), we test differences in reward and punishment learning and action initiation from childhood to adolescence. Computational modelling reveals that whilst punishment learning rates increase with age, reward learning remains stable. In parallel, action initiation biases decrease with age. Results are similar when considering pubertal stage instead of chronological age. We conclude that heightened reward responsivity in adolescence can reflect differences in action initiation rather than enhanced reward learning.

Using representational similarity analysis to reveal category and process specificity in visual object recognition

Cross-condition comparisons on neurodevelopmental conditions are central in neurodiversity research. In the realm of visual perception, the performance of participants with different category-specific disorders such as developmental prosopagnosia (problems with faces) and dyslexia (problems with words) have contributed to understanding of perceptual processes involved in word and face recognition. Alterations in face and word recognition are present in several neurodiverse populations, and improved knowledge about their relationship may increase our understanding of this variability of impairment. The present study investigates organizing principles of visual object processing and their implications for developmental disorders of recognition. Some accounts suggest that distinct mechanisms are responsible for recognizing objects of different categories, while others propose that categories share or even compete for cortical resources. We took an individual differences approach to estimate the relationship between abilities in recognition. Neurotypical participants (N = 97 after outlier exclusion) performed a match-to-sample task with faces, houses, and pseudowords. Either individual features or feature configurations were manipulated. To estimate the separability of visual recognition mechanisms, we used representational similarity analysis (RSA) where correlational matrices for accuracy were compared to predicted data patterns. Recognition abilities separated into face recognition on one hand and house/pseudoword recognition on the other, indicating that face recognition may rely on relatively selective mechanisms in neurotypicals. We also found evidence for a general visual object recognition mechanism, while some combinations of category (faces, houses, words) and processing type (featural, configural) likely rely on additional mechanisms. Developmental conditions may therefore reflect combinations of impaired and intact aspects of specific and general visual object recognition mechanisms, where featural and configural processes for one object category separate from the featural or configural processing of another. More generally, RSA is a promising approach for advancing understanding of neurodiversity, including shared aspects and distinctions between neurodevelopmental conditions of visual recognition.

Evidence for an amodal domain-general object recognition ability

A general object recognition ability predicts performance across a variety of high-level visual tests, categories, and performance in haptic recognition. Does this ability extend to auditory recognition? Vision and haptics tap into similar representations of shape and texture. In contrast, features of auditory perception like pitch, timbre, or loudness do not readily translate into shape percepts related to edges, surfaces, or spatial arrangement of parts. We find that an auditory object recognition ability correlates highly with a visual object recognition ability after controlling for general intelligence, perceptual speed, low-level visual ability, and memory ability. Auditory object recognition was a stronger predictor of visual object recognition than all control measures across two experiments, even though those control variables were also tested visually. These results point towards a single high-level ability used in both vision and audition. Much work highlights how the integration of visual and auditory information is important in specific domains (e.g., speech, music), with evidence for some overlap of visual and auditory neural representations. Our results are the first to reveal a domain-general ability, o, that predicts object recognition performance in both visual and auditory tests. Because o is domain-general, it reveals mechanisms that apply across a wide range of situations, independent of experience and knowledge. As o is distinct from general intelligence, it is well positioned to potentially add predictive validity when explaining individual differences in a variety of tasks, above and beyond measures of common cognitive abilities like general intelligence and working memory.

A perceptual field test in object experts using gaze-contingent eye tracking

A hallmark of expert object recognition is rapid and accurate subordinate-category recognition of visually homogenous objects. However, the perceptual strategies by which expert recognition is achieved is less known. The current study investigated whether visual expertise changes observers' perceptual field (e.g., their ability to use information away from fixation for recognition) for objects in their domain of expertise, using a gaze-contingent eye-tracking paradigm. In the current study, bird experts and novices were presented with two bird images sequentially, and their task was to determine whether the two images were of the same species (e.g., two different song sparrows) or different species (e.g., song sparrow and chipping sparrow). The first study bird image was presented in full view. The second test bird image was presented fully visible (full-view), restricted to a circular window centered on gaze position (central-view), or restricted to image regions beyond a circular mask centered on gaze position (peripheral-view). While experts and novices did not differ in their eye-movement behavior, experts' performance on the discrimination task for the fastest responses was less impaired than novices in the peripheral-view condition. Thus, the experts used peripheral information to a greater extent than novices, indicating that the experts have a wider perceptual field to support their speeded subordinate recognition.

Deep learning models challenge the prevailing assumption that face-like effects for objects of expertise support domain-general mechanisms

The question of whether task performance is best achieved by domain-specific, or domain-general processing mechanisms is fundemental for both artificial and biological systems. This question has generated a fierce debate in the study of expert object recognition. Because humans are experts in face recognition, face-like neural and cognitive effects for objects of expertise were considered support for domain-general mechanisms. However, effects of domain, experience and level of categorization, are confounded in human studies, which may lead to erroneous inferences. To overcome these limitations, we trained deep learning algorithms on different domains (objects, faces, birds) and levels of categorization (basic, sub-ordinate, individual), matched for amount of experience. Like humans, the models generated a larger inversion effect for faces than for objects. Importantly, a face-like inversion effect was found for individual-based categorization of non-faces (birds) but only in a network specialized for that domain. Thus, contrary to prevalent assumptions, face-like effects for objects of expertise do not support domain-general mechanisms but may originate from domain-specific mechanisms. More generally, we show how deep learning algorithms can be used to dissociate factors that are inherently confounded in the natural environment of biological organisms to test hypotheses about their isolated contributions to cognition and behaviour.

Social experience drives the development of holistic face processing in paper wasps

Most recognition is based on identifying features, but specialization for face recognition in some taxa relies on a different mechanism, termed 'holistic processing' where facial features are bound together into a gestalt which is more than the sum of its parts. Although previous work suggests that extensive experience may be required for the development of holistic processing, we lack experiments that test how age and experience interact to influence holistic processing. Here, we test how age and experience influence the development of holistic face processing in Polistes fuscatus paper wasps. Previous work has shown that P. fuscatus use facial patterns to individually identify conspecifics and wasps use holistic processing to discriminate between conspecific faces. We tested face processing in three groups of P. fuscatus: young (1-week-old), older, experienced (2-weeks-old, normal experience), and older, inexperienced (2-weeks-old, 1 week normal social experience and 1 week social isolation). Older, experienced wasps used holistic processing to discriminate between conspecific faces. In contrast, older inexperienced wasps used featural rather than holistic mechanisms to discriminate between faces. Young wasps show some evidence of holistic face processing, but this ability was less refined than older, experienced wasps. Notably, wasps only required 2 weeks of normal experience to develop holistic processing, while previous work suggests that humans may require years of experience. Overall, P. fuscatus wasps rapidly develop holistic processing for conspecific faces. Experience rather than age facilitates the transition between featural and holistic face processing mechanisms.

Using global feedback to induce learning of gist of abnormality in mammograms

Extraction of global structural regularities provides general 'gist' of our everyday visual environment as it does the gist of abnormality for medical experts reviewing medical images. We investigated whether naïve observers could learn this gist of medical abnormality. Fifteen participants completed nine adaptive training sessions viewing four categories of unilateral mammograms: normal, obvious-abnormal, subtle-abnormal, and global signals of abnormality (mammograms with no visible lesions but from breasts contralateral to or years prior to the development of cancer) and receiving only categorical feedback. Performance was tested pre-training, post-training, and after a week's retention on 200 mammograms viewed for 500 ms without feedback. Performance measured as d' was modulated by mammogram category, with the highest performance for mammograms with visible lesions. Post-training, twelve observed showed increased d' for all mammogram categories but a subset of nine, labelled learners also showed a positive correlation of d' across training. Critically, learners learned to detect abnormality in mammograms with only the global signals, but improvements were poorly retained. A state-of-the-art breast cancer classifier detected mammograms with lesions but struggled to detect cancer in mammograms with the global signal of abnormality. The gist of abnormality can be learned through perceptual/incidental learning in mammograms both with and without visible lesions, subject to individual differences. Poor retention suggests perceptual tuning to gist needs maintenance, converging with findings that radiologists' gist performance correlates with the number of cases reviewed per year, not years of experience. The human visual system can tune itself to complex global signals not easily captured by current deep neural networks.

A label isn't just a label: Brief training leads to label-dependent visuo-cortical processing in adults

The current study examines the extent to which hearing individual-level names (e.g., Jimmy) and category-level labels (e.g., Hitchel) paired with novel objects impacts neural responses across a brief (6 min) learning period. Event-related Potentials (ERPs) were recorded while adult participants (n = 44) viewed and heard exemplars of two different species of named novel objects. ERPs were examined for each labeling condition and compared across the first and second half of the learning trials (∼3 min/half). Mean amplitude decreased for the P1 and increased for the N170 from the first to the second half of trials. The decrease in P1 was right lateralized. In addition, the P1 amplitude recorded over right occipitotemporal regions was greater than left occipitotemporal areas, but only for objects paired with individual-level labels. Category-level labels did not show regional P1 differences. The N250 component was greatest over the right occipitotemporal region and was enhanced for objects labeled with individual-level relative to category-level names during the second half of trials. Overall, these findings highlight the unfolding of label-dependent visual processing across a short training period in adults. The results suggest that linguistic labels have an important, top-down impact, on visual processing and that label specificity shapes visuo-cortical responses within a 6-min learning period.

The mechanisms supporting holistic perception of words and faces are not independent

The question of whether word and face recognition rely on overlapping or dissociable neural and cognitive mechanisms received considerable attention in the literature. In the present work, we presented words (aligned or misaligned) superimposed on faces (aligned or misaligned) and tested the interference from the unattended stimulus category on holistic processing of the attended category. In Experiment 1, we found that holistic face processing is reduced when a face was overlaid with an unattended, aligned word (processed holistically). In Experiment 2, we found a similar reduction of holistic processing for words when a word was superimposed on an unattended, aligned face (processed holistically). This reciprocal interference effect indicates a trade-off in holistic processing of the two stimuli, consistent with the idea that word and face recognition may rely on non-independent, overlapping mechanisms.

Electrophysiological measurements of holistic processing of Chinese characters

Holistic processing (HP) is a marker of perceptual expertise in facial recognition. In the present study, we examined neural responses to the HP of Chinese characters, adopting the composite paradigm. The behavioral results showed that the discrimination of congruent trials was significantly higher than that of incongruent trials, and participants responded faster. Moreover, the congruent trials elicited significantly larger N170 amplitude than the incongruent trials. The HP effect of the N170 component was observed for upright characters, as the configural information of inverted characters and misaligned characters were destroyed. Right-lateralization of processing Chinese characters was observed in the N170 amplitudes and delta-theta band oscillations. The results suggested that Chinese character recognition employed a strategy of HP, and the finding that neural indicators provide a better signal of the strength of HP in Chinese characters than behavioral indicators was also crucial.

A featural account for own-face processing? Looking for support from face inversion, composite face, and part-whole tasks

It is widely accepted that face perception relies on holistic processing. However, this holistic advantage is not always found in the processing of the own face. Our study aimed to explore the role of holistic and featural processing in the identification of the own face, using three standard, but largely independent measures of holistic face processing: the face inversion task, the composite face task, and the part-whole task. Participants were asked to identify their face, a friend’s face, and an unfamiliar face in three different experimental blocks: (a) inverted versus upright; (b) top and bottom halves of the face aligned versus misaligned; and (c) facial features presented in isolation versus whole foil face context. Inverting a face impaired its identification, regardless of the identity. However, alignment effects were only found when identifying a friend or an unfamiliar face. In addition, a stronger feature advantage (i.e., better recognition for isolated features compared to in a whole-face context) was observed for the own face compared to the friend and unfamiliar faces. Altogether, these findings suggest that the own face is processed in a more featural manner but also relies on holistic processing. This work also highlights the importance of taking into consideration that different holistic processing paradigms could tap different forms of holistic processing.

The relationships between reading fluency and different measures of holistic word processing

Recently, paradigms in the face recognition literature have been adopted to reveal holistic processing in word recognition. It is unknown, however, whether different measures of holistic word processing share similar underlying mechanisms, and whether fluent word reading relies on holistic word processing. We measured holistic processing effects in three paradigms (composite, configural sensitivity, part-whole) as well as in reading fluency (3DM task: reading aloud high- and low-frequency words and pseudowords). Bin scores were used to combine accuracy and response time variables in the quest for a more comprehensive, reliable, and valid measure of holistic processing. Weak correlations were found between the different holistic processing measures, with only a significant correlation between the configural sensitivity effect and part-whole effect (r = .32) and a trend of a positive correlation between the word composite effect and configural sensitivity effect (r = .21). Of the three holistic processing measures, only one (part-whole effect) correlated with a lexical access measure of 3DM (r = .23). We also performed a principal component analysis (PCA) of performance in the three lists of 3DM, with the second most probably reflecting lexical access processes. There was a tendency for a positive correlation between part-whole bin measure and Component 2 of PCA. We also found a positive correlation between composite aligned in accuracy and Component 2 of PCA.Our results show that different measures of holistic word processing reflect predominantly different mechanisms, and that differences among normal readers in word reading do not seem to depend highly on holistic processing.

Are you for real? Decoding realistic AI-generated faces from neural activity

Can we trust our eyes? Until recently, we rarely had to question whether what we see is indeed what exists, but this is changing. Artificial neural networks can now generate realistic images that challenge our perception of what is real. This new reality can have significant implications for cybersecurity, counterfeiting, fake news, and border security. We investigated how the human brain encodes and interprets realistic artificially generated images using behaviour and brain imaging. We found that we could reliably decode AI generated faces using people's neural activity. However, while at a group level people performed near chance classifying real and realistic fakes, participants tended to interchange the labels, classifying real faces as realistic fakes and vice versa. Understanding this difference between brain and behavioural responses may be key in determining the 'real' in our new reality. Stimuli, code, and data for this study can be found at https://osf.io/n2z73/.

Visual object recognition ability is not related to experience with visual arts

Visual arts require the ability to process, categorize, recognize, and understand a variety of visual inputs. These challenges may engage and even influence mechanisms that are also relevant for visual object recognition beyond visual arts. A domain-general object recognition ability that applies broadly across a range of visual tasks was recently discovered. Here, we ask whether experience with visual arts is correlated with this domain-general ability. We developed a new survey to measure general visual arts experience and use it to measure arts experience in 142 individuals in whom we also estimated domain-general object recognition ability. Despite our measures demonstrating high reliability in a large sample size, we found substantial evidence (BF01 = 9.52) for no correlation between visual arts experience and general object recognition ability. This suggests that experience in visual arts has little influence on object recognition skills or vice versa, at least in our sample ranging from low to moderately high levels of arts experience. Our methods can be extended to other populations and our results should be replicated, as they suggest some limitations for the generalization of programs targeting visual literacy beyond the visual arts.

Non-monotonic developmental trend of holistic processing in visual expertise: the case of Chinese character recognition

Holistic processing has been identified as an expertise marker of face and object recognition. By contrast, reduced holistic processing is purportedly an expertise marker in recognising orthographic characters in Chinese. Does holistic processing increase or decrease in expertise development? Is orthographic recognition a domain-specific exception to all other kinds of recognition (e.g. face and objects)? In two studies, we examined the developmental trend of holistic processing in Chinese character recognition in Chinese and non-Chinese children, and its relationship with literacy abilities: Chinese first graders—with emergent Chinese literacy acquired in kindergarten—showed increased holistic processing perhaps as an inchoate expertise marker when compared with kindergartners and non-Chinese first graders; however, the holistic processing effect was reduced in higher-grade Chinese children. These results suggest a non-monotonic inverted U-shape trend of holistic processing in visual expertise development: An increase in holistic processing due to initial reading experience followed by a decrease in holistic processing due to literacy enhancement. This result marks the development of holistic and analytic processing skills, both of which can be essential for mastering visual recognition. This study is the first to investigate the developmental trend of holistic processing in Chinese character recognition using the composite paradigm.

Relative tuning of holistic face processing towards the fovea

Humans quickly detect and gaze at faces in the world, which reflects their importance in cognition and may lead to tuning of face recognition toward the central visual field. Although sometimes reported, foveal selectivity in face processing is debated: brain imaging studies have found evidence for a central field bias specific to faces, but behavioral studies have found little foveal selectivity in face recognition. These conflicting results are difficult to reconcile, but they could arise from stimulus-specific differences. Recent studies, for example, suggest that individual faces vary in the degree to which they require holistic processing. Holistic processing is the perception of faces as a whole rather than as a set of separate features. We hypothesized that the dissociation between behavioral and neuroimaging studies arises because of this stimulus-specific dependence on holistic processing. Specifically, the central bias found in neuroimaging studies may be specific to holistic processing. Here, we tested whether the eccentricity-dependence of face perception is determined by the degree to which faces require holistic processing. We first measured the holistic-ness of individual Mooney faces (two-tone shadow images readily perceived as faces). In a group of independent observers, we then used a gender discrimination task to measured recognition of these Mooney faces as a function of their eccentricity. Face gender was recognized across the visual field, even at substantial eccentricities, replicating prior work. Importantly, however, holistic face gender recognition was relatively tuned-slightly, but reliably stronger in the central visual field. Our results may reconcile the debate on the eccentricity-dependance of face perception and reveal a spatial inhomogeneity specifically in the holistic representations of faces.

Sensitivity to orientation is not unique to social attention cueing

It is well-established that faces and bodies cue observers’ visuospatial attention; for example, target items are found faster when their location is cued by the directionality of a task-irrelevant face or body. Previous results suggest that these cueing effects are greatly reduced when the orientation of the task-irrelevant stimulus is inverted. It remains unclear, however, whether sensitivity to orientation is a unique hallmark of “social” attention cueing or a more general phenomenon. In the present study, we sought to determine whether the cueing effects produced by common objects (power drills, desk lamps, desk fans, cameras, bicycles, and cars) are also attenuated by inversion. When cueing stimuli were shown upright, all six object classes produced highly significant cueing effects. When shown upside-down, however, the results were mixed. Some of the cueing effects (e.g., those induced by bicycles and cameras) behaved liked faces and bodies: they were greatly reduced by orientation inversion. However, other cueing effects (e.g., those induced by cars and power drills) were insensitive to orientation: upright and inverted exemplars produced significant cueing effects of comparable strength. We speculate that (i) cueing effects depend on the rapid identification of stimulus directionality, and (ii) some cueing effects are sensitive to orientation because upright exemplars of those categories afford faster processing of directionality, than inverted exemplars. Contrary to the view that attenuation-by-inversion is a unique hallmark of social attention, our findings indicate that some non-social cueing effects also exhibit sensitivity to orientation.

The Effect of Task on Object Processing revealed by EEG decoding

Recent studies showed that task demand affects object representations in higher-level visual areas and beyond, but not so much in earlier areas. There are, however, limitations in those studies including the relatively weak manipulation of task due to the use of familiar real-life objects, the low temporal resolution in fMRI, and the emphasis on the amount and not the source of information carried by brain activations. In the current study, observers categorized images of artificial objects in one of two orthogonal dimensions, shape and texture, while their brain activity was recorded with electroencephalogram (EEG). Results showed that object processing along the texture dimension was affected by task demand starting from a relatively late time (320-370ms time window) after image onset. The findings are consistent with the view that task exerts an effect on the later phases of object processing.

How Visual Expertise Changes Representational Geometry: A Behavioral and Neural Perspective

Many people develop expertise in specific domains of interest, such as chess, microbiology, radiology, and, the case in point in our study: ornithology. It is poorly understood to what extent such expertise alters brain function. Previous neuroimaging studies of expertise have typically focused upon the category level, for example, selectivity for birds versus nonbird stimuli. We present a multivariate fMRI study focusing upon the representational similarity among objects of expertise at the subordinate level. We compare the neural representational spaces of experts and novices to behavioral judgments. At the behavioral level, ornithologists (n = 20) have more fine-grained and task-dependent representations of item similarity that are more consistent among experts compared to control participants. At the neural level, the neural patterns of item similarity are more distinct and consistent in experts than in novices, which is in line with the behavioral results. In addition, these neural patterns in experts show stronger correlations with behavior compared to novices. These findings were prominent in frontal regions, and some effects were also found in occipitotemporal regions. This study illustrates the potential of an analysis of representational geometry to understand to what extent expertise changes neural information processing.

Music-reading expertise associates with face but not Chinese character processing ability

A growing number of behavioural and neuroimaging studies have investigated the cognitive mechanisms and neural substrates underlying various forms of visual expertise, such as face and word processing. However, it remains poorly understood whether and to what extent the acquisition of one form of expertise would be associated with that of another. The current study examined the relationship between music-reading expertise and face and Chinese character processing abilities. In a series of experiments, music experts and novices performed discrimination and recognition tasks of musical notations, faces, and words. Results consistently showed that musical experts responded more accurately to musical notations and faces, but not to words, than did musical novices. More intriguingly, the music expert's age of training onset could well predict their face but not word processing performance: the earlier musical experts began musical notation reading, the better their face processing performance. Taken together, our findings provide preliminary and converging evidence that music-reading expertise links with face, but not word, processing, and lend support to the notion that the development of different types of visual expertise may not be independent, but rather interact with each other during their acquisition.

Associations of observer's gender, Body Mass Index and internalization of societal beauty ideals to visual body processing

We examined whether visual processing mechanisms of the body of conspecifics are different in women and men and whether these rely on westernised socio-cultural ideals and body image concerns. Twenty-four women and 24 men performed a visual discrimination task of upright or inverted images of female or male bodies and faces (Experiment 1) and objects (Experiment 2). In Experiment 1, both groups of women and men showed comparable abilities in the discrimination of upright and inverted bodies and faces. However, the gender of the human stimuli yielded different effects on participants' performance, so that female faces, and male bodies appeared to be processed less configurally than female bodies and male faces, respectively. Interestingly, the reduction of configural processing for male bodies was significantly predicted by participants' Body Mass Index (BMI) and their level of internalization of muscularity. Our findings suggest that configural visual processing of bodies and faces in women and men may be linked to a selective attention to detail needed for discriminating salient physical (perhaps sexual) cues of conspecifics. Importantly, BMI and muscularity internalization of beauty ideals may also play a crucial role in this mechanism.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Why is the literature on first impressions so focused on White faces?

We spontaneously attribute to strangers a wide variety of character traits based on their facial appearance. While these first impressions have little or no basis in reality, they exert a strong influence over our behaviour. Cognitive scientists have revealed a great deal about first impressions from faces including their factor structure, the cues on which they are based, the neurocognitive mechanisms responsible, and their developmental trajectory. In this field, authors frequently strive to remove as much ethnic variability from stimulus sets as possible. Typically, this convention means that participants are asked to judge the likely traits of White faces only. In the present article, we consider four possible reasons for the lack of facial diversity in this literature and find that it is unjustified. Next, we illustrate how the focus on White faces has undermined scientific efforts to understand first impressions from faces and argue that it reinforces socially regressive ideas about 'race' and status. We go on to articulate our concern that opportunities may be lost to leverage the knowledge derived from the study of first impressions against the dire consequences of prejudice and discrimination. Finally, we highlight some promising developments in the field.

Domain-specific and domain-general contributions to reading musical notation

Musical practice may benefit not only domain-specific abilities, such as pitch discrimination and music performance, but also domain-general abilities, like executive functioning and memory. Behavioral and neural changes in visual processing have been associated with music-reading experience. However, it is still unclear whether there is a domain-specific visual ability to process musical notation. This study investigates the specificity of the visual skills relevant to simple decisions about musical notation. Ninety-six participants varying in music-reading experience answered a short survey to quantify experience with musical notation and completed a test battery that assessed musical notation reading fluency and accuracy at the level of individual note or note sequence. To characterize how this ability may relate to domain-general abilities, we also estimated general intelligence (as measured with the Raven's Progressive Matrices) and general object-recognition ability (as measure by a recently proposed construct o). We obtained reliable measurements on our various tasks and found evidence for a domain-specific ability of the perception of musical notation. This music-reading ability and domain-general abilities were found to contribute to performance on specific tasks differently, depending on the level of experience reading music.

Attention capture by trains and faces in children with and without autism spectrum disorder

This study examined involuntary capture of attention, overt attention, and stimulus valence and arousal ratings, all factors that can contribute to potential attentional biases to face and train objects in children with and without autism spectrum disorder (ASD). In the visual domain, faces are particularly captivating, and are thought to have a ‘special status’ in the attentional system. Research suggests that similar attentional biases may exist for other objects of expertise (e.g. birds for bird experts), providing support for the role of exposure in attention prioritization. Autistic individuals often have circumscribed interests around certain classes of objects, such as trains, that are related to vehicles and mechanical systems. This research aimed to determine whether this propensity in autistic individuals leads to stronger attention capture by trains, and perhaps weaker attention capture by faces, than what would be expected in non-autistic children. In Experiment 1, autistic children (6–14 years old) and age- and IQ-matched non-autistic children performed a visual search task where they manually indicated whether a target butterfly appeared amongst an array of face, train, and neutral distractors while their eye-movements were tracked. Autistic children were no less susceptible to attention capture by faces than non-autistic children. Overall, for both groups, trains captured attention more strongly than face stimuli and, trains had a larger effect on overt attention to the target stimuli, relative to face distractors. In Experiment 2, a new group of children (autistic and non-autistic) rated train stimuli as more interesting and exciting than the face stimuli, with no differences between groups. These results suggest that: (1) other objects (trains) can capture attention in a similar manner as faces, in both autistic and non-autistic children (2) attention capture is driven partly by voluntary attentional processes related to personal interest or affective responses to the stimuli.

Children process faces holistically with the same efficiency as adults

Previous studies had reported qualitatively identical holistic face processing (using the composite task) already in 6-year-olds. In the present study, we evaluated these processes quantitatively by evaluating whether children are less efficient in dealing with and encoding faces. Thus, in the present study we explored the time course of holistic processing in children and adults by manipulating stimulus presentation time. The study composite task was presented for 800 ms. The test composite face was presented either for 183 ms or 800 ms. Our youngest participants, 6-year-olds, process faces holistically with the same efficiency as typical adults.

Creepy cats and strange high houses: Support for configural processing in testing predictions of nine uncanny valley theories

In 1970, Masahiro Mori proposed the uncanny valley (UV), a region in a human-likeness continuum where an entity risks eliciting a cold, eerie, repellent feeling. Recent studies have shown that this feeling can be elicited by entities modeled not only on humans but also nonhuman animals. The perceptual and cognitive mechanisms underlying the UV effect are not well understood, although many theories have been proposed to explain them. To test the predictions of nine classes of theories, a within-subjects experiment was conducted with 136 participants. The theories' predictions were compared with ratings of 10 classes of stimuli on eeriness and coldness indices. One type of theory, configural processing, predicted eight out of nine significant effects. Atypicality, in its extended form, in which the uncanny valley effect is amplified by the stimulus appearing more human, also predicted eight. Threat avoidance predicted seven; atypicality, perceptual mismatch, and mismatch+ predicted six; category+, novelty avoidance, mate selection, and psychopathy avoidance predicted five; and category uncertainty predicted three. Empathy's main prediction was not supported. Given that the number of significant effects predicted depends partly on our choice of hypotheses, a detailed consideration of each result is advised. We do, however, note the methodological value of examining many competing theories in the same experiment.

Face and word composite effects are similarly affected by priming of local and global processing

Holistic processing has been shown with both faces and words, but it is unclear how similar their underlying mechanisms are. In this study attention to global and local features was manipulated and the consequences for holistic word and face processing were examined. On each trial participants were presented two Navon figures and told to focus on either the global or the local level. Then they performed a composite task in which they indicated whether the target halves of two sequentially presented faces or words were the same or different, ignoring the irrelevant halves. Similar stronger global priming effects were found for faces and words, indicating that holistic processing for the two types of stimuli were susceptible to attention manipulations to similar degrees, which was confirmed with Bayesian analyses. The findings add to the investigation of the similarity and differences between holistic processing and help reveal those aspects of holistic processing that are domain general and those specific to individual categories.

Perceptual expertise with Chinese characters predicts Chinese reading performance among Hong Kong Chinese children with developmental dyslexia

This study explores the theoretical proposal that developmental dyslexia involves a failure to develop perceptual expertise with words despite adequate education. Among a group of Hong Kong Chinese children diagnosed with developmental dyslexia, we investigated the relationship between Chinese word reading and perceptual expertise with Chinese characters. In a perceptual fluency task, the time of visual exposure to Chinese characters was manipulated and limited such that the speed of discrimination of a short sequence of Chinese characters at an accuracy level of 80% was estimated. Pair-wise correlations showed that perceptual fluency for characters predicted speeded and non-speeded word reading performance. Exploratory hierarchical regressions showed that perceptual fluency for characters accounted for 5.3% and 9.6% variance in speeded and non-speeded reading respectively, in addition to age, non-verbal IQ, phonological awareness, morphological awareness, rapid automatized naming (RAN) and perceptual fluency for digits. The findings suggest that perceptual expertise with words plays an important role in Chinese reading performance in developmental dyslexia, and that perceptual training is a potential remediation direction.

Holistic processing of Chinese characters in college students with dyslexia

Expert face recognition has long been marked by holistic processing. Hence, due to the many visual properties shared between face perception and Chinese characters, it has been suggested that Chinese character recognition may induce stronger holistic processing in expert readers than in novices. However, there have been different viewpoints presented about Chinese character recognition, one of which suggests that expertise in this skill involved reduced holistic processing which may be modulated by writing experiences/performances. In this study we examined holistic processing in Chinese character recognition in adults with and without dyslexia, using the complete composite paradigm. Our results showed that the adults with dyslexia recognized Chinese characters with a stronger holistic processing effect than the typical controls. It seems that those with dyslexia relied overly on the visual spatial information of characters and showed deficits in attending selectively to their components when processing Chinese characters, which hindered the development of expert reading and writing skills. This effect was in contrast to previous perceptual expertise studies in which reduced holistic processing marked deficits in face/visual object recognition. This study is also the first to show that Chinese adults with dyslexia had persistent below average performances in Chinese literacy.

Neuropsychological Subgroups of Emotion Processing in Youths With Conduct Disorder

Background: At the group level, youths with conduct disorder (CD) show deficient emotion processing across various tasks compared to typically developing controls (TDC). But little is known about neuropsychological subgroups within the CD population, the clinical correlates of emotion processing deficits [for instance, with regard to the presence or absence of the DSM-5 Limited Prosocial Emotions (LPE) specifier], and associated risk factors. Methods: 542 children and adolescents with CD (317 girls) and 710 TDCs (479 girls), aged 9-18 years, were included from the FemNAT-CD multisite study. All participants completed three neuropsychological tasks assessing emotion recognition, emotion learning, and emotion regulation. We used a self-report measure of callous-unemotional traits to create a proxy for the LPE specifier. Results: Relative to TDCs, youths with CD as a group performed worse in all three emotion domains. But using clinically based cut-off scores, we found poor emotion recognition skills in only 23% of the participants with CD, followed by emotion regulation deficits in 18%, and emotion learning deficits in 13% of the CD group. Critically, the majority of youths with CD (~56%) did not demonstrate any meaningful neuropsychological deficit, and only a very small proportion showed pervasive deficits across all three domains (~1%). Further analyses indicate that established DSM-5 subtypes of CD are not tightly linked to neurocognitive deficits in one particular emotion domain over another (i.e., emotion recognition deficits in CD+LPE vs. emotion regulation deficits in CD-LPE). Conclusions: Findings from this large-scale data set suggest substantial neuropsychological diversity in emotion processing in the CD population and, consequently, only a subgroup of youths with CD are likely to benefit from additional behavioral interventions specifically targeting emotion processing mechanisms.

Investigating holistic face processing within and outside of face-responsive brain regions

It has been shown that human faces are processed holistically (i.e. as indecomposable wholes, rather than by their component parts) and this holistic face processing is linked to brain activity in face-responsive brain regions. Although several brain regions outside of the face-responsive network are also sensitive to relational processing and perceptual grouping, whether these non-face-responsive regions contribute to holistic processing remains unclear. Here, we investigated holistic face processing in the composite face paradigm both within and outside of face-responsive brain regions. We recorded participants' brain activity using fMRI while they performed a composite face task. Behavioural results indicate that participants tend to judge the same top face halves as different when they are aligned with different bottom face halves but not when they are misaligned, demonstrating a composite face effect. Neuroimaging results revealed significant differences in responses to aligned and misaligned faces in the lateral occipital complex (LOC), and trends in the anterior part of the fusiform face area (FFA2) and transverse occipital sulcus (TOS), suggesting that these regions are sensitive to holistic versus part-based face processing. Furthermore, the retrosplenial cortex (RSC) and the parahippocampal place area (PPA) showed a pattern of neural activity consistent with a holistic representation of face identity, which also correlated with the strength of the behavioural composite face effect. These results suggest that neural activity in brain regions both within and outside of the face-responsive network contributes to the composite-face effect.

Car expertise does not compete with face expertise during ensemble coding

When objects from two categories of expertise (e.g., faces and cars in dual car/face experts) are processed simultaneously, competition occurs across a variety of tasks. Here, we investigate whether competition between face and car processing also occurs during ensemble coding. The relationship between single object recognition and ensemble coding is debated, but if ensemble coding relies on the same ability as object recognition, we expect cars to interfere with ensemble coding of faces as a function of car expertise. We measured the ability to judge the variability in identity of arrays of faces, in the presence of task-irrelevant distractors (cars or novel objects). On each trial, participants viewed two sequential arrays containing four faces and four distractors, judging which array was the more diverse in terms of face identity. We measured participants' car expertise, object recognition ability, and face recognition ability. Using Bayesian statistics, we found evidence against competition as a function of car expertise during ensemble coding of faces. Face recognition ability predicted ensemble judgments for faces, regardless of the category of task-irrelevant distractors. The result suggests that ensemble coding is not susceptible to competition between different domains of similar expertise, unlike single-object recognition.

Further evidence for a late locus of holistic word processing: Exploring vertex effect in the word composite task

Previous studies have shown a rather late and lexical level for holistic word processing. In the present study, we evaluated whether there are early effects in holistic processing of words, taking into consideration the role of lower-level visual processes that are critical in the hierarchy of visual word recognition: the extraction of viewpoint-invariant line junctions/vertices. We used contour-deleted words in two conditions: preservation of the vertices versus preservation of midsegments and an all-contour condition. We found evidence of a composite effect that was equivalent for all materials. Thus, we found no evidence of an early contribution of holistic processing to word recognition, and confirmed that holistic word processing is related to late lexical orthographic representations.

Distinct mechanisms of face representation by enhancive and suppressive neurons of the inferior temporal cortex

Face-selective neurons in the inferior temporal (IT) cortex respond to faces by either increasing (ENH) or decreasing (SUP) their spiking activities compared with their baseline. Although nearly half of IT face neurons are selectively suppressed by face stimulation, their role in face representation is not clear. To address this issue, we recorded the spiking activities and local field potential (LFP) from IT cortex of three monkeys while they viewed a large set of visual stimuli. LFP high-gamma (HG-LFP) power indicated the presence of both ENH and SUP face-selective neural clusters in IT cortex. The magnitude of HG-LFP power of the recording sites was correlated with the magnitude of change in the evoked spiking activities of its constituent neurons for both ENH and SUP face clusters. Spatial distribution of the ENH and SUP face clusters suggests the presence of a complex and heterogeneous face hypercluster organization in IT cortex. Importantly, ENH neurons conveyed more face category and SUP neurons conveyed more face identity information at both the single-unit and neuronal population levels. Onset and peak of suppressive single-unit, neuronal population, and HG-LFP power activities lagged those of the ENH ones. These results demonstrate that IT neuronal code for face representation is optimized by increasing sparseness through selective suppression of a subset of face neurons. We suggest that IT cortex contains spatial clusters of both ENH and SUP face neurons with distinct specialized functional role in face representation.NEW & NOTEWORTHY Electrophysiological and imaging studies have suggested that face information is encoded by a network of clusters of enhancive face-selective neurons in the visual cortex of man and monkey. We show that nearly half of face-selective neurons are suppressed by face stimulation. The suppressive neurons form spatial clusters and convey more face identity information than the enhancive face neurons. Our results suggest the presence of two neuronal subsystems for coarse and fine face information processing.

Experience Transforms Conjunctive Object Representations: Neural Evidence for Unitization After Visual Expertise

Certain transformations must occur within the brain to allow rapid processing of familiar experiences. Complex objects are thought to become unitized, whereby multifeature conjunctions are retrieved as rapidly as a single feature. Behavioral studies strongly support unitization theory, but a compelling neural mechanism is lacking. Here, we examined how unitization transforms conjunctive representations to become more “feature-like” by recruiting posterior regions of the ventral visual stream (VVS) whose architecture is specialized for processing single features. We used functional magnetic resonance imaging to scan humans before and after visual training with novel objects. We implemented a novel multivoxel pattern analysis to measure a conjunctive code, which represented a conjunction of object features above and beyond the sum of the parts. Importantly, a multivoxel searchlight showed that the strength of conjunctive coding in posterior VVS increased posttraining. Furthermore, multidimensional scaling revealed representational separation at the level of individual features in parallel to the changes at the level of feature conjunctions. Finally, functional connectivity between anterior and posterior VVS was higher for novel objects than for trained objects, consistent with early involvement of anterior VVS in unitizing feature conjunctions in response to novelty. These data demonstrate that the brain implements unitization as a mechanism to refine complex object representations over the course of multiple learning experiences.

Holistic word processing is correlated with efficiency in visual word recognition

Holistic processing of visual words (i.e., obligatory encoding of/attending to all letters of a word) could be a marker of expert word recognition. In the present study, we thus examined for the first time whether there is a direct relation between the word-composite effect (i.e., all parts of a visual word are fully processed when observers perform a task on a word part) and fast access to the orthographic lexicon by visual word experts (i.e., fluent adult readers). We adopted an individual differences approach and used the word-frequency effect (i.e., faster recognition of high- than low-frequency words) in an independent lexical decision task as a proxy of fast access to lexical orthographic representations. Fluent readers with larger word-composite effect showed smaller word-frequency effect. This correlation was mainly driven by an association between a larger composite effect and faster lexical decision on low-frequency words, probably because these lexical representations are less stable and integrated/unitized, hence allowing differentiating among fluent readers. We thus showed that holistic processing of visual words is indeed related to higher efficiency in visual word recognition by skilled readers.

Is it impossible to acquire absolute pitch in adulthood?

Absolute pitch (AP) refers to the rare ability to name the pitch of a tone without external reference. It is widely believed to be only for the selected few with rare genetic makeup and early musical training during the critical period, and therefore acquiring AP in adulthood is impossible. Previous studies have not offered a strong test of the effect of training because of issues like small sample size and insufficient training. In three experiments, adults learned to name pitches in a computerized, gamified and personalized training protocol for 12 to 40 hours, with the number of pitches gradually increased from three to twelve. Across the three experiments, the training covered different octaves, timbre, and training environment (inside or outside laboratory). AP learning showed classic characteristics of perceptual learning, including generalization of learning dependent on the training stimuli, and sustained improvement for at least one to three months. 14% of the participants (6 out of 43) were able to name twelve pitches at 90% or above accuracy, comparable to that of 'AP possessors' as defined in the literature. Overall, AP continues to be learnable in adulthood, which challenges the view that AP development requires both rare genetic predisposition and learning within the critical period. The finding calls for reconsideration of the role of learning in the occurrence of AP, and pushes the field to pinpoint and explain the differences, if any, between the aspects of AP more trainable in adulthood and the aspects of AP that are potentially exclusive for the few exceptional AP possessors observed in the real world.

Is holistic processing of written words modulated by phonology?

Holistic processing, a hallmark of face processing, has been shown for written words, signaled by the word composite effect. Fluent readers find it harder to focus on one half of a written word (e.g., the first syllable of a CV.CV word) while ignoring the other half (e.g., the second syllable), especially when the two halves are aligned rather than misaligned. Given the linguistic nature of written words, in the present study, we examined whether the word composite effect is modulated by phonology. In Experiment 1, participants saw two sequentially presented CV.CV words and had to decide if the left half (first syllable) was the same or not, regardless of the right half. The word pairs were either phonologically consistent (univocal orthography to phonology mapping; e.g., TI is always /ti/ in Portuguese) or inconsistent (orthography can map into different phonological representations; e.g., CA can correspond to /ka/ or /kɐ/). The word composite effect was found for phonologically consistent words but not for phonologically inconsistent words. In Experiment 2, timing of trial events was reduced to test whether the influence of phonology was fast and automatic. Similar to what was found in Experiment 1, the word composite effect was found only for phonologically consistent words. The faster trial events in Experiment 2 rendered it less likely that the influence of phonology in word composite effect is merely a result of strategic processing. These findings suggest that holistic processing of visual words is modulated by fast and automatic activation of lexical phonological representations.

Holistic word context does not influence holistic processing of artificial objects in an interleaved composite task

Holistic processing, a hallmark of expert processing, has been shown for written words, signaled by the word composite effect, similar to the face composite effect: fluent readers find it difficult to focus on just one half of a written word while ignoring the other half, especially when the two word halves are aligned rather than misaligned. This effect is signaled by a significant interaction between alignment and congruency of the two word parts. Face and visual word recognition, however, involve different neural mechanisms with an opposite hemispheric lateralization. It is then possible that faces and words can both involve holistic processing in their own separate face and word processing systems, but by using different mechanisms. In the present study, we replicated with words a previous study done with faces (Richler, Bukach, & Gauthier, 2009, Experiment 3). In a first experiment we showed that in a composite task with aligned artificial objects, no congruency effects are found. In a second experiment, using an interleaved task, a congruency effect for Ziggerins was induced in trials in which a word was first encoded, but more strongly when it was aligned. However, in a stricter test, we found no differences between the congruency effect for Ziggerins induced by aligned words versus pseudowords. Our results demonstrate that different mechanisms can underlie holistic processing in different expertise domains.

Visual training with musical notes changes late but not early electrophysiological responses in the visual cortex

Visual expertise with musical notation is unique. Fluent music readers show selectively higher activity to musical notes than to other visually similar patterns in both the retinotopic and higher-level visual areas and both very early (e.g., C1) and later (e.g., N170) visual event-related potential (ERP) components. This is different from domains such as face and letter perception, of which the neural expertise marker is typically found in the higher-level ventral visual areas and later (e.g., N170) ERP components. An intriguing question concerns whether the visual skills and neural selectivity observed in music-reading experts are a result of the effects of extensive visual experience with musical notation. The current study aimed to investigate the causal relationship between visual experience and its neural changes with musical notation. Novices with no formal musical training experience were trained to visually discriminate between note patterns in the laboratory for 10-26 hr such that their performance was comparable with fluent music readers. The N170 component became more selective for musical notes after training. Training was not, however, followed by changes in the earlier C1 component. The findings show that visual training is enough for causing changes in the responses of the higher-level visual areas to musical notation while the engagement of the early visual areas may involve additional nonvisual factors.

Extended categorization of conjunction object stimuli decreases the latency of attentional feature selection and recruits orthography-linked ERPs

The role of attention in driving perceptual expertise effects is controversial. The current study addressed the effect of training on ERP components related to and independent of attentional feature selection. Participants learned to categorize cartoon animals over six training sessions (8,800 trials) after which ERPs were recorded during a target detection task performed on trained and untrained stimulus sets. The onset of the selection negativity, an ERP component indexing attentional modulation, was about 60 msec earlier for trained than untrained stimuli. Trained stimuli also elicited centro-parietal N200 and N320 components that were insensitive to attentional feature selection. The scalp distribution and timecourse of these components were better matched by studies of orthography than object expertise. Source localization using eLORETA suggested that the strongest neural sources of the selection negativity were in right ventral temporal cortex whereas the strongest sources of the N200/N320 components were in left ventral temporal cortex, again consistent with the hypothesis that training recruited orthography related areas. Overall, training altered neural processes related to attentional selection, but also affected neural processes that were independent of feature selection.