Hemispheric Organization for Visual Object Recognition: A Theoretical Account and Empirical Evidence

Individual variation in the functional lateralization of human ventral temporal cortex: Local competition and long-range coupling

The ventral temporal cortex (VTC) of the human cerebrum is critically engaged in computations related to high-level vision. One intriguing aspect of this region is its asymmetric organization and functional lateralization. Notably, in the VTC, neural responses to words are stronger in the left hemisphere, whereas neural responses to faces are stronger in the right hemisphere. Converging evidence has suggested that left-lateralized word responses emerge to couple efficiently with left-lateralized frontotemporal language regions, but evidence is more mixed regarding the sources of the right-lateralization for face perception. Here, we use individual differences as a tool to adjudicate between three theories of VTC organization arising from: 1) local competition between words and faces, 2) local competition between faces and other categories, 3) long-range coupling with VTC and frontotemporal areas subject to their own local competition. First, in an in-house functional MRI experiment, we demonstrated that individual differences in laterality are both substantial and reliable within a right-handed population of young adults. We found no (anti-)correlation in the laterality of word and face selectivity relative to object responses, and a positive correlation when using selectivity relative to a fixation baseline, challenging ideas of local competition between words and faces. We next examined broader local competition with faces using the large-scale Human Connectome Project (HCP) dataset. Face and tool laterality were significantly anti-correlated, while face and body laterality were positively correlated, consistent with the idea that generic local representational competition and cooperation may shape face lateralization. Last, we assessed the role of long-range coupling in the development of VTC laterality. Within our in-house experiment, substantial correlation was evident between VTC text laterality and several other nodes of a distributed text-processing circuit. In the HCP data, VTC face laterality was both negatively correlated with frontotemporal language laterality, and positively correlated with social perception laterality in the same areas, consistent with a long-range coupling effect between face and social processing representations, driven by local competition between language and social processing. We conclude that both local and long-range interactions shape the heterogeneous hemispheric specializations in high-level visual cortex.

Hemispheric dominance in reading system alters contribution to face processing lateralization across development

Face processing dominates the right hemisphere. This lateralization can be affected by co-lateralization within the same system and influence between different systems, such as neural competition from reading acquisition. Yet, how the relationship pattern changes through development remains unknown. This study examined the lateralization of core face processing and word processing in different age groups. By comparing fMRI data from 36 school-aged children and 40 young adults, we investigated whether there are age and regional effects on lateralization, and how relationships between lateralization within and between systems change across development. Our results showed significant right hemispheric lateralization in the core face system and left hemispheric lateralization in reading-related areas for both age groups when viewing faces and texts passively. While all participants showed stronger lateralization in brain regions of higher functional hierarchy when viewing faces, only adults exhibited this lateralization when viewing texts. In both age cohorts, there was intra-system co-lateralization for face processing, whereas an inter-system relationship was only found in adults. Specifically, functional lateralization of Broca's area during reading negatively predicted functional asymmetry in the FFA during face perception. This study initially provides neuroimaging evidence for the reading-induced neural competition theory from a maturational perspective in Chinese cohorts.

An early effect of the parafoveal preview on post-saccadic processing of English words

A key aspect of efficient visual processing is to use current and previous information to make predictions about what we will see next. In natural viewing, and when looking at words, there is typically an indication of forthcoming visual information from extrafoveal areas of the visual field before we make an eye movement to an object or word of interest. This "preview effect" has been studied for many years in the word reading literature and, more recently, in object perception. Here, we integrated methods from word recognition and object perception to investigate the timing of the preview on neural measures of word recognition. Through a combined use of EEG and eye-tracking, a group of multilingual participants took part in a gaze-contingent, single-shot saccade experiment in which words appeared in their parafoveal visual field. In valid preview trials, the same word was presented during the preview and after the saccade, while in the invalid condition, the saccade target was a number string that turned into a word during the saccade. As hypothesized, the valid preview greatly reduced the fixation-related evoked response. Interestingly, multivariate decoding analyses revealed much earlier preview effects than previously reported for words, and individual decoding performance correlated with participant reading scores. These results demonstrate that a parafoveal preview can influence relatively early aspects of post-saccadic word processing and help to resolve some discrepancies between the word and object literatures.

Cortical Face-Selective Responses Emerge Early in Human Infancy

In human adults, multiple cortical regions respond robustly to faces, including the occipital face area (OFA) and fusiform face area (FFA), implicated in face perception, and the superior temporal sulcus (STS) and medial prefrontal cortex (MPFC), implicated in higher-level social functions. When in development, does face selectivity arise in each of these regions? Here, we combined two awake infant functional magnetic resonance imaging (fMRI) datasets to create a sample size twice the size of previous reports (n = 65 infants; 2.6-9.6 months). Infants watched movies of faces, bodies, objects, and scenes, while fMRI data were collected. Despite variable amounts of data from each infant, individual subject whole-brain activation maps revealed responses to faces compared to nonface visual categories in the approximate location of OFA, FFA, STS, and MPFC. To determine the strength and nature of face selectivity in these regions, we used cross-validated functional region of interest analyses. Across this larger sample size, face responses in OFA, FFA, STS, and MPFC were significantly greater than responses to bodies, objects, and scenes. Even the youngest infants (2-5 months) showed significantly face-selective responses in FFA, STS, and MPFC, but not OFA. These results demonstrate that face selectivity is present in multiple cortical regions within months of birth, providing powerful constraints on theories of cortical development.

Reading instruction causes changes in category-selective visual cortex

Education sculpts specialized neural circuits for skills like reading that are critical to success in modern society but were not anticipated by the selective pressures of evolution. Does the emergence of brain regions that selectively process novel visual stimuli like words occur at the expense of cortical representations of other stimuli like faces and objects? "Neuronal Recycling" predicts that learning to read should enhance the response to words in ventral occipitotemporal cortex (VOTC) and decrease the response to other visual categories such as faces and objects. To test this hypothesis, and more broadly to understand the changes that are induced by the early stages of literacy instruction, we conducted a randomized controlled trial with pre-school children (five years of age). Children were randomly assigned to intervention programs focused on either reading skills or oral language skills and magnetoencephalography (MEG) data collected before and after the intervention was used to measure visual responses to images of text, faces, and objects. We found that being taught reading versus oral language skills induced different patterns of change in category-selective regions of visual cortex, but that there was not a clear tradeoff between the response to words versus other categories. Within a predefined region of VOTC corresponding to the visual word form area (VWFA) we found that the relative amplitude of responses to text, faces, and objects changed, but increases in the response to words were not linked to decreases in the response to faces or objects. How these changes play out over a longer timescale is still unknown but, based on these data, we can surmise that high-level visual cortex undergoes rapid changes as children enter school and begin establishing new skills like literacy.

Verbal semantic expertise is associated with reduced functional connectivity between left and right anterior temporal lobes

The left and right anterior temporal lobes (ATLs) encode semantic representations. They show graded hemispheric specialization in function, with the left ATL contributing preferentially to verbal semantic processing. We investigated the cognitive correlates of this organization, using resting-state functional connectivity as a measure of functional segregation between ATLs. We analyzed two independent resting-state fMRI datasets (n = 86 and n = 642) in which participants' verbal semantic expertise was measured using vocabulary tests. In both datasets, people with more advanced verbal semantic knowledge showed weaker functional connectivity between left and right ventral ATLs. This effect was highly specific. It was not observed for within-hemisphere connections between semantic regions (ventral ATL and inferior frontal gyrus (IFG), though it was found for left-right IFG connectivity in one dataset). Effects were not found for tasks probing semantic control, nonsemantic cognition, or face recognition. Our results suggest that hemispheric specialization in the ATLs is not an innate property but rather emerges as people develop highly detailed verbal semantic representations. We speculate that this effect is a consequence of the left ATL's greater connectivity with left-lateralized written word recognition regions, which causes it to preferentially represent meaning for advanced vocabulary acquired primarily through reading.

Functional Resilience of the Neural Visual Recognition System Post-Pediatric Occipitotemporal Resection

In the typically developing (TD) brain, neural representations for visual stimulus categories (e.g., faces, objects, and words) emerge in bilateral occipitotemporal cortex (OTC), albeit with weighted asymmetry; in parallel, recognition behavior continues to be refined. A fundamental question is whether two hemispheres are necessary or redundant for the emergence of neural representations and recognition behavior typically distributed across both hemispheres. The rare population of patients undergoing unilateral OTC resection in childhood offers a unique opportunity to evaluate whether neural computations for visual stimulus individuation suffice for recognition with only a single developing OTC. Here, using functional magnetic resonance imaging, we mapped category selectivity (CS) and neural representations for individual stimulus exemplars using repetition suppression (RS) in the non-resected hemisphere of pediatric OTC resection patients (n = 9) and control patients with resection outside of OTC (n = 12), as well as in both hemispheres of TD controls (n = 21). There were no univariate group differences in the magnitude of CS or RS or any multivariate differences (per representational similarity analysis) in neural activation to faces, objects, or words across groups. Notwithstanding their comparable neural profiles, accuracy of OTC resection patients on face and object recognition, but not word recognition, was statistically inferior to that of controls. The comparable neural signature of the OTC resection patients' preserved hemisphere and the other two groups highlights the resilience of the system following damage to the contralateral homologue. Critically, however, a single OTC does not suffice for normal behavior, and, thereby, implicates the necessity for two hemispheres.

Developmental surface dyslexia and dysgraphia in a child with corpus callosum agenesis: an approach to diagnosis and treatment

We present a case study detailing cognitive performance, functional neuroimaging, and effects of a hypothesis-driven treatment in a 10-year-old girl diagnosed with complete, isolated corpus callosum agenesis. Despite having average overall intellectual abilities, the girl exhibited profound surface dyslexia and dysgraphia. Spelling treatment significantly and persistently improved her spelling of trained irregular words, and this improvement generalized to reading accuracy and speed of trained words. Diffusion weighted imaging revealed strengthened intrahemispheric white matter connectivity of the left temporal cortex after treatment and identified interhemispheric connectivity between the occipital lobes, likely facilitated by a pathway crossing the midline via the posterior commissure. This case underlines the corpus callosum's critical role in lexical reading and writing. It demonstrates that spelling treatment may enhance interhemispheric connectivity in corpus callosum agenesis through alternative pathways, boosting the development of a more efficient functional organization of the visual word form area within the left temporo-occipital cortex.

Holistic processing and face expertise after pediatric resection of occipitotemporal cortex

The nature and extent of hemispheric lateralization and its potential for reorganization continues to be debated, although there is general agreement that there is a right hemisphere (RH) advantage for face processing in human adults. Here, we examined face processing and its lateralization in individuals with a single preserved occipitotemporal cortex (OTC), either in the RH or left hemisphere (LH), following early childhood resection for the management of drug-resistant epilepsy. The matched controls and those with a lesion outside of OTC evinced the standard superiority in processing upright over inverted faces and the reverse sensitivity to a nonface category (bicycles). In contrast, the LH and the RH patient groups were significantly less accurate than the controls and showed mild orientation sensitivities at best (and not always in the predicted directions). For the two patient groups, the accuracies of face and bicycle processing did not differ from each other and were not obviously related to performance on intermediate level global form tasks with, again, poorer thresholds for both patient groups than controls and no difference between the patient groups. These findings shed light on the complexity of hemispheric lateralization and face and nonface object processing in individuals following surgical resection of OTC. Overall, this study highlights the unique dynamics and potential for plasticity in those with childhood cortical resection.

From Perugino to Picasso revisited: Electrophysiological responses to faces in paintings from different art styles

Behavioral research (Ventura, et al., 2023) suggested that pictorial representations of faces varying along a realism-distortion spectrum elicit holistic processing as natural faces. Whether holistic face neural responses are engaged similarly remains, however, underexplored. In the present study, we evaluated the neural correlates of naturalist and artistic face processing, by exploring electrophysiological responses to faces in photographs versus in four major painting styles. The N170 response to faces in photographs was indistinguishable from that elicited by faces in the renaissance art style (depicting the most realistic faces), whilst both categories elicited larger N170 than faces in other art styles (post-impressionism, expressionism, and cubism), with a gradation in brain activity. The present evidence suggest that visual processing may become finer grained the more the realistic nature of the face. Despite behavioral equivalence, the neural mechanisms for holistic processing of natural faces and faces in diverse art styles are not equivalent.

Rethinking cortical recycling in ventral temporal cortex

High-level visual areas in ventral temporal cortex (VTC) support recognition of important categories, such as faces and words. Word-selective regions are left lateralized and emerge at the onset of reading instruction. Face-selective regions are right lateralized and have been documented in infancy. Prevailing theories suggest that face-selective regions become right lateralized due to competition with word-selective regions in the left hemisphere. However, recent longitudinal studies examining face- and word-selective responses in childhood do not provide support for this theory. Instead, there is evidence that word representations recycle cortex previously involved in processing other stimuli, such as limbs. These findings call for more longitudinal investigations of cortical recycling and a new era of work that links visual experience and behavior with neural responses.

Differential functional reorganization of ventral and dorsal visual pathways following childhood hemispherectomy

Hemispherectomy is a surgical procedure in which an entire hemisphere of a patient's brain is resected or functionally disconnected to manage seizures in individuals with drug-resistant epilepsy. Despite the extensive loss of both ventral and dorsal visual pathways in one hemisphere, pediatric patients who have undergone hemispherectomy show a remarkably high degree of perceptual function across many domains. In the current study, we sought to understand the extent to which functions of the ventral and dorsal visual pathways reorganize to the contralateral hemisphere following childhood hemispherectomy. To this end, we collected fMRI data from an equal number of left and right hemispherectomy patients who completed tasks that typically elicit lateralized responses from the ventral or the dorsal pathway, namely, word (left ventral), face (right ventral), tool (left dorsal), and global form (right dorsal) perception. Overall, there was greater evidence of functional reorganization in the ventral pathway than in the dorsal pathway. Importantly, because ventral and dorsal reorganization was tested within the very same patients, these results cannot be explained by idiosyncratic factors such as disease etiology, age at the time of surgery, or age at testing. These findings suggest that because the dorsal pathway may mature earlier, it may have a shorter developmental window of plasticity than the ventral pathway and, hence, be less malleable after perturbation.

Interdependency in lateralization of written word and face processing in right-handed individuals

It has been suggested that the right hemisphere lateralization typically observed for face processing may depend on lateralization of written word processing to the left hemisphere; a pattern referred to as the causal complementary principle of lateralization. According to a strong version of this principle, a correlation should be found between the degree of left and right hemisphere lateralization for word and face processing respectively. This has been observed in two studies, but only for left-handed individuals. The present study tested whether a similar lateralization pattern could be found in a relatively large sample of right-handed individuals (N = 210) using behavioral measures (divided visual field paradigms). It was also tested whether the degree of right hemisphere lateralization for face and global shape processing would correlate positively, as predicted by a strong version of the input asymmetry principle of lateralization. This was tested in a subsample (n = 189). Bayesian analyses found no evidence for lateralization interdependency as the observed data were 4-17 times more likely under the null hypothesis. Unfortunately, the reliabilities of the lateralization measures were found to be poor. While this dampens the firmness of the conclusions that can be drawn, it is argued that at present there is no positive evidence for strong interdependency between written word and face processing in right-handed individuals.

Functional connectivity of the human face network exhibits right hemispheric lateralization from infancy to adulthood

Adults typically exhibit right hemispheric dominance in the processing of faces. In this cross-sectional study, we investigated age-dependent changes in face processing lateralization from infancy to adulthood (1-48 years old; N = 194). We co-registered anatomical and resting state functional Magnetic Resonance Imaging (fMRI) scans of toddlers, children, adolescents, and adults into a common space and examined functional connectivity across the face, as well as place, and object-selective regions identified in adults. As expected, functional connectivity between core face-selective regions was stronger in the right compared to the left hemisphere in adults. Most importantly, the same lateralization was evident in all other age groups (infants, children, adolescents) and appeared only in face-selective regions, and not in place or object-selective regions. These findings suggest that the physiological development of face-selective brain areas may differ from that of object and place-selective areas. Specifically, the functional connectivity of the core-face selective regions exhibits rightward lateralization from infancy, years before these areas develop mature face-selective responses.

Differential functional reorganization of ventral and dorsal visual pathways following childhood hemispherectomy

Hemispherectomy is a surgical procedure in which an entire hemisphere of a patient's brain is resected or functionally disconnected to manage seizures in individuals with drug-resistant epilepsy. Despite the extensive loss of input from both ventral and dorsal visual pathways of one hemisphere, pediatric patients who have undergone hemispherectomy show a remarkably high degree of perceptual function across many domains. In the current study, we sought to understand the extent to which functions of the ventral and dorsal visual pathways reorganize to the contralateral hemisphere following childhood hemispherectomy. To this end, we collected fMRI data from an equal number of left and right hemispherectomy patients who completed tasks that typically elicit lateralized responses from the ventral or the dorsal pathway, namely, word (left ventral), face (right ventral), tool (left dorsal), and global form (right dorsal) perception. Overall, there was greater evidence of functional reorganization in the ventral pathway than in the dorsal pathway. Importantly, because ventral and dorsal reorganization was tested in the very same patients, these results cannot be explained by idiosyncratic factors such as disease etiology, age at the time of surgery, or age at testing. These findings suggest that because the dorsal pathway may mature earlier, it may have a shorter developmental window of plasticity than the ventral pathway and, hence, be less malleable.

Developmental emergence of holistic processing in word recognition

Holistic processing (HP) of faces refers to the obligatory, simultaneous processing of the parts and their relations, and it emerges over the course of development. HP is manifest in a decrement in the perception of inverted versus upright faces and a reduction in face processing ability when the relations between parts are perturbed. Here, adopting the HP framework for faces, we examined the developmental emergence of HP in another domain for which human adults have expertise, namely, visual word processing. Children, adolescents, and adults performed a lexical decision task and we used two established signatures of HP for faces: the advantage in perception of upright over inverted words and nonwords and the reduced sensitivity to increasing parts (word length). Relative to the other groups, children showed less of an advantage for upright versus inverted trials and lexical decision was more affected by increasing word length. Performance on these HP indices was strongly associated with age and with reading proficiency. Also, the emergence of HP for word perception was not simply a result of improved visual perception over the course of development as no group differences were observed on an object decision task. These results reveal the developmental emergence of HP for orthographic input, and reflect a further instance of experience-dependent tuning of visual perception. These results also add to existing findings on the commonalities of mechanisms of word and face recognition. RESEARCH HIGHLIGHTS: Children showed less of an advantage for upright versus inverted trials compared to adolescents and adults. Relative to the other groups, lexical decision in children was more affected by increasing word length. Performance on holistic processing (HP) indices was strongly associated with age and with reading proficiency. HP emergence for word perception was not due to improved visual perception over development as there were no group differences on an object decision task.

Sensory modality and spoken language shape reading network in blind readers of Braille

The neural basis of reading is highly consistent across many languages and scripts. Are there alternative neural routes to reading? How does the sensory modality of symbols (tactile vs. visual) influence their neural representations? We examined these questions by comparing reading of visual print (sighted group, n = 19) and tactile Braille (congenitally blind group, n = 19). Blind and sighted readers were presented with written (words, consonant strings, non-letter shapes) and spoken stimuli (words, backward speech) that varied in word-likeness. Consistent with prior work, the ventral occipitotemporal cortex (vOTC) was active during Braille and visual reading. A posterior/anterior vOTC word-form gradient was observed only in sighted readers with more anterior regions preferring larger orthographic units (words). No such gradient was observed in blind readers. Consistent with connectivity predictions, in blind compared to sighted readers, posterior parietal cortices were recruited to a greater degree and contained word-preferring patches. Lateralization of Braille in blind readers was predicted by laterality of spoken language and reading hand. The effect of spoken language increased along a cortical hierarchy, whereas effect of reading hand waned. These results suggested that the neural basis of reading is influenced by symbol modality and spoken language and support connectivity-based views of cortical function.

Intracerebral Electrophysiological Recordings to Understand the Neural Basis of Human Face Recognition

Understanding how the human brain recognizes faces is a primary scientific goal in cognitive neuroscience. Given the limitations of the monkey model of human face recognition, a key approach in this endeavor is the recording of electrophysiological activity with electrodes implanted inside the brain of human epileptic patients. However, this approach faces a number of challenges that must be overcome for meaningful scientific knowledge to emerge. Here we synthesize a 10 year research program combining the recording of intracerebral activity (StereoElectroEncephaloGraphy, SEEG) in the ventral occipito-temporal cortex (VOTC) of large samples of participants and fast periodic visual stimulation (FPVS), to objectively define, quantify, and characterize the neural basis of human face recognition. These large-scale studies reconcile the wide distribution of neural face recognition activity with its (right) hemispheric and regional specialization and extend face-selectivity to anterior regions of the VOTC, including the ventral anterior temporal lobe (VATL) typically affected by magnetic susceptibility artifacts in functional magnetic resonance imaging (fMRI). Clear spatial dissociations in category-selectivity between faces and other meaningful stimuli such as landmarks (houses, medial VOTC regions) or written words (left lateralized VOTC) are found, confirming and extending neuroimaging observations while supporting the validity of the clinical population tested to inform about normal brain function. The recognition of face identity - arguably the ultimate form of recognition for the human brain - beyond mere differences in physical features is essentially supported by selective populations of neurons in the right inferior occipital gyrus and the lateral portion of the middle and anterior fusiform gyrus. In addition, low-frequency and high-frequency broadband iEEG signals of face recognition appear to be largely concordant in the human association cortex. We conclude by outlining the challenges of this research program to understand the neural basis of human face recognition in the next 10 years.

Intact reading ability despite lacking a canonical visual word form area in an individual born without the left superior temporal lobe

The visual word form area (VWFA), a region canonically located within left ventral temporal cortex (VTC), is specialized for orthography in literate adults presumbly due to its connectivity with frontotemporal language regions. But is a typical, left-lateralized language network critical for the VWFA's emergence? We investigated this question in an individual (EG) born without the left superior temporal lobe but who has normal reading ability. EG showed canonical typical face-selectivity bilateraly but no wordselectivity either in right VWFA or in the spared left VWFA. Moreover, in contrast with the idea that the VWFA is simply part of the language network, no part of EG's VTC showed selectivity to higher-level linguistic processing. Interestingly, EG's VWFA showed reliable multivariate patterns that distinguished words from other categories. These results suggest that a typical left-hemisphere language network is necessary for acanonical VWFA, and that orthographic processing can otherwise be supported by a distributed neural code.

Longitudinal changes in brain activation underlying reading fluency

Reading fluency-the speed and accuracy of reading connected text-is foundational to educational success. The current longitudinal study investigates the neural correlates of fluency development using a connected-text paradigm with an individualized presentation rate. Twenty-six children completed a functional MRI task in 1st/2nd grade (time 1) and again 1-2 years later (time 2). There was a longitudinal increase in activation in the ventral occipito-temporal (vOT) cortex from time 1 to time 2. This increase was also associated with improvements in reading fluency skills and modulated by individual speed demands. These findings highlight the reciprocal relationship of the vOT region with reading proficiency and its importance for supporting the developmental transition to fluent reading. These results have implications for developing effective interventions to target increased automaticity in reading.

Structural and functional connectivity of the inferior temporal numeral area

A growing body of evidence suggests that in adults, there is a spatially consistent "inferior temporal numeral area" (ITNA) in the occipitotemporal cortex that appears to preferentially process Arabic digits relative to non-numerical symbols and objects. However, very little is known about why the ITNA is spatially segregated from regions that process other orthographic stimuli such as letters, and why it is spatially consistent across individuals. In the present study, we used diffusion-weighted imaging and functional magnetic resonance imaging to contrast structural and functional connectivity between left and right hemisphere ITNAs and a left hemisphere letter-preferring region. We found that the left ITNA had stronger structural and functional connectivity than the letter region to inferior parietal regions involved in numerical magnitude representation and arithmetic. Between hemispheres, the left ITNA showed stronger structural connectivity with the left inferior frontal gyrus (Broca's area), while the right ITNA showed stronger structural connectivity to the ipsilateral inferior parietal cortex and stronger functional coupling with the bilateral IPS. Based on their relative connectivity, our results suggest that the left ITNA may be more readily involved in mapping digits to verbal number representations, while the right ITNA may support the mapping of digits to quantity representations.

Human Error Prediction Using Heart Rate Variability and Electroencephalography

As human's simple tasks are being increasingly replaced by autonomous systems and robots, it is likely that the responsibility of handling more complex tasks will be more often placed on human workers. Thus, situations in which workplace tasks change before human workers become proficient at those tasks will arise more frequently due to rapid changes in business trends. Based on this background, the importance of preventing human error will become increasingly crucial. Existing studies on human error reveal how task errors are related to heart rate variability (HRV) indexes and electroencephalograph (EEG) indexes. However, in terms of preventing human error, analysis on their relationship with conditions before human error occurs (i.e., the human pre-error state) is still insufficient. This study aims at identifying biological indexes potentially useful for the detection of high-risk psychological states. As a result of correlation analysis between the number of errors in a Stroop task and the multiple HRV and EEG indexes obtained before and during the task, significant correlations were obtained with respect to several biological indexes. Specifically, we confirmed that conditions before the task are important for predicting the human error risk in high-cognitive-load tasks while conditions both before and during tasks are important in low-cognitive-load tasks.

The mechanisms supporting holistic perception of words and faces are not independent

The question of whether word and face recognition rely on overlapping or dissociable neural and cognitive mechanisms received considerable attention in the literature. In the present work, we presented words (aligned or misaligned) superimposed on faces (aligned or misaligned) and tested the interference from the unattended stimulus category on holistic processing of the attended category. In Experiment 1, we found that holistic face processing is reduced when a face was overlaid with an unattended, aligned word (processed holistically). In Experiment 2, we found a similar reduction of holistic processing for words when a word was superimposed on an unattended, aligned face (processed holistically). This reciprocal interference effect indicates a trade-off in holistic processing of the two stimuli, consistent with the idea that word and face recognition may rely on non-independent, overlapping mechanisms.

With childhood hemispherectomy, one hemisphere can support—but is suboptimal for—word and face recognition

The right and left cerebral hemispheres are important for face and word recognition, respectively—a specialization that emerges over human development. The question is whether this bilateral distribution is necessary or whether a single hemisphere, be it left or right, can support both face and word recognition. Here, face and word recognition accuracy in patients (median age 16.7 y) with a single hemisphere following childhood hemispherectomy was compared against matched typical controls. In experiment 1, participants viewed stimuli in central vision. Across both face and word tasks, accuracy of both left and right hemispherectomy patients, while significantly lower than controls' accuracy, averaged above 80% and did not differ from each other. To compare patients' single hemisphere more directly to one hemisphere of controls, in experiment 2, participants viewed stimuli in one visual field to constrain initial processing chiefly to a single (contralateral) hemisphere. Whereas controls had higher word accuracy when words were presented to the right than to the left visual field, there was no field/hemispheric difference for faces. In contrast, left and right hemispherectomy patients, again, showed comparable performance to one another on both face and word recognition, albeit significantly lower than controls. Altogether, the findings indicate that a single developing hemisphere, either left or right, may be sufficiently plastic for comparable representation of faces and words. However, perhaps due to increased competition or “neural crowding,” constraining cortical representations to one hemisphere may collectively hamper face and word recognition, relative to that observed in typical development with two hemispheres.

Left visual field bias during face perception aligns with individual differences in reading skills and is absent in dyslexia

BACKGROUND

When looking at faces, we tend to attend more to the left visual field (corresponding to the right side of the person's face). This phenomenon is called the left visual field bias (LVF) and is presumed to reflect the brain's right-sided dominance for face processing. Whether alterations in hemispheric dominance are present in dyslexia, and are linked with individual differences in word reading development more generally, is still unclear, and no prior research has utilized gaze-based LVF bias to explore these topics.

AIMS

The aim of the study was to examine whether the LVF bias differs in dyslexia and to examine the association with word-reading skills assessed dimensionally.

SAMPLE

Forty-six 9-13 year-old children with dyslexia and community control children, matched on age and listening comprehension.

METHODS

Participants were presented with a recorded face on a screen while their gaze patterns were collected with an eye tracker. Fixations to the left versus the right side of the face stimuli were compared.

RESULTS

Results showed a clear LVF bias in community controls, while no such bias was seen in the dyslexic group. Moreover, the strength of the LVF bias was correlated with better word reading in the controls.

CONCLUSIONS

Our results suggest a link between weakened hemispheric dominance for face processing in dyslexia and in poor word reading, at least to the extent that the LVF bias actually mirrors underlying physiology. We discuss the implications of these novel findings, highlighting the need for future research to determine the specificity and developmental sources of LVF bias alterations.

Patterns of Neural Functional Connectivity in Infants at Familial Risk of Developmental Dyslexia

Importance

Developmental dyslexia is a heritable learning disability affecting 7% to 10% of the general population and can have detrimental impacts on mental health and vocational potential. Individuals with dyslexia show altered functional organization of the language and reading neural networks; however, it remains unknown how early in life these neural network alterations might emerge.

Objective

To determine whether the early emergence of large-scale neural functional connectivity (FC) underlying long-term language and reading development is altered in infants with a familial history of dyslexia (FHD).

Design, Setting, and Participants

This cohort study included infants recruited at Boston Children's Hospital between May 2011 and February 2019. Participants underwent structural and resting-state functional magnetic resonance imaging in the Department of Radiology at Boston Children's Hospital. Infants with FHD were matched with infants without FHD based on age and sex. Data were analyzed from April 2019 to June 2021.

Exposures

FHD was defined as having at least 1 first-degree relative with a dyslexia diagnosis or documented reading difficulties.

Main Outcomes and Measures

Whole-brain FC patterns associated with 20 predefined cerebral regions important for long-term language and reading development were computed for each infant. Multivariate pattern analyses were applied to identify specific FC patterns that differentiated between infants with vs without FHD. For classification performance estimates, 99% CIs were calculated as the classification accuracy minus chance level.

Results

A total of 98 infants (mean [SD] age, 8.5 [2.3] months; 51 [52.0%] girls) were analyzed, including 35 infants with FHD and 63 infants without FHD. Multivariate pattern analyses identified distinct FC patterns between infants with vs without FHD in the left fusiform gyrus (classification accuracy, 0.55 [99% CI, 0.046-0.062]; corrected P < .001; Cohen d = 0.76). Connections linking left fusiform gyrus to regions in the frontal and parietal language and attention networks were among the paths with the highest contributions to the classification performance.

Conclusions and Relevance

These findings suggest that on the group level, FHD was associated with an early onset of atypical FC of regions important for subsequent word form recognition during reading acquisition. Longitudinal studies linking the atypical functional network and school-age reading abilities will be essential to further elucidate the ontogenetic mechanisms underlying the development of dyslexia.

Let's face it: The lateralization of the face perception network as measured with fMRI is not clearly right dominant

The neural face perception network is distributed across both hemispheres. However, the dominant role in humans is virtually unanimously attributed to the right hemisphere. Interestingly, there are, to our knowledge, no imaging studies that systematically describe the distribution of hemispheric lateralization in the core system of face perception across subjects in large cohorts so far. To address this, we determined the hemispheric lateralization of all core system regions (i.e., occipital face area (OFA), fusiform face area (FFA), posterior superior temporal sulcus (pSTS)) in 108 healthy subjects using functional magnetic resonance imaging (fMRI). We were particularly interested in the variability of hemispheric lateralization across subjects and explored how many subjects can be classified as right-dominant based on the fMRI activation pattern. We further assessed lateralization differences between different regions of the core system and analyzed the influence of handedness and sex on the lateralization with a generalized mixed effects regression model. As expected, brain activity was on average stronger in right-hemispheric brain regions than in their left-hemispheric homologues. This asymmetry was, however, only weakly pronounced in comparison to other lateralized brain functions (such as language and spatial attention) and strongly varied between individuals. Only half of the subjects in the present study could be classified as right-hemispheric dominant. Additionally, we did not detect significant lateralization differences between core system regions. Our data did also not support a general leftward shift of hemispheric lateralization in left-handers. Only the interaction of handedness and sex in the FFA revealed that specifically left-handed men were significantly more left-lateralized compared to right-handed males. In essence, our fMRI data did not support a clear right-hemispheric dominance of the face perception network. Our findings thus ultimately question the dogma that the face perception network - as measured with fMRI - can be characterized as "typically right lateralized".

Acquiring Complex Communicative Systems: Statistical Learning of Language and Emotion

During the early postnatal years, most infants rapidly learn to understand two naturally evolved communication systems: language and emotion. While these two domains include different types of content knowledge, it is possible that similar learning processes subserve their acquisition. In this review, we compare the learnable statistical regularities in language and emotion input. We then consider how domain-general learning abilities may underly the acquisition of language and emotion, and how this process may be constrained in each domain. This comparative developmental approach can advance our understanding of how humans learn to communicate with others.

Evolution of reading and face circuits during the first three years of reading acquisition

Although words and faces activate neighboring regions in the fusiform gyrus, we lack an understanding of how such category selectivity emerges during development. To investigate the organization of reading and face circuits at the earliest stage of reading acquisition, we measured the fMRI responses to words, faces, houses, and checkerboards in three groups of 60 French children: 6-year-old pre-readers, 6-year-old beginning readers and 9-year-old advanced readers. The results showed that specific responses to written words were absent prior to reading, but emerged in beginning readers, irrespective of age. Likewise, specific responses to faces were barely visible in pre-readers and continued to evolve in the 9-year-olds, yet primarily driven by age rather than by schooling. Crucially, the sectors of ventral visual cortex that become specialized for words and faces harbored their own functional connectivity prior to reading acquisition: the VWFA with left-hemispheric spoken language areas, and the FFA with the contralateral region and the amygdalae. The results support the view that reading acquisition occurs through the recycling of a pre-existing but plastic circuit which, in pre-readers, already connects the VWFA site to other distant language areas. We argue that reading acquisition does not compete with the face system directly, through a pruning of preexisting face responses, but indirectly, by hindering the slow growth of face responses in the left hemisphere, thus increasing a pre-existing right hemispheric bias.

Smell what you hardly see: Odors assist visual categorization in the human brain

Visual categorization is the brain ability to rapidly and automatically respond to a certain category of inputs. Whether category-selective neural responses are purely visual or can be influenced by other sensory modalities remains unclear. Here, we test whether odors modulate visual categorization, expecting that odors facilitate the neural categorization of congruent visual objects, especially when the visual category is ambiguous. Scalp electroencephalogram (EEG) was recorded while natural images depicting various objects were displayed in rapid 12-Hz streams (i.e., 12 images / second) and variable exemplars of a target category (either human faces, cars, or facelike objects in dedicated sequences) were interleaved every 9^th stimulus to tag category-selective responses at 12/9 = 1.33 Hz in the EEG frequency spectrum. During visual stimulation, participants (N = 26) were implicitly exposed to odor contexts (either body, gasoline or baseline odors) and performed an orthogonal cross-detection task. We identify clear category-selective responses to every category over the occipito-temporal cortex, with the largest response for human faces and the lowest for facelike objects. Critically, body odor boosts the response to the ambiguous facelike objects (i.e., either perceived as nonface objects or faces) over the right hemisphere, especially for participants reporting their presence post-stimulation. By contrast, odors do not significantly modulate other category-selective responses, nor the general visual response recorded at 12 Hz, revealing a specific influence on the categorization of congruent ambiguous stimuli. Overall, these findings support the view that the brain actively uses cues from the different senses to readily categorize visual inputs, and that olfaction, which has long been considered as poorly functional in humans, is well placed to disambiguate visual information.

Shallow or deep? The impact of orthographic depth on visual processing impairments in developmental dyslexia

The extent to which impaired visual and phonological mechanisms may contribute to the manifestation of developmental dyslexia across orthographies of varying depth has yet to be fully established. By adopting a cross-linguistic approach, the current study aimed to explore the nature of visual and phonological processing in developmental dyslexic readers of shallow (Italian) and deep (English) orthographies, and specifically the characterisation of visual processing deficits in relation to orthographic depth. To achieve this aim, we administered a battery of non-reading visual and phonological tasks. Developmental dyslexics performed worse than typically developing readers on all visual and phonological tasks. Critically, readers of the shallow orthography were disproportionately impaired on visual processing tasks. Our results suggest that the impaired reading and associated deficits observed in developmental dyslexia are anchored by dual impairments to visual and phonological mechanisms that underpin reading, with the magnitude of the visual deficit varying according to orthographic depth.

Lateralization of word and face processing in developmental dyslexia and developmental prosopagnosia

In right-handed adults, face processing is lateralized to the right hemisphere and visual word processing to the left hemisphere. According to the many-to-many account (MTMA) of functional cerebral organization this lateralization pattern is partly dependent on the acquisition of literacy. Hence, the MTMA predicts that: (i) processing of both words and faces should show no or at least less lateralization in individuals with developmental dyslexia compared with controls, and (ii) lateralization in word processing should be normal in individuals with developmental prosopagnosia whereas lateralization in face processing should be absent. To test these hypotheses, 21 right-handed adults with developmental dyslexia and 21 right-handed adults with developmental prosopagnosia performed a divided visual field paradigm with delayed matching of faces, words and cars. Contrary to the predictions, we find that lateralization effects in face processing are within the normal range for both developmental dyslexics and prosopagnosics. Moreover, the group with developmental dyslexia showed right hemisphere lateralization for word processing. We argue that these findings are incompatible with the specific predictions of the MTMA.

A connectivity-constrained computational account of topographic organization in primate high-level visual cortex

Inferotemporal (IT) cortex in humans and other primates is topographically organized, containing multiple hierarchically organized areas selective for particular domains, such as faces and scenes. This organization is commonly viewed in terms of evolved domain-specific visual mechanisms. Here, we develop an alternative, domain-general and developmental account of IT cortical organization. The account is instantiated in interactive topographic networks (ITNs), a class of computational models in which a hierarchy of model IT areas, subject to biologically plausible connectivity-based constraints, learns high-level visual representations optimized for multiple domains. We find that minimizing a wiring cost on spatially organized feedforward and lateral connections, alongside realistic constraints on the sign of neuronal connectivity within model IT, results in a hierarchical, topographic organization. This organization replicates a number of key properties of primate IT cortex, including the presence of domain-selective spatial clusters preferentially involved in the representation of faces, objects, and scenes; columnar responses across separate excitatory and inhibitory units; and generic spatial organization whereby the response correlation of pairs of units falls off with their distance. We thus argue that topographic domain selectivity is an emergent property of a visual system optimized to maximize behavioral performance under generic connectivity-based constraints.

A connectivity-constrained computational account of topographic organization in primate high-level visual cortex

Inferotemporal (IT) cortex in humans and other primates is topographically organized, containing multiple hierarchically organized areas selective for particular domains, such as faces and scenes. This organization is commonly viewed in terms of evolved domain-specific visual mechanisms. Here, we develop an alternative, domain-general and developmental account of IT cortical organization. The account is instantiated in interactive topographic networks (ITNs), a class of computational models in which a hierarchy of model IT areas, subject to biologically plausible connectivity-based constraints, learns high-level visual representations optimized for multiple domains. We find that minimizing a wiring cost on spatially organized feedforward and lateral connections, alongside realistic constraints on the sign of neuronal connectivity within model IT, results in a hierarchical, topographic organization. This organization replicates a number of key properties of primate IT cortex, including the presence of domain-selective spatial clusters preferentially involved in the representation of faces, objects, and scenes; columnar responses across separate excitatory and inhibitory units; and generic spatial organization whereby the response correlation of pairs of units falls off with their distance. We thus argue that topographic domain selectivity is an emergent property of a visual system optimized to maximize behavioral performance under generic connectivity-based constraints.

Unique, Shared, and Dominant Brain Activation in Visual Word Form Area and Lateral Occipital Complex during Reading and Picture Naming

Identifying printed words and pictures concurrently is ubiquitous in daily tasks, and so it is important to consider the extent to which reading words and naming pictures may share a cognitive-neurophysiological functional architecture. Two functional magnetic resonance imaging (fMRI) experiments examined whether reading along the left ventral occipitotemporal region (vOT; often referred to as a visual word form area, VWFA) has activation that is overlapping with referent pictures (i.e., both conditions significant and shared, or with one significantly more dominant) or unique (i.e., one condition significant, the other not), and whether picture naming along the right lateral occipital complex (LOC) has overlapping or unique activation relative to referent words. Experiment 1 used familiar regular and exception words (to force lexical reading) and their corresponding pictures in separate naming blocks, and showed dominant activation for pictures in the LOC, and shared activation in the VWFA for exception words and their corresponding pictures (regular words did not elicit significant VWFA activation). Experiment 2 controlled for visual complexity by superimposing the words and pictures and instructing participants to either name the word or the picture, and showed primarily shared activation in the VWFA and LOC regions for both word reading and picture naming, with some dominant activation for pictures in the LOC. Overall, these results highlight the importance of including exception words to force lexical reading when comparing to picture naming, and the significant shared activation in VWFA and LOC serves to challenge specialized models of reading or picture naming.

Modular community structure of the face network supports face recognition

Face recognition is dependent on computations conducted in specialized brain regions and the communication among them, giving rise to the face-processing network. We examined whether modularity of this network may underlie the vast individual differences found in human face recognition abilities. Modular networks, characterized by strong within and weaker between-network connectivity, were previously suggested to promote efficacy and reduce interference among cognitive systems and also correlated with better cognitive abilities. The study was conducted in a large sample (n = 409) with diffusion-weighted imaging, resting-state fMRI, and a behavioral face recognition measure. We defined a network of face-selective regions and derived a novel measure of communication along with structural and functional connectivity among them. The modularity of this network was positively correlated with recognition abilities even when controlled for age. Furthermore, the results were specific to the face network when compared with the place network or to spatially permuted null networks. The relation to behavior was also preserved at the individual-edge level such that a larger correlation to behavior was found within hemispheres and particularly within the right hemisphere. This study provides the first evidence of modularity-behavior relationships in the domain of face processing and more generally in visual perception.

Developmental changes in neural lateralization for visual-spatial function: Evidence from a line-bisection task

Studies of hemispheric specialization have traditionally cast the left hemisphere as specialized for language and the right hemisphere for spatial function. Much of the supporting evidence for this separation of function comes from studies of healthy adults and those who have sustained lesions to the right or left hemisphere. However, we know little about the developmental origins of lateralization. Recent evidence suggests that the young brain represents language bilaterally, with 4-6-year-olds activating the left-hemisphere regions known to support language in adults as well as homotopic regions in the right hemisphere. This bilateral pattern changes over development, converging on left-hemispheric activation in late childhood. In the present study, we ask whether this same developmental trajectory is observed in a spatial task that is strongly right-lateralized in adults-the line bisection (or "Landmark") task. We examined fMRI activation among children ages 5-11 years as they were asked to judge which end of a bisected vertical line was longer. We found that young children showed bilateral activation, with activation in the same areas of the right hemisphere as has been shown among adults, as well as in the left hemisphere homotopic regions. By age 10, activation was right-lateralized. This strongly resembles the developmental trajectory for language, moving from bilateral to lateralized activation. We discuss potential underlying mechanisms and suggest that understanding the development of lateralization for a range of cognitive functions can play a crucial role in understanding general principles of how and why the brain comes to lateralize certain functions.

Dissociated face- and word-selective intracerebral responses in the human ventral occipito-temporal cortex

The extent to which faces and written words share neural circuitry in the human brain is actively debated. Here, we compare face-selective and word-selective responses in a large group of patients (N = 37) implanted with intracerebral electrodes in the ventral occipito-temporal cortex (VOTC). Both face-selective (i.e., significantly different responses to faces vs. non-face visual objects) and word-selective (i.e., significantly different responses to words vs. pseudofonts) neural activity is isolated with frequency-tagging. Critically, this sensitive approach allows to objectively quantify category-selective neural responses and disentangle them from general visual responses. About 70% of significant electrode contacts show either face-selectivity or word-selectivity only, with the expected right and left hemispheric dominance, respectively. Spatial dissociations are also found within core regions of face and word processing, with a medio-lateral dissociation in the fusiform gyrus (FG) and surrounding sulci, respectively. In the 30% of overlapping face- and word-selective contacts across the VOTC or in the FG and surrounding sulci, between-category-selective amplitudes (faces vs. words) show no-to-weak correlations, despite strong correlations in both the within-category-selective amplitudes (face-face, word-word) and the general visual responses to words and faces. Overall, these observations support the view that category-selective circuitry for faces and written words is largely dissociated in the human adult VOTC.

Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia

Faces and words are traditionally assumed to be independently processed. Dyslexia is also traditionally thought to be a non-visual deficit. Counter to both ideas, face perception deficits in dyslexia have been reported. Others report no such deficits. We sought to resolve this discrepancy. 60 adults participated in the study (24 dyslexic, 36 typical readers). Feature-based processing and configural or global form processing of faces was measured with a face matching task. Opposite laterality effects in these tasks, dependent on left-right orientation of faces, supported that they tapped into separable visual mechanisms. Dyslexic readers tended to be poorer than typical readers at feature-based face matching while no differences were found for global form face matching. We conclude that word and face perception are associated when the latter requires the processing of visual features of a face, while processing the global form of faces apparently shares minimal-if any-resources with visual word processing. The current results indicate that visual word and face processing are both associated and dissociated-but this depends on what visual mechanisms are task-relevant. We suggest that reading deficits could stem from multiple factors, and that one such factor is a problem with feature-based processing of visual objects.

Is human face recognition lateralized to the right hemisphere due to neural competition with left-lateralized visual word recognition? A critical review

The right hemispheric lateralization of face recognition, which is well documented and appears to be specific to the human species, remains a scientific mystery. According to a long-standing view, the evolution of language, which is typically substantiated in the left hemisphere, competes with the cortical space in that hemisphere available for visuospatial processes, including face recognition. Over the last decade, a specific hypothesis derived from this view according to which neural competition in the left ventral occipito-temporal cortex with selective representations of letter strings causes right hemispheric lateralization of face recognition, has generated considerable interest and research in the scientific community. Here, a systematic review of studies performed in various populations (infants, children, literate and illiterate adults, left-handed adults) and methodologies (behavior, lesion studies, (intra)electroencephalography, neuroimaging) offers little if any support for this reading lateralized neural competition hypothesis. Specifically, right-lateralized face-selective neural activity already emerges at a few months of age, well before reading acquisition. Moreover, consistent evidence of face recognition performance and its right hemispheric lateralization being modulated by literacy level during development or at adulthood is lacking. Given the absence of solid alternative hypotheses and the key role of neural competition in the sensory-motor cortices for selectivity of representations, learning, and plasticity, a revised language-related neural competition hypothesis for the right hemispheric lateralization of face recognition should be further explored in future research, albeit with substantial conceptual clarification and advances in methodological rigor.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Reading: The Confluence of Vision and Language

The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Odor-driven face-like categorization in the human infant brain

Understanding how the young infant brain starts to categorize the flurry of ambiguous sensory inputs coming in from its complex environment is of primary scientific interest. Here, we test the hypothesis that senses other than vision play a key role in initiating complex visual categorizations in 20 4-mo-old infants exposed either to a baseline odor or to their mother's odor while their electroencephalogram (EEG) is recorded. Various natural images of objects are presented at a 6-Hz rate (six images/second), with face-like object configurations of the same object categories (i.e., eliciting face pareidolia in adults) interleaved every sixth stimulus (i.e., 1 Hz). In the baseline odor context, a weak neural categorization response to face-like stimuli appears at 1 Hz in the EEG frequency spectrum over bilateral occipitotemporal regions. Critically, this face-like-selective response is magnified and becomes right lateralized in the presence of maternal body odor. This reveals that nonvisual cues systematically associated with human faces in the infant's experience shape the interpretation of face-like configurations as faces in the right hemisphere, dominant for face categorization. At the individual level, this intersensory influence is particularly effective when there is no trace of face-like categorization in the baseline odor context. These observations provide evidence for the early tuning of face-(like)-selective activity from multisensory inputs in the developing brain, suggesting that perceptual development integrates information across the senses for efficient category acquisition, with early maturing systems such as olfaction driving the acquisition of categories in later-developing systems such as vision.

Category-selective deficits are the exception and not the rule: Evidence from a case-series of 64 patients with ventral occipito-temporal cortex damage

The organisational principles of the visual ventral stream are still highly debated, particularly the relative association/dissociation between word and face recognition and the degree of lateralisation of the underlying processes. Reports of dissociations between word and face recognition stem from single case-studies of category selective impairments, and neuroimaging investigations of healthy participants. Despite the historical reliance on single case-studies, more recent group studies have highlighted a greater commonality between word and face recognition. Studying individual patients with rare selective deficits misses (a) important variability between patients, (b) systematic associations between task performance, and (c) patients with mild, severe and/or non-selective impairments; meaning that the full spectrum of deficits is unknown. The Back of the Brain project assessed the range and specificity of visual perceptual impairment in 64 patients with posterior cerebral artery stroke recruited based on lesion localization and not behavioural performance. Word, object, and face processing were measured with comparable tests across different levels of processing to investigate associations and dissociations across domains. We present two complementary analyses of the extensive behavioural battery: (1) a data-driven analysis of the whole patient group, and (2) a single-subject case-series analysis testing for deficits and dissociations in each individual patient. In both analyses, the general organisational principle was of associations between words, objects, and faces even following unilateral lesions. The majority of patients either showed deficits across all domains or in no domain, suggesting a spectrum of visuo-perceptual deficits post stroke. Dissociations were observed, but they were the exception and not the rule: Category-selective impairments were found in only a minority of patients, all of whom showed disproportionate deficits for words. Interestingly, such selective word impairments were found following both left and right hemisphere lesions. This large-scale investigation of posterior cerebral artery stroke patients highlights the bilateral representation of visual perceptual function.

Complementary deficits in perceptual classification in pure alexia and acquired prosopagnosia - New insights from two classic cases

Pure alexia and prosopagnosia traditionally have been seen as prime examples of dissociated, category-specific agnosias affecting reading and face recognition, respectively. More recent accounts have moved towards domain-independent explanations that postulate potential cross-links between different types of visual agnosia. According to one proposal, abnormal crowding, i.e. the impairment of recognition when features of adjacent objects are positioned too closely to each other, might provide a unified account for the perceptual deficits experienced by an agnosic patient. An alternative approach is based on the notion of complementary visual subsystems favouring the processing of abstract categories and specific exemplars, respectively. To test predictions of these two approaches with regard to pure alexia and prosopagnosia, we present previously unpublished data on digit recognition and visual crowding from two in the neuropsychological literature extensively studied patients, KD and MT (e.g., Campbell et al., 1986; Landis and Regard, 1988; Rentschler et al., 1994). Patient MT, diagnosed with pure alexia, showed pronounced abnormal foveal crowding, whereas KD, diagnosed with prosopagnosia, did not. These results form a distinct double dissociation with the performance of the two patients in other perceptual classification tasks involving Gabor micropatterns and textures, as well as Glass patterns, which revealed a significantly greater impairment in KD relative to MT. Based on an analysis of the specific task demands we argue that prosopagnosia and pure alexia may involve complementary deficits in instantiation and abstraction, respectively, during perceptual classification, beyond any category specificity. Such an explanation appears in line with previous distinctions between a predominantly left-hemispheric, abstract-category and a predominantly right-hemispheric, specific-exemplar subsystem underlying object recognition.

Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach

For more than two decades, a network of face-selective brain regions has been identified as the core system for face processing, including occipital face area (OFA), fusiform face area (FFA), and posterior region of superior temporal sulcus (pSTS). Moreover, recent studies have suggested that the ventral route of face processing and memory should end at the anterior temporal lobes (i.e., vATLs), which may play an important role bridging face perception and face memory. It is not entirely clear, however, the extent to which neural activities in these face-selective regions can effectively predict behavioral performance on tasks that are frequently used to investigate face processing and face memory test that requires recognition beyond variation in pose and lighting, especially when non-Caucasian East Asian faces are involved. To address these questions, we first identified during a functional scan the core face network by asking participants to perform a one-back task, while viewing either static images or dynamic videos. Dynamic localizers were effective in identifying regions of interest (ROIs) in the core face-processing system. We then correlated the brain activities of core ROIs with performances on face-processing tasks (component, configural, and composite) and face memory test (Taiwanese Face Memory Test, TFMT) and found evidence for limited predictability. We next adopted an multi-voxel pattern analysis (MVPA) approach to further explore the predictability of face-selective brain regions on TFMT performance and found evidence suggesting that a basic visual processing area such as calcarine and an area for structural face processing such as OFA may play an even greater role in memorizing faces. Implications regarding how differences in processing demands between behavioral and neuroimaging tasks and cultural specificity in face-processing and memory strategies among participants may have contributed to the findings reported here are discussed.

Unique N170 signatures to words and faces in deaf ASL signers reflect experience-specific adaptations during early visual processing

Previous studies with deaf adults reported reduced N170 waveform asymmetry to visual words, a finding attributed to reduced phonological mapping in left-hemisphere temporal regions compared to hearing adults. An open question remains whether this pattern indeed results from reduced phonological processing or from general neurobiological adaptations in visual processing of deaf individuals. Deaf ASL signers and hearing nonsigners performed a same-different discrimination task with visually presented words, faces, or cars, while scalp EEG time-locked to the onset of the first item in each pair was recorded. For word recognition, the typical left-lateralized N170 in hearing participants and reduced left-sided asymmetry in deaf participants were replicated. The groups did not differ on word discrimination but better orthographic skill was associated with larger N170 in the right hemisphere only for deaf participants. Face recognition was characterized by unique N170 signatures for both groups, and deaf individuals exhibited superior face discrimination performance. Laterality or discrimination performance effects did not generalize to the N170 responses to cars, confirming that deaf signers are not inherently less lateralized in their electrophysiological responses to words and critically, giving support to the phonological mapping hypothesis. P1 was attenuated for deaf participants compared to the hearing, but in both groups, P1 selectively discriminated between highly learned familiar objects - words and faces versus less familiar objects - cars. The distinct electrophysiological signatures to words and faces reflected experience-driven adaptations to words and faces that do not generalize to object recognition.