Visual word processing and experiential origins of functional selectivity in human extrastriate cortex

Shared and task-specific brain functional differences across multiple tasks in children with developmental dyslexia

Different tasks have been used in examining the neural functional differences associated with developmental dyslexia (DD), and consequently, different findings have been reported. However, very few studies have systematically compared multiple tasks in understanding what specific task differences each brain region is associated with. In this study, we employed an auditory rhyming task, a visual rhyming task, and a visual spelling task, in order to investigate shared and task-specific neural differences in Chinese children with DD. First, we found that children with DD had reduced activation in the opercular part of the left inferior frontal gyrus (IFG) only in the two rhyming tasks, suggesting impaired phonological analysis. Children with DD showed functional differences in the right lingual gyrus/inferior occipital gyrus only in the two visual tasks, suggesting deficiency in their visuo-orthographic processing. Moreover, children with DD showed reduced activation in the left dorsal inferior frontal gyrus and increased activation in the right precentral gyrus across all of the three tasks, suggesting neural signatures of DD in Chinese. In summary, our study successfully separated brain regions associated with differences in orthographic processing, phonological processing, and general lexical processing in DD. It advances our understanding about the neural mechanisms of DD.

Associations between brain imaging-derived phenotypes and cognitive functions

We aimed to evaluate the potential causal relationship between brain imaging-derived phenotypes and cognitive functions via Mendelian randomization analyses. Genetic instruments for 470 brain imaging-derived phenotypes were selected from a genome-wide association study based on the UK Biobank (n = 33,224). Statistics for cognitive functions were obtained from the genome-wide association study based on the UK Biobank. We used the inverse variance weighted Mendelian randomization method to investigate the associations between brain imaging-derived phenotypes and cognitive functions, and reverse Mendelian randomization analyses were performed for significant brain imaging-derived phenotypes to examine the reverse causation for the identified associations. We identified three brain imaging-derived phenotypes to be associated with verbal-numerical reasoning, including cortical surface area of the left fusiform gyrus (beta, 0.18 [95% confidence interval, 0.11 to 0.25], P = 4.74 × 10-7), cortical surface area of the right superior temporal gyrus (beta, 0.25 [95% confidence interval, 0.15 to 0.35], P = 6.30 × 10-7), and orientation dispersion in the left superior longitudinal fasciculus (beta, 0.14 [95% confidence interval, 0.09 to 0.20], P = 8.37 × 10-7). The reverse Mendelian randomization analysis indicated that verbal-numerical reasoning had no effect on these three brain imaging-derived phenotypes. This Mendelian randomization study identified cortical surface area of the left fusiform gyrus, cortical surface area of the right superior temporal gyrus, and orientation dispersion in the left superior longitudinal fasciculus as predictors of verbal-numerical reasoning.

Semantic encoding during language comprehension at single-cell resolution

From sequences of speech sounds1,2 or letters3, humans can extract rich and nuanced meaning through language. This capacity is essential for human communication. Yet, despite a growing understanding of the brain areas that support linguistic and semantic processing4-12, the derivation of linguistic meaning in neural tissue at the cellular level and over the timescale of action potentials remains largely unknown. Here we recorded from single cells in the left language-dominant prefrontal cortex as participants listened to semantically diverse sentences and naturalistic stories. By tracking their activities during natural speech processing, we discover a fine-scale cortical representation of semantic information by individual neurons. These neurons responded selectively to specific word meanings and reliably distinguished words from nonwords. Moreover, rather than responding to the words as fixed memory representations, their activities were highly dynamic, reflecting the words' meanings based on their specific sentence contexts and independent of their phonetic form. Collectively, we show how these cell ensembles accurately predicted the broad semantic categories of the words as they were heard in real time during speech and how they tracked the sentences in which they appeared. We also show how they encoded the hierarchical structure of these meaning representations and how these representations mapped onto the cell population. Together, these findings reveal a finely detailed cortical organization of semantic representations at the neuron scale in humans and begin to illuminate the cellular-level processing of meaning during language comprehension.

The language network as a natural kind within the broader landscape of the human brain

Language behaviour is complex, but neuroscientific evidence disentangles it into distinct components supported by dedicated brain areas or networks. In this Review, we describe the 'core' language network, which includes left-hemisphere frontal and temporal areas, and show that it is strongly interconnected, independent of input and output modalities, causally important for language and language-selective. We discuss evidence that this language network plausibly stores language knowledge and supports core linguistic computations related to accessing words and constructions from memory and combining them to interpret (decode) or generate (encode) linguistic messages. We emphasize that the language network works closely with, but is distinct from, both lower-level - perceptual and motor - mechanisms and higher-level systems of knowledge and reasoning. The perceptual and motor mechanisms process linguistic signals, but, in contrast to the language network, are sensitive only to these signals' surface properties, not their meanings; the systems of knowledge and reasoning (such as the system that supports social reasoning) are sometimes engaged during language use but are not language-selective. This Review lays a foundation both for in-depth investigations of these different components of the language processing pipeline and for probing inter-component interactions.

Developing cortex is functionally pluripotent: Evidence from blindness

How rigidly does innate architecture constrain function of developing cortex? What is the contribution of early experience? We review insights into these questions from visual cortex function in people born blind. In blindness, occipital cortices are active during auditory and tactile tasks. What 'cross-modal' plasticity tells us about cortical flexibility is debated. On the one hand, visual networks of blind people respond to higher cognitive information, such as sentence grammar, suggesting drastic repurposing. On the other, in line with 'metamodal' accounts, sighted and blind populations show shared domain preferences in ventral occipito-temporal cortex (vOTC), suggesting visual areas switch input modality but perform the same or similar perceptual functions (e.g., face recognition) in blindness. Here we bring these disparate literatures together, reviewing and synthesizing evidence that speaks to whether visual cortices have similar or different functions in blind and sighted people. Together, the evidence suggests that in blindness, visual cortices are incorporated into higher-cognitive (e.g., fronto-parietal) networks, which are a major source long-range input to the visual system. We propose the connectivity-constrained experience-dependent account. Functional development is constrained by innate anatomical connectivity, experience and behavioral needs. Infant cortex is pluripotent, the same anatomical constraints develop into different functional outcomes.

Visual word processing engages a hierarchical, distributed, and bilateral cortical network

Although the Visual Word Form Area (VWFA) in left temporal cortex is considered the pre-eminent region in visual word processing, other regions are also implicated. We examined the entire text-selective circuit, using functional MRI. Ten regions of interest (ROIs) per hemisphere were defined, which, based on clustering, grouped into early vision, high-level vision, and language clusters. We analyzed the responses of the ROIs and clusters to words, inverted words, and consonant strings using univariate, multivariate, and functional connectivity measures. Bilateral modulation by stimulus condition was evident, with a stronger effect in left hemisphere regions. Last, using graph theory, we observed that the VWFA was equivalently connected with early visual and language clusters in both hemispheres, reflecting its role as a mediator in the circuit. Although the individual ROIs and clusters bilaterally were flexibly altered by the nature of the input, stability held at the level of global circuit connectivity, reflecting the complex hierarchical distributed system serving visual text perception.

Neural Specialization for English and Arabic Print in Early Readers

Learning to read requires the specialization of a region in the left fusiform gyrus known as the visual word form area (VWFA). This region, which initially responds to faces and objects, develops specificity for print over a long trajectory of instruction and practice. VWFA neurons may be primed for print because of their pre-literate tuning properties, becoming specialized through top-down feedback mechanisms during learning. However, much of what is known about the VWFA comes from studies of Western orthographies, whose alphabets share common visual characteristics. Far less is known about the development of the VWFA for Arabic, which is a complex orthography and is significantly more difficult to achieve fluency in in reading. In the current study, electroencephalography responses were collected from first grade children in the United Arab Emirates learning to read in both English and Arabic. Children viewed words and false font strings in English and Arabic while performing a vigilance task. The P1 and N1 responses to all stimulus categories were quantified in two occipital and two parietal electrodes as well as the alpha band signal across all four electrodes of interest. Analysis revealed a significantly stronger N1 response to English compared to Arabic and decreased alpha power to Arabic compared to English. These findings suggest a fundamental difference in neural plasticity for these two distinct orthographies, even when instruction is concurrent. Future work is needed to determine whether VWFA specialization for Arabic takes longer than more well-studied orthographies and if differences in reading instruction approaches help accelerate this process.

Lexical and sublexical cortical tuning for print revealed by Steady-State Visual Evoked Potentials (SSVEPs) in early readers

There are multiple levels of processing relevant to reading that vary in their visual, sublexical, and lexical orthographic processing demands. Segregating distinct cortical sources for each of these levels has been challenging in EEG studies of early readers. To address this challenge, we applied recent advances in analyzing high-density EEG using Steady-State Visual Evoked Potentials (SSVEPs) via data-driven Reliable Components Analysis (RCA) in a group of early readers spanning from kindergarten to second grade. Three controlled stimulus contrasts-familiar words versus unfamiliar pseudofonts, familiar words versus pseudowords, and pseudowords versus nonwords-were used to isolate coarse print tuning, lexical processing, and sublexical orthography-related processing, respectively. First, three overlapping yet distinct neural sources-left vOT, dorsal parietal, and primary visual cortex were revealed underlying coarse print tuning. Second, we segregated distinct cortical sources for the other two levels of processing: lexical fine tuning over occipito-temporal/parietal regions; sublexical orthographic fine tuning over left occipital regions. Finally, exploratory group analyses based on children's reading fluency suggested that coarse print tuning emerges early even in children with limited reading knowledge, while sublexical and higher-level lexical processing emerge only in children with sufficient reading knowledge. RESEARCH HIGHLIGHTS: Cognitive processes underlying coarse print tuning, sublexical, and lexical fine tuning were examined in beginning readers. Three overlapping yet distinct neural sources-left ventral occipito-temporal (vOT), left temporo-parietal, and primary visual cortex-were revealed underlying coarse print tuning. Responses to sublexical orthographic fine tuning were found over left occipital regions, while responses to higher-level linguistic fine tuning were found over occipito-temporal/parietal regions. Exploratory group analyses suggested that coarse print tuning emerges in children with limited reading knowledge, while sublexical and higher-level linguistic fine tuning effects emerge in children with sufficient reading knowledge.

Developmental emergence of holistic processing in word recognition

Holistic processing (HP) of faces refers to the obligatory, simultaneous processing of the parts and their relations, and it emerges over the course of development. HP is manifest in a decrement in the perception of inverted versus upright faces and a reduction in face processing ability when the relations between parts are perturbed. Here, adopting the HP framework for faces, we examined the developmental emergence of HP in another domain for which human adults have expertise, namely, visual word processing. Children, adolescents, and adults performed a lexical decision task and we used two established signatures of HP for faces: the advantage in perception of upright over inverted words and nonwords and the reduced sensitivity to increasing parts (word length). Relative to the other groups, children showed less of an advantage for upright versus inverted trials and lexical decision was more affected by increasing word length. Performance on these HP indices was strongly associated with age and with reading proficiency. Also, the emergence of HP for word perception was not simply a result of improved visual perception over the course of development as no group differences were observed on an object decision task. These results reveal the developmental emergence of HP for orthographic input, and reflect a further instance of experience-dependent tuning of visual perception. These results also add to existing findings on the commonalities of mechanisms of word and face recognition. RESEARCH HIGHLIGHTS: Children showed less of an advantage for upright versus inverted trials compared to adolescents and adults. Relative to the other groups, lexical decision in children was more affected by increasing word length. Performance on holistic processing (HP) indices was strongly associated with age and with reading proficiency. HP emergence for word perception was not due to improved visual perception over development as there were no group differences on an object decision task.

Does the visual word form area split in bilingual readers? A millimeter-scale 7-T fMRI study

In expert readers, a brain region known as the visual word form area (VWFA) is highly sensitive to written words, exhibiting a posterior-to-anterior gradient of increasing sensitivity to orthographic stimuli whose statistics match those of real words. Using high-resolution 7-tesla functional magnetic resonance imaging (fMRI), we ask whether, in bilingual readers, distinct cortical patches specialize for different languages. In 21 English-French bilinguals, unsmoothed 1.2-millimeters fMRI revealed that the VWFA is actually composed of several small cortical patches highly selective for reading, with a posterior-to-anterior word-similarity gradient, but with near-complete overlap between the two languages. In 10 English-Chinese bilinguals, however, while most word-specific patches exhibited similar reading specificity and word-similarity gradients for reading in Chinese and English, additional patches responded specifically to Chinese writing and, unexpectedly, to faces. Our results show that the acquisition of multiple writing systems can indeed tune the visual cortex differently in bilinguals, sometimes leading to the emergence of cortical patches specialized for a single language.

Dyslexia: Causes and Concomitant Impairments

In recent decades, theories have been presented to explain the nature of dyslexia, but the causes of dyslexia remained unclear. Although the investigation of the causes of dyslexia presupposes a clear understanding of the concept of cause, such an understanding is missing. The present paper proposes the absence of at least one necessary condition or the absence of all sufficient conditions as causes for impaired reading. The causes of impaired reading include: an incorrect fixation location, too short a fixation time, the attempt to recognize too many letters simultaneously, too large saccade amplitudes, and too short verbal reaction times. It is assumed that a longer required fixation time in dyslexic readers results from a functional impairment of areas V1, V2, and V3 that require more time to complete temporal summation. These areas and areas that receive input from them, such as the fusiform gyrus, are assumed to be impaired in their ability to simultaneously process a string of letters. When these impairments are compensated by a new reading strategy, reading ability improves immediately.

Sensory modality and spoken language shape reading network in blind readers of Braille

The neural basis of reading is highly consistent across many languages and scripts. Are there alternative neural routes to reading? How does the sensory modality of symbols (tactile vs. visual) influence their neural representations? We examined these questions by comparing reading of visual print (sighted group, n = 19) and tactile Braille (congenitally blind group, n = 19). Blind and sighted readers were presented with written (words, consonant strings, non-letter shapes) and spoken stimuli (words, backward speech) that varied in word-likeness. Consistent with prior work, the ventral occipitotemporal cortex (vOTC) was active during Braille and visual reading. A posterior/anterior vOTC word-form gradient was observed only in sighted readers with more anterior regions preferring larger orthographic units (words). No such gradient was observed in blind readers. Consistent with connectivity predictions, in blind compared to sighted readers, posterior parietal cortices were recruited to a greater degree and contained word-preferring patches. Lateralization of Braille in blind readers was predicted by laterality of spoken language and reading hand. The effect of spoken language increased along a cortical hierarchy, whereas effect of reading hand waned. These results suggested that the neural basis of reading is influenced by symbol modality and spoken language and support connectivity-based views of cortical function.

Intact reading ability despite lacking a canonical visual word form area in an individual born without the left superior temporal lobe

The visual word form area (VWFA), a region canonically located within left ventral temporal cortex (VTC), is specialized for orthography in literate adults presumbly due to its connectivity with frontotemporal language regions. But is a typical, left-lateralized language network critical for the VWFA's emergence? We investigated this question in an individual (EG) born without the left superior temporal lobe but who has normal reading ability. EG showed canonical typical face-selectivity bilateraly but no wordselectivity either in right VWFA or in the spared left VWFA. Moreover, in contrast with the idea that the VWFA is simply part of the language network, no part of EG's VTC showed selectivity to higher-level linguistic processing. Interestingly, EG's VWFA showed reliable multivariate patterns that distinguished words from other categories. These results suggest that a typical left-hemisphere language network is necessary for acanonical VWFA, and that orthographic processing can otherwise be supported by a distributed neural code.

Color-biased regions in the ventral visual pathway are food selective

Color-biased regions have been found between face- and place-selective areas in the ventral visual pathway. To investigate the function of the color-biased regions in a pathway responsible for object recognition, we analyzed the natural scenes dataset (NSD), a large 7T fMRI dataset from 8 participants who each viewed up to 30,000 trials of images of colored natural scenes over more than 30 scanning sessions. In a whole-brain analysis, we correlated the average color saturation of the images with voxel responses, revealing color-biased regions that diverge into two streams, beginning in V4 and extending medially and laterally relative to the fusiform face area in both hemispheres. We drew regions of interest (ROIs) for the two streams and found that the images for each ROI that evoked the largest responses had certain characteristics: they contained food, circular objects, warmer hues, and had higher color saturation. Further analyses showed that food images were the strongest predictor of activity in these regions, implying the existence of medial and lateral ventral food streams (VFSs). We found that color also contributed independently to voxel responses, suggesting that the medial and lateral VFSs use both color and form to represent food. Our findings illustrate how high-resolution datasets such as the NSD can be used to disentangle the multifaceted contributions of many visual features to the neural representations of natural scenes.

Longitudinal changes in brain activation underlying reading fluency

Reading fluency-the speed and accuracy of reading connected text-is foundational to educational success. The current longitudinal study investigates the neural correlates of fluency development using a connected-text paradigm with an individualized presentation rate. Twenty-six children completed a functional MRI task in 1st/2nd grade (time 1) and again 1-2 years later (time 2). There was a longitudinal increase in activation in the ventral occipito-temporal (vOT) cortex from time 1 to time 2. This increase was also associated with improvements in reading fluency skills and modulated by individual speed demands. These findings highlight the reciprocal relationship of the vOT region with reading proficiency and its importance for supporting the developmental transition to fluent reading. These results have implications for developing effective interventions to target increased automaticity in reading.

General object-based features account for letter perception

After years of experience, humans become experts at perceiving letters. Is this visual capacity attained by learning specialized letter features, or by reusing general visual features previously learned in service of object categorization? To explore this question, we first measured the perceptual similarity of letters in two behavioral tasks, visual search and letter categorization. Then, we trained deep convolutional neural networks on either 26-way letter categorization or 1000-way object categorization, as a way to operationalize possible specialized letter features and general object-based features, respectively. We found that the general object-based features more robustly correlated with the perceptual similarity of letters. We then operationalized additional forms of experience-dependent letter specialization by altering object-trained networks with varied forms of letter training; however, none of these forms of letter specialization improved the match to human behavior. Thus, our findings reveal that it is not necessary to appeal to specialized letter representations to account for perceptual similarity of letters. Instead, we argue that it is more likely that the perception of letters depends on domain-general visual features.

For over a century, scientists have conducted behavioral experiments to investigate how the visual system recognizes letters, but it has proven difficult to propose a model of the feature space underlying this capacity. Here we leveraged recent advances in machine learning to model a wide variety of features ranging from specialized letter features to general object-based features. Across two large-scale behavioral experiments we find that general object-based features account well for letter perception, and that adding letter specialization did not improve the correspondence to human behavior. It is plausible that the ability to recognize letters largely relies on general visual features unaltered by letter learning.

The examination of the visual-perceptual locus in hemispheric laterality of the word length effect using Korean visual word

Greater word length effects have been reported when a word was presented in the left visual field (LVF) than when presented in the right visual field (RVF). The current study employed 2 experiments to examine the visual-perceptual loci of asymmetric word length effect while testing the physical and linguistic length effects and the effect of visual angle increase at the RVF. Experiment 1 showed significant effects on the number of strokes in both VHFs (visual half fields) with the added significance of the number of syllables in the LVF, suggesting both parafoveal fields were affected by the physical length factors in contrast with the linguistic length factors, inducing asymmetric word length effects in the symmetrically presented word recognition in parafoveal vision. Experiment 2 widened the visual angle of the RVF presentation to test the differential effects of the visual-perceptual difficulty across the VHFs. It showed successful interruption at the RVF word recognition and comparable word length effects between the LVF and RVF. Therefore, this study suggests that the asymmetric word length effects in the parafoveal word recognition are attributable to the greater visual-perceptual difficulty at the LVF than at the RVF.

Probabilistic atlas for the language network based on precision fMRI data from >800 individuals

Two analytic traditions characterize fMRI language research. One relies on averaging activations across individuals. This approach has limitations: because of inter-individual variability in the locations of language areas, any given voxel/vertex in a common brain space is part of the language network in some individuals but in others, may belong to a distinct network. An alternative approach relies on identifying language areas in each individual using a functional ‘localizer’. Because of its greater sensitivity, functional resolution, and interpretability, functional localization is gaining popularity, but it is not always feasible, and cannot be applied retroactively to past studies. To bridge these disjoint approaches, we created a probabilistic functional atlas using fMRI data for an extensively validated language localizer in 806 individuals. This atlas enables estimating the probability that any given location in a common space belongs to the language network, and thus can help interpret group-level activation peaks and lesion locations, or select voxels/electrodes for analysis. More meaningful comparisons of findings across studies should increase robustness and replicability in language research.

Measurement(s)	Brain activity measurement
Technology Type(s)	fMRI
Sample Characteristic - Organism	Homo sapiens

Evolution of reading and face circuits during the first three years of reading acquisition

Although words and faces activate neighboring regions in the fusiform gyrus, we lack an understanding of how such category selectivity emerges during development. To investigate the organization of reading and face circuits at the earliest stage of reading acquisition, we measured the fMRI responses to words, faces, houses, and checkerboards in three groups of 60 French children: 6-year-old pre-readers, 6-year-old beginning readers and 9-year-old advanced readers. The results showed that specific responses to written words were absent prior to reading, but emerged in beginning readers, irrespective of age. Likewise, specific responses to faces were barely visible in pre-readers and continued to evolve in the 9-year-olds, yet primarily driven by age rather than by schooling. Crucially, the sectors of ventral visual cortex that become specialized for words and faces harbored their own functional connectivity prior to reading acquisition: the VWFA with left-hemispheric spoken language areas, and the FFA with the contralateral region and the amygdalae. The results support the view that reading acquisition occurs through the recycling of a pre-existing but plastic circuit which, in pre-readers, already connects the VWFA site to other distant language areas. We argue that reading acquisition does not compete with the face system directly, through a pruning of preexisting face responses, but indirectly, by hindering the slow growth of face responses in the left hemisphere, thus increasing a pre-existing right hemispheric bias.

Searching beyond the looking glass with sandwich priming

Duñabeitia et al. (NeuroImage 54(4), 3004-3009, 2011) demonstrated that mirror letters induce the same electrophysiological response as canonical letters during the orthographic stage of visual word recognition. However, behavioral evidence in support of such an effect has remained scarce. We hypothesize that the poor reliability of the behavioral data could be due to the lack of sensitivity of the paradigms used in the literature. In Experiment 1 and Experiment 2, we compared conventional and sandwich-masked priming paradigms. Results showed that mirror primes (mirror) produced a significant priming effect on high-frequency words in the case of sandwich priming only. In Experiment 3, we used sandwich priming with a new material set to address a number of concerns regarding prime-target visual overlap. We obtained a graded facilitatory mirror-letter priming effect that acted additively with lexical frequency, thus supporting the idea that it originates in the fast automatic orthographic stage. Given that the graded priming effect provides little support for the idea of the complete preservation of mirror invariance for non-reversal letters, complementary explanations are explored.

Task modulates the orthographic and phonological representations in the bilateral ventral Occipitotemporal cortex

As a key area in word reading, the left ventral occipitotemporal cortex is proposed for abstract orthographic processing, and its middle part has even been labeled as the visual word form area. Because the definition of the VWFA largely varies and the reading task differs across studies, the function of the left ventral occipitotemporal cortex in word reading is continuingly debated on whether this region is specific for orthographic processing or be involved in an interactive framework. By using representational similarity analysis (RSA), this study examined information representation in the VWFA at the individual level and the modulatory effect of reading task. Twenty-four subjects were scanned while performing the explicit (i.e., the naming task) and implicit (i.e., the perceptual task) reading tasks. Activation analysis showed that the naming task elicited greater activation in regions related to phonological processing (e.g., the bilateral prefrontal cortex and temporoparietal cortex), while the perceptual task recruited greater activation in visual cortex and default mode network (e.g., the bilateral middle frontal gyrus, angular gyrus, and the right middle temporal gyrus). More importantly, RSA also showed that task modulated information representation in the bilateral anterior occipitotemporal cortex and VWFA. Specifically, ROI-based RSA revealed enhanced orthographic and phonological representations in the bilateral anterior fusiform cortex and VWFA in the naming task relative to the perceptual task. These results suggest that lexical representation in the VWFA is influenced by the demand of phonological processing, which supports the interactive account of the VWFA.

Unique, Shared, and Dominant Brain Activation in Visual Word Form Area and Lateral Occipital Complex during Reading and Picture Naming

Identifying printed words and pictures concurrently is ubiquitous in daily tasks, and so it is important to consider the extent to which reading words and naming pictures may share a cognitive-neurophysiological functional architecture. Two functional magnetic resonance imaging (fMRI) experiments examined whether reading along the left ventral occipitotemporal region (vOT; often referred to as a visual word form area, VWFA) has activation that is overlapping with referent pictures (i.e., both conditions significant and shared, or with one significantly more dominant) or unique (i.e., one condition significant, the other not), and whether picture naming along the right lateral occipital complex (LOC) has overlapping or unique activation relative to referent words. Experiment 1 used familiar regular and exception words (to force lexical reading) and their corresponding pictures in separate naming blocks, and showed dominant activation for pictures in the LOC, and shared activation in the VWFA for exception words and their corresponding pictures (regular words did not elicit significant VWFA activation). Experiment 2 controlled for visual complexity by superimposing the words and pictures and instructing participants to either name the word or the picture, and showed primarily shared activation in the VWFA and LOC regions for both word reading and picture naming, with some dominant activation for pictures in the LOC. Overall, these results highlight the importance of including exception words to force lexical reading when comparing to picture naming, and the significant shared activation in VWFA and LOC serves to challenge specialized models of reading or picture naming.

The effects of stimulus inversion on the neural representations of Chinese character and face recognition

This study investigates whether stimulus inversion influences neural responses of Chinese character recognition similarly to its effect on face recognition in category-selective and object-related brain areas using functional magnetic resonance imaging. Participants performed a one-back matching task for simple (one radical) and compound (two radicals) Chinese characters and faces with upright and inverted orientations. Inverted stimuli produced slower response times with stronger activity within the fusiform gyrus (FG) than upright stimuli for faces and Chinese characters. While common inversion-related activation was identified in the left FG among stimulus types, we observed a significant inter-regional correlation between the left FG and the intraparietal sulcus for face inversion. Importantly, analyses of region-of-interest (ROI) multivariate pattern classification showed that classifiers trained on face inversion can decode the representations of character inversion in the character-selective ROI. However, this was not true for face inversion in face-selective ROIs when the classifiers were trained on characters. Similar activity patterns for character and face inversion were observed in the object-related ROIs. We also showed higher decoding accuracy for upright stimuli in the face-selective ROI than in the character-selective ROI but this was not true for inverted ones or when patterns were examined in the object-related ROIs. Together, our results support shared and distinct configural representations for character and face recognition in category-selective and object-related brain areas.

Acquired dyslexias following temporal lesions

The acquisition of reading by children is supported by deep changes in the brain systems devoted to vision and language. The left temporal lobe contributes critically to both systems, and lesions affecting it may therefore cause both peripheral vision-related and central language-related reading impairments. The diversity of peripheral dyslexias reflects the anatomical and functional division of the visual cortex into early visual regions, whose lesions have a limited impact on reading; ventral regions, whose lesions are mostly associated to Pure Alexia; and dorsal regions, whose lesions may yield spatial, neglect-related, and attentional dyslexias. Similarly, central alexias reflect the broad distinction, within language processes, between phonological and lexico-semantic components. Phonological and surface dyslexias roughly result from impairment of the former and the latter processes, respectively, while deep dyslexia may be seen as the association of both. In this chapter, we review such types of acquired dyslexias, their clinical features, pathophysiology, and anatomical correlates.

NeuroGen: Activation optimized image synthesis for discovery neuroscience

Functional MRI (fMRI) is a powerful technique that has allowed us to characterize visual cortex responses to stimuli, yet such experiments are by nature constructed based on a priori hypotheses, limited to the set of images presented to the individual while they are in the scanner, are subject to noise in the observed brain responses, and may vary widely across individuals. In this work, we propose a novel computational strategy, which we call NeuroGen, to overcome these limitations and develop a powerful tool for human vision neuroscience discovery. NeuroGen combines an fMRI-trained neural encoding model of human vision with a deep generative network to synthesize images predicted to achieve a target pattern of macro-scale brain activation. We demonstrate that the reduction of noise that the encoding model provides, coupled with the generative network’s ability to produce images of high fidelity, results in a robust discovery architecture for visual neuroscience. By using only a small number of synthetic images created by NeuroGen, we demonstrate that we can detect and amplify differences in regional and individual human brain response patterns to visual stimuli. We then verify that these discoveries are reflected in the several thousand observed image responses measured with fMRI. We further demonstrate that NeuroGen can create synthetic images predicted to achieve regional response patterns not achievable by the best-matching natural images. The NeuroGen framework extends the utility of brain encoding models and opens up a new avenue for exploring, and possibly precisely controlling, the human visual system.

Dissociated face- and word-selective intracerebral responses in the human ventral occipito-temporal cortex

The extent to which faces and written words share neural circuitry in the human brain is actively debated. Here, we compare face-selective and word-selective responses in a large group of patients (N = 37) implanted with intracerebral electrodes in the ventral occipito-temporal cortex (VOTC). Both face-selective (i.e., significantly different responses to faces vs. non-face visual objects) and word-selective (i.e., significantly different responses to words vs. pseudofonts) neural activity is isolated with frequency-tagging. Critically, this sensitive approach allows to objectively quantify category-selective neural responses and disentangle them from general visual responses. About 70% of significant electrode contacts show either face-selectivity or word-selectivity only, with the expected right and left hemispheric dominance, respectively. Spatial dissociations are also found within core regions of face and word processing, with a medio-lateral dissociation in the fusiform gyrus (FG) and surrounding sulci, respectively. In the 30% of overlapping face- and word-selective contacts across the VOTC or in the FG and surrounding sulci, between-category-selective amplitudes (faces vs. words) show no-to-weak correlations, despite strong correlations in both the within-category-selective amplitudes (face-face, word-word) and the general visual responses to words and faces. Overall, these observations support the view that category-selective circuitry for faces and written words is largely dissociated in the human adult VOTC.

Anatomy and physiology of word-selective visual cortex: from visual features to lexical processing

Over the past 2 decades, researchers have tried to uncover how the human brain can extract linguistic information from a sequence of visual symbols. The description of how the brain's visual system processes words and enables reading has improved with the progressive refinement of experimental methodologies and neuroimaging techniques. This review provides a brief overview of this research journey. We start by describing classical models of object recognition in non-human primates, which represent the foundation for many of the early models of visual word recognition in humans. We then review functional neuroimaging studies investigating the word-selective regions in visual cortex. This research led to the differentiation of highly specialized areas, which are involved in the analysis of different aspects of written language. We then consider the corresponding anatomical measurements and provide a description of the main white matter pathways carrying neural signals crucial to word recognition. Finally, in an attempt to integrate structural, functional, and electrophysiological findings, we propose a view of visual word recognition, accounting for spatial and temporal facets of word-selective neural processes. This multi-modal perspective on the neural circuitry of literacy highlights the relevance of a posterior-anterior differentiation in ventral occipitotemporal cortex for visual processing of written language and lexical features. It also highlights unanswered questions that can guide us towards future research directions. Bridging measures of brain structure and function will help us reach a more precise understanding of the transformation from vision to language.

Emergence of a compositional neural code for written words: Recycling of a convolutional neural network for reading

The visual word form area (VWFA) is a region of human inferotemporal cortex that emerges at a fixed location in the occipitotemporal cortex during reading acquisition and systematically responds to written words in literate individuals. According to the neuronal recycling hypothesis, this region arises through the repurposing, for letter recognition, of a subpart of the ventral visual pathway initially involved in face and object recognition. Furthermore, according to the biased connectivity hypothesis, its reproducible localization is due to preexisting connections from this subregion to areas involved in spoken-language processing. Here, we evaluate those hypotheses in an explicit computational model. We trained a deep convolutional neural network of the ventral visual pathway, first to categorize pictures and then to recognize written words invariantly for case, font, and size. We show that the model can account for many properties of the VWFA, particularly when a subset of units possesses a biased connectivity to word output units. The network develops a sparse, invariant representation of written words, based on a restricted set of reading-selective units. Their activation mimics several properties of the VWFA, and their lesioning causes a reading-specific deficit. The model predicts that, in literate brains, written words are encoded by a compositional neural code with neurons tuned either to individual letters and their ordinal position relative to word start or word ending or to pairs of letters (bigrams).

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Distinct neural sources underlying visual word form processing as revealed by steady state visual evoked potentials (SSVEP)

EEG has been central to investigations of the time course of various neural functions underpinning visual word recognition. Recently the steady-state visual evoked potential (SSVEP) paradigm has been increasingly adopted for word recognition studies due to its high signal-to-noise ratio. Such studies, however, have been typically framed around a single source in the left ventral occipitotemporal cortex (vOT). Here, we combine SSVEP recorded from 16 adult native English speakers with a data-driven spatial filtering approach—Reliable Components Analysis (RCA)—to elucidate distinct functional sources with overlapping yet separable time courses and topographies that emerge when contrasting words with pseudofont visual controls. The first component topography was maximal over left vOT regions with a shorter latency (approximately 180 ms). A second component was maximal over more dorsal parietal regions with a longer latency (approximately 260 ms). Both components consistently emerged across a range of parameter manipulations including changes in the spatial overlap between successive stimuli, and changes in both base and deviation frequency. We then contrasted word-in-nonword and word-in-pseudoword to test the hierarchical processing mechanisms underlying visual word recognition. Results suggest that these hierarchical contrasts fail to evoke a unitary component that might be reasonably associated with lexical access.

Music-selective neural populations arise without musical training

Recent work has shown that human auditory cortex contains neural populations anterior and posterior to primary auditory cortex that respond selectively to music. However, it is unknown how this selectivity for music arises. To test whether musical training is necessary, we measured fMRI responses to 192 natural sounds in 10 people with almost no musical training. When voxel responses were decomposed into underlying components, this group exhibited a music-selective component that was very similar in response profile and anatomical distribution to that previously seen in individuals with moderate musical training. We also found that musical genres that were less familiar to our participants (e.g., Balinese gamelan) produced strong responses within the music component, as did drum clips with rhythm but little melody, suggesting that these neural populations are broadly responsive to music as a whole. Our findings demonstrate that the signature properties of neural music selectivity do not require musical training to develop, showing that the music-selective neural populations are a fundamental and widespread property of the human brain.NEW & NOTEWORTHY We show that music-selective neural populations are clearly present in people without musical training, demonstrating that they are a fundamental and widespread property of the human brain. Additionally, we show music-selective neural populations respond strongly to music from unfamiliar genres as well as music with rhythm but little pitch information, suggesting that they are broadly responsive to music as a whole.

The rise and fall of rapid occipito-temporal sensitivity to letters: Transient specialization through elementary school

Letters, foundational units of alphabetic writing systems, are quintessential to human culture. The ability to read, indispensable to perform in today’s society, necessitates a reorganization of visual cortex for fast letter recognition, but the developmental course of this process has not yet been characterized. Here, we show the emergence of visual sensitivity to letters across five electroencephalography measurements from kindergarten and throughout elementary school and relate this development to emerging reading skills. We examined the visual N1, the electrophysiological correlate of ventral occipito-temporal cortex activation in 65 children at varying familial risk for dyslexia. N1 letter sensitivity emerged in first grade, when letter sound knowledge gains were most pronounced and decayed shortly after when letter knowledge is consolidated, showing an inverted U-shaped development. This trajectory can be interpreted within an interactive framework that underscores the influence of top-down predictions. While the N1 amplitudes to letters correlated with letter sound knowledge at the beginning of learning, no association between the early N1 letter response and later reading skills was found. In summary, the current findings provide an important reference point for our neuroscientific understanding of learning trajectories and the process of visual specialization during skill learning.

Expert Tool Users Show Increased Differentiation between Visual Representations of Hands and Tools

The idea that when we use a tool we incorporate it into the neural representation of our body (embodiment) has been a major inspiration for philosophy, science, and engineering. While theoretically appealing, there is little direct evidence for tool embodiment at the neural level. Using functional magnetic resonance imaging (fMRI) in male and female human subjects, we investigated whether expert tool users (London litter pickers: n = 7) represent their expert tool more like a hand (neural embodiment) or less like a hand (neural differentiation), as compared with a group of tool novices (n = 12). During fMRI scans, participants viewed first-person videos depicting grasps performed by either a hand, litter picker, or a non-expert grasping tool. Using representational similarity analysis (RSA), differences in the representational structure of hands and tools were measured within occipitotemporal cortex (OTC). Contrary to the neural embodiment theory, we find that the experts group represent their own tool less like a hand (not more) relative to novices. Using a case-study approach, we further replicated this effect, independently, in five of the seven individual expert litter pickers, as compared with the novices. An exploratory analysis in left parietal cortex, a region implicated in visuomotor representations of hands and tools, also indicated that experts do not visually represent their tool more similar to hands, compared with novices. Together, our findings suggest that extensive tool use leads to an increased neural differentiation between visual representations of hands and tools. This evidence provides an important alternative framework to the prominent tool embodiment theory.SIGNIFICANCE STATEMENT It is commonly thought that tool use leads to the assimilation of the tool into the neural representation of the body, a process referred to as embodiment. Here, we demonstrate that expert tool users (London litter pickers) neurally represent their own tool less like a hand (not more), compared with novices. Our findings advance our current understanding for how experience shapes functional organization in high-order visual cortex. Further, this evidence provides an alternative framework to the prominent tool embodiment theory, suggesting instead that experience with tools leads to more distinct, separable hand and tool representations.

How does inattention affect written and spoken language processing?

The classic cocktail party effect suggests that some, but probably not all levels of language processing can proceed without attention. We used whole-brain functional MRI to investigate how modality-specific and modality-independent language areas are modulated by the withdrawal of attention to another sensory modality (e.g., attending to vision during the presentation of auditory sentences, or vice-versa). We tested the hypotheses that inattention may abolish sentence-level integration and eliminate top-down effects. In both written and spoken modalities, language processing was strongly modulated by the distraction of attention, but this inattention effect varied considerably depending on the area and hierarchical level of language processing. Under inattention, a bottom-up activation remained in early modality-specific areas, particularly in superior temporal spoken-language areas, but the difference between sentences and words lists vanished. Under both attended and unattended conditions, ventral temporal cortices were activated in a top-down manner by spoken language more than by control stimuli, reaching posteriorily the Visual Word Form Area. We conclude that inattention prevents sentence-level syntactic and semantic integration, but preserves some top-down crossmodal processing, plus a large degree of bottom-up modality-specific processing, including a ventral occipito-temporal specialization for letter strings in a known alphabet.

Visual association learning induces global network reorganization

It has been proposed that visual learning is accomplished not only by neural plasticity in the visual cortex, but also by complex interactions between bottom-up and top-down processes that may induce global network reorganization. Here, we applied a multivariate analysis to functional connectivity (FC) patterns across the brain to investigate how visual association learning was achieved through large-scale network reorganization. Participants were trained to associate a set of artificial line-drawing objects with English letters. After three consecutive days of training, participants underwent a functional magnetic resonance imaging scan in which they were presented with the trained stimuli, untrained stimuli, and English words. By calculating pairwise FC between 189 nodes of 10 well-established networks across the brain, we found that the visual association learning induced changes in the global FC pattern when viewing the trained stimuli, rendering it more similar to the FC pattern when viewing English words. Critically, the learning-induced global FC pattern differences were mainly driven by the FC related to the high-level networks involved in attention and cognitive control, suggesting the modification of top-down processes during learning. In sum, our study provides one of the first evidence revealing global network reorganization induced by visual learning and sheds new light on the network mechanisms of top-down influences in learning.

The neurocognitive basis of skilled reading in prelingually and profoundly deaf adults

Deaf individuals have unique sensory and linguistic experiences that influence how they read and become skilled readers. This review presents our current understanding of the neurocognitive underpinnings of reading skill in deaf adults. Key behavioural and neuroimaging studies are integrated to build a profile of skilled adult deaf readers and to examine how changes in visual attention and reduced access to auditory input and phonology shape how they read both words and sentences. Crucially, the behaviours, processes, and neural circuity of deaf readers are compared to those of hearing readers with similar reading ability to help identify alternative pathways to reading success. Overall, sensitivity to orthographic and semantic information is comparable for skilled deaf and hearing readers, but deaf readers rely less on phonology and show greater engagement of the right hemisphere in visual word processing. During sentence reading, deaf readers process visual word forms more efficiently and may have a greater reliance on and altered connectivity to semantic information compared to their hearing peers. These findings highlight the plasticity of the reading system and point to alternative pathways to reading success.

The contributions of the left fusiform subregions to successful encoding of novel words

The left fusiform cortex has been identified as a crucial structure in visual word learning and memory. Nevertheless, the specific roles of the fusiform subregions in word memory and their consistency across different writings have not been elaborated. To address these questions, the present study performed two experiments, in which study-test paradigm was used. Participants' brain activity was measured with fMRI while memorizing novel logographic words in Experiment 1 and novel alphabetic words in Experiment 2. A post-scan recognition memory test was then administered to acquire the memory performance. Results showed that, neural responses in the left anterior and middle fusiform subregions during encoding were positively correlated with recognition memory of novel words. Moreover, the positive brain-behavior correlations in the left anterior and middle fusiform cortex were evident for both logographic and alphabetic writings. The present findings clarify the relationship between the left fusiform subregions and novel word memory.

Neural Representation in Visual Word Form Area during Word Reading

The visual word form area (VWFA) has been consistently identified as a crucial structure in visual word processing. Nevertheless, it is controversial whether the VWFA represents external visual information (e.g., case information) of visual words. To address that question, we functionally localized VWFA at the group level (gVWFA) and at the individual level (iVWFA), and used multivariate pattern analysis (MVPA) to explore the information representation in the VWFA during an implicit reading task (i.e., a passive viewing task). Univariate activation analysis revealed that participants showed stronger activations for uppercase English words compared to lowercase ones in the VWFA. MVPA further revealed that the classifier trained based on lowercase words versus letter strings significantly distinguished uppercase words versus letter strings in the iVWFA, while that trained based on lowercase words versus uppercase words distinguished lowercase letter strings versus uppercase letter strings neither in the gVWFA nor in the iVWFA. These results suggest that the VWFA does not represent case information, but represents case-independent linguistic information. Our findings elaborate the function in the VWFA and support the VWFA hypothesis.

Serial and syntactic processing in the visual analysis of multi-digit numbers

The visual analysis of letter strings and digit strings is done by two separate cognitive processes. Recent studies have hypothesized that these processes are not only separate but also qualitatively different, in that they may encode information specific to numbers or to words. To examine this hypothesis and to shed further light on the visual analysis of numbers, we asked adults to read aloud multi-digit strings presented to them for brief durations. Their performance was better in digits on the number's left side than in digits farther to the right, with better performance in the two outer digits than their neighbors. This indicates the digits were processed serially, from left to right. Visual similarity of digits increased the likelihood of errors, and when a digit migrated to an incorrect position, it was most often to an adjacent location. Interestingly, the positions of 0 and 1 were encoded better than the positions of 2-9, and 2-9 were identified better when they were next to 0 or 1. To accommodate these findings, we propose a detailed model for the visual analysis of digit strings. The model assumes imperfect digit detectors in which a digit's visual information leaks to adjacent locations, and a compensation mechanism that inhibits this leakage. Crucially, the compensating inhibition is stronger for 0 and 1 than for the digits 2-9, presumably because of the importance of 0 and 1 in the number system. This sensitivity to 0 and 1 makes the visual analyzer specifically adapted to numbers, not words, and may be one of the brain's reasons to implement the visual analysis of numbers and words in two separate cognitive processes.

Visual word form processing deficits driven by severity of reading impairments in children with developmental dyslexia

The visual word form area (VWFA) in the left ventral occipito-temporal (vOT) cortex is key to fluent reading in children and adults. Diminished VWFA activation during print processing tasks is a common finding in subjects with severe reading problems. Here, we report fMRI data from a multicentre study with 140 children in primary school (7.9-12.2 years; 55 children with dyslexia, 73 typical readers, 12 intermediate readers). All performed a semantic task on visually presented words and a matched control task on symbol strings. With this large group of children, including the entire spectrum from severely impaired to highly fluent readers, we aimed to clarify the association of reading fluency and left vOT activation during visual word processing. The results of this study confirm reduced word-sensitive activation within the left vOT in children with dyslexia. Interestingly, the association of reading skills and left vOT activation was especially strong and spatially extended in children with dyslexia. Thus, deficits in basic visual word form processing increase with the severity of reading disability but seem only weakly associated with fluency within the typical reading range suggesting a linear dependence of reading scores with VFWA activation only in the poorest readers.

A universal reading network and its modulation by writing system and reading ability in French and Chinese children

Are the brain mechanisms of reading acquisition similar across writing systems? And do similar brain anomalies underlie reading difficulties in alphabetic and ideographic reading systems? In a cross-cultural paradigm, we measured the fMRI responses to words, faces, and houses in 96 Chinese and French 10-year-old children, half of whom were struggling with reading. We observed a reading circuit which was strikingly similar across languages and consisting of the left fusiform gyrus, superior temporal gyrus/sulcus, precentral and middle frontal gyri. Activations in some of these areas were modulated either by language or by reading ability, but without interaction between those factors. In various regions previously associated with dyslexia, reading difficulty affected activation similarly in Chinese and French readers, including the middle frontal gyrus, a region previously described as specifically altered in Chinese. Our analyses reveal a large degree of cross-cultural invariance in the neural correlates of reading acquisition and reading impairment.

Innate connectivity patterns drive the development of the visual word form area

What determines the functional organization of cortex? One hypothesis is that innate connectivity patterns, either structural or functional connectivity, set up a scaffold upon which functional specialization can later take place. We tested this hypothesis by asking whether the visual word form area (VWFA), an experience-driven region, was already functionally connected to proto language networks in neonates scanned within one week of birth. Using the data from the Human Connectone Project (HCP) and the Developing Human Connectome Project (dHCP), we calculated intrinsic functional connectivity during resting-state functional magnetic resonance imaging (fMRI), and found that neonates showed similar functional connectivity patterns to adults. We observed that (1) language regions connected more strongly with the putative VWFA than other adjacent ventral visual regions that also show foveal bias, and (2) the VWFA connected more strongly with frontotemporal language regions than with regions adjacent to these language regions. These data suggest that the location of the VWFA is earmarked at birth due to its connectivity with the language network, providing evidence that innate connectivity instructs the later refinement of cortex.

Adults vs. neonates: Differentiation of functional connectivity between the basolateral amygdala and occipitotemporal cortex

The amygdala, a subcortical structure known for social and emotional processing, consists of multiple subnuclei with unique functions and connectivity patterns. Tracer studies in adult macaques have shown that the basolateral subnuclei differentially connect to parts of visual cortex, with stronger connections to anterior regions and weaker connections to posterior regions; infant macaques show robust connectivity even with posterior visual regions. Do these developmental differences also exist in the human amygdala, and are there specific functional regions that undergo the most pronounced developmental changes in their connections with the amygdala? To address these questions, we explored the functional connectivity (from resting-state fMRI data) of the basolateral amygdala to occipitotemporal cortex in human neonates scanned within one week of life and compared the connectivity patterns to those observed in young adults. Specifically, we calculated amygdala connectivity to anterior-posterior gradients of the anatomically-defined occipitotemporal cortex, and also to putative occipitotemporal functional parcels, including primary and high-level visual and auditory cortices (V1, A1, face, scene, object, body, high-level auditory regions). Results showed a decreasing gradient of functional connectivity to the occipitotemporal cortex in adults-similar to the gradient seen in macaque tracer studies-but no such gradient was observed in neonates. Further, adults had stronger connections to high-level functional regions associated with face, body, and object processing, and weaker connections to primary sensory regions (i.e., A1, V1), whereas neonates showed the same amount of connectivity to primary and high-level sensory regions. Overall, these results show that functional connectivity between the amygdala and occipitotemporal cortex is not yet differentiated in neonates, suggesting a role of maturation and experience in shaping these connections later in life.

Lack of selectivity for syntax relative to word meanings throughout the language network

To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.

Lack of selectivity for syntax relative to word meanings throughout the language network

To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.

Combined Neural Tuning in Human Ventral Temporal Cortex Resolves the Perceptual Ambiguity of Morphed 2D Images

We have an amazing ability to categorize objects in the world around us. Nevertheless, how cortical regions in human ventral temporal cortex (VTC), which is critical for categorization, support this behavioral ability, is largely unknown. Here, we examined the relationship between neural responses and behavioral performance during the categorization of morphed silhouettes of faces and hands, which are animate categories processed in cortically adjacent regions in VTC. Our results reveal that the combination of neural responses from VTC face- and body-selective regions more accurately explains behavioral categorization than neural responses from either region alone. Furthermore, we built a model that predicts a person's behavioral performance using estimated parameters of brain-behavior relationships from a different group of people. Moreover, we show that this brain-behavior model generalizes to adjacent face- and body-selective regions in lateral occipitotemporal cortex. Thus, while face- and body-selective regions are located within functionally distinct domain-specific networks, cortically adjacent regions from both networks likely integrate neural responses to resolve competing and perceptually ambiguous information from both categories.

Early dissociation of numbers and letters in the human brain

Numbers and letters are culturally created symbols which are learned through repeated training. This experience leads to a functional specialization of the perceptual system of our brain. Recent evidence suggests a neural dissociation between these two symbols. While previous literature has shown that letters elicit a left lateralized neural response, new studies suggest that numbers elicit preferentially a bilateral or right lateralized response. However, the time course of the neural patterns that characterize this dissociation is still underspecified. In the present study, we investigated with magnetoencephalography (MEG) the spatio-temporal dynamics of the neural response generated by numbers, letters and perceptually matched false fonts presented visually. Twenty-five healthy adults were recorded while participants performed a dot detection task. By including two experiments, we were able to study the effects of single characters as well as those of strings of characters. The signal analysis was focused on the event related fields (ERF) of the MEG signal in the sensors and in the source space. The main results of our study showed an early (<200 msec) preferential dissociation between single numbers and single letters on occipito-temporal sensors. When comparing strings of numbers and pseudowords, they differed also over prefrontal regions of the brain. These data offer a new example of acquired category-specific responses in the human brain.