The neural substrates of visual perceptual learning of words: implications for the visual word form area hypothesis

Permutation-based true discovery proportions for functional magnetic resonance imaging cluster analysis

We propose a permutation-based method for testing a large collection of hypotheses simultaneously. Our method provides lower bounds for the number of true discoveries in any selected subset of hypotheses. These bounds are simultaneously valid with high confidence. The methodology is particularly useful in functional Magnetic Resonance Imaging cluster analysis, where it provides a confidence statement on the percentage of truly activated voxels within clusters of voxels, avoiding the well-known spatial specificity paradox. We offer a user-friendly tool to estimate the percentage of true discoveries for each cluster while controlling the family-wise error rate for multiple testing and taking into account that the cluster was chosen in a data-driven way. The method adapts to the spatial correlation structure that characterizes functional Magnetic Resonance Imaging data, gaining power over parametric approaches.

The neural representations underlying asymmetric cross-modal prediction of words

Cross-modal prediction serves a crucial adaptive role in the multisensory world, yet the neural mechanisms underlying this prediction are poorly understood. The present study addressed this important question by combining a novel audiovisual sequence memory task, functional magnetic resonance imaging (fMRI), and multivariate neural representational analyses. Our behavioral results revealed a reliable asymmetric cross-modal predictive effect, with a stronger prediction from visual to auditory (VA) modality than auditory to visual (AV) modality. Mirroring the behavioral pattern, we found the superior parietal lobe (SPL) showed higher pattern similarity for VA than AV pairs, and the strength of the predictive coding in the SPL was positively correlated with the behavioral predictive effect in the VA condition. Representational connectivity analyses further revealed that the SPL mediated the neural pathway from the visual to the auditory cortex in the VA condition but was not involved in the auditory to visual cortex pathway in the AV condition. Direct neural pathways within the unimodal regions were found for the visual-to-visual and auditory-to-auditory predictions. Together, these results provide novel insights into the neural mechanisms underlying cross-modal sequence prediction.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Extracting representations of cognition across neuroimaging studies improves brain decoding

Cognitive brain imaging is accumulating datasets about the neural substrate of many different mental processes. Yet, most studies are based on few subjects and have low statistical power. Analyzing data across studies could bring more statistical power; yet the current brain-imaging analytic framework cannot be used at scale as it requires casting all cognitive tasks in a unified theoretical framework. We introduce a new methodology to analyze brain responses across tasks without a joint model of the psychological processes. The method boosts statistical power in small studies with specific cognitive focus by analyzing them jointly with large studies that probe less focal mental processes. Our approach improves decoding performance for 80% of 35 widely-different functional-imaging studies. It finds commonalities across tasks in a data-driven way, via common brain representations that predict mental processes. These are brain networks tuned to psychological manipulations. They outline interpretable and plausible brain structures. The extracted networks have been made available; they can be readily reused in new neuro-imaging studies. We provide a multi-study decoding tool to adapt to new data.

The contributions of the left fusiform subregions to successful encoding of novel words

The left fusiform cortex has been identified as a crucial structure in visual word learning and memory. Nevertheless, the specific roles of the fusiform subregions in word memory and their consistency across different writings have not been elaborated. To address these questions, the present study performed two experiments, in which study-test paradigm was used. Participants' brain activity was measured with fMRI while memorizing novel logographic words in Experiment 1 and novel alphabetic words in Experiment 2. A post-scan recognition memory test was then administered to acquire the memory performance. Results showed that, neural responses in the left anterior and middle fusiform subregions during encoding were positively correlated with recognition memory of novel words. Moreover, the positive brain-behavior correlations in the left anterior and middle fusiform cortex were evident for both logographic and alphabetic writings. The present findings clarify the relationship between the left fusiform subregions and novel word memory.

The Small and Efficient Language Network of Polyglots and Hyper-polyglots

Acquiring a foreign language is challenging for many adults. Yet certain individuals choose to acquire sometimes dozens of languages and often just for fun. Is there something special about the minds and brains of such polyglots? Using robust individual-level markers of language activity, measured with fMRI, we compared native language processing in polyglots versus matched controls. Polyglots (n = 17, including nine "hyper-polyglots" with proficiency in 10-55 languages) used fewer neural resources to process language: Their activations were smaller in both magnitude and extent. This difference was spatially and functionally selective: The groups were similar in their activation of two other brain networks-the multiple demand network and the default mode network. We hypothesize that the activation reduction in the language network is experientially driven, such that the acquisition and use of multiple languages makes language processing generally more efficient. However, genetic and longitudinal studies will be critical to distinguish this hypothesis from the one whereby polyglots' brains already differ at birth or early in development. This initial characterization of polyglots' language network opens the door to future investigations of the cognitive and neural architecture of individuals who gain mastery of multiple languages, including changes in this architecture with linguistic experiences.

Fine-grain atlases of functional modes for fMRI analysis

Population imaging markedly increased the size of functional-imaging datasets, shedding new light on the neural basis of inter-individual differences. Analyzing these large data entails new scalability challenges, computational and statistical. For this reason, brain images are typically summarized in a few signals, for instance reducing voxel-level measures with brain atlases or functional modes. A good choice of the corresponding brain networks is important, as most data analyses start from these reduced signals. We contribute finely-resolved atlases of functional modes, comprising from 64 to 1024 networks. These dictionaries of functional modes (DiFuMo) are trained on millions of fMRI functional brain volumes of total size 2.4 ​TB, spanned over 27 studies and many research groups. We demonstrate the benefits of extracting reduced signals on our fine-grain atlases for many classic functional data analysis pipelines: stimuli decoding from 12,334 brain responses, standard GLM analysis of fMRI across sessions and individuals, extraction of resting-state functional-connectomes biomarkers for 2500 individuals, data compression and meta-analysis over more than 15,000 statistical maps. In each of these analysis scenarii, we compare the performance of our functional atlases with that of other popular references, and to a simple voxel-level analysis. Results highlight the importance of using high-dimensional "soft" functional atlases, to represent and analyze brain activity while capturing its functional gradients. Analyses on high-dimensional modes achieve similar statistical performance as at the voxel level, but with much reduced computational cost and higher interpretability. In addition to making them available, we provide meaningful names for these modes, based on their anatomical location. It will facilitate reporting of results.

Analysis of task-based functional MRI data preprocessed with fMRIPrep

Functional magnetic resonance imaging (fMRI) is a standard tool to investigate the neural correlates of cognition. fMRI noninvasively measures brain activity, allowing identification of patterns evoked by tasks performed during scanning. Despite the long history of this technique, the idiosyncrasies of each dataset have led to the use of ad-hoc preprocessing protocols customized for nearly every different study. This approach is time consuming, error prone and unsuitable for combining datasets from many sources. Here we showcase fMRIPrep (http://fmriprep.org), a robust tool to prepare human fMRI data for statistical analysis. This software instrument addresses the reproducibility concerns of the established protocols for fMRI preprocessing. By leveraging the Brain Imaging Data Structure to standardize both the input datasets (MRI data as stored by the scanner) and the outputs (data ready for modeling and analysis), fMRIPrep is capable of preprocessing a diversity of datasets without manual intervention. In support of the growing popularity of fMRIPrep, this protocol describes how to integrate the tool in a task-based fMRI investigation workflow.

Visual Working Memory of Chinese Characters and Expertise: The Expert's Memory Advantage Is Based on Long-Term Knowledge of Visual Word Forms

People unfamiliar with Chinese characters show poorer visual working memory (VWM) performance for Chinese characters than do literates in Chinese. In a series of experiments, we investigated the reasons for this expertise advantage. Experiments 1 and 2 showed that the advantage of Chinese literates does not transfer to novel material. Experts had similar resolution as novices for material outside of their field of expertise, and the memory of novices and experts did not differ when detecting a big change, e.g., when a character’s color was changed. Memorizing appears to function as a rather abstract representation of word forms because memory for characters’ fonts was poor independently of expertise (Experiment 3), though still visual. Distractors that were highly similar conceptually did not increase memory errors, but visually similar distractors impaired memory (Experiment 4). We hypothesized that literates in Chinese represent characters in VWM as tokens of visual word forms made available by long-term memory. In Experiment 5, we provided novices with visual word form knowledge. Participants subsequently performed a change detection task with trained and novel characters in a functional magnetic resonance experiment. We analyzed set size- and training-dependent effects in the intraparietal sulcus (IPS) and the visual word form area. VWM for trained characters was better than for novel characters. Neural activity increased with set size and at a slower rate for trained than for novel characters. All conditions approached the same maximum, but novel characters reached the maximum at a smaller set size than trained characters. The time course of the bold response depended on set size and knowledge status. Starting from the same initial maximum, neural activity at small set sizes returned to baseline more quickly for trained characters than for novel characters. Additionally, high performers showed generally more neural activity in the IPS than low performers. We conclude that experts’ better performance in working memory (WM) is caused by the availability of visual long-term representations (word form types) that allow a sparse representation of the perceived stimuli and make even small changes big because they cause a type change that is easily detected.

Functional Dissociations of the Left Anterior and Posterior Occipitotemporal Cortex for Semantic and Non-semantic Phonological Access

Previous studies have identified the ventral and dorsal brain regions that respectively support semantic and non-semantic phonological access. Nevertheless, the specific role of the left occipitotemporal cortex (lOTC) in the two pathways of phonological access is ambiguous. To address that question, the present study compared word reading in Chinese (presumably relying on the semantic pathway) with that in English (presumably relying on the non-semantic pathway). Results revealed a clear dissociation in the involvement of the anterior and posterior lOTC in semantic and non-semantic phonological access. Specifically, the anterior lOTC showed greater activation for Chinese than for English, whereas the posterior lOTC showed greater activation for English than for Chinese. More importantly, both psychophysiological interaction analysis and resting-state functional connectivity analysis showed that the anterior lOTC was functionally connected to the ventral brain regions (e.g., left anterior fusiform gyrus, anterior temporal lobe, and ventral inferior frontal gyrus), whereas the posterior lOTC was functionally connected to the dorsal brain regions (e.g., left posterior superior temporal gyrus, supramarginal gyrus, and dorsal inferior frontal gyrus). These results suggest that the anterior and posterior lOTC are involved in semantic and non-semantic phonological access, respectively.

Functional laterality of the anterior and posterior occipitotemporal cortex is affected by language experience and processing strategy, respectively

Both language experience and processing strategy have been found to affect functional lateralization of the ventral occipitotemporal cortex (vOT). In this study, we adopted a factorial design to investigate the effects of language experience and processing strategy on functional lateralization of different vOT subregions in the processing of familiar (Chinese characters) and unfamiliar characters (Korean Hangul characters) in logographic writings. The processing strategy was manipulated by using part- and whole-based judgement tasks to induce part- and whole-based processing, respectively. The results showed that language experience enhanced neural responses in the anterior and middle vOT subregions, whereas part-based processing enhanced neural activations in the middle and posterior vOT subregions. More importantly, increased neural activations in the left hemisphere induced by language experience and part-based processing resulted in left laterality of the anterior and posterior vOT subregions, respectively, in the processing of logographic characters. These results suggested that functional lateralization of the anterior and posterior vOT subregions were respectively affected by language experience and processing strategy.

The visual word form area (VWFA) is part of both language and attention circuitry

While predominant models of visual word form area (VWFA) function argue for its specific role in decoding written language, other accounts propose a more general role of VWFA in complex visual processing. However, a comprehensive examination of structural and functional VWFA circuits and their relationship to behavior has been missing. Here, using high-resolution multimodal imaging data from a large Human Connectome Project cohort (N = 313), we demonstrate robust patterns of VWFA connectivity with both canonical language and attentional networks. Brain-behavior relationships revealed a striking pattern of double dissociation: structural connectivity of VWFA with lateral temporal language network predicted language, but not visuo-spatial attention abilities, while VWFA connectivity with dorsal fronto-parietal attention network predicted visuo-spatial attention, but not language abilities. Our findings support a multiplex model of VWFA function characterized by distinct circuits for integrating language and attention, and point to connectivity-constrained cognition as a key principle of human brain organization.

The visual word form area (VWFA) is a brain region associated with written language, but it has also been linked to visuospatial attention. Here, the authors reveal distinct structural and functional circuits linking VWFA with language and attention networks, and demonstrate that these circuits separately predict language and attention abilities.

Brain activation patterns associated with paragraph learning in persons with multiple sclerosis: The MEMREHAB trial

The modified Story Memory Technique (mSMT) is a memory rehabilitation program that combines training in visualization and context formation to improve learning and memory. Previous studies have shown improvement in learning and memory in individuals with multiple sclerosis (MS) after undergoing the mSMT, including changes in brain activity related to working memory and word encoding. The current study examined changes in brain activity in 16 individuals diagnosed with MS (n _treatment = 6; n _{placebo control} = 10) when they were presented with to-be-remembered information within a meaningful context (i.e. a paragraph) from before to after mSMT treatment. We expected treatment-related changes in brain activation in the language network (LAN), default mode network (DMN), and executive control network (ECN). Consistent with this prediction, fMRI results revealed reduced brain activation in the LAN, DMN and ECN after completing the mSMT treatment in the context of paragraph learning. While no significant behavioral changes were observed, a marginally significant improvement with a large effect size was noted between baseline and follow-up performance on the Rivermead Behavioral Memory Test in persons who completed treatment. Results are discussed in terms of the impact of imagery training on patterns of cerebral activation when learning words presented within a context.

Dissociating the functions of superior and inferior parts of the left ventral occipito-temporal cortex during visual word and object processing

During word and object recognition, extensive activation has consistently been observed in the left ventral occipito-temporal cortex (vOT), focused around the occipito-temporal sulcus (OTs). Previous studies have shown that there is a hierarchy of responses from posterior to anterior vOT regions (along the y-axis) that corresponds with increasing levels of recognition - from perceptual to semantic processing, respectively. In contrast, the functional differences between superior and inferior vOT responses (i.e. along the z-axis) have not yet been elucidated. To investigate, we conducted an extensive review of the literature and found that peak activation for reading varies by more than 1 cm in the z-axis. In addition, we investigated functional differences between superior and inferior parts of left vOT by analysing functional MRI data from 58 neurologically normal skilled readers performing 8 different visual processing tasks. We found that group activation in superior vOT was significantly more sensitive than inferior vOT to the type of task, with more superior vOT activation when participants were matching visual stimuli for their semantic or perceptual content than producing speech to the same stimuli. This functional difference along the z-axis was compared to existing boundaries between cytoarchitectonic areas around the OTs. In addition, using dynamic causal modelling, we show that connectivity from superior vOT to anterior vOT increased with semantic content during matching tasks but not during speaking tasks whereas connectivity from inferior vOT to anterior vOT was sensitive to semantic content for matching and speaking tasks. The finding of a functional dissociation between superior and inferior parts of vOT has implications for predicting deficits and response to rehabilitation for patients with partial damage to vOT following stroke or neurosurgery.

Visual training with musical notes changes late but not early electrophysiological responses in the visual cortex

Visual expertise with musical notation is unique. Fluent music readers show selectively higher activity to musical notes than to other visually similar patterns in both the retinotopic and higher-level visual areas and both very early (e.g., C1) and later (e.g., N170) visual event-related potential (ERP) components. This is different from domains such as face and letter perception, of which the neural expertise marker is typically found in the higher-level ventral visual areas and later (e.g., N170) ERP components. An intriguing question concerns whether the visual skills and neural selectivity observed in music-reading experts are a result of the effects of extensive visual experience with musical notation. The current study aimed to investigate the causal relationship between visual experience and its neural changes with musical notation. Novices with no formal musical training experience were trained to visually discriminate between note patterns in the laboratory for 10-26 hr such that their performance was comparable with fluent music readers. The N170 component became more selective for musical notes after training. Training was not, however, followed by changes in the earlier C1 component. The findings show that visual training is enough for causing changes in the responses of the higher-level visual areas to musical notation while the engagement of the early visual areas may involve additional nonvisual factors.

Context-Based Facilitation in Visual Word Recognition: Evidence for Visual and Lexical But Not Pre-Lexical Contributions

Word familiarity and predictive context facilitate visual word processing, leading to faster recognition times and reduced neuronal responses. Previously, models with and without top-down connections, including lexical-semantic, pre-lexical (e.g., orthographic/phonological), and visual processing levels were successful in accounting for these facilitation effects. Here we systematically assessed context-based facilitation with a repetition priming task and explicitly dissociated pre-lexical and lexical processing levels using a pseudoword (PW) familiarization procedure. Experiment 1 investigated the temporal dynamics of neuronal facilitation effects with magnetoencephalography (MEG; N = 38 human participants), while experiment 2 assessed behavioral facilitation effects (N = 24 human participants). Across all stimulus conditions, MEG demonstrated context-based facilitation across multiple time windows starting at 100 ms, in occipital brain areas. This finding indicates context-based facilitation at an early visual processing level. In both experiments, we furthermore found an interaction of context and lexical familiarity, such that stimuli with associated meaning showed the strongest context-dependent facilitation in brain activation and behavior. Using MEG, this facilitation effect could be localized to the left anterior temporal lobe at around 400 ms, indicating within-level (i.e., exclusively lexical-semantic) facilitation but no top-down effects on earlier processing stages. Increased pre-lexical familiarity (in PWs familiarized utilizing training) did not enhance or reduce context effects significantly. We conclude that context-based facilitation is achieved within visual and lexical processing levels. Finally, by testing alternative hypotheses derived from mechanistic accounts of repetition suppression, we suggest that the facilitatory context effects found here are implemented using a predictive coding mechanism.

Graffiti and perceived neighborhood safety: a neuroimaging study

Purpose

The purpose of this paper is to uncover the neural basis underlying the negative impact of graffiti on evaluations of neighborhood safety.

Design/methodology/approach

While in a functional magnetic resonance imaging scanner, participants rated the perceived safety of neighborhood scenes shown in photographic images. Some scenes were systematically altered to include graffiti, surveillance cameras or framed public art.

Findings

Consistent with previous research, the average safety rating for each scene including graffiti was significantly lower than for every other non-graffiti scene presented. The powerful salience of graffiti (as demonstrated by increased activation of the left fusiform gyrus) accompanied a decreased salience of other built environment scene elements (as demonstrated by reduced activation in the right parahippocampal gyrus). It appears as though the presence of graffiti causes the cognitive impact of other scene elements to fade. This redirection of cognitive focus may help to explain the dominant impact of graffiti on neighborhood safety evaluations.

Practical implications

Because of these basic perceptual tendencies, graffiti will necessarily dominate neighborhood safety evaluations. In any attempts to improve neighborhood safety evaluations, combating graffiti should be accorded a position of great importance, in keeping with these cognitive realities.

Originality/value

This is the first neuroimaging study of graffiti and perceived neighborhood safety.

fMRIPrep: a robust preprocessing pipeline for functional MRI

Preprocessing of functional MRI (fMRI) involves numerous steps to clean and standardize data before statistical analysis. Generally, researchers create ad-hoc preprocessing workflows for each new dataset, building upon a large inventory of tools available. The complexity of these workflows has snowballed with rapid advances in acquisition and processing. We introduce fMRIPrep, an analysis-agnostic tool that addresses the challenge of robust and reproducible preprocessing for fMRI data. FMRIPrep automatically adapts a best-in-breed workflow to the idiosyncrasies of virtually any dataset, ensuring high-quality preprocessing with no manual intervention. By introducing visual assessment checkpoints into an iterative integration framework for software-testing, we show that fMRIPrep robustly produces high-quality results on a diverse fMRI data collection. Additionally, fMRIPrep introduces less uncontrolled spatial smoothness than commonly used preprocessing tools. FMRIPrep equips neuroscientists with a high-quality, robust, easy-to-use and transparent preprocessing workflow, which can help ensure the validity of inference and the interpretability of their results.

Converging evidence for functional and structural segregation within the left ventral occipitotemporal cortex in reading

The ventral occipitotemporal cortex (vOTC) is crucial for recognizing visual patterns, and previous evidence suggests that there may be different subregions within the vOTC involved in the rapid identification of word forms. Here, we characterize vOTC reading circuitry using a multimodal approach combining functional, structural, and quantitative MRI and behavioral data. Two main word-responsive vOTC areas emerged: a posterior area involved in visual feature extraction, structurally connected to the intraparietal sulcus via the vertical occipital fasciculus; and an anterior area involved in integrating information with other regions of the language network, structurally connected to the angular gyrus via the posterior arcuate fasciculus. Furthermore, functional activation in these vOTC regions predicted reading behavior outside of the scanner. Differences in the microarchitectonic properties of gray-matter cells in these segregated areas were also observed, in line with earlier cytoarchitectonic evidence. These findings advance our understanding of the vOTC circuitry by linking functional responses to anatomical structure, revealing the pathways of distinct reading-related processes.

Orthographic and Phonological Representations in the Fusiform Cortex

Mental and neural representations of words are at the core of understanding the cognitive and neural mechanisms of reading. Despite extensive studies, the nature of visual word representation remains highly controversial due to methodological limitations. In particular, it is unclear whether the fusiform cortex contains only abstract orthographic representation, or represents both lower and higher level orthography as well as phonology. Using representational similarity analysis, we integrated behavioral ratings, computational models of reading and visual object recognition, and neuroimaging data to examine the nature of visual word representations in the fusiform cortex. Our results provided clear evidence that the middle and anterior fusiform represented both phonological and orthographic information. Whereas lower level orthographic information was represented at every stage of the ventral visual stream, abstract orthographic information was increasingly represented along the posterior-to-anterior axis. Furthermore, the left and right hemispheres were tuned to high- and low-frequency orthographic information, respectively. These results help to resolve the long-standing debates regarding the role of the fusiform in reading, and have significant implications for the development of psychological, neural, and computational theories of reading.

How many deficits in the same dyslexic brains? A behavioural and fMRI assessment of comorbidity in adult dyslexics

Dyslexia can have different manifestations: this has motivated different theories on its nature, on its underlying brain bases and enduring controversies on how to best treat it. The relative weight of the different manifestations has never been evaluated using both behavioural and fMRI measures, a challenge taken here to assess the major systems called into play in dyslexia by different theories. We found that adult well-compensated dyslexics were systematically impaired only in reading and in visuo-phonological tasks, while deficits for other systems (e.g., motor/cerebellar, visual magnocellular/motion perception) were only very occasional. In line with these findings, fMRI showed a reliable hypoactivation only for the task of reading, in the left occipito-temporal cortex (l-OTC). The l-OTC, normally a crossroad between the reading system and other systems, did not show the same level of intersection in dyslexics; yet, it was not totally silent because it responded, in segregated parts, during auditory phonological and visual motion perception tasks. This minimal behavioural and functional anatomical comorbidity demonstrates that a specific deficit of reading is the best description for developmental dyslexia, at least for adult well-compensated cases, with clear implications for rehabilitation strategies. The reduced intersection of multiple systems in the l-OTC suggests that dyslexics suffer from a coarser connectivity, leading to disconnection between the multiple domains that normally interact during reading.

Decoding and disrupting left midfusiform gyrus activity during word reading

The nature of the visual representation for words has been fiercely debated for over 150 y. We used direct brain stimulation, pre- and postsurgical behavioral measures, and intracranial electroencephalography to provide support for, and elaborate upon, the visual word form hypothesis. This hypothesis states that activity in the left midfusiform gyrus (lmFG) reflects visually organized information about words and word parts. In patients with electrodes placed directly in their lmFG, we found that disrupting lmFG activity through stimulation, and later surgical resection in one of the patients, led to impaired perception of whole words and letters. Furthermore, using machine-learning methods to analyze the electrophysiological data from these electrodes, we found that information contained in early lmFG activity was consistent with an orthographic similarity space. Finally, the lmFG contributed to at least two distinguishable stages of word processing, an early stage that reflects gist-level visual representation sensitive to orthographic statistics, and a later stage that reflects more precise representation sufficient for the individuation of orthographic word forms. These results provide strong support for the visual word form hypothesis and demonstrate that across time the lmFG is involved in multiple stages of orthographic representation.

Chinese Character and English Word processing in children's ventral occipitotemporal cortex: fMRI evidence for script invariance

Learning to read is thought to involve the recruitment of left hemisphere ventral occipitotemporal cortex (OTC) by a process of "neuronal recycling", whereby object processing mechanisms are co-opted for reading. Under the same theoretical framework, it has been proposed that the visual word form area (VWFA) within OTC processes orthographic stimuli independent of culture and writing systems, suggesting that it is universally involved in written language. However, this "script invariance" has yet to be demonstrated in monolingual readers of two different writing systems studied under the same experimental conditions. Here, using functional magnetic resonance imaging (fMRI), we examined activity in response to English Words and Chinese Characters in 1st graders in the United States and China, respectively. We examined each group separately and found the readers of English as well as the readers of Chinese to activate the left ventral OTC for their respective native writing systems (using both a whole-brain and a bilateral OTC-restricted analysis). Critically, a conjunction analysis of the two groups revealed significant overlap between them for native writing system processing, located in the VWFA and therefore supporting the hypothesis of script invariance. In the second part of the study, we further examined the left OTC region responsive to each group's native writing system and found that it responded equally to Object stimuli (line drawings) in the Chinese-reading children. In English-reading children, the OTC responded much more to Objects than to English Words. Together, these results support the script invariant role of the VWFA and also support the idea that the areas recruited for character or word processing are rooted in object processing mechanisms of the left OTC.

Adding words to the brain's visual dictionary: novel word learning selectively sharpens orthographic representations in the VWFA

The nature of orthographic representations in the human brain is still subject of much debate. Recent reports have claimed that the visual word form area (VWFA) in left occipitotemporal cortex contains an orthographic lexicon based on neuronal representations highly selective for individual written real words (RWs). This theory predicts that learning novel words should selectively increase neural specificity for these words in the VWFA. We trained subjects to recognize novel pseudowords (PWs) and used fMRI rapid adaptation to compare neural selectivity with RWs, untrained PWs (UTPWs), and trained PWs (TPWs). Before training, PWs elicited broadly tuned responses, whereas responses to RWs indicated tight tuning. After training, TPW responses resembled those of RWs, whereas UTPWs continued to show broad tuning. This change in selectivity was specific to the VWFA. Therefore, word learning appears to selectively increase neuronal specificity for the new words in the VWFA, thereby adding these words to the brain's visual dictionary.

Long-term experience with Chinese language shapes the fusiform asymmetry of English reading

Previous studies have suggested differential engagement of the bilateral fusiform gyrus in the processing of Chinese and English. The present study tested the possibility that long-term experience with Chinese language affects the fusiform laterality of English reading by comparing three samples: Chinese speakers, English speakers with Chinese experience, and English speakers without Chinese experience. We found that, when reading words in their respective native language, Chinese and English speakers without Chinese experience differed in functional laterality of the posterior fusiform region (right laterality for Chinese speakers, but left laterality for English speakers). More importantly, compared with English speakers without Chinese experience, English speakers with Chinese experience showed more recruitment of the right posterior fusiform cortex for English words and pseudowords, which is similar to how Chinese speakers processed Chinese. These results suggest that long-term experience with Chinese shapes the fusiform laterality of English reading and have important implications for our understanding of the cross-language influences in terms of neural organization and of the functions of different fusiform subregions in reading.

Words in the bilingual brain: an fNIRS brain imaging investigation of lexical processing in sign-speech bimodal bilinguals

Early bilingual exposure, especially exposure to two languages in different modalities such as speech and sign, can profoundly affect an individual's language, culture, and cognition. Here we explore the hypothesis that bimodal dual language exposure can also affect the brain's organization for language. These changes occur across brain regions universally important for language and parietal regions especially critical for sign language (Newman et al., 2002). We investigated three groups of participants (N = 29) that completed a word repetition task in American Sign Language (ASL) during fNIRS brain imaging. Those groups were (1) hearing ASL-English bimodal bilinguals (n = 5), (2) deaf ASL signers (n = 7), and (3) English monolinguals naïve to sign language (n = 17). The key finding of the present study is that bimodal bilinguals showed reduced activation in left parietal regions relative to deaf ASL signers when asked to use only ASL. In contrast, this group of bimodal signers showed greater activation in left temporo-parietal regions relative to English monolinguals when asked to switch between their two languages (Kovelman et al., 2009). Converging evidence now suggest that bimodal bilingual experience changes the brain bases of language, including the left temporo-parietal regions known to be critical for sign language processing (Emmorey et al., 2007). The results provide insight into the resilience and constraints of neural plasticity for language and bilingualism.

Brain-potential analysis of visual word recognition in dyslexics and typically reading children

The specialization of visual brain areas for fast processing of printed words plays an important role in the acquisition of reading skills. Dysregulation of these areas may be among the deficits underlying developmental dyslexia. The present study examines the specificity of word activation in dyslexic children in 3rd grade by comparing early components of brain potentials elicited by visually presented words vs. strings of meaningless letter-like symbols. Results showed a more pronounced N1 component for words compared to symbols for both groups. The dyslexic group revealed larger left-lateralized, word-specific N1 responses than the typically reading group. Furthermore, positive correlations between N1 amplitudes and reading fluency were found in the dyslexic group. Our results support the notion of N1 as a sensitive index of visual word processing involved in reading fluency.

The VWFA: it's not just for words anymore

Reading is an important but phylogenetically new skill. While neuroimaging studies have identified brain regions used in reading, it is unclear to what extent these regions become specialized for use predominantly in reading vs. other tasks. Over the past several years, our group has published three studies addressing this question, particularly focusing on whether the putative visual word form area (VWFA) is used predominantly in reading, or whether it is used more generally in a number of tasks. Our three studies utilize a range of neuroimaging techniques, including task based fMRI experiments, a seed based resting state functional connectivity (RSFC) experiment, and a network based RSFC experiment. Overall, our studies indicate that the VWFA is not used specifically or even predominantly for reading. Rather the VWFA is a general use region that has processing properties making it particularly useful for reading, though it continues to be used in any task that requires its general processing properties. Our network based RSFC analysis extends this finding to other regions typically thought to be used predominantly for reading. Here, we review these findings and describe how the three studies complement each other. Then, we argue that conceptualizing the VWFA as a brain region with specific processing characteristics rather than a brain region devoted to a specific stimulus class, allows us to better explain the activity seen in this region during a variety of tasks. Having this type of conceptualization not only provides a better understanding of the VWFA but also provides a framework for understanding other brain regions, as it affords an explanation of function that is in keeping with the long history of studying the brain in terms of the type of information processing performed (Posner, 1978).

BROCCOLI: Software for fast fMRI analysis on many-core CPUs and GPUs

Analysis of functional magnetic resonance imaging (fMRI) data is becoming ever more computationally demanding as temporal and spatial resolutions improve, and large, publicly available data sets proliferate. Moreover, methodological improvements in the neuroimaging pipeline, such as non-linear spatial normalization, non-parametric permutation tests and Bayesian Markov Chain Monte Carlo approaches, can dramatically increase the computational burden. Despite these challenges, there do not yet exist any fMRI software packages which leverage inexpensive and powerful graphics processing units (GPUs) to perform these analyses. Here, we therefore present BROCCOLI, a free software package written in OpenCL (Open Computing Language) that can be used for parallel analysis of fMRI data on a large variety of hardware configurations. BROCCOLI has, for example, been tested with an Intel CPU, an Nvidia GPU, and an AMD GPU. These tests show that parallel processing of fMRI data can lead to significantly faster analysis pipelines. This speedup can be achieved on relatively standard hardware, but further, dramatic speed improvements require only a modest investment in GPU hardware. BROCCOLI (running on a GPU) can perform non-linear spatial normalization to a 1 mm³ brain template in 4–6 s, and run a second level permutation test with 10,000 permutations in about a minute. These non-parametric tests are generally more robust than their parametric counterparts, and can also enable more sophisticated analyses by estimating complicated null distributions. Additionally, BROCCOLI includes support for Bayesian first-level fMRI analysis using a Gibbs sampler. The new software is freely available under GNU GPL3 and can be downloaded from github (https://github.com/wanderine/BROCCOLI/).

Turning visual shapes into sounds: early stages of reading acquisition revealed in the ventral occipitotemporal cortex

The exact role of the left ventral occipitotemporal cortex (VOTC) during the initial stages of reading acquisition is a hotly debated issue, especially regarding the comparative effect of learning on early stimulus-dependent vs. later task-dependent processes. We show that this controversy can be solved with high-temporal resolution intracerebral EEG recordings of the VOTC. We measured High-Frequency Activity (50-150 Hz) as a proxy of population-level spiking activity while participants learned Japanese Katakana symbols, and found that learning primarily affects top-down/task-dependent neural processing, after a few minutes only. In contrast, adaptation of early bottom-up/stimulus-dependent processing takes several days to adapt and provides the basis for fluent reading. Such evidence that two consecutive stages of neural processing, stimulus- and task-dependent are differentially affected by learning, can reconcile seemingly opposite hypotheses on the role of the VOTC during reading acquisition.

Neural processes during encoding support durable memory

The ability to form durable memory is critical for human survival and development, but its underlying cognitive and neural mechanisms have not been well understood. In particular, existing studies have not clearly dissociated the neural processes supporting short- and long-duration memories. The present study addressed this issue with functional MRI and a modified subsequent memory paradigm. Participants were asked to make semantic judgment on a list of 320 words in the scanner. Half of the words were tested after a short delay (i.e., 1day, T1) and again after a long delay (i.e., 1week, T12), whereas the other half were tested only once after the long delay (T2). Materials forgotten during T1 were categorized as forgotten trials, and those remembered during T2 were categorized as long-duration trials. In contrast, trials remembered during T1 but not during T12 were categorized as short-duration trials. We found that compared to forgotten trials, short-duration trials showed decreased activation in the posterior cingulate cortex (PCC) and precuneus, which is consistent with many previous observations. Importantly, long-duration trials showed stronger activity in the left inferior frontal gyrus (LIFG) but less deactivation in the PCC relative to short-duration trials. Psychophysiological interactions (PPI) analysis revealed stronger functional connectivity between LIFG and PCC for long-duration trials than for forgotten trials. Our results suggest that strong PCC activity, in combination with strong LIFG activity, supports long-lasting memory.

Selective transfer of visual working memory training on Chinese character learning

Previous research has shown a systematic relationship between phonological working memory capacity and second language proficiency for alphabetic languages. However, little is known about the impact of working memory processes on second language learning in a non-alphabetic language such as Mandarin Chinese. Due to the greater complexity of the Chinese writing system we expect that visual working memory rather than phonological working memory exerts a unique influence on learning Chinese characters. This issue was explored in the present experiment by comparing visual working memory training with an active (auditory working memory training) control condition and a passive, no training control condition. Training induced modulations in language-related brain networks were additionally examined using functional magnetic resonance imaging in a pretest-training-posttest design. As revealed by pre- to posttest comparisons and analyses of individual differences in working memory training gains, visual working memory training led to positive transfer effects on visual Chinese vocabulary learning compared to both control conditions. In addition, we found sustained activation after visual working memory training in the (predominantly visual) left infero-temporal cortex that was associated with behavioral transfer. In the control conditions, activation either increased (active control condition) or decreased (passive control condition) without reliable behavioral transfer effects. This suggests that visual working memory training leads to more efficient processing and more refined responses in brain regions involved in visual processing. Furthermore, visual working memory training boosted additional activation in the precuneus, presumably reflecting mental image generation of the learned characters. We, therefore, suggest that the conjoint activity of the mid-fusiform gyrus and the precuneus after visual working memory training reflects an interaction of working memory and imagery processes with complex visual stimuli that fosters the coherent synthesis of a percept from a complex visual input in service of enhanced Chinese character learning.

Decoding the neuroanatomical basis of reading ability: a multivoxel morphometric study

As a relatively recent cultural invention in human evolution, reading is an important gateway to personal development and socioeconomic success. Despite the well documented individual differences in reading ability, its neuroanatomical correlates have not been well understood, largely due to the fact that reading is a complex skill that consists of multiple components. Using a large sample of 416 college students and 7 reading tasks, the present study successfully identified three uncorrelated components of reading ability: phonological decoding, form-sound association, and naming speed. We then tried to predict individuals' scores in these components from their gray matter volume (GMV) on a subset of participants (N = 253) with high-quality structural images, adopting a multivariate support vector regression analysis with tenfold cross-validation. Our results revealed distinct neural regions that supported different aspects of reading ability: whereas phonological decoding was associated with the GMV in the left superior parietal lobe extending to the supramarginal gyrus, form-sound association was predicted by the GMV in the hippocampus and cerebellum. Naming speed was associated with GMV in distributed brain regions in the occipital, temporal, parietal, and frontal cortices. Phonological decoding and form-sound association were uncorrelated with general cognitive abilities. However, naming speed was correlated with intelligence and processing speed, and some of the regions that were predictive of naming speed also predicted these general cognitive abilities. These results provide further insights on the cognitive and neural architecture of reading and the structural basis of individual differences in reading abilities.

Non-Gaussian methods and high-pass filters in the estimation of effective connections

We consider several alternative ways of exploiting non-Gaussian distributional features, including some that can in principle identify direct, positive feedback relations (graphically, 2-cycles) and combinations of methods that can identify high dimensional graphs. All of the procedures are implemented in the TETRAD freeware (Ramsey et al., 2013). We show that in most cases the limited accuracy of the several non-Gaussian methods in the Smith et al. (2011) simulations can be attributed to the high-pass Butterworth filter used in that study. Without that filter, or with the filter in the widely used FSL program (Jenkinson et al., 2012), the directional accuracies of several of the non-Gaussian methods are at or near ceiling in many conditions of the Smith et al. simulation. We show that the improvement of an apparently Gaussian method (Patel et al., 2006) when filtering is removed is due to non-Gaussian features of that method introduced by the Smith et al. implementation. We also investigate some conditions in which multi-subject data help with causal structure identification using higher moments, notably with non-stationary time series or with 2-cycles. We illustrate the accuracy of the methods with more complex graphs with and without 2-cycles, and with a 500 node graph; to illustrate applicability and provide a further test we apply the methods to an empirical case for which aspects of the causal structure are known. Finally, we note a number of cautions and issues that remain to be investigated, and some outstanding problems for determining the structure of effective connections from fMRI data.

Stimulus value signals in ventromedial PFC reflect the integration of attribute value signals computed in fusiform gyrus and posterior superior temporal gyrus

We often have to make choices among multiattribute stimuli (e.g., a food that differs on its taste and health). Behavioral data suggest that choices are made by computing the value of the different attributes and then integrating them into an overall stimulus value signal. However, it is not known whether this theory describes the way the brain computes the stimulus value signals, or how the underlying computations might be implemented. We investigated these questions using a human fMRI task in which individuals had to evaluate T-shirts that varied in their visual esthetic (e.g., color) and semantic (e.g., meaning of logo printed in T-shirt) components. We found that activity in the fusiform gyrus, an area associated with the processing of visual features, correlated with the value of the visual esthetic attributes, but not with the value of the semantic attributes. In contrast, activity in posterior superior temporal gyrus, an area associated with the processing of semantic meaning, exhibited the opposite pattern. Furthermore, both areas exhibited functional connectivity with an area of ventromedial prefrontal cortex that reflects the computation of overall stimulus values at the time of decision. The results provide supporting evidence for the hypothesis that some attribute values are computed in cortical areas specialized in the processing of such features, and that those attribute-specific values are then passed to the vmPFC to be integrated into an overall stimulus value signal to guide the decision.

Dissociating frontal regions that co-lateralize with different ventral occipitotemporal regions during word processing

The ventral occipitotemporal sulcus (vOT) sustains strong interactions with the inferior frontal cortex during word processing. Consequently, activation in both regions co-lateralize towards the same hemisphere in healthy subjects. Because the determinants of lateralisation differ across posterior, middle and anterior vOT subregions, we investigated whether lateralisation in different inferior frontal regions would co-vary with lateralisation in the three different vOT subregions. A whole brain analysis found that, during semantic decisions on written words, laterality covaried in (1) posterior vOT and the precentral gyrus; (2) middle vOT and the pars opercularis, pars triangularis, and supramarginal gyrus; and (3) anterior vOT and the pars orbitalis, middle frontal gyrus and thalamus. These findings increase the spatial resolution of our understanding of how vOT interacts with other brain areas during semantic categorisation on words.

Toward open sharing of task-based fMRI data: the OpenfMRI project

The large-scale sharing of task-based functional neuroimaging data has the potential to allow novel insights into the organization of mental function in the brain, but the field of neuroimaging has lagged behind other areas of bioscience in the development of data sharing resources. This paper describes the OpenFMRI project (accessible online at http://www.openfmri.org), which aims to provide the neuroimaging community with a resource to support open sharing of task-based fMRI studies. We describe the motivation behind the project, focusing particularly on how this project addresses some of the well-known challenges to sharing of task-based fMRI data. Results from a preliminary analysis of the current database are presented, which demonstrate the ability to classify between task contrasts with high generalization accuracy across subjects, and the ability to identify individual subjects from their activation maps with moderately high accuracy. Clustering analyses show that the similarity relations between statistical maps have a somewhat orderly relation to the mental functions engaged by the relevant tasks. These results highlight the potential of the project to support large-scale multivariate analyses of the relation between mental processes and brain function.

The role of the left putamen in multilingual language production

Subcortical structures are a key component of bilingual language processing. For instance, there is now evidence that the head of the left caudate is involved in controlling languages in bilingual individuals. On the other hand, the left putamen is hypothesized to be involved in articulatory processes but little is known on its engagement in bilingual language processing. Here, our hypothesis was that the left putamen of multilinguals is engaged when producing words in the less proficient language. We investigated this issue with event-related functional Magnetic Resonance (er-fMRI) in a group of multilinguals (n = 14) and in monolinguals (n = 14) during a picture-naming task. Further, we hypothesized increased grey matter density in the left putamen as an effect of experience since multilinguals constantly face a major articulatory load (i.e., speaking multiple languages) during life. To test these hypotheses we measured structural differences between multilinguals and monolinguals using voxel-based morphometry (VBM). Our results indicate that multilinguals have increased activation in the left putamen for a non-native language, but only if they are not highly proficient in that language. In addition, we found increased grey matter density in the left putamen of multilinguals compared to monolinguals. These findings highlight that the multilingual brain handles a complex articulatory repertoire (i.e., dealing with multiple languages) by inducing structural plasticity in the left putamen.

Orthographic transparency modulates the functional asymmetry in the fusiform cortex: an artificial language training study

The laterality difference in the occipitotemporal region between Chinese (bilaterality) and alphabetic languages (left laterality) has been attributed to their difference in visual appearance. However, these languages also differ in orthographic transparency. To disentangle the effect of orthographic transparency from visual appearance, we trained subjects to read the same artificial script either as an alphabetic (i.e., transparent orthography) or a logographic (i.e., nontransparent orthography) language. Consistent with our previous results, both types of phonological training enhanced activations in the left fusiform gyrus. More interestingly, the laterality in the fusiform gyrus (especially the posterior region) was modulated by the orthographic transparency of the artificial script (more left-lateralized activation after alphabetic training than after logographic training). These results provide an alternative account (i.e., orthographic transparency) for the laterality difference between Chinese and alphabetic languages, and may have important implications for the role of the fusiform in reading.

Visual print tuning deficits in dyslexic adolescents under minimized phonological demands

The left ventral occipitotemporal cortex is reliably activated by visual orthographic stimulation and has repeatedly been found underactivated in developmental dyslexia. However, previous studies have made little effort to specifically probe orthographic processing while minimizing the need for higher-order reading related operations, especially phonological processing. Phonological deficits are well documented in dyslexia but may limit interpretations of ventral occipitotemporal underactivation as a primarily orthographic coding deficit, considering that different processing modes occur highly parallel. We therefore used a task that restricts higher-order processing to better isolate orthographic deficits. Thirteen dyslexic adolescents and twenty-two matched typical readers performed a low-level target detection task combined with rapidly presented stimuli of increasing similarity to real words during functional magnetic resonance imaging. The clear deviance found in impaired readers' left ventral occipitotemporal organization suggested deficits in print sensitivity at bottom-up processing stages that are largely independent of phonological operations. This finding elucidates print processing during a critical developmental transition from child- to adulthood and extends current accounts on left ventral occipitotemporal functionality.

The neural basis of visual word form processing: a multivariate investigation

Current research on the neurobiological bases of reading points to the privileged role of a ventral cortical network in visual word processing. However, the properties of this network and, in particular, its selectivity for orthographic stimuli such as words and pseudowords remain topics of significant debate. Here, we approached this issue from a novel perspective by applying pattern-based analyses to functional magnetic resonance imaging data. Specifically, we examined whether, where and how, orthographic stimuli elicit distinct patterns of activation in the human cortex. First, at the category level, multivariate mapping found extensive sensitivity throughout the ventral cortex for words relative to false-font strings. Secondly, at the identity level, the multi-voxel pattern classification provided direct evidence that different pseudowords are encoded by distinct neural patterns. Thirdly, a comparison of pseudoword and face identification revealed that both stimulus types exploit common neural resources within the ventral cortical network. These results provide novel evidence regarding the involvement of the left ventral cortex in orthographic stimulus processing and shed light on its selectivity and discriminability profile. In particular, our findings support the existence of sublexical orthographic representations within the left ventral cortex while arguing for the continuity of reading with other visual recognition skills.

Gains of item-specific training in visual working memory and their neural correlates

Experts sometimes show higher working memory performance than novices but contrary to this finding, evidence for a positive effect of item-specific training is rare. This study provides evidence for item-specific training gains. We presented Chinese characters and artificial patterns (spotted figures) in a change detection task before and after training (varying set size from 1 to 3). A part of the Chinese characters were trained; others and the spotted figures were not trained. Memory capacity was between one and two items. For set size two, memory performance for trained characters was higher than for untrained characters and they were processed faster. Within superior intraparietal sulcus and middle occipital cortex (part of the putative posterior working memory network), the neural activity asymptotically increased with set size. Untrained items reached the activation maximum already at set size two. For this set size, the activity was significantly reduced for trained items so that a further increase from two to three items was observed. We interpret this difference as a correlate of a gain in neural efficiency. The size of this difference correlated with the training gain in memory. We assume that training causes a more efficient neural representation of trained items supported by long-term memory and this allows holding more items in working memory.

A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading

The anatomy of language has been investigated with PET or fMRI for more than 20 years. Here I attempt to provide an overview of the brain areas associated with heard speech, speech production and reading. The conclusions of many hundreds of studies were considered, grouped according to the type of processing, and reported in the order that they were published. Many findings have been replicated time and time again leading to some consistent and undisputable conclusions. These are summarised in an anatomical model that indicates the location of the language areas and the most consistent functions that have been assigned to them. The implications for cognitive models of language processing are also considered. In particular, a distinction can be made between processes that are localized to specific structures (e.g. sensory and motor processing) and processes where specialisation arises in the distributed pattern of activation over many different areas that each participate in multiple functions. For example, phonological processing of heard speech is supported by the functional integration of auditory processing and articulation; and orthographic processing is supported by the functional integration of visual processing, articulation and semantics. Future studies will undoubtedly be able to improve the spatial precision with which functional regions can be dissociated but the greatest challenge will be to understand how different brain regions interact with one another in their attempts to comprehend and produce language.

Investigating unique environmental contributions to the neural representation of written words: a monozygotic twin study

The visual word form area (VWFA) is a region of left inferior occipitotemporal cortex that is critically involved in visual word recognition. Previous studies have investigated whether and how experience shapes the functional characteristics of VWFA by comparing neural response magnitude in response to words and nonwords. Conflicting results have been obtained, however, perhaps because response magnitude can be influenced by other factors such as attention. In this study, we measured neural activity in monozygotic twins, using functional magnetic resonance imaging. This allowed us to quantify differences in unique environmental contributions to neural activation evoked by words, pseudowords, consonant strings, and false fonts in the VWFA and striate cortex. The results demonstrate significantly greater effects of unique environment in the word and pseudoword conditions compared to the consonant string and false font conditions both in VWFA and in left striate cortex. These findings provide direct evidence for environmental contributions to the neural architecture for reading, and suggest that learning phonology and/or orthographic patterns plays the biggest role in shaping that architecture.

The left occipitotemporal cortex does not show preferential activity for words

Regions in left occipitotemporal (OT) cortex, including the putative visual word form area, are among the most commonly activated in imaging studies of single-word reading. It remains unclear whether this part of the brain is more precisely characterized as specialized for words and/or letters or contains more general-use visual regions having properties useful for processing word stimuli, among others. In Analysis 1, we found no evidence of greater activity in left OT regions for words or letter strings relative to other high-spatial frequency high-contrast stimuli, including line drawings and Amharic strings (which constitute the Ethiopian writing system). In Analysis 2, we further investigated processing characteristics of OT cortex potentially useful in reading. Analysis 2 showed that a specific part of OT cortex 1) is responsive to visual feature complexity, measured by the number of strokes forming groups of letters or Amharic strings and 2) processes learned combinations of characters, such as those in words and pseudowords, as groups but does not do so in consonant and Amharic strings. Together, these results indicate that while regions of left OT cortex are not specialized for words, at least part of OT cortex has properties particularly useful for processing words and letters.

Task by stimulus interactions in brain responses during Chinese character processing

In the visual word recognition literature, it is well understood that various stimulus effects interact with behavioral task. For example, effects of word frequency are exaggerated and effects of spelling-to-sound regularity are reduced in the lexical decision task, relative to reading aloud. Neuroimaging studies of reading often examine effects of task and stimulus properties on brain activity independently, but potential interactions between task demands and stimulus effects have not been extensively explored. To address this issue, we conducted lexical decision and symbol detection tasks using stimuli that varied parametrically in their word-likeness, and tested for task by stimulus class interactions. Interactions were found throughout the reading system, such that stimulus selectivity was observed during the lexical decision task, but not during the symbol detection task. Further, the pattern of stimulus selectivity was directly related to task difficulty, so that the strongest brain activity was observed to the most word-like stimuli that required "no" responses, whereas brain activity to words, which elicit rapid and accurate "yes" responses were relatively weak. This is in line with models that argue for task-dependent specialization of brain regions, and contrasts with the notion of task-independent stimulus selectivity in the reading system.