Event-related functional magnetic resonance imaging study of the extrastriate cortex response to a categorically ambiguous stimulus primed by letters and familiar geometric figures

Beyond the visual word form area: the orthography-semantics interface in spelling and reading

Lexical orthographic information provides the basis for recovering the meanings of words in reading and for generating correct word spellings in writing. Research has provided evidence that an area of the left ventral temporal cortex, a subregion of what is often referred to as the visual word form area (VWFA), plays a significant role specifically in lexical orthographic processing. The current investigation goes beyond this previous work by examining the neurotopography of the interface of lexical orthography with semantics. We apply a novel lesion mapping approach with three individuals with acquired dysgraphia and dyslexia who suffered lesions to left ventral temporal cortex. To map cognitive processes to their neural substrates, this lesion mapping approach applies similar logical constraints to those used in cognitive neuropsychological research. Using this approach, this investigation: (a) identifies a region anterior to the VWFA that is important in the interface of orthographic information with semantics for reading and spelling; (b) determines that, within this orthography-semantics interface region (OSIR), access to orthography from semantics (spelling) is topographically distinct from access to semantics from orthography (reading); (c) provides evidence that, within this region, there is modality-specific access to and from lexical semantics for both spoken and written modalities, in both word production and comprehension. Overall, this study contributes to our understanding of the neural architecture at the lexical orthography-semantic-phonological interface within left ventral temporal cortex.

Letter representations in writing: an fMRI adaptation approach

Behavioral and neuropsychological research in reading and spelling has provided evidence for the role of the following types of orthographic representations in letter writing: letter shapes, letter case, and abstract letter identities. We report on the results of an fMRI investigation designed to identify the neural substrates of these different representational types. Using an fMRI adaptation paradigm we examined the neural distribution of inhibition and release from inhibition in a letter-writing task in which, on every trial, participants produced three repetitions of the same letter and a fourth letter that was either identical to (no-change trial) or different from the previous three (change trial). Change trials involved a change in the shape, case, and/or identity of the letter. After delineating the general letter writing network by identifying areas that exhibited significant neural adaptation effects on no-change trials, we used deconvolution analysis to examine this network for effects of release from inhibition on change trials. In this way we identified regions specifically associated with the representation of letter shape (in the left SFS and SFG/pre-CG) and letter identity [in the left fusiform gyrus (FG)] or both [right cerebellum, left post-central gyrus (post-CG), and left middle frontal gyrus (MFG)]. No regions were associated with the representation of letter case. This study showcases an investigational approach that allows for the differentiation of the neurotopography of the representational types that are key to our ability to produce written language.

What differs in visual recognition of handwritten vs. printed letters? An fMRI study

In models of letter recognition, handwritten letters are considered as a particular font exemplar, not qualitatively different in their processing from printed letters. Yet, some data suggest that recognizing handwritten letters might rely on distinct processes, possibly related to motor knowledge. We applied functional magnetic resonance imaging to compare the neural correlates of perceiving handwritten letters vs. standard printed letters. Statistical analysis circumscribed to frontal brain regions involved in hand-movement triggering and execution showed that processing of handwritten letters is supported by a stronger activation of the left primary motor cortex and the supplementary motor area. At the whole-brain level, additional differences between handwritten and printed letters were observed in the right superior frontal, middle occipital, and parahippocampal gyri, and in the left inferior precentral and the fusiform gyri. The results are suggested to indicate embodiment of the visual perception of handwritten letters.

Functional specialization and dynamic resource allocation in visual cortex

We studied the spatiotemporal characteristics of cortical activity in early visual areas and the fusiform gyri (FG) by means of magnetoencephalography (MEG). Subjects performed a visual classification task, in which letters and visually similar pseudoletters were presented in different surrounds and under different task demands. The stimuli appeared in a cued half of the visual field (VF). We observed prestimulus effects on amplitudes in V1 and Cuneus relating to VF and task demands, suggesting a combination of active anticipation and specialized routing of activity in visual processing. Amplitudes in the right FG between 150 and 350 ms after stimulus onset reflected task demands, while those in the left FG between 300 and 400 ms showed selectivity for graphemes. The contrasting stimulus-evoked effects in the right and left FG show that the former area is sensitive to task demands irrespective of stimulus content, whereas the left FG is sensitive to stimulus content irrespectively of task demand.

fMRI correlates of cortical specialization and generalization for letter processing

The present study used functional magnetic resonance imaging to examine cortical specialization for letter processing. We assessed whether brain regions that were involved in letter processing exhibited domain-specific and/or mandatory responses, following Fodor's definition of properties of modular systems (Fodor, J.A., 1983. The Modularity of Mind. The MIT Press, Cambridge, MA.). Domain-specificity was operationalized as selective, or exclusive, activation for letters relative to object and visual noise processing and a baseline fixation task. Mandatory processing was operationalized as selective activation for letters during both a silent naming and a perceptual matching task. In addition to these operational definitions, other operational definitions of selectivity for letter processing discussed by [Pernet, C., Celsis, P., Demonet, J., 2005. Selective response to letter categorization within the left fusiform gyrus. NeuroImage 28, 738-744] were applied to the data. Although the left fusiform gyrus showed a specialized response to letters using the definition of selectivity put forth by [Pernet, C., Celsis, P., Demonet, J., 2005. Selective response to letter categorization within the left fusiform gyrus. NeuroImage 28, 738-744], this region did not exhibit specialization for letters according to our more conservative definition of selectivity. Instead, this region showed equivalent activation by letters and objects in both the naming and matching tasks. Hence, the left fusiform gyrus does not exhibit domain-specific or mandatory processing but may reflect a shared input system for both stimulus types. The left insula and some portions of the left inferior parietal lobule, however, did show a domain-specific response for letter naming but not for letter matching. These regions likely subserve some linguistically oriented cognitive process that is unique to letters, such as grapheme-to-phoneme translation or retrieval of phonological codes for letter names. Hence, cortical specialization for letters emerged in the naming task in some peri-sylvian language related cortices, but not in occipito-temporal cortex. Given that the domain-specific response for letters in left peri-sylvian regions was only present in the naming task, these regions do not process letters in a mandatory fashion, but are instead modulated by the linguistic nature of the task.

Lateral masking, levels of processing and stimulus category: A comparative study between normal and dyslexic readers

The lateral masking effect results in lower performance on letter recognition when items are flanked by other stimuli. Using a new paradigm based on discrimination (feature analysis) and categorization (memory access) tasks, we investigated the influence of level of processing (as addressed, respectively, by these two tasks) and stimulus type (Latin letters, Korean letters and geometrical figures) on lateral masking. In addition, performance of dyslexic and non-dyslexic adult readers was compared. The non-dyslexic participants demonstrated a classical lateral masking effect with lower performance for flanked items than isolated ones. In addition, lateral masking was stronger in the categorization than in the discrimination task and was restricted to familiar items, i.e., Latin letters and geometrical figures. Dyslexic participants showed poorer performance than non-dyslexics on processing isolated items, and the pattern of decrease in performance for lateral masking was similar to non-dyslexics. However, they also showed a stronger decrease in performance in categorization and a stronger decrease related to the lateral masking for this categorization task. Our results in normal readers suggest that lateral masking relies on the interference between the target and the flankers during feature integration that may result in marked impairment of memory access (categorization task). Poorer performance in dyslexic readers may reflect impaired parafoveal/peripheral low-level processing during feature integration that may have worsened during the flanked condition due to a target selection/spatial-attentional disorder. Moreover, dyslexic subjects presented an additional categorization deficit that may relate to a specific left-hemispheric disorder.

Letter processing automatically recruits a sensory–motor brain network

Behavioral, neuropsychological and neuroimaging research suggest a distributed network that is recruited when we interact with letters. For the first time, we combine several letter processing tasks in a single experiment to study why letters seem to engage such disparate processing areas. Using fMRI, we investigate how the brain responds to letters using tasks that should recruit systems for letter perception, letter writing, letter copying and letter imagery. We describe a network of five cortical regions including the left fusiform gyrus, two left pre-central areas, left cuneus and the left inferior frontal gyrus that are all selectively engaged during a 1-back matching paradigm with letters. Our results suggest involvement of these regions to different extents in different tasks. However, the regions also form an integrated network such that letter perception also engages motor regions while writing recruits letter-specific visual regions as well. We suggest that this distributed network is a direct result of our sensory-motor interactions with letters.

Selective response to letter categorization within the left fusiform gyrus

Neuroimaging studies that look at reading processes using words, pseudowords, nonwords and letters frequently report specific left fusiform gyrus (BA37) activations. In the present study, we examined fMRI signal variations within the left and right BA37 for paired Latin letters, Korean letters and geometrical figures in discrimination and categorization tasks. Data of Pernet et al. (Pernet, C., Franceries, X., Basan, S., Cassol, E., Démonet, J.F., Celsis, P., 2004. Anatomy and time course of discrimination and categorization processes in vision: an fMRI study. NeuroImage 22, 1563-1577) were re-analyzed using a ROI methodology that highlights the selective response of the left BA37 to Latin letter categorization. First, differences according to stimulus type were observed for the categorization task only. Second, we found weaker activation for Latin letter categorization than for both geometrical figure and Korean letter categorization. Third, only Latin letter categorization elicited as left-sided activation, although the direct comparison between regions did not demonstrate a significant difference. These data suggest that the left fusiform gyrus sustains access to letter representations in memory; and results are discussed with reference to the relationship between letter categorization and word recognition and to selective vs. specific (i.e. task-independent) neural response.

Developmental Changes in Mental Arithmetic: Evidence for Increased Functional Specialization in the Left Inferior Parietal Cortex

Arithmetic reasoning is arguably one of the most important cognitive skills a child must master. Here we examine neurodevelopmental changes in mental arithmetic. Subjects (ages 8-19 years) viewed arithmetic equations and were asked to judge whether the results were correct or incorrect. During two-operand addition or subtraction trials, for which accuracy was comparable across age, older subjects showed greater activation in the left parietal cortex, along the supramarginal gyrus and adjoining anterior intra-parietal sulcus as well as the left lateral occipital temporal cortex. These age-related changes were not associated with alterations in gray matter density, and provide novel evidence for increased functional maturation with age. By contrast, younger subjects showed greater activation in the prefrontal cortex, including the dorsolateral and ventrolateral prefrontal cortex and the anterior cingulate cortex, suggesting that they require comparatively more working memory and attentional resources to achieve similar levels of mental arithmetic performance. Younger subjects also showed greater activation of the hippocampus and dorsal basal ganglia, reflecting the greater demands placed on both declarative and procedural memory systems. Our findings provide evidence for a process of increased functional specialization of the left inferior parietal cortex in mental arithmetic, a process that is accompanied by decreased dependence on memory and attentional resources with development.

The roles of the “visual word form area” in reading

Activation of the left midfusiform gyrus in response to reading words and pseudowords is such a reliable finding in functional imaging that this region has been called "the visual word form area" (VWFA). However, this label has recently been challenged, because activation in VWFA is also observed in other lexical tasks. We evaluated whether VWFA is necessary, sufficient, or specialized for reading by examining how frequently acute lesions in VWFA disrupt tasks that require access to written word forms versus other lexical tasks. We administered lexical tasks with spoken and written input and output, and identified damage or dysfunction of VWFA and other regions of interest (ROI) on diffusion- and perfusion-weighted imaging (DWI and PWI) in 80 patients within 24 h of onset of acute left ischemic stroke. Associations between abnormalities in each region of interest and impairment on lexical tasks were evaluated with chi-squared tests. Damage or dysfunction of VWFA was not significantly associated with impairment of written word comprehension or lexical decision, but was significantly associated with impairment on all tasks requiring lexical output: oral reading and oral naming (visual or tactile input), and written naming. We account for these results and results from functional imaging by proposing that the left midfusiform gyrus normally has two roles in reading: (1) computation of location- and modality-independent grapheme sequences from written word stimuli, and (2) a modality-independent stage of lexical processing that links modality-specific input and output representations. VWFA is not necessary for the former because the right homologue of VWFA can immediately assume this role.

Anatomy and time course of discrimination and categorization processes in vision: an fMRI study

Studies investigating the cerebral areas involved in visual processes generally oppose either different tasks or different stimulus types. This work addresses, by fMRI, the interaction between the type of task (discrimination vs. categorization) and the type of stimulus (Latin letters, well-known geometrical figures, and Korean letters). Behavioral data revealed that the two tasks did not differ in term of percentage of errors or correct responses, but a delay of 185 ms was observed for the categorization task in comparison with the discrimination task. All conditions activated a common neural network that includes both striate and extrastriate areas, especially the fusiform gyri, the precunei, the insulae, and the dorsolateral frontal cortex. In addition, interaction analysis revealed that the right insula was sensitive to both tasks and stimuli, and that stimulus type induced several significant signal variations for the categorization task in right frontal cortex, the right middle occipital gyrus, the right cuneus, and the left and right fusiform gyri, whereas for the discrimination task, significant signal variations were observed in the right occipito-parietal junction only. Finally, analyzing the latency of the BOLD signal also revealed a differential neural dynamics according to tasks but not to stimulus type. These temporal differences suggest a parallel hemisphere processing in the discrimination task vs. a cooperative interhemisphere processing in the categorization task that may reflect the observed differences in reaction time.

Integration of Letters and Speech Sounds in the Human Brain

Most people acquire literacy skills with remarkable ease, even though the human brain is not evolutionarily adapted to this relatively new cultural phenomenon. Associations between letters and speech sounds form the basis of reading in alphabetic scripts. We investigated the functional neuroanatomy of the integration of letters and speech sounds using functional magnetic resonance imaging (fMRI). Letters and speech sounds were presented unimodally and bimodally in congruent or incongruent combinations. Analysis of single-subject data and group data aligned on the basis of individual cortical anatomy revealed that letters and speech sounds are integrated in heteromodal superior temporal cortex. Interestingly, responses to speech sounds in a modality-specific region of the early auditory cortex were modified by simultaneously presented letters. These results suggest that efficient processing of culturally defined associations between letters and speech sounds relies on neural mechanisms similar to those naturally evolved for integrating audiovisual speech.

Neural timing of visual implicit categorization

Most of the neuroimaging studies that have shown visual category-specific activations or categorization effects have been based on a subtractive approach. In the present study, we investigated, by means of EEG, not only the net result of the categorization but also the dynamics of the process. Subjects had to perform a target detection task throughout an image set of distractors belonging to six categories: letters, geometrical figures, faces, tools, structured textures and Asiatic characters. Multivariate analyses were performed on the responses to the non-target stimuli according to their category. Categorical neural responses were only obtained on P2 latencies and N2 amplitudes. This result suggests that there are no differences in the first stage of the implicit categorization of the distractors (visual analysis and proximal stimulus representation elaboration from 100 to 220 ms) and that differences appear between 220 and 280 ms (matching to structural representations). Over-learned stimuli (e.g. letters) elicited the shortest P2 latency, contrasting with unknown categories (e.g. Asiatic characters) that revealed the longest P2 latencies and flattened N2 waves. Categorical differences indicate that the more a subject knows about an object, the less cognitive resources are used. In conclusion, our results suggest that a reduction in neural activity could reflect an improved accuracy in cognitive and cortical processing.

Shared and dissociated cortical regions for object and letter processing

The present study determined the extent to which object and letter recognition recruit similar or dissociated neural resources. Participants passively viewed and silently named line drawings of objects, single letters, and visual noise patterns and centrally fixated an asterisk. We used whole-brain functional MRI and a very conservative approach to hypothesis testing that distinguished among brain regions that were selectively activated by different experimental conditions and those that were conjointly activated. The left fusiform gyrus (BA 19 & 37) and left inferior frontal cortex BA(44/6) showed a greater degree of conjoined activation for objects and letters than selective activation for either category, whereas left inferior parietal cortex (BA 40) and the left insula showed a strong letter-selective response. Equal recruitment of left fusiform and inferior frontal regions by objects and letters reflects similar demands on cognitive processing by these two categories and argues against category-specific modules in these regions. However, cortical systems for object and letter processing are not completely shared given the exclusive activation of left inferior parietal cortex by letters.

Automatic grapheme processing in the left occipitotemporal cortex

In a previous event-related fMRI study, we showed that the left occipitotemporal cortex was specifically involved in the abstract categorization of visually presented alphabetic symbols. Here, we duplicate the fMRI study by measuring visual event-related potentials to verify whether the left posterior cortex supports the processing of graphemic representations at a perceptual, prelexical level. N170 amplitudes elicited by the categorically ambiguous stimulus 'O' were about twice as small in the left as in the right occipitotemporal region, and comparable to that of other letters on the left, and to that of other geometric figures on the right. The side asymmetry suggests that a graphemic module is unilaterally implemented in the left hemisphere, where it automatically processes heteromorphic representations that do not depend on the physical characteristics of the signal, whereas the difference in amplitude suggests that this left graphemic module is in series with, precedes and does not transmit information to, or inhibits a general shape-analysis module.