The role of top-down task context in learning to perceive objects

Repetition Probability Effects for Chinese Characters and German Words in the Visual Word Form Area

The magnitude of repetition suppression (RS), measured by fMRI, is modulated by the probability of repetitions (P(rep)) for various sensory stimulus categories. It has been suggested that for visually presented simple letters this P(rep) effect depends on the prior practices of the participants with the stimuli. Here we tested further if previous experiences affect the neural mechanisms of RS, leading to the modulatory effects of stimulus P(rep), for more complex lexical stimuli as well. We measured the BOLD signal in the Visual Word Form Area (VWFA) of native Chinese and German participants and estimated the P(rep) effects for Chinese characters and German words. The results showed a significant P(rep) effect for stimuli of the mother tongue in both participant groups. Interestingly, Chinese participants, learning German as a second language, also showed a significant P(rep) modulation of RS for German words while the German participants who had no prior experiences with the Chinese characters showed no such effects. Our findings suggest that P(rep) effects on RS are manifest for visual word processing as well, but only for words of a language with which participants are highly familiar. These results support further the idea that predictive processes, estimated by P(rep) modulations of RS, require prior experiences.

Visual association learning induces global network reorganization

It has been proposed that visual learning is accomplished not only by neural plasticity in the visual cortex, but also by complex interactions between bottom-up and top-down processes that may induce global network reorganization. Here, we applied a multivariate analysis to functional connectivity (FC) patterns across the brain to investigate how visual association learning was achieved through large-scale network reorganization. Participants were trained to associate a set of artificial line-drawing objects with English letters. After three consecutive days of training, participants underwent a functional magnetic resonance imaging scan in which they were presented with the trained stimuli, untrained stimuli, and English words. By calculating pairwise FC between 189 nodes of 10 well-established networks across the brain, we found that the visual association learning induced changes in the global FC pattern when viewing the trained stimuli, rendering it more similar to the FC pattern when viewing English words. Critically, the learning-induced global FC pattern differences were mainly driven by the FC related to the high-level networks involved in attention and cognitive control, suggesting the modification of top-down processes during learning. In sum, our study provides one of the first evidence revealing global network reorganization induced by visual learning and sheds new light on the network mechanisms of top-down influences in learning.

Motor Learning Improves the Stability of Large-Scale Brain Connectivity Pattern

Repeated practice is fundamental to the acquisition of skills, which is typically accompanied by increasing reliability of neural representations that manifested as more stable activation patterns for the trained stimuli. However, large-scale neural pattern induced by learning has been rarely studied. Here, we investigated whether global connectivity patterns became more reliable as a result of motor learning using a novel analysis of the multivariate pattern of functional connectivity (MVPC). Human participants were trained with a finger-tapping motor task for five consecutive days and went through Functional magnetic resonance imaging (fMRI) scanning before and after training. We found that motor learning increased the whole-brain MVPC stability of the primary motor cortex (M1) when participants performed the trained sequence, while no similar effects were observed for the untrained sequence. Moreover, the increase of MVPC stability correlated with participants’ improvement in behavioral performance. These findings suggested that the acquisition of motor skills was supported by the increased connectivity pattern stability between the M1 and the rest of the brain. In summary, our study not only suggests global neural pattern stabilization as a neural signature for effective learning but also advocates applying the MVPC analysis to reveal mechanisms of distributed network reorganization supporting various types of learning.

Spatiotemporal dynamics of orthographic and lexical processing in the ventral visual pathway

Reading is a rapid, distributed process that engages multiple components of the ventral visual stream. To understand the neural constituents and their interactions that allow us to identify written words, we performed direct intra-cranial recordings in a large cohort of humans. This allowed us to isolate the spatiotemporal dynamics of visual word recognition across the entire left ventral occipitotemporal cortex. We found that mid-fusiform cortex is the first brain region sensitive to lexicality, preceding the traditional visual word form area. The magnitude and duration of its activation are driven by the statistics of natural language. Information regarding lexicality and word frequency propagates posteriorly from this region to visual word form regions and to earlier visual cortex, which, while active earlier, show sensitivity to words later. Further, direct electrical stimulation of this region results in reading arrest, further illustrating its crucial role in reading. This unique sensitivity of mid-fusiform cortex to sub-lexical and lexical characteristics points to its central role as the orthographic lexicon-the long-term memory representations of visual word forms.

Linguistic experience acquisition for novel stimuli selectively activates the neural network of the visual word form area

The human ventral visual cortex is functionally organized into different domains that sensitively respond to different categories, such as words and objects. There is heated debate over what principle constrains the locations of those domains. Taking the visual word form area (VWFA) as an example, we tested whether the word preference in this area originates from the bottom-up processes related to word shape (the shape hypothesis) or top-down connectivity of higher-order language regions (the connectivity hypothesis). We trained subjects to associate identical, meaningless, non-word-like figures with high-level features of either words or objects. We found that the word-feature learning for the figures elicited the neural activation change in the VWFA, and learning performance effectively predicted the activation strength of this area after learning. Word-learning effects were also observed in other language areas (i.e., the left posterior superior temporal gyrus, postcentral gyrus, and supplementary motor area), with increased functional connectivity between the VWFA and the language regions. In contrast, object-feature learning was not associated with obvious activation changes in the language regions. These results indicate that high-level language features of stimuli can modulate the activation of the VWFA, providing supportive evidence for the connectivity hypothesis of words processing in the ventral occipitotemporal cortex.

Extended categorization of conjunction object stimuli decreases the latency of attentional feature selection and recruits orthography-linked ERPs

The role of attention in driving perceptual expertise effects is controversial. The current study addressed the effect of training on ERP components related to and independent of attentional feature selection. Participants learned to categorize cartoon animals over six training sessions (8,800 trials) after which ERPs were recorded during a target detection task performed on trained and untrained stimulus sets. The onset of the selection negativity, an ERP component indexing attentional modulation, was about 60 msec earlier for trained than untrained stimuli. Trained stimuli also elicited centro-parietal N200 and N320 components that were insensitive to attentional feature selection. The scalp distribution and timecourse of these components were better matched by studies of orthography than object expertise. Source localization using eLORETA suggested that the strongest neural sources of the selection negativity were in right ventral temporal cortex whereas the strongest sources of the N200/N320 components were in left ventral temporal cortex, again consistent with the hypothesis that training recruited orthography related areas. Overall, training altered neural processes related to attentional selection, but also affected neural processes that were independent of feature selection.

A probabilistic atlas of the human motion complex built from large-scale functional localizer data

Accurate motion perception is critical to dealing with the changing dynamics of our visual world. A cluster known as the human MT+ complex (hMT+) has been identified as a core region involved in motion perception. Several atlases defined based on cytoarchitecture, retinotopy, connectivity, and multimodal features include homologs of the hMT+. However, an hMT+ atlas defined directly based on this region's response for motion is still lacking. Here, we identified the hMT+ based on motion responses from functional magnetic resonance imaging (fMRI) localizer data in 509 participants and then built a probabilistic atlas of the hMT+. As a result, four main findings were revealed. First, the hMT+ showed large interindividual variability across participants. Second, the atlases stabilized when the number of participants used to build the atlas was more than 100. Third, the functional hMT+ showed good agreement with the hMT+ atlases built based on cytoarchitecture, retinotopy, and connectivity, suggesting a good structural-functional correspondence. Fourth, tests on multiple fMRI data sets acquired from independent participants, imaging parameters and paradigms revealed that the functional hMT+ showed higher sensitivity than all other atlases in ROI analysis except that connectivity and multimodal hMT+ atlases in the left hemisphere could infrequently attain comparable sensitivity to the functional atlas. Taken together, our findings reveal the benefit of using large-scale functional localizer data to build a reliable and representative hMT+ atlas. Our atlas is freely available for download; it can be used to localize the hMT+ in individual participants when functional localizer data are not available.

Cross-task perceptual learning of object recognition in simulated retinal implant perception

The perception gained by retina implants (RI) is limited, which asks for a learning regime to improve patients' visual perception. Here we simulated RI vision and investigated if object recognition in RI patients can be improved and maintained through training. Importantly, we asked if the trained object recognition can be generalized to a new task context, and to new viewpoints of the trained objects. For this purpose, we adopted two training tasks, a labelling task where participants had to choose the correct label out of other distracting labels for the presented object, and a reverse labelling task where participants had to choose the correct object out of other distracting objects to match the presented label. Our results showed that, despite of the task order, recognition performance was improved in both tasks and lasted at least for a week. The improved object recognition, however, can be transferred only from the labelling task to the reverse labelling task but not vice versa. Additionally, the trained object recognition can be transferred to new viewpoints of the trained objects only in the labelling task but not in the reverse labelling task. Training with the labelling task is therefore recommended for RI patients to achieve persistent and flexible visual perception.

Modulating Effects of Contextual Emotions on the Neural Plasticity Induced by Word Learning

Recently, numerous studies have investigated the neurocognitive mechanism of learning words in isolation or in semantic contexts. However, emotion as an important influencing factor on novel word learning has not been fully considered in the previous studies. In addition, the effects of emotion on word learning and the underlying neural mechanism have not been systematically investigated. Sixteen participants were trained to learn novel concrete or abstract words under negative, neutral, and positive contextual emotions over 3 days; then, fMRI scanning was done during the testing sessions on day 1 and day 3. We compared the brain activations in day 1 and day 3 to investigate the role of contextual emotions in learning different types of words and the corresponding neural plasticity changes. Behaviorally, the performance of the words learned in the negative context was lower than those in the neutral and positive contexts, which indicated that contextual emotions had a significant impact on novel word learning. Correspondingly, the functional plasticity changes of the right angular gyrus (AG), bilateral insula, and anterior cingulate cortex (ACC) induced by word learning were modulated by the contextual emotions. The insula also was sensitive to the concreteness of the learned words. More importantly, the functional plasticity changes of the left inferior frontal gyrus (left IFG) and left fusiform gyrus (left FG) were interactively influenced by the contextual emotions and concreteness, suggesting that the contextual emotional information had a discriminable effect on different types of words in the neural mechanism level. These results demonstrate that emotional information in contexts is inevitably involved in word learning. The role of contextual emotions in brain plasticity for learning is discussed.

Quantifying the variability of scene-selective regions: Interindividual, interhemispheric, and sex differences

Scene-selective regions (SSRs), including the parahippocampal place area (PPA), retrosplenial cortex (RSC), and transverse occipital sulcus (TOS), are among the most widely characterized functional regions in the human brain. However, previous studies have mostly focused on the commonality within each SSR, providing little information on different aspects of their variability. In a large group of healthy adults (N = 202), we used functional magnetic resonance imaging to investigate different aspects of topographical and functional variability within SSRs, including interindividual, interhemispheric, and sex differences. First, the PPA, RSC, and TOS were delineated manually for each individual. We then demonstrated that SSRs showed substantial interindividual variability in both spatial topography and functional selectivity. We further identified consistent interhemispheric differences in the spatial topography of all three SSRs, but distinct interhemispheric differences in scene selectivity. Moreover, we found that all three SSRs showed stronger scene selectivity in men than in women. In summary, our work thoroughly characterized the interindividual, interhemispheric, and sex variability of the SSRs and invites future work on the origin and functional significance of these variabilities. Additionally, we constructed the first probabilistic atlases for the SSRs, which provide the detailed anatomical reference for further investigations of the scene network. Hum Brain Mapp 38:2260-2275, 2017. © 2017 Wiley Periodicals, Inc.

The informativity of sound modulates crossmodal facilitation of visual discrimination: a fMRI study

Many studies have investigated behavioral crossmodal facilitation when a visual stimulus is accompanied by a concurrent task-irrelevant sound. Lippert and colleagues reported that a concurrent task-irrelevant sound reduced the uncertainty of the timing of the visual display and improved perceptional responses (informative sound). However, the neural mechanism by which the informativity of sound affected crossmodal facilitation of visual discrimination remained unclear. In this study, we used event-related functional MRI to investigate the neural mechanisms underlying the role of informativity of sound in crossmodal facilitation of visual discrimination. Significantly faster reaction times were observed when there was an informative relationship between auditory and visual stimuli. The functional MRI results showed sound informativity-induced activation enhancement including the left fusiform gyrus and the right lateral occipital complex. Further correlation analysis showed that the right lateral occipital complex was significantly correlated with the behavioral benefit in reaction times. This suggests that this region was modulated by the informative relationship within audiovisual stimuli that was learnt during the experiment, resulting in late-stage multisensory integration and enhanced behavioral responses.

Word and object recognition during reading acquisition: MEG evidence

Studies on adults suggest that reading-induced brain changes might not be limited to linguistic processes. It is still unclear whether these results can be generalized to reading development. The present study shows to which extent neural responses to verbal and nonverbal stimuli are reorganized while children learn to read. MEG data of thirty Basque children (4-8y) were collected while they were presented with written words, spoken words and visual objects. The evoked fields elicited by the experimental stimuli were compared to their scrambled counterparts. Visual words elicited left posterior (200-300ms) and temporal activations (400-800ms). The size of these effects increased as reading performance improved, suggesting a reorganization of children's visual word responses. Spoken words elicited greater left temporal responses relative to scrambles (300-700ms). No evidence for the influence of reading expertise was observed. Brain responses to objects were greater than to scrambles in bilateral posterior regions (200-500ms). There was a greater left hemisphere involvement as reading errors decreased, suggesting a strengthened verbal decoding of visual configurations with reading acquisition. The present results reveal that learning to read not only influences written word processing, but also affects visual object recognition, suggesting a non-language specific impact of reading on children's neural mechanisms.

Quantifying interindividual variability and asymmetry of face-selective regions: a probabilistic functional atlas

Face-selective regions (FSRs) are among the most widely studied functional regions in the human brain. However, individual variability of the FSRs has not been well quantified. Here we use functional magnetic resonance imaging (fMRI) to localize the FSRs and quantify their spatial and functional variabilities in 202 healthy adults. The occipital face area (OFA), posterior and anterior fusiform face areas (pFFA and aFFA), posterior continuation of the superior temporal sulcus (pcSTS), and posterior and anterior STS (pSTS and aSTS) were delineated for each individual with a semi-automated procedure. A probabilistic atlas was constructed to characterize their interindividual variability, revealing that the FSRs were highly variable in location and extent across subjects. The variability of FSRs was further quantified on both functional (i.e., face selectivity) and spatial (i.e., volume, location of peak activation, and anatomical location) features. Considerable interindividual variability and rightward asymmetry were found in all FSRs on these features. Taken together, our work presents the first effort to characterize comprehensively the variability of FSRs in a large sample of healthy subjects, and invites future work on the origin of the variability and its relation to individual differences in behavioral performance. Moreover, the probabilistic functional atlas will provide an adequate spatial reference for mapping the face network.

Similar ventral occipito-temporal cortex activations in literate and illiterate adults during the Chinese character matching task: an fMRI study

Visual word expertise is typically associated with enhanced ventral occipito-temporal (vOT) cortex activation in response to written words. Previous study utilized a passive viewing task and found that vOT response to written words was significantly stronger in literate compared to the illiterate subjects. However, recent neuroimaging findings have suggested that vOT response properties are highly dependent upon the task demand. Thus, it is unknown whether literate adults would show stronger vOT response to written words compared to illiterate adults during other cognitive tasks, such as perceptual matching. We addressed this issue by comparing vOT activations between literate and illiterate adults during a Chinese character and simple figure matching task. Unlike passive viewing, a perceptual matching task requires active shape comparison, therefore minimizing automatic word processing bias. We found that although the literate group performed better at Chinese character matching task, the two subject groups showed similar strong vOT responses during this task. Overall, the findings indicate that the vOT response to written words is not affected by expertise during a perceptual matching task, suggesting that the association between visual word expertise and vOT response may depend on the task demand.

Spatiotopic perceptual learning mediated by retinotopic processing and attentional remapping

Visual processing takes place in both retinotopic and spatiotopic frames of reference. Whereas visual perceptual learning is usually specific to the trained retinotopic location, our recent study has shown spatiotopic specificity of learning in motion direction discrimination. To explore the mechanisms underlying spatiotopic processing and learning, and to examine whether similar mechanisms also exist in visual form processing, we trained human subjects to discriminate an orientation difference between two successively displayed stimuli, with a gaze shift in between to manipulate their positional relation in the spatiotopic frame of reference without changing their retinal locations. Training resulted in better orientation discriminability for the trained than for the untrained spatial relation of the two stimuli. This learning-induced spatiotopic preference was seen only at the trained retinal location and orientation, suggesting experience-dependent spatiotopic form processing directly based on a retinotopic map. Moreover, a similar but weaker learning-induced spatiotopic preference was still present even if the first stimulus was rendered irrelevant to the orientation discrimination task by having the subjects judge the orientation of the second stimulus relative to its mean orientation in a block of trials. However, if the first stimulus was absent, and thus no attention was captured before the gaze shift, the learning produced no significant spatiotopic preference, suggesting an important role of attentional remapping in spatiotopic processing and learning. Taken together, our results suggest that spatiotopic visual representation can be mediated by interactions between retinotopic processing and attentional remapping, and can be modified by perceptual training.

Failure in developing high-level visual functions after occipitoparietal lesions at an early age: a case study

Previous functional magnetic resonance imaging (fMRI) studies have identified several regions in the ventral visual pathway that are specialized for processing faces, words and general objects. However, little is known about the origin of the functional selectivity of these regions. Here, we reported a pediatric patient who suffered a left occipitoparietal lesion in the first year after birth from a subdural hematoma. After the hematoma was removed at the age of six, the hemianopia in the right visual field was alleviated, and no obvious deficits in low-level vision were observed in the patient at the age of twelve. In line with the behavioral observations, meridian mappings with fMRI showed that the early visual cortex of the left hemisphere was significantly activated, which was similar to that of the intact right hemisphere. However, the left ventral temporal cortex failed to show selective responses for faces, words and objects, which were in contrast to the normal selective responses for these objects in the right counterpart. Therefore, it is likely that the development of object selectivity in the ventral temporal cortex depends on visual inputs from the early visual cortex at an early age.

Representation of contextually related multiple objects in the human ventral visual pathway

Real-world scenes usually contain a set of cluttered and yet contextually related objects. Here we used fMRI to investigate where and how contextually related multiple objects were represented in the human ventral visual pathway. Specifically, we measured the responses in face-selective and body-selective regions along the ventral pathway when faces and bodies were presented either simultaneously or in isolation. We found that, in the posterior regions, the response for the face and body pair was the weighted average response for faces and bodies presented in isolation. In contrast, the anterior regions encoded the face and body pair in a mutually facilitative fashion, with the response for the pair significantly higher than that for its constituent objects. Furthermore, in the right fusiform face area, the face and body pair was represented as one inseparable object, possibly to reduce perceptual load and increase representation efficiency. Therefore, our study suggests that the visual system uses a hierarchical representation scheme to process multiple objects in natural scenes: the average mechanism in posterior regions helps retaining information of individual objects in clutter, whereas the nonaverage mechanism in the anterior regions uses the contextual information to optimize the representation for multiple objects.

Motor training increases the stability of activation patterns in the primary motor cortex

Learning to be skillful is an endowed talent of humans, but neural mechanisms underlying behavioral improvement remain largely unknown. Some studies have reported that the mean magnitude of neural activation is increased after learning, whereas others have instead shown decreased activation. In this study, we used functional magnetic resonance imaging (fMRI) to investigate learning-induced changes in the neural activation in the human brain with a classic motor training task. Specifically, instead of comparing the mean magnitudes of activation before and after training, we analyzed the learning-induced changes in multi-voxel spatial patterns of neural activation. We observed that the stability of the activation patterns, or the similarity of the activation patterns between the even and odd runs of the fMRI scans, was significantly increased in the primary motor cortex (M1) after training. By contrast, the mean magnitude of neural activation remained unchanged. Therefore, our study suggests that learning shapes the brain by increasing the stability of the activation patterns, therefore providing a new perspective in understanding the neural mechanisms underlying learning.

Top-down processing of symbolic meanings modulates the visual word form area

Functional magnetic resonance imaging (fMRI) studies on humans have identified a region in the left middle fusiform gyrus consistently activated by written words. This region is called the visual word form area (VWFA). Recently, a hypothesis, called the interactive account, is proposed that to effectively analyze the bottom-up visual properties of words, the VWFA receives predictive feedback from higher-order regions engaged in processing sounds, meanings, or actions associated with words. Further, this top-down influence on the VWFA is independent of stimulus formats. To test this hypothesis, we used fMRI to examine whether a symbolic nonword object (e.g., the Eiffel Tower) intended to represent something other than itself (i.e., Paris) could activate the VWFA. We found that scenes associated with symbolic meanings elicited a higher VWFA response than those not associated with symbolic meanings, and such top-down modulation on the VWFA can be established through short-term associative learning, even across modalities. In addition, the magnitude of the symbolic effect observed in the VWFA was positively correlated with the subjective experience on the strength of symbol-referent association across individuals. Therefore, the VWFA is likely a neural substrate for the interaction of the top-down processing of symbolic meanings with the analysis of bottom-up visual properties of sensory inputs, making the VWFA the location where the symbolic meaning of both words and nonword objects is represented.

Smaller holistic processing of faces associated with face drawing experience

The type of experience involved with an object category has been regarded as one important factor in shaping of the human object recognition system. Laboratory training studies have shown that different kinds of learning experience with the same set of novel objects resulted in different perceptual and neural changes. Whether this applies to natural real-world objects remains to be seen. We compared two groups of observers who had different learning experiences with faces, using holistic processing as a dependent measure. We found that, while ordinary observers had extensive individuation experience with faces and displayed typical holistic face processing, art students who had acquired additional experience in drawing faces, and thus in attending to parts of a face, showed less holistic processing than did ordinary observers. These results converge with laboratory training studies on the role of type of experience in the development of different perceptual markers for different object categories. It is thus insufficient to categorize expertise simply in terms of object domains (e.g., expertise with faces). Instead, perceptual expertise should be classified in terms of the underlying process or task demand.

Unfolding visual lexical decision in time

Visual lexical decision is a classical paradigm in psycholinguistics, and numerous studies have assessed the so-called "lexicality effect" (i.e., better performance with lexical than non-lexical stimuli). Far less is known about the dynamics of choice, because many studies measured overall reaction times, which are not informative about underlying processes. To unfold visual lexical decision in (over) time, we measured participants' hand movements toward one of two item alternatives by recording the streaming x,y coordinates of the computer mouse. Participants categorized four kinds of stimuli as "lexical" or "non-lexical:" high and low frequency words, pseudowords, and letter strings. Spatial attraction toward the opposite category was present for low frequency words and pseudowords. Increasing the ambiguity of the stimuli led to greater movement complexity and trajectory attraction to competitors, whereas no such effect was present for high frequency words and letter strings. Results fit well with dynamic models of perceptual decision-making, which describe the process as a competition between alternatives guided by the continuous accumulation of evidence. More broadly, our results point to a key role of statistical decision theory in studying linguistic processing in terms of dynamic and non-modular mechanisms.

The nature of experience determines object representations in the visual system

Visual perceptual learning (PL) and perceptual expertise (PE) traditionally lead to different training effects and recruit different brain areas, but reasons for these differences are largely unknown. Here, we tested how the learning history influences visual object representations. Two groups were trained with tasks typically used in PL or PE studies, with the same novel objects, training duration and parafoveal stimulus presentation. We observed qualitatively different changes in the cortical representations of these objects following PL and PE training, replicating typical training effects in each field. These effects were also modulated by testing tasks, suggesting that experience interacts with attentional set and that the choice of testing tasks critically determines the pattern of training effects one can observe after a short-term visual training. Experience appears sufficient to account for prior differences in the neural locus of learning between PL and PE. The nature of the experience with an object's category can determine its representation in the visual system.

Task by stimulus interactions in brain responses during Chinese character processing

In the visual word recognition literature, it is well understood that various stimulus effects interact with behavioral task. For example, effects of word frequency are exaggerated and effects of spelling-to-sound regularity are reduced in the lexical decision task, relative to reading aloud. Neuroimaging studies of reading often examine effects of task and stimulus properties on brain activity independently, but potential interactions between task demands and stimulus effects have not been extensively explored. To address this issue, we conducted lexical decision and symbol detection tasks using stimuli that varied parametrically in their word-likeness, and tested for task by stimulus class interactions. Interactions were found throughout the reading system, such that stimulus selectivity was observed during the lexical decision task, but not during the symbol detection task. Further, the pattern of stimulus selectivity was directly related to task difficulty, so that the strongest brain activity was observed to the most word-like stimuli that required "no" responses, whereas brain activity to words, which elicit rapid and accurate "yes" responses were relatively weak. This is in line with models that argue for task-dependent specialization of brain regions, and contrasts with the notion of task-independent stimulus selectivity in the reading system.

The interactive account of ventral occipitotemporal contributions to reading

The ventral occipitotemporal cortex (vOT) is involved in the perception of visually presented objects and written words. The Interactive Account of vOT function is based on the premise that perception involves the synthesis of bottom-up sensory input with top-down predictions that are generated automatically from prior experience. We propose that vOT integrates visuospatial features abstracted from sensory inputs with higher level associations such as speech sounds, actions and meanings. In this context, specialization for orthography emerges from regional interactions without assuming that vOT is selectively tuned to orthographic features. We discuss how the Interactive Account explains left vOT responses during normal reading and developmental dyslexia; and how it accounts for the behavioural consequences of left vOT damage.

The unique role of the visual word form area in reading

Reading systematically activates the left lateral occipitotemporal sulcus, at a site known as the visual word form area (VWFA). This site is reproducible across individuals/scripts, attuned to reading-specific processes, and partially selective for written strings relative to other categories such as line drawings. Lesions affecting the VWFA cause pure alexia, a selective deficit in word recognition. These findings must be reconciled with the fact that human genome evolution cannot have been influenced by such a recent and culturally variable activity as reading. Capitalizing on recent functional magnetic resonance imaging experiments, we provide strong corroborating evidence for the hypothesis that reading acquisition partially recycles a cortical territory evolved for object and face recognition, the prior properties of which influenced the form of writing systems.

The interactive account of ventral occipitotemporal contributions to reading

The ventral occipitotemporal cortex (vOT) is involved in the perception of visually presented objects and written words. The Interactive Account of vOT function is based on the premise that perception involves the synthesis of bottom-up sensory input with top-down predictions that are generated automatically from prior experience. We propose that vOT integrates visuospatial features abstracted from sensory inputs with higher level associations such as speech sounds, actions and meanings. In this context, specialization for orthography emerges from regional interactions without assuming that vOT is selectively tuned to orthographic features. We discuss how the Interactive Account explains left vOT responses during normal reading and developmental dyslexia; and how it accounts for the behavioural consequences of left vOT damage.

Interference in character processing reflects common perceptual expertise across writing systems

Perceptual expertise, even within the visual domain, can take many forms, depending on the goals of the practiced task and the visual information available to support performance. Given the same goals, expertise for different categories can recruit common perceptual resources, which could lead to interference during concurrent processing. We measured whether irrelevant characters of one writing system produce interference during visual search for characters of another writing system, as a function of expertise. Chinese-English bilinguals and English readers searched for target Roman letters among other distractors in a rapid serial visual presentation (RSVP) sequence. Chinese character distractors interfered with Roman letter search more than pseudoletter distractors, only for bilingual readers, suggesting a common perceptual bottleneck for Roman and Chinese processing in experts with both domains. We ruled out an explanation at the level of phonetic codes, by showing that concurrent verbal rehearsal has no effect on the magnitude of such interference. These findings converge with results showing competition between faces and cars in car experts to suggest that different domains of expertise that overlap in their cortical representations also possess a common perceptual bottleneck.