Writing letters in two graphic systems: Behavioral and neural correlates in Latin-Arabic biscripters

Biscriptuality is the ability to read and write using two scripts. Despite the increasing number of biscripters, this phenomenon remains poorly understood. Here, we focused on investigating graphomotor processing in French-Arabic biscripters. We chose the French and Arabic alphabets because they have comparable visuospatial complexity and linguistic features, but differ dramatically in their graphomotor characteristics. In a first experiment we describe the graphomotor features of the two alphabets and showed that while Arabic and Latin letters are produced with the same velocity and fluency, Arabic letters require more pen lifts, contain more right-to-left strokes and clockwise curves, and take longer to write than Latin letters. These results suggest that Arabic and Latin letters are produced via different motor patterns. In a second experiment we used functional magnetic resonance imaging to ask whether writing the two scripts relies upon partially distinct or fully overlapping neural networks, and whether the elements of the previously described handwriting network are recruited to the same extent by the two scripts. We found that both scripts engaged the so-called "writing network", but that within the network, Arabic letters recruited the left superior parietal lobule (SPL) and the left primary motor cortex (M1) more strongly than Latin letters. Both regions have previously been identified as holding scale-invariant representations of letter trajectories. Arabic and Latin letters also activated distinct regions that do not belong to the writing network. Complementary analyses indicate that the differences observed between scripts at the neural level could be driven by the specific graphomotor features of each script. Overall, our results indicate that particular features of the practiced scripts can lead to different motor organization at both the behavioral and brain levels in biscripters.

Repetition Probability Effects for Chinese Characters and German Words in the Visual Word Form Area

The magnitude of repetition suppression (RS), measured by fMRI, is modulated by the probability of repetitions (P(rep)) for various sensory stimulus categories. It has been suggested that for visually presented simple letters this P(rep) effect depends on the prior practices of the participants with the stimuli. Here we tested further if previous experiences affect the neural mechanisms of RS, leading to the modulatory effects of stimulus P(rep), for more complex lexical stimuli as well. We measured the BOLD signal in the Visual Word Form Area (VWFA) of native Chinese and German participants and estimated the P(rep) effects for Chinese characters and German words. The results showed a significant P(rep) effect for stimuli of the mother tongue in both participant groups. Interestingly, Chinese participants, learning German as a second language, also showed a significant P(rep) modulation of RS for German words while the German participants who had no prior experiences with the Chinese characters showed no such effects. Our findings suggest that P(rep) effects on RS are manifest for visual word processing as well, but only for words of a language with which participants are highly familiar. These results support further the idea that predictive processes, estimated by P(rep) modulations of RS, require prior experiences.

Acquired dyslexias following temporal lesions

The acquisition of reading by children is supported by deep changes in the brain systems devoted to vision and language. The left temporal lobe contributes critically to both systems, and lesions affecting it may therefore cause both peripheral vision-related and central language-related reading impairments. The diversity of peripheral dyslexias reflects the anatomical and functional division of the visual cortex into early visual regions, whose lesions have a limited impact on reading; ventral regions, whose lesions are mostly associated to Pure Alexia; and dorsal regions, whose lesions may yield spatial, neglect-related, and attentional dyslexias. Similarly, central alexias reflect the broad distinction, within language processes, between phonological and lexico-semantic components. Phonological and surface dyslexias roughly result from impairment of the former and the latter processes, respectively, while deep dyslexia may be seen as the association of both. In this chapter, we review such types of acquired dyslexias, their clinical features, pathophysiology, and anatomical correlates.

Words as Visual Objects: Neural and Behavioral Evidence for High-Level Visual Impairments in Dyslexia

Developmental dyslexia is defined by reading impairments that are disproportionate to intelligence, motivation, and the educational opportunities considered necessary for reading. Its cause has traditionally been considered to be a phonological deficit, where people have difficulties with differentiating the sounds of spoken language. However, reading is a multidimensional skill and relies on various cognitive abilities. These may include high-level vision—the processes that support visual recognition despite innumerable image variations, such as in viewpoint, position, or size. According to our high-level visual dysfunction hypothesis, reading problems of some people with dyslexia can be a salient manifestation of a more general deficit of high-level vision. This paper provides a perspective on how such non-phonological impairments could, in some cases, cause dyslexia. To argue in favor of this hypothesis, we will discuss work on functional neuroimaging, structural imaging, electrophysiology, and behavior that provides evidence for a link between high-level visual impairment and dyslexia.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Hemispheric Organization for Visual Object Recognition: A Theoretical Account and Empirical Evidence

Despite the similarity in structure, the hemispheres of the human brain have somewhat different functions. A traditional view of hemispheric organization asserts that there are independent and largely lateralized domain-specific regions in ventral occipitotemporal (VOTC), specialized for the recognition of distinct classes of objects. Here, we offer an alternative account of the organization of the hemispheres, with a specific focus on face and word recognition. This alternative account relies on three computational principles: distributed representations and knowledge, cooperation and competition between representations, and topography and proximity. The crux is that visual recognition results from a network of regions with graded functional specialization that is distributed across both hemispheres. Specifically, the claim is that face recognition, which is acquired relatively early in life, is processed by VOTC regions in both hemispheres. Once literacy is acquired, word recognition, which is co-lateralized with language areas, primarily engages the left VOTC and, consequently, face recognition is primarily, albeit not exclusively, mediated by the right VOTC. We review psychological and neural evidence from a range of studies conducted with normal and brain-damaged adults and children and consider findings which challenge this account. Last, we offer suggestions for future investigations whose findings may further refine this account.

Neural Responses of the Anterior Ventral Occipitotemporal Cortex in Developmental Dyslexia: Beyond the Visual Word Form Area

Purpose

For the past 2 decades, neuroimaging studies in dyslexia have pointed toward a hypoactivation of the ventral occipitotemporal cortex (VOTC), a region that has been closely associated to reading through the extraction of a representation of words which is invariant to position, size, font or case. However, most of the studies are confined to the visual word form area (VWFA), while recent studies have demonstrated a posterior-to-anterior gradient of print specificity along the VOTC. In our study, the whole VOTC, partitioned into three main patches of cortex, is assessed in dyslexic and control adults.

Methods

A total of 30 participants were included in this study (14 developmental dyslexics and 16 age- and education-matched controls). The design consisted of alternately viewed blocks of stimuli from a given class (words, consonant strings, phase-scrambled words, phase-scrambled consonant strings, small checkerboards, large checkerboards). The analyzed contrast was print stimuli (words and consonants) versus scrambled stimuli and checkerboards.

Results

Corroborating previous findings, our results showed underactivation to print stimuli in the VWFA of dyslexics. Additionally, differences between dyslexics and controls were also found, particularly in an area of the anterior partition of the VOTC, suggesting a relevant role of this area in word processing.

Conclusions

In sum, our study goes beyond the underactivation hypothesis in the VWFA of dyslexics and indicates that a particular area on the anterior fusiform region might be particularly involved in the reading deficits in dyslexia, demonstrating the involvement of multiple areas within VOTC in reading processes.

An Analysis of the Brain Systems Involved with Producing Letters by Hand

Complex visual-motor behaviors dominate human-environment interactions. Letter production, writing individual letters by hand, is an example of a complex visual-motor behavior composed of numerous behavioral components, including the required motor movements and the percepts that those motor movements create. By manipulating and isolating components of letter production, we provide experimental evidence that this complex visual-motor behavior is supported by a widespread neural system that is composed of smaller subsystems related to different sensorimotor components. Adult participants hand-printed letters with and without "ink" on an MR-safe digital writing tablet, perceived static and dynamic representations of their own handwritten letters, and perceived typeface letters during fMRI scanning. Our results can be summarized by three main findings: (1) Frontoparietal systems were associated with the motor component of letter production, whereas temporo-parietal systems were more associated with the visual component. (2) The more anterior regions of the left intraparietal sulcus were more associated with the motor component, whereas the more posterior regions were more associated with the visual component, with an area of visual-motor overlap in the posterior intraparietal sulcus. (3) The left posterior intraparietal sulcus and right fusiform gyrus responded similarly to both visual and motor components, and both regions also responded more during the perception of one's own handwritten letters compared with perceiving typed letters. These findings suggest that the neural systems recruited during complex visual-motor behaviors are composed of a set of interrelated sensorimotor subsystems that support the full behavior in different ways and, furthermore, that some of these subsystems can be rerecruited during passive perception in the absence of the full visual-motor behavior.

Chinese Handwriting Identification Method Based on Keyword Extraction

Text-independent handwriting identification methods require that features such as texture are extracted from lengthy document image; while text-dependent handwriting identification methods require that the contents of the documents being compared are identical. In order to overcome these confinements, this paper presents a novel Chinese handwriting identification technique. First, Chinese characters are segmented from handwriting document, then keywords are extracted based on matching and voting of local features of character. Then the same-content keywords are used to build training sets, and these training sets of two documents are compared. Because the keywords are similar to signature, the handwriting identification problem is transformed into signature verification problem. Experiments on HIT-MW, HIT-SW and CASIA show this method outperforms many text-independent handwriting identification methods.

The relationship between visual word and face processing lateralization in the fusiform gyri: A cross-sectional study

Visual words and faces activate similar networks but with complementary hemispheric asymmetries, faces being lateralized to the right and words to the left. A recent theory proposes that this reflects developmental competition between visual word and face processing. We investigated whether this results in an inverse correlation between the degree of lateralization of visual word and face activation in the fusiform gyri. 26 literate right-handed healthy adults underwent functional MRI with face and word localizers. We derived lateralization indices for cluster size and peak responses for word and face activity in left and right fusiform gyri, and correlated these across subjects. A secondary analysis examined all face- and word-selective voxels in the inferior occipitotemporal cortex. No negative correlations were found. There were positive correlations for the peak MR response between word and face activity within the left hemisphere, and between word activity in the left visual word form area and face activity in the right fusiform face area. The face lateralization index was positively rather than negatively correlated with the word index. In summary, we do not find a complementary relationship between visual word and face lateralization across subjects. The significance of the positive correlations is unclear: some may reflect the influences of general factors such as attention, but others may point to other factors that influence lateralization of function.

Word and text processing in acquired prosopagnosia

OBJECTIVE

A novel hypothesis of object recognition asserts that multiple regions are engaged in processing an object type, and that cerebral regions participate in processing multiple types of objects. In particular, for high-level expert processing, it proposes shared rather than dedicated resources for word and face perception, and predicts that prosopagnosic subjects would have minor deficits in visual word processing, and alexic subjects would have subtle impairments in face perception. In this study, we evaluated whether prosopagnosic subjects had deficits in processing either the word content or the style of visual text.

METHODS

Eleven prosopagnosic subjects, 6 with unilateral right lesions and 5 with bilateral lesions, participated. In the first study, we evaluated their word length effect in reading single words. In the second study, we assessed their time and accuracy for sorting text by word content independent of style, and for sorting text by handwriting or font style independent of word content.

RESULTS

Only subjects with bilateral lesions showed mildly elevated word length effects. Subjects were not slowed in sorting text by word content, but were nearly uniformly impaired in accuracy for sorting text by style.

INTERPRETATION

Our results show that prosopagnosic subjects are impaired not only in face recognition but also in perceiving stylistic aspects of text. This supports a modified version of the many-to-many hypothesis that incorporates hemispheric specialization for processing different aspects of visual text.

The similarity structure of distributed neural responses reveals the multiple representations of letters

Most cognitive theories of reading and spelling posit modality-specific representations of letter shapes, spoken letter names, and motor plans as well as abstract, amodal letter representations that serve to unify the various modality-specific formats. However, fundamental questions remain regarding the very existence of abstract letter representations, the neuro-topography of the different types of letter representations, and the degree of cortical selectivity for orthographic information. We directly test quantitative models of the similarity/dissimilarity structure of distributed neural representations of letters using Multivariate Pattern Analysis-Representational Similarity Analysis (MVPA-RSA) searchlight methods to analyze the BOLD response recorded from single letter viewing. These analyses reveal a left hemisphere ventral temporal region selectively tuned to abstract letter representations as well as substrates tuned to modality-specific (visual, phonological and motoric) representations of letters. The approaches applied in this research address various shortcomings of previous studies that have investigated these questions and, therefore, the findings we report serve to advance our understanding of the nature and format of the representations that occur within the various sub-regions of the large-scale networks used in reading and spelling.

Alternating zones selective to faces and written words in the human ventral occipitotemporal cortex

Recognition of faces and written words is associated with category-specific brain activation in the ventral occipitotemporal cortex (vOT). However, topological and functional relationships between face-selective and word-selective vOT regions remain unclear. In this study, we collected data from patients with intractable epilepsy who underwent high-density recording of surface field potentials in the vOT. "Faces" and "letterstrings" induced outstanding category-selective responses among the 24 visual categories tested, particularly in high-γ band powers. Strikingly, within-hemispheric analysis revealed alternation of face-selective and letterstring-selective zones within the vOT. Two distinct face-selective zones located anterior and posterior portions of the mid-fusiform sulcus whereas letterstring-selective zones alternated between and outside of these 2 face-selective zones. Further, a classification analysis indicated that activity patterns of these zones mostly represent dedicated categories. Functional connectivity analysis using Granger causality indicated asymmetrically directed causal influences from face-selective to letterstring-selective regions. These results challenge the prevailing view that different categories are represented in distinct contiguous regions in the vOT.

Brain activation patterns resulting from learning letter forms through active self-production and passive observation in young children

Although previous literature suggests that writing practice facilitates neural specialization for letters, it is unclear if this facilitation is driven by the perceptual feedback from the act of writing or the actual execution of the motor act. The present study addresses this issue by measuring the change in BOLD signal in response to hand-printed letters, unlearned cursive letters, and cursive letters that 7-year-old children learned actively, by writing, and passively, by observing an experimenter write. Brain activation was assessed using fMRI while perceiving letters-in both cursive and manuscript forms. Results showed that active training led to increased recruitment of the sensori-motor network associated with letter perception as well as the insula and claustrum, but passive observation did not. This suggests that perceptual networks for newly learned cursive letters are driven by motor execution rather than by perceptual feedback.

The visual representations of words and style in text: an adaptation study

While the nature of face representations in the human perceptual system has been extensively studied using adaptation, there has been little investigation using this technique of the neural basis of another parallel class of high-level objects, words. We used the perceptual-bias technique to determine if aftereffects could be generated for either the word content or stylistic properties of textual stimuli, and if these aftereffects showed invariance for the non-adapted dimension. In a first experiment, we examined adaptation for word versus handwriting style. In a second experiment we contrasted adaptation for words with adaptation for computer font. The third experiment performed a similar study of aftereffects for words and case. In all three experiments we consistently found adaptation for words, which were not diminished by changing the style between the adapting and probe stimuli: hence word aftereffects are invariant for handwriting, font and case. Aftereffects were negligible for style. Additional analyses showed that discriminative ability was better for word than for style content. These results confirm that the neural representations of words can be probed with the adaptation technique and suggest that adaptation accesses word representations at an abstract level, where the identity of a word is invariant for stylistic properties.

A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading

The anatomy of language has been investigated with PET or fMRI for more than 20 years. Here I attempt to provide an overview of the brain areas associated with heard speech, speech production and reading. The conclusions of many hundreds of studies were considered, grouped according to the type of processing, and reported in the order that they were published. Many findings have been replicated time and time again leading to some consistent and undisputable conclusions. These are summarised in an anatomical model that indicates the location of the language areas and the most consistent functions that have been assigned to them. The implications for cognitive models of language processing are also considered. In particular, a distinction can be made between processes that are localized to specific structures (e.g. sensory and motor processing) and processes where specialisation arises in the distributed pattern of activation over many different areas that each participate in multiple functions. For example, phonological processing of heard speech is supported by the functional integration of auditory processing and articulation; and orthographic processing is supported by the functional integration of visual processing, articulation and semantics. Future studies will undoubtedly be able to improve the spatial precision with which functional regions can be dissociated but the greatest challenge will be to understand how different brain regions interact with one another in their attempts to comprehend and produce language.

Writing's shadow: corticospinal activation during letter observation

We can recognize handwritten letters despite the variability among writers. One possible strategy is exploiting the motor memory of orthography. By using TMS, we clarified the excitatory and inhibitory neural circuits of the motor corticospinal pathway that might be activated during the observation of handwritten letters. During experiments, participants looked at the handwritten or printed single letter that appeared in a random order. The excitability of the left and right primary motor cortex (M1) was evaluated by motor-evoked potentials elicited by single-pulse TMS. Short interval intracortical inhibition (SICI) of the left M1 was evaluated using paired-pulse TMS. F waves were measured for the right ulnar nerve. We found significant reduction of corticospinal excitability only for the right hand at 300-400 msec after each letter presentation without significant changes in SICI. This suppression is likely to be of supraspinal origin, because of no significant alteration in F-wave amplitudes. These findings suggest that the recognition of handwritten letters may include the implicit knowledge of "writing" in M1. The M1 activation associated with that process, which has been shown in previous neuroimaging studies, is likely to reflect the active suppression of the corticospinal excitability.

Repetition priming and repetition suppression: Multiple mechanisms in need of testing

In our Discussion Paper, we reviewed four theoretical proposals that have the potential to link the neural and behavioral phenomena of Repetition Suppression and Repetition Priming. We argued that among these proposals, the Synchrony and Bayesian Explaining Away models appear to be the most promising in addressing existing data, and we articulated a series of predictions to distinguish between them. The commentaries have helped to clarify some of these predictions, have highlighted additional evidence supporting the Facilitation and Sharpening models, and have emphasized dissociations by repetition lag and brain location. Our reply addresses these issues in turn, and we argue that progress will require the testing of Repetition Suppression, changes in neural tuning, and changes in synchronization throughout the brain and over a variety of lags and task contexts.

What differs in visual recognition of handwritten vs. printed letters? An fMRI study

In models of letter recognition, handwritten letters are considered as a particular font exemplar, not qualitatively different in their processing from printed letters. Yet, some data suggest that recognizing handwritten letters might rely on distinct processes, possibly related to motor knowledge. We applied functional magnetic resonance imaging to compare the neural correlates of perceiving handwritten letters vs. standard printed letters. Statistical analysis circumscribed to frontal brain regions involved in hand-movement triggering and execution showed that processing of handwritten letters is supported by a stronger activation of the left primary motor cortex and the supplementary motor area. At the whole-brain level, additional differences between handwritten and printed letters were observed in the right superior frontal, middle occipital, and parahippocampal gyri, and in the left inferior precentral and the fusiform gyri. The results are suggested to indicate embodiment of the visual perception of handwritten letters.

Facilitating memory for novel characters by reducing neural repetition suppression in the left fusiform cortex

Background

The left midfusiform and adjacent regions have been implicated in processing and memorizing familiar words, yet its role in memorizing novel characters has not been well understood.

Methodology/Principal Findings

Using functional MRI, the present study examined the hypothesis that the left midfusiform is also involved in memorizing novel characters and spaced learning could enhance the memory by enhancing the left midfusiform activity during learning. Nineteen native Chinese readers were scanned while memorizing the visual form of 120 Korean characters that were novel to the subjects. Each character was repeated four times during learning. Repetition suppression was manipulated by using two different repetition schedules: massed learning and spaced learning, pseudo-randomly mixed within the same scanning session. Under the massed learning condition, the four repetitions were consecutive (with a jittered inter-repetition interval to improve the design efficiency). Under the spaced learning condition, the four repetitions were interleaved with a minimal inter-repetition lag of 6 stimuli. Spaced learning significantly improved participants' performance during the recognition memory test administered one hour after the scan. Stronger left midfusiform and inferior temporal gyrus activities during learning (summed across four repetitions) were associated with better memory of the characters, based on both within- and cross-subjects analyses. Compared to massed learning, spaced learning significantly reduced neural repetition suppression and increased the overall activities in these regions, which were associated with better memory for novel characters.

Conclusions/Significance

These results demonstrated a strong link between cortical activity in the left midfusiform and memory for novel characters, and thus challenge the visual word form area (VWFA) hypothesis. Our results also shed light on the neural mechanisms of the spacing effect in memorizing novel characters.

Reading words, seeing style: the neuropsychology of word, font and handwriting perception

The reading of text is predominantly a left hemisphere function. However, it is also possible to process text for attributes other than word or letter identity, such as style of font or handwriting. Anecdotal observations have suggested that processing the latter may involve the right hemisphere. We devised a test that, using the identical stimuli, required subjects first to match on the basis of word identity and second to match on the basis of script style. We presented two versions, one using various computer fonts, and the other using the handwriting of different individuals. We tested four subjects with unilateral lesions who had been well characterized by neuropsychological testing and structural and/or functional MRI. We found that two prosopagnosic subjects with right lateral fusiform damage eliminating the fusiform face area and likely the right visual word form area were impaired in completion times and/or accuracy when sorting for script style, but performed better when sorting for word identity. In contrast, one alexic subject with left fusiform damage showed normal accuracy for sorting by script style and normal or mildly elevated completion times for sorting by style, but markedly prolonged reading times for sorting by word identity. A prosopagnosic subject with right medial occipitotemporal damage sparing areas in the lateral fusiform gyrus performed well on both tasks. The contrast in the performance of patients with right versus left fusiform damage suggests an important distinction in hemispheric processing that reflects not the type of stimulus but the nature of processing required.