Universal brain systems for recognizing word shapes and handwriting gestures during reading

Functional interactions underlying visuospatial orthographic processes in Chinese reading

As a logographic writing system, Chinese reading involves the processing of visuospatial orthographic (ORT) properties. However, this aspect has received relatively less attention in neuroimaging research, which has tended to emphasize phonological (PHO) and semantic (SEM) aspects in processing Chinese characters. Here, we compared the functional correlates supporting all these three processes in a functional MRI single-character reading study, in which 35 native Chinese adults were asked to make ORT, PHO, and SEM judgments in separate task-specific activation blocks. Our findings revealed increased involvement of the right hemisphere in processing Chinese visuospatial orthography, particularly evident in the right ventral occipito-temporal cortex (vOTC). Additionally, time course analysis revealed that the left superior parietal gyrus (SPG) was initially involved in SEM processing but contributed to the visuospatial processing of words in a later time window. Finally, ORT processing demonstrated stronger recruitment of left vOTC-SPG-middle frontal gyrus (MFG) functional connectivity compared to SEM processing. This functional coupling correlated with reduced regional engagement of the left vOTC and MFG, highlighting that visuospatial ORT processes in reading Chinese rely on functional interactions among key regions rather than local regional processes. In conclusion, these findings underscore visuospatial ORT processes as a distinctive feature of reading logographic characters.

Universality and language specificity of brain reading networks: A developmental perspective

The development of reading networks across different languages and cultures provides an important window to address gene-culture interactions in brain functionality development. Previous meta-analyses have explored the neural correlates of reading in different languages with diverse orthographic transparencies. However, it remains unknown whether the neural topographic relationship of different languages varies when taking development into account. To address this issue, we conducted meta-analyses of neuroimaging studies with approaches of activation likelihood estimation and seed-based effect size mapping and focused on two highly contrasting languages, Chinese and English. The meta-analyses covered 61 studies of Chinese reading and 64 studies of English reading by native speakers. The brain reading networks of child and adult readers were further separately analyzed and compared to explore the developmental effects. The results revealed that the commonalities and differences in reading networks for Chinese and English were inconsistent between children and adults. In addition, the reading networks converged with development, and the effects of writing systems on brain function organizations were more salient in the initial stages of reading. An interesting finding was that the left inferior parietal lobule demonstrated increased effect sizes in adults compared with children in both Chinese and English reading, indicating a common developmental feature of reading mechanisms across the two languages. These findings provide new insights into the functional evolution and cultural modulation of brain reading networks. RESEARCH HIGHLIGHTS: Meta-analyses with approaches of activation likelihood estimation and seed-based effect size mapping were performed to evaluate the developmental characteristics of brain reading networks. The engagement of universal and language-specific reading networks was different between children and adults, and the reading networks converged with increased reading experience. Overall the middle/inferior occipital and inferior/middle frontal gyrus were specific to Chinese and the middle temporal, right inferior frontal gyrus were specific to English. The left inferior parietal lobule was engaged more in adults than children in Chinese and English reading, demonstrating a common developmental feature of reading mechanisms.

Reading instruction causes changes in category-selective visual cortex

Education sculpts specialized neural circuits for skills like reading that are critical to success in modern society but were not anticipated by the selective pressures of evolution. Does the emergence of brain regions that selectively process novel visual stimuli like words occur at the expense of cortical representations of other stimuli like faces and objects? "Neuronal Recycling" predicts that learning to read should enhance the response to words in ventral occipitotemporal cortex (VOTC) and decrease the response to other visual categories such as faces and objects. To test this hypothesis, and more broadly to understand the changes that are induced by the early stages of literacy instruction, we conducted a randomized controlled trial with pre-school children (five years of age). Children were randomly assigned to intervention programs focused on either reading skills or oral language skills and magnetoencephalography (MEG) data collected before and after the intervention was used to measure visual responses to images of text, faces, and objects. We found that being taught reading versus oral language skills induced different patterns of change in category-selective regions of visual cortex, but that there was not a clear tradeoff between the response to words versus other categories. Within a predefined region of VOTC corresponding to the visual word form area (VWFA) we found that the relative amplitude of responses to text, faces, and objects changed, but increases in the response to words were not linked to decreases in the response to faces or objects. How these changes play out over a longer timescale is still unknown but, based on these data, we can surmise that high-level visual cortex undergoes rapid changes as children enter school and begin establishing new skills like literacy.

Cognitive Science From the Perspective of Linguistic Diversity

This letter addresses two issues in language research that are important to cognitive science: the comparability of word meanings across languages and the neglect of an integrated approach to writing systems. The first issue challenges generativist claims by emphasizing the importance of comparability of data, drawing on typologists' findings about different languages. The second issue addresses the exclusion of diverse writing systems from linguistic investigation and argues for a more extensive study of their effects on language and cognition. We argue for a refocusing of cognitive science research on linguistic diversity in all modalities to develop the most robust understanding of language and its role in human cognition more broadly.

Lateralized Functional Connectivity of the Sensorimotor Cortex and its Variations During Complex Visuomotor Tasks

Previous studies have shown that the left hemisphere dominates motor function, often observed through homotopic activation measurements. Using a functional connectivity approach, this study investigated the lateralization of the sensorimotor cortex during handwriting and drawing, two complex visuomotor tasks with varying contextual demands. We found that both left- and right-lateralized connectivity in the primary motor cortex (M1), dorsal premotor cortex (PMd), somatosensory cortex, and visual regions were evident in adults (males and females), primarily in an interhemispheric integrative fashion. Critically, these lateralization tendencies remained highly invariant across task contexts, representing a task-invariant neural architecture for encoding fundamental motor programs consistently implemented in different task contexts. Additionally, the PMd exhibited a slight variation in lateralization degree between task contexts, reflecting the ability of the high-order motor system to adapt to varying task demands. However, connectivity-based lateralization of the sensorimotor cortex was not detected in 10-year-old children (males and females), suggesting that the maturation of connectivity-based lateralization requires prolonged development. In summary, this study demonstrates both task-invariant and task-sensitive connectivity lateralization in sensorimotor cortices that support the resilience and adaptability of skilled visuomotor performance. These findings align with the hierarchical organization of the motor system and underscore the significance of the functional connectivity-based approach in studying functional lateralization.

Notational systems are distinct cognitive systems with different material prehistories

Notations are cognitive systems involving distinctive psychological functions, behaviors, and material forms. Seen through this lens, two main types - semasiography and visible language - are fundamentally differentiated by their material prehistories, emphasis on iconography, and the centrality of language's combinatorial faculty. These fundamental differences suggest that key qualities (iconicity, expressiveness, concision) are difficult to conjoin in a single system.

Reading Braille by Touch Recruits Posterior Parietal Cortex

Blind readers use a tactile reading system consisting of raised dot arrays: braille/⠃⠗⠇. How do human brains implement reading by touch? The current study looked for signatures of reading-specific orthographic processes in braille, separate from low-level somatosensory responses and semantic processes. Of specific interest were responses in posterior parietal cortices (PPCs), because of their role in high-level tactile perception. Congenitally blind, proficient braille readers read real words and pseudowords by touch while undergoing fMRI. We leveraged the system of contractions in English braille, where one braille cell can represent multiple English print letters (e.g., "ing" ⠬, "one" ⠐⠕), making it possible to separate physical and orthographic word length. All words in the study consisted of four braille cells, but their corresponding Roman letter spellings varied from four to seven letters (e.g., "con-c-er-t" ⠒⠉⠻⠞. contracted: four cells; uncontracted: seven letters). We found that the bilateral supramarginal gyrus in the PPC increased its activity as the uncontracted word length increased. By contrast, in the hand region of primary somatosensory cortex (S1), activity increased as a function of a low-level somatosensory feature: dot-number per word. The PPC also showed greater response to pseudowords than real words and distinguished between real and pseudowords in multivariate-pattern analysis. Parieto-occipital, early visual and ventral occipito-temporal, as well as prefrontal cortices also showed sensitivity to the real-versus-pseudoword distinction. We conclude that PPC is involved in orthographic processing for braille, that is, braille character and word recognition, possibly because of braille's tactile modality.

Writing letters in two graphic systems: Behavioral and neural correlates in Latin-Arabic biscripters

Biscriptuality is the ability to read and write using two scripts. Despite the increasing number of biscripters, this phenomenon remains poorly understood. Here, we focused on investigating graphomotor processing in French-Arabic biscripters. We chose the French and Arabic alphabets because they have comparable visuospatial complexity and linguistic features, but differ dramatically in their graphomotor characteristics. In a first experiment we describe the graphomotor features of the two alphabets and showed that while Arabic and Latin letters are produced with the same velocity and fluency, Arabic letters require more pen lifts, contain more right-to-left strokes and clockwise curves, and take longer to write than Latin letters. These results suggest that Arabic and Latin letters are produced via different motor patterns. In a second experiment we used functional magnetic resonance imaging to ask whether writing the two scripts relies upon partially distinct or fully overlapping neural networks, and whether the elements of the previously described handwriting network are recruited to the same extent by the two scripts. We found that both scripts engaged the so-called "writing network", but that within the network, Arabic letters recruited the left superior parietal lobule (SPL) and the left primary motor cortex (M1) more strongly than Latin letters. Both regions have previously been identified as holding scale-invariant representations of letter trajectories. Arabic and Latin letters also activated distinct regions that do not belong to the writing network. Complementary analyses indicate that the differences observed between scripts at the neural level could be driven by the specific graphomotor features of each script. Overall, our results indicate that particular features of the practiced scripts can lead to different motor organization at both the behavioral and brain levels in biscripters.

Reading anxiety modulates the functional connectivity of the reading-related network during adult reading

Researchers have studied cognitive and linguistic skills in predicting reading abilities, but the impact of affective factors such as anxiety on reading at the neurobiological level is not well understood. Here, we used functional magnetic resonance imaging to investigate the neural correlates of reading anxiety in adult readers performing a semantic judgment task. The results showed that reading anxiety was significantly correlated with response time but not with accuracy. Neurobiologically, functional connectivity strength rather than activation level of semantic-related areas significantly predicted reading anxiety. Activation of regions (i.e., the right putamen and right precentral gyrus) external to the semantic-related areas positively correlated with reading anxiety levels. These findings suggest that reading anxiety influences adult reading by modulating functional connections of semantic-related areas and brain activation of semantic-unrelated areas. This study provides insights into the neural mechanisms underlying reading anxiety experienced by adult readers.

Sensory modality and spoken language shape reading network in blind readers of Braille

The neural basis of reading is highly consistent across many languages and scripts. Are there alternative neural routes to reading? How does the sensory modality of symbols (tactile vs. visual) influence their neural representations? We examined these questions by comparing reading of visual print (sighted group, n = 19) and tactile Braille (congenitally blind group, n = 19). Blind and sighted readers were presented with written (words, consonant strings, non-letter shapes) and spoken stimuli (words, backward speech) that varied in word-likeness. Consistent with prior work, the ventral occipitotemporal cortex (vOTC) was active during Braille and visual reading. A posterior/anterior vOTC word-form gradient was observed only in sighted readers with more anterior regions preferring larger orthographic units (words). No such gradient was observed in blind readers. Consistent with connectivity predictions, in blind compared to sighted readers, posterior parietal cortices were recruited to a greater degree and contained word-preferring patches. Lateralization of Braille in blind readers was predicted by laterality of spoken language and reading hand. The effect of spoken language increased along a cortical hierarchy, whereas effect of reading hand waned. These results suggested that the neural basis of reading is influenced by symbol modality and spoken language and support connectivity-based views of cortical function.

How Characters Are Learned Leaves Its Mark on the Neural Substrates of Chinese Reading

Understanding how the brain functions differently as one learns to read may shed light on the controversial nature of the reading ability of human being. Logographic writing system such as Chinese has been found to rely on specialized neural substrates beyond the reading network of alphabetic languages. The ability to read in Chinese has also been proposed to rely on writing skills. However, it was unclear whether the learning-related alteration of neural responses was language specific or resulted from the more reliance on writing practice during acquisition. This study investigated whether the emergence of typical logographic-specific regions relied on learning by writing. We taught proficient alphabetic language readers Chinese characters and used pre-test and post-test to identify changes in two critical stages of reading, namely, orthographic processing and orthographic-to-phonological mapping. Two typical left hemispheric areas for logographic reading showed increased responses to characters in the brains of proficient alphabetic readers after learning, regardless of whether the learning strategy involved writing practice. Moreover, learning strategy modulated the response magnitude or multivoxel patterns in the left superior parietal lobule, left middle frontal gyrus, and right fusiform gyrus, some of which were task dependent. The findings corroborated a limited role of writing in the emergence of logographic-specific reading network and suggested the heterogeneous nature of different brain regions in this network.

Brain Correlates of Chinese Handwriting and Their Relation to Reading Development in Children: An fMRI Study

Handwriting plays an important role in written communication, reading, and academic success. However, little is known about the neural correlates of handwriting in children. Using functional magnetic resonance imaging (fMRI) and a copying task, we investigated regional brain activation and functional lateralization associated with Chinese handwriting in children (N = 36, 9-11 years old), as well as their relations to reading skills. We found significant activation of the bilateral frontal motor cortices, somatosensory cortex, intraparietal sulcus (IPS), fusiform gyrus (FuG), and cerebellum during handwriting, suggesting that an adult-like brain activation pattern emerges by middle childhood. Moreover, children showed left-lateralized and bilateral activation of motor regions and right-lateralized activation of the FuG and cerebellum during handwriting, suggesting that functional lateralization of handwriting is not fully established by this age. Finally, the activation of Exner's area and the lateralization of the IPS and cerebellum during handwriting were correlated with reading skills, possibly representing a neural link between handwriting and reading in children. Collectively, this study reveals the brain correlates of handwriting and their relation to reading development in Chinese children, offering new insight into the development of handwriting and reading skills.

Graph theoretical analysis reveals the functional role of the left ventral occipito-temporal cortex in speech processing

The left ventral occipito-temporal cortex (left-vOT) plays a key role in reading. Interestingly, the area also responds to speech input, suggesting that it may have other functions beyond written word recognition. Here, we adopt graph theoretical analysis to investigate the left-vOT's functional role in the whole-brain network while participants process spoken sentences in different contexts. Overall, different connectivity measures indicate that the left-vOT acts as an interface enabling the communication between distributed brain regions and sub-networks. During simple speech perception, the left-vOT is systematically part of the visual network and contributes to the communication between neighboring areas, remote areas, and sub-networks, by acting as a local bridge, a global bridge, and a connector, respectively. However, when speech comprehension is explicitly required, the specific functional role of the area and the sub-network to which the left-vOT belongs change and vary with the quality of speech signal and task difficulty. These connectivity patterns provide insightful information on the contribution of the left-vOT in various contexts of language processing beyond its role in reading. They advance our general understanding of the neural mechanisms underlying the flexibility of the language network that adjusts itself according to the processing context.

Functional connectivity during orthographic, phonological, and semantic processing of Chinese characters identifies distinct visuospatial and phonosemantic networks

While neuroimaging studies have identified brain regions associated with single word reading, its three constituents, namely, orthography, phonology, and meaning, and the functional connectivity of their networks remain underexplored. This study examined the neurocognitive underpinnings of these neural activations and functional connectivity of the identified brain regions using a within-subject design. Thirty-one native Mandarin speakers performed orthographic, phonological, and semantic judgment tasks during functional magnetic resonance imaging. The results indicated that the three processes shared a core network consisting of a large region in the left prefrontal cortex, fusiform gyrus, and medial superior frontal gyrus but not the superior temporal gyrus. Orthographic processing more strongly recruited the left dorsolateral prefrontal cortex, left superior parietal lobule and bilateral fusiform gyri; semantic processing more strongly recruited the left inferior frontal gyrus and left middle temporal gyrus, whereas phonological processing more strongly activated the dorsal part of the precentral gyrus. Functional connectivity analysis identified a posterior visuospatial network and a frontal phonosemantic network interfaced by the left middle frontal gyrus. We conclude that reading Chinese recruits cognitive resources that correspond to basic task demands with unique features best explained in connection with the individual reading subprocesses.

Personality traits modulate the neural responses to handwriting processing

Handwriting is a vital skill for everyday human activities. It has a wealth of information about writers' characteristics and can hint toward underlying neurological conditions, such as Parkinson's disease, autism, dyslexia, and attention-deficit/hyperactivity disorder (ADHD). Many previous studies have reported a link between personality and individual differences in handwriting, but the evidence for the relationship tends to be anecdotal in nature. Using functional magnetic resonance imaging (fMRI), we examined whether the association between personality traits and handwriting was instantiated at the neural level. Results showed that the personality trait of conscientiousness modulated brain activation in the left premotor cortex and right inferior/middle frontal gyrus, which may reflect the impact of personality on orthography-to-grapheme transformation and executive control involved in handwriting. Such correlations were not observed in symbol-drawing or word-reading tasks, suggesting the specificity of the link between conscientiousness and handwriting in these regions. Moreover, using a connectome-based predictive modeling approach, we found that individuals' conscientiousness scores could be predicted based on handwriting-related functional brain networks, suggesting that the influence of personality on handwriting may occur within a broader network. Our findings provide neural evidence for the link between personality and handwriting processing, extending our understanding of the nature of individual differences in handwriting.

Lifespan developmental changes in neural substrates and functional connectivity for visual semantic processing

Human learning and cognitive functions change with age and experience, with late-developed complex cognitive functions, particularly those served by the prefrontal cortex, showing more age-dependent variance. Reading as a complex process of constructing meaning from print uses the left prefrontal cortex and may show a similar aging pattern. In this study, we delineated the lifespan developmental changes in the neural substrates and functional connectivity for visual semantic processing from childhood (age 6) to late adulthood (age 74). Different from previous studies that reported aging as a form of activation or neuronal changes, we examined additionally how the functional connectivity networks changed with age. A cohort of 122 Chinese participants performed semantic and font-size judgment tasks during functional magnetic resonance imaging. Although a common left-lateralized neural system including the left mid-inferior prefrontal cortex was recruited across all participants, the effect of age, or reading experience, is evident as 2 contrastive developmental patterns: a declining trend in activation strength and extent and an increasing trend in functional connections of the network. This study suggests that visual semantic processing is not prone to cognitive decline, and that continuous reading until old age helps strengthen the functional connections of reading-related brain regions.

Written Language Acquisition Is Both Shaped by and Has an Impact on Brain Functioning and Cognition

Spoken language is a distinctive trace of our species and it is naturally acquired during infancy. Written language, in contrast, is artificial, and the correspondences between arbitrary visual symbols and the spoken language for reading and writing should be explicitly learned with external help. In this paper, I present several examples of how written language acquisition is both shaped by and has an impact on brain function and cognition. They show in one hand how our phylogenetic legacy influences education and on the other hand how ontogenetic needs for education can rapidly subdue deeply rooted neurocognitive mechanisms. The understanding of this bidirectional influences provides a more dynamic view of how plasticity interfaces phylogeny and ontogeny in human learning, with implications for both neurosciences and education.

Distinct spatiotemporal patterns of syntactic and semantic processing in human inferior frontal gyrus

Human languages are based on syntax, a set of rules which allow an infinite number of meaningful sentences to be constructed from a finite set of words. A theory associated with Chomsky and others holds that syntax is a mind-internal, universal structure independent of semantics. This theory, however, has been challenged by studies of the Chinese language showing that syntax is processed under the semantic umbrella, and is secondary and not independent. Here, using intracranial high-density electrocorticography, we find distinct spatiotemporal patterns of neural activity in the left inferior frontal gyrus that are specifically associated with syntactic and semantic processing of Chinese sentences. These results suggest that syntactic processing may occur before semantic processing. Our findings are consistent with the view that the human brain implements syntactic structures in a manner that is independent of semantics.

From Hand to Eye With the Devil In-Between: Which Cognitive Mechanisms Underpin the Benefit From Handwriting Training When Learning Visual Graphs?

Cognitive science has recently shown a renewed interest on the benefit from training in handwriting (HW) when learning visual graphs, given that this learning experience improves more subsequent visual graph recognition than other forms of training. However, the underlying cognitive mechanism of this HW benefit has been elusive. Building on the 50 years of research on this topic, the present work outlines a theoretical approach to study this mechanism, specifying testable hypotheses that will allow distinguishing between confronting perspectives, i.e., symbolic accounts that hold that perceptual learning and visual analysis underpin the benefit from HW training vs. embodied sensorimotor accounts that argue for motoric representations as inner part of orthographic representations acquired via HW training. From the evidence critically revisited, we concluded that symbolic accounts are parsimonious and could better explain the benefit from HW training when learning visual graphs. The future challenge will be to put at test the detailed predictions presented here, so that the devil has no longer room in this equation.

Bilingual experience and intrinsic functional connectivity in adults, aging, and Alzheimer's disease

The past decade marked the beginning of the use of resting-state functional connectivity (RSFC) imaging in bilingualism studies. This paper intends to review the latest evidence of changes in RSFC in language and cognitive control networks in bilinguals during adulthood, aging, and early Alzheimer's disease, which can add to our understanding of brain functional reshaping in the context of second language (L2) acquisition. Because of high variability in bilingual experience, recent studies mostly focus on the role of the main aspects of bilingual experience (age of acquisition (AoA), language proficiency, and language usage) on intrinsic functional connectivity (FC). Existing evidence accounts for stronger FC in simultaneous rather than sequential bilinguals in language and control networks, and the modulation of the AoA impact by language proficiency and usage. Studies on older bilingual adults show stronger FC in language and frontoparietal networks and preserved FC in posterior brain regions, which can protect the brain against cognitive decline and neurodegenerative processes. Altered RSFC in language and control networks subsequent to L2 training programs also is associated with improved global cognition in older adults. This review ends with a brief discussion of potential confounding factors in bilingualism research and conclusions and suggestions for future research.

The brain basis of handwriting deficits in Chinese children with developmental dyslexia

Abundant behavioral studies have demonstrated high comorbidity of reading and handwriting difficulties in developmental dyslexia (DD), a neurological condition characterized by unexpectedly low reading ability despite adequate nonverbal intelligence and typical schooling. The neural correlates of handwriting deficits remain largely unknown; however, as well as the extent that handwriting deficits share common neural bases with reading deficits in DD. The present work used functional magnetic resonance imaging to examine brain activity during handwriting and reading tasks in Chinese dyslexic children (n = 18) and age-matched controls (n = 23). Compared to controls, dyslexic children exhibited reduced activation during handwriting tasks in brain regions supporting sensory-motor processing (including supplementary motor area and postcentral gyrus) and visual-orthography processing (including bilateral precuneus and right cuneus). Among these regions, the left supplementary motor area and the right precuneus also showed a trend of reduced activation during reading tasks in dyslexics. Moreover, increased activation was found in the left inferior frontal gyrus and anterior cingulate cortex in dyslexics, which may reflect more efforts of executive control to compensate for the impairments of motor and visual-orthographic processing. Finally, dyslexic children exhibited aberrant functional connectivity among brain areas for cognitive control and sensory-motor processes during handwriting tasks. Together, these findings suggest that handwriting deficits in DD are associated with functional abnormalities of multiple brain regions implicated in motor execution, visual-orthographic processing, and cognitive control, providing important implications for the diagnosis and treatment of dyslexia.

The Effects of Handwriting Experience on Literacy Learning

Previous research indicates that writing practice may be more beneficial than nonmotor practice for letter learning. Here, we report a training study comparing typing, visual, and writing learning conditions in adults (N = 42). We investigated the behavioral consequences of learning modality on literacy learning and evaluated the nature of the learned letter representations. Specifically, the study addressed three questions. First, are the benefits of handwriting practice due to motor learning per se or to other incidental factors? Second, do the benefits generalize to untrained tasks? And third, does handwriting practice lead to learning and strengthening only of motor representations or of other types of representations as well? Our results clearly show that handwriting compared with nonmotor practice produces faster learning and greater generalization to untrained tasks than previously reported. Furthermore, only handwriting practice leads to learning of both motor and amodal symbolic letter representations.

Right Inferior Parietal Lobule Activity Is Associated With Handwriting Spontaneous Tempo

Handwriting is a complex activity including motor planning and visuomotor integration and referring to some brain areas identified as "writing centers." Although temporal features of handwriting are as important as spatial ones, to our knowledge, there is no evidence of the description of specific brain areas associated with handwriting tempo. People with multiple sclerosis (PwMS) show handwriting impairments that are mainly referred to as the temporal features of the task. The aim of this work was to assess differences in the brain activation pattern elicited by handwriting between PwMS and healthy controls (HC), with the final goal of identifying possible areas specific for handwriting tempo. Subjects were asked to write a sentence at their spontaneous speed. PwMS differed only in temporal handwriting features from HC and showed reduced activation with a subset of the clusters observed in HC. Spearman's correlation analysis was performed between handwriting temporal parameters and the activity in the brain areas resulting from the contrast analysis, HC > PwMS. We found that the right inferior parietal lobule (IPL) negatively correlated with the duration of the sentence, indicating that the higher the right IPL activity, the faster the handwriting performance. We propose that the right IPL might be considered a "writing tempo center."

Graphomotor memory in Exner's area enhances word learning in the blind

Handwriting is thought to impede vocabulary learning in sighted adults because the motor execution of writing interferes with efficient audiovisual processing during encoding. However, the motor memory of writing may facilitate adult word learning when visual sensory inputs are severely restricted. Using functional MRI, we show that late-blind participants, but not sighted participants, learned novel words by recruiting the left dorsal premotor cortex known as Exner’s writing area and its functional coupling with the left hippocampus. During later recall, the phonological and semantic contents of these words are represented in the activation patterns of the left hippocampus as well as in those of left frontotemporal language areas. These findings suggest that motor codes of handwriting help blind participants maintain word-form representations during learning and retrieval. We propose that such reliance on the motor system reflects a broad architecture of the cerebral language network which encompasses the limb motor system as a hardwired component.

Mizuochi-Endo et al. conduct a fMRI study, which reveals that in blind participants, unlike sighted participants, learning new words is associated with increased activity in Exner’s area—a part of the brain known to play a crucial role in handwriting motor memory. This demonstrates the importance of writing motor memory in vocabulary learning in the blind.

Selective Inhibition of Mirror Invariance for Letters Consolidated by Sleep Doubles Reading Fluency

Mirror invariance is a visual mechanism that enables a prompt recognition of mirror images. This visual capacity emerges early in human development, is useful to recognize objects, faces, and places from both left and right perspectives, and is also present in primates, pigeons, and cephalopods. Notwithstanding, the same visual mechanism has been suspected to be the source of a specific difficulty for a relatively recent human invention-reading-by creating confusion between mirror letters (e.g., b-d in the Latin alphabet). Using an ecologically valid school-based design, we show here that mirror invariance represents indeed a major leash for reading fluency acquisition in first graders. Our causal approach, which specifically targeted mirror invariance inhibition for letters, in a synergic combination with post-training sleep to increase learning consolidation, revealed unprecedented improvement in reading fluency, which became two-times faster. This gain was obtained with as little as 7.5 h of multisensory-motor training to distinguish mirror letters, such as "b" versus "d." The magnitude, automaticity, and duration of this mirror discrimination learning were greatly enhanced by sleep, which keeps the gains perfectly intact even after 4 months. The results were consistently replicated in three randomized controlled trials. They not only reveal an extreme case of cognitive plasticity in humans (i.e., the inhibition in just 3 weeks of a ∼25-million-year-old visual mechanism), that allows adaptation to a cultural activity (reading), but at the same time also show a simple and cost-effective way to unleash the reading fluency potential of millions of children worldwide.

The contributions of the left fusiform subregions to successful encoding of novel words

The left fusiform cortex has been identified as a crucial structure in visual word learning and memory. Nevertheless, the specific roles of the fusiform subregions in word memory and their consistency across different writings have not been elaborated. To address these questions, the present study performed two experiments, in which study-test paradigm was used. Participants' brain activity was measured with fMRI while memorizing novel logographic words in Experiment 1 and novel alphabetic words in Experiment 2. A post-scan recognition memory test was then administered to acquire the memory performance. Results showed that, neural responses in the left anterior and middle fusiform subregions during encoding were positively correlated with recognition memory of novel words. Moreover, the positive brain-behavior correlations in the left anterior and middle fusiform cortex were evident for both logographic and alphabetic writings. The present findings clarify the relationship between the left fusiform subregions and novel word memory.

Tablet Technology for Writing and Drawing during Functional Magnetic Resonance Imaging: A Review

Functional magnetic resonance imaging (fMRI) is a powerful modality to study brain activity. To approximate naturalistic writing and drawing behaviours inside the scanner, many fMRI-compatible tablet technologies have been developed. The digitizing feature of the tablets also allows examination of behavioural kinematics with greater detail than using paper. With enhanced ecological validity, tablet devices have advanced the fields of neuropsychological tests, neurosurgery, and neurolinguistics. Specifically, tablet devices have been used to adopt many traditional paper-based writing and drawing neuropsychological tests for fMRI. In functional neurosurgery, tablet technologies have enabled intra-operative brain mapping during awake craniotomy in brain tumour patients, as well as quantitative tremor assessment for treatment outcome monitoring. Tablet devices also play an important role in identifying the neural correlates of writing in the healthy and diseased brain. The fMRI-compatible tablets provide an excellent platform to support naturalistic motor responses and examine detailed behavioural kinematics.

Integrating Machine Learning with Human Knowledge

Machine learning has been heavily researched and widely used in many disciplines. However, achieving high accuracy requires a large amount of data that is sometimes difficult, expensive, or impractical to obtain. Integrating human knowledge into machine learning can significantly reduce data requirement, increase reliability and robustness of machine learning, and build explainable machine learning systems. This allows leveraging the vast amount of human knowledge and capability of machine learning to achieve functions and performance not available before and will facilitate the interaction between human beings and machine learning systems, making machine learning decisions understandable to humans. This paper gives an overview of the knowledge and its representations that can be integrated into machine learning and the methodology. We cover the fundamentals, current status, and recent progress of the methods, with a focus on popular and new topics. The perspectives on future directions are also discussed.

Chinese characters are read using not only visual but also writing motor information

It has been suggested that mature reading systems consist of both a visual analysis decoding system and a motor gesture decoding system that facilitates reading by processing writing motor information. However, there is still uncertainty about the mechanisms and effectiveness of the latter system when reading Chinese characters. This study therefore aimed to provide empirical neural evidence for this phenomenon using a writing video as prompt in a delayed sequential same/different judgment task. We investigated whether and how the orthographic processing of target characters was modulated by the writing direction of the prompt (forward vs. backward) and the character repetition (repeat vs. nonrepeat) between the prompt and target characters. The results indicated that (a) the N170 component was more negative under the forward condition than under the backward condition; and (b) both writing direction and character repetition modulated the centro-parietal N200 component. These writing-direction effects were specific to Chinese characters--they did not apply to Korean characters, which are visually similar to Chinese characters but unfamiliar to the participants. These results suggest that the experience of learning Chinese might establish a motor gesture decoding system for reading, which begins to perform general orthographic representation at an early stage and works together with the visual analysis decoding system to achieve deep orthographic processing.

A universal reading network and its modulation by writing system and reading ability in French and Chinese children

Are the brain mechanisms of reading acquisition similar across writing systems? And do similar brain anomalies underlie reading difficulties in alphabetic and ideographic reading systems? In a cross-cultural paradigm, we measured the fMRI responses to words, faces, and houses in 96 Chinese and French 10-year-old children, half of whom were struggling with reading. We observed a reading circuit which was strikingly similar across languages and consisting of the left fusiform gyrus, superior temporal gyrus/sulcus, precentral and middle frontal gyri. Activations in some of these areas were modulated either by language or by reading ability, but without interaction between those factors. In various regions previously associated with dyslexia, reading difficulty affected activation similarly in Chinese and French readers, including the middle frontal gyrus, a region previously described as specifically altered in Chinese. Our analyses reveal a large degree of cross-cultural invariance in the neural correlates of reading acquisition and reading impairment.

When a sentence loses semantics: Selective involvement of a left anterior temporal subregion in semantic processing

Although the left anterior temporal lobe (ATL) has been associated with semantic processing, the role of this region in syntactic structure building of sentences remains a subject of debate. Functional neuroimaging studies contrasting well-formed sentences with word lists lacking syntactic structure have produced mixed results. The current functional magnetic resonance imaging study examined whether the left ATL is selectively involved in semantic processing or also plays a role in syntactic structure building by manipulating syntactic complexity and meaningfulness in a novel way. To deprive semantic/pragmatic information from a sentence, we replaced all content words with pronounceable meaningless placeholders. We conducted an experiment with a 2 × 2 factorial design with factors of SEMANTICS (natural sentences [NAT]; sentences with placeholders [SPH]) and SYNTAX (the basic Japanese Subject-Object-Verb [SOV] word order; a changed Object-Subject-Verb [OSV] word order). A main effect of SEMANTICS (NAT > SPH) was found in the left ATL, as well as in the ventral occipitotemporal regions. The opposite contrast (SPH > NAT) revealed activation in the dorsal regions encompassing Brodmann area 44, the premotor area, and the parietal cortex in the left hemisphere. We found no main effect of SYNTAX (OSV > SOV) in a subregion of the left ATL that was more responsive to natural sentences than meaningless sentences. These results indicate selective involvement of a subregion of the left ATL in semantic/pragmatic processing.

A Lifespan fMRI Study of Neurodevelopment Associated with Reading Chinese

We used functional magnetic resonance imaging (fMRI) to map the neural systems involved in reading Chinese in 125 participants 6-74 years old to examine two theoretical issues: how brain structure and function are related in the context of the lifetime neural development of human cognition and whether the neural network for reading is universal or different across languages. Our findings showed that a common network of left frontal and occipital regions typically involved in reading Chinese was recruited across all participants. Crucially, activation in left mid-inferior frontal regions, fusiform and striate-extrastriate sites, premotor cortex, right inferior frontal gyrus, bilateral insula, and supplementary motor area all showed linearly decreasing changes with age. These findings differ from previous findings on alphabetic reading development and suggest that early readers at age 6-7 are already using the same cortical network to process printed words as adults, though the connections among these regions are modulated by reading proficiency, and cortical regions for reading are tuned by experience toward reduced and more focused activation. This fMRI study has demonstrated, for the first time, the neurodevelopment of reading across the lifespan and suggests that learning experience, instead of pre-existing brain structures, determines reading acquisition.

Men and women differ in the neural basis of handwriting

There is an ongoing debate about whether, and to what extent, males differ from females in their language skills. In the case of handwriting, a composite language skill involving language and motor processes, behavioral observations consistently show robust sex differences but the mechanisms underlying the effect are unclear. Using functional magnetic resonance imaging (fMRI) in a copying task, the present study examined the neural basis of sex differences in handwriting in 53 healthy adults (ages 19–28, 27 males). Compared to females, males showed increased activation in the left posterior middle frontal gyrus (Exner's area), a region thought to support the conversion between orthographic and graphomotor codes. Functional connectivity between Exner's area and the right cerebellum was greater in males than in females. Furthermore, sex differences in brain activity related to handwriting were independent of language material. This study identifies a novel neural signature of sex differences in a hallmark of human behavior, and highlights the importance of considering sex as a factor in scientific research and clinical applications involving handwriting.

Left Amygdala Regulates the Cerebral Reading Network During Fast Emotion Word Processing

Emotion words constitute a special class of verbal stimuli which can quickly activate the limbic system outside the left-hemisphere language network. Such fast response to emotion words may arise independently of the left occipitotemporal area involved in visual word-form analysis and rely on a distinct amygdala-dependent emotion circuit involved in fearful face processing. Using a hemifield priming paradigm with fMRI, we explored how the left and right amygdala systems interact with the reading network during emotion word processing. On each trial, participants viewed a centrally presented target which was preceded by a masked prime flashed either to the left or right visual field. Primes and targets, each denoting negative or positive nouns, could be either affectively congruent or incongruent with each other. We observed that affective congruency produced parallel changes in neural priming between the left frontal and parietotemporal regions and the bilateral amygdala. However, we also found that the left, but not right, amygdala exhibited significant change in functional connectivity with the neural components of reading as a function of affective congruency. Collectively, these results suggest that emotion words activate the bilateral amygdala during early stages of emotion word processing, whereas only the left amygdala exerts a long-distance regulatory influence over the reading network via its strong within-hemisphere connectivity.

Shared premotor activity in spoken and written communication

The aim of the present study was to uncover a possible common neural organizing principle in spoken and written communication, through the coupling of perceptual and motor representations. In order to identify possible shared neural substrates for processing the basic units of spoken and written language, a sparse sampling fMRI acquisition protocol was performed on the same subjects in two experimental sessions with similar sets of letters being read and written and of phonemes being heard and orally produced. We found evidence of common premotor regions activated in spoken and written language, both in perception and in production. The location of those brain regions was confined to the left lateral and medial frontal cortices, at locations corresponding to the premotor cortex, inferior frontal cortex and supplementary motor area. Interestingly, the speaking and writing tasks also appeared to be controlled by largely overlapping networks, possibly indicating some domain general cognitive processing. Finally, the spatial distribution of individual activation peaks further showed more dorsal and more left-lateralized premotor activations in written than in spoken language.

The neural basis of semantic cognition in Mandarin Chinese: A combined fMRI and TMS study

While converging sources of evidence point to the possibility of a large‐scale distributed network for semantic cognition, a consensus regarding the underlying subregions and their specific function in this network has not been reached. In the current study, we combined functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS) methodology to investigate the neural basis of semantic cognition in Mandarin Chinese. In the fMRI experiment, strong activations were observed in left inferior frontal gyrus (IFG) and left middle temporal gyrus (MTG) for semantic judgment task. Moreover, functional connectivity was found from seed region left IFG to left MTG. Meanwhile, negative correlation between performance and extracted parameter estimates from left IFG to left MTG was detected in semantic task. Subsequent TMS stimulation over left IFG resulted in performance deficits in semantic judgment task, in contrast to other three sites: left MTG, right intraparietal sulcus (IPS) and a control site. We concluded that the neural basis of semantic processing for Mandarin Chinese closely resembled that for alphabetic languages such as English, supporting a language‐universal view on semantic cognition.

Orthographic Priming in Braille Reading as Evidence for Task-specific Reorganization in the Ventral Visual Cortex of the Congenitally Blind

The task-specific principle asserts that, following deafness or blindness, the deprived cortex is reorganized in a manner such that the task of a given area is preserved even though its input modality has been switched. Accordingly, tactile reading engages the ventral occipitotemporal cortex (vOT) in the blind in a similar way to regular reading in the sighted. Others, however, show that the vOT of the blind processes spoken sentence structure, which suggests that the task-specific principle might not apply to vOT. The strongest evidence for the vOT's engagement in sighted reading comes from orthographic repetition-suppression studies. Here, congenitally blind adults were tested in an fMRI repetition-suppression paradigm. Results reveal a double dissociation, with tactile orthographic priming in the vOT and auditory priming in general language areas. Reconciling our finding with other evidence, we propose that the vOT in the blind serves multiple functions, one of which, orthographic processing, overlaps with its function in the sighted.

An Analysis of the Brain Systems Involved with Producing Letters by Hand

Complex visual-motor behaviors dominate human-environment interactions. Letter production, writing individual letters by hand, is an example of a complex visual-motor behavior composed of numerous behavioral components, including the required motor movements and the percepts that those motor movements create. By manipulating and isolating components of letter production, we provide experimental evidence that this complex visual-motor behavior is supported by a widespread neural system that is composed of smaller subsystems related to different sensorimotor components. Adult participants hand-printed letters with and without "ink" on an MR-safe digital writing tablet, perceived static and dynamic representations of their own handwritten letters, and perceived typeface letters during fMRI scanning. Our results can be summarized by three main findings: (1) Frontoparietal systems were associated with the motor component of letter production, whereas temporo-parietal systems were more associated with the visual component. (2) The more anterior regions of the left intraparietal sulcus were more associated with the motor component, whereas the more posterior regions were more associated with the visual component, with an area of visual-motor overlap in the posterior intraparietal sulcus. (3) The left posterior intraparietal sulcus and right fusiform gyrus responded similarly to both visual and motor components, and both regions also responded more during the perception of one's own handwritten letters compared with perceiving typed letters. These findings suggest that the neural systems recruited during complex visual-motor behaviors are composed of a set of interrelated sensorimotor subsystems that support the full behavior in different ways and, furthermore, that some of these subsystems can be rerecruited during passive perception in the absence of the full visual-motor behavior.

Predictive regulation and human design

Organisms evolving toward greater complexity were selected across aeons to use energy and resources efficiently. Efficiency depended on prediction at every stage: first a clock to predict the planet's statistical regularities; then a brain to predict bodily needs and compute commands that dynamically adjust the flows of energy and nutrients. Predictive regulation (allostasis) frugally matches resources to needs and thus forms a core principle of our design. Humans, reaching a pinnacle of cognitive complexity, eventually produced a device (the steam engine) that converted thermal energy to work and were suddenly awash in resources. Today boundless consumption in many nations challenges all our regulatory mechanisms, causing obesity, diabetes, drug addiction and their sequelae. So far we have sought technical solutions, such as drugs, to treat complex circuits for metabolism, appetites and mood. Here I argue for a different approach which starts by asking: why does our regulatory system, which evolution tuned for small satisfactions, now constantly demand 'more'?

Voxel-based lesion analysis of brain regions underlying reading and writing

The neural basis of reading and writing has been a source of inquiry as well as controversy in the neuroscience literature. Reading has been associated with both left posterior ventral temporal zones (termed the "visual word form area") as well as more dorsal zones, primarily in left parietal cortex. Writing has also been associated with left parietal cortex, as well as left sensorimotor cortex and prefrontal regions. Typically, the neural basis of reading and writing are examined in separate studies and/or rely on single case studies exhibiting specific deficits. Functional neuroimaging studies of reading and writing typically identify a large number of activated regions but do not necessarily identify the core, critical hubs. Last, due to constraints on the functional imaging environment, many previous studies have been limited to measuring the brain activity associated with single-word reading and writing, rather than sentence-level processing. In the current study, the brain correlates of reading and writing at both the single- and sentence-level were studied in a large sample of 111 individuals with a history of chronic stroke using voxel-based lesion symptom mapping (VLSM). VLSM provides a whole-brain, voxel-by-voxel statistical analysis of the role of distinct regions in a particular behavior by comparing performance of individuals with and without a lesion at every voxel. Rather than comparing individual cases or small groups with particular behavioral dissociations in reading and writing, VLSM allowed us to analyze data from a large, well-characterized sample of stroke patients exhibiting a wide range of reading and writing impairments. The VLSM analyses revealed that reading was associated with a critical left inferior temporo-occipital focus, while writing was primarily associated with the left supramarginal gyrus. Separate VLSM analyses of single-word versus sentence-level reading showed that sentence-level reading was uniquely associated with anterior to mid-portions of the middle and superior temporal gyri. Both single-word and sentence-level writing overlapped to a great extent in the left supramarginal gyrus, but sentence-level writing was associated with additional underlying white matter pathways such as the internal capsule. These findings suggest that critical aspects of reading and writing processes diverge, with reading relying critically on the ventral visual recognition stream and writing relying on a dorsal visuo-spatial-motor stream.

Blind readers break mirror invariance as sighted do

Mirror invariance refers to a predisposition of humans, including infants and animals, which urge them to consider mirrored images as corresponding to the same object. Yet in order to learn to read a written system that incorporates mirrored letters (e.g., <b> vs. <d> in the Latin alphabet), humans learn to break this perceptual bias. Here we examined the role visual experience and input modality play in the emergence of this bias. To this end, we tested congenital blind (CB) participants in two same-different tactile comparison tasks including pairs of mirrored and non-mirrored Braille letters as well as embossed unfamiliar geometric shapes and Latin letters, and compared their results to those of age-matched sighted participants involved in similar but visually-presented tasks. Sighted participants showed a classical pattern of results for their material of expertise, Latin letters. CB's results signed for their expertise with the Braille script compared to the other two materials that they processed according to an internal frame of reference. They also evidenced that they automatically break mirror invariance for different materials explored through the tactile modality, including Braille letters. Altogether, these results demonstrate that learning to read Braille through the tactile modality allows breaking mirror invariance in a comparable way to what is observed in sighted individuals for the mirrored letters of the Latin alphabet.

Brain bases of morphological processing in Chinese-English bilingual children

Can bilingual exposure impact children's neural circuitry for learning to read? To answer this question, we investigated the brain bases of morphological awareness, one of the key spoken language abilities for learning to read in English and Chinese. Bilingual Chinese-English and monolingual English children (N = 22, ages 7-12) completed morphological tasks that best characterize each of their languages: compound morphology in Chinese (e.g. basket + ball = basketball) and derivational morphology in English (e.g. re + do = redo). In contrast to monolinguals, bilinguals showed greater activation in the left middle temporal region, suggesting that bilingual exposure to Chinese impacts the functionality of brain regions supporting semantic abilities. Similar to monolinguals, bilinguals showed greater activation in the left inferior frontal region [BA 45] in English than Chinese, suggesting that young bilinguals form language-specific neural representations. The findings offer new insights to inform bilingual and cross-linguistic models of language and literacy acquisition.

The Relationship between Intrinsic Couplings of the Visual Word Form Area with Spoken Language Network and Reading Ability in Children and Adults

Reading plays a key role in education and communication in modern society. Learning to read establishes the connections between the visual word form area (VWFA) and language areas responsible for speech processing. Using resting-state functional connectivity (RSFC) and Granger Causality Analysis (GCA) methods, the current developmental study aimed to identify the difference in the relationship between the connections of VWFA-language areas and reading performance in both adults and children. The results showed that: (1) the spontaneous connectivity between VWFA and the spoken language areas, i.e., the left inferior frontal gyrus/supramarginal gyrus (LIFG/LSMG), was stronger in adults compared with children; (2) the spontaneous functional patterns of connectivity between VWFA and language network were negatively correlated with reading ability in adults but not in children; (3) the causal influence from LIFG to VWFA was negatively correlated with reading ability only in adults but not in children; (4) the RSFCs between left posterior middle frontal gyrus (LpMFG) and VWFA/LIFG were positively correlated with reading ability in both adults and children; and (5) the causal influence from LIFG to LSMG was positively correlated with reading ability in both groups. These findings provide insights into the relationship between VWFA and the language network for reading, and the role of the unique features of Chinese in the neural circuits of reading.

Language Learning Enhanced by Massive Multiple Online Role-Playing Games (MMORPGs) and the Underlying Behavioral and Neural Mechanisms

Massive Multiple Online Role-Playing Games (MMORPGs) have increased in popularity among children, juveniles, and adults since MMORPGs' appearance in this digital age. MMORPGs can be applied to enhancing language learning, which is drawing researchers' attention from different fields and many studies have validated MMORPGs' positive effect on language learning. However, there are few studies on the underlying behavioral or neural mechanism of such effect. This paper reviews the educational application of the MMORPGs based on relevant macroscopic and microscopic studies, showing that gamers' overall language proficiency or some specific language skills can be enhanced by real-time online interaction with peers and game narratives or instructions embedded in the MMORPGs. Mechanisms underlying the educational assistant role of MMORPGs in second language learning are discussed from both behavioral and neural perspectives. We suggest that attentional bias makes gamers/learners allocate more cognitive resources toward task-related stimuli in a controlled or an automatic way. Moreover, with a moderating role played by activation of reward circuit, playing the MMORPGs may strengthen or increase functional connectivity from seed regions such as left anterior insular/frontal operculum (AI/FO) and visual word form area to other language-related brain areas.

Cross-cultural consistency and diversity in intrinsic functional organization of Broca's Region

As a core language area, Broca's region was consistently activated in a variety of language studies even across different language systems. Moreover, a high degree of structural and functional heterogeneity in Broca's region has been reported in many studies. This raised the issue of how the intrinsic organization of Broca's region effects by different language experiences in light of its subdivisions. To address this question, we used multi-center resting-state fMRI data to explore the cross-cultural consistency and diversity of Broca's region in terms of its subdivisions, connectivity patterns and modularity organization in Chinese and German speakers. A consistent topological organization of the 13 subdivisions within the extended Broca's region was revealed on the basis of a new in-vivo parcellation map, which corresponded well to the previously reported receptorarchitectonic map. Based on this parcellation map, consistent functional connectivity patterns and modularity organization of these subdivisions were found. Some cultural difference in the functional connectivity patterns was also found, for instance stronger connectivity in Chinese subjects between area 6v2 and the motor hand area, as well as higher correlations between area 45p and middle frontal gyrus. Our study suggests that a generally invariant organization of Broca's region, together with certain regulations of different language experiences on functional connectivity, might exists to support language processing in human brain.