Neural systems for reading aloud: a multiparametric approach

Constraining current neuroanatomical models of reading: the view from Arabic

There is a growing interest in imaging understudied orthographies to unravel their neuronal correlates and their implications for existing computational and neuroanatomical models. Here, we review current brain mapping literature about Arabic words. We first offer a succinct description of some unique linguistic features of Arabic that challenge current cognitive models of reading. We then appraise the existing functional neuroimaging studies that investigated written Arabic word processing. Our review revealed that (1) Arabic is still understudied, (2) the most investigated features concerned the effects of vowelling and diglossia in Arabic reading, (3) findings were not always discussed in the light of existing reading models such as the dual route cascaded, the triangle, and the connectionist dual process models, and (4) current evidence is unreliable when it comes to the exact neuronal pathways that sustain Arabic word processing. Overall, despite the fact that Arabic has some unique linguistic features that challenge and ultimately enrich current reading models, the existing functional neuroimaging literature falls short of offering a reliable evidence about brain networks of Arabic reading. We conclude by highlighting the need for more systematic studies of the linguistic features of Arabic to build theoretical and neuroanatomical models that are concurrently specific and general.

Reading Reshapes Stimulus Selectivity in the Visual Word Form Area

Reading depends on a brain region known as the "visual word form area" (VWFA) in the left ventral occipitotemporal cortex. This region's function is debated because its stimulus selectivity is not absolute, it is modulated by a variety of task demands, and it is inconsistently localized. We used fMRI to characterize the combination of sensory and cognitive factors that activate word-responsive regions that we precisely localized in 16 adult humans (4 male). We then presented three types of character strings: English words, pseudowords, and unfamiliar characters with matched visual features. Participants performed three different tasks while viewing those stimuli: detecting real words, detecting color in the characters, and detecting color in the fixation mark. There were three primary findings about the VWFA's response: (1) It preferred letter strings over unfamiliar characters even when the stimuli were ignored during the fixation task. (2) Compared with those baseline responses, engaging in the word reading task enhanced the response to words but suppressed the response to unfamiliar characters. (3) Attending to the stimuli to judge their color had little effect on the response magnitudes. Thus, the VWFA is uniquely modulated by a cognitive signal that is specific to voluntary linguistic processing and is not additive. Functional connectivity analyses revealed that communication between the VWFA and a left frontal language area increased when the participant engaged in the linguistic task. We conclude that the VWFA is inherently selective for familiar orthography, but it falls under control of the language network when the task demands it.

Reading reshapes stimulus selectivity in the visual word form area

Reading depends on a brain region known as the "visual word form area" (VWFA) in left ventral occipito-temporal cortex. This region's function is debated because its stimulus selectivity is not absolute, it is modulated by a variety of task demands, and it is inconsistently localized. We used fMRI to characterize the combination of sensory and cognitive factors that activate word-responsive regions that we precisely localized in 16 adult humans (4 male). We then presented three types of character strings: English words, pseudowords, and unfamiliar characters with matched visual features. Participants performed three different tasks while viewing those stimuli: detecting real words, detecting color in the characters, and detecting color in the fixation mark. There were three primary findings about the VWFA's response: (1) It preferred letter strings over unfamiliar characters even when the stimuli were ignored during the fixation task; (2) Compared to those baseline responses, engaging in the word reading task enhanced the response to words but suppressed the response to unfamiliar characters. (3) Attending to the stimuli to judge their font color had little effect on the response magnitudes. Thus, the VWFA is uniquely modulated by a cognitive signal that is specific to voluntary linguistic processing and is not additive. Functional connectivity analyses revealed that communication between the VWFA and a left frontal language area increased when the participant engaged in the linguistic task. We conclude that the VWFA is inherently selective for familiar orthography, but it falls under control of the language network when the task demands it.

Developmental surface dyslexia and dysgraphia in a child with corpus callosum agenesis: an approach to diagnosis and treatment

We present a case study detailing cognitive performance, functional neuroimaging, and effects of a hypothesis-driven treatment in a 10-year-old girl diagnosed with complete, isolated corpus callosum agenesis. Despite having average overall intellectual abilities, the girl exhibited profound surface dyslexia and dysgraphia. Spelling treatment significantly and persistently improved her spelling of trained irregular words, and this improvement generalized to reading accuracy and speed of trained words. Diffusion weighted imaging revealed strengthened intrahemispheric white matter connectivity of the left temporal cortex after treatment and identified interhemispheric connectivity between the occipital lobes, likely facilitated by a pathway crossing the midline via the posterior commissure. This case underlines the corpus callosum's critical role in lexical reading and writing. It demonstrates that spelling treatment may enhance interhemispheric connectivity in corpus callosum agenesis through alternative pathways, boosting the development of a more efficient functional organization of the visual word form area within the left temporo-occipital cortex.

An inclusive multivariate approach to neural localization of language components

To determine how language is implemented in the brain, it is important to know which brain areas are primarily engaged in language processing and which are not. Existing protocols for localizing language are typically univariate, treating each small unit of brain volume as independent. One prominent example that focuses on the overall language network in functional magnetic resonance imaging (fMRI) uses a contrast between neural responses to sentences and sets of pseudowords (pronounceable nonwords). This contrast reliably activates peri-sylvian language areas but is less sensitive to extra-sylvian areas that are also known to support aspects of language such as word meanings (semantics). In this study, we assess areas where a multivariate, pattern-based approach shows high reproducibility across multiple measurements and participants, identifying these areas as multivariate regions of interest (mROI). We then perform a representational similarity analysis (RSA) of an fMRI dataset where participants made familiarity judgments on written words. We also compare those results to univariate regions of interest (uROI) taken from previous sentences > pseudowords contrasts. RSA with word stimuli defined in terms of their semantic distance showed greater correspondence with neural patterns in mROI than uROI. This was confirmed in two independent datasets, one involving single-word recognition, and the other focused on the meaning of noun-noun phrases by contrasting meaningful phrases > pseudowords. In all cases, areas of spatial overlap between mROI and uROI showed the greatest neural association. This suggests that ROIs defined in terms of multivariate reproducibility can help localize components of language such as semantics. The multivariate approach can also be extended to focus on other aspects of language such as phonology, and can be used along with the univariate approach for inclusively mapping language cortex.

How does the "default mode" network contribute to semantic cognition?

This review examines whether and how the "default mode" network (DMN) contributes to semantic processing. We review evidence implicating the DMN in the processing of individual word meanings and in sentence- and discourse-level semantics. Next, we argue that the areas comprising the DMN contribute to semantic processing by coordinating and integrating the simultaneous activity of local neuronal ensembles across multiple unimodal and multimodal cortical regions, creating a transient, global neuronal ensemble. The resulting ensemble implements an integrated simulation of phenomenological experience - that is, an embodied situation model - constructed from various modalities of experiential memory traces. These situation models, we argue, are necessary not only for semantic processing but also for aspects of cognition that are not traditionally considered semantic. Although many aspects of this proposal remain provisional, we believe it provides new insights into the relationships between semantic and non-semantic cognition and into the functions of the DMN.

The angular gyrus serves as an interface between the non-lexical reading network and the semantic system: evidence from dynamic causal modeling

Understanding encoded language, such as written words, requires multiple cognitive processes that act in a parallel and interactive fashion. These processes and their interactions, however, are not fully understood. Various conceptual and methodical approaches including computational modeling and neuroimaging have been applied to better understand the neural underpinnings of these complex processes in the human brain. In this study, we tested different predictions of cortical interactions that derived from computational models for reading using dynamic causal modeling. Morse code was used as a model for non-lexical decoding followed by a lexical-decision during a functional magnetic resonance examination. Our results suggest that individual letters are first converted into phonemes within the left supramarginal gyrus, followed by a phoneme assembly to reconstruct word phonology, involving the left inferior frontal cortex. To allow the identification and comprehension of known words, the inferior frontal cortex then interacts with the semantic system via the left angular gyrus. As such, the left angular gyrus is likely to host phonological and semantic representations and serves as a bidirectional interface between the networks involved in language perception and word comprehension.

Altered dynamic effective connectivity of the default mode network in type 2 diabetes

Introduction

Altered functional connectivity of resting-state functional magnetic resonance imaging (rs-fMRI) within default mode network (DMN) regions has been verified to be closely associated with cognitive decline in patients with Type 2 diabetes mellitus (T2DM), but most studies neglected the fluctuations of brain activities-the dynamic effective connectivity (DEC) within DMN of T2DM is still unknown.

Methods

For the current investigation, 40 healthy controls (HC) and 36 T2DM patients have been recruited as participants. To examine the variation of DEC between T2DM and HC, we utilized the methodologies of independent components analysis (ICA) and multivariate granger causality analysis (mGCA).

Results

We found altered DEC within DMN only show decrease in state 1. In addition, the causal information flow of diabetic patients major affected areas which are closely associated with food craving and metabolic regulation, and T2DM patients stayed longer in low activity level and exhibited decreased transition rate between states. Moreover, these changes related negatively with the MoCA scores and positively with HbA1C level.

Conclusion

Our study may offer a fresh perspective on brain dynamic activities to understand the mechanisms underlying T2DM-related cognitive deficits.

Reading Braille by Touch Recruits Posterior Parietal Cortex

Blind readers use a tactile reading system consisting of raised dot arrays: braille/⠃⠗⠇. How do human brains implement reading by touch? The current study looked for signatures of reading-specific orthographic processes in braille, separate from low-level somatosensory responses and semantic processes. Of specific interest were responses in posterior parietal cortices (PPCs), because of their role in high-level tactile perception. Congenitally blind, proficient braille readers read real words and pseudowords by touch while undergoing fMRI. We leveraged the system of contractions in English braille, where one braille cell can represent multiple English print letters (e.g., "ing" ⠬, "one" ⠐⠕), making it possible to separate physical and orthographic word length. All words in the study consisted of four braille cells, but their corresponding Roman letter spellings varied from four to seven letters (e.g., "con-c-er-t" ⠒⠉⠻⠞. contracted: four cells; uncontracted: seven letters). We found that the bilateral supramarginal gyrus in the PPC increased its activity as the uncontracted word length increased. By contrast, in the hand region of primary somatosensory cortex (S1), activity increased as a function of a low-level somatosensory feature: dot-number per word. The PPC also showed greater response to pseudowords than real words and distinguished between real and pseudowords in multivariate-pattern analysis. Parieto-occipital, early visual and ventral occipito-temporal, as well as prefrontal cortices also showed sensitivity to the real-versus-pseudoword distinction. We conclude that PPC is involved in orthographic processing for braille, that is, braille character and word recognition, possibly because of braille's tactile modality.

Modality-Specificity of the Neural Correlates of Linguistic and Non-Linguistic Demand

Imaging studies of language processing in clinical populations can be complicated to interpret for several reasons, one being the difficulty of matching the effortfulness of processing across individuals or tasks. To better understand how effortful linguistic processing is reflected in functional activity, we investigated the neural correlates of task difficulty in linguistic and non-linguistic contexts in the auditory modality and then compared our findings to a recent analogous experiment in the visual modality in a different cohort. Nineteen neurologically normal individuals were scanned with fMRI as they performed a linguistic task (semantic matching) and a non-linguistic task (melodic matching), each with two levels of difficulty. We found that left hemisphere frontal and temporal language regions, as well as the right inferior frontal gyrus, were modulated by linguistic demand and not by non-linguistic demand. This was broadly similar to what was previously observed in the visual modality. In contrast, the multiple demand (MD) network, a set of brain regions thought to support cognitive flexibility in many contexts, was modulated neither by linguistic demand nor by non-linguistic demand in the auditory modality. This finding was in striking contradistinction to what was previously observed in the visual modality, where the MD network was robustly modulated by both linguistic and non-linguistic demand. Our findings suggest that while the language network is modulated by linguistic demand irrespective of modality, modulation of the MD network by linguistic demand is not inherent to linguistic processing, but rather depends on specific task factors.

SCOPE: The South Carolina psycholinguistic metabase

The number of databases that provide various measurements of lexical properties for psycholinguistic research has increased rapidly in recent years. The proliferation of lexical variables, and the multitude of associated databases, makes the choice, comparison, and standardization of these variables in psycholinguistic research increasingly difficult. Here, we introduce The South Carolina Psycholinguistic Metabase (SCOPE), which is a metabase (or a meta-database) containing an extensive, curated collection of psycholinguistic variable values from major databases. The metabase currently contains 245 lexical variables, organized into seven major categories: General (e.g., frequency), Orthographic (e.g., bigram frequency), Phonological (e.g., phonological uniqueness point), Orth-Phon (e.g., consistency), Semantic (e.g., concreteness), Morphological (e.g., number of morphemes), and Response variables (e.g., lexical decision latency). We hope that SCOPE will become a valuable resource for researchers in psycholinguistics and affiliated disciplines such as cognitive neuroscience of language, computational linguistics, and communication disorders. The availability and ease of use of the metabase with comprehensive set of variables can facilitate the understanding of the unique contribution of each of the variables to word processing, and that of interactions between variables, as well as new insights and development of improved models and theories of word processing. It can also help standardize practice in psycholinguistics. We demonstrate use of the metabase by measuring relationships between variables in multiple ways and testing their individual contribution towards a number of dependent measures, in the most comprehensive analysis of this kind to date. The metabase is freely available at go.sc.edu/scope.

A single case neuroimaging study of tickertape synesthesia

Reading acquisition is enabled by deep changes in the brain's visual system and language areas, and in the links subtending their collaboration. Disruption of those plastic processes commonly results in developmental dyslexia. However, atypical development of reading mechanisms may occasionally result in ticker-tape synesthesia (TTS), a condition described by Francis Galton in 1883 wherein individuals "see mentally in print every word that is uttered (…) as from a long imaginary strip of paper". While reading is the bottom-up translation of letters into speech, TTS may be viewed as its opposite, the top-down translation of speech into internally visualized letters. In a series of functional MRI experiments, we studied MK, a man with TTS. We showed that a set of left-hemispheric areas were more active in MK than in controls during the perception of normal than reversed speech, including frontoparietal areas involved in speech processing, and the Visual Word Form Area, an occipitotemporal region subtending orthography. Those areas were identical to those involved in reading, supporting the construal of TTS as upended reading. Using dynamic causal modeling, we further showed that, parallel to reading, TTS induced by spoken words and pseudowords relied on top-down flow of information along distinct lexical and phonological routes, involving the middle temporal and supramarginal gyri, respectively. Future studies of TTS should shed new light on the neurodevelopmental mechanisms of reading acquisition, their variability and their disorders.

Dyslexia: Causes and Concomitant Impairments

In recent decades, theories have been presented to explain the nature of dyslexia, but the causes of dyslexia remained unclear. Although the investigation of the causes of dyslexia presupposes a clear understanding of the concept of cause, such an understanding is missing. The present paper proposes the absence of at least one necessary condition or the absence of all sufficient conditions as causes for impaired reading. The causes of impaired reading include: an incorrect fixation location, too short a fixation time, the attempt to recognize too many letters simultaneously, too large saccade amplitudes, and too short verbal reaction times. It is assumed that a longer required fixation time in dyslexic readers results from a functional impairment of areas V1, V2, and V3 that require more time to complete temporal summation. These areas and areas that receive input from them, such as the fusiform gyrus, are assumed to be impaired in their ability to simultaneously process a string of letters. When these impairments are compensated by a new reading strategy, reading ability improves immediately.

Decoding semantic representations in mind and brain

A key goal for cognitive neuroscience is to understand the neurocognitive systems that support semantic memory. Recent multivariate analyses of neuroimaging data have contributed greatly to this effort, but the rapid development of these novel approaches has made it difficult to track the diversity of findings and to understand how and why they sometimes lead to contradictory conclusions. We address this challenge by reviewing cognitive theories of semantic representation and their neural instantiation. We then consider contemporary approaches to neural decoding and assess which types of representation each can possibly detect. The analysis suggests why the results are heterogeneous and identifies crucial links between cognitive theory, data collection, and analysis that can help to better connect neuroimaging to mechanistic theories of semantic cognition.

Interhemispheric functional brain connectivity predicts new language learning success in adults

Investigating interhemispheric interactions between homologous cortical regions during language processing is of interest. Despite prevalent left hemisphere lateralization of language, the right hemisphere also plays an important role and interhemispheric connectivity is influenced by language experience and is implicated in second language (L2) acquisition. Regions involved in language processing have differential connectivity to other cortical regions and to each other, and play specific roles in language. We examined the interhemispheric interactions of subregions of the inferior frontal gyrus (areas 44 and 45), the adjacent area 9/46v in the middle frontal gyrus, the superior temporal gyrus (STG), and the posterior inferior parietal lobule (pIPL) in relation to distinct and specific aspects of L2 learning success. The results indicated that the connectivity between left and right areas 44 and 9/46v predicted improvement in sentence repetition, connectivity between left and right area 45 and mid-STG predicted improvement in auditory comprehension, and connectivity between left and right pIPL predicted improvement in reading speed. We show interhemispheric interactions in the specific context of facilitating performance in adult L2 acquisition that follow an anterior to posterior gradient in the brain, and are consistent with the respective roles of these regions in language processing.

Causal involvement of the left angular gyrus in higher functions as revealed by transcranial magnetic stimulation: a systematic review

Transcranial magnetic stimulation (TMS) is a non-invasive technique that can transiently interfere with local cortical functioning, thus enabling inferences of causal left AG involvement in higher functions from experimentation with healthy participants. Here, we examine 35 studies that measure behavioural outcomes soon after or during targeting TMS to the left AG, by design and as documented by individual magnetic resonance images, in healthy adult participants. The reviewed evidence suggests a specific causal involvement of the left AG in a wide range of tasks involving language, memory, number processing, visuospatial attention, body awareness and motor planning functions. These core findings are particularly valuable to inform theoretical models of the left AG role(s) in higher functions, due to the anatomical specificity afforded by the selected studies and the complementarity of TMS to different methods of investigation. In particular, the variety of the operations within and between functions in which the left AG appears to be causally involved poses a formidable challenge to any attempts to identify a single computational process subserved by the left AG (as opposed to just outlining a broad type of functional contribution) that could apply across thematic areas. We conclude by highlighting directions for improvement in future experimentation with TMS, in order to strengthen the available evidence, while taking into account the anatomical heterogeneity of this brain region.

The role of the angular gyrus in arithmetic processing: a literature review

Since the pioneering work of the early 20th century neuropsychologists, the angular gyrus (AG), particularly in the left hemisphere, has been associated with numerical and mathematical processing. The association between the AG and numerical and mathematical processing has been substantiated by neuroimaging research. In the present review article, we will examine what is currently known about the role of the AG in numerical and mathematical processing with a particular focus on arithmetic. Specifically, we will examine the role of the AG in the retrieval of arithmetic facts in both typically developing children and adults. The review article will consider alternative accounts that posit that the involvement of the AG is not specific to arithmetic processing and will consider how numerical and mathematical processing and their association with the AG overlap with other neurocognitive processes. The review closes with a discussion of future directions to further characterize the relationship between the angular gyrus and arithmetic processing.

The parietal lobe evolution and the emergence of material culture in the human genus

Traditional and new disciplines converge in suggesting that the parietal lobe underwent a considerable expansion during human evolution. Through the study of endocasts and shape analysis, paleoneurology has shown an increased globularity of the braincase and bulging of the parietal region in modern humans, as compared to other human species, including Neandertals. Cortical complexity increased in both the superior and inferior parietal lobules. Emerging fields bridging archaeology and neuroscience supply further evidence of the involvement of the parietal cortex in human-specific behaviors related to visuospatial capacity, technological integration, self-awareness, numerosity, mathematical reasoning and language. Here, we complement these inferences on the parietal lobe evolution, with results from more classical neuroscience disciplines, such as behavioral neurophysiology, functional neuroimaging, and brain lesions; and apply these to define the neural substrates and the role of the parietal lobes in the emergence of functions at the core of material culture, such as tool-making, tool use and constructional abilities.

Correspondence between cognitive and neural representations for phonology, orthography, and semantics in supramarginal compared to angular gyrus

The angular and supramarginal gyri (AG and SMG) together constitute the inferior parietal lobule (IPL) and have been associated with cognitive functions that support reading. How those functions are distributed across the AG and SMG is a matter of debate, the resolution of which is hampered by inconsistencies across stereotactic atlases provided by the major brain image analysis software packages. Schematic results from automated meta-analyses suggest primarily semantic (word meaning) processing in the left AG, with more spatial overlap among phonological (auditory word form), orthographic (visual word form), and semantic processing in the left SMG. To systematically test for correspondence between patterns of neural activation and phonological, orthographic, and semantic representations, we re-analyze a functional magnetic resonance imaging data set of participants reading aloud 465 words. Using representational similarity analysis, we test the hypothesis that within cytoarchitecture-defined subregions of the IPL, phonological representations are primarily associated with the SMG, while semantic representations are primarily associated with the AG. To the extent that orthographic representations can be de-correlated from phonological representations, they will be associated with cortex peripheral to the IPL, such as the intraparietal sulcus. Results largely confirmed these hypotheses, with some nuanced exceptions, which we discuss in terms of neurally inspired computational cognitive models of reading that learn mappings among distributed representations for orthography, phonology, and semantics. De-correlating constituent representations making up complex cognitive processes, such as reading, by careful selection of stimuli, representational formats, and analysis techniques, are promising approaches for bringing additional clarity to brain structure-function relationships.

Automatic Detection of Putative Mild Cognitive Impairment from Speech Acoustic Features in Mandarin-Speaking Elders

BACKGROUND

To date, the reliable detection of mild cognitive impairment (MCI) remains a significant challenge for clinicians. Very few studies investigated the sensitivity of acoustic features in detecting Mandarin-speaking elders at risk for MCI, defined as "putative MCI" (pMCI).

OBJECTIVE

This study sought to investigate the possibility of using automatically extracted speech acoustic features to detect elderly people with pMCI and reveal the potential acoustic markers of cognitive decline at an early stage.

METHODS

Forty-one older adults with pMCI and 41 healthy elderly controls completed four reading tasks (syllable utterance, tongue twister, diadochokinesis, and short sentence reading), from which acoustic features were extracted automatically to train machine learning classifiers. Correlation analysis was employed to evaluate the relationship between classifier predictions and participants' cognitive ability measured by Mini-Mental State Examination 2.

RESULTS

Classification results revealed that some temporal features (e.g., speech rate, utterance duration, and the number of silent pauses), spectral features (e.g., variability of F1 and F2), and energy features (e.g., SD of peak intensity and SD of intensity range) were effective predictors of pMCI. The best classification result was achieved in the Random Forest classifier (accuracy = 0.81, AUC = 0.81). Correlation analysis uncovered a strong negative correlation between participants' cognitive test scores and the probability estimates of pMCI in the Random Forest classifier, and a modest negative correlation in the Support Vector Machine classifier.

CONCLUSIONS

The automatic acoustic analysis of speech could provide a promising non-invasive way to assess and monitor the early cognitive decline in Mandarin-speaking elders.

Deep learning-based speech analysis for Alzheimer's disease detection: a literature review

BACKGROUND

Alzheimer's disease has become one of the most common neurodegenerative diseases worldwide, which seriously affects the health of the elderly. Early detection and intervention are the most effective prevention methods currently. Compared with traditional detection methods such as traditional scale tests, electroencephalograms, and magnetic resonance imaging, speech analysis is more convenient for automatic large-scale Alzheimer's disease detection and has attracted extensive attention from researchers. In particular, deep learning-based speech analysis and language processing techniques for Alzheimer's disease detection have been studied and achieved impressive results.

METHODS

To integrate the latest research progresses, hundreds of relevant papers from ACM, DBLP, IEEE, PubMed, Scopus, Web of Science electronic databases, and other sources were retrieved. We used these keywords for paper search: (Alzheimer OR dementia OR cognitive impairment) AND (speech OR voice OR audio) AND (deep learning OR neural network).

CONCLUSIONS

Fifty-two papers were finally retained after screening. We reviewed and presented the speech databases, deep learning methods, and model performances of these studies. In the end, we pointed out the mainstreams and limitations in the current studies and provided a direction for future research.

The Angular Gyrus as a Hub for Modulation of Language-related Cortex by Distinct Prefrontal Executive Control Regions

It has become clear in recent years that reading, while relying on domain-specific language processing regions, also involves regions that implement executive processes more broadly. Such executive control is generally considered to be implemented by prefrontal regions, which exert control via connectivity that allows them to modulate processing in target brain regions. The present study examined whether three previously identified and distinct executive control regions in the pFC [Wang, K., Banich, M. T., Reineberg, A. E., Leopold, D. R., Willcutt, E. G., Cutting, L. E., et al. Left posterior prefrontal regions support domain-general executive processes needed for both reading and math. Journal of Neuropsychology, 14, 467-495, 2020] show similar patterns of functional connectivity (FC) during a reading comprehension task as compared with a symbol identification condition. Our FC results in a sample of adolescents (n = 120) suggest all three regions commonly show associations with activity in "classic" left hemisphere reading areas, including the angular and supramarginal gyri, yet each exhibits differential connectivity as well. In particular, precentral regions show differential FC to parietal portions of the dorsal language stream, the inferior frontal junction shows differential FC to middle temporal regions of the right hemisphere and other regions involved in semantic processing, and portions of the inferior frontal gyrus show differential FC to an extensive set of right hemisphere prefrontal regions. These results suggest that prefrontal control over language-related regions occurs in a coordinated yet discrete manner.

Semantic network activation facilitates oral word reading in chronic aphasia

People with aphasia often show partial impairments on a given task. This trial-to-trial variability offers a potential window into understanding how damaged language networks function. We test the hypothesis that successful word reading in participants with phonological system damage reflects semantic system recruitment. Residual semantic and phonological networks were defined with fMRI in 21 stroke participants with phonological damage using semantic- and rhyme-matching tasks. Participants performed an oral word reading task, and activation was compared between correct and incorrect trials within the semantic and phonological networks. The results showed a significant interaction between hemisphere, network activation, and reading success. Activation in the left hemisphere semantic network was higher when participants successfully read words. Residual phonological regions showed no difference in activation between correct and incorrect trials on the word reading task. The results provide evidence that semantic processing supports successful phonological retrieval in participants with phonological impairment.

Modeling developmental changes in print tuning in a transparent alphabetic orthography

The development of print tuning involves the increased specificity and redundancy for orthographic representations. However, it is by no means clear how decoding accuracy and efficiency are related over the years and how it affects reading disability. In the present study, we monitored the development of accuracy and efficiency of decoding in Dutch as a relatively transparent orthography as a function of orthographic complexity and lexical status throughout the primary grades. There was clear evidence that development of decoding accuracy preceded development of decoding efficiency and that a certain threshold of accuracy is needed for decoding efficiency to evolve. Furthermore, it was shown that pseudoword decoding efficiency predicted growth in word decoding efficiency, especially for the higher levels of orthographic complexity. There was also evidence that accuracy precedes efficiency across different profiles of readers and that decoding strength can be defined as a function of orthographic complexity and lexicality.

A Spatiotemporal Map of Reading Aloud

Reading words aloud is a fundamental aspect of literacy. The rapid rate at which multiple distributed neural substrates are engaged in this process can only be probed via techniques with high spatiotemporal resolution. We probed this with direct intracranial recordings covering most of the left hemisphere in 46 humans (26 male, 20 female) as they read aloud regular, exception and pseudo-words. We used this to create a spatiotemporal map of word processing and to derive how broadband γ activity varies with multiple word attributes critical to reading speed: lexicality, word frequency, and orthographic neighborhood. We found that lexicality is encoded earliest in mid-fusiform (mFus) cortex, and precentral sulcus, and is represented reliably enough to allow single-trial lexicality decoding. Word frequency is first represented in mFus and later in the inferior frontal gyrus (IFG) and inferior parietal sulcus (IPS), while orthographic neighborhood sensitivity resides solely in IPS. We thus isolate the neural correlates of the distributed reading network involving mFus, IFG, IPS, precentral sulcus, and motor cortex and provide direct evidence for parallel processes via the lexical route from mFus to IFG, and the sublexical route from IPS and precentral sulcus to anterior IFG.SIGNIFICANCE STATEMENT Reading aloud depends on multiple complex cerebral computations: mapping from a written letter string on a page to a sequence of spoken sound representations. Here, we used direct intracranial recordings in a large cohort while they read aloud known and novel words, to track, across space and time, the progression of neural representations of behaviorally relevant factors that govern reading speed. We find, concordant with cognitive models of reading, that known and novel words are differentially processed through a lexical route, sensitive to frequency of occurrence of known words in natural language, and a sublexical route, performing letter-by-letter construction of novel words.

The lexical categorization model: A computational model of left ventral occipito-temporal cortex activation in visual word recognition

To characterize the functional role of the left-ventral occipito-temporal cortex (lvOT) during reading in a quantitatively explicit and testable manner, we propose the lexical categorization model (LCM). The LCM assumes that lvOT optimizes linguistic processing by allowing fast meaning access when words are familiar and filtering out orthographic strings without meaning. The LCM successfully simulates benchmark results from functional brain imaging described in the literature. In a second evaluation, we empirically demonstrate that quantitative LCM simulations predict lvOT activation better than alternative models across three functional magnetic resonance imaging studies. We found that word-likeness, assumed as input into a lexical categorization process, is represented posteriorly to lvOT, whereas a dichotomous word/non-word output of the LCM could be localized to the downstream frontal brain regions. Finally, training the process of lexical categorization resulted in more efficient reading. In sum, we propose that word recognition in the ventral visual stream involves word-likeness extraction followed by lexical categorization before one can access word meaning.

Visual word recognition is a critical process for reading and relies on the human brain’s left ventral occipito-temporal (lvOT) regions. However, the lvOTs specific function in visual word recognition is not yet clear. We propose that these occipito-temporal brain systems are critical for lexical categorization, i.e., the process of determining whether an orthographic percept is a known word or not, so that further lexical and semantic processing can be restricted to those percepts that are part of our "mental lexicon". We demonstrate that a computational model implementing this process, the lexical categorization model, can explain seemingly contradictory benchmark results from the published literature. We further use functional magnetic resonance imaging to show that the lexical categorization model successfully predicts brain activation in the left ventral occipito-temporal cortex elicited during a word recognition task. It does so better than alternative models proposed so far. Finally, we provide causal evidence supporting this model by empirically demonstrating that training the process of lexical categorization improves reading performance.

Neural representation of phonological information during Chinese character reading

Previous studies have revealed that phonological processing of Chinese characters elicited activation in the left prefrontal cortex, bilateral parietal cortex, and occipitotemporal regions. However, it is controversial what role the left middle frontal gyrus plays in Chinese character reading, and whether the core regions (e.g., the left superior temporal gyrus and supramarginal gyrus) for phonological processing of alphabetic languages are also involved in Chinese character reading. To address these questions, the present study used both univariate and multivariate analysis (i.e., representational similarity analysis, RSA) to explore neural representations of phonological information during Chinese character reading. Participants were scanned while performing a reading aloud task. Univariate activation analysis revealed a widely distributed network for word reading, including the bilateral inferior frontal gyrus, middle frontal gyrus, lateral temporal cortex, and occipitotemporal cortex. More importantly, RSA showed that the left prefrontal (i.e., the left middle frontal gyrus and left inferior frontal gyrus) and bilateral occipitotemporal areas (i.e., the left inferior and middle temporal gyrus and bilateral fusiform gyrus) represented phonological information of Chinese characters. These results confirmed the importance of the left middle frontal gyrus and regions in ventral pathway in representing phonological information of Chinese characters.

Task modulates the orthographic and phonological representations in the bilateral ventral Occipitotemporal cortex

As a key area in word reading, the left ventral occipitotemporal cortex is proposed for abstract orthographic processing, and its middle part has even been labeled as the visual word form area. Because the definition of the VWFA largely varies and the reading task differs across studies, the function of the left ventral occipitotemporal cortex in word reading is continuingly debated on whether this region is specific for orthographic processing or be involved in an interactive framework. By using representational similarity analysis (RSA), this study examined information representation in the VWFA at the individual level and the modulatory effect of reading task. Twenty-four subjects were scanned while performing the explicit (i.e., the naming task) and implicit (i.e., the perceptual task) reading tasks. Activation analysis showed that the naming task elicited greater activation in regions related to phonological processing (e.g., the bilateral prefrontal cortex and temporoparietal cortex), while the perceptual task recruited greater activation in visual cortex and default mode network (e.g., the bilateral middle frontal gyrus, angular gyrus, and the right middle temporal gyrus). More importantly, RSA also showed that task modulated information representation in the bilateral anterior occipitotemporal cortex and VWFA. Specifically, ROI-based RSA revealed enhanced orthographic and phonological representations in the bilateral anterior fusiform cortex and VWFA in the naming task relative to the perceptual task. These results suggest that lexical representation in the VWFA is influenced by the demand of phonological processing, which supports the interactive account of the VWFA.

White matter disconnectivity fingerprints causally linked to dissociated forms of alexia

For over 150 years, the study of patients with acquired alexia has fueled research aimed at disentangling the neural system critical for reading. An unreached goal, however, relates to the determination of the fiber pathways that root the different visual and linguistic processes needed for accurate word reading. In a unique series of neurosurgical patients with a tumor close to the visual word form area, we combine direct electrostimulation and population-based streamline tractography to map the disconnectivity fingerprints characterizing dissociated forms of alexia. Comprehensive analyses of disconnectivity matrices establish similarities and dissimilarities in the disconnection patterns associated with pure, phonological and lexical-semantic alexia. While disconnections of the inferior longitudinal and posterior arcuate fasciculi are common to all alexia subtypes, disconnections of the long arcuate and vertical occipital fasciculi are specific to phonological and pure alexia, respectively. These findings provide a strong anatomical background for cognitive and neurocomputational models of reading.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Gray matter correlates of reading fluency deficits: SES matters, IQ does not

Brain correlates of reading ability have been intensely investigated. Most studies have focused on single-word reading and phonological processing, but the brain basis of reading fluency remains poorly explored to date. Here, in a voxel-based morphometry study with 8-year-old children, we compared fluent readers (n = 18; seven boys) with dysfluent readers with normal IQ (n = 18; six boys) and with low IQ (n = 18; ten boys). Relative to dysfluent readers, fluent readers had larger gray matter volume in the right superior temporal gyrus and the two subgroups of dysfluent readers did not differ from each other, as shown in frequentist and Bayesian analyses. Pairwise comparisons showed that dysfluent readers of normal and low IQ did not differ in core reading regions and that both subgroups had less gray matter volume than fluent readers in occipito-temporal, parieto-temporal and fusiform areas. We also examined gray matter volume in matched subgroups of dysfluent readers differing only in socioeconomic status (SES): lower-SES (n = 14; seven boys) vs. higher-SES (n = 14; seven boys). Higher-SES dysfluent readers had larger gray matter volume in the right angular gyrus than their lower-SES peers, and the volume of this cluster correlated positively with lexico-semantic fluency. Age, sex, IQ, and gray matter volume of the right angular cluster explained 68% of the variance in the reading fluency of higher-SES dysfluent readers. In sum, this study shows that gray matter correlates of dysfluent reading are independent of IQ, and suggests that SES modulates areas sub-serving lexico-semantic processes in dysfluent readers-two findings that may be useful to inform language/reading remediation programs.

Identifying Dyslexia: Link between Maze Learning and Dyslexia Susceptibility Gene, DCDC2, in Young Children

Dyslexia is a common learning disability that affects processing of written language despite adequate intelligence and educational background. If learning disabilities remain untreated, a child may experience long-term social and emotional problems, which influence future success in all aspects of their life. Dyslexia has a 60% heritability rate, and genetic studies have identified multiple dyslexia susceptibility genes (DSGs). DSGs, such as DCDC2, are consistently associated with the risk and severity of reading disability (RD). Altered neural connectivity within temporoparietal regions of the brain is associated with specific variants of DSGs in individuals with RD. Genetically altering DSG expression in mice results in visual and auditory processing deficits as well as neurophysiological and neuroanatomical disruptions. Previously, we demonstrated that learning deficits associated with RD can be translated across species using virtual environments. In this 2-year longitudinal study, we demonstrate that performance on a virtual Hebb-Williams maze in pre-readers is able to predict future reading impairment, and the genetic risk strengthens, but is not dependent on, this relationship. Due to the lack of oral reporting and use of letters, this easy-to-use tool may be particularly valuable in a remote working environment as well as working with vulnerable populations such as English language learners.

Effects of training of shadowing and reading aloud of second language on working memory and neural systems

Shadowing and reading aloud both involve multiple complex cognitive processes, and both are considered effective methods for second-language learning. The working memory system, particularly the phonological loop, has been suggested to be involved in shadowing and reading aloud. The purpose of this study was to investigate the effects of a 4-week intensive adaptive training including shadowing and reading aloud of second language on working-memory capacity, regional gray matter volume (rGMV), and functional activation related to the n-back working-memory task in young adults. The results showed that compared with the training groups without speaking (listening to compressed speech and active control involving the second language), the training groups with speaking (shadowing and reading aloud) showed a tendency for greater test-retest increases in digit-span scores, and significantly greater test-retest decreases in N-back task reaction time (increase in working memory performance). Imaging analyses revealed compared with the active control group, shadowing group exhibited decreases in rGMV and brain activity during the working memory task (2-back task), in the left cerebellum and reading group exhibited decreases in them in the right anterior insula. These regions are parts of the phonological loop, suggesting the presence of training-induced neural plasticity in these neurocognitive mechanisms.

Reorganization of brain structural networks in aging: A longitudinal study

Normal aging is characterized by structural and functional changes in the brain contributing to cognitive decline. Structural connectivity (SC) describes the anatomical backbone linking distinct functional subunits of the brain and disruption of this communication is thought to be one of the potential contributors for the age-related deterioration observed in cognition. Several studies already explored brain network's reorganization during aging, but most focused on average connectivity of the whole-brain or in specific networks, such as the resting-state networks. Here, we aimed to characterize longitudinal changes of white matter (WM) structural brain networks, through the identification of sub-networks with significantly altered connectivity along time. Then, we tested associations between longitudinal changes in network connectivity and cognition. We also assessed longitudinal changes in topological properties of the networks. For this, older adults were evaluated at two timepoints, with a mean interval time of 52.8 months (SD = 7.24). WM structural networks were derived from diffusion magnetic resonance imaging, and cognitive status from neurocognitive testing. Our results show age-related changes in brain SC, characterized by both decreases and increases in connectivity weight. Interestingly, decreases occur in intra-hemispheric connections formed mainly by association fibers, while increases occur mostly in inter-hemispheric connections and involve association, commissural, and projection fibers, supporting the last-in-first-out hypothesis. Regarding topology, two hubs were lost, alongside with a decrease in connector-hub inter-modular connectivity, reflecting reduced integration. Simultaneously, there was an increase in the number of provincial hubs, suggesting increased segregation. Overall, these results confirm that aging triggers a reorganization of the brain structural network.

Symbolic categorization of novel multisensory stimuli in the human brain

When primates (both human and non-human) learn to categorize simple visual or acoustic stimuli by means of non-verbal matching tasks, two types of changes occur in their brain: early sensory cortices increase the precision with which they encode sensory information, and parietal and lateral prefrontal cortices develop a categorical response to the stimuli. Contrary to non-human animals, however, our species mostly constructs categories using linguistic labels. Moreover, we naturally tend to define categories by means of multiple sensory features of the stimuli. Here we trained adult subjects to parse a novel audiovisual stimulus space into 4 orthogonal categories, by associating each category to a specific symbol. We then used multi-voxel pattern analysis (MVPA) to show that during a cross-format category repetition detection task three neural representational changes were detectable. First, visual and acoustic cortices increased both precision and selectivity to their preferred sensory feature, displaying increased sensory segregation. Second, a frontoparietal network developed a multisensory object-specific response. Third, the right hippocampus and, at least to some extent, the left angular gyrus, developed a shared representational code common to symbols and objects. In particular, the right hippocampus displayed the highest level of abstraction and generalization from a format to the other, and also predicted symbolic categorization performance outside the scanner. Taken together, these results indicate that when humans categorize multisensory objects by means of language the set of changes occurring in the brain only partially overlaps with that described by classical models of non-verbal unisensory categorization in primates.

Functional connectivity in the developing language network in 4-year-old children predicts future reading ability

Understanding how pre-literate children's language abilities and neural function relate to future reading ability is important for identifying children who may be at-risk for reading problems. Pre-literate children are already proficient users of spoken language and their developing brain networks for language become highly overlapping with brain networks that emerge during literacy acquisition. In the present longitudinal study, we examined language abilities, and neural activation and connectivity within the language network in pre-literate children (mean age = 4.2 years). We tested how language abilities, brain activation, and connectivity predict children's reading abilities 1 year later (mean age = 5.2 years). At Time 1, children (n = 37) participated in a functional near infrared spectroscopy (fNIRS) experiment of speech processing (listening to words and pseudowords) and completed a standardized battery of language and cognitive assessments. At Time 2, children (n = 28) completed standardized reading assessments. Using psychophysiological interaction (PPI) analyses, we observed significant connectivity between the left IFG and right STG in pre-literate children, which was modulated by task (i.e., listening to words). Neural activation in left IFG and STG and increased task-modulated connectivity between the left IFG and right STG was predictive of multiple reading outcomes. Increased connectivity was associated later with increased reading ability.

Cortical responses to letters and ambiguous speech vary with reading skills in dyslexic and typically reading children

•

Text recalibrates ambiguous speech perception in children with and without dyslexia.

•

Dyslexia and poorer reading skills are linked to reduced left fusiform activation.

•

Poorer letter-speech sound matching is linked to higher superior temporal activation.

One of the proposed issues underlying reading difficulties in dyslexia is insufficiently automatized letter-speech sound associations. In the current fMRI experiment, we employ text-based recalibration to investigate letter-speech sound mappings in 8–10 year-old children with and without dyslexia. Here an ambiguous speech sound /a?a/ midway between /aba/ and /ada/ is combined with disambiguating “aba” or “ada” text causing a perceptual shift of the ambiguous /a?a/ sound towards the text (recalibration). This perceptual shift has been found to be reduced in adults but not in children with dyslexia compared to typical readers. Our fMRI results show significantly reduced activation in the left fusiform in dyslexic compared to typical readers, despite comparable behavioural performance. Furthermore, enhanced audio-visual activation within this region was linked to better reading and phonological skills. In contrast, higher activation in bilateral superior temporal cortex was associated with lower letter-speech sound identification fluency. These findings reflect individual differences during the early stages of reading development with reduced recruitment of the left fusiform in dyslexic readers together with an increased involvement of the superior temporal cortex in children with less automatized letter-speech sound associations.

Patterns and networks of language control in bilingual language production

Many studies have examined the cognitive and neural mechanisms of bilingual language control, but few of them have captured the pattern information of brain activation. However, language control is a functional combination of both cognitive control and language production which demonstrates distinct patterns of neural representations under different language contexts. The first aim of the present study was to explore the brain activation patterns of language control using multivoxel pattern analysis (MVPA). During the experiment, Chinese-English bilinguals were instructed to name pictures in either Chinese or English according to a visually presented cue while being scanned with functional magnetic resonance imaging (fMRI). We found that patterns of neural activity in frontal brain regions including the left dorsolateral prefrontal cortex, left inferior frontal gyrus, left supplementary motor area, anterior cingulate cortex, bilateral precentral gyri, and the left cerebellum reliably discriminated between switch and non-switch conditions. We then modeled causal interactions between these regions by applying effective connectivity analyses based on an extended unified structure equation model (euSEM). The results showed that frontal and fronto-cerebellar connectivity were key components of the language control network. These findings further reveal the engagement of the cognitive control network in bilingual language production.

Distinct neural correlates of linguistic demand and non-linguistic demand

In this study, we investigated how the brain responds to task difficulty in linguistic and non-linguistic contexts. This is important for the interpretation of functional imaging studies of neuroplasticity in post-stroke aphasia, because of the inherent difficulty of matching or controlling task difficulty in studies with neurological populations. Twenty neurologically normal individuals were scanned with fMRI as they performed a linguistic task and a non-linguistic task, each of which had two levels of difficulty. Critically, the tasks were matched across domains (linguistic, non-linguistic) for accuracy and reaction time, such that the differences between the easy and difficult conditions were equivalent across domains. We found that non-linguistic demand modulated the same set of multiple demand (MD) regions that have been identified in many prior studies. In contrast, linguistic demand modulated MD regions to a much lesser extent, especially nodes belonging to the dorsal attention network. Linguistic demand modulated a subset of language regions, with the left inferior frontal gyrus most strongly modulated. The right hemisphere region homotopic to Broca's area was also modulated by linguistic but not non-linguistic demand. When linguistic demand was mapped relative to non-linguistic demand, we also observed domain by difficulty interactions in temporal language regions as well as a widespread bilateral semantic network. In sum, linguistic and non-linguistic demand have strikingly different neural correlates. These findings can be used to better interpret studies of patients recovering from aphasia. Some reported activations in these studies may reflect task performance differences, while others can be more confidently attributed to neuroplasticity.

Using information-theoretic measures to characterize the structure of the writing system: the case of orthographic-phonological regularities in English

It is generally well accepted that proficient reading requires the assimilation of myriad statistical regularities present in the writing system, including in particular the correspondences between words' orthographic and phonological forms. There is considerably less agreement, however, as to how to quantify these regularities. Here we present a comprehensive approach for this quantification using tools from Information Theory. We start by providing a glossary of the relevant information-theoretic metrics, with simplified examples showing their potential in assessing orthographic-phonological regularities. We specifically highlight the flexibility of our approach in quantifying information under different contexts (i.e., context-independent and dependent readings) and in different types of mappings (e.g., orthography-to-phonology and phonology-to-orthography). Then, we use these information-theoretic measures to assess real-world orthographic-phonological regularities of 10,093 mono-syllabic English words and examine whether these measures predict inter-item variability in accuracy and response times using available large-scale datasets of naming and lexical decision tasks. Together, the analyses demonstrate how information-theoretical measures can be used to quantify orthographical-phonological correspondences, and show that they capture variance in reading performance that is not accounted for by existing measures. We discuss the similarities and differences between the current framework and previous approaches as well as future directions towards understanding how the statistical regularities embedded in a writing system impact reading and reading acquisition.

Spatiotemporal dynamics of orthographic and lexical processing in the ventral visual pathway

Reading is a rapid, distributed process that engages multiple components of the ventral visual stream. To understand the neural constituents and their interactions that allow us to identify written words, we performed direct intra-cranial recordings in a large cohort of humans. This allowed us to isolate the spatiotemporal dynamics of visual word recognition across the entire left ventral occipitotemporal cortex. We found that mid-fusiform cortex is the first brain region sensitive to lexicality, preceding the traditional visual word form area. The magnitude and duration of its activation are driven by the statistics of natural language. Information regarding lexicality and word frequency propagates posteriorly from this region to visual word form regions and to earlier visual cortex, which, while active earlier, show sensitivity to words later. Further, direct electrical stimulation of this region results in reading arrest, further illustrating its crucial role in reading. This unique sensitivity of mid-fusiform cortex to sub-lexical and lexical characteristics points to its central role as the orthographic lexicon-the long-term memory representations of visual word forms.

Activation time-course of phonological code in silent word recognition in adult readers with and without dyslexia

In skilled adult readers, reading words is generally assumed to rapidly and automatically activate the phonological code. In adults with dyslexia, despite the main consensus on their phonological processing deficits, little is known about the activation time course of this code. The present study investigated this issue in both populations. Participants' accuracy and eye movements were recorded while they performed a visual lexical decision task in which phonological consistency of written words was manipulated. Readers with dyslexia were affected by phonological consistency during second fixation duration of visual word recognition suggesting a late activation of the phonological code. Regarding skilled readers, no influence of phonological consistency was found when the participants were considered a homogeneous population. However, a different pattern emerged when they were divided into two subgroups according to their phonological and semantic abilities: Those who showed better decoding than semantic skills were affected by phonological consistency at the earliest stage of visual word recognition while those who showed better semantic than decoding skills were not affected by this factor at any processing stage. Overall, the findings suggest that the presence of phonological deficits in readers with dyslexia is associated with a delayed activation of phonological representations during reading. In skilled readers, the contribution of phonology varies with their reading profile, i.e., being phonologically or semantically oriented.

Neural Components of Reading Revealed by Distributed and Symbolic Computational Models

Determining how the cognitive components of reading - orthographic, phonological, and semantic representations - are instantiated in the brain has been a longstanding goal of psychology and human cognitive neuroscience. The two most prominent computational models of reading instantiate different cognitive processes, implying different neural processes. Artificial neural network (ANN) models of reading posit non-symbolic, distributed representations. The dual-route cascaded (DRC) model instead suggests two routes of processing, one representing symbolic rules of spelling-sound correspondence, the other representing orthographic and phonological lexicons. These models are not adjudicated by behavioral data and have never before been directly compared in terms of neural plausibility. We used representational similarity analysis to compare the predictions of these models to neural data from participants reading aloud. Both the ANN and DRC model representations corresponded with neural activity. However, ANN model representations correlated to more reading-relevant areas of cortex. When contributions from the DRC model were statistically controlled, partial correlations revealed that the ANN model accounted for significant variance in the neural data. The opposite analysis, examining the variance explained by the DRC model with contributions from the ANN model factored out, revealed no correspondence to neural activity. Our results suggest that ANNs trained using distributed representations provide a better correspondence between cognitive and neural coding. Additionally, this framework provides a principled approach for comparing computational models of cognitive function to gain insight into neural representations.

Taking the sublexical route: brain dynamics of reading in the semantic variant of primary progressive aphasia

Reading aloud requires mapping an orthographic form to a phonological one. The mapping process relies on sublexical statistical regularities (e.g. 'oo' to |uː|) or on learned lexical associations between a specific visual form and a series of sounds (e.g. yacht to/jɑt/). Computational, neuroimaging, and neuropsychological evidence suggest that sublexical, phonological and lexico-semantic processes rely on partially distinct neural substrates: a dorsal (occipito-parietal) and a ventral (occipito-temporal) route, respectively. Here, we investigated the spatiotemporal features of orthography-to-phonology mapping, capitalizing on the time resolution of magnetoencephalography and the unique clinical model offered by patients with semantic variant of primary progressive aphasia (svPPA). Behaviourally, patients with svPPA manifest marked lexico-semantic impairments including difficulties in reading words with exceptional orthographic to phonological correspondence (irregular words). Moreover, they present with focal neurodegeneration in the anterior temporal lobe, affecting primarily the ventral, occipito-temporal, lexical route. Therefore, this clinical population allows for testing of specific hypotheses on the neural implementation of the dual-route model for reading, such as whether damage to one route can be compensated by over-reliance on the other. To this end, we reconstructed and analysed time-resolved whole-brain activity in 12 svPPA patients and 12 healthy age-matched control subjects while reading irregular words (e.g. yacht) and pseudowords (e.g. pook). Consistent with previous findings that the dorsal route is involved in sublexical, phonological processes, in control participants we observed enhanced neural activity over dorsal occipito-parietal cortices for pseudowords, when compared to irregular words. This activation was manifested in the beta-band (12-30 Hz), ramping up slowly over 500 ms after stimulus onset and peaking at ∼800 ms, around response selection and production. Consistent with our prediction, svPPA patients did not exhibit this temporal pattern of neural activity observed in controls this contrast. Furthermore, a direct comparison of neural activity between patients and controls revealed a dorsal spatiotemporal cluster during irregular word reading. These findings suggest that the sublexical/phonological route is involved in processing both irregular and pseudowords in svPPA. Together these results provide further evidence supporting a dual-route model for reading aloud mediated by the interplay between lexico-semantic and sublexical/phonological neurocognitive systems. When the ventral route is damaged, as in the case of neurodegeneration affecting the anterior temporal lobe, partial compensation appears to be possible by over-recruitment of the slower, serial attention-dependent, dorsal one.

Differential activation of the visual word form area during auditory phoneme perception in youth with dyslexia

Developmental dyslexia is a learning disorder characterized by difficulties reading words accurately and/or fluently. Several behavioral studies have suggested the presence of anomalies at an early stage of phoneme processing, when the complex spectrotemporal patterns in the speech signal are analyzed and assigned to phonemic categories. In this study, fMRI was used to compare brain responses associated with categorical discrimination of speech syllables (P) and acoustically matched nonphonemic stimuli (N) in children and adolescents with dyslexia and in typically developing (TD) controls, aged 8-17 years. The TD group showed significantly greater activation during the P condition relative to N in an area of the left ventral occipitotemporal cortex that corresponds well with the region referred to as the "visual word form area" (VWFA). Regression analyses using reading performance as a continuous variable across the full group of participants yielded similar results. Overall, the findings are consistent with those of previous neuroimaging studies using print stimuli in individuals with dyslexia that found reduced activation in left occipitotemporal regions; however, the current study shows that these activation differences seen during reading are apparent during auditory phoneme discrimination in youth with dyslexia, suggesting that the primary deficit in at least a subset of children may lie early in the speech processing stream and that categorical perception may be an important target of early intervention in children at risk for dyslexia.

Trivariate Theory of Mind Data Analysis with a Conditional Joint Modeling Approach

Theory of mind (ToM) is an essential social-cognitive ability to understand one's own and other people's mental states. Neural data as well as behavior data have been utilized in ToM research, but the two types of data have rarely been analyzed together, creating a large gap in the literature. In this paper, we propose and apply a novel joint modeling approach to analyze brain activations with two types of behavioral data, response times and response accuracy, obtained from a multi-item ToM assessment, with the intention to shed new light on the nature of the underlying process of ToM reasoning. Our trivariate data analysis suggested that different levels or kinds of processes might be involved during the ToM assessment, which seem to differ in terms of cognitive efficiency and sensitivity to ToM items and the correctness of item responses. Additional details on the trivariate data analysis results are provided with discussions on their implications for ToM research.

Unmasking individual differences in adult reading procedures by disrupting holistic orthographic perception

Word identification is undeniably important for skilled reading and ultimately reading comprehension. Interestingly, both lexical and sublexical procedures can support word identification. Recent cross-linguistic comparisons have demonstrated that there are biases in orthographic coding (e.g., holistic vs. analytic) linked with differences in writing systems, such that holistic orthographic coding is correlated with lexical-level reading procedures and vice versa. The current study uses a measure of holistic visual processing used in the face processing literature, orientation sensitivity, to test individual differences in word identification within a native English population. Results revealed that greater orientation sensitivity (i.e., greater holistic processing) was associated with a reading profile that relies less on sublexical phonological measures and more on lexical-level characteristics within the skilled English readers. Parallels to Chinese procedures of reading and a proposed alternative route to skilled reading are discussed.

Reading music and words: The anatomical connectivity of musicians' visual cortex

Musical score reading and word reading have much in common, from their historical origins to their cognitive foundations and neural correlates. In the ventral occipitotemporal cortex (VOT), the specialization of the so-called Visual Word Form Area for word reading has been linked to its privileged structural connectivity to distant language regions. Here we investigated how anatomical connectivity relates to the segregation of regions specialized for musical notation or words in the VOT. In a cohort of professional musicians and non-musicians, we used probabilistic tractography combined with task-related functional MRI to identify the connections of individually defined word- and music-selective left VOT regions. Despite their close proximity, these regions differed significantly in their structural connectivity, irrespective of musical expertise. The music-selective region was significantly more connected to posterior lateral temporal regions than the word-selective region, which, conversely, was significantly more connected to anterior ventral temporal cortex. Furthermore, musical expertise had a double impact on the connectivity of the music region. First, music tracts were significantly larger in musicians than in non-musicians, associated with marginally higher connectivity to perisylvian music-related areas. Second, the spatial similarity between music and word tracts was significantly increased in musicians, consistently with the increased overlap of language and music functional activations in musicians, as compared to non-musicians. These results support the view that, for music as for words, very specific anatomical connections influence the specialization of distinct VOT areas, and that reciprocally those connections are selectively enhanced by the expertise for word or music reading.